Course map · S1 How LLMs work · Episode 10 of 12
Field note: reasoning versus standard
Lesson complete
Field note: reasoning versus standard
The rule to keep
Turn reasoning on for problems that need several steps held in mind at once. Leave it off for lookups and simple sums, and pilot before you commit.
1 / 20
Lesson notes
Across three providers and 720 calls, high reasoning gained about 20 points on multi-step tasks and nothing on lookups or simple sums, mostly from one model.
Decision rule
Turn reasoning on for problems that need several steps held in mind at once. Leave it off for lookups and simple sums, and pilot before you commit.
Ideas in this lesson
- Token cost
- Reasoning
- Measuring, not quoting
- Latency