Course map · S1 How LLMs work · Episode 11 of 12
When is a reasoning model worth the cost?
Lesson complete
When is a reasoning model worth the cost?
The rule to keep
Keep reasoning at its lowest setting by default. Turn it up per task, only where a paired test on your own items shows it earns its tokens and seconds.
1 / 17
Lesson notes
Reasoning pays only on tasks that hold several steps in mind at once, so keep it low by default and prove each increase with a paired test.
Decision rule
Keep reasoning at its lowest setting by default. Turn it up per task, only where a paired test on your own items shows it earns its tokens and seconds.
Ideas in this lesson
- Token cost
- Reasoning
- Measuring, not quoting
- Latency