Course map · S1 How LLMs work · Episode 6 of 12
Context windows
Lesson complete
Context windows
The rule to keep
Treat the context window as a budget: count what you send, reserve room for the answer, and test at your real size.
1 / 16
Lesson notes
The context window is one shared budget for instructions, history, documents, and the answer, and what falls past its edge is often dropped without any error.
Decision rule
Treat the context window as a budget: count what you send, reserve room for the answer, and test at your real size.
Ideas in this lesson
- Tokens
- Statelessness
- Context
- Latency