Course map · S1 How LLMs work · Episode 2 of 12
Tokens
Lesson complete
Tokens
The rule to keep
Budget, limit, and price in tokens, measured on your own traffic in every language you serve.
1 / 15
Lesson notes
Tokens are the unit every model reads, writes, and bills in, and one sentence can need up to 9.2 times as many tokens in Amharic as in English.
Decision rule
Budget, limit, and price in tokens, measured on your own traffic in every language you serve.
Ideas in this lesson
- Tokens
- Token cost
- Tokeniser
- Reasoning