Course map · S2 Retrieval and RAG · Episode 4 of 16
Chunking
Lesson complete
Chunking
The rule to keep
Cut documents along their own structure, then test it on your own questions.
1 / 23
Lesson notes
Cutting by section beat every fixed size: structure chunks of 1,024 tokens found the answer passage for 281 of 400 questions, 42 more than E2's cut.
Decision rule
Cut documents along their own structure, then test it on your own questions.
Ideas in this lesson
- Vectors