Course map · S1 How LLMs work · Episode 9 of 12
Hallucination
Lesson complete
Hallucination
The rule to keep
Never ship an answer you cannot trace: ground it in a source, let the model say it does not know, and measure the error rate by reading, not just by keyword.
1 / 22
Lesson notes
Fluent answers can be confidently wrong, and the only fabrication in this test came from the keyword scoring, not the model, so check error rates by reading answers.
Decision rule
Never ship an answer you cannot trace: ground it in a source, let the model say it does not know, and measure the error rate by reading, not just by keyword.
Ideas in this lesson
- Probability
- Grounding
- Evaluation
- Measuring, not quoting