Chunking

Letter C

How documents get split before retrieval. Often the difference between AI that works and AI that hallucinates.

Updated:

Working definition

Chunking is how documents get split before retrieval. Sounds boring. Quietly destroys most RAG systems. Fixed-size chunking ignores meaning. Semantic chunking respects it. Often the difference between AI that works and AI that hallucinates.