Asked about Splitting documents well

How would you chunk documents for retrieval?

An answer that works

Split on structure rather than a fixed character count: sections, then paragraphs, then sentences, never mid-sentence. Around 200 to 500 tokens with a sentence or two of overlap, and prepend the document title and heading path before embedding so each chunk is self-describing.

Reading an answer is not being able to give one. The section that teaches this is Splitting documents well, 4 hours of Chunking & document processing.

Learn this properly