Why Chunk Documents?

Don't send the entire document.

Instead:

Document
 ↓
Chunk 1
Chunk 2
Chunk 3
Chunk 4
...

If a user asks about workshop timings, we don't need to send the entire 20-page document to the model.

Benefits

• Relevant context
• Lower token usage
• Better retrieval
• Better response quality