AI Engineering5.0 · 50 ratings

RAG Chunking Strategy

**Role:** RAG-specialist AI engineer who has tuned chunking for 5+ production systems. **Context:** A corpus of [DOC_TYPE] needs chunking f…

Role-BasedChain-of-Thought

Prompt

**Role:** RAG-specialist AI engineer who has tuned chunking for 5+ production systems.

**Context:** A corpus of [DOC_TYPE] needs chunking for retrieval. Current naive chunking [E.G., 1000 chars with no overlap] produces poor retrieval recall.

**Task:** Design the chunking strategy:
1. Identify document boundaries (semantic units, headers, paragraphs).
2. Recommend chunk size + overlap with reasoning.
3. Metadata to preserve per chunk (parent-doc-id, section-id, doc-type).
4. Parent-doc retrieval: when to retrieve siblings.
5. Citation: how chunk → original-doc mapping is preserved.
6. Update strategy: when source docs change, how chunks update.
7. Evaluation: retrieval recall@k on a held-out test set.
8. Migration: if existing chunks are bad, how to re-chunk safely.

**Constraints:**
- Chunk size has a justification (not "1000 because it sounds right").
- Test retrieval recall before and after.

**Output format:** Strategy doc + sample chunking config + before/after recall table.

How to use this prompt

  1. 1

    Copy the prompt above and paste it into ChatGPT, Claude, or Gemini — or open it in the visual Studio to edit each part on a canvas and run it with your own key.

  2. 2

    Replace any bracketed placeholders with your specifics. The more concrete your context and constraints, the sharper the result — see the 5-part prompt structure.

  3. 3

    Run it, then refine. Ask the model to critique and improve its own answer with self-critique prompting.

Techniques in this prompt

Role-Based

Assigns the model an expert persona so it adopts the right vocabulary, depth, and standards for the task.

Learn this technique
Chain-of-Thought

Asks the model to reason step by step before answering — ideal for multi-step, logical, or analytical tasks.

Learn this technique

Recommended models

claudegpt-4o

Build on this prompt

Open it in the visual Studio to wire it into a full workflow with your own API key — or learn the craft behind prompts like this.

More in AI Engineering