AI Engineering5.0 · 50 ratings

RAG vs Fine-tune Decision Memo

**Role:** You are a senior AI engineer who has shipped both RAG-based and fine-tuned LLM products at production scale. You believe most team…

Role-BasedChain-of-Thought

Prompt

**Role:** You are a senior AI engineer who has shipped both RAG-based and fine-tuned LLM products at production scale. You believe most teams pick the wrong path because they ask the wrong question first.

**Context:** A team is deciding between RAG, fine-tuning, prompt engineering, or a combination for a specific use case: [DESCRIBE_USE_CASE]. Their constraints: corpus size [N docs], freshness [hourly/daily/static], cost budget per query [$X], expected QPS [Y], data sensitivity [public/PII/regulated].

**Task:** Produce a decision memo. Walk through:
1. Quality requirement: does the answer demand recent facts (→ RAG), domain vocabulary (→ fine-tune), or just structured reasoning (→ prompts)?
2. Cost analysis: per-query $ for each path, plus engineering overhead.
3. Latency analysis: cold start, warm path, p95.
4. Operational complexity: who maintains it, what breaks when models rotate.
5. Risk: hallucination tolerance, regulatory implications.
6. Recommendation: ONE path + the test that would prove the choice was right.

**Constraints:**
- Show your math (not "RAG is cheaper" but "$0.04 vs $0.12 per query, n=100k/day = $2.9k/mo vs $8.7k/mo").
- Acknowledge the second-place option and what would tip the decision.
- Refuse to recommend without naming the success metric.

**Output format:** Markdown memo, 6 sections, ≤900 words, ready for an exec review.

How to use this prompt

  1. 1

    Copy the prompt above and paste it into ChatGPT, Claude, or Gemini — or open it in the visual Studio to edit each part on a canvas and run it with your own key.

  2. 2

    Replace any bracketed placeholders with your specifics. The more concrete your context and constraints, the sharper the result — see the 5-part prompt structure.

  3. 3

    Run it, then refine. Ask the model to critique and improve its own answer with self-critique prompting.

Techniques in this prompt

Role-Based

Assigns the model an expert persona so it adopts the right vocabulary, depth, and standards for the task.

Learn this technique
Chain-of-Thought

Asks the model to reason step by step before answering — ideal for multi-step, logical, or analytical tasks.

Learn this technique

Recommended models

claudegpt-4o

Build on this prompt

Open it in the visual Studio to wire it into a full workflow with your own API key — or learn the craft behind prompts like this.

More in AI Engineering