RAG vs Fine-tune Decision Memo
**Role:** You are a senior AI engineer who has shipped both RAG-based and fine-tuned LLM products at production scale. You believe most team…
Prompt
**Role:** You are a senior AI engineer who has shipped both RAG-based and fine-tuned LLM products at production scale. You believe most teams pick the wrong path because they ask the wrong question first. **Context:** A team is deciding between RAG, fine-tuning, prompt engineering, or a combination for a specific use case: [DESCRIBE_USE_CASE]. Their constraints: corpus size [N docs], freshness [hourly/daily/static], cost budget per query [$X], expected QPS [Y], data sensitivity [public/PII/regulated]. **Task:** Produce a decision memo. Walk through: 1. Quality requirement: does the answer demand recent facts (→ RAG), domain vocabulary (→ fine-tune), or just structured reasoning (→ prompts)? 2. Cost analysis: per-query $ for each path, plus engineering overhead. 3. Latency analysis: cold start, warm path, p95. 4. Operational complexity: who maintains it, what breaks when models rotate. 5. Risk: hallucination tolerance, regulatory implications. 6. Recommendation: ONE path + the test that would prove the choice was right. **Constraints:** - Show your math (not "RAG is cheaper" but "$0.04 vs $0.12 per query, n=100k/day = $2.9k/mo vs $8.7k/mo"). - Acknowledge the second-place option and what would tip the decision. - Refuse to recommend without naming the success metric. **Output format:** Markdown memo, 6 sections, ≤900 words, ready for an exec review.
How to use this prompt
- 1
Copy the prompt above and paste it into ChatGPT, Claude, or Gemini — or open it in the visual Studio to edit each part on a canvas and run it with your own key.
- 2
Replace any bracketed placeholders with your specifics. The more concrete your context and constraints, the sharper the result — see the 5-part prompt structure.
- 3
Run it, then refine. Ask the model to critique and improve its own answer with self-critique prompting.
Techniques in this prompt
Assigns the model an expert persona so it adopts the right vocabulary, depth, and standards for the task.
Learn this techniqueAsks the model to reason step by step before answering — ideal for multi-step, logical, or analytical tasks.
Learn this techniqueRecommended models
Build on this prompt
Open it in the visual Studio to wire it into a full workflow with your own API key — or learn the craft behind prompts like this.
More in AI Engineering
Evals Harness Design for [Domain]
**Role:** AI engineer who has built evals suites that have caught 30+ production regressions before they shipped. You believe vibes-based "t…
System Prompt Audit
**Role:** Senior prompt engineer who has audited 100+ production system prompts. You read prompts the way an editor reads prose — for the me…
Agent Loop Halt-Condition Design
**Role:** Applied AI engineer who has shipped agents that completed millions of tool-calling iterations in production. You believe most agen…
Vector DB Schema Migration Plan
**Role:** Database architect specializing in vector stores at production scale. **Context:** Team is migrating from [SOURCE: e.g., pgvector…