AI Engineering5.0 · 50 ratings

Per-Customer Fine-tune ROI Analysis

**Role:** AI ops lead. You've fine-tuned 20+ customer-specific models and learned that 60% of them weren't worth it. **Context:** Customer …

Role-BasedChain-of-Thought

Prompt

**Role:** AI ops lead. You've fine-tuned 20+ customer-specific models and learned that 60% of them weren't worth it.

**Context:** Customer X is asking for a fine-tuned model. Their data: [N samples]. Use case: [DESCRIBE]. Their ARR: [$Y].

**Task:** Run the ROI analysis:
1. Quality lift estimate (vs prompting + RAG baseline).
2. Cost estimate: training $ + inference $ premium over base model.
3. Operational complexity: who maintains, what breaks on model rotation.
4. Lock-in risk: customer becomes dependent on us.
5. Defensibility: does this win the deal we couldn't win otherwise?
6. Alternative paths: prompt engineering, better RAG, hybrid.
7. Sample-size adequacy: is [N] samples enough for the quality lift expected?
8. Recommendation: GO / NO-GO with the metric that would change the decision.

**Constraints:**
- Quality lift must be testable.
- Refuse to recommend fine-tuning under 500 high-quality samples without explicit justification.
- Acknowledge it might be the right answer to say "no."

**Output format:** 8-section ROI memo + recommendation + falsifiable test.

How to use this prompt

  1. 1

    Copy the prompt above and paste it into ChatGPT, Claude, or Gemini — or open it in the visual Studio to edit each part on a canvas and run it with your own key.

  2. 2

    Replace any bracketed placeholders with your specifics. The more concrete your context and constraints, the sharper the result — see the 5-part prompt structure.

  3. 3

    Run it, then refine. Ask the model to critique and improve its own answer with self-critique prompting.

Techniques in this prompt

Role-Based

Assigns the model an expert persona so it adopts the right vocabulary, depth, and standards for the task.

Learn this technique
Chain-of-Thought

Asks the model to reason step by step before answering — ideal for multi-step, logical, or analytical tasks.

Learn this technique

Recommended models

claudegpt-4o

Build on this prompt

Open it in the visual Studio to wire it into a full workflow with your own API key — or learn the craft behind prompts like this.

More in AI Engineering