Data Science4.6 · 220 ratings
A/B Test Designer
Design a rigorous A/B test for: Hypothesis: [what we're testing]
Role-Based
Prompt
Design a rigorous A/B test for: Hypothesis: [what we're testing]. Metric: [primary KPI]. Current conversion rate: [baseline]. Minimum detectable effect: [X%]. Confidence level: [95%]. Power: [80%]. Calculate: (1) Required sample size per variant. (2) Expected test duration. (3) Randomization unit (user/session/device). (4) Guardrail metrics to monitor. (5) Segmentation strategy. (6) How to handle novelty effect. (7) Statistical test to use (z-test/t-test/chi-squared/etc.). (8) Decision criteria before starting.
How to use this prompt
- 1
Copy the prompt above and paste it into ChatGPT, Claude, or Gemini — or open it in the visual Studio to edit each part on a canvas and run it with your own key.
- 2
Replace any bracketed placeholders with your specifics. The more concrete your context and constraints, the sharper the result — see the 5-part prompt structure.
- 3
Run it, then refine. Ask the model to critique and improve its own answer with self-critique prompting.
Techniques in this prompt
Role-Based
Assigns the model an expert persona so it adopts the right vocabulary, depth, and standards for the task.
Learn this techniqueRecommended models
claudegpt-4ogemini
Build on this prompt
Open it in the visual Studio to wire it into a full workflow with your own API key — or learn the craft behind prompts like this.