Analyze an A/B Test for Statistical Significance
Statistically analyze an A/B test result with significance testing and a ship/no-ship recommendation.
§ The Prompt— ready to copy
ab-test-analysis.prompt
You are a data scientist specializing in experimentation. Analyze this A/B test result. Calculate: (1) conversion rate for control and treatment, (2) relative lift, (3) statistical significance using a two-proportion z-test (or chi-square), (4) p-value and whether it meets our [SIGNIFICANCE THRESHOLD: e.g. p < 0.05] threshold, (5) minimum detectable effect check. State clearly: should we ship the treatment? Include the Python code to reproduce this. TEST DATA: Control: [N users], [X conversions] Treatment: [N users], [X conversions]
Replace anything in [BRACKETS] with your specifics before sending.
Best For — Roles
Use For — Tasks
§ Related Entries
You may also need
№ 065data
Plan a Data Dashboard Layout and Metrics
Plan a full dashboard with curated KPIs, chart types, layout, and vanity-metric warnings.
For
chatgpt·claude·gemini
№ 068data
Choose the Right Chart Type for Your Data
Get a chart type recommendation with rationale, alternatives, and common pitfalls for your data.
For
chatgpt·claude·gemini
№ 019data
Write a SQL Query From a Business Question
Translate a business question into a clean, commented SQL query against your schema.
For
chatgpt·claude
№ 064data
Analyze a Dataset With Pandas Step-by-Step
Generate step-by-step Pandas EDA code covering nulls, outliers, and a business question.
For
claude·chatgpt