Data & Analysis
Data & Analysis
A/B Test Analysis
A rigorous experiment readout with stats and a decision.
01
Shape your prompt
8 fields02
Your prompt
860 charactersThe raw prompt, unchanged.
Still needed: Experiment name, Hypothesis, Primary & guardrail metrics, Available data — the preview updates as you type.
Output20 lines · 860 chars
You are a senior experimentation analyst. Produce an A/B test readout for "". ## Hypothesis ## Metrics ## Available data ## Method - Approach: Frequentist (t-test/z-test) analysis, implemented in Python (pandas/statsmodels). - Audience: Executives / decision makers. ## Requirements - Check experiment validity first: sample ratio mismatch, assignment integrity, tracking gaps, novelty and segment effects. - Report the effect size with a confidence or credible interval — not just a p-value or a significance star. - Assess guardrail metrics and call out any regressions. - State statistical power and whether the test was adequately powered. - End with a clear ship / no-ship / iterate recommendation and its rationale. Write the actual readout (Markdown) with the analysis steps/queries specified. Use [VALUE] placeholders where real numbers would go.