Start a project

Tool 164 of 425 · Experiments

A/B Test Significance Calculator

Tells you whether an A/B test winner is real or noise, with p-value and confidence interval.

A/B Test Significance Calculator

Your input

Result

MeasureValue

    01

    What it does

    Tells you whether an A/B test winner is real or noise, with p-value and confidence interval.

    • Two-proportion z-test
    • Two-sided p-value
    • Confidence interval for the difference
    • 90, 95 or 99% confidence

    02

    Private by design

    Everything happens in your browser. Nothing you type, paste or upload is sent anywhere, and it keeps working offline once the page has loaded.

    03

    What you get

    Rates, uplift, p-value and verdict, with a Copy and a Download button on every result.

    • A/B testing
    • CRO
    • Statistics

    Why it matters

    Calling a test early on a small lift is the classic CRO mistake: random variation looks like a winner surprisingly often.

    This shows how sure you can be, and the confidence interval shows how large the real effect might be.

    How to use it

    1. Type or paste your input; the example shows the format.
    2. Press Check significance. Results also update as you type.
    3. Read the summary line, then the table, notes or output below it.
    4. Copy or download what you need. Nothing leaves this page.

    FAQ

    Can I stop the test as soon as it's significant?

    No. Peeking inflates false positives. Decide the sample size first and check once.

    Which test is this?

    A pooled two-proportion z-test, the standard for conversion rates with reasonably large samples.

    Is my input uploaded?

    No. The tool runs in your browser and nothing you type, paste or open is sent anywhere.

    Can I rely on the result?

    It follows the public specification or formula named on this page and says where it simplifies. Check anything critical against the official tool or documentation before you ship it.

    Work with me

    Want a site that gets these right?

    I build fast, accessible websites and web apps that pass these checks from day one. Tell me about your project and I'll reply personally with honest next steps.

    All developer tools · Back to leej.uk