Free Marketing Tools/A/B Test Calculator

Free Tool

Ad A vs. B:
a real winner, or just luck?

Enter the visitors/clicks and conversions for each version. We calculate statistical confidence and tell you which version to choose, or how much more data you need.

AVersion A (original)
BVersion B (test)
95% is standard. For small decisions that are easy to reverse, 90% is fine.

Plan before you test

How many people per version and how many days to run before you can draw a conclusion

%
%
Results will appear here

Enter people and conversions
for both versions

Confidence that the difference is real
-
Conversion Rate A
Conversion Rate B
B vs. A
P-value

    * Uses a two-tailed two-proportion z-test. Results are accurate when people are split randomly, versions run at the same time, and you don't stop the test the moment you see a good result.

    About this tool

    Decide with data, not gut feel

    What is it?

    An A/B test statistical significance calculator that tells you whether the difference between 2 ads, creatives, landing pages or messages is big enough to trust, and helps you plan how many people and days you need before concluding.

    Who it's for

    • Advertisers testing multiple creatives or headlines
    • Website owners testing landing pages or buy buttons
    • Teams testing email subject lines or LINE broadcast messages
    • Anyone who sees slightly different numbers and isn't sure whether to switch

    How to use

    1. Before testing, enter your current conversion rate and visitors per day in the "Plan before you test" box to see how many days to run
    2. When the test is done, enter the people and conversions for versions A and B
    3. Choose a confidence level (usually 95%)
    4. If it says "Winner", switch to the winning version. If it's not clear yet, keep running until you reach the recommended number of people.

    FAQ about A/B testing

    Test the right way to get results you can trust

    What is statistical significance?

    It's the confidence that the difference you see isn't due to chance. For example, 95% confidence means that if the two versions were actually the same, there'd be less than a 5% chance of seeing a difference this large by luck.

    How long should a test run?

    At least until you reach the number of people the tool recommends, and for at least 7 days to cover both weekday and weekend behavior. Don't stop as soon as one version pulls ahead, because early results often swing.

    How many things should I change per test?

    Change one thing at a time, such as only the image or only the headline, so you know what improved results. If you change several things at once, you'll know which version is better but not why.

    Can I use this with Facebook Ads A/B tests?

    Yes. Use clicks (or reach) as the number of people and results as each version's conversions. This tool helps double-check whether the result the platform announces is significant enough.

    Other free marketing tools

    Use them together to cover every part of your marketing plan