Split-Test Calculator

This split test calculator can help you make better decisions when you are split testing. It ‘decides’ if a split test is complete when the confidence level (inverse p-value) is greater than 90%. If you’d prefer more (or less), just look at the confidence level and make your decisions from there.

Instructions

Enter your visitor/conversion numbers in the boxes below, then read the output of the calculator. It is recommended that you do not make any assumptions about success, or failure, or a split test until the confidence level is above 90%. This can avoid most statistical anomalies, meaning your test is more accurate.

Visitors Conversions Conversion Rate
Control {{vm.control_conversion_rate * 100| number :1}}%
Variation {{vm.variation_conversion_rate * 100| number :1}}%
Message {{vm.message}}
Winning {{vm.winning}}
Confidence {{vm.confidence * 100| number :1}}%
>