b2KIT

A/B Test Duration Calculator

Calculate how long to run an A/B test based on traffic, baseline conversion rate, and minimum detectable effect. Avoid stopping tests too early.

Tested tool guide Tested browser tools Checked August 16, 2026

What A/B Test Duration Calculator does, with a checked example

This calculator turns the three numbers you have before a test starts - daily traffic, current conversion rate, and the smallest improvement worth detecting - into a required sample size and a run duration in days and weeks. It applies the standard sample-size math for comparing two conversion proportions at a chosen confidence level and power, then divides by traffic to reach a calendar date. The number people get wrong first: sample size does not grow linearly with what you want to detect. Detecting half the effect needs about four times the visitors, which is why so many under-powered tests end inconclusively after a month.

Worked example

A concrete input and expected output from the current implementation.

Input

Baseline conversion rate 10%, minimum detectable effect 2 percentage points, 100 visitors per variant per day, 95% confidence, 80% power.

Expected output

Required sample: 3,841 visitors per variant, 7,682 total. At 100 visitors per variant per day, the test should run about 39 days - roughly 5.5 weeks.

The two-proportion sample-size formula returns 3,841 per group for detecting a shift from 10% to 12% at 95% confidence with 80% power, and 3,841 divided by 100 visitors per day is 38.4, rounded up to a 39-day run.

How the result is produced

1

Sample size first, then duration

The tool first computes the visitors needed per variant from four inputs: baseline conversion rate, minimum detectable effect, confidence level, and power. Because it compares two proportions, the requirement depends on the spread of both the baseline rate and the assumed improved rate. Only afterwards does it divide by daily traffic to express the same sample as calendar duration. Traffic changes the duration; it never changes the sample size.

2

The inverse-square rule

The required sample scales with the square of one over the effect: halving the minimum detectable effect multiplies the needed visitors by about four, because a smaller difference sits closer to the noise floor. At a 5% baseline, detecting a 1-point lift takes roughly 8,200 visitors per variant; at a 10% baseline, the same 1-point lift takes about 14,750. Low baselines make the same absolute lift easier to detect.

Good uses

  • Planning a new test: enter current conversion rate and realistic daily traffic to learn whether a two-week run can detect the effect you care about, or whether the calendar forces you to accept a larger effect or a lower confidence level.
  • Auditing a test already in flight: compare the visitors accumulated so far with the required sample to judge whether an insignificant result is a genuine null or an under-powered test that was simply stopped too early.
  • Stress-testing the plan before launch: re-run the numbers with weekend traffic, a seasonal dip, or an expected baseline shift after a redesign to see how the end date moves, so the test is scheduled against the slowest realistic week.

Limits and checks

  • The duration is a minimum, not a guarantee. It assumes traffic arrives at the entered rate, is split evenly between variants, and that the test runs unchanged. Reaching the planned end with no significant difference means the test failed to detect the effect - it does not prove the variants are equal.
  • A 20% minimum detectable effect means 2 percentage points at a 10% baseline but 1 point at a 5% baseline. Entering the wrong flavor - for example meaning 2 points but typing 20% at a 5% baseline - can change the required sample by a factor near four. Check which unit the form asks for.
  • Each visitor counts once. The formula assumes unique visitors are split evenly between variants; repeat sessions, multiple devices, and bot traffic inflate the visitor tally without adding information, so the real-world duration lands longer than the calendar suggests. The result is a planning estimate - traffic rates drift - not a guarantee of the end date.

Common questions

Can I stop the test as soon as the result looks significant?

Not and keep the 5% error rate. Watching the result day by day and stopping at the first significant p-value is peeking; it pushes the real false-positive rate well above the nominal 5%, which is exactly why the planned duration exists. If you want early stopping, pick a sequential testing design before the test starts, and treat its result as the only stopping rule.

Why does the required sample jump so much when I tighten the minimum detectable effect?

The formula scales with the inverse square of the effect. Halving the effect halves the difference you must resolve against the same background noise, and statistical precision only grows with the square root of the sample, so the visitors must roughly quadruple. At a 10% baseline, a 2-point effect needs about 3,840 visitors per variant; 1 point needs about 14,750.

References and verification

The example and behavioral notes were checked against the browser implementation. Standards and primary references below define the relevant format, formula, or platform behavior.

Related Tools