Mistake Master
Student view — seeing the site as a student does

Justifying a Claim Based on a Confidence Interval for the Difference Between Two Population Proportions

▶︎  Watch it animatedinteractive step-through · ~3 min · optional

An interval for $p_1 - p_2$ is read against 0, the value that says the two population proportions are equal. Entirely above 0 gives evidence that $p_1 > p_2$; entirely below gives evidence that $p_1 < p_2$; containing 0 leaves both directions plausible and settles nothing. The checkout interval $(0.018, 0.182)$ for new minus old lies above 0, so the new system's rate is higher by roughly 2 to 18 percentage points. A justification states the interval and what it captures, locates 0, gives the direction, and gives the magnitude, with the order of subtraction named throughout.

Two readings recur. An interval containing 0 gets reported as proof that the groups are equal, though 0 is one plausible value among many and the correct sentence is that the data do not provide convincing evidence of a difference. And the direction gets lost: an interval judged by which side holds more of its length, or a negative interval read as though the first group were ahead, because the order of subtraction was never stated. Reversing that order flips $(-0.14, -0.02)$ into $(0.02, 0.14)$ with no change in meaning, which is exactly why the order has to be written down.

three positions relative to zero 0 entirely above: evidence that p1 > p2 0 entirely below: evidence that p1 < p2 0 contains 0: no convincing evidence of a difference and NOT evidence that the two proportions are equal
Only the third case is commonly misreported. It leaves differences in both directions plausible, which is a failure to decide rather than a finding that the groups match.
one finding, two orders of subtraction 0 -0.14 -0.02 treatment minus control: treatment is LOWER 0 0.02 0.14 control minus treatment: same finding, stated the other way
Reversing the order flips both endpoints and both signs while changing nothing about the world. The stated order is the only thing that lets a reader tell which group is ahead.

The work

3 ways in · any order
Lesson
Justifying a Claim Based on a Confidence Interval for the Difference Between Two Population Proportions

Reads an interval for a difference against zero: entirely above or below gives a direction, containing zero leaves the question open without establishing equality, and the sign is meaningless until the order of subtraction is stated.

Skill check · 10 scenarios
Diagnostic
10-item topic check

Ten items on differences and zero: intervals containing zero read as proof of equality, direction judged by which side holds more of the interval, negative intervals read as favoring the first group, and causal claims from observed groups. Take it cold to find your habit, or after the lesson to check it is gone.

Not started · 10 items · ~15 min
Targeted Practice
Drill a single misconception

Pick one of the failure modes you missed and drill it on its own. The round is adaptive: two correct in a row clears it for now and moves you to the next. Two in a row is a checkpoint, not proof: if the error resurfaces later, the misconception comes back.

Take the diagnostic to identify your misconceptions