Mistake Master
Inside means plausible, not proven
An interval is a list of plausible values for the parameter, and that single sentence decides every claim it can be used to judge. A value the interval contains has not been ruled out. A value it misses is not supported by this sample. Neither one is proof, and running the logic backwards, rejecting a claim because the interval contains it, is the error this topic exists to remove.
§1
Every value inside is plausible; values outside are not supported.
▸
A confidence interval is a set of plausible values for the parameter. To judge a claim about $p$, find where the claimed value falls:
- Inside the interval. The claimed value is plausible: this sample gives no reason to doubt it.
- Outside the interval. The claimed value is not supported: this sample provides evidence against it.
A poll of 400 district voters gives a 95% interval of $(0.572, 0.668)$ for the proportion supporting a measure. A campaign claims that half the district supports it, $p = 0.50$. That value sits below the entire interval, so the data provide evidence against the claim; the plausible values are all well above 0.50.
A different poll gives $(0.47, 0.55)$. Now 0.50 is inside, so it is plausible and cannot be ruled out. Notice what has not been shown: 0.49, 0.52, and 0.54 are equally inside and equally plausible. The interval has not selected 0.50; it has merely failed to exclude it.
§2
Directional claims need the whole interval on one side.
▸
Many claims are one-sided: "more than half", "at least 30%", "under a quarter". The interval answers these by position:
- Interval entirely above the threshold: the data support the claim that $p$ exceeds it. $(0.572, 0.668)$ lies entirely above 0.50, so there is evidence that a majority supports the measure.
- Interval entirely below: evidence that $p$ falls short of the threshold.
- Interval straddling it: no conclusion about direction. $(0.47, 0.55)$ contains 0.50, so the data are consistent with a majority, with a minority, and with an exact split.
The straddling case is where the two backwards readings appear. "The interval runs above 0.50 at its top end, so there is a majority" ignores the values below 0.50 that are equally plausible. "The interval contains 0.50, so there is no majority" turns a failure to decide into a decision the other way. The correct conclusion is that this sample cannot distinguish the possibilities, which is a real and reportable finding.
§3
Plausible is not proven, and unsupported is not disproven.
▸
Two overreaches ride along with every interval.
An interval containing a value does not prove that value. The interval $(0.47, 0.55)$ contains 0.50 and also contains every other value in that range; a single sample cannot pick one out. The right phrasing is that 0.50 is a plausible value for $p$, not that $p$ equals 0.50 or that the claim is confirmed.
An interval missing a value does not disprove it either. A 95% interval is built by a method that misses the parameter about 5% of the time, so an interval excluding the true value is uncommon and entirely possible. The claim is that the data provide evidence against the value, at the stated level of confidence.
The confidence level travels with that hedge. It is a property of the method across repeated samples: about 95% of intervals built this way capture $p$. It is not the probability that this interval is right, and a wider interval does not mean a better method, only a more cautious claim.
§4
The justification has three parts, in order.
▸
A complete justification reads as one short paragraph with a fixed structure:
- State the interval and what it estimates. "We are 95% confident that the interval from 0.572 to 0.668 captures the true proportion of all district voters supporting the measure."
- Locate the claimed value. "The claimed value of 0.50 lies below the entire interval."
- Conclude about the parameter, in context. "So these data provide evidence against the claim that only half the district supports the measure, and support the claim that more than half do."
Two habits keep the paragraph correct. Name the population every time, since an interval that never mentions who is being described has already lost its referent. And keep the verbs hedged: evidence against, plausible, consistent with, never proves or shows conclusively. The hedge is not a stylistic softener; it is the accurate report of what a sample can establish.
§5
Skill Check.
▸
Ten scenarios. Pick the chips that match your answer, then check. A scenario marks complete the first time every part is right. Progress saves on this device.