Mistake Master

Potential Problems with Sampling

Bias is a systematic error in a sampling method that makes the statistic consistently overshoot or undershoot the parameter. Undercoverage leaves part of the population out of the frame, as a landline survey leaves out the cell-only young. Voluntary response lets the sample assemble itself from volunteers with strong feelings. Nonresponse loses selected individuals who differ from those who answer. Response bias bends the answers themselves, through loaded wording or self-report. A complete bias claim names the mechanism, the direction of the error, and the reason for that direction.

The central trap is repair by enlargement: defending a tilted method by its count, as if 10,000 self-selected responses could outvote their own selection. Sample size reduces scatter around the method's target; it never moves the target. The other traps are name confusions: calling a convenience sample random because it felt unpredictable, filing voluntary response under nonresponse, or crediting a big response rate as proof of no bias while the answers themselves were bent by the question.

PROBLEM WHAT GOES WRONG DIRECTION undercoverage frame omits a group away from the missed voluntary response sample selects itself toward strong feelings nonresponse chosen units drop out toward who answers response bias answers bent by wording or self-report toward the push
Every row has a direction. A bias claim without one is a vocabulary word; with one, it is a checkable prediction.

The work

Lesson live · diagnostic and drills coming soon
Lesson
Potential Problems with Sampling

Defines bias as a systematic tilt of the method, then works undercoverage, voluntary response, nonresponse, and question wording, each with the direction it pushes the estimate and the reason, and dismantles the idea that a bigger sample fixes any of it.

Skill check · 10 scenarios
Diagnostic
10-item topic check

Ten items on sampling problems: naming the bias at work, predicting which way it pushes the estimate, separating voluntary response from nonresponse, and rejecting sample size as a cure. Take it cold to find the bias you misname, or after the lesson to confirm you no longer do.

Not yet available · 10 items
Targeted Practice
Drill a single misconception

Pick one of the failure modes you missed and drill it on its own. The round is adaptive: two correct in a row clears it for now and moves you to the next. Two in a row is a checkpoint, not proof: if the error resurfaces later, the misconception comes back.

Unlocks from the diagnostic, which is not published yet