The chance that at least some p-values will be lower than 0.05 increases when
A)the sample is nonprobabilistic.
B)the sample is smaller than 100 cases.
C)there is actually reverse causality.
D)the number of analyses gets higher.

Question

Quizplus · Accepted Answer

When the number of analyses gets higher, the chance of finding at least some p-values lower than 0.05 increases, even if there is no true effect. This is known as the problem of multiple comparisons, and researchers need to correct for it to avoid false positive results.

The Chance That at Least Some P-Values Will Be Lower