When doing a simulation study, if any of our test statistic values are more extreme than the original value, then we would not reject the null hypothesis.

Question

Quizplus · Accepted Answer

In a simulation study, if any of our test statistic values are more extreme than the original value, it suggests that the observed result could occur by chance under the null hypothesis. However, the decision to reject the null hypothesis depends on the proportion of these more extreme values relative to all simulated values, not just on their existence. Rejecting the null hypothesis typically depends on whether this proportion is less than the chosen significance level.

When Doing a Simulation Study, If Any of Our Test