If you repeatedly perform a hypothesis test when the null hypothesis is true, p-values will randomly drift between 0 and 1, and therefore, if you test often enough, you will always find a significant effect. lakens.github.io/statistical_i This is why preregistration is important. You can test multiple times as data comes in, but then you need to adjust the alpha level: lakens.github.io/statistical_i For a single simulation of the p-values you could get, see:

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.