Hello ! A reviewer asks me to perform a post-hoc . I know this is generally not advised because if you replace the a priori effect size by the effect size measured in the experiment, this will introduce an erroneous relationship between the significance level of the test and the measured power.
... but does that mean that there is no proper way of measuring power retrospectively? For example, if you refrain from using the measured effect size and instead simulate a range of "a priori" effect size unrelated to the results of the test, then the dependency of the power to the significance level should not happen?
@lakens

@leovarnet @lakens Our thoughts:

Heinsberg LW, Weeks DE. Post hoc power is not informative. Genet Epidemiol. 2022 Oct;46(7):390-394.

pubmed.ncbi.nlm.nih.gov/356425

@StatGenDan This looks very relevant to my question indeed! Thank you!

Sign in to participate in the conversation
Qoto Mastodon

QOTO: Question Others to Teach Ourselves
An inclusive, Academic Freedom, instance
All cultures welcome.
Hate speech and harassment strictly forbidden.