Hello #statstodon! A reviewer asks me to perform a post-hoc #PowerAnalysis. I know this is generally not advised because if you replace the a priori effect size by the effect size measured in the experiment, this will introduce an erroneous relationship between the significance level of the test and the measured power.
... but does that mean that there is no proper way of measuring power retrospectively? For example, if you refrain from using the measured effect size and instead simulate a range of "a priori" effect size unrelated to the results of the test, then the dependency of the power to the significance level should not happen?
#stats #statschat @lakens

@leovarnet there is sensitivity power analysis (see the section in the sample size justification chapter in my textbook). That can be done after a study. Otherwise power for the smallest effect of interest.

@lakens Thank you! And this is a very good reminder that your book is in my to-read list!