I have just finished rolling out the Python version of the R package 'statcheck", created by prof. Michèle Nuijten.
Statcheck can be used to extract and analyze statistical results from scientific articles.
Currently working on adding the option to extract tables.
If anyone would like to check it out, here is the repo:
https://github.com/hplisiecki/statcheck_python?fbclid=IwAR30Y1Gxn0k9bK3rKWTmGA6tHi-X_lrBKnvvLz0v9IMOmF8QXV29g0LYCRI
@hplisiecki
I hope that it's been checked carefully to see that it extracts the right error SD. That can often take a lot of digging in supplementary materials.
@david_colquhoun
I made sure to make as few changes to the original code as possible, and have recoded all original tests. In terms of the standard deviations and errors, it actually doesn't extract them;
It extracts the value of a test statistic, and the degrees of freedom and recomputes the p-values on that basis.
@david_colquhoun Indeed, the main aim of the verification is the incorrect rounding of the statistic or pure fabrication. Checking earlier steps would be way more problematic as they are not usually directly reported.
@hplisiecki
Aha so it assumes that the authors used the right error variance and df, and checks only the last step?