These are public posts tagged with #reproducibilitycrisis. You can interact with them if you have an account anywhere in the fediverse.
Science, particularly the biomedical branch, suffers from a #reproducibilitycrisis. Elizabeth Bik from https://microbiomedigest.com/ who is one of the best known science sleuths (and alas still on X). Has received the Einstein Award - along with #PubPeer: https://award.einsteinfoundation.de/award-winners-finalists/recipients-2024
A daily digest of scientific microbiome papers, by…
Microbiome Digest - Bik's PicksMild swearing, scammy behaviour
@fernand0 it is now 19 years from Get me off your fucking mailing list (Mazières and Koehler, 2005)… and there are far more tools and incentives now in support of the scams than the journals.
https://www.vox.com/2014/11/21/7259207/scientific-paper-scam
#PeerReview #FakeScience #ReproducibleResearch #ReproducibilityCrisis
I have thought of refusing to review manuscripts which do not provide the underlying data or code that the conclusions are based upon.
The technical difficulty is that one only can verify this after accepting the review so I haven't been able to carry this through systematically.
Last week I reviewed a manuscript for an #Elsevier journal Marine Micropaleontology. In my review I explained the need to provide the original data and document statistical analyses, as only their conclusions (significant/not) were provided. I (think I) explained politely why this is not reproducible and recommended a revision.
This entire part of my review was omitted from the decision sent to the authors and only the least significant comments on some details were passed on.
What would you do @academicchatter #openscience #reproducibilitycrisis
It was an interesting few weeks, but it looks like the #lk99 story has been told. No superconductor for us, but a great example of science working the way it's supposed to. Yay for #reproducibility
https://www.nature.com/articles/d41586-023-02585-7
#reproducibilitycrisis #openscience #science
Long thread/6
#10yrsago San Diego cop smashes phone & beats up suspect: “Phones can be converted to a weapon. Look it up online.” https://www.youtube.com/watch?v=qbUvvyXoExI
#5yrsago China escalates the war on jaywalkers with automated shouting laser/squirtguns tied to motion-sensors https://www.straitstimes.com/asia/east-asia/attention-jaywalkers-youll-be-sprayed-with-water-in-central-china-city
#5yrsago Koch-backed #ClimateDeniers are exploiting the #ReproducibilityCrisis to discredit climate science https://www.wired.com/story/sciences-reproducibility-crisis-is-being-used-as-political-ammunition/
6/
New posting! A riff on the dream of community-led feedback on research findings, the #ReproducibilityCrisis, the problem of policing data integrity, and one possible alternative - that we all make an effort to praise and highlight good-quality work when we encounter it. Hope you like it.
https://totalinternalreflectionblog.com/2022/11/27/praise-censure-and-the-dream-of-open-science/
“Thus, more than 97% of the 41 manuscripts did not present the raw data supporting their results when requested by an editor”
“No raw data, no science: another possible source of the reproducibility crisis.” https://molecularbrain.biomedcentral.com/articles/10.1186/s13041-020-0552-2
#reproducibility #reproducibilitycrisis #rawdata #molecularbrain #miyakawa
A reproducibility crisis is a situation where many…
BioMed CentralTalk: Leakage and the Reproducibility Crisis in ML-based Science by @sayashk
Online or in person at Exeter
https://www.exeter.ac.uk/news/events/details/index.php?event=12481
"There are many known methodological pitfalls, including data leakage, in ML-based science. In this paper, we systematically investigate reproducibility issues in ML-based science. We show that data leakage is indeed a widespread problem and has led to severe reproducibility failures."
#MachineLearning #DataScience #ReproducibilityCrisis #OpenScience
And to think, we owe it all to a dead salmon
#science #reproducibilitycrisis
Cognitive neuroscience at the crossroads
https://www.nature.com/articles/d41586-022-02283-w