A mustread by Neuroskeptic: Reproducibility Crisis: The Plot Thickens

There has been a lot of talk about the importance of reproducibility of research e.g. in psychology (and don’t get me starting about replication in educational sciences) and via this post by Neuroskeptic that you just must read you’ll discover another reason why. Just look at this picture from this paper by David Shanks et al.Romance, Risk, and Replication on romantic priming:

Neuroskeptic sums it up:

Shanks et al. say that this is evidence of the existence of “either p-hacking in previously published studies or selective publication of results (or both).”These two forms of bias go hand in hand, so the answer is probably both.Publication bias is the tendency of scientists (including peer reviewers and editors) to prefer positive results over negative ones. P-hacking is a process by which scientists can maximize their chances of finding positive results.

I’ve been blogging about these issues for years, yet still I was taken aback by the dramatic nature of the bias in this case. The studies are like a torrent, rolling down the mountain of significance. The image is not so much a funnel plot as an avalanche plot.

If we want to have people to listen to science – which I think is important – and scientists, we need to get our act together, imho.

No comments yet... Be the first to leave a reply!

Geef een reactie of deel je eigen ervaringen. Graag met je eigen naam ondertekenen, geen pseudoniemen. Anonieme reacties worden verwijderd.

Vul je gegevens in of klik op een icoon om in te loggen.

WordPress.com logo

Je reageert onder je WordPress.com account. Log uit / Bijwerken )

Twitter-afbeelding

Je reageert onder je Twitter account. Log uit / Bijwerken )

Facebook foto

Je reageert onder je Facebook account. Log uit / Bijwerken )

Google+ photo

Je reageert onder je Google+ account. Log uit / Bijwerken )

Verbinden met %s

%d bloggers op de volgende wijze: