“A Vast Graveyard of Undead Theories: Publication Bias and Psychological Science’s Aversion to the Null”

You have to love that title, which comes from a paper by Christopher Ferguson and Moritz Heene, which the excellent Andrew Gelman parses, and passes on to the rest of us. Any field that uses statistics is susceptible to publication bias (i.e., not publishing statistical analyses that find “no effect”). It is notorious in pharmaceutical research, where money talks shouts. I am guessing that the reason psychology gets a particularly bad reputation for publication bias, compared with other social sciences, is that it deals with a lot of small experimental data sets – so you really do have a situation where nearly identical experiments can be run twenty times by different researchers, and the one that gets a significant effect gets published. Statistical work in economics and political science tends to keep re-using a small number of mostly public data sets, so the problems are different.

Advertisements

One thought on ““A Vast Graveyard of Undead Theories: Publication Bias and Psychological Science’s Aversion to the Null”

  1. Pingback: Spurious significance, junk science | Frederick Guy

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s