Sensible advice for aches, pains & injuries
bibliography * The PainScience Bibliography contains plain language summaries of thousands of scientific papers and others sources, like a specialized blog. This page is about a single scientific paper in the bibliography, Nieuwenhuis 2011.

Erroneous analyses of interactions in neuroscience: a problem of significance

Nieuwenhuis S, Forstmann BU, Wagenmakers EJ. Erroneous analyses of interactions in neuroscience: a problem of significance. Nat Neurosci. 2011;14(9):1105–7. PubMed #21878926.
Tags: scientific medicine, bad science, random

PainSci summary of Nieuwenhuis 2011?This page is one of thousands in the bibliography. It is not a general article: it is focussed on a single scientific paper, and it may provide only just enough context for the summary to make sense. Links to other papers and more general information are provided at the bottom of the page, as often as possible. ★★★★☆?4-star ratings are for bigger/better studies and reviews published in more prestigious journals, with only quibbles. Ratings are a highly subjective opinion, and subject to revision at any time. If you think this paper has been incorrectly rated, please let me know.

This research identified a major common problem in scientific papers. It was described by Ben Goldacre for The Guardian as “a stark statistical error so widespread it appears in about half of all the published papers surveyed from the academic neuroscience research literature.” Dr. Steven Novella also wrote about it for recently, adding that “there is no reason to believe that it is unique to neuroscience research or more common in neuroscience than in other areas of research.”

~ Paul Ingraham

original abstract

In theory, a comparison of two experimental effects requires a statistical test on their difference. In practice, this comparison is often based on an incorrect procedure involving two separate tests in which researchers conclude that effects differ when one effect is significant (P < 0.05) but the other is not (P> 0.05). We reviewed 513 behavioral, systems and cognitive neuroscience articles in five top-ranking journals (Science, Nature, Nature Neuroscience, Neuron and The Journal of Neuroscience) and found that 78 used the correct procedure and 79 used the incorrect procedure. An additional analysis suggests that incorrect analyses of interactions are even more common in cellular and molecular neuroscience. We discuss scenarios in which the erroneous procedure is particularly beguiling.

related content

One article on cites Nieuwenhuis 2011 as a source:

This page is part of the PainScience BIBLIOGRAPHY, which contains plain language summaries of thousands of scientific papers & others sources. It’s like a highly specialized blog.