Sensible advice for aches, pains & injuries
bibliography * The PainScience Bibliography contains plain language summaries of thousands of scientific papers and others sources, like a specialized blog. This page is about a single scientific paper in the bibliography, Saragiotto 2016.

Claims about subgroups of back pain study subjects have “low credibility”

Saragiotto BT, Maher CG, Moseley AM, Yamato TP, Koes BW, Sun X, Hancock MJ. A systematic review reveals that the credibility of subgroup claims in low back pain trials was low. J Clin Epidemiol. 2016 Jun. PubMed #27297201.
Tags: back pain, scientific medicine, debunkery, bad news, neat, pain problems, spine

PainSci summary of Saragiotto 2016?This page is one of thousands in the bibliography. It is not a general article: it is focused on a single scientific paper, and it may provide only just enough context for the summary to make sense. Links to other papers and more general information are provided at the bottom of the page, as often as possible. ★★★★☆?4-star ratings are for bigger/better studies and reviews published in more prestigious journals, with only quibbles. Ratings are a highly subjective opinion, and subject to revision at any time. If you think this paper has been incorrectly rated, please let me know.

“The credibility of subgroup claims in back pain trials is usually low, irrespective of the strength of the authors’ claim.” This interesting conclusion really needs some context…

A subgroup claim is a claim that a treatment works better for a specific group of back pain sufferers — patients with specific signs or symptoms that might indicate the nature of their back pain. Patients for back pain studies are usually quite generic (e.g. people with “chronic non-specific low back pain for more than six months”). There could be many types of back pain going on in that group. It makes perfect sense that some of those study subjects might respond better to a treatment than others, but such “subgroup claims” have become problematic in research, and especially back pain research. Are subgroups a holy grail? Or just a handy excuse for blinkered proponents of unproven treatment methods?

“If only they’d studied the right kind of back pain patients” could be viewed as a legitimate gripe about a study’s limitations, or it could be a great example of special pleading (conveniently disguised as a legitimate gripe). I have often suspected the latter, because subgroup hopes so often seem to be the loudest when expressed by ideologues and true believers, professionals with an obvious financial interest in evidence supporting their pet theories. These are the folks that can be counted on to make subgroup claims.

Back to this study: apparently Saragiotto et al were wondering about the same problem, so they systematically examined the credibility of subgroup claims in back pain trials… and they confirmed their bias (I assume) that the “credibility” of subgroup claims is low, suggesting are indeed often a form of special pleading, baked right into actual scientific studies — never mind biased clinicians commenting on them in arguments online.

original abstract

OBJECTIVES: To assess the credibility of subgroup claims in back pain randomized controlled trials.

STUDY DESIGN AND SETTING: A sample of reports of back pain trials from 2000 to 2015 that provided a subgroup claim were included (n=38). Two reviewers independently assessed risk of bias and credibility of subgroup claims as well as the strength of the author's claim. The credibility of subgroup claims was assessed using a 10-criteria tool, and strength of the subgroup claims was assessed based on seven criteria to categorize claims into a reasonably strong claim of a definitive subgroup effect or a more cautious claim of a possible effect.

RESULTS: A total of 91 claims of a subgroup effect were reported in the 38 included trials, of which 28 were considered strong claims of a definitive effect, and 63 were cautious claims of a possible effect. None of the subgroup claims met all 10 credibility criteria, and only 24% (22 claims) satisfied at least five criteria. The only criteria satisfied by more than 50% of the claims were if the subgroup variable was a characteristic measured at baseline, and whether the test of interaction was significant. All other criteria were satisfied by less than 30% of the claims. There was no association between the credibility of subgroup claims and the journal impact factor, risk of bias, sample size, or year of publication.

CONCLUSION: The credibility of subgroup claims in back pain trials is usually low, irrespective of the strength of the authors' claim.

related content

These three articles on cite Saragiotto 2016 as a source:

This page is part of the PainScience BIBLIOGRAPHY, which contains plain language summaries of thousands of scientific papers & others sources. It’s like a highly specialized blog.