PainSci summary of Saragiotto 2016?This page is one of thousands in the PainScience.com bibliography. It is not a general article: it is focused on a single scientific paper, and it may provide only just enough context for the summary to make sense. Links to other papers and more general information are provided at the bottom of the page, as often as possible. ★★★★☆4-star ratings are for bigger/better studies and reviews published in more prestigious journals, with only quibbles. Ratings are a highly subjective opinion, and subject to revision at any time. If you think this paper has been incorrectly rated, please let me know.
“The credibility of subgroup claims in back pain trials is usually low, irrespective of the strength of the authors’ claim.” This interesting conclusion really needs some context …
A subgroup claim is a claim that a treatment works better for a specific group of back pain sufferers — patients with specific signs or symptoms that might indicate the nature of their back pain. Patients for back pain studies are usually quite generic (e.g. people with “chronic non-specific low back pain for more than six months”). There could be many types of back pain going on in that group. It makes perfect sense that some of those study subjects might respond better to a treatment than others, but such “subgroup claims” have become problematic in research, and especially back pain research. Are subgroups a holy grail? Or just a handy excuse for blinkered proponents of unproven treatment methods?
“If only they’d studied the right kind of back pain patients” could be viewed as a legitimate gripe about a study’s limitations, or it could be a great example of special pleading (conveniently disguised as a legitimate gripe). I have often suspected the latter, because subgroup hopes so often seem to be the loudest when expressed by ideologues and true believers, professionals with an obvious financial interest in evidence supporting their pet theories. These are the folks that can be counted on to make subgroup claims.
Back to this study: apparently Saragiotto et al were wondering about the same problem, so they systematically examined the credibility of subgroup claims in back pain trials … and they confirmed their bias (I assume) that the “credibility” of subgroup claims is low, suggesting are indeed often a form of special pleading, baked right into actual scientific studies — never mind biased clinicians commenting on them in arguments online.
original abstract†Abstracts here may not perfectly match originals, for a variety of technical and practical reasons. Some abstacts are truncated for my purposes here, if they are particularly long-winded and unhelpful. I occasionally add clarifying notes. And I make some minor corrections.
OBJECTIVES: To assess the credibility of subgroup claims in back pain randomized controlled trials.
STUDY DESIGN AND SETTING: A sample of reports of back pain trials from 2000 to 2015 that provided a subgroup claim were included (n=38). Two reviewers independently assessed risk of bias and credibility of subgroup claims as well as the strength of the author's claim. The credibility of subgroup claims was assessed using a 10-criteria tool, and strength of the subgroup claims was assessed based on seven criteria to categorize claims into a reasonably strong claim of a definitive subgroup effect or a more cautious claim of a possible effect.
RESULTS: A total of 91 claims of a subgroup effect were reported in the 38 included trials, of which 28 were considered strong claims of a definitive effect, and 63 were cautious claims of a possible effect. None of the subgroup claims met all 10 credibility criteria, and only 24% (22 claims) satisfied at least five criteria. The only criteria satisfied by more than 50% of the claims were if the subgroup variable was a characteristic measured at baseline, and whether the test of interaction was significant. All other criteria were satisfied by less than 30% of the claims. There was no association between the credibility of subgroup claims and the journal impact factor, risk of bias, sample size, or year of publication.
CONCLUSION: The credibility of subgroup claims in back pain trials is usually low, irrespective of the strength of the authors' claim.
- “Analgesic effects of treatments for non-specific low back pain: a meta-analysis of placebo-controlled randomized trials,” L A C Machado, S J Kamper, R D Herbert, C G Maher, and J H McAuley, Rheumatology (Oxford), 2009.
- “Subgrouping Patients With Nonspecific Low Back Pain: Hope or Hype?,” Bruno T Saragiotto, Chris G Maher, Mark J Hancock, and Bart W Koes, Journal of Orthopaedic & Sports Physical Therapy, 2017.
These three articles on PainScience.com cite Saragiotto 2016 as a source:
- PS Save Yourself from Low Back Pain! — Low back pain myths debunked and all your treatment options reviewed
- PS The Chiropractic Controversies — An introduction to chiropractic controversies like aggressive billing, treating kids, and neck manipulation risks
- PS Does Spinal Manipulation Work? — Spinal manipulation, adjustment, and popping of the spinal joints and the subluxation theory of disease, back pain and neck pain
This page is part of the PainScience BIBLIOGRAPHY, which contains plain language summaries of thousands of scientific papers & others sources. It’s like a highly specialized blog. A few highlights:
- Effectiveness of customised foot orthoses for Achilles tendinopathy: a randomised controlled trial. Munteanu 2015 Br J Sports Med.
- A Bayesian model-averaged meta-analysis of the power pose effect with informed and default priors: the case of felt power. Gronau 2017 Comprehensive Results in Social Psychology.
- The neck and headaches. Bogduk 2014 Neurol Clin.
- Agreement of self-reported items and clinically assessed nerve root involvement (or sciatica) in a primary care setting. Konstantinou 2012 Eur Spine J.
- Effect of NSAIDs on Recovery From Acute Skeletal Muscle Injury: A Systematic Review and Meta-analysis. Morelli 2017 Am J Sports Med.