Do certain countries produce only positive results? A systematic review of controlled trials
One article on PainSci cites Vickers 1998: Does Acupuncture Work for Pain?
PainSci commentary on Vickers 1998: ?This page is one of thousands in the PainScience.com bibliography. It is not a general article: it is focused on a single scientific paper, and it may provide only just enough context for the summary to make sense. Links to other papers and more general information are provided wherever possible.
Apparently “research conducted in certain countries was uniformly favorable to acupuncture.” Russia and China in particular effectively do not publish any negative results about acupuncture. I love this ripe, juicy understatement: “Publication bias is a possible explanation.” YA THINK?!
original abstract †Abstracts here may not perfectly match originals, for a variety of technical and practical reasons. Some abstacts are truncated for my purposes here, if they are particularly long-winded and unhelpful. I occasionally add clarifying notes. And I make some minor corrections.
OBJECTIVE: To determine whether clinical trials originating in certain countries always have positive results.
DATA SOURCES: Abstracts of trials from Medline (January 1966-June 1995).
STUDY SELECTION: Two separate studies were conducted. The first included trials in which the clinical outcome of a group of subjects receiving acupuncture was compared to that of a group receiving placebo, no treatment, or a nonacupuncture intervention. In the second study, randomized or controlled trials of interventions other than acupuncture that were published in China, Japan, Russia/USSR, or Taiwan were compared to those published in England.
DATA EXTRACTION: Blinded reviewers determined inclusion and outcome and separately classified each trial by country of origin.
DATA SYNTHESIS: In the study of acupuncture trials, 252 of 1085 abstracts met the inclusion criteria. Research conducted in certain countries was uniformly favorable to acupuncture; all trials originating in China, Japan, Hong Kong, and Taiwan were positive, as were 10 out of 11 of those published in Russia/USSR. In studies that examined interventions other than acupuncture, 405 of 1100 abstracts met the inclusion criteria. Of trials published in England, 75% gave the test treatment as superior to control. The results for China, Japan, Russia/USSR, and Taiwan were 99%, 89%, 97%, and 95%, respectively. No trial published in China or Russia/USSR found a test treatment to be ineffective.
CONCLUSIONS: Some countries publish unusually high proportions of positive results. Publication bias is a possible explanation. Researchers undertaking systematic reviews should consider carefully how to manage data from these countries.
related content
- “The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta-analyses,” Ioannidis, Milbank Q, 2016.
This page is part of the PainScience BIBLIOGRAPHY, which contains plain language summaries of thousands of scientific papers & others sources. It’s like a highly specialized blog. A few highlights:
- Cannabidiol (CBD) products for pain: ineffective, expensive, and with potential harms. Moore 2023 J Pain.
- Inciting events associated with lumbar disc herniation. Suri 2010 Spine J.
- Prediction of an extruded fragment in lumbar disc patients from clinical presentations. Pople 1994 Spine (Phila Pa 1976).
- Characteristics of patients with low back and leg pain seeking treatment in primary care: baseline results from the ATLAS cohort study. Konstantinou 2015 BMC Musculoskelet Disord.
- Effectiveness and cost-effectiveness of universal school-based mindfulness training compared with normal school provision in reducing risk of mental health problems and promoting well-being in adolescence: the MYRIAD cluster randomised controlled trial. Kuyken 2022 Evid Based Ment Health.