The measurement of observer agreement for categorical data
Two articles on PainSci cite Landis 1977: (1) Is Diagnosis for Pain Problems Reliable? (2) Trigger Point Doubts
PainSci notes on Landis 1977:
Landis and Koch suggested labels for ranges of https://en.wikipedia.org/wiki/Cohen%27s_kappa values, describing 𝛋 = 0β0.20 as slight, 0.21β0.40 as fair, 0.41β0.60 as moderate, 0.61β0.80 as substantial, and 0.81β1 as almost perfect . These labels were just expert opinion, and are controversial, but have been widely cited and used ever since, because they are imprecise enough to be βgood enoughβ for many purposes.
original abstract β Abstracts here may not perfectly match originals, for a variety of technical and practical reasons. Some abstacts are truncated for my purposes here, if they are particularly long-winded and unhelpful. I occasionally add clarifying notes. And I make some minor corrections.
This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially involves the construction of functions of the observed proportions which are directed at the extent to which the observers agree among themselves and the construction of test statistics for hypotheses involving these functions. Tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interobserver agreement are developed as generalized kappa-type statistics. These procedures are illustrated with a clinical diagnosis example from the epidemiological literature.
This page is part of the PainScience BIBLIOGRAPHY, which contains plain language summaries of thousands of scientific papers & others sources. Itβs like a highly specialized blog. A few highlights:
- Relationships Between Sleep Quality and Pain-Related Factors for People with Chronic Low Back Pain: Tests of Reciprocal and Time of Day Effects. Gerhart 2017 Ann Behav Med.
- Modulation in the elastic properties of gastrocnemius muscle heads in individuals with plantar fasciitis and its relationship with pain. Zhou 2020 Sci Rep.
- Association Between Plantar Fasciitis and Isolated Gastrocnemius Tightness. Nakale 2018 Foot Ankle Int.
- No Added Benefit of Combining Dry Needling With Guideline-Based Physical Therapy When Managing Chronic Neck Pain: A Randomized Controlled Trial. Stieven 2020 J Orthop Sports Phys Ther.
- Effectiveness of customised foot orthoses for Achilles tendinopathy: a randomised controlled trial. Munteanu 2015 Br J Sports Med.