Spectrum bias explained

In biostatistics, spectrum bias refers to the phenomenon that the performance of a diagnostic test may vary in different clinical settings because each setting has a different mix of patients.^[1] Because the performance may be dependent on the mix of patients, performance at one clinic may not be predictive of performance at another clinic.^[2] These differences are interpreted as a kind of bias. Mathematically, the spectrum bias is a sampling bias and not a traditional statistical bias; this has led some authors to refer to the phenomenon as spectrum effects,^[3] whilst others maintain it is a bias if the true performance of the test differs from that which is 'expected'.^[2] Usually the performance of a diagnostic test is measured in terms of its sensitivity and specificity and it is changes in these that are considered when referring to spectrum bias. However, other performance measures such as the likelihood ratios may also be affected by spectrum bias.^[2]

Generally spectrum bias is considered to have three causes.^[2] The first is due to a change in the case-mix of those patients with the target disorder (disease) and this affects the sensitivity. The second is due to a change in the case-mix of those without the target disorder (disease-free) and this affects the specificity. The third is due to a change in the prevalence, and this affects both the sensitivity and specificity.^[4] This final cause is not widely appreciated, but there is mounting empirical evidence^[5] as well as theoretical arguments^[6] which suggest that it does indeed affect a test's performance.

Examples where the sensitivity and specificity change between different sub-groups of patients may be found with the carcinoembryonic antigen test^[7] and urinary dipstick tests.^[8]

Diagnostic test performances reported by some studies may be artificially overestimated if it is a case-control design where a healthy population ('fittest of the fit') is compared with a population with advanced disease ('sickest of the sick'); that is two extreme populations are compared, rather than typical healthy and diseased populations.^[9]

If properly analyzed, recognition of heterogeneity of subgroups can lead to insights about the test's performance in varying populations.

See also

• Simpson's paradox
• Biased sample
• Reporting bias
• Reference class problem

Notes and References

1. Ransohoff DF, Feinstein AR . Problems of spectrum and bias in evaluating the efficacy of diagnostic tests . N. Engl. J. Med. . 299 . 17 . 926–30 . 1978 . 692598 . 10.1056/NEJM197810262991705.
2. Willis BH . Spectrum biaswhy clinicians need to be cautious when applying diagnostic test studies . Family Practice . 2008 . 25. 18765409 . 10.1093/fampra/cmn051. 5 . 390–96. free .
3. Mulherin SA, Miller WC . Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation . Ann. Intern. Med. . 137 . 7 . 598–602 . 2002 . 12353947 . 10.7326/0003-4819-137-7-200210010-00011. 35752032 .
4. Willis . BH . Evidence that disease prevalence may affect the performance of diagnostic tests with an implicit threshold: a cross sectional study . . 2012 . 2 . 1 . e000746 . 22307105 . 10.1136/bmjopen-2011-000746 . 3274715.
5. Leeflang MM, Bossuyt PM, Irwig L., Diagnostic test accuracy may vary with prevalence: implications for evidence-based diagnosis, J Clin Epidemiol. 2009 Jan;62(1) 5–12.
6. Goehring C, Perrier A, Morabia A . Spectrum bias: a quantitative and graphical analysis of the variability of medical diagnostic test performance . Statistics in Medicine . 23 . 1 . 125–35 . 2004 . 14695644 . 10.1002/sim.1591. 24636826 .
7. Fletcher RH . Carcinoembryonic antigen . Ann. Intern. Med. . 104 . 1 . 66–73 . 1986 . 3510056 . 10.7326/0003-4819-104-1-66.
8. Lachs MS, Nachamkin I, Edelstein PH, Goldman J, Feinstein AR, Schwartz JS . Spectrum bias in the evaluation of diagnostic tests: lessons from the rapid dipstick test for urinary tract infection . Ann. Intern. Med. . 117 . 2 . 135–40 . 1992 . 1605428 . 10.7326/0003-4819-117-2-135. 25381473 .
9. Rutjes AWS, Reitsma JB, Vandenbroucke JP, Glas AS, Bossuyt PMM, Case-control and two-gate designs in diagnostic accuracy studies, Clin Chem 2005;51(8):1335–41.