Patient Health Questionnaire Explained

Patient Health Questionnaire
Synonyms:PHQ

The Patient Health Questionnaire (PHQ) is a multiple-choice self-report inventory that is used as a screening and diagnostic tool for mental health disorders of depression, anxiety, alcohol, eating, and somatoform disorders. It is the self-report version of the Primary Care Evaluation of Mental Disorders (PRIME-MD), a diagnostic tool developed in the mid-1990s by Pfizer Inc.[1] The length of the original assessment limited its feasibility; consequently, a shorter version, consisting of 11 multi-part questions - the Patient Health Questionnaire was developed and validated.[2]

In addition to the PHQ, a nine-item version to assess symptoms of depression, a seven-item version to assess symptoms of anxiety (GAD-7),[3] and a 15-item version to detect somatic symptoms (PHQ-15)[4] have been developed and validated. The PHQ-9, GAD-7, and the PHQ-15 were combined to create the PHQ-somatic, anxiety, depressive symptoms (PHQ-SADS) and includes questions regarding panic attacks (after the GAD-7 section). Though less commonly used, there are also brief versions of the PHQ-9 and GAD-7 that may be useful as screening tools in some settings. In recent years, the PHQ-9 has been validated for use in adolescents,[5] and a version for adolescents was also developed and validated (PHQ-A).[6] Although these tests were originally designed as self-report inventories they can also be administered by trained health care practitioners.[7]

The PHQ is available in over 20 languages, available on the PHQ website. Both the original Patient Health Questionnaire and later variants are public domain resources; no fees or permissions are required for using or copying the measures. Additionally, the measures have been validated in a number of different populations internationally.[8] [9]

Versions

The original Patient Health Questionnaire contains five modules; these contain questions about depressive, anxiety, somatoform, alcohol, and eating disorders. Designed for use in the primary care setting, it lacks coverage for disorders seen in psychiatric settings.[10] Some modules are used independently, and variants have been developed based on the original items.

9-item depression scale

See main article: PHQ-9. The PHQ-9 (DEP-9 in some sources[11]), a tool specific to depression, scores each of the 9 DSM-IV related criteria based on the mood module from the original PRIME-MD.[12] The PHQ-9 is both sensitive and specific in its diagnoses, which has led to its prominence in the primary care setting. This tool is used in a variety of different contexts, including clinical settings across the United States as well as research studies.

One study which used the PHQ-9, examined if college student displays of depression symptoms on Facebook were representative of offline symptoms. Results demonstrated that those who displayed depression symptoms on Facebook scored higher on the PHQ-9, suggesting that those who display depression symptoms on Facebook are experiencing them offline.[13]

2-item depression screener

Patient Health Questionnaire 2 item
Synonyms:PHQ-2

The Patient Health Questionnaire 2 item (PHQ-2) is an ultra-brief screening instrument containing the first two questions from the PHQ-9. Two screening questions to assess the presence of a depressed mood and a loss of interest or pleasure in routine activities, and a positive response to either question indicates further testing is required.[14] This version of the PHQ has been shown to have good diagnostic sensitivity but poor specificity.

4-item depression and anxiety screener

Patient Health Questionnaire 4 item
Synonyms:PHQ-4

The Patient Health Questionnaire 4 item (PHQ-4) combines the PHQ-2 with the Generalized Anxiety Disorder 2 (GAD-2), an ultra-brief anxiety screener containing the first two questions from the Generalized Anxiety Disorder 7 (GAD-7).

15-item somatic scale

Patient Health Questionnaire 15 item
Synonyms:PHQ-15, PHQ Somatic Symptom Scale

See also: Somatic Symptom Scale - 8. The Patient Health Questionnaire 15 item (PHQ-15) contains the PHQ's somatic symptom scale.[15] It is a well-validated measure, which asks whether symptoms are present and about their severity.[16] A brief version, the Somatic Symptom Scale - 8 was derived from PHQ-15. The development of the PHQ-15 helped address three main problems in the assessment and diagnosis of somatoform disorders. Firstly, traditional methods of diagnosing somatoform disorders would only capture about 20% of true cases due to the number of symptoms required to meet a diagnosis. Secondly, in order to attain more reliable and valid data, assessments need to address more current rather than previous symptoms. Thirdly, continuing to adhere to the "medically unexplained" requirement for symptoms makes it very difficult to make a diagnosis because it is extremely hard to ascertain if a symptom is or is not part of a larger medical condition (ex: chronic fatigue and depression).

7-item anxiety scale

See main article: Generalized Anxiety Disorder 7. The GAD-7 is a 7-item scale designed to assess symptoms of anxiety. Each item is scored on a 0-to-3 point scale ("not at all" to "nearly every day"). Cut points of 5, 10, and 15 correspond to mild, moderate, and severe anxiety.[17]

8-item depression scale

The PHQ-8 is an eight-item scale developed specifically to screen for depression in American epidemiological populations.[18]

Somatic, anxiety, and depressive symptoms

Patient Health Questionnaire - Somatic, Anxiety, and Depressive Symptoms
Synonyms:PHQ-SADS

The Patient Health Questionnaire - Somatic, Anxiety, and Depressive Symptoms (PHQ-SADS) screens for somatic, anxiety, and depressive symptoms using PHQ-9, GAD-7, and PHQ-15, plus the panic symptoms question from the original PHQ.[19] [20]

Adolescent scale

The PHQ-A is a four module self-report to evaluate depression, anxiety, substance use and eating disorders in adolescent primary care patients.

Reliability

MeasureCriterionRating* (adequate, good, excellent, too good)Explanation
PHQNormsExcellentMultiple convenience and random samples, as well as research studies in both clinical and nonclinical sample[21] [22]
Internal consistency (Cronbach's alpha, split half, etc.)GoodCronbach's alpha reported at .88 for measuring depression
Inter-rater reliabilityGoodKappas range from .64-.81 for depression.[23] Kappa for anxiety is .83
Test-retest reliability (stability)No published studies formally checking test-retest reliability
RepeatabilityNo published studies formally checking repeatability
PHQ-9NormsExcellentMultiple convenience and random samples, as well as research studies in both clinical and nonclinical samples.[24] [25]
Internal consistency (Cronbach's alpha, split half, etc.)GoodCronbach's alphas range from .83 to .89[26]
Inter-rater reliabilityGoodOne study in Nigerian university students with found ranges between .83 and .92[27]
Test-retest reliability (stability)AdequateCorrelation between administrations done within 48 hours was .84.
RepeatabilityNot publishedNo published studies formally checking repeatability.
GAD-7NormsExcellentMultiple convenience and random samples, as well as research studies in both clinical and nonclinical samples
Internal consistency (Cronbach's alpha, split half, etc.)GoodCronbach's alpha reported at .92
Inter-rater reliabilityGoodThe interviewer vs. self-rated correlation ranges from .83 and .84
Test-retest reliability (stabilityGoodReported as .83
RepeatabilityNot publishedNo published studies formally checking repeatability
PHQ-15NormsExcellentTwo large studies with convenience and random samples used. One research studies (N=906) in clinical sample and one research study (N=6000) in nonclinical sample.
Internal consistency (Cronbach's alpha, split half, etc.)GoodCronbach's alpha reported at .80
Inter-rater reliabilityNo published studies formally checking inter-rater reliability
Test-retest reliability (stability)GoodKappa = .60 when administration was done within 2 weeks of first test[28]
RepeatabilityNo published studies formally checking repeatability.

Validity

MeasureCriterionRating* (adequate, good, excellent, too good*)Explanation with references
PHQContent validityGoodCovers DSM-IV criteria for major depressive disorder, panic disorder, other anxiety disorder, bulimia nervosa, other depressive disorder, probable alcohol abuse or dependence, and somatoform and binge eating disorders
Construct validity (e.g., predictive, concurrent, convergent, and discriminant validity)AdequateConstruct validity has not been fully established, and more substantial evidence of convergent and discriminant validity would be helpful.[29] Validity is consistent with PRIME-MD.
Discriminative validityExcellentAUCs range from .89 to .92 for detecting depression
Validity generalizationNo published studies formally checking validity generalization.
Treatment sensitivityNo published studies formally checking treatment sensitivity.
Clinical utilityGoodThe PHQ is free and can be completed independently by the patient; it assesses a wide array of mental health concerns.
PHQ-9Content validityExcellentCovers the DSM-IV criteria for major depressive disorder.
Construct validity (e.g., predictive, concurrent, convergent, and discriminant validity)GoodHigher PHQ-9 scores were correlated with greater self-reported disability days, clinic visits, health-care utilization, as well as difficulties in activities and relationships.
Discriminative validityToo excellentAn average sensitivity of .77 and specificity of .94 (corresponding to an AUC .94) in primary care settings suggests good discriminative validity in populations that are generally not depressed, but it may not perform as well in clinical populations.
Validity generalizationVariableA meta-analysis of 27 samples suggested that performance of the PHQ-9 is highly heterogeneous; pooled sensitivity is low and specificity is high.
Treatment sensitivityGoodIn a treatment study using three medical outpatient cohorts, the PHQ-9 has been shown to be sensitive to change over time[30]

The PHQ-9 has been used in studies to effectively monitor change following cognitive behavioral treatment.[31]

A meta analysis stated that the PHQ-9 had good treatment sensitivity.

Clinical utilityGoodThe PHQ-9 is brief, free to use, and easy to score. It has good specificity, but the poor sensitivity could lead to false negatives, which is a problem for a screening tool. It is likely to perform best in samples where the prevalence of depressive disorders is high. To improve clinical utility, meta-analyses suggest increasing cut score to 10 or higher to improve sensitivity.
GAD-7Content validityGoodCovers seven of the core symptoms for generalized anxiety disorder.[32]
Construct validity (e.g., predictive, concurrent, convergent, and discriminant validity)GoodScores correlate with the Beck Anxiety Inventory (r= .72) and the anxiety subscale of the SCL-90 (r=.74).
Discriminative validityToo excellentAUC for detecting generalized anxiety disorder was .91, for panic disorder AUC= .85 for panic disorder, AUC=.83 for social anxiety disorder, and AUC=.83 for PTSD.
Validity generalizationGoodValidity has been established across multiple populations.[33] [34]
Treatment sensitivityGoodThe GAD-7 showed good sensitivity to treatment effects in two randomized-controlled trials.[35]
Clinical utilityExcellentThe GAD-7 is brief, free to use, and easy to score. It is sensitive to change following treatment. There is some evidence that elderly people may require some help to complete the scale accurately.
PHQ-15Content validityGoodScores correspond well to DSM-IV somatoform diagnoses from the SCID and General Health Questionnaire-15.[36]
Construct validity (e.g., predictive, concurrent, convergent, and discriminant validity)AdequatePHQ-15 scores correlated with medically unexplained symptom counts (r=.52) measured via an independent psychiatric review and with the General Health Questionnaire-15.
Discriminative validityExcellentSensitivity was 78% and specificity was 71% for a DSM-IV diagnosis of somatoform disorder, corresponding to an AUC of .76.
Validity generalizationAlthough the PHQ-15 is currently being used in major studies in several European countries and Australia. there is evidence that it does not perform as well in Hispanic populations.[37]
Treatment sensitivityUnknownMeta-analysis states that the treatment sensitivity for the PHQ-15 has not been researched much, but there is some support that the PHQ-15 is sensitive to treatment.
Clinical utilityGoodThe PHQ-15 is easy to use, free, and has a high discriminant and convergent validity, it has also been validated in many different clinical populations.

Limitations

All versions of the PHQ are self reports and, consequently, are subject to inherent biases, including social desirability[38] and poor retrospective recall.[39]

The influence of these biases can mitigated by following up with a structured or semi-structured interview, the gold standard for diagnostic assessment.[40]

The time period assessed by each scale could also be a limitation; the PHQ-9 asks about the last four weeks, whereas the GAD-7 focuses on the past two weeks, and the PHQ asks about various time periods from the last two weeks to the last six months. Depending on the time period in question, this may or may not require a revision (i.e., if you are interested in depression over the last six months, you might alter the instructions), which could impact the validity of the measure.

The scoring thresholds recommended are influenced by the samples in which they were validated and correspond with different levels of sensitivity and specificity,[41] which may or may not match well with the intended use of the scale.

See also

References

External links

Notes and References

  1. Robert Spitzer (psychiatrist) . Spitzer . Robert L. . Kroenke . Kurt. Janet B. W. Williams . Williams . Janet B.W. . Patient Health Questionnaire Primary Care Study Group . 3 . vanc . 10 November 1999 . Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study . . 282 . 18 . 1737–44 . 10568646 . 10.1001/jama.282.18.1737 . free .
  2. Kroenke. Kurt. Spitzer. Robert L.. Williams. Janet B. W.. Löwe. Bernd. 2010-07-01. The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: a systematic review. General Hospital Psychiatry. 32. 4. 345–359. 10.1016/j.genhosppsych.2010.03.006. 1873-7714. 20633738. 34713999 .
  3. Kroenke. Kurt. Spitzer. Robert L. Williams. Janet B W. 2017-05-31. The PHQ-9. Journal of General Internal Medicine. 16. 9. 606–613. 10.1046/j.1525-1497.2001.016009606.x. 0884-8734. 1495268. 11556941.
  4. Kroenke. Kurt. Spitzer. Robert L.. Williams. Janet B. W.. Löwe. Bernd. 2010-07-01. The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: a systematic review. General Hospital Psychiatry. en. 32. 4. 345–359. 10.1016/j.genhosppsych.2010.03.006. 20633738. 34713999 . 0163-8343.
  5. Allgaier. Antje-Kathrin. Pietsch. Kathrin. Frühe. Barbara. Sigl-Glöckner. Johanna. Schulte-Körne. Gerd. 2012-10-01. Screening for Depression in Adolescents: Validity of the Patient Health Questionnaire in Pediatric Care. Depression and Anxiety. en. 29. 10. 906–913. 10.1002/da.21971. 22753313. 40022177 . 1520-6394. free.
  6. Johnson. Jeffery. Harris. Spitzer. Williams. March 2002. The patient health questionnaire for adolescents. Journal of Adolescent Health. 30. 3. 196–204. 10.1016/s1054-139x(01)00333-0. 11869927.
  7. Arroll . Bruce . Goodyear-Smith . Felicity . Crengle . Susan . Gunn . Jane . Kerse . Ngaire . Fishman . Tana . Falloon . Karen . Hatcher . Simon . vanc . Validation of PHQ-2 and PHQ-9 to screen for major depression in the primary care population . Annals of Family Medicine . July 2010 . 8 . 4 . 348–53 . 10.1370/afm.1139 . free . 20644190 . 2906530 .
  8. Tsai. Fang-Ju. Huang. Yu-Hsin. Liu. Hui-Ching. Huang. Kuo-Yang. Huang. Yen-Hsun. Liu. Shen-Ing. 2014-02-01. Patient Health Questionnaire for School-Based Depression Screening Among Chinese Adolescents. Pediatrics. en. 133. 2. e402–e409. 10.1542/peds.2013-0204. 0031-4005. 24446447. 7039662 .
  9. Chen. Teddy M.. Huang. Frederick Y.. Chang. Christine. Chung. Henry. 2006-07-01. Using the PHQ-9 for Depression Screening and Treatment Monitoring for Chinese Americans in Primary Care. Psychiatric Services. 57. 7. 976–981. 10.1176/ps.2006.57.7.976. 16816282. 1075-2730.
  10. Book: Blacker, D. . vanc . Psychiatric Rating Scales . Sadock . Benjamin J. . Sadock . Virginia A. . Ruiz . Pedro . Kaplan & Sadock's Comprehensive Textbook of Psychiatry . 9th . 2009 . 1042 . 978-0-7817-6899-3 .
  11. Book: Luigi Grassi. Michelle Riba. Clinical Psycho-Oncology: An International Perspective. 18 May 2012. John Wiley & Sons. 978-1-119-94109-5. 23–.
  12. Kroenke . Kurt . Spitzer . Robert L. . Williams . Janet B.W. . vanc . September 2001 . The PHQ-9: Validity of a brief depression severity measure . . 16 . 9 . 606–613 . 11556941 . 1495268 . 10.1046/j.1525-1497.2001.016009606.x .
  13. Moreno. Megan Andreas . Christakis. Dimitri A. . Egan. Katie G. . Jelenchick. Lauren A. . Cox. Elizabeth . Young. Henry . Villiard. Hope . Becker. Tara . vanc . A pilot evaluation of associations between displayed depression references on Facebook and self-reported depression using a clinical scale. Journal of Behavioral Health Services & Research. July 2012 . 39 . 3 . 295–304 . 10.1007/s11414-011-9258-7 . 21863354 . 3266445 .
  14. Whooley . Mary A. . Avins . Andrew L. . Miranda . Jeanne . Browner . Warren S. . vanc . Case-finding instruments for depression: Two questions are as good as many . Journal of General Internal Medicine . 12 . 7 . 439–45 . July 1997 . 9229283 . 1497134 . 10.1046/j.1525-1497.1997.00076.x .
  15. Kroenke . K . Spitzer . RL . Williams . JB . March 2002 . The PHQ-15: validity of a new measure for evaluating the severity of somatic symptoms . Psychosomatic Medicine . 64 . 2 . 258–66 . 11914441 . 10.1097/00006842-200203000-00008. 28701848 .
  16. Gierk . B . Kohlmann . S . Kroenke . K . Spangenberg . L . Zenger . M . Brähler . E . Löwe . B . March 2014 . The Somatic Symptom Scale–8 (SSS-8): A Brief Measure of Somatic Symptom Burden . JAMA Internal Medicine . 174 . 3 . 399–407 . 24276929 . 10.1001/jamainternmed.2013.12179 . free .
  17. Spitzer. Robert L.. Kroenke. Kurt. Williams. Janet B. W.. Löwe. Bernd. 2006-05-22. A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7. Archives of Internal Medicine. 166. 10. 1092–1097. 10.1001/archinte.166.10.1092. 16717171. 0003-9926. free.
  18. Kroenke. Kurt. Strine. Tara W.. Spitzer. Robert L.. Williams. Janet B. W.. Berry. Joyce T.. Mokdad. Ali H.. 2009-04-01. The PHQ-8 as a measure of current depression in the general population. Journal of Affective Disorders. 114. 1–3. 163–173. 10.1016/j.jad.2008.06.026. 1573-2517. 18752852. 3568107 .
  19. Web site: 16 April 2014. Instructions for Patient Health Questionnaire (PHQ) and GAD-7 Measures. Patient Health Questionnaire (PHQ) Screeners. Pfizer.
  20. Kroenke . K . Spitzer . RL . Williams . JB . Löwe . B . July 2010 . The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: A systematic review . General Hospital Psychiatry . 32 . 4 . 345–59 . 20633738 . 10.1016/j.genhosppsych.2010.03.006 . 34713999 .
  21. Löwe. Burnd. Spitzer. Gräfe. Kroenke. Quenter. Zipfel. Buchholz. Witte. Herzog. February 2004. Comparative validity of three screening questionnaires for DSM-IV depressive disorders and physicians' diagnoses. Journal of Affective Disorders. 78. 2. 131–140. 10.1016/s0165-0327(02)00237-9. 14706723.
  22. Löwe. Bernd. Gräfe. Kerstin. Zipfel. Stephan. Witte. Steffen. Loerch. Bernd. Herzog. Wolfgang. Diagnosing ICD-10 Depressive Episodes: Superior Criterion Validity of the Patient Health Questionnaire. Psychotherapy and Psychosomatics. 73. 6. 386–390. 10.1159/000080393. 15479995. 2004. 22830312 .
  23. Persoons. Phillippe. Luyckx. Koen. Desloovere. Christian. Vandenberghe. Joris. Fischler. Benjamin. 2003-09-01. Anxiety and mood disorders in otorhinolaryngology outpatients presenting with dizziness: validation of the self-administered PRIME-MD Patient Health Questionnaire and epidemiology. General Hospital Psychiatry. en. 25. 5. 316–323. 10.1016/s0163-8343(03)00072-0. 12972222. 0163-8343.
  24. Wittkampf. Karin A.. Naeije. Leonie. Schene. Aart H.. Huyser. Jochanan. van Weert. Henk C.. 2007-09-01. Diagnostic accuracy of the mood module of the Patient Health Questionnaire: a systematic review. General Hospital Psychiatry. 29. 5. 388–395. 10.1016/j.genhosppsych.2007.06.004. 0163-8343. 17888804.
  25. Manea. Laura. Gilbody. Simon. McMillan. Dean. 2015-01-01. A diagnostic meta-analysis of the Patient Health Questionnaire-9 (PHQ-9) algorithm scoring method as a screen for depression. General Hospital Psychiatry. 37. 1. 67–75. 10.1016/j.genhosppsych.2014.09.009. 1873-7714. 25439733.
  26. Cameron. Isobel M. Crawford. John R. Lawton. Kenneth. Reid. Ian C. 2008-01-01. Psychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care. The British Journal of General Practice. 58. 546. 32–36. 10.3399/bjgp08X263794. 0960-1643. 2148236. 18186994.
  27. Adewuya. Abiodun O.. Ola. Bola A.. Afolabi. Olusegun O.. 2006-11-01. Validity of the patient health questionnaire (PHQ-9) as a screening tool for depression amongst Nigerian university students. Journal of Affective Disorders. 96. 1–2. 89–93. 10.1016/j.jad.2006.05.021. 0165-0327. 16857265.
  28. van Ravesteijn. Hiske. Wittkampf. Karin. Lucassen. Peter. van de Lisdonk. Eloy. van den Hoogen. Henk. van Weert. Henk. Huijser. Jochanan. Schene. Aart. van Weel. Chris. 2009-05-01. Detecting somatoform disorders in primary care with the PHQ-15. Annals of Family Medicine. 7. 3. 232–238. 10.1370/afm.985. 1544-1717. 2682971. 19433840.
  29. Schat. Aaron C. H.. Kelloway. E. Kevin. Desmarais. Serge. The Physical Health Questionnaire (PHQ): Construct Validation of a Self-Report Scale of Somatic Symptoms.. Journal of Occupational Health Psychology. 10. 4. 363–381. 10.1037/1076-8998.10.4.363. 16248686. 2005.
  30. Löwe. Bernd. Kroenke. Kurt. Herzog. Wolfgang. Gräfe. Kerstin. 2004-07-01. Measuring depression outcome with a brief self-report instrument: sensitivity to change of the Patient Health Questionnaire (PHQ-9). Journal of Affective Disorders. 81. 1. 61–66. 10.1016/S0165-0327(03)00198-8. 0165-0327. 15183601.
  31. General Hospital Psychiatry. 37. 5. 470–475. Cut points on the Patient Health Questionnaire (PHQ-9) that predict response to cognitive-behavioral treatments for depression. 10.1016/j.genhosppsych.2015.05.009. 26077754. 4558333. 2015. Schueller. Stephen M.. Kwasny. Mary J.. Dear. Blake F.. Titov. Nickolai. Mohr. David C..
  32. Spitzer. Robert L.. Kroenke. Kurt. Williams. Janet B. W.. Löwe. Bernd. 2006-05-22. A brief measure for assessing generalized anxiety disorder: the GAD-7. Archives of Internal Medicine. 166. 10. 1092–1097. 10.1001/archinte.166.10.1092. 0003-9926. 16717171. free.
  33. García-Campayo. Javier. Zamorano. Enric. Ruiz. Miguel A.. Pardo. Antonio. Pérez-Páramo. María. López-Gómez. Vanessa. Freire. Olga. Rejas. Javier. 2010. Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health and Quality of Life Outcomes. 8. 8. 10.1186/1477-7525-8-8. 1477-7525. 2831043. 20089179 . free .
  34. Löwe. Bernd. Decker. Oliver. Müller. Stefanie. Brähler. Elmar. Schellberg. Dieter. Herzog. Wolfgang. Herzberg. Philipp Yorck. 2008-03-01. Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Medical Care. 46. 3. 266–274. 10.1097/MLR.0b013e318160d093. 0025-7079. 18388841. 16052239 .
  35. Dear. Blake F.. Titov. Nickolai. Sunderland. Matthew. McMillan. Dean. Anderson. Tracy. Lorian. Carolyn. Robinson. Emma. 2011-09-01. Psychometric Comparison of the Generalized Anxiety Disorder Scale-7 and the Penn State Worry Questionnaire for Measuring Response during Treatment of Generalised Anxiety Disorder. Cognitive Behaviour Therapy. 40. 3. 216–227. 10.1080/16506073.2011.582138. 1650-6073. 21770844. 25918813 .
  36. Han. Changsu. Pae. Chi-Un. Patkar. Ashwin A.. Masand. Prakash S.. Kim. Ki Woong. Joe. Sook-Haeng. Jung. In-Kwa. Psychometric Properties of the Patient Health Questionnaire–15 (PHQ–15) for Measuring the Somatic Symptoms of Psychiatric Outpatients. Psychosomatics. 50. 6. 580–585. 10.1016/s0033-3182(09)70859-x. 2009. 19996228 .
  37. Interian. Alejandro. Allen. Lesley A.. Gara. Michael A.. Escobar. Javier I.. Díaz-Martínez. Angélica M.. Somatic Complaints in Primary Care: Further Examining the Validity of the Patient Health Questionnaire (PHQ-15). Psychosomatics. 47. 5. 392–398. 10.1176/appi.psy.47.5.392. 16959927. 2006. free.
  38. Hunt. Melissa. Auriemma. Joseph. Cashaw. Ashara C. A.. 2003-02-01. Self-Report Bias and Underreporting of Depression on the BDI-II. Journal of Personality Assessment. 80. 1. 26–30. 10.1207/S15327752JPA8001_10. 0022-3891. 12584064. 22024156 .
  39. Ph.D. Dror Ben-Zeev. Young. Michael A.. Madsen. Joshua W.. 2009-08-01. Retrospective recall of affect in clinically depressed individuals and controls. Cognition and Emotion. 23. 5. 1021–1040. 10.1080/02699930802607937. 144033759 . 0269-9931.
  40. Rettew. David C.. Lynch. Alicia Doyle. Achenbach. Thomas M.. Dumenci. Levent. Ivanova. Masha Y.. 2009-09-01. Meta-analyses of agreement between diagnoses made from clinical evaluations and standardized diagnostic interviews. International Journal of Methods in Psychiatric Research. en. 18. 3. 169–184. 10.1002/mpr.289. 19701924. 6878243. 1557-0657.
  41. Youngstrom. Eric A.. 2014-03-01. A Primer on Receiver Operating Characteristic Analysis and Diagnostic Efficiency Statistics for Pediatric Psychology: We Are Ready to ROC. Journal of Pediatric Psychology. 39. 2. 204–221. 10.1093/jpepsy/jst062. 0146-8693. 3936258. 23965298.