Published on in Vol 11, No 9 (2022): September

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/37854, first published .
Psychometric Properties of the Hospital Anxiety and Depression Scale in Individuals With Chronic Obstructive Pulmonary Disease: Protocol for a Systematic Review

Psychometric Properties of the Hospital Anxiety and Depression Scale in Individuals With Chronic Obstructive Pulmonary Disease: Protocol for a Systematic Review

Psychometric Properties of the Hospital Anxiety and Depression Scale in Individuals With Chronic Obstructive Pulmonary Disease: Protocol for a Systematic Review

Protocol

1School of Rehabilitation Science, McMaster University, Hamilton, ON, Canada

2West Park Healthcare Centre, Toronto, ON, Canada

3Lab 3R Respiratory Research and Rehabilitation Laboratory, School of Health Sciences, University of Aveiro, Aveiro, Portugal

4Department of Physical Therapy and Rehabilitation Science, University of Toronto, Toronto, ON, Canada

Corresponding Author:

Sanaa Alsubheen, PhD

School of Rehabilitation Science

McMaster University

1280 Main St W,

Hamilton, ON, L8S 4L8

Canada

Phone: 1 519 878 9647

Email: alsubhes@mcmaster.ca


Background: In individuals with chronic obstructive pulmonary disease (COPD), anxiety and depression contribute to increased mortality and exacerbations, decreased physical functioning, and deteriorated health-related quality of life. The Hospital Anxiety and Depression Scale (HADS) is a patient-reported tool developed to measure symptoms of anxiety and depression in clinical settings. The HADS has been frequently used with individuals with COPD; however, its measurement properties lack critical appraisal in this population.

Objective: This review aims to summarize and critically appraise the validity, reliability, and responsiveness of the HADS in individuals with COPD.

Methods: Five electronic databases (MEDLINE, Embase, Scopus, PsychINFO, and Web of Science) will be systematically searched. Articles will be included if they assessed the measurement properties of the HADS in COPD; were published in a peer-reviewed journal; and were written in English. The COSMIN (Consensus-based Standards for the Selection of Health Measurement Instruments) guidelines will be used to assess the methodological quality and level of evidence in the selected studies.

Results: To date, 12 articles met the inclusion criteria and will be included in the systematic review. The results of the psychometric properties of HADS will be qualitatively summarized and compared against the criteria for good measurement properties. The overall quality of evidence will be graded using the modified Grading of Recommendations, Assessment, Development and Evaluation approach. We expect to complete the systematic review by December 2022.

Conclusions: This systematic review will be the first to evaluate the psychometric properties of the HADS in individuals with COPD. Given the negative impact of anxiety and depression on physical functioning and health-related quality of life, this systematic review provides an opportunity to use the HADS as a validated measurement tool for the assessment and treatment of anxiety and depression in individuals with COPD.

Trial Registration: PROSPERO CRD42022302064; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=302064

International Registered Report Identifier (IRRID): PRR1-10.2196/37854

JMIR Res Protoc 2022;11(9):e37854

doi:10.2196/37854

Keywords



Chronic obstructive pulmonary disease (COPD) is a common treatable but incurable lung disease that is characterized by persistent airflow limitation due to the significant exposure to noxious particles or gases resulting in a chronic inflammatory airway response [1]. COPD is strongly linked to a history of smoking and is associated with advanced age [2]. Globally, the World Health Organization estimates that COPD will be the third-leading cause of death in the world by 2030 [3].

Anxiety and depression are two of the most common and least treated comorbidities in individuals with COPD [4] with an estimated prevalence of 10% to 86% [4,5]. In general medical patients, anxiety disorders involve excessive feelings of fear, tension, and worry; changes in behavior such as avoidance or panic attacks; and physical manifestations such as tachycardia and hyperhidrosis [6]. Depressive disorders include emotions of sadness, loss of energy, anhedonia, and feelings of hopelessness, and can cause cognitive and somatic symptoms such as decreased appetite, fatigue, trouble sleeping, and difficulty concentrating [7].

Women and older adults (aged >65 years) with COPD are at an increased risk of developing both anxiety and depression [8,9]. Furthermore, individuals with COPD are 85% more likely to develop anxiety disorders than their healthy age-sex matched controls [10] and patients with other chronic diseases [11]. Anxiety is also reported to cause dyspnea at earlier stages of COPD [12,13], and both disorders are associated with decreased physical functioning and deteriorated health-related quality of life [14,15]. The assessment and timely interventions for these symptoms is essential, as anxiety and depression are associated with increased mortality, COPD exacerbations, hospitalizations [16,17], and medical costs [18].

The Hospital Anxiety and Depression Scale (HADS) is a self-assessment tool developed to measure symptoms of anxiety and depression in clinical settings [19], and is used for individuals with COPD [20,21]. The scale consists of 14 items, with seven items assessing anxiety and seven items assessing depression. Items are rated on a 4-point Likert scale: zero (not present) to 3 (severe symptoms). Scores range from 0 to 21 for each subscale and can be summed to give a total anxiety-depression score with a maximum of 42 points. Higher scores indicate an increasing severity of symptoms, with a cutoff score of 8 indicating high symptoms of depression and anxiety [22].

Several systematic reviews examined the criterion validity of the HADS and reported a wide range of specificity (54%-95%) and sensitivity (44%-100%) values of the HADS in patients with mental disorders [23], impaired physical health [24], cancer [25], cardiac disease [26], multiple sclerosis [27], and COPD [28]. However, the methodological quality and level of evidence for criterion validity [28] and other measurement properties has not been evaluated and critically appraised for individuals with COPD.

We aim to evaluate and critically appraise the validity, reliability, and responsiveness of the HADS in individuals with COPD. Such an evaluation will provide robust measurement information for clinicians and researchers involved in respiratory care and guide the clinical assessment and management of anxiety and depression in individuals with COPD.


The systematic review will be conducted according to the COSMIN (Consensus-based Standards for the Selection of Health Measurement Instruments) guidelines for systematic reviews [29], and the results will be reported following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines [30]. The protocol registration number on PROSPERO is CRD42022302064.

Eligibility Criteria

Studies will be included if they assessed the psychometric properties (reliability, validity, responsiveness) of the HADS in adults 18 years and older who are diagnosed with COPD, are published in a peer-reviewed journal, and are written in the English language.

Studies will be excluded if they used the HADS as an outcome measure in an interventional study and did not assess its psychometric properties; included people younger than 18 years; assessed the psychometric properties of the HADS in patients with chronic disease other than COPD; included individuals with COPD during/immediately after acute exacerbations (within 4 weeks); and are systematic reviews, conference publications, abstracts, posters, editorials, and commentaries of the HADS.

Search Methods for Identification of Studies

Two authors (AD and SQ) will independently conduct a systematic electronic search in five digital databases (MEDLINE, Embase, Scopus, PsychINFO, and Web of Science) from inception until March 2022 using the following keywords: reliability OR validity OR responsiveness OR psychometric properties OR measurement properties AND Hospital Anxiety and Depression Scale OR HADS AND Chronic Obstructive Pulmonary Disease OR COPD. In addition, the reference list of the selected studies will be manually searched to identify further relevant articles. Endnote (Clarivate) will be used to remove duplicates, and nonduplicated articles will be uploaded to Covidence for screening. An example of the search strategy in MEDLINE is reported in Multimedia Appendix 1.

Study Selection

Two authors (AD and EK) will independently perform screening of the titles and abstracts of the identified studies. Articles that appear to meet inclusion criteria will be included at this stage. These articles will be retrieved with full text and will be screened independently by two reviewers. Disagreements between the two authors will be resolved by discussion with a senior research team member. An example of the PRISMA flow diagram showing the proposed study selection process for the HADS is presented in Figure 1.

Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram showing the proposed study selection process for the Hospital Anxiety and Depression Scale.
View this figure

Data Extraction

Two authors (AN and EK) will independently carry out data extraction. The data extracted from individual studies will include the last name of the first author, year of publication, country, original language and available translations, study design, number of participants, age and sex of participants, and COPD severity. The HADS score and its psychometric properties including content, construct, criterion validity, reliability (internal consistency and measurement error), and responsiveness will also be extracted in accordance with COSMIN guidelines [29]. After completion, all data will be cross reviewed by the senior author for accuracy and completeness.

Methodological Quality

Two authors will independently evaluate the methodological quality of each selected study on psychometric properties using the COSMIN Risk of Bias checklist [29]. The results of the psychometric properties will be qualitatively summarized for all psychometric properties and compared against the criteria for good measurement properties to rate the overall summary result of the scale as sufficient (+), insufficient (–), indeterminate (?), or inconsistent (±). A meta-analysis will be performed for the intraclass correlation coefficients if we find enough studies assessing test-retest reliability of the HADS in COPD. The overall quality of evidence will be graded as high, moderate, low, or very low using the modified Grading of Recommendations, Assessment, Development and Evaluation approach [29].

Hypothesis Testing for Construct and Criterion Validity and Responsiveness

To interpret the results of hypothesis testing and assess the quality of evidence for construct and criterion validity and responsiveness, the review team will formulate a set of hypotheses about the expected relationships (direction and magnitude) of the HADS and other instruments and variables based on COSMIN recommendations [29]. These hypotheses will be based on the literature and the clinical experiences of the review team. The review team expect strong correlations (r≥0.50) between the HADS and anxiety and depression scales (similar construct), moderate correlations (0.30≤r<0.50) with related constructs such as positive affect, and weak or no correlations (r<0.30) for unrelated constructs such as demographics. An example of the expected hypotheses is summarized in Multimedia Appendix 2.


Five systematic databases will be searched for articles investigating the psychometric properties of the HADS. Currently, 12 articles met the inclusion criteria and are included in the systematic review. The results of the psychometric properties of the HADS will be qualitatively summarized and compared against the criteria for good measurement properties. The methodological quality of each selected study will be evaluated using the COSMIN Risk of Bias checklist [29]. The overall quality of evidence will be graded as high, moderate, low, or very low. We expect to complete the systematic review by December 2022.


Anxiety and depression can negatively impact physical functioning, health-related quality of life, and adherence to pulmonary rehabilitation programs in individuals with COPD. This systematic review provides an opportunity to use the HADS as a validated measurement tool for the assessment and treatment of anxiety and depression in individuals with COPD in the clinical setting. This systematic review presents several strengths and limitations. It will be the first systematic review to evaluate and critically appraise the psychometric properties of the HADS in individuals with COPD. Additionally, a comprehensive literature search across five databases will be conducted. The limitations of this review include the possibility of excluding articles written in languages other than English and examining other chronic respiratory disorders.

Acknowledgments

DB holds the National Sanitarium Association Chair in Respiratory Rehabilitation Research. SA is supported by the E.B. Eastburn Postdoctoral Fellowship. This proposal was completed as partial credit for course work at McMaster University toward a Master of Physiotherapy credential.

Conflicts of Interest

None declared.

Multimedia Appendix 1

MEDLINE search strategy.

DOCX File , 15 KB

Multimedia Appendix 2

Hypothesis testing for criterion and construct validity and responsiveness.

DOCX File , 15 KB

  1. Stuttgart GTVKG. GOLD (Global Initiative for Chronic Obstructive Lung Disease). Pneumologie 2017;71(1):9-14.
  2. Anton A, Ratarasarn K. Pulmonary function testing and role of pulmonary rehabilitation in the elderly population with pulmonary diseases. Curr Geri Rep 2016 Apr 1;5(2):117-123. [CrossRef]
  3. The top 10 causes of death. World Health Organization. 2018.   URL: https://www.who.int/news-room/fact-sheets/detail/the-top-10-causes-of-death [accessed 2022-03-21]
  4. Maurer J, Rebbapragada V, Borson S, Goldstein R, Kunik M, Yohannes A, ACCP Workshop Panel on Anxiety and Depression in COPD. Anxiety and depression in COPD: current understanding, unanswered questions, and research needs. Chest 2008 Oct;134(4 Suppl):43S-56S [FREE Full text] [CrossRef] [Medline]
  5. Kunik M, Roundy K, Veazey C, Souchek J, Richardson P, Wray N, et al. Surprisingly high prevalence of anxiety and depression in chronic breathing disorders. Chest 2005 Apr;127(4):1205-1211. [CrossRef] [Medline]
  6. What are anxiety disorders? American Psychiatric Association. 2022.   URL: https://www.psychiatry.org/patients-families/anxiety-disorders/what-are-anxiety-disorders [accessed 2022-03-17]
  7. What is depression? American Psychiatric Association. 2022.   URL: https://www.psychiatry.org/patients-families/depression/what-is-depression [accessed 2022-03-17]
  8. Gut-Gobert C, Cavaillès A, Dixmier A, Guillot S, Jouneau S, Leroyer C, et al. Women and COPD: do we need more evidence? Eur Respir Rev 2019 Mar 31;28(151):180055 [FREE Full text] [CrossRef] [Medline]
  9. Gelberg J, McIvor R. Overcoming gaps in the management of chronic obstructive pulmonary disease in older patients: new insights. Drugs Aging 2010 May;27(5):367-375. [CrossRef] [Medline]
  10. Eisner M, Blanc P, Yelin E, Katz P, Sanchez G, Iribarren C, et al. Influence of anxiety on health outcomes in COPD. Thorax 2010 Mar;65(3):229-234 [FREE Full text] [CrossRef] [Medline]
  11. Solano J, Gomes B, Higginson I. A comparison of symptom prevalence in far advanced cancer, AIDS, heart disease, chronic obstructive pulmonary disease and renal disease. J Pain Symptom Manage 2006 Jan;31(1):58-69 [FREE Full text] [CrossRef] [Medline]
  12. Spitzer C, Gläser S, Grabe H, Ewert R, Barnow S, Felix S, et al. Mental health problems, obstructive lung disease and lung function: findings from the general population. J Psychosom Res 2011 Sep;71(3):174-179. [CrossRef] [Medline]
  13. Regvat J, Žmitek A, Vegnuti M, Košnik M, Šuškovič S. Anxiety and depression during hospital treatment of exacerbation of chronic obstructive pulmonary disease. J Int Med Res 2011;39(3):1028-1038 [FREE Full text] [CrossRef] [Medline]
  14. Light R, Merrill E, Despars J, Gordon G, Mutalipassi L. Prevalence of depression and anxiety in patients with COPD. Relationship to functional capacity. Chest 1985 Jan;87(1):35-38. [CrossRef] [Medline]
  15. Felker B, Katon W, Hedrick S, Rasmussen J, McKnight K, McDonnell M, et al. The association between depressive symptoms and health status in patients with chronic pulmonary disease. Gen Hosp Psychiatry 2001;23(2):56-61. [CrossRef] [Medline]
  16. Laforest L, Roche N, Devouassoux G, Belhassen M, Chouaid C, Ginoux M, et al. Frequency of comorbidities in chronic obstructive pulmonary disease, and impact on all-cause mortality: a population-based cohort study. Respir Med 2016 Aug;117:33-39 [FREE Full text] [CrossRef] [Medline]
  17. Xu W, Collet J, Shapiro S, Lin Y, Yang T, Platt R, et al. Independent effect of depression and anxiety on chronic obstructive pulmonary disease exacerbations and hospitalizations. Am J Respir Crit Care Med 2008 Nov 01;178(9):913-920. [CrossRef] [Medline]
  18. Dalal A, Shah M, Lunacsek O, Hanania N. Clinical and economic burden of depression/anxiety in chronic obstructive pulmonary disease patients within a managed care population. COPD 2011 Aug;8(4):293-299. [CrossRef] [Medline]
  19. Zigmond A, Snaith R. The hospital anxiety and depression scale. Acta Psychiatr Scand 1983 Jun;67(6):361-370. [CrossRef] [Medline]
  20. Nowak C, Sievi N, Clarenbach C, Schwarz E, Schlatzer C, Brack T, et al. Accuracy of the Hospital Anxiety and Depression Scale for identifying depression in chronic obstructive pulmonary disease patients. Pulm Med 2014;2014:973858. [CrossRef] [Medline]
  21. Dowson C, Laing R, Barraclough R, Town I, Mulder R, Norris K, et al. The use of the Hospital Anxiety and Depression Scale (HADS) in patients with chronic obstructive pulmonary disease: a pilot study. N Z Med J 2001 Oct 12;114(1141):447-449. [Medline]
  22. Olssøn I, Mykletun A, Dahl A. The Hospital Anxiety and Depression Rating Scale: a cross-sectional study of psychometrics and case finding abilities in general practice. BMC Psychiatry 2005 Dec 14;5:46 [FREE Full text] [CrossRef] [Medline]
  23. de Graaff AM, Cuijpers P, Leeflang M, Sferra I, Uppendahl J, de Vries R, et al. A systematic review and meta-analysis of diagnostic test accuracy studies of self-report screening instruments for common mental disorders in Arabic-speaking adults. Glob Ment Health (Camb) 2021;8:e43 [FREE Full text] [CrossRef] [Medline]
  24. Wu Y, Levis B, Sun Y, He C, Krishnan A, Neupane D, DEPRESsion Screening Data (DEPRESSD) HADS Group. Accuracy of the Hospital Anxiety and Depression Scale Depression subscale (HADS-D) to screen for major depression: systematic review and individual participant data meta-analysis. BMJ 2021 May 10;373:n972 [FREE Full text] [CrossRef] [Medline]
  25. Vodermaier A, Millman R. Accuracy of the Hospital Anxiety and Depression Scale as a screening tool in cancer patients: a systematic review and meta-analysis. Support Care Cancer 2011 Dec;19(12):1899-1908. [CrossRef] [Medline]
  26. González-Roz A, Gaalema D, Pericot-Valverde I, Elliott R, Ades P. A systematic review of the diagnostic accuracy of depression questionnaires for cardiac populations: implications for cardiac rehabilitation. J Cardiopulm Rehabil Prev 2019 Nov;39(6):354-364 [FREE Full text] [CrossRef] [Medline]
  27. Litster B, Fiest K, Patten S, Fisk J, Walker J, Graff L, CIHR Team “Defining the Burden and Managing the Effects of Psychiatric Comorbidity in Chronic Immunoinflammatory Disease”. Screening tools for anxiety in people with multiple sclerosis: a systematic review. Int J MS Care 2016;18(6):273-281 [FREE Full text] [CrossRef] [Medline]
  28. Larsen C, Bendstrup E, Neergaard M. Screening tools for depression and anxiety in patients with chronic obstructive pulmonary disease - a systematic review. COPD 2021 Dec;18(6):683-689. [CrossRef] [Medline]
  29. Prinsen C, Mokkink L, Bouter L, Alonso J, Patrick D, de Vet HCW, et al. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res 2018 May;27(5):1147-1157 [FREE Full text] [CrossRef] [Medline]
  30. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021 Mar 29;372:n71 [FREE Full text] [CrossRef] [Medline]


COPD: chronic obstructive pulmonary disease
COSMIN: Consensus-based Standards for the Selection of Health Measurement Instruments
HADS: Hospital Anxiety and Depression Scale
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses


Edited by T Leung; submitted 22.03.22; peer-reviewed by E Andrikopoulou, L Hess, N Chalghaf; comments to author 25.06.22; revised version received 13.07.22; accepted 30.07.22; published 22.09.22

Copyright

©Aleksandra Nikolovski, Lara Gamgoum, Arshpreet Deol, Shea Quilichini, Ethan Kazemir, Jonathan Rhodenizer, Ana Oliveira, Dina Brooks, Sanaa Alsubheen. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 22.09.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.