Published on in Vol 12 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/44702, first published .
The Impact of Heat Waves on Health Care Services in Low- or Middle-Income Countries: Protocol for a Systematic Review

The Impact of Heat Waves on Health Care Services in Low- or Middle-Income Countries: Protocol for a Systematic Review

The Impact of Heat Waves on Health Care Services in Low- or Middle-Income Countries: Protocol for a Systematic Review

Protocol

1Department of Public Health Medicine, Faculty of Medicine, Universiti Teknologi Mara, Selangor, Malaysia

2Environmental Health Research Centre, Institute for Medical Research, National Institutes of Health, Ministry of Health, Selangor, Malaysia

Corresponding Author:

Mohamad Ikhsan Selamat, MPH, PhD

Department of Public Health Medicine

Faculty of Medicine

Universiti Teknologi Mara

Jalan Hospital

Selangor, 47000

Malaysia

Phone: 60 199565077

Email: mohamadikhsan@uitm.edu.my


Background: Heat waves significantly impact ecosystems and human health, especially that of vulnerable populations, and are associated with increased morbidity and mortality. Besides being directly related to climate-sensitive health outcomes, heat waves have indirectly increased the burden on our health care systems. Although the existing literature examines the impact of heat waves and morbidity, past research has mostly been conducted in high-income countries (HICs), and studies on the impact of heat waves on morbidity in low- or middle-income countries (LMICs) are still scarce.

Objective: This paper presents the protocol for a systematic review that aims to provide evidence of the impact of heat waves on health care services in LMICs.

Methods: We will identify peer-reviewed studies from 3 online databases, including the Web of Science, PubMed, and SCOPUS, published from January 2002 to April 2023, using the PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) guidelines. Quality assessment will be conducted using the Navigation Guide checklist. Key search terms include heatwaves, extreme heat, hospitalization, outpatient visit, burden, health services, and morbidity.

Results: This systematic review will provide insight into the impact of heat waves on health care services in LMICs, especially on emergency department visits, ambulance call-outs, hospital admissions, outpatient department visits, in-hospital mortality, and health care operational costs.

Conclusions: The results of this review are anticipated to help policymakers and key stakeholders obtain a better understanding of the impact of heat waves on health care services and prioritize investments to mitigate the effects of heat waves in LMICs. This entails creating a comprehensive heat wave plan and ensuring that adequate infrastructure, capacity, and human resources are allocated in the health care sector. These measures will undoubtedly contribute to the development of resilience in health care systems and hence protect the health and well-being of individuals and communities.

Trial Registration: PROSPERO CRD42022365471; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=365471

International Registered Report Identifier (IRRID): DERR1-10.2196/44702

JMIR Res Protoc 2023;12:e44702

doi:10.2196/44702

Keywords



The world is facing significant climate change with a variety of impacts, especially from rising temperatures and more frequent heat wave episodes. Globally, the annual average temperature has been rising since the beginning of the 20th century, and it is now higher than the 1901 to 2000 average [1]. Global warming as a result of the continuous increase in greenhouse gas production has contributed to heat waves with increasing frequency, severity, and duration [2]. Moreover, the effects of heat waves are aggravated by rapid urbanization, population growth, and the urban heat island effect [3]; more than half of the world’s population lived in urban settings in 2017 [4]. The Intergovernmental Panel on Climate Change (IPCC) has projected that global warming of 1.5 °C could be reached in the 2030s if countries do not adhere to the Paris Agreement and do not create a mitigation action plan [5,6]. Major heat wave events have caused widespread casualties and strain on health care systems worldwide. The impacts were observed during the 2003 European heat wave, with the deaths of an estimated 72,000 people, and the 2010 Russian heat wave, with 56,000 deaths [7]. The number of deaths is projected to increase in the future, with 250,000 additional deaths per year between 2030 and 2050 [8]. An extended time-series study demonstrated increased risks of mortality of 5.1%, 2.9%, and 5.5% for every degree rise in temperature above the identified threshold for London, Budapest, and Milan, respectively [9].

Heat waves are generally defined as prolonged periods of exceptionally high or extreme temperatures and are characterized by the magnitude, duration, severity, and extent of the event [10,11]. Up to now, there has been no agreed definition of a heat wave, as the best definition would largely depend on the specific climatic zone of a geographical area, time trends, and individual acclimatization [12]. The unavailability of a unified global index further complicates research that seeks to compare results [12] and discuss patterns, trends, and impacts [13] for the development of health warning systems. The World Meteorological Organization and the Centre for Research on the Epidemiology of Disasters define heat waves as 2 or more consecutive days of temperatures exceeding the local region’s given temperature or a percentile threshold [14-16]. A heat wave index (HI) can be defined using temperatures alone or in combination with other meteorological factors, such as humidity and wind speed, for a specified duration, ranging from 1 to several consecutive days [10,13]. Some researchers prefer to use daily mean temperature [17], while others have used daily maximum and apparent temperature [18] to understand the exposure relationship. For instance, Kent et al [12] and Zhang et al [19] found a relative mean temperature HI was the most predictive of adverse heat-related health effects compared to other HIs. According to Wu et al [20], the diversity in heat wave definitions could lead to uncertainty of approximately 22% in predictions of mortality risk.

An increase of 1 °C in temperature above a city-specific threshold is a serious public health concern due to increased mortality and hospital admissions [21-23]. Health effects following heat waves are usually acute, ranging from immediate effects to effects that persist until 7 days later [24,25]. Heat waves have been linked directly to multiple medical conditions, such as heat-related illnesses [26], accelerated complications and deaths from cardiorespiratory and renal diseases, endocrine disorders, food and waterborne diseases, vector-borne diseases [27], accidents [28], increased preterm births [12], and many more. Furthermore, morbidity and mortality in urban areas are higher due to the urban heat island effect [29,30]. On the other hand, improvements in living conditions, urban green space, and awareness of heat waves [31] have been shown to reduce the adverse health effects.

Heat waves will create a surge in demand for health care services and subsequently increase the burden on these services at all levels, including primary care, elective admissions, and intensive care. This includes increased ambulance call-outs, slower response time [32], increased emergency and outpatient department visits [33], increased hospitalization [34], shortages of medicine, and ultimately increased health care expenditures, both direct and indirect [35]. Even though a few previous studies found that emergency hospital admissions were lower compared to mortalities during heat waves [36,37], the number of excess emergency department visits can still be high and thus impose an extra burden on health care services. For instance, during heat wave events in California in 2006, an excess of 16,166 emergency department visits was documented [38]. Health care systems will be under pressure with high bed occupancy rates and constrained resources, which may ultimately affect the care plans of patients [39] and lead to greater economic costs [40].

The effects of heat waves are more pronounced in vulnerable groups. Numerous systematic reviews have examined the effects of heat waves on older people [31]; children [41,42]; men and women [43]; pregnant women [44]; people with chronic conditions, such as mental illness [45,46], cardiovascular disease [47-50], and kidney disease [51]; people experiencing homelessness; people with low socioeconomic status and poor access to green areas [52]; and people in certain occupational sectors, such as agriculture, forestry or fishing, construction, and manufacturing [53]. Reviews that examined the impact of heat waves on health services in low- or middle-income countries (LMICs) are still scare [52,54], with the majority concentrating on high-income countries (HICs) [34] or a combination of LMICs and HICs [55,56]. Moreover, LMICs have limited access to health care systems, lack of adequate infrastructure, and a lower allocation of gross domestic product (GDP) to health care [52]; they also have more vulnerable populations due to low adaptive capacity to heat waves [57-59], lower socioeconomic status, and lack of cooling facilities such as air-conditioning in homes [60,61].

Thus, it is necessary to understand the specific, isolated impact of heat waves on health care services in LMICs in order to ensure adequate preparedness, health promotion, and risk management and allow preventive measures to be carried out effectively to protect vulnerable people from the harmful effects of extreme weather, as highlighted by the World Health Organization and the US National Climate Assessment Program 2014 [62]. Moreover, previous research in China has demonstrated that public health divisions and clinical divisions were unprepared to act confidently in facing challenges related to climate change due to lack of logistical support, capacity building, and funding [27,63]. The enhancement of health care services ultimately aims to reduce morbidity and mortality arising from heat wave exposure.

This systematic review aims to evaluate the impact of heat waves on health care services in LMICs. Moreover, this study aims to identify critical research gaps in the existing literature for future research and to aid in the dissemination of important research findings to policymakers and relevant stakeholders for strategic policy planning and implementation.


Protocol Registration

This study has been registered with the international Prospective Register of Systematic Reviews (PROSPERO; CRD42022365471). This paper presents a protocol for a systematic review of literature reporting on the impact of heat waves on health care services, particularly in LMICs.

Identifying the Research Question

The main research question is “How do heat waves place a burden on health care systems, particularly in LMICs?” The specific questions are (1) “What are the impacts of heat waves on health care systems—emergency department visits, hospital admissions, outpatient department visits, ambulance call-outs, in-hospital mortality, and health care operational costs?” and (2) “What are the risk factors involved?”

Search Strategy

A comprehensive literature search of electronic databases for peer-reviewed literature published between January 2002 and April 2023 will be conducted on the Web of Science, PubMed, and SCOPUS using a common search strategy. The process of the review started in March 2023 and is currently still in the screening phase. This process involves a 3-stage protocol, as depicted in Figure 1, using the Boolean operators “AND” and “OR.” A search strategy combining MeSH terms and keywords that will be used in the 3 online databases is described in Multimedia Appendix 1. As a preliminary search, these keywords will be used on each database using the following search terms: (“heat wave” OR “extreme heat” OR “heat wave”) AND (“hospitalization” OR “hospital admission”) OR (“morbidity” OR “heat-related illness”) OR “ambulance” OR “outpatient visit” OR “emergency department” OR “health services.”

Figure 1. Schematic flow chart of the systematic review process. PRISMA: Preferred Reporting Items for Systematic reviews and Meta-Analyses.

Selection of Eligible Studies

To increase the feasibility of this review, studies that have been published during the past 20 years will be included. Subsequently, eligibility criteria will be developed using the PECO (population, exposure, comparison, and outcomes) analytical framework, as detailed in Textbox 1.

Textbox 1. Inclusion and exclusion criteria, developed using the PECO (population, exposure, comparison, and outcomes) analytical framework.

Inclusion criteria

  • Population: The general population of low- or middle-income countries (LMICs) that are affected by heat waves and seek treatment in health care services, regardless of their age, gender, location, or ethnicity. The International Monetary Fund definition of LMICs will be used [64,65]; the list of included countries is provided in Multimedia Appendix 1.
  • Exposure: All studies related to heat waves will be included, regardless of their definition of a heat wave.
  • Comparison: The same population at a time they are not exposed to a heat wave event or a comparable population that are not exposed to a heat wave event.
  • Outcomes: Health care services, including ambulance-call-outs, emergency department visits, outpatient department visits, hospitalization, and in-hospital mortality.

Exclusion criteria

  • Population: Morbidity and mortality outside of health care services (ie, hospitals, outpatient clinics, and ambulance dispatches); populations in high-income countries
  • Exposure: No definition of heat wave provided; studies on ambient temperature that do not examine heat waves; studies on cold temperatures

All observational studies on heat waves will be included. Intervention studies (eg, randomized controlled trials, single-arm studies), case reports, guidelines, book chapters, commentaries, reviews (eg, systematic reviews, scoping reviews), editorials, protocols, short communications, guidelines, surveillance studies, qualitative research, and non-English publications will be excluded. The full text of selected studies is required to be retrievable for further review. The epidemiological measures must be reported as relative risks, odds ratios, or incidence rate ratios with the 95% CI.

Study Selection Process

Before starting the screening process, a standardized questionnaire for study selection will be developed based on the predetermined eligibility criteria followed by a training session at each level of screening to ensure high interrater reliability (>75% agreement).

Eligible articles will be exported into EndNote X9 (Clarivate) for data management, which will include identifying and removing duplicates, by one reviewer. Subsequently, the data will be exported into Covidence (Level 10) for screening and data extraction. All attempts will be made to obtain the full text of selected articles, including web searching, engaging with the University Teknologi Mara librarian, or, if necessary, contacting the author.

After removing all duplicate articles, 2 reviewers will examine the eligibility of the articles in a 2-stage process. During the first screening, the list of titles and abstracts in the search results will be evaluated for relevancy. In the second screening, potentially relevant full-text papers will be reviewed according to the eligibility criteria. Articles that do not fulfill the criteria will be excluded from the study. Three reviewers will independently execute both stages of study selection, and cross-validation will be conducted for any potential disagreements. Cross-validation will be used to analyze inconsistencies in the list of included and excluded studies. In the event of a disagreement, a fourth reviewer will be assigned before considering the involvement of a fifth verifier. All disagreements will be resolved through discussion, and agreement will be assessed using the κ statistic, with a value of more than 0.8 considered good agreement.

The selection process will be conducted following the PRISMA-P (Preferred Reporting Items for Systematic reviews and Meta-Analyses protocol) checklist [66]. We expect that this systematic review will be completed in December 2023.

Data Items and Data Abstraction Process

Three independent reviewers will perform data abstraction to ensure high interrater reliability and minimize error. Prior to this process, a standardized data collection form will be pilot-tested by 3 independent reviewers. Any discrepancies identified will be resolved by a fourth and fifth reviewer.

Data items will include all relevant information on (1) study characteristics (author, publication year, study design, study location, study years); (2) exposure definition; (3) population characteristics (study population geographical area, vulnerability factors such as age, gender, medical conditions), (4) measures of exposure and outcome, (5) confounders, and (6) effect estimates and outcome characteristics (ambulance call-outs, emergency department visits, outpatient department visits, and in-hospital admissions).

Charting the Data

A data charting form will be used to capture all relevant information for each included study in the review. This process will be conducted by 2 independent reviewers. A thematic analysis approach will be used to identify the key concepts from the full-text articles and code them into non–mutually exclusive themes. All relevant articles will be coded manually in the spreadsheets and presented in the evidence table. The third reviewer will verify the charted data.

Critical Appraisal

Overview

The included papers will be assessed in accordance with the Navigation Guide, which provides criteria for evaluating the quality of systematic reviews of environmental health observational studies in order to minimize the risk of bias (RoB) and maximize transparency [67]. The assessment will be conducted in three stages: (1) individual study RoB assessments, (2) assessment of the overall quality of the evidence across all included papers, and (3) rating of the overall strength of the evidence across studies. This process will be independently conducted by 2 reviewers and followed by discussion to reach agreement on ratings. Whenever there is disagreement, a third reviewer will be called in for further discussion on the appraisal.

RoB Assessment

The quality of the individual studies will be assessed using the Office of Health Assessment and Translation (OHAT) RoB assessment tool to examine internal validity and whether the study’s design and execution jeopardized the validity of the association between exposure and outcome [68]. This tool was adapted from several guidelines, such as those of the Agency of Health Care Research and Quality [69], the Navigation Guide [70] and the Cochrane Handbook [71]. Since OHAT does not specifically consider time-series environmental health study design, 2 subject-matter experts will modify some of its domains according to our research questions. The RoB domains that will be used are selection, confounding, exposure assessment, outcome assessment, selective reporting, conflict of interest, and other possible bias. The overall rating will be categorized as “definitely low,” “probably low,” “probably high,” or “definitely high.”

Assessment of Overall Quality of Evidence Across All Included Papers

Based on the Navigation Guide, the certainty of evidence will be assessed using the Grading of Recommendation Assessment, Development and Evaluation (GRADE) system for each exposure outcome. The body of evidence will be initially graded as moderate based on priority criteria in human observational evidence [67] and then downgraded according to 5 domains (individual study limitations, inconsistency of results, indirectness of evidence, imprecision, and publication bias) and upgraded based on 3 domains (dose-response gradient, large magnitude of effect, and confounding). The final assessment will be as “high,” “moderate,” “low,” or “very low” [72].

Rating of Overall Strength of Evidence Across Studies

The Navigation Guide further outlines four considerations when rating the overall strength of evidence across studies [67], which include (1) the quality of the body of evidence, (2) the direction of effect estimates, (3) confidence in the effect estimates, and (4) any other attributes that might affect certainty. The rating will be either “sufficient,” “limited,” “inadequate,” or “evidence of lack of effect.” The final rating will indicate the level of certainty of effect [70].

Ethical Approval

Formal ethical approval is not required as this study does not use primary data.


We anticipate publishing the systematic review by May 2024. To enhance the transparency and clarity of the results and provide a comprehensive overview of the results obtained from each database during preliminary screening, we present our current results in Table 1, which includes a few examples.

Table 1. Characteristics of the studies during preliminary screening.
TitleYearJournal nameDatabaseFirst screeningSecond screeningReason for exclusion
“Cause-specific risk of hospital admission related to extreme heat in older adults” [73]2014JAMASCOPUSIncludedExcludedConducted in high-income country
“Increased risk of emergency hospital admissions for children with renal diseases during heatwaves in Brisbane, Australia” [74]2014World Journal of PediatricsSCOPUSExcludedN/AaConducted in high-income country
“The effects of heatwaves on human morbidity in primary care settings: a case-crossover study” [75]2022Scholarly Community EncyclopediaWeb of ScienceExcludedN/AShort communication
“The burden of extreme heat and heatwave on emergency ambulance dispatches: A time-series study in Huainan, China” [76]2016Science of the Total EnvironmentPubMedIncludedIncludedN/A
“Burden of non-accidental mortality attributable to ambient temperatures: a time series study in a high plateau area of southwest China” [77]2019BMJ OpenPubMedIncludedExcludedMortality outside health care services

aN/A: not applicable.

Descriptive Analysis

A narrative report will be produced to summarize the extracted data related to the research questions in the final review. The results will be presented in the final evidence tables; Figures 2, 3, and 4 represent samples of these tables, which include the following information: (1) the study characteristics, including author, publication year, study design, study location, the years the study covers, and the definition of a heat wave; (2) population characteristics and vulnerability (ie, risk factors), including age, gender, race, location (urban vs rural); (3) type of disease according to body system, such as cardiovascular disease, respiratory disease, and renal disease, which will be presented in the effect estimates sections of the tables in Figures 3 and 4; and (4) the burden on health care services, including ambulance call-outs, emergency department visits, outpatient department visits, hospital admissions, in-hospital mortality, and health care operational costs.

Figure 2. Sample table for characteristics of articles selected for the study.
Figure 3. Sample table for impact on hospital admissions.
Figure 4. Sample table for impact of heat waves on other health care services.

Statistical Analysis

This study will not conduct a meta-analysis of the results due to the heterogeneity of outcome measures. Hence, only descriptive thematic analysis will be performed. Nevertheless, the RoB assessment will be performed using SPSS (version 27; IBM Corp) for categorical outcomes, which will be presented as frequencies and percentages.


Principal Findings

It is anticipated that the strain on health care systems will increase significantly if heat wave events rise in frequency, length, and severity. This review’s findings are expected to demonstrate that heat waves significantly increase ambulance call-outs, emergency department visits, hospitalization, outpatient department visits, and in-hospital mortality, as well as health care operational costs. Previously, Campbell et al [78] found that ambulance call-outs increased by 34% during extreme heat waves, 10% during severe heat waves, and 4% during low-intensity heat waves. Davis and Novicoff [79] found significantly increased risk for emergency department visits and hospitalization for White and Black people, as well as men and women aged 20 to 49 years, with a variety of presentations, including diabetes, pregnancy complications, poisoning, and traffic crashes, [80] in addition to common presentations such as renal disorder [81,82], cardiovascular disease, respiratory disease [83,84], mental disease [85], and heat-related illness [86].

To our knowledge, this study will be the first to review the impacts of heat waves on health care systems in LMICs and thus fill a knowledge gap. Since the impact of heat waves is more pronounced in LMICs due to their inadequate infrastructure, low access to health care [52], and dense populations of vulnerable people [87], it will be beneficial if LMICs can identify temperature thresholds and vulnerable groups in their region so that targeted interventions can be implemented effectively. Moreover, morbidity indicators such as ambulance call-outs, hospital admissions, and emergency department visits should be used during heat wave impact assessments and the development of early warning systems. Wang et al [88] recommended examining ambulance dispatch data to develop a real-time surveillance heat health warning system that would allow early detection of residents’ health demands and health status in a region. Toloo et al [89] demonstrated that the implementation of an early warning system can be cost-effective and reduce mortality and ambulance call-outs. Indeed, many HICs have developed and implemented heat health action plans [90,91]. However, Ahmedabad, India, has become the first South Asian city to develop and implement an early warning system and heat preparedness plan based on collected evidence, such as an analysis of local temperature and mortality data and surveys of the population vulnerable to heat. Nevertheless, evaluation and continuous improvement are still ongoing [92].

The findings of this review also could assist public health and health care systems in allocating resources effectively, such as by allocating more GDP to health care, improving existing infrastructure [26], increasing human resources, and promoting health. Apart from this, health care workers must be provided with adequate training and updates on the latest information or guidelines related to heat waves [16]. Enhanced diagnostic accuracy and speed, followed by immediate treatment, is vital for hospitals and other community medical institutions in order to reduce morbidity and mortality [26]. Lastly, understanding the impact of heat waves on health care services underscores the need for climate change mitigation and adaptation, such as increasing the resilience of health care systems and being responsive to the effects of heat waves [93,94].

Among the limitations that we expect in this review are the inability to access full texts and some of the articles not being in English. This could limit the overall findings of the review. Secondly, during our search, we found numerous articles that examined the impact of ambient temperature on health care services but few that examined the impact of heat waves. In fact, some of the articles did not provide a definition of a heat wave. This might be due to underrepresentation of some LMICs [95], which will further limit the findings of the review. However, we believe that this finding could encourage these countries to participate and conduct more research on this topic, as well as highlight to HICs that funding to these countries is necessary for them to conduct more research.

Conclusion

Undeniably, heat waves pose a significant health risk to individuals and the community. Therefore, understanding the burden on health care services due to exposure to heat waves is of paramount importance as heat waves are becoming more frequent and increasing in intensity. This proposed systematic review is expected to provide a better understanding of the impact of heat waves on health care systems in LMICs; this will be critical for optimal planning, preventive activities, policymaking, and climate action. By prioritizing this understanding and disseminating this information to policymakers and relevant stakeholders, we can better protect individuals’ and communities’ health and well-being, as well as construct a more resilient health care system in the face of climate change.

Acknowledgments

This project is funded by Geran Pembudayaan Penyelidikan Dana University Teknologi Mara Cawangan Selangor from the University Teknologi Mara, with project code 600-UiTMSEL (P.15/4)(080/2022). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. This review is a part of research by the Ministry of Higher Education Malaysia under University Teknologi Mara with collaboration from the National Institutes of Health Malaysia. The authors would like to thank the director-general of health of Malaysia for the permission to publish this paper. We also acknowledge the reviewers of the manuscript for all their contributions in giving constructive feedback on this protocol.

Authors' Contributions

All authors contributed to conceptualization, formal analysis, investigation, methodology, validation, visualization, and review and editing of the manuscript. HS, MIS, RI, and WRWM contributed to resources. HS, MIS, and MRI contributed to data curation and software. HS and MIS contributed to project administration and funding acquisition. MIS and MRI supervised the project. HS wrote the original draft.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Search strategy, list of low- and middle-income countries, and risk of bias assessment.

DOCX File , 52 KB

Multimedia Appendix 2

PRISMA-P (Preferred Reporting Items for Systematic reviews and Meta-Analyses protocol) checklist.

DOCX File , 41 KB

  1. Hyland D. Climate change and extreme heat: What you can do to prepare. United States Environmental Protection Agency. Oct 2016. URL: https:/​/www.​researchgate.net/​publication/​312891446_Climate_Change_and_Extreme_Heat_What_You_Can_Do_to_Prepare/​link/​5888dbe3458515701200ebf1/​download [accessed 2023-09-29]
  2. Masson-Delmotte V, Zhai P, Pörtner HO, Roberts J, Skea PR, Shukla A, et al. Global Warming of 1.5°C: IPCC Special Report on Impacts of Global Warming of 1.5°C above Pre-industrial Levels in Context of Strengthening Response to Climate Change, Sustainable Development, and Efforts to Eradicate Poverty. Cambridge, UK. Cambridge University Press; 2022.
  3. Kong J, Zhao Y, Carmeliet J, Lei C. Urban heat island and its interaction with heatwaves: A review of studies on mesoscale. Sustainability. Sep 30, 2021;13(19):10923. [FREE Full text] [CrossRef]
  4. Ritchie H, Roser M. Urbanization. Our World in Data. URL: https://ourworldindata.org/urbanization [accessed 2023-09-29]
  5. Climate change 2007 – impacts, adaptation and vulnerability: Working Group II contribution to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change. Intergovernmental Panel on Climate Change. URL: https://www.ipcc.ch/site/assets/uploads/2018/03/ar4_wg2_full_report.pdf [accessed 2023-10-02]
  6. The Paris Agreement. United Nations Climate Change. URL: https://unfccc.int/process-and-meetings/the-paris-agreement/the-paris-agreement [accessed 2023-10-02]
  7. United Nations Office for Disarmament Affairs. Human Cost of Disasters: An Overview of the Last 20 Years 2000-2019. New York, NY. United Nations Publications; 2020.
  8. Climate change and health. World Health Organization. 2018. URL: https://www.who.int/news-room/fact-sheets/detail/climate-change-and-health [accessed 2023-10-02]
  9. Hajat S, Armstrong B, Baccini M, Biggeri A, Bisanti L, Russo A, et al. Impact of high temperatures on mortality: is there an added heat wave effect? Epidemiology. Nov 2006;17(6):632-638. [CrossRef] [Medline]
  10. Faye M, Dème A, Diongue AK, Diouf I. Impact of different heat wave definitions on daily mortality in Bandafassi, Senegal. PLoS One. 2021;16(4):e0249199. [FREE Full text] [CrossRef] [Medline]
  11. Guo Y, Gasparrini A, Armstrong B, Li S, Tawatsupa B, Tobias A, et al. Global variation in the effects of ambient temperature on mortality: a systematic evaluation. Epidemiology. Nov 2014;25(6):781-789. [FREE Full text] [CrossRef] [Medline]
  12. Kent ST, McClure LA, Zaitchik BF, Smith TT, Gohlke JM. Heat waves and health outcomes in Alabama (USA): the importance of heat wave definition. Environ Health Perspect. Mar 2014;122(2):151-158. [FREE Full text] [CrossRef] [Medline]
  13. Smith TT, Zaitchik BF, Gohlke JM. Heat waves in the United States: definitions, patterns and trends. Clim Change. Jun 2013;118(3-4):811-825. [FREE Full text] [CrossRef] [Medline]
  14. Extreme heat and heat waves. Climate Signals. 2021. URL: https://www.climatesignals.org/climate-signals/extreme-heat-and-heat-waves [accessed 2023-10-02]
  15. Rodriguez J, Vos F, Below R, Guha-Sapir D. Annual disaster statistical review 2008: The numbers and trends. Centre for Research on the Epidemiology of Disasters. 2009. URL: https://www.emdat.be/publications/page/4/ [accessed 2023-01-12]
  16. Hu J, Wen Y, Duan Y, Yan S, Liao Y, Pan H, et al. The impact of extreme heat and heat waves on emergency ambulance dispatches due to external cause in Shenzhen, China. Environ Pollut. Jun 2020;261:114156. [CrossRef] [Medline]
  17. Sun X, Sun Q, Yang M, Zhou X, Li X, Yu A, et al. Effects of temperature and heat waves on emergency department visits and emergency ambulance dispatches in Pudong New Area, China: a time series analysis. Environ Health. Oct 02, 2014;13:76. [FREE Full text] [CrossRef] [Medline]
  18. Phung D, Chu C, Rutherford S, Nguyen HLT, Do CM, Huang C. Heatwave and risk of hospitalization: A multi-province study in Vietnam. Environ Pollut. Jan 2017;220(Pt A):597-607. [CrossRef] [Medline]
  19. Zhang Y, Feng R, Wu R, Zhong P, Tan X, Wu K, et al. Global climate change: impact of heat waves under different definitions on daily mortality in Wuhan, China. Glob Health Res Policy. 2017;2:10. [FREE Full text] [CrossRef] [Medline]
  20. Wu J, Zhou Y, Gao Y, Fu JS, Johnson BA, Huang C, et al. Estimation and uncertainty analysis of impacts of future heat waves on mortality in the eastern United States. Environ Health Perspect. Jan 2014;122(1):10-16. [FREE Full text] [CrossRef] [Medline]
  21. Son J, Bell ML, Lee J. The impact of heat, cold, and heat waves on hospital admissions in eight cities in Korea. Int J Biometeorol. Nov 2014;58(9):1893-1903. [CrossRef] [Medline]
  22. Wichmann J. Heat effects of ambient apparent temperature on all-cause mortality in Cape Town, Durban and Johannesburg, South Africa: 2006-2010. Sci Total Environ. Jun 01, 2017;587-588:266-272. [CrossRef] [Medline]
  23. Gasparrini A, Armstrong B. The impact of heat waves on mortality. Epidemiology. Jan 2011;22(1):68-73. [FREE Full text] [CrossRef] [Medline]
  24. Alahmad B, Shakarchi A, Alseaidan M, Fox M. The effects of temperature on short-term mortality risk in Kuwait: A time-series analysis. Environ Res. Apr 2019;171:278-284. [CrossRef] [Medline]
  25. Dang TN, Seposo XT, Duc NHC, Thang TB, An DD, Hang LTM, et al. Characterizing the relationship between temperature and mortality in tropical and subtropical cities: a distributed lag non-linear model analysis in Hue, Viet Nam, 2009-2013. Glob Health Action. 2016;9:28738. [FREE Full text] [CrossRef] [Medline]
  26. Bai L, Ding G, Gu S, Bi P, Su B, Qin D, et al. The effects of summer temperature and heat waves on heat-related illness in a coastal city of China, 2011-2013. Environ Res. Jul 2014;132:212-219. [FREE Full text] [CrossRef] [Medline]
  27. Yang L, Liu C, Bi P, Vardoulakis S, Huang C. Local actions to health risks of heatwaves and dengue fever under climate change: Strategies and barriers among primary healthcare professionals in southern China. Environ Res. Aug 2020;187:109688. [CrossRef] [Medline]
  28. Ebi KL, Capon A, Berry P, Broderick C, de Dear R, Havenith G, et al. Hot weather and heat extremes: health risks. Lancet. Aug 21, 2021;398(10301):698-708. [CrossRef] [Medline]
  29. Kovats RS, Hajat S. Heat stress and public health: a critical review. Annu Rev Public Health. 2008;29:41-55. [CrossRef] [Medline]
  30. Ma W, Zeng W, Zhou M, Wang L, Rutherford S, Lin H, et al. The short-term effect of heat waves on mortality and its modifiers in China: an analysis from 66 communities. Environ Int. Mar 2015;75:103-109. [FREE Full text] [CrossRef] [Medline]
  31. Tan J, Zheng Y, Song G, Kalkstein LS, Kalkstein AJ, Tang X. Heat wave impacts on mortality in Shanghai, 1998 and 2003. Int J Biometeorol. Jan 2007;51(3):193-200. [CrossRef] [Medline]
  32. Turner LR, Connell D, Tong S. The effect of heat waves on ambulance attendances in Brisbane, Australia. Prehosp Disaster Med. Oct 2013;28(5):482-487. [CrossRef] [Medline]
  33. Heat and health. World Health Organization. 2018. URL: https://www.who.int/news-room/fact-sheets/detail/climate-change-heat-and-health [accessed 2023-10-02]
  34. Mason H, C King J, E Peden A, C Franklin R. Systematic review of the impact of heatwaves on health service demand in Australia. BMC Health Serv Res. Jul 28, 2022;22(1):960. [FREE Full text] [CrossRef] [Medline]
  35. Schmitt L, Graham H, White P. Economic evaluations of the health impacts of weather-related extreme events: A scoping review. Int J Environ Res Public Health. Nov 08, 2016;13(11):1105. [FREE Full text] [CrossRef] [Medline]
  36. Johnson H, Kovats S, McGregor G, Stedman J, Gibbs M, Walton H, et al. The impact of the 2003 heat wave on mortality and hospital admissions in England. Health Stat Q. 2005(25):6-11. [Medline]
  37. Schaffer A, Muscatello D, Broome R, Corbett S, Smith W. Emergency department visits, ambulance calls, and mortality associated with an exceptional heat wave in Sydney, Australia, 2011: a time-series analysis. Environ Health. Jan 24, 2012;11(1):3. [FREE Full text] [CrossRef] [Medline]
  38. Knowlton K, Rotkin-Ellman M, King G, Margolis HG, Smith D, Solomon G, et al. The 2006 California heat wave: impacts on hospitalizations and emergency department visits. Environ Health Perspect. Jan 2009;117(1):61-67. [FREE Full text] [CrossRef] [Medline]
  39. Rizmie D, de Preux L, Miraldo M, Atun R. Impact of extreme temperatures on emergency hospital admissions by age and socio-economic deprivation in England. Soc Sci Med. Sep 2022;308:115193. [FREE Full text] [CrossRef] [Medline]
  40. Schmeltz M, Petkova E, Gamble J. Economic burden of hospitalizations for heat-related illnesses in the United States, 2001-2010. Int J Environ Res Public Health. Sep 08, 2016;13(9):894. [FREE Full text] [CrossRef] [Medline]
  41. Gao J, Sun Y, Lu Y, Li L. Impact of ambient humidity on child health: a systematic review. PLoS One. 2014;9(12):e112508. [FREE Full text] [CrossRef] [Medline]
  42. Xu Z, Sheffield PE, Su H, Wang X, Bi Y, Tong S. The impact of heat waves on children's health: a systematic review. Int J Biometeorol. Mar 2014;58(2):239-247. [CrossRef] [Medline]
  43. Gifford R, Todisco T, Stacey M, Fujisawa T, Allerhand M, Woods DR, et al. Risk of heat illness in men and women: A systematic review and meta-analysis. Environ Res. Apr 2019;171:24-35. [CrossRef] [Medline]
  44. Chersich MF, Pham MD, Areal A, Haghighi MM, Manyuchi A, Swift CP, et al. Climate ChangeHeat-Health Study Group. Associations between high temperatures in pregnancy and risk of preterm birth, low birth weight, and stillbirths: systematic review and meta-analysis. BMJ. Nov 04, 2020;371:m3811. [FREE Full text] [CrossRef] [Medline]
  45. Rataj E, Kunzweiler K, Garthus-Niegel S. Extreme weather events in developing countries and related injuries and mental health disorders - a systematic review. BMC Public Health. Sep 29, 2016;16(1):1020. [FREE Full text] [CrossRef] [Medline]
  46. Thompson R, Hornigold R, Page L, Waite T. Associations between high ambient temperatures and heat waves with mental health outcomes: a systematic review. Public Health. Aug 2018;161:171-191. [CrossRef] [Medline]
  47. Cheng J, Xu Z, Bambrick H, Prescott V, Wang N, Zhang Y, et al. Cardiorespiratory effects of heatwaves: A systematic review and meta-analysis of global epidemiological evidence. Environ Res. Oct 2019;177:108610. [CrossRef] [Medline]
  48. Liu J, Varghese BM, Hansen A, Zhang Y, Driscoll T, Morgan G, et al. Heat exposure and cardiovascular health outcomes: a systematic review and meta-analysis. Lancet Planet Health. Jun 2022;6(6):e484-e495. [FREE Full text] [CrossRef] [Medline]
  49. Phung D, Thai P, Guo Y, Morawska L, Rutherford S, Chu C. Ambient temperature and risk of cardiovascular hospitalization: An updated systematic review and meta-analysis. Sci Total Environ. Apr 15, 2016;550:1084-1102. [CrossRef] [Medline]
  50. Moghadamnia M, Ardalan A, Mesdaghinia A, Keshtkar A, Naddafi K, Yekaninejad M. Ambient temperature and cardiovascular mortality: a systematic review and meta-analysis. PeerJ. 2017;5:e3574. [FREE Full text] [CrossRef] [Medline]
  51. Liu J, Varghese B, Hansen A, Borg MA, Zhang Y, Driscoll T, et al. Hot weather as a risk factor for kidney disease outcomes: A systematic review and meta-analysis of epidemiological evidence. Sci Total Environ. Dec 20, 2021;801:149806. [CrossRef] [Medline]
  52. Green H, Bailey J, Schwarz L, Vanos J, Ebi K, Benmarhnia T. Impact of heat on mortality and morbidity in low and middle income countries: A review of the epidemiological evidence and considerations for future research. Environ Res. Apr 2019;171:80-91. [CrossRef] [Medline]
  53. Fatima SH, Rothmore P, Giles LC, Varghese BM, Bi P. Extreme heat and occupational injuries in different climate zones: A systematic review and meta-analysis of epidemiological evidence. Environ Int. Mar 2021;148:106384. [FREE Full text] [CrossRef] [Medline]
  54. Dimitrova A, Ingole V, Basagaña X, Ranzani O, Milà C, Ballester J, et al. Association between ambient temperature and heat waves with mortality in South Asia: Systematic review and meta-analysis. Environ Int. Jan 2021;146:106170. [FREE Full text] [CrossRef] [Medline]
  55. Li M, Gu S, Bi P, Yang J, Liu Q. Heat waves and morbidity: current knowledge and further direction-a comprehensive literature review. Int J Environ Res Public Health. May 18, 2015;12(5):5256-5283. [FREE Full text] [CrossRef] [Medline]
  56. Arsad FS, Hod R, Ahmad N, Ismail R, Mohamed N, Baharom M, et al. The impact of heatwaves on mortality and morbidity and the associated vulnerability factors: A systematic review. Int J Environ Res Public Health. Dec 06, 2022;19(23):16356. [FREE Full text] [CrossRef] [Medline]
  57. McCracken K, Phillips DR. Climate change and the health of older people in Southeast Asia. In: Akhtar R, editor. Climate Change and Human Health Scenario in South and Southeast Asia. Advances in Asian Human-Environmental Research. Cham, Switzerland. Springer; 2016;A.
  58. Intergovernmental Panel on Climate Change. Climate Change 2001: Impacts, Adaptation and Vulnerability. Cambridge, UK. Cambridge University Press; 2001.
  59. Costello A, Abbas M, Allen A, Ball S, Bell S, Bellamy R, et al. Managing the health effects of climate change: Lancet and University College London Institute for Global Health Commission. Lancet. May 16, 2009;373(9676):1693-1733. [CrossRef] [Medline]
  60. Watts N, Amann M, Ayeb-Karlsson S, Belesova K, Bouley T, Boykoff M, et al. The Lancet Countdown on health and climate change: from 25 years of inaction to a global transformation for public health. Lancet. Mar 10, 2018;391(10120):581-630. [FREE Full text] [CrossRef] [Medline]
  61. Guo Y, Barnett AG, Yu W, Pan X, Ye X, Huang C, et al. A large change in temperature between neighbouring days increases the risk of mortality. PLoS One. Mar 02, 2011;6(2):e16511. [FREE Full text] [CrossRef] [Medline]
  62. Heat waves and health: Guidance on warning-system development. World Meteorological Organization. 2015. URL: https://public.wmo.int/en/resources/library/heatwaves-and-health-guidance-warning-system-development [accessed 2023-10-02]
  63. Tong M, Hansen A, Hanson-Easey S, Xiang J, Cameron S, Liu Q, et al. China's capacity of hospitals to deal with infectious diseases in the context of climate change. Soc Sci Med. Jun 2018;206:60-66. [FREE Full text] [CrossRef] [Medline]
  64. List of 152 developing countries. WorldData. 2022. URL: https://www.worlddata.info/developing-countries.php [accessed 2023-10-02]
  65. World economic outlook: A rocky recovery. International Monetary Fund. 2023. URL: https://www.imf.org/en/Publications/WEO/Issues/2023/04/11/world-economic-outlook-april-2023 [accessed 2023-10-02]
  66. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. Jan 01, 2015;4(1):1. [FREE Full text] [CrossRef] [Medline]
  67. Woodruff TJ, Sutton P. The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect. Oct 2014;122(10):1007-1014. [FREE Full text] [CrossRef] [Medline]
  68. OHAT risk of bias rating tool for human and animal studies. National Toxicology Program. URL: https://ntp.niehs.nih.gov/ntp/ohat/pubs/riskofbiastool_508.pdf [accessed 2023-10-02]
  69. Viswanathan M, Ansari M, Berkman N, Chang S, Hartling L, McPheeters M, et al. Assessing the risk of bias of individual studies in systematic reviews of health care interventions. Agency for Healthcare Research and Quality. 2012. URL: https:/​/effectivehealthcare.​ahrq.gov/​sites/​default/​files/​product/​pdf/​assessing-the-risk-of-bias-in-systematic-reviews-of-health-care-interventions-01.​pdf [accessed 2023-09-29]
  70. Johnson PI, Sutton P, Atchley DS, Koustas E, Lam J, Sen S, et al. The Navigation Guide - evidence-based medicine meets environmental health: systematic review of human evidence for PFOA effects on fetal growth. Environ Health Perspect. Oct 2014;122(10):1028-1039. [FREE Full text] [CrossRef] [Medline]
  71. Higgins JG. Cochrane handbook for systematic reviews of interventions. URL: https://training.cochrane.org/handbook [accessed 2023-10-02]
  72. Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. Rating the quality of evidence. J Clin Epidemiol. Apr 2011;64(4):401-406. [CrossRef] [Medline]
  73. Bobb JF, Obermeyer Z, Wang Y, Dominici F. Cause-specific risk of hospital admission related to extreme heat in older adults. JAMA. 2014;312(24):2659-2667. [FREE Full text] [CrossRef] [Medline]
  74. Wang X, Barnett A, Guo Y, Yu W, Shen X, Tong S. Increased risk of emergency hospital admissions for children with renal diseases during heatwaves in Brisbane, Australia. World J Pediatr. Nov 2014;10(4):330-335. [CrossRef] [Medline]
  75. Alsaiqali M, De Troeyer K, Casas L, Hamdi R, Faes C, Van Pottelbergh G. The effects of heatwaves on human morbidity in primary care settings: A case-crossover study. Int J Environ Res Public Health. Jan 12, 2022;19(2):832. [FREE Full text] [CrossRef] [Medline]
  76. Cheng J, Xu Z, Zhao D, Xie M, Zhang H, Wang S, et al. The burden of extreme heat and heatwave on emergency ambulance dispatches: A time-series study in Huainan, China. Sci Total Environ. Nov 15, 2016;571:27-33. [CrossRef] [Medline]
  77. Deng C, Ding Z, Li L, Wang Y, Guo P, Yang S, et al. Burden of non-accidental mortality attributable to ambient temperatures: a time series study in a high plateau area of southwest China. BMJ Open. Mar 15, 2019;9(2):e024708. [FREE Full text] [CrossRef] [Medline]
  78. Campbell SL, Remenyi T, Williamson GJ, Rollins D, White CJ, Johnston FH. Ambulance dispatches and heatwaves in Tasmania, Australia: A case-crossover analysis. Environ Res. Nov 2021;202:111655. [FREE Full text] [CrossRef] [Medline]
  79. Davis R, Novicoff W. The impact of heat waves on emergency department admissions in Charlottesville, Virginia, U.S.A. Int J Environ Res Public Health. Jul 07, 2018;15(7):1436. [FREE Full text] [CrossRef] [Medline]
  80. Wu CY, Zaitchik BF, Gohlke JM. Heat waves and fatal traffic crashes in the continental United States. Accid Anal Prev. Oct 2018;119:195-201. [FREE Full text] [CrossRef] [Medline]
  81. Chu L, Phung D, Crowley S, Dubrow R. Relationships between short-term ambient temperature exposure and kidney disease hospitalizations in the warm season in Vietnam: A case-crossover study. Environ Res. Jun 2022;209:112776. [CrossRef] [Medline]
  82. Hansen AL, Bi P, Ryan P, Nitschke M, Pisaniello D, Tucker G. The effect of heat waves on hospital admissions for renal disease in a temperate city of Australia. Int J Epidemiol. Dec 2008;37(6):1359-1365. [CrossRef] [Medline]
  83. Anderson GB, Dominici F, Wang Y, McCormack MC, Bell ML, Peng RD. Heat-related emergency hospitalizations for respiratory diseases in the Medicare population. Am J Respir Crit Care Med. May 15, 2013;187(10):1098-1103. [FREE Full text] [CrossRef] [Medline]
  84. Song X, Wang S, Li T, Tian J, Ding G, Wang J, et al. The impact of heat waves and cold spells on respiratory emergency department visits in Beijing, China. Sci Total Environ. Mar 15, 2018;615:1499-1505. [CrossRef] [Medline]
  85. Hansen A, Bi P, Nitschke M, Ryan P, Pisaniello D, Tucker G. The effect of heat waves on mental health in a temperate Australian city. Environ Health Perspect. Oct 2008;116(10):1369-1375. [FREE Full text] [CrossRef] [Medline]
  86. Harduar Morano L, Watkins S, Kintziger K. A comprehensive evaluation of the burden of heat-related illness and death within the Florida population. Int J Environ Res Public Health. May 31, 2016;13(6):551. [FREE Full text] [CrossRef] [Medline]
  87. Hijioka YL, Pereira J, Corlett R, Cui X, Insarov G. Climate change 2014: impacts, adaptation, and vulnerability. Part B: regional aspects. Intergovernmental Panel on Climate Change. 2014. URL: https://www.ipcc.ch/site/assets/uploads/2018/02/WGIIAR5-PartB_FINAL.pdf [accessed 2023-10-02]
  88. Wang Q, He Y, Hajat S, Cheng J, Xu Z, Hu W, et al. Temperature-sensitive morbidity indicator: consequence from the increased ambulance dispatches associated with heat and cold exposure. Int J Biometeorol. Nov 2021;65(11):1871-1880. [CrossRef] [Medline]
  89. Toloo G, FitzGerald G, Aitken P, Verrall K, Tong S. Evaluating the effectiveness of heat warning systems: systematic review of epidemiological evidence. Int J Public Health. Oct 2013;58(5):667-681. [CrossRef] [Medline]
  90. Bose-O'Reilly S, Daanen H, Deering K, Gerrett N, Huynen MMTE, Lee J, et al. COVID-19 and heat waves: New challenges for healthcare systems. Environ Res. Jul 2021;198:111153. [FREE Full text] [CrossRef] [Medline]
  91. Casanueva A, Burgstall A, Kotlarski S, Messeri A, Morabito M, Flouris AD, et al. Overview of existing heat-health warning systems in Europe. Int J Environ Res Public Health. Jul 25, 2019;16(15):2657. [FREE Full text] [CrossRef] [Medline]
  92. Knowlton K, Kulkarni S, Azhar G, Mavalankar D, Jaiswal A, Connolly M, et al. Ahmedabad Heat and Climate Study Group. Development and implementation of South Asia's first heat-health action plan in Ahmedabad (Gujarat, India). Int J Environ Res Public Health. Mar 25, 2014;11(4):3473-3492. [FREE Full text] [CrossRef] [Medline]
  93. Guihenneuc J, Ayraud-Thevenot S, Roschnik S, Dupuis A, Migeot V. Climate change and health care facilities: A risk analysis framework through a mapping review. Environ Res. Jan 01, 2023;216(Pt 3):114709. [FREE Full text] [CrossRef] [Medline]
  94. Summary for policymakers - climate change 2014: mitigation of climate change. Cambridge University. 2014. URL: https:/​/www.​cambridge.org/​core/​books/​abs/​climate-change-2014-mitigation-of-climate-change/​summary-for-policymakers/​EE0E4ADA727454B77093DA3AE19533BB [accessed 2023-10-02]
  95. Campbell S, Remenyi T, White C, Johnston F. Heatwave and health impact research: A global review. Health Place. Sep 2018;53:210-218. [FREE Full text] [CrossRef] [Medline]


GDP: gross domestic product
GRADE: Grading of Recommendation Assessment, Development and Evaluation
HI: heat wave index
HIC: high-income country
IPCC: Intergovernmental Panel on Climate Change
LMIC: low- or middle-income country
OHAT: Office of Health Assessment and Translation
PECO: population, exposure, comparison, and outcomes
PRISMA-P: Preferred Reporting Items for Systematic reviews and Meta-Analyses–Protocols
PROSPERO: Prospective Register of Systematic Reviews
RoB: risk of bias


Edited by A Mavragani; submitted 04.12.22; peer-reviewed by M Raimi, MM Patwary, C Wu, K Whitburn; comments to author 25.04.23; revised version received 02.06.23; accepted 31.08.23; published 16.10.23.

Copyright

©Hadita Sapari, Mohamad Ikhsan Selamat, Mohamad Rodi Isa, Rohaida Ismail, Wan Rozita Wan Mahiyuddin. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 16.10.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.