Published on in Vol 12 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/49131, first published .
Effects of the COVID-19 Pandemic on Primary Health Care for Chronic Conditions in Canada: Protocol for a Retrospective Pre-Post Study Using National Practice-Based Research Network Data

Effects of the COVID-19 Pandemic on Primary Health Care for Chronic Conditions in Canada: Protocol for a Retrospective Pre-Post Study Using National Practice-Based Research Network Data

Effects of the COVID-19 Pandemic on Primary Health Care for Chronic Conditions in Canada: Protocol for a Retrospective Pre-Post Study Using National Practice-Based Research Network Data

Protocol

1Department of Family Medicine, McMaster University, Hamilton, ON, Canada

2Primary Healthcare Research Unit, Memorial University of Newfoundland, St. John's, NL, Canada

3Department of Family Medicine, University of Alberta, Edmonton, AB, Canada

4Département de médecine de famille et de médecine d’urgence, Université de Montréal, Montréal, QC, Canada

5Department of Family Medicine, Queen's University, Kingston, ON, Canada

6Department of Epidemiology and Biostatistics, Western University, London, ON, Canada

Corresponding Author:

Michelle Howard, PhD

Department of Family Medicine

McMaster University

David Braley Health Sciences Centre, 5th Floor

100 Main St. W

Hamilton, ON, L8P 1H6

Canada

Phone: 1 905 525 9140 ext 28502

Email: mhoward@mcmaster.ca


Background: Since the COVID-19 pandemic began, there have been concerns that interruptions to the health care system may have led to changes in primary care, especially for care of chronic conditions such as diabetes and heart failure. Such changes may have longer term implications for population health.

Objective: This study aims to describe the impacts of the COVID-19 pandemic on indicators of primary care access, comprehensiveness, and appropriateness among adult patients, as well as on specific indictors of chronic conditions. Additionally, this study aims to determine whether any identified changes were associated with patient sociodemographic characteristics and multimorbidity.

Methods: This is a retrospective, single-arm, pre-post study using Canadian Primary Care Sentinel Surveillance Network (CPCSSN) data. CPCSSN is a research network supported by a primary care electronic medical record database, comprising over 1500 physicians and nearly 2 million patients. We are examining changes in care (eg, frequency of contacts, laboratory tests and investigations, referrals, medications prescribed, etc) among adults. We will also examine indicators specific to evidence-based recommendations for care in patients with diabetes and those with heart failure. We will compare rates of outcomes during key periods of the pandemic between March 13, 2020, and December 31, 2022, with equal time periods before the pandemic. Differences will be examined among specific subgroups of adults, including by decade of age, number of comorbidities, and socioeconomic status. Regression models appropriate to outcome distributions will be used to estimate changes, adjusting for potential confounders. This analysis is part of a mixed-methods study with a qualitative component investigating how patients with diabetes with or without concurrent heart failure perceived the impact of the pandemic on access to primary care and health care–related decisions. This study was approved by the Hamilton Integrated Research Ethics Board (14782-C).

Results: The start date of this study was October 5, 2022, and the prospective end date is January 31, 2024. As of May 2023, the study cohort (n=875,934) is defined, data cleaning is complete, and exploratory analyses have begun. Extended analyses using 2022 data are planned once the new data becomes available. We will disseminate results through peer-reviewed publications and academic conference, as well as creating evidence briefs, infographics, and a video for policy maker and patient audiences.

Conclusions: This study will investigate whether the COVID-19 pandemic has resulted in changes in the provision of primary care in Canada and whether these potential changes have led to gaps in care. This study will also identify patient-level characteristics associated with changes in care patterns across the COVID-19 pandemic. Indicators specific to chronic conditions, namely diabetes and heart failure, will also be explored to determine whether there were changes in care of these conditions.

Trial Registration: ClinicalTrials.gov NCT05813652; https://clinicaltrials.gov/ct2/show/NCT05813652

International Registered Report Identifier (IRRID): RR1-10.2196/49131

JMIR Res Protoc 2023;12:e49131

doi:10.2196/49131

Keywords



The presence of strong primary care systems has been shown to be associated with superior and more equitable health outcomes in the population [1-6]. Core elements of primary care that contribute to population health outcomes include access, continuity, comprehensiveness, coordination, person focus, and equity enhancement [7]. Chronic diseases are common and represent the leading causes of death worldwide [8]. The core elements of primary care make this setting ideal for managing chronic diseases [4,9], and family medicine and other primary care services provide the majority of care for chronic diseases across the lifespan [4,10]. With increasing age, there is an increasing prevalence of multiple chronic diseases [11], and these patients require careful management to reduce morbidity and mortality and improve quality of life [12]. Life-limiting chronic diseases such as chronic obstructive pulmonary disease, heart failure, and chronic kidney disease [13-15] affect millions of people in Canada and are mostly managed in primary care [16-19]. Other conditions that are risk factors for numerous cardiovascular and cerebrovascular diseases (eg, diabetes and hypertension) are associated with poor health outcomes, and these are also managed in primary care [20].

On March 11, 2020, the World Health Organization declared the circulating SARS-CoV-2 as a pandemic. The SARS-CoV-2 pandemic placed a substantial strain on health care services for care of both COVID-19 illness (the majority of which was provided in primary care without need for hospitalization) and non–COVID-19 illness [8,21]. The documented early impacts of the COVID-19 pandemic were reductions in the number of patients visiting primary care offices [22], dramatic increases in remote care especially for older patients [22,23], and new strategies to maintain care such as implementing wellness checks for high-risk patients [24,25].

Early in the pandemic, there were reductions in visits for chronic condition management [20,26,27], preventive screening and diagnostic testing [28,29], and changes in physician referral behaviors [30]. The limited availability of testing and coordination of prevention services was a concern among Canadian family physicians [31]. Professional organizations recommended continuation of in-person care during the pandemic for complex chronic conditions and when physical examination was required; however, many patients avoided seeking primary care, and clinics experienced decreased attendance relating to the care of serious conditions [32,33]. Although telemedicine strategies can be effective for some chronic disease monitoring, patients who experience lack of equity in access to health care are also likely to experience barriers to using technology [34-36].

The onset of the pandemic worsened existing challenges to the prospects of achieving and maintaining an adequate level of comprehensive primary care in Canada. Understanding the ways in which the core functions of primary care [37-39] were affected by the COVID-19 pandemic is essential for chronic condition management and for system assessment overall. Although there are reports that the volume of primary care in Canada has largely returned to prepandemic levels, it is not clear whether and for whom there is a need to “catch up” on care for chronic diseases. For practices with a tendency for overuse of testing and investigations, these may have declined to more appropriate levels during the pandemic, also highlighting the areas of practice improvement. The objectives of this study are to describe the impacts of COVID-19 on chronic disease care and to determine whether changes were associated with patients’ sociodemographic characteristics and multimorbidity.


Data Source

The Canadian Primary Care Sentinel Surveillance Network (CPCSSN [40]) is a multidisease electronic medical record (EMR) research and surveillance data repository that securely collects deidentified health information from EMRs of participating primary care clinicians (eg, family physicians and nurse practitioners) who are referred to as “sentinels.” CPCSSN currently brings together 13 primary care research networks for the purposes of research, disease surveillance, and quality improvement, with more networks due to join in the near future. Every 6 months, CPCSSN acquires deidentified patient-level clinical data from primary care EMR systems held by 1583 primary care providers across Canada, with approximately 200 patient encounters per month per physician [20]. CPCSSN acquires most of the data fields in Canadian primary care EMRs with the exceptions of portable document format such as imaging data and the narrative “Subjective, Objective, Assessment, and Planning” notes. The acquired data are processed into a standard format and are made available for surveillance and research [41]. The relative frequency, longitudinal format, and comprehensiveness of CPCSSN data are ideal for the study of changes in practice, through time, in response to significant environmental imperatives, such as public health or research initiatives [41]. Numerous case definition validation studies have been completed [42-44], and the data have also been used to evaluate patterns and quality of health care [19,45].

Study Design

This protocol was designed using the RECORD (REporting of studies Conducted using Observational Routinely collected Data) statement [46]. We will conduct a retrospective closed cohort study with a single group using a pre-post design. We will examine prevention and management activities for exemplar conditions on the basis of having a validated CPCSSN case definition [47,48] (ie, diabetes and heart failure), having substantial prevalence in primary care, and either having high morbidity or being risk factors for morbidity if not well managed. Patient-level data extracted from the CPCSSN repository between 2018 and 2022 will be used to investigate changes in rates of presentation and clinical management of various chronic diseases before, and through the phases of, the pandemic.

Study Population

The study population is all patients who were 18 years and older in 2018, and some analyses will focus on subgroups of patients with specific chronic conditions. We will use the 2-year contact population as recommended previously for defining practice populations for primary care [49]. This method uses contacts within encounter, medication, and billing-related data tables, and has been used previously with CPCSSN data to produce national chronic disease estimates [50]. This method will be used in the period from March 13, 2018, to March 13 2020. We will use this population rather than the full CPCSSN patient population data (dating back more than 2 decades for some networks) to limit the size of the data set, while maintaining the patient population that is likely to have a relationship with a primary care practice during the study period. Although this approach may exclude patients who are younger, healthier, and less likely to seek primary care compared with patients with chronic conditions, we do not expect this to have a major impact on findings because this study focuses on the age group where chronic condition prevalence begins to increase and where screening guidelines apply (eg, diabetes). Therefore, this age group is more likely to see a primary care physician regularly.

People who died during the study period will be included up to the point of death using the death date if captured or the presence of a deceased status with date estimated from the most recent contact in CPCSSN data. Patients who were older than 105 years at the start of the COVID-19 pandemic will be excluded as a possible data error.

Variables of Interest

Primary Exposure

The primary exposure is the start of the pandemic in March 13, 2020. This date was selected as it marks the beginning of Canadian provincial governments responding to the formal declaration of the pandemic by the World Health Organization on March 11, 2020, by enforcing sweeping public health and safety measures. The prepandemic time frame used is defined as June 22, 2018, through March 12, 2020. The pandemic time frame used in this study runs from March 13, 2020, through December 31, 2022. In addition to comparison between these 2 periods, 30-day interval rates will also be calculated for selected outcomes and indicators where possible.

Outcome Definitions and Measures

Outcomes were informed by a large primary care trial on improving prevention and management of chronic conditions in primary care [51], a quality index created for primary care with items measurable in EMRs [52], and consideration of data capture across the networks of CPCSSN. We further conceptualized outcomes according to whether they represent aspects of access, comprehensiveness, or appropriateness (Table 1).

Table 1. Outcomes and outcome measures.
PopulationIndicatorRelated domainData sourcea
Number and types of encountersEncounter, encounter diagnosis, and billing

All patients in our defined cohortOverall number of all encountersAccess

Patients with the CPCSSNb case definition of diabetes and HFcOverall number and types of diabetes-related and HF-related investigationsComprehensiveness
Diagnoses addressed in encountersComprehensiveness and appropriatenessEncounter, encounter diagnosis, and billing

All patientsNumber of different diagnoses addressed per patient per year


Patients with ≥1 condition with the validated CPCSSN case definitionNumber and proportion of chronic conditions (ie, CPCSSN case definitions) addressed by physician at least once a year


Patients with the CPCSSN case definition of diabetes and HFOverall number and types of diabetes-related and HF-related investigations


Patients with the CPCSSN case definition of diabetes and HFProportion of patients with diabetes-related encounter and HF-related encounter every 6 and 12 months (as appropriate for condition)

Services providedComprehensivenessBilling, vaccine, and medication

Patients age ≥65 yearsNumber of patients receiving pneumococcal vaccine and influenza vaccine


Patients with the CPCSSN case definition of diabetes and HFProportion of patients with influenza vaccination

Procedures performedAppropriatenessBilling

Patients with the CPCSSN case definition of diabetesProportion of patients with foot examinations in last 12 months

Physical examinationsAppropriatenessExaminations

All patients in our defined cohort; all patients grouped by CPCSSN case definitionProportion with BPd measured every 6 months or every 12 months (as appropriate for condition)

Referrals made to specialistsComprehensivenessReferral

All patients in our defined cohort; all patients grouped by CPCSSN case definitionOverall number and types of referrals; proportion referred to cardiology, endocrinology (as appropriate for condition)

Investigations performedAppropriatenessLaboratory

All patients in our defined cohortNumber of vitamin D, CBCe, eGFRf, ACRg, and liver function tests performed


Patients with CKDhNumber with and frequency of eGFR and ACR tests


Patients without diabetesNumber with HbA1ci, FBSj measured (screening)


Patients taking or not taking statinsNumber with and frequency of lipid panel/LDLk


Patients taking or not taking levothyroxineNumber with and frequency of TSHl measured


Patients with the CPCSSN case definition of diabetesProportion with HbA1c measured every 6 months and every 12 months

Monitoring resultsAppropriatenessExamination

All patients in our defined cohort; all patients grouped by CPCSSN case definition and ageProportion with BP ≤140/90 or ≤130/80 (as appropriate based on chronic conditions and age); proportion of patients in the following sBPm ranges: ≤130, 131-140, 141-150, 151-160, and >160

MedicationsComprehensiveness and appropriatenessMedication and risk factor

Patients with the CPCSSN case definition of diabetesProportion of patients with and overall number and frequency of metformin prescriptions, insulin prescriptions, and other oral antidiabetic prescriptionsn


Patients with the CPCSSN case definition of HFProportion of patients with and overall number and frequency of β-blocker prescriptions, ARBo prescriptions, and ACE-Ip prescriptions


Patients who smokeNumber of patients with NRTq prescription

aCPCSSN data table.

bCPCSSN: Canadian Primary Care Sentinel Surveillance Network.

cHF: heart failure.

dBP: blood pressure.

eCBC: complete blood count.

feGFR: estimated glomerular filtration rate.

gACR: albumin-to-creatinine ratio.

hCKD: chronic kidney disease.

iHbA1c: hemoglobin A1c.

jFBS: fasting blood sugar.

kLDL: low-density lipoprotein.

lTSH: thyroid-stimulating hormone.

msBP: systolic blood pressure.

nOther oral antidiabetic medications include classes such as sodium-glucose cotransporter-2 inhibitors, sulfonylureas, meglitinides, dipeptidyl peptidase 4 inhibitors, etc.

oARB: angiotensin receptor blocker.

pACE-I: angiotensin-converting enzyme inhibitor.

qNRT: nicotine replacement therapy.

Access to the practice will be measured as the overall number of encounters.

Comprehensiveness refers to primary care addressing “all problems in the population (with short-term referral as needed), except those that are too unusual (generally a frequency of less than 1 or 2 per thousand in the population served) for the primary care practitioner or team to treat competently” [1]. As indicators of comprehensiveness, we will measure number of different diagnoses addressed per patient per year, proportion of patients’ chronic conditions addressed at least once a year, number of pneumococcal vaccines and influenza vaccines in patients 65 years or older, and number of prescriptions for nicotine replacement therapy

Appropriateness will be examined in 2 ways: laboratory tests that are indicated for monitoring of chronic conditions but may be ordered more frequently than necessary (eg, hemoglobin A1c in diabetics) and laboratory tests that are frequently ordered routinely (or for screening purposes) but may be overused in certain populations, including thyroid function tests, vitamin D, albumin-to-creatinine ratio, and lipid panel testing [53]. We hypothesize that some of these tests, while indicated at a base frequency, may be commonly overused; thus, their frequency may have declined during the pandemic.

Diabetes and heart failure are 2 chronic conditions where aspects of care can be reasonably evaluated in CPCSSN. We will describe care across the population in terms of frequency of contacts, laboratory tests and investigations, and medications prescribed that would suggest care that is in step with evidence-based recommendations [54]. For patients with diabetes, we will measure the percentage of patients with a diabetes-related encounter every 6 and 12 months; percent with a foot examination in the last 12 months; percent with a blood pressure measure and hemoglobin A1c test every 6 and 12 months (and results); percent with influenza vaccination; overall number of diabetes-related investigations; percent referred to endocrinology; percent receiving, and number and frequency of metformin, insulin, and other antidiabetic prescriptions. For patients with heart failure, we will measure percentage of patients with heart failure–related encounters every 6 and 12 months; number of investigations (echocardiogram and blood tests); percent with a blood pressure measure every 6 and 12 months (and results); percent with influenza vaccination; percent receiving β-blocker, angiotensin-converting enzyme inhibitors, and angiotensin receptor blockers; and percent referred to cardiology and other specialists.

Statistical Analysis and Power

As of 2018, there were 1.13 million adult patients in the CPCSSN database, with 65% (734,500/1,130,000) having at least 1 chronic condition [55]. A sample size of 1276 paired (pre-post) individuals would be required to detect a change from 50% to 55% of patients experiencing an outcome, with a correlation between paired observations of 0.2 [56]. With a correlation between pairs of 0.1, the required sample size would be 1432. We expect to have adequate sample size to examine changes within specific conditions given the approximate prevalence of hypertension (22%), diabetes (10%), chronic obstructive pulmonary disease (4%), and heart failure (4%) among adults in CPCSSN data or other Canadian data [13,55].

Descriptive Analyses

To describe the cohort, continuous or count variables will be analyzed for their mean, median, SDs, and IQRs. For categorical variables, percentages will be calculated. We will present outcomes stratified by sex, age category (40-49, 50-59, 60-69, and ≥70 years), urban versus rural patient address, and neighborhood income quintile (1-2 [lower] vs 3-5 [higher]).

Analyses of Changes Over Time

We will present the proportions of patients experiencing the outcomes for each time period or mean changes for continuous variables and 95% CIs. Statistical significance of changes from pre to post time period will be assessed using the McNemar test for binary variables, the Wilcoxon signed rank test for original variables, and the paired t test for continuous variables. Regression models appropriate to outcome distributions will be used to control for potential confounders of age (<70 vs ≥70 years), sex, count of comorbidities (CPCSSN-validated conditions), neighborhood income quintile, and CPCSSN network (corresponding to location within Canada). Interactions will be examined in the descriptive analysis and will be considered for inclusion in models if they are found to be relevant. We will present adjusted estimates and 95% CIs for outcomes and parameter estimates for the independent variable and covariates. Analyses will be completed using SAS (version 9.4; SAS Institute, Inc).

Sensitivity Analysis

To examine whether results are biased because of the nonrepresentativeness of the CPCSSN population, we will conduct the analyses on a sample of patients that is representative of the Canadian population based on age, sex, neighborhood socioeconomic status, and rural or urban residence.

Ethics Approval

This study was approved by the Hamilton Integrated Research Ethics Board on April 11, 2022 (project number 14782-C). Because we will be using deidentified data, no consent is required. This study is also registered with ClinicalTrials.gov (NCT05813652).


Study Timeline

The start date of this study was October 5, 2022, and the prospective end date is January 31, 2024. At the time of writing (May 2023), we have finished data cleaning and begun exploratory analyses. As there are known consistencies with CPCSSN data, having a longer exploratory analysis phase has allowed us to liaise with central CPCSSN data managers in order to prepare data for the main analyses. We have now also defined our study cohort: a total of 875,934 individuals between the ages of 18 and 105 years as of 2018 were included.

Future Analyses

We will attempt to extend our analyses to include the first half of 2022 when data become available if our timelines and resources allow. At the time of writing this protocol (May 2023), data were available up to December 2021. The additional 2022 data will allow us to investigate changes in primary care in the later portion of the COVID-19 pandemic, capturing the Omicron wave, and measure whether any changes identified in the earlier portion of the pandemic were sustained or returned to prepandemic patterns of care.

Dissemination

We plan to share knowledge products for patients and the public with the patient advisory committee being created as part of the David Braley Primary Care Research Collaborative at McMaster University, with whom several authors are affiliated. For clinicians, we will create evidence briefs to be shared with the national and provincial colleges of family physicians through social media and our CPCSSN practice-based research network linkages. For researchers and policy and practice decision makers (eg, College of Family Physicians of Canada), we will produce peer-reviewed publications and evidence briefs where we will contextualize the new knowledge against recent research relating to pandemic recovery in health care. The 1- to 2-page evidence briefs will be shared with knowledge users involved in the development and implementation of policies and resources related to pandemic recovery. For patients, we will create infographics and a short video that will raise awareness of the issue of chronic condition care gaps and describe patients’ perspectives. These will be circulated via social media and clinical organizations.


Key Findings

The aim of this study is to help identify signals of change across several domains of primary care, including access, comprehensiveness, and appropriateness, that may have occurred in response to the COVID-19 pandemic. This will be done by investigating the overall number of primary care encounters during the pandemic compared with prepandemic, as well as potential changes in the number of diagnoses addressed during encounters, number of blood pressure measurements, number of vaccines provided, number of blood tests carried out, and so on. Potential changes in indicators specific to the management of chronic conditions will also be investigated, for example, frequency of HbA1c testing for those with diabetes, number and frequency of visits for monitoring of heart failure, and number of prescriptions for diabetes or heart failure. Potential changes in any of these indicators may indicate that gaps in care are present that may benefit from targeted recovery measures.

However, these potential changes in primary care are not inherently negative. For example, many blood tests, examinations, and procedures are considered overused in certain populations and may be conducted more frequently than necessary [53,57,58]. If decreases in number or frequency of these overused tests are identified during the pandemic, this may be considered more appropriate use when compared to prepandemic levels. Furthermore, decreases in frequency of certain primary care interventions may not be clinically significant or necessarily lead to negative health outcomes. Therefore, it is important that each identified change be carefully considered in a broad clinical context before firm conclusions can be drawn.

Strengths and Limitations

The strengths of this study include the use of a large, multiprovince primary care EMR data source, developed to understand the epidemiology of chronic diseases and care in Canadian primary care. The data set is regularly updated and includes coded information on most aspects of primary care practice. The relative currency, longitudinal format, and comprehensiveness of CPCSSN data are ideal for the study of practice changes, through time, in response to significant environmental imperatives, such as the sweeping public health measures put in place during the pandemic [41]. Numerous case definition validation studies have been completed [42,43], and the data have also been used to evaluate patterns and quality of health care [19,45]. CPCSSN has undertaken extensive data cleaning algorithms to address data quality issues [41].

There are limitations in this study. EMR data are collected for clinical and administrative purposes and are not primarily collected for research, which may result in incomplete capture of information. Furthermore, participating sentinel clinics are overrepresented by academic practices [59], and by extension, we cannot be certain to what extent the patients in the CPCSSN data differ from other Canadian primary health care patients. There may be issues of nonparticipation bias and variation in data quality. This study will not provide information on people who are not attached to a primary care provider. As with primary care patients generally, older adults and female individuals are overrepresented in the CPCSSN database as compared with the national population; however, as this study is about changes in care patterns, this data set is representative of the population of interest [59]. Clinical context for some research based on secondary use of EMR data can be difficult to infer. Detailed information on family and living circumstances, ethnicity, language spoken, education, and socioeconomic status is rarely captured in EMRs, so it is more difficult to conduct equity analyses, relying instead on neighbor-level indicators.

Patient and Public Involvement

This research was initially designed and received funding without patient involvement. When the research team presented the data request to the CPCSSN data access committee (May 2022), a patient advisor on the committee provided input. The advisor noted that the proposal was broad in terms of the scope of chronic diseases to be investigated. In response, we refined our analysis plans to examine diabetes and heart failure in greater detail as exemplar diseases. The advisor also suggested that it would be important to consider the changes in the health care system and behaviors of the public over different phases of the pandemic, especially since the Omicron variant.

Conclusions

We anticipate that this study will provide evidence that will inform whether and in what aspects of primary care the COVID-19 pandemic is associated with interruptions that may require attention. It will also highlight gaps or provide reassurance with respect to chronic condition care for populations who were expected to be disproportionately affected by pandemic health care changes such as those who are older or of lower socioeconomic status.

Acknowledgments

The authors would like to sincerely thank Rachael Morkem, Stephanie Garies, Mike Cummings, Chad Herman, and the entire CPCSSN team for their generous help, guidance, and support with this study. This work was supported by the Canadian Institutes of Health Research (grant WI1-179885). The sponsor has no role in study design; collection, management, analysis, and interpretation of data; writing of the report; and the decision to submit the report for publication.

Data Availability

The data set from this study is held securely by CPCSSN, and data sharing agreements prohibit the authors from making the data set publicly available. Researchers can request access to CPCSSN data on their website [60].

Authors' Contributions

MH, DM, ND, M-T L, K A-B, AR, and MV were responsible for the study concept. MH, DM, ND, M-T L, KN, K A-B, SH, KF, and JL contributed to the study design. MH wrote the first draft of the manuscript. DM, ND, M-T L, KN, K A-B, SH, KF, JL, and AR critically revised the manuscript. MH, DM, ND, M-T L, KN, K A-B, SH, KF, JL, and AR approved the final manuscript as submitted.

Conflicts of Interest

M-TL declares having received consultation fees from le Collège des médecins du Québec and sits on the board for a small research and communications company. Neither of these have any direct link to this project or manuscript.

Multimedia Appendix 1

Peer review report by Canadian Institutes of Health Research (Canada).

PDF File (Adobe PDF File), 222 KB

  1. Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q. 2005;83(3):457-502. [FREE Full text] [CrossRef] [Medline]
  2. OECD. Realising the Potential of Primary Health Care. OECD Health Policy Studies. Paris. OECD Publishing; 2020. URL: https:/​/www.​oecd-ilibrary.org/​social-issues-migration-health/​realising-the-potential-of-primary-health-care_a92adee4-en [accessed 2023-06-13]
  3. Kidd M, editor. The Contribution of Family Medicine to Improving Health Systems: A Guidebook from the World Organization of Family Doctors, 1st edn. London. CRC Press; 2013.
  4. Kolber MR, Korownyk CS, Young J, Garrison S, Kirkwood J, Allan GM. The value of family medicine: an impossible job, done impossibly well. Can Fam Physician. 2023;69(4):269-270. [FREE Full text] [CrossRef] [Medline]
  5. Basu S, Berkowitz SA, Phillips RL, Bitton A, Landon BE, Phillips RS. Association of primary care physician supply with population mortality in the United States, 2005-2015. JAMA Intern Med. 2019;179(4):506-514. [FREE Full text] [CrossRef] [Medline]
  6. Chang C, O'Malley AJ, Goodman DC. Association between temporal changes in primary care workforce and patient outcomes. Health Serv Res. 2017;52(2):634-655. [FREE Full text] [CrossRef] [Medline]
  7. Mangin D. The contribution of primary care research to improving health services. In: Goodyear-Smith F, Mash B, editors. International Perspectives on Primary Care Research. London. CRC Press; 2017;67-72.
  8. Hajat C, Stein E. The global burden of multiple chronic conditions: a narrative review. Prev Med Rep. 2018;12:284-293. [FREE Full text] [CrossRef] [Medline]
  9. Rothman AA, Wagner EH. Chronic illness management: what is the role of primary care? Ann Intern Med. 2003;138(3):256-261. [CrossRef] [Medline]
  10. Aggarwal M, Hutchison BG. Toward a Primary Care Strategy for Canada. Ottawa, ON. Canadian Foundation for Healthcare Improvement; 2012.
  11. Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet. 2012;380(9836):37-43. [FREE Full text] [CrossRef] [Medline]
  12. Lunney JR, Lynn J, Foley DJ, Lipson S, Guralnik JM. Patterns of functional decline at the end of life. JAMA. 2003;289(18):2387-2392. [FREE Full text] [CrossRef] [Medline]
  13. Heart disease in Canada: highlights from the Canadian Chronic Disease Surveillance System. Public Health Agency of Canada. 2017. URL: https:/​/www.​canada.ca/​en/​public-health/​services/​publications/​diseases-conditions/​heart-disease-canada-fact-sheet.​html [accessed 2023-06-13]
  14. Asthma and chronic obstructive pulmonary disease (COPD) in Canada, 2018: report from the Canadian Chronic Disease Surveillance System. Public Health Agency of Canada. 2018. URL: https:/​/www.​canada.ca/​en/​public-health/​services/​publications/​diseases-conditions/​asthma-chronic-obstructive-pulmonary-disease-canada-2018.​html [accessed 2023-06-13]
  15. Arora P, Vasa P, Brenner D, Iglar K, McFarlane P, Morrison H, et al. Prevalence estimates of chronic kidney disease in Canada: results of a nationally representative survey. CMAJ. 2013;185(9):E417-E423. [FREE Full text] [CrossRef] [Medline]
  16. Benipal H, Wang X, Austin PC, Lee DS, Demers C. Uptake of the heart failure management incentive billing code by family physicians in Ontario, Canada: a retrospective cohort study. Can J Cardiol. 2021;37(3):508-512. [CrossRef] [Medline]
  17. Quinn KL, Bell CM. Closer to the heart: incentivizing improved care and outcomes for patients with heart failure. Can J Cardiol. 2021;37(3):372-373. [CrossRef] [Medline]
  18. Cho EE, Mecredy GC, Wong HH, Stanbrook MB, Gershon AS. Which physicians are taking care of people with COPD? Chest. 2019;155(4):771-777. [CrossRef] [Medline]
  19. Bello AK, Ronksley PE, Tangri N, Kurzawa J, Osman MA, Singer A, et al. Quality of chronic kidney disease management in Canadian primary care. JAMA Netw Open. 2019;2(9):e1910704. [FREE Full text] [CrossRef] [Medline]
  20. Stephenson E, Butt DA, Gronsbell J, Ji C, O'Neill B, Crampton N, et al. Changes in the top 25 reasons for primary care visits during the COVID-19 pandemic in a high-COVID region of Canada. PLoS One. 2021;16(8):e0255992. [FREE Full text] [CrossRef] [Medline]
  21. Roberts KC, Rao DP, Bennett TL, Loukine L, Jayaraman GC. Prevalence and patterns of chronic disease multimorbidity and associated determinants in Canada. Health Promot Chronic Dis Prev Can. 2015;35(6):87-94. [FREE Full text] [CrossRef] [Medline]
  22. Glazier RH, Green ME, Wu FC, Frymire E, Kopp A, Kiran T. Shifts in office and virtual primary care during the early COVID-19 pandemic in Ontario, Canada. CMAJ. 2021;193(6):E200-E210. [FREE Full text] [CrossRef] [Medline]
  23. Tu K, Kristiansson RS, Gronsbell J, de Lusignan S, Flottorp S, Goh LH, et al. INTRePID. Changes in primary care visits arising from the COVID-19 pandemic: an international comparative study by the International Consortium of Primary Care Big Data Researchers (INTRePID). BMJ Open. 2022;12(5):e059130. [FREE Full text] [CrossRef] [Medline]
  24. Bhatti S, Commisso E, Rayner J. A rapid primary healthcare response to COVID-19: an equity-based and systems-thinking approach to care ensuring that no one is left behind. Healthc Q. 2020;23(3):29-33. [CrossRef] [Medline]
  25. Ashcroft R, Donnelly C, Gill S, Dancey M, Lam S, Grill AK, et al. The delivery of patient care in Ontario's family health teams during the first wave of the COVID-19 pandemic. Healthc Policy. 2021;17(2):72-89. [FREE Full text] [CrossRef] [Medline]
  26. de Mestral C, Gomez D, Wilton AS, Lee DS, Albalawi Z, Austin PC, et al. A population-based analysis of diabetes-related care measures, foot complications, and amputation during the COVID-19 pandemic in Ontario, Canada. JAMA Netw Open. 2022;5(1):e2142354. [FREE Full text] [CrossRef] [Medline]
  27. Carr MJ, Wright AK, Leelarathna L, Thabit H, Milne N, Kanumilli N, et al. Impact of COVID-19 on diagnoses, monitoring, and mortality in people with type 2 diabetes in the UK. Lancet Diabetes Endocrinol. 2021;9(7):413-415. [FREE Full text] [CrossRef] [Medline]
  28. Laing S, Johnston S. Estimated impact of COVID-19 on preventive care service delivery: an observational cohort study. BMC Health Serv Res. 2021;21(1):1107. [FREE Full text] [CrossRef] [Medline]
  29. Walker MJ, Meggetto O, Gao J, Espino-Hernández G, Jembere N, Bravo CA, et al. Measuring the impact of the COVID-19 pandemic on organized cancer screening and diagnostic follow-up care in Ontario, Canada: a provincial, population-based study. Prev Med. 2021;151:106586. [FREE Full text] [CrossRef] [Medline]
  30. Urbach DR, Martin D. Confronting the COVID-19 surgery crisis: time for transformational change. CMAJ. 2020;192(21):E585-E586. [FREE Full text] [CrossRef] [Medline]
  31. Vaughan C, Lukewich J, Mathews M, Marshall EG, Hedden L, Spencer S, et al. Family physicians' perspectives on the impact of COVID-19 on preventative care in primary care: findings from a qualitative study. Fam Pract. 2022:cmac113. [FREE Full text] [CrossRef] [Medline]
  32. Frankfurter C, Buchan TA, Kobulnik J, Lee DS, Luk A, McDonald M, et al. Reduced rate of hospital presentations for heart failure during the COVID-19 pandemic in Toronto, Canada. Can J Cardiol. 2020;36(10):1680-1684. [FREE Full text] [CrossRef] [Medline]
  33. Bres Bullrich M, Fridman S, Mandzia JL, Mai LM, Khaw A, Vargas Gonzalez JC, et al. COVID-19: stroke admissions, emergency department visits, and prevention clinic referrals. Can J Neurol Sci. 2020;47(5):693-696. [FREE Full text] [CrossRef] [Medline]
  34. Eberly LA, Khatana SAM, Nathan AS, Snider C, Julien HM, Deleener ME, et al. Telemedicine outpatient cardiovascular care during the COVID-19 pandemic: bridging or opening the digital divide? Circulation. 2020;142(5):510-512. [FREE Full text] [CrossRef] [Medline]
  35. Nouri S, Khoong E, Lyles C, Karliner L. Addressing equity in telemedicine for chronic disease management during the covid-19 pandemic. NEJM Catal. 2020;1(3):1-13. [FREE Full text]
  36. Agarwal P, Wang R, Meaney C, Walji S, Damji A, Gill N, et al. Sociodemographic differences in patient experience with primary care during COVID-19: results from a cross-sectional survey in Ontario, Canada. BMJ Open. 2022;12(5):e056868. [FREE Full text] [CrossRef] [Medline]
  37. Kiran T. Keeping the front door open: ensuring access to primary care for all in Canada. CMAJ. 2022;194(48):E1655-E1656. [FREE Full text] [CrossRef] [Medline]
  38. Kiran T, Green ME, Wu CF, Kopp A, Latifovic L, Frymire E, et al. Family physicians stopping practice during the COVID-19 pandemic in Ontario, Canada. Ann Fam Med. 2022;20(5):460-463. [FREE Full text] [CrossRef] [Medline]
  39. Kiran T, Wang R, Handford C, Laraya N, Eissa A, Pariser P, et al. Family physician practice patterns during COVID-19 and future intentions: cross-sectional survey in Ontario, Canada. Can Fam Physician. 2022;68(11):836-846. [FREE Full text] [CrossRef] [Medline]
  40. Canada’s first multi-disease electronic medical record surveillance system. CPCSSN. URL: https://cpcssn.ca/ [accessed 2023-06-18]
  41. Garies S, Birtwhistle R, Drummond N, Queenan J, Williamson T. Data resource profile: national electronic medical record data from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN). Int J Epidemiol. 2017;46(4):1091-1092f. [FREE Full text] [CrossRef] [Medline]
  42. Bello AK, Ronksley PE, Tangri N, Kurzawa J, Osman MA, Singer A, et al. Prevalence and demographics of CKD in Canadian primary care practices: a cross-sectional study. Kidney Int Rep. 2019;4(4):561-570. [FREE Full text] [CrossRef] [Medline]
  43. Williamson T, Green ME, Birtwhistle R, Khan S, Garies S, Wong ST, et al. Validating the 8 CPCSSN case definitions for chronic disease surveillance in a primary care database of electronic health records. Ann Fam Med. 2014;12(4):367-372. [FREE Full text] [CrossRef] [Medline]
  44. Cave AJ, Soos B, Gillies C, Drummond N, Pham ANQ, Williamson T. Validating a case definition for adult asthma in primary care electronic medical records. NPJ Prim Care Respir Med. 2020;30(1):24. [FREE Full text] [CrossRef] [Medline]
  45. Greiver M, Kalia S, Voruganti T, Aliarzadeh B, Moineddin R, Hinton W, et al. Trends in end digit preference for blood pressure and associations with cardiovascular outcomes in Canadian and UK primary care: a retrospective observational study. BMJ Open. 2019;9(1):e024970. [FREE Full text] [CrossRef] [Medline]
  46. Benchimol EI, Smeeth L, Guttmann A, Harron K, Moher D, Petersen I, et al. RECORD Working Committee. The REporting of studies Conducted using Observational Routinely-collected health Data (RECORD) statement. PLoS Med. 2015;12(10):e1001885. [FREE Full text] [CrossRef] [Medline]
  47. Williamson T. CPCSSN disease definitions: Canadian Primary Care Sentinel Surveillance Network. CPCSSN RCSSSP. 2014. URL: https://cpcssn.ca/wp-content/uploads/2014/07/CPCSSN_DiseaseDefinitionsFINAL_July16-2014.pdf [accessed 2023-06-13]
  48. CPCSSN Team. Case Definitions: Canadian Primary Care Sentinel Surveillance Network (CPCSSN), Version 2022-Q4. CPCSSN RCSSSP. 2023. URL: https://cpcssn.ca/wp-content/uploads/2023/03/CPCSSN-Case-Definitions-2022-Q4_v2.pdf [accessed 2023-06-13]
  49. Menec V, Black C, Roos NP, Bogdanovic BB, Reid R. Defining Practice Populations for Primary Care: Methods and Issues. Winnipeg, Manitoba. Manitoba Centre for Health Policy and Evaluation; 2000.
  50. Garies S, Cummings M, Marasignhe DH, Queenan J. Methods for defining a patient denominator in the Canadian Primary Care Sentinel Surveillance Network (CPCSSN) database: recommendations for best practices. Internal Quality Improvement Report for CPCSSN. 2021. URL: https://acfp.ca/wp-content/uploads/2021/02/741-Garies_2021-FMS-Denominator-FINAL5.pdf [accessed 2023-06-13]
  51. Grunfeld E, Manca D, Moineddin R, Thorpe KE, Hoch JS, Campbell-Scherer D, et al. BETTER Trial Investigators. Improving chronic disease prevention and screening in primary care: results of the BETTER pragmatic cluster randomized controlled trial. BMC Fam Pract. 2013;14:175. [FREE Full text] [CrossRef] [Medline]
  52. Nietert PJ, Wessell AM, Jenkins RG, Feifer C, Nemeth LS, Ornstein SM. Using a summary measure for multiple quality indicators in primary care: the summary QUality InDex (SQUID). Implement Sci. 2007;2:11. [FREE Full text] [CrossRef] [Medline]
  53. Family medicine: thirteen tests and treatments to question. Choosing Wisely Canada. 2023. URL: https://choosingwiselycanada.org/recommendation/family-medicine/#report [accessed 2023-06-01]
  54. Jain R, Stone JA, Agarwal G, Andrade JG, Bacon SL, Bajaj HS, et al. Canadian Cardiovascular Harmonized National Guideline Endeavour (C-CHANGE) guideline for the prevention and management of cardiovascular disease in primary care: 2022 update. CMAJ. 2022;194(43):E1460-E1480. [FREE Full text] [CrossRef] [Medline]
  55. Queenan JA, Wong ST, Barber D, Morkem R, Salman A. The prevalence of common chronic conditions seen in Canadian Primary Care: results from the Canadian Primary Care Sentinel Surveillance Network. CPCSSN RCSSSP. 2021. URL: https://cpcssn.ca/wp-content/uploads/2021/05/cpcssn-chronic-conditions-report-2021.pdf [accessed 2023-06-13]
  56. Sample size calculator for comparing two paired proportions. Statulator. 2014. URL: http://statulator.com/SampleSize/ss2PP.html [accessed 2023-06-13]
  57. Moynihan R, Doust J, Henry D. Preventing overdiagnosis: how to stop harming the healthy. BMJ. 2012;344:e3502. [CrossRef] [Medline]
  58. Canadian Institute of Health Information. Unnecessary Care in Canada. Ottawa, ON. Canadian Institute for Health Information; 2017.
  59. Queenan JA, Williamson T, Khan S, Drummond N, Garies S, Morkem R, et al. Representativeness of patients and providers in the Canadian primary care sentinel surveillance network: a cross-sectional study. CMAJ Open. 2016;4(1):E28-E32. [FREE Full text] [CrossRef] [Medline]
  60. Data access request. CPCSSN. URL: https://cpcssn.ca/dar/ [accessed 2023-06-18]


CPCSSN: Canadian Primary Care Sentinel Surveillance Network
EMR: electronic medical record
RECORD: REporting of studies Conducted using Observational Routinely collected Data


Edited by A Mavragani; The proposal for this study was peer-reviewed by the Canadian Institutes of Health Research (Canada). See the Multimedia Appendix for the peer-review report; submitted 24.05.23; accepted 06.06.23; published 21.07.23.

Copyright

©Michelle Howard, Kris Aubrey-Bassler, Neil Drummond, Marie-Thérèse Lussier, John A Queenan, Meredith Vanstone, Kathryn Nicholson, Amanda Ramdyal, Jennifer Lawson, Shuaib Hafid, Karla Freeman, Rebecca Clark, Dee Mangin. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 21.07.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.