Protocol
Abstract
Background: Postacute sequelae of COVID-19 (PASC) remain understudied in nonhospitalized patients. Digital wearables allow for a continuous collection of physiological parameters such as respiratory rate and oxygen saturation that have been predictive of disease trajectories in hospitalized patients.
Objective: This protocol outlines the design and procedures of a prospective, longitudinal, observational study of PASC that aims to identify wearables-collected physiological parameters that are associated with PASC in patients with a positive diagnosis.
Methods: This is a single-arm, prospective, observational study of a cohort of 550 patients, aged 18 to 65 years, male or female, who own a smartphone or a tablet that meets predetermined Bluetooth version and operating system requirements, speak English, and provide documentation of a positive COVID-19 test issued by a health care professional within 5 days before enrollment. The primary end point is long COVID-19, defined as ≥1 symptom at 3 weeks beyond the first symptom onset or positive diagnosis, whichever comes first. The secondary end point is chronic COVID-19, defined as ≥1 symptom at 12 weeks beyond the first symptom onset or positive diagnosis. Participants must be willing and able to consent to participate in the study and adhere to study procedures for 6 months.
Results: The first patient was enrolled in October 2021. The estimated year for publishing the study results is 2025.
Conclusions: This is a fully decentralized study investigating PASC using wearable devices to collect physiological parameters and patient-reported outcomes. The study will shed light on the duration and symptom manifestation of PASC in nonhospitalized patient subgroups and is an exemplar of the use of wearables as population-level monitoring health tools for communicable diseases.
Trial Registration: ClinicalTrials.gov NCT04927442; https://clinicaltrials.gov/study/NCT04927442
International Registered Report Identifier (IRRID): DERR1-10.2196/57382
doi:10.2196/57382
Keywords
Introduction
Long-term health consequences have been identified as a core outcome domain for studies of patients with COVID-19 [
]. Dubbed as “long covid” [ ] (or post–COVID-19 condition), postacute sequelae of COVID-19 (PASC) have been described on social media and in news media [ , ]. These reports referred to experiences of patients who take longer than normal time to recover or have more than 1 symptom that persists or develops after recovery [ , ]. This prompted calls to investigate the “prevalence, type, duration, and severity of persistent symptoms following resolution of acute SARS-CoV-2 infection, [and] risk factors associated with their development” [ ]. Definitions of PASC varied depending on the onset and duration of symptoms, number and clustering of symptoms, patient population, and possibility of alternative explanations [ - ]. Heterogeneity in defining PASC translated into varying prevalence estimates, ranging from 43% to 80% in systematic reviews and meta-analyses of PASC among patients with COVID-19 at ~1+ month after infection [ - ]. Currently, the World Health Organization (WHO) defines PASC as a [ ] “condition...in individuals with a history of probable or confirmed SARS CoV-2 infection, usually 3 months from the onset of COVID-19 with symptoms and that last for at least 2 months and cannot be explained by an alternative diagnosis.”Patient-reported outcomes (PROs) and clinical evaluations show that patients with COVID-19 exhibit long-term health complications, regardless of initial disease severity [
- ], attributed to several hypothesized biological mechanisms [ , , ]. These biological mechanisms include persistent viral reservoirs, sustained autoimmune and inflammatory responses, gut microbiome dysbiosis, endothelial dysfunction, and neurological signaling dysfunction [ , ]. PASC symptoms include fatigue, memory loss, and chest and abdominal pain, among 200+ other symptoms that affect multiple organs and systems [ , - ], whereas emergent conditions include diabetes and hypertension [ , ]. Corroborating evidence shows persistent symptoms in recovered patients of other coronaviruses [ , ] and postviral chronic syndromes (eg, myalgic encephalomyelitis/chronic fatigue syndrome) [ ]. Evidence of PASC is based on data primarily from hospitalized patients [ , , - ] and minimally from nonhospitalized patients [ , ], who represent ~20% and 80% of patients with COVID-19, respectively [ ]. Longitudinal studies of PASC are limited because they have single-time outcome measurements [ ], sparsely spaced data collection intervals, or short follow-ups (eg, [ , , , ]). Furthermore, studies focus on single symptoms or symptom clusters (eg, [ ]), while few report psychological and well-being outcomes (eg, [ , - , ]). This raises the need for prospective longitudinal studies of nonhospitalized patients with COVID-19 with extended follow-ups to understand the nature, duration, and multisymptom manifestation of PASC [ , ].Wearable devices continuously capture physiological parameters, which have been beneficial in detecting COVID-19 and monitoring its acute-phase symptoms [
- ]. These studies show that physiological, sleep, and activity parameters differ in the preinfection versus acute phases of the disease, symptomatic versus asymptomatic patients, and patients with COVID-19 versus healthy people. Physiological parameters collected via wearables parallel clinical indicators (eg, elevated respiratory rate) [ ] and self-reported symptoms (eg, shortness of breath) [ ] documented in patients and are associated with PASC [ , ]. Wearables-based studies of PASC are scarce and have short follow-ups [ , ]. COVID-19 wearables studies have several limitations including a focus on select parameters (eg, [ , ]); use of custom or specialized devices (eg, [ , ]), which limits their applicability and population-level impact; or recruitment of participants who already own wearable devices (eg, [ , ]), thereby introducing between-device variations in parameter calculations and self-selection biases [ ].This protocol outlines the design, objectives, and procedures of a 6-month decentralized prospective, observational study of PASC in a cohort of 550 nonhospitalized patients with a confirmed positive COVID-19 diagnosis.
Methods
Design
This is a single-arm, prospective, observational study of PASC in a cohort of 550 nonhospitalized patients with a positive COVID-19 diagnosis.
Objective
The study aims to identify physiological parameters collected by wearable devices that are associated with PASC.
End Points
The primary end point is long COVID-19, defined as 1 or more symptom at 3 weeks from date of the first symptom onset or positive diagnosis, whichever comes first. The secondary end point is chronic COVID-19, defined as 1 or more symptom at 12 weeks from symptom onset or positive diagnosis [
, - ].Hypothesis
There is an association between physiological parameters collected by wearable devices and patient-reported long or chronic COVID-19.
Population
A total of 550 patients will be recruited based on the demographic composition of the US population (
) [ ]. A prospective research volunteer (PRV) must meet all the inclusion criteria to be eligible for enrollment. The inclusion criteria are, first, male or female adults, aged 18 to 65 years. The pediatric population younger than 18 years of age is excluded because it differs from adults who are 18 years or older in infection rates, symptom manifestation, and outcomes [ ]. The older than 65 years of age population is excluded because of its high-risk status, which prompted protections to reduce transmission among the older population, especially in nursing homes [ , ]. The second criterion is documentation of a SARS-CoV-19 polymerase chain reaction or antigen or rapid positive test, fewer than or 5 days before enrollment, issued by a public or private health care or COVID-19 testing facility, provider, or practitioner. The third criterion is ownership of or access to a smartphone or tablet, with an existing cellular data plan, that is compliant with the following specifications: (1) Android devices with an operating system of 6.0 or newer; Bluetooth 4.2, 5.x, or 6.0; and that implement Bluetooth Low Energy standard; (2) iPhone 6s or 6s plus (Apple) or newer; and (3) iPad mini 4 or newer, iPad 5th generation or newer, iPad Air 2 (second generation or newer), iPad Pro (9.7”, 10.5”, 11” first generation or newer), or 12.9-inch iPad Pro first generation or newer. The fourth criterion is English language proficiency. Non-English speakers will be unable to use the study mobile app, which is available only in English. The fifth criterion is the ability to understand and willingness to consent to participate. The sixth criterion is stated willingness to comply with all study procedures and availability for study duration. Finally, agreement to adhere to lifestyle considerations throughout the study (eg, wearing the wristband and temperature patch) is needed.Ethnicity and race | US population, n (%) | Study sample, n (%)c | ||||||||||||
Malea | Femalea | Totalb | Male | Female | Total | |||||||||
Non-Hispanic or Latino | ||||||||||||||
White | 61,422,351 (50.1) | 61,189,372 (49.9) | 122,611,723 (73) | 164 (50.2) | 163 (49.8) | 327 (73) | ||||||||
Black | 13,264,328 (48.1) | 14,324,175 (51.9) | 27,588,503 (16.4) | 36 (48.6) | 38 (51.4) | 74 (16.4) | ||||||||
American Indian and Alaska Native | 1,311,132 (48.8) | 1,376,957 (51.2) | 2,688,089 (1.6) | 3 (42.9) | 4 (57.1) | 7 (1.6) | ||||||||
Asian | 6,788,614 (47.8) | 7,418,266 (52.2) | 14,206,880 (8.5) | 18 (47.4) | 20 (52.6) | 38 (8.5) | ||||||||
Native Hawaiian and Pacific Islander | 376,873 (50) | 377,530 (50) | 754,403 (0.4) | 1 (50) | 1 (50) | 2 (0.4) | ||||||||
Total | 83,163,298 (49.5) | 84,686,300 (50.5) | 167,849,598 (100) | 222 (49.6) | 226 (50.4) | 448 (81.4)d | ||||||||
Hispanic or Latino | ||||||||||||||
White | 17,271,789 (51.1) | 16,500,664 (48.9) | 33,772,453 (88) | 46 (51.7) | 43 (48.3) | 89 (88) | ||||||||
Black | 1,073,954 (48.9) | 1,122,733 (51.1) | 2,196,687 (5.7) | 3 (50) | 3 (50) | 6 (5.7) | ||||||||
American Indian and Alaska Native | 809,646 (52.1) | 743,289 (47.9) | 1,552,935 (4) | 2 (50) | 2 (50) | 4 (4) | ||||||||
Asian | 306,995 (49.7) | 311,194 (50.3) | 618,189 (1.6) | 1 (50) | 1 (50) | 2 (1.6) | ||||||||
Native Hawaiian and Pacific Islander | 116,272 (51.6) | 108,954 (48.4) | 225,226 (0.6) | 1 (100) | N/Ae | 1 (0.6) | ||||||||
Total | 19,578,656 (51) | 18,786,834 (49) | 38,365,490 (100) | 53 (52.0) | 49 (48.0) | 102 (18.6)d |
a“Male” and “Female” cells for US population represent the percentage of each sex out of the total population by race or ethnicity (eg, percentage male individuals out of the total non-Hispanic or Latino White population).
b“Total” columns for US population represent the percentage of each race out of the total population by ethnicity (eg, percentage of White individuals out of the total non-Hispanic or Latino population).
cCells for the study sample shown for each racial and ethnic category by sex based on US population aged 18 to 64 years for a sample of 550 patients.
dCells represent total and percentage of the 550 target sample.
eN/A: not applicable.
An individual who meets any of the exclusion criteria is not eligible to enroll. The exclusion criteria are (1) residence outside of the US mainland, (2) enrollment in clinical trials on experimental COVID-19 therapeutics at baseline, (3) requirement of hospitalization at enrollment, (4) known history of allergic reaction to adhesives, and (5) inability to consent and unwillingness to comply with study procedures (eg, downloading a mobile app and sharing the data with the research team and providing required data such as close kin contact information).
Recruitment
The Office of Patient Recruitment (OPR) created all recruitment materials and advertised the study in print and on the National Institutes of Health (NIH) Clinical Center television monitors and website [
]. Commercial marketing venues are used depending on recruitment pace and funding availability. Additionally, we partnered with Fulgent Genetics, a company that administers COVID-19 testing in Los Angeles, California. As part of their scheduling for COVID-19 testing, patients who express interest in participating in research studies are asked “would you be interested in sharing information you submitted during this registration process with researchers so they can contact you about studies?”Only information about patients who have agreed to be contacted is accessed. Outreach activities are engaged in to increase the enrollment of minorities.
Study Procedures
PRVs contact OPR’s recruitment center by phone or email. OPR’s staff screens interested PRVs for initial eligibility using yes or no questions. OPR staff shares basic demographic and contact information of eligible PRVs with the study team. PRVs who reach out directly to us or are part of Fulgent Genetics’ patient database receive an email and text invitation to enroll in the study, which includes a link to a proactive recruitment survey with yes or no questions like those that OPR uses to determine the initial PRV eligibility. These initial screening questions are about (1) PRV’s age; (2) having a confirmed positive COVID-19 test within the past 72 hours, which leaves us 2 additional days to enroll PRVs within the 5-day eligibility window; (3) having an Apple or Android smartphone or tablet with brand and model information; and (4) willingness to comply with study procedures. Initial screening occurs before patients provide an informed consent (IC) to participate in the study.
PRVs who pass the initial screening receive a welcome email inviting them to schedule an enrollment appointment. The email includes a link to an electronic IC, which states that this is a research study and outlines the schedule of activities (
), risks and benefits to patients, and the voluntary and confidential nature of participation. The IC emphasizes that the study wearable devices should not be the basis of any medical decisions. During the appointment, we review the IC with patients who are given opportunities to ask questions and request time to consult with their families or physicians before consenting to participate. Patients who eConsent to participate undergo eligibility verification and are enrolled only if they meet all inclusion criteria and none of the exclusion criteria. Patients who have ≤4 GBs per person on their monthly cellular data plan and limited access to personal Wi-Fi are provided US $60 gift cards to purchase additional GBs from their phone carrier.Procedures | Preenrollment | Enrollment, day 0 | Day 1-30 | Day 31-60 | Day 61-90 | Day 91-120 | Day 121-150 | Day 151-180 |
Screening | ✓ | |||||||
Informed consent | ✓ | |||||||
Eligibility verification | ✓ | |||||||
Baseline questionnaire | ✓ | |||||||
Physiological data collection (number of days) | 30✓ | 8✓ | 8✓ | 8✓ | 8✓ | 8✓ | ||
Ecological momentary assessments (number of EMAsa) | 30✓ | 4✓ | 4✓ | 4✓ | 4✓ | 4✓ | ||
Monthly survey (number of surveys) | 1✓ | 1✓ | 1✓ | 1✓ | 1✓ | 1✓ | ||
Adverse outcomes survey (as applicable) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ||
Technical or general support (patient-initiated) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
aEMA: ecological momentary assessment.
Upon enrollment, patients are assigned a study ID and mobile app log-in credentials, which ensures patients do not use personal identifiable information to create an app account. Using the enrollment date, Research Electronic Data Capture (REDCap; Vanderbilt University) generates calendar dates that correspond to preloaded randomized data collection schedules that map the days on which each patient must perform study activities over 6 months (
). The first day of device wearing starts on the third calendar day post enrollment to allow time for shipping an enrollment kit. During the first month, patients are required to wear a wristband and a temperature patch around the clock and answer a daily 2-question ecological momentary assessment (EMA). For months 2 to 6, patients are required to wear a wristband only for randomly selected 20 pairs of 2 consecutive days, resulting in an additional 40 device-wearing days in total. The schedule has a minimum of 48 hours buffer between 2 consecutive device-wearing periods, an approximately equal representation of weekdays and weekends where each day of the week appears 5 or 6 times during months 2 to 6, and an equal number of device-wearing days each month (ie, 8 days). For each 48-hour device-wearing period, patients answer a 2-question EMA. Patients are encouraged to wear the wristband and temperature patch upon receiving the enrollment kit, to wear the wristband beyond the 8 scheduled days per month during months 2 to 6, and to make up missed device-wearing days.Month and data collection days | Frequency and timing of study activities | |||||||
Device wearing | EMAsb | Monthly survey (once) | ||||||
Month 1 (daily) | On April 2, 2023 | |||||||
Days 1-30 | From March 4, 2023, to April 2, 2023 | From March 4, 2023, to April 2, 2023 | ||||||
Month 2 (4 times) | On May 2, 2023 | |||||||
Days 31 and 32 | From wake up on April 4, 2023, to wake up on April 6, 2023 | On April 6, 2023 | ||||||
Days 33 and 34 | From wake up on April 10, 2023, to wake up on April 12, 2023 | On April 12, 2023 | ||||||
Days 35 and 36 | From wake up on April 19, 2023, to wake up on April 21, 2023 | On April 21, 2023 | ||||||
Days 37 and 38 | From wake up on April 28, 2023, to wake up on April 30, 2023 | On April 30, 2023 | ||||||
Month 3 (4 times) | On June 1, 2023 | |||||||
Days 39 and 40 | From wake up on May 8, 2023, to wake up on May 10, 2023 | On May 10, 2023 | ||||||
Days 41 and 42 | From wake up on May 16, 2023, to wake up on May 18, 2023 | On May 18, 2023 | ||||||
Days 43 and 44 | From wake up on May 20, 2023, to wake up on May 22, 2023 | On May 22, 2023 | ||||||
Days 45 and 46 | From wake up on May 28, 2023, to wake up on May 30, 2023 | On May 30, 2023 | ||||||
Month 4 (4 times) | On July 1, 2023 | |||||||
Days 47 and 48 | From wake up on June 4, 2023, to wake up on June 6, 2023 | On June 6, 2023 | ||||||
Days 49 and 50 | From wake up on June 9, 2023, to wake up on June 11, 2023 | On June 11, 2023 | ||||||
Days 51 and 52 | From wake up on June 14, 2023, to wake up on June 16, 2023 | On June 16, 2023 | ||||||
Days 53 and 54 | From wake up on June 28, 2023, to wake up on June 30, 2023 | On June 30, 2023 | ||||||
Month 5 (4 times) | On July 31, 2023 | |||||||
Days 55 and 56 | From wake up on July 6, 2023, to wake up on July 8, 2023 | On July 8, 2023 | ||||||
Days 57 and 58 | From wake up on July 10, 2023, to wake up on July 12, 2023 | On July 12, 2023 | ||||||
Days 59 and 60 | From wake up on July 20, 2023, to wake up on July 22, 2023 | On July 22, 2023 | ||||||
Days 61 and 62 | From wake up on July 25, 2023, to wake up on July 27, 2023 | On July 27, 2023 | ||||||
Month 6 (4 times) | On August 18, 2023 | |||||||
Days 63 and 64 | From wake up on August 4, 2023, to wake up on August 6, 2023 | On August 6, 2023 | ||||||
Days 65 and 66 | From wake up on August 12, 2023, to wake up on August 14, 2023 | On August 14, 2023 | ||||||
Days 67 and 68 | From wake up on August 19, 2023, to wake up on August 21, 2023 | On August 21, 2023 | ||||||
Days 69 and 70 | From wake up on August 24, 2023, to wake up on August 26, 2023 | On August 26, 2023 |
aSchedule is based on an enrollment date of March 1, 2023. Participation in the study is for 6 months with a total of 70 days of digital device wearing. In the first month, patients are required to wear a wristband and temperature patch, then only the wristband in months 2 to 6.
bEMA: ecological momentary assessment.
Patients are asked to complete 1 baseline and 6 monthly surveys. The baseline does not expire but patients are encouraged to complete it instantly after their enrollment appointment. Monthly surveys remain open for 12 days. Patients receive their data collection schedule, mobile app log-in credentials, and link to the baseline survey during their enrollment appointment. This allows us to verify that patients are receiving our electronic communications and to review these elements with them. We ship each patient an enrollment kit overnight, which includes (1) a print copy of their data collection schedule and their username for the mobile app account; (2) a wristband, charger, and sweatband; (3) a temperature patch, charger with batteries, and adhesives to secure the patch onto one’s body; (4) information sheet with first-time device set up instructions, data sync, and troubleshooting tips; (5) clinical trials informational sheet; and (6) a prepaid return slip with complete address information to ship back any defective devices.
For patients with no incoming wearables data and EMA responses for 3 consecutive days during the first month or 2 consecutive data collection periods during months 2 to 6, we attempt to contact patients to counsel them on the importance of adhering to their assigned study schedule. If we fail to reach a patient, we contact their close kin to complete an adverse events survey. Hospitalized patients are allowed to resume their participation in the study upon discharge and will complete an adverse events survey on their hospital stay. Upon completing the study, patients receive an end-of-study email thanking them and instructing them on how to create a personal mobile app account to continue using their wearable device should they choose to. After data analysis is complete, patients will receive a summary of the main findings.
Study Evaluations
For 6 months, enrolled patients engage in various research activities. First, physiological parameters are passively collected through a wristband, Biostrap EVO Biometric set [
], and a Food and Drug Administration (FDA)-cleared temperature monitor, Vivalink [ ]. The wristband is a noninvasive red and infrared optical sensor, which is less sensitive to skin tone variations and perfusion levels, and includes built-in accelerometer and gyroscope sensors that capture 6-axis motion data. Raw biosignals are used to estimate the (1) activity tracking accelerometer data captured continuously at 10 Hertz and converted into step count and activity duration saved in 1-minute increments; (2) arterial pulse volume monitoring using photoplethysmography, a 45-second recording collected at 43 Hertz, which provides derived biometrics including heart rate, heart rate variability with interbeat intervals between successive heartbeats times output, peripheral capillary oxygen saturation as percent oxygen, and respiratory rate; and (3) sleep analysis (eg, sleep duration, sleep onset and wake time, and sleep stages). The wristband technology has been validated previously [ ]. The temperature patch collects body temperature captured continuously and reported as an average value each minute given the smartphone is within range. To ensure consistency in patient data, we set the sampling frequency to every 5 minutes and hid the settings option that allows patients to adjust the rate, duration, and intervals between measurements on the mobile app. Patients have instant and continuous access to their data. Second, EMAs capture COVID-19 symptoms and medications [ , ] that are collected in the mobile app ( ). Third, a baseline survey captures demographics and social determinants of health [ - ]; technology access [ , ]; COVID-19 symptoms and medications [ , ]; medical information [ , ]; risk and protective factors [ ]; and PROs that capture cognitive, mental, and physical health domains [ - ]. Fourth, monthly surveys repeatedly capture data collected at baseline, mainly COVID-19 symptoms and medications [ , ], medical information [ , ], and PROs [ - ]. The first and last monthly surveys capture wearables acceptability data [ - ]. The last survey captures updated data on COVID-19 reinfection, vaccination, and medical care since enrollment in the study. Finally, the adverse outcomes survey captures the occurrence and timing of death or hospitalization, length of hospital stay, and treatment received [ , ].Eligibility verification | Baseline survey | Monthly surveys | EMAsa | Adverse outcomes survey | ||||||||||||||||||
#1 | #2 | #3 | #4 | #5 | #6 | |||||||||||||||||
Inclusion and exclusion questions | ✓ | |||||||||||||||||||||
Contact information | ✓ | |||||||||||||||||||||
Demographics | ✓ | ✓ | ||||||||||||||||||||
Social determinants of health | ✓ | |||||||||||||||||||||
Technology access and acceptability | ||||||||||||||||||||||
Smartphone or tablet access | ✓ | ✓ | ||||||||||||||||||||
Internet or cellular data access | ✓ | ✓ | ||||||||||||||||||||
Wearables acceptability | ✓ | ✓ | ||||||||||||||||||||
COVID-19 information | ||||||||||||||||||||||
COVID-19 testing | ✓ | ✓ | ||||||||||||||||||||
COVID-19 vaccination | ✓ | ✓ | ||||||||||||||||||||
COVID-19 symptoms | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ||||||||||||||
COVID-19 medications | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ||||||||||||||
Medical information | ||||||||||||||||||||||
Concomitant medications | ✓ | |||||||||||||||||||||
Pregnancy and menstrual cycle | ✓ | |||||||||||||||||||||
Disability | ✓ | |||||||||||||||||||||
Existing and new health conditions | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | |||||||||||||||
Inpatient or outpatient care | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ||||||||||||||
Adverse events | ✓ | ✓ | ||||||||||||||||||||
Risk and protective factors | ||||||||||||||||||||||
Body measurements | ✓ | |||||||||||||||||||||
Fruit and vegetable intake | ✓ | |||||||||||||||||||||
Physical activity | ✓ | |||||||||||||||||||||
Tobacco use | ✓ | |||||||||||||||||||||
Alcohol consumption | ✓ | |||||||||||||||||||||
Marijuana use | ✓ | |||||||||||||||||||||
Prescription and illicit drugs use | ✓ | |||||||||||||||||||||
Patient-reported outcomes | ||||||||||||||||||||||
General health | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | |||||||||||||||
Perceived health change | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | |||||||||||||||
EQ-5D-5L health statusb | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | |||||||||||||||
EQ-VASc | ||||||||||||||||||||||
PROMISd-29 profile version 2.1 health-related quality of lifed | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | |||||||||||||||
PROMIS cognitive function version 2.0 (short form 8a) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | |||||||||||||||
PROMIS dyspnea severity version 1.0 (short form 10a) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
aEMA: ecological momentary assessment.
bEQ-5D-5L: EurQol 5 domains, 5 levels. Captures 5 health dimensions: mobility, self-care, usual activities, pain or discomfort, and anxiety or depression.
cEQ-VAS: EurQol visual analog scale. Captures 7 domains: physical function, anxiety, depression, fatigue, sleep disturbance, ability to participate in social roles and activities, and pain interference, in addition to pain intensity.
dPROMIS: Patient-reported outcomes measurement information system.
Baseline, monthly, and adverse outcomes surveys are collected using REDCap electronic data capture tools hosted at the National Institute of Diabetes and Digestive and Kidney Diseases [
, ]. REDCap is a secure, web-based platform that serves as the project database and data capture tool. REDCap houses the IC and other study forms (eg, eligibility verification). The Biomedical Translational Research Information System REDCap team of the NIH Clinical Center provided REDCap project administration and consultation.Compliance and Retention
To maximize compliance with study activities, automatic reminders are sent to all patients. Additional reminders are sent to noncompliant patients. To maximize retention, we review an infographic aimed at increasing patients’ research literacy and highlighting the importance of completing research studies during their enrollment appointment [
]. Additionally, whenever there are 50 actively enrolled patients in a given month, protocol-compliant patients who completed their most recent monthly survey and scored ≥75% for device wearing and EMA completion are entered in monthly raffles for a US $100 gift card. Patients keep the wearable devices as a participation incentive.Statistical Analysis
We assume 20% to 35% event rates for the primary outcome of long COVID-19 and a 10% event rate for the secondary outcome of chronic COVID-19 [
, ].Power
A nonprobability sample of 550 patients with COVID-19 will be recruited for this study. With 550 participants, we have >85% power to detect a standardized difference (δ/σ) of 0.28, 0.33, and 0.43 in daily continuous physiologic parameters between long or chronic COVID-19 and non–long COVID-19 groups, assuming 35%, 20%, or 10% of participants will have long or chronic COVID-19, respectively, and allowing a 2-sided type I error of 5%. Our analysis will use multiple days of data per participant and will adjust for prognostic baseline factors, thus power will be substantially higher [
].Analysis Plan
We will use a linear mixed model of daily awake-time and sleep-time (calendar day) values of physiological parameters to determine associations with long and chronic COVID-19, the primary and secondary end points [
]. All valid days will be included for all subjects where a valid day consists of 18 hours of device wearing. Models will include baseline fixed-effect factors for demographic and clinical variables. A term for the COVID-19 status group (ie, non–long COVID-19, long COVID-19, and chronic COVID-19) will be included. All models will have a fixed-effect cubic model for time since testing positive or symptom onset for each COVID-19 status group. Subject-specific random effects (intercept and slope) and a spatial (in time) model will be used for within-subject errors, accounting for correlation between observations within a subject [ ]. The cluster robust variance will be used [ , ]. The results of the above model will allow plotting differences between COVID-19 status groups at any time. For formal testing between groups, we will fit models exactly as described, but with only linear time models for each COVID-19 status group. Contrasts between the slope terms will then be used to test if groups have different trends over 6 months. Linear mixed-effect models are robust to missing data based on a missing-at-random assumption [ ]. Subgroup analyses will be performed for analyses of both primary and secondary events restricted to patients within demographic characteristics (eg, race and ethnicity).Data Security
Data from wearables are transferred to iOS or Android mobile phones via Bluetooth and stored in Biostrap cloud servers for data processing to estimate physiological parameters. Patients’ personal identifiable information and protected health information are not shared with Biostrap. Data are downloaded weekly to the study server at the National Institute on Minority Health and Health Disparities and a final data transfer will occur at the end of the study.
Ethical Considerations
The protocol was reviewed and approved by the National Institute on Minority Health and Health Disparities’s Scientific Review Committee and NIH’s Chief Scientific Officer on April 26, 2021. NIH’s institutional review board approved the protocol on June 21, 2021 (IRB#: 000315). Amendments were approved on September 23, 2021, and April 20, 2022. Administrative amendments were approved on June 17, 2022, August 24, 2022, May 16, 2023, June 30, 2023, and December 8, 2023 (ie, changes to the mailing address and key study personnel). Any adverse events or unanticipated problems are reported to the institutional review board. All patients enrolled in the study provide IC.
Results
The first patient was enrolled on October 11, 2021. We expect to publish the results in 2025.
Discussion
Summary
This protocol is a prospective, longitudinal, observational study of PASC among a cohort of 550 nonhospitalized people with a confirmed positive COVID-19 diagnosis. The study captures intensive longitudinal physiological data collected via digital wearables and PROs for 6 months. The study will shed light on the course of PASC in nonhospitalized patients and represents an example of the use of wearable technology in disease monitoring generally and COVID-19 specifically.
Despite the pandemic emergency state declared officially over [
], research into PASC remains a priority given its health and economic costs [ , ], national initiatives [ , ], continued scientific interest [ , ], and patient advocacy [ - ]. Conservatively, there are 10 to 30 million people who experience PASC, with estimates likely higher if probable and suspected cases are included beyond the 100+ million confirmed COVID-19 cases in the United States [ ]. The study will shed light on PASC in patient subgroups given its associations with demographics and risk profiles [ ]. This is particularly important because evidence on PASC in racial and ethnic groups is scarce and inconclusive [ , , , , ] despite minority groups disproportionally bearing the burden of COVID-19 infection and adverse outcomes [ ]. While COVID-19 wearables-based studies focused mainly on its detection or acute phase, we capture a multitude of PASC digital biomarkers. This will allow us to identify PASC digital phenotypes that aid in its clinical assessment and treatment [ , ]. Furthermore, we can triangulate evidence of PASC from physiological parameters and self-reported patient outcomes [ ]. Future studies should determine the clinical use of digital wearables in monitoring nonhospitalized patients with COVID-19 over longer follow-up periods.Study strengths include its intensive longitudinal data on PROs and physiological parameters, 6-month follow-up, and focus on nonhospitalized patients whose characteristics and disease trajectory differ from hospitalized patients [
, , ] (compare [ ]). We require a positive COVID-19 diagnosis because of PASC-like self-reported symptoms and physiological changes among COVID-19 untested or negative individuals [ , , ]. This is a decentralized trial, which allows for nationwide recruitment, increased participation of diverse and underrepresented populations in research, and reduced participant burden [ - ].This study has several limitations. Sample size calculations are based on PASC surveillance data available when the study was launched. These data have since changed based on evolving definitions of PASC [
]. Recruitment started after COVID-19 vaccines were rolled out irrespective of age or underlying medical conditions, which means our sample will include unvaccinated and vaccinated patients. The availability and effectiveness of COVID-19 vaccines and treatments as well as dominant variants throughout recruitment activities may affect study end points [ , , , ]. Given limited evidence on the demographic breakdown of patients who endure PASC, our sample reflects the US population by sex and race and ethnicity rather than PASC prevalence in population subgroups [ ]. The study mobile app is available only in English. Thus, we exclude non-English speaking patients from participation. Self-selection bias is another limitation whereby participants with certain predispositions (eg, digitally literate) may be inclined to enroll in the study. With a 5-day enrollment window from a positive COVID-19 diagnosis, the initial severity of one’s illness can deter PRVs from enrolling. We have no baseline data from patients prior to their positive diagnosis. Given the decentralized nature of the study, its reliance on mobile technologies, and its follow-up duration, certain limitations are expected (eg, data loss due to technical issues or shipping delays, poor compliance, or high attrition) [ - ]. The study wristband is not FDA-approved. Physiological parameters do not capture all PASC symptoms (eg, loss of sense of taste). Accrual is expected to fluctuate with infection rates, which may affect our ability to meet the target sample or prolong recruitment.This study has wider public health implications pertaining to the role of mobile technologies in digital medicine [
, , , ]. Indeed, mobile technologies have been central to public health response to the COVID-19 pandemic [ , ]—from crowdsourcing platforms for contact tracing [ ] to symptom reporting [ - ] and sensor data collection [ , ]. Wearables physiological data improve the identification of COVID-19–positive cases above and beyond self-reported symptoms [ ], which have been the basis of pilot COVID-19 detection tools [ - ], and show preliminary differentiation between COVID-19 and other respiratory illnesses [ ]. Prior to the COVID-19 pandemic, wearables have been piloted for the detection, monitoring, and public surveillance of communicable and noncommunicable diseases, health conditions, and behaviors [ - ]. They enjoy increasing uptake and acceptability, and afford opportunities for unobtrusive and continuous capture of objective data, including awake and sleep-time data, outside of traditional health care settings [ , ]. When integrated with remote monitoring platforms, patient-generated data can support real-time feedback to patients and physicians that is calibrated to a patient’s baseline data and has the potential to improve individual-level health outcomes [ , ] (compare [ ]). While evidence on wearables and their integration into clinical practice is in its infancy and challenges exist until their potential is fully realized [ , , ], if widely adopted, wearables can be scaled up as cost-effective tools for population-level disease surveillance, management, and prevention [ ].Conclusions
This protocol outlines a 6-month prospective observational study of PASC in a cohort of 550 nonhospitalized patients with a positive COVID-19 diagnosis. The study uses off-the-shelf wearable devices to collect a multitude of physiological parameters to examine their associations with patient-reported PASC. The study exemplifies the potential of wearable technologies in population-level disease monitoring and their wider role in digital medicine.
Acknowledgments
This research is supported by the Division of Intramural Research, National Institute on Minority Health and Health Disparities (NIMHD), National Institutes of Health (NIH; ZIA MD000011). The effort of SET, PH, GZ, NM, and TMPW is supported by the Division of Intramural Research, NIMHD, NIH. The effort of JT and TMPW is supported by the Division of Intramural Research, National Heart, Lung, and Blood Institute, NIH. The authors would like to thank the research participants without whom this research would not be possible; Los Angeles County, which granted the access to information about patients with COVID-19 who have opted-in to receive information about research studies when they register to schedule a COVID-19 test with Fulgent Genetics, one of the companies that administers the COVID-19 test at county sites; Informational Management Services, Inc, an information management services company that specializes in statistical consultation, for calculating sample size; and NIMHD’s administrative and information technology staff, NIH’s Office of Patient Recruitment staff, NIH’s Clinical Center staff, the Biomedical Translational Research Information System (BRTIS) Research Electronic Data Capture (REDCap) support team of the NIH Clinical Center, and the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) REDCap team, all of whom have supported various administrative and outreach activities for the study.
Data Availability
Data sharing is not applicable to this paper as no data sets were generated or analyzed during this study.
Disclaimer
Use of commercial products in the study does not imply endorsement of these products. Similarly, authorship does not imply endorsement of any Biostrap USA, LLC or Vivalink products. Biostrap USA, LLC, was paid for the devices used in this study (Biostrap EVO Biometric set and Vivalink temperature monitor) and for the services it provided and has no input on study conceptualization, data analysis, or interpretation. The views expressed in this paper are those of the authors and do not necessarily represent the views of the National Institute on Minority Health and Health Disparities; the National Heart, Lung, and Blood Institute; the National Institutes of Health; or the US Department of Health and Human Services.
Authors' Contributions
SET conceptualized and supervised the study and drafted the paper. PH built patient database and coordinated efforts with Biostrap USA, LLC. GZ managed patient database. ARD tailored the mobile app for the purposes of this study, implemented automated reminders, compliance checks, and data backup. NM coordinated the study from June 2021 to June 2022. SET, PH, GZ, and NM managed day-to-day tasks. JT devised the analysis plan. TMPW served as the medical advisory investigator for the study. All authors reviewed and approved the paper.
Conflicts of Interest
ARD is employed by Biostrap USA, LLC. All other coauthors declare no conflicts of interest.
Response to scientific review stipulations.
DOCX File , 134 KBReferences
- Tong A, Elliott JH, Azevedo LC, Baumgart A, Bersten A, Cervantes L, et al. Core outcomes set for trials in people with coronavirus disease 2019. Crit Care Med. 2020;48(11):1622-1635. [FREE Full text] [CrossRef] [Medline]
- Callard F, Perego E. How and why patients made long Covid. Soc Sci Med. 2021;268:113426. [FREE Full text] [CrossRef] [Medline]
- Matharaarachchi S, Domaratzki M, Katz A, Muthukumarana S. Discovering long COVID symptom patterns: association rule mining and sentiment analysis in social media tweets. JMIR Form Res. 2022;6(9):e37984. [FREE Full text] [CrossRef] [Medline]
- Rowland C. Long covid is destroying careers, leaving economic distress in its wake. The Washington Post. 2021. URL: https://www.washingtonpost.com/business/2021/12/09/long-covid-work-unemployed/ [accessed 2024-07-19]
- Mahase E. Covid-19: what do we know about "long covid"? BMJ. 2020;370:m2815. [CrossRef] [Medline]
- Greenhalgh T, Knight M, A'Court C, Buxton M, Husain L. Management of post-acute covid-19 in primary care. BMJ. 2020;370:m3026. [CrossRef] [Medline]
- Late sequelae of COVID-19. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/coronavirus/2019-ncov/hcp/clinical-care/late-sequelae.html [accessed 2020-12-15]
- Fernández-de-Las-Peñas C, Palacios-Ceña D, Gómez-Mayordomo V, Cuadrado ML, Florencio LL. Defining post-COVID symptoms (post-acute COVID, long COVID, persistent post-COVID): an integrative classification. Int J Environ Res Public Health. 2021;18(5):2621. [FREE Full text] [CrossRef] [Medline]
- Amenta EM, Spallone A, Rodriguez-Barradas MC, El Sahly HM, Atmar RL, Kulkarni PA. Postacute COVID-19: an overview and approach to classification. Open Forum Infect Dis. 2020;7(12):ofaa509. [FREE Full text] [CrossRef] [Medline]
- Datta SD, Talwar A, Lee JT. A proposed framework and timeline of the spectrum of disease due to SARS-CoV-2 infection: illness beyond acute infection and public health implications. JAMA. 2020;324(22):2251-2252. [CrossRef] [Medline]
- Nalbandian A, Sehgal K, Gupta A, Madhavan MV, McGroder C, Stevens JS, et al. Post-acute COVID-19 syndrome. Nat Med. 2021;27(4):601-615. [FREE Full text] [CrossRef] [Medline]
- Groff D, Sun A, Ssentongo AE, Ba DM, Parsons N, Poudel GR, et al. Short-term and long-term rates of postacute sequelae of SARS-CoV-2 infection: a systematic review. JAMA Netw Open. 2021;4(10):e2128568. [FREE Full text] [CrossRef] [Medline]
- Chen C, Haupert SR, Zimmermann L, Shi X, Fritsche LG, Mukherjee B. Global prevalence of post-coronavirus disease 2019 (COVID-19) condition or long COVID: a meta-analysis and systematic review. J Infect Dis. 2022;226(9):1593-1607. [FREE Full text] [CrossRef] [Medline]
- Lopez-Leon S, Wegman-Ostrosky T, Perelman C, Sepulveda R, Rebolledo PA, Cuapio A, et al. More than 50 long-term effects of COVID-19: a systematic review and meta-analysis. Sci Rep. 2021;11(1):16144. [FREE Full text] [CrossRef] [Medline]
- Nasserie T, Hittle M, Goodman SN. Assessment of the frequency and variety of persistent symptoms among patients with COVID-19: a systematic review. JAMA Netw Open. 2021;4(5):e2111417. [FREE Full text] [CrossRef] [Medline]
- A clinical case definition of post COVID-19 condition by a Delphi consensus. World Health Organization. URL: https://www.who.int/publications/i/item/WHO-2019-nCoV-Post_COVID-19_condition-Clinical_case_definition-2021.1 [accessed 2023-08-01]
- Tenforde MW, Kim SS, Lindsell CJ, Billig Rose E, Shapiro NI, Files DC, et al. Symptom duration and risk factors for delayed return to usual health among outpatients with COVID-19 in a multistate health care systems network - United States, March-June 2020. MMWR Morb Mortal Wkly Rep. 2020;69(30):993-998. [FREE Full text] [CrossRef] [Medline]
- Arnold DT, Hamilton FW, Milne A, Morley AJ, Viner J, Attwood M, et al. Patient outcomes after hospitalisation with COVID-19 and implications for follow-up: results from a prospective UK cohort. Thorax. 2021;76(4):399-401. [FREE Full text] [CrossRef] [Medline]
- Puntmann VO, Carerj ML, Wieters I, Fahim M, Arendt C, Hoffmann J, et al. Outcomes of cardiovascular magnetic resonance imaging in patients recently recovered from coronavirus disease 2019 (COVID-19). JAMA Cardiol. 2020;5(11):1265-1273. [FREE Full text] [CrossRef] [Medline]
- Raman B, Cassar M, Tunnicliffe E, Filippini N, Griffanti L, Alfaro-Almagro F, et al. Medium-term effects of SARS-CoV-2 infection on multiple vital organs, exercise capacity, cognition, quality of life and mental health, post-hospital discharge. EClinicalMedicine. 2021;31:100683. [FREE Full text] [CrossRef] [Medline]
- Lu Y, Li X, Geng D, Mei N, Wu P, Huang C, et al. Cerebral micro-structural changes in COVID-19 patients - an MRI-based 3-month follow-up study. EClinicalMedicine. 2020;25:100484. [FREE Full text] [CrossRef] [Medline]
- Davis HE, McCorkell L, Vogel JM, Topol EJ. Long COVID: major findings, mechanisms and recommendations. Nat Rev Microbiol. 2023;21(3):133-146. [FREE Full text] [CrossRef] [Medline]
- Sherif ZA, Gomez CR, Connors TJ, Henrich TJ, Reeves WB, RECOVER Mechanistic Pathway Task Force. Pathogenic mechanisms of post-acute sequelae of SARS-CoV-2 infection (PASC). Elife. 2023;12:e86002. [FREE Full text] [CrossRef] [Medline]
- Thaweethai T, Jolley SE, Karlson EW, Levitan EB, Levy B, McComsey GA, et al. Development of a definition of postacute sequelae of SARS-CoV-2 infection. JAMA. 2023;329(22):1934-1946. [FREE Full text] [CrossRef] [Medline]
- Bowyer RCE, Huggins C, Toms R, Shaw RJ, Hou B, Thompson EJ, et al. Characterising patterns of COVID-19 and long COVID symptoms: evidence from nine UK longitudinal studies. Eur J Epidemiol. 2023;38(2):199-210. [FREE Full text] [CrossRef] [Medline]
- Davis HE, Assaf GS, McCorkell L, Wei H, Low RJ, Re'em Y, et al. Characterizing long COVID in an international cohort: 7 months of symptoms and their impact. EClinicalMedicine. 2021;38:101019. [FREE Full text] [CrossRef] [Medline]
- Sathish T, Kapoor N, Cao Y, Tapp RJ, Zimmet P. Proportion of newly diagnosed diabetes in COVID-19 patients: a systematic review and meta-analysis. Diabetes Obes Metab. 2021;23(3):870-874. [FREE Full text] [CrossRef] [Medline]
- Chen G, Li X, Gong Z, Xia H, Wang Y, Wang X, et al. Hypertension as a sequela in patients of SARS-CoV-2 infection. PLoS One. 2021;16(4):e0250815. [FREE Full text] [CrossRef] [Medline]
- Lam MH, Wing Y, Yu MW, Leung C, Ma RCW, Kong APS, et al. Mental morbidities and chronic fatigue in severe acute respiratory syndrome survivors: long-term follow-up. Arch Intern Med. 2009;169(22):2142-2147. [CrossRef] [Medline]
- Ngai JC, Ko FW, Ng SS, To K, Tong M, Hui DS. The long-term impact of severe acute respiratory syndrome on pulmonary function, exercise capacity and health status. Respirology. 2010;15(3):543-550. [FREE Full text] [CrossRef] [Medline]
- Choutka J, Jansari V, Hornig M, Iwasaki A. Unexplained post-acute infection syndromes. Nat Med. 2022;28(5):911-923. [CrossRef] [Medline]
- Carfì A, Bernabei R, Landi F, Gemelli Against COVID-19 Post-Acute Care Study Group. Persistent symptoms in patients after acute COVID-19. JAMA. 2020;324(6):603-605. [FREE Full text] [CrossRef] [Medline]
- Wong AW, Shah AS, Johnston JC, Carlsten C, Ryerson CJ. Patient-reported outcome measures after COVID-19: a prospective cohort study. Eur Respir J. 2020;56(5):2003276. [FREE Full text] [CrossRef] [Medline]
- Halpin SJ, McIvor C, Whyatt G, Adams A, Harvey O, McLean L, et al. Postdischarge symptoms and rehabilitation needs in survivors of COVID-19 infection: a cross-sectional evaluation. J Med Virol. 2021;93(2):1013-1022. [FREE Full text] [CrossRef] [Medline]
- Garrigues E, Janvier P, Kherabi Y, Le Bot A, Hamon A, Gouze H, et al. Post-discharge persistent symptoms and health-related quality of life after hospitalization for COVID-19. J Infect. 2020;81(6):e4-e6. [FREE Full text] [CrossRef] [Medline]
- Subramanian A, Nirantharakumar K, Hughes S, Myles P, Williams T, Gokhale KM, et al. Symptoms and risk factors for long COVID in non-hospitalized adults. Nat Med. 2022;28(8):1706-1714. [FREE Full text] [CrossRef] [Medline]
- Coronavirus disease 2019 (COVID-19) situation report – 46. World Health Organization. URL: https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200306-sitrep-46-covid-19.pdf?sfvrsn=96b04adf_4 [accessed 2020-11-23]
- Innovative support for patients with SARS-CoV-2 infections (INSPIRE): prospective cohort study. Centers for Disease Control and Prevention. URL: https://covid.cdc.gov/covid-data-tracker/?CDC_AA_refVal=https%3A%2F%2Fwww.cdc.gov%2Fcoronavirus%2F2019-ncov%2Fcases-updates%2Fcases-in-us.html#inspire [accessed 2023-06-15]
- Perlis RH, Santillana M, Ognyanova K, Safarpour A, Lunz Trujillo K, Simonson MD, et al. Prevalence and correlates of long COVID symptoms among US adults. JAMA Netw Open. 2022;5(10):e2238804. [FREE Full text] [CrossRef] [Medline]
- Jacobs MM, Evans E, Ellis C. Racial, ethnic, and sex disparities in the incidence and cognitive symptomology of long COVID-19. J Natl Med Assoc. 2023;115(2):233-243. [FREE Full text] [CrossRef] [Medline]
- Wisk LE, Gottlieb MA, Spatz ES, Yu H, Wang RC, Slovis BH, et al. Association of initial SARS-CoV-2 test positivity with patient-reported well-being 3 months after a symptomatic illness. JAMA Netw Open. 2022;5(12):e2244486. [FREE Full text] [CrossRef] [Medline]
- Gemelli Against COVID-19 Post-Acute Care Study Group. Post-COVID-19 global health strategies: the need for an interdisciplinary approach. Aging Clin Exp Res. 2020;32(8):1613-1620. [FREE Full text] [CrossRef] [Medline]
- Yelin D, Wirtheim E, Vetter P, Kalil AC, Bruchfeld J, Runold M, et al. Long-term consequences of COVID-19: research needs. Lancet Infect Dis. 2020;20(10):1115-1117. [FREE Full text] [CrossRef] [Medline]
- Channa A, Popescu N, Skibinska J, Burget R. The rise of wearable devices during the COVID-19 pandemic: a systematic review. Sensors (Basel). 2021;21(17):5787. [FREE Full text] [CrossRef] [Medline]
- Mitratza M, Goodale BM, Shagadatova A, Kovacevic V, van de Wijgert J, Brakenhoff TB, et al. The performance of wearable sensors in the detection of SARS-CoV-2 infection: a systematic review. Lancet Digit Health. 2022;4(5):e370-e383. [FREE Full text] [CrossRef] [Medline]
- Shandhi MH, Cho PJ, Roghanizad AR, Singh K, Wang W, Enache OM, et al. A method for intelligent allocation of diagnostic testing by leveraging data from commercial wearable devices: a case study on COVID-19. NPJ Digit Med. 2022;5(1):130. [FREE Full text] [CrossRef] [Medline]
- Alavi A, Bogu G, Wang M, Rangan ES, Brooks AW, Wang Q, et al. Real-time alerting system for COVID-19 and other stress events using wearable data. Nat Med. 2022;28(1):175-184. [FREE Full text] [CrossRef] [Medline]
- Conroy B, Silva I, Mehraei G, Damiano R, Gross B, Salvati E, et al. Real-time infection prediction with wearable physiological monitoring and AI to aid military workforce readiness during COVID-19. Sci Rep. 2022;12(1):3797. [FREE Full text] [CrossRef] [Medline]
- Hirten RP, Danieletto M, Tomalin L, Choi KH, Zweig M, Golden E, et al. Use of physiological data from a wearable device to identify SARS-CoV-2 infection and symptoms and predict COVID-19 diagnosis: observational study. J Med Internet Res. 2021;23(2):e26107. [FREE Full text] [CrossRef] [Medline]
- Quer G, Radin JM, Gadaleta M, Baca-Motes K, Ariniello L, Ramos E, et al. Wearable sensor data and self-reported symptoms for COVID-19 detection. Nat Med. 2021;27(1):73-77. [CrossRef] [Medline]
- Mason AE, Hecht FM, Davis SK, Natale JL, Hartogensis W, Damaso N, et al. Detection of COVID-19 using multimodal data from a wearable device: results from the first TemPredict study. Sci Rep. 2022;12(1):3463. [FREE Full text] [CrossRef] [Medline]
- Hasty F, García G, Dávila H, Wittels SH, Hendricks S, Chong S. Heart rate variability as a possible predictive marker for acute inflammatory response in COVID-19 patients. Mil Med. 2021;186(1-2):e34-e38. [FREE Full text] [CrossRef] [Medline]
- Natarajan A, Su H, Heneghan C. Assessment of physiological signs associated with COVID-19 measured using wearable devices. NPJ Digit Med. 2020;3(1):156. [FREE Full text] [CrossRef] [Medline]
- Miller DJ, Capodilupo JV, Lastella M, Sargent C, Roach GD, Lee VH, et al. Analyzing changes in respiratory rate to predict the risk of COVID-19 infection. PLoS One. 2020;15(12):e0243693. [FREE Full text] [CrossRef] [Medline]
- Gielen W, Longoria KA, van Mourik RA. Two cases of COVID-19 monitored by a wearable biosensor-a case report. Mhealth. 2021;7:62. [FREE Full text] [CrossRef] [Medline]
- Von Preyss-Friedman S, Von Preyss-Friedman S, Emmet L, Deckert D, Medrano D, David D, et al. Prediction of deterioration from COVID-19 in patients in skilled nursing facilities using wearable devices: a feasibility study. J Am Med Dir Assoc. 2022;23(6):e12. [FREE Full text] [CrossRef]
- Mishra T, Wang M, Metwally A, Bogu GK, Brooks AW, Bahmani A, et al. Pre-symptomatic detection of COVID-19 from smartwatch data. Nat Biomed Eng. 2020;4(12):1208-1220. [FREE Full text] [CrossRef] [Medline]
- Smarr BL, Aschbacher K, Fisher SM, Chowdhary A, Dilchert S, Puldon K, et al. Feasibility of continuous fever monitoring using wearable devices. Sci Rep. 2020;10(1):21640. [FREE Full text] [CrossRef] [Medline]
- Lonini L, Shawen N, Botonis O, Fanton M, Jayaraman C, Mummidisetty CK, et al. Rapid screening of physiological changes associated with COVID-19 using soft-wearables and structured activities: a pilot study. IEEE J Transl Eng Health Med. 2021;9:4900311. [FREE Full text] [CrossRef] [Medline]
- Price-Haywood EG, Burton J, Fort D, Seoane L. Hospitalization and mortality among Black patients and White patients with Covid-19. N Engl J Med. 2020;382(26):2534-2543. [FREE Full text] [CrossRef] [Medline]
- Huang Y, Pinto MD, Borelli JL, Asgari Mehrabadi M, Abrahim HL, Dutt N, et al. COVID symptoms, symptom clusters, and predictors for becoming a long-hauler looking for clarity in the haze of the pandemic. Clin Nurs Res. 2022;31(8):1390-1398. [FREE Full text] [CrossRef] [Medline]
- Guzman-Esquivel J, Mendoza-Hernandez MA, Guzman-Solorzano HP, Sarmiento-Hernandez KA, Rodriguez-Sanchez IP, Martinez-Fierro ML, et al. Clinical characteristics in the acute phase of COVID-19 that predict long COVID: tachycardia, myalgias, severity, and use of antibiotics as main risk factors, while education and blood group B are protective. Healthcare (Basel). 2023;11(2):197. [FREE Full text] [CrossRef] [Medline]
- Burton C, Dawes H, Goodwill S, Thelwell M, Dalton C. Within and between-day variation and associations of symptoms in long Covid: intensive longitudinal study. PLoS One. 2023;18(1):e0280343. [FREE Full text] [CrossRef] [Medline]
- Mekhael M, Lim CH, El Hajjar AH, Noujaim C, Pottle C, Makan N, et al. Studying the effect of long COVID-19 infection on sleep quality using wearable health devices: observational study. J Med Internet Res. 2022;24(7):e38000. [FREE Full text] [CrossRef] [Medline]
- Jeong H, Rogers JA, Xu S. Continuous on-body sensing for the COVID-19 pandemic: gaps and opportunities. Sci Adv. 2020;6(36):eabd4794. [FREE Full text] [CrossRef] [Medline]
- Cho PJ, Yi J, Ho E, Shandhi MMH, Dinh Y, Patil A, et al. Demographic imbalances resulting from the bring-your-own-device study design. JMIR Mhealth Uhealth. 2022;10(4):e29510. [FREE Full text] [CrossRef] [Medline]
- Annual Estimates of the Resident Population by Sex, Age, Race Alone or in Combination, and Hispanic Origin for the United States: April 1, 2010 to July 1, 2019 (NC-EST2019-ASR5H). United States Census Bureau, Population Division. URL: https://www.census.gov/data/tables/time-series/demo/popest/2010s-state-detail.html [accessed 2024-07-13]
- Cruz AT, Zeichner SL. COVID-19 in children: initial characterization of the pediatric disease. Pediatrics. 2020;145(6):e20200834. [CrossRef] [Medline]
- Preparing for COVID-19 in nursing homes. Centers for Disease Control and Prevention. URL: https://stacks.cdc.gov/view/cdc/97611 [accessed 2021-03-15]
- Underlying medical conditions associated with higher risk for severe COVID-19: information for healthcare professionals. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/coronavirus/2019-ncov/hcp/clinical-care/underlyingconditions.html [accessed 2023-08-23]
- COVID-19 research studies. NIH Clinical Center. URL: https://clinicalstudies.info.nih.gov/ [accessed 2023-06-01]
- Biostrap Evo. Biostrap. URL: https://biostrap.com/getting-started/evo/ [accessed 2023-06-01]
- Wearable continuous temperature monitor. VivaLink. URL: https://www.vivalink.com/wearable-temperature-monitor [accessed 2023-06-01]
- Dur O, Rhoades C, Ng MS, Elsayed R, van Mourik R, Majmudar MD. Design rationale and performance evaluation of the wavelet health wristband: benchtop validation of a wrist-worn physiological signal recorder. JMIR Mhealth Uhealth. 2018;6(10):e11040. [FREE Full text] [CrossRef] [Medline]
- Human infection with 2019 novel coronavirus case report form. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/coronavirus/2019-ncov/downloads/pui-form.pdf [accessed 2021-03-10]
- Global COVID-19 clinical platform: rapid core case report form (CRF), version 8 April 2020, revised 13 July 2020. World Health Organization. URL: https://apps.who.int/iris/handle/10665/333229 [accessed 2020-12-01]
- NIH RADx-UP common data elements. National Institutes of Health. URL: https://radx-up.org/research/cdes/ [accessed 2023-06-15]
- Health information national trends survey. National Cancer Institute. URL: https://hints.cancer.gov/ [accessed 2021-03-15]
- Sample ACS & PRCS forms and instructions. United States Census Bureau. URL: https://www.census.gov/programs-surveys/acs/about/forms-and-instructions.html [accessed 2023-06-20]
- 36-item short form survey instrument (SF-36). RAND Corporation. URL: https://www.rand.org/health-care/surveys_tools/mos/36-item-short-form/survey-instrument.html [accessed 2021-03-10]
- PROMIS adult profile instruments scoring manual. HealthMeasures. URL: https://www.healthmeasures.net/administrator/components/com_instruments/uploads/PROMIS%20Adult%20Profile%20Scoring%20Manual.pdf [accessed 2021-03-15]
- Dyspnea scoring manual. HealthMeasures. URL: https://www.healthmeasures.net/administrator/components/com_instruments/uploads/PROMIS%20Dyspnea%20Scoring%20Manual.pdf [accessed 2021-03-15]
- Cognitive function scoring manual. HealthMeasures. URL: https://www.healthmeasures.net/administrator/components/com_instruments/uploads/PROMIS%20Cognitive%20Function%20Scoring%20Manual_03June2022.pdf [accessed 2021-03-15]
- Hays RD, Spritzer KL, Schalet BD, Cella D. PROMIS-29 v2.0 profile physical and mental health summary scores. Qual Life Res. 2018;27(7):1885-1891. [FREE Full text] [CrossRef] [Medline]
- Choi SW, Victorson DE, Yount S, Anton S, Cella D. Development of a conceptual framework and calibrated item banks to measure patient-reported dyspnea severity and related functional limitations. Value Health. 2011;14(2):291-306. [FREE Full text] [CrossRef] [Medline]
- Cella D, Choi S, Condon D, Schalet B, Hays RD, Rothrock NE, et al. PROMIS adult health profiles: efficient short-form measures of seven health domains. Value Health. 2019;22(5):537-544. [FREE Full text] [CrossRef] [Medline]
- EQ-5D-5L. EuroQol. URL: https://euroqol.org/eq-5d-instruments/eq-5d-5l-about/ [accessed 2021-03-15]
- Herdman M, Gudex C, Lloyd A, Janssen MF, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727-1736. [FREE Full text] [CrossRef] [Medline]
- Feng Y, Kohlmann T, Janssen M, Buchholz I. Psychometric properties of the EQ-5D-5L: a systematic review of the literature. Qual Life Res. 2021;30(3):647-673. [FREE Full text] [CrossRef] [Medline]
- Wu L, Wu L, Chang S. Exploring consumers’ intention to accept smartwatch. Comput Human Behav. 2016;64:383-392. [FREE Full text] [CrossRef]
- Li J, Ma Q, Chan A, Man S. Health monitoring through wearable technologies for older adults: smart wearables acceptance model. Appl Ergon. 2019;75:162-169. [CrossRef] [Medline]
- Pavic M, Klaas V, Theile G, Kraft J, Tröster G, Guckenberger M. Feasibility and usability aspects of continuous remote monitoring of health status in palliative cancer patients using wearables. Oncology. 2020;98(6):386-395. [FREE Full text] [CrossRef] [Medline]
- Harris PA, Taylor R, Minor B, Elliott V, Fernandez M, O'Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208. [FREE Full text] [CrossRef] [Medline]
- Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377-381. [FREE Full text] [CrossRef] [Medline]
- Kiernan M, Oppezzo MA, Resnicow K, Alexander GL. Effects of a methodological infographic on research participants' knowledge, transparency, and trust. Health Psychol. 2018;37(8):782-786. [FREE Full text] [CrossRef] [Medline]
- The prevalence of long COVID symptoms and COVID-19 complications. Office for National Statistics. URL: https://www.ons.gov.uk/news/statementsandletters/theprevalenceoflongcovidsymptomsandcovid19complications [accessed 2021-03-15]
- Hulley SB, Cummings SR, Browner WS, Grady D, Newman TB. Designing Clinical Research: An Epidemiologic Approach. 4th ed. Philadelphia, PA. Lippincott Williams & Wilkins; 2013.
- Fitzmaurice G, Laird N, Ware J. Applied Longitudinal Analysis. Hoboken, New Jersey. John Wiley & Sons; 2004.
- Pustejovsky J. clubSandwich: Cluster-Robust (Sandwich) Variance Estimators with Small-Sample Corrections. Jun 20, 2024. URL: https://cran.r-project.org/web/packages/clubSandwich/index.html [accessed 2024-07-19]
- Pustejovsky JE, Tipton E. Small-sample methods for cluster-robust variance estimation and hypothesis testing in fixed effects models. J Bus Econ Stat. 2018;36(4):672-683. [CrossRef]
- End of the federal COVID-19 public health emergency (PHE) declaration. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/coronavirus/2019-ncov/your-health/end-of-phe.html [accessed 2023-06-20]
- Nurchis MC, Pascucci D, Sapienza M, Villani L, D'Ambrosio F, Castrini F, et al. Impact of the burden of COVID-19 in Italy: results of disability-adjusted life years (DALYs) and productivity loss. Int J Environ Res Public Health. 2020;17(12):4233. [FREE Full text] [CrossRef] [Medline]
- Cutler DM. The costs of long COVID. JAMA Health Forum. 2022;3(5):e221809. [FREE Full text] [CrossRef] [Medline]
- National research action plan on long COVID. Department of Health and Human Services. URL: https://www.covid.gov/assets/files/National-Research-Action-Plan-on-Long-COVID-08012022.pdf [accessed 2023-06-25]
- Services and supports for longer-term impacts of COVID-19. Department of Health and Human Services. URL: https://www.covid.gov/assets/files/Services-and-Supports-for-Longer-Term-Impacts-of-COVID-19-08012022.pdf [accessed 2023-06-25]
- RECOVER: researching COVID to enhance recovery. National Institutes of Health. URL: https://recovercovid.org/ [accessed 2023-06-25]
- COVID-19 research initiatives. All of Us. URL: https://www.researchallofus.org/discover/covid-19-research-initiatives/ [accessed 2023-06-25]
- An analysis of the prolonged COVID-19 symptoms survey by patient-led research team. Patient-Led Research Collaborative. URL: https://patientresearchcovid19.com/research/report-1/ [accessed 2023-07-05]
- Body Politic. Body Politic. URL: https://www.wearebodypolitic.com/covid-19 [accessed 2023-07-05]
- COVID-19 “Long Hauler” symptoms survey report. Survivor Corps. URL: https://dig.abclocal.go.com/wls/documents/2020/072720-wls-covid-symptom-study-doc.pdf [accessed 2023-07-10]
- WHO COVID-19 dashboard. World Health Organization. URL: https://covid19.who.int/region/amro/country/us [accessed 2023-08-01]
- Long COVID. United States Census Bureau. URL: https://www.cdc.gov/nchs/covid19/pulse/long-covid.htm [accessed 2023-08-01]
- Webb Hooper M, Nápoles AM, Pérez-Stable EJ. COVID-19 and racial/ethnic disparities. JAMA. 2020;323(24):2466-2467. [FREE Full text] [CrossRef] [Medline]
- McGinnis RS, McGinnis EW. Advancing digital medicine with wearables in the wild. Sensors (Basel). 2022;22(12):4576. [FREE Full text] [CrossRef] [Medline]
- Sim I. Mobile devices and health. N Engl J Med. 2019;381(10):956-968. [CrossRef] [Medline]
- Thurmond VA. The point of triangulation. J Nurs Scholarsh. 2001;33(3):253-258. [CrossRef] [Medline]
- Tenforde MW, Billig Rose E, Lindsell CJ, Shapiro NI, Files DC, Gibbs KW, et al. Characteristics of adult outpatients and inpatients with COVID-19 - 11 academic medical centers, United States, March-May 2020. MMWR Morb Mortal Wkly Rep. 2020;69(26):841-846. [FREE Full text] [CrossRef] [Medline]
- Global Burden of Disease Long COVID Collaborators, Wulf Hanson S, Abbafati C, Aerts JG, Al-Aly Z, Ashbaugh C, et al. Estimated global proportions of individuals with persistent fatigue, cognitive, and respiratory symptom clusters following symptomatic COVID-19 in 2020 and 2021. JAMA. 2022;328(16):1604-1615. [FREE Full text] [CrossRef] [Medline]
- Dorsey ER, Kluger B, Lipset CH. The new normal in clinical trials: decentralized studies. Ann Neurol. 2020;88(5):863-866. [CrossRef] [Medline]
- Lentz J, Kennett M, Perlmutter J, Forrest A. Paving the way to a more effective informed consent process: recommendations from the clinical trials transformation initiative. Contemp Clin Trials. 2016;49:65-69. [FREE Full text] [CrossRef] [Medline]
- Petrini C, Mannelli C, Riva L, Gainotti S, Gussoni G. Decentralized clinical trials (DCTs): a few ethical considerations. Front Public Health. 2022;10:1081150. [FREE Full text] [CrossRef] [Medline]
- Brannock MD, Chew RF, Preiss AJ, Hadley EC, Redfield S, McMurry JA, et al. Long COVID risk and pre-COVID vaccination in an EHR-based cohort study from the RECOVER program. Nat Commun. 2023;14(1):2914. [FREE Full text] [CrossRef] [Medline]
- Antonelli M, Pujol JC, Spector TD, Ourselin S, Steves CJ. Risk of long COVID associated with delta versus omicron variants of SARS-CoV-2. Lancet. 2022;399(10343):2263-2264. [FREE Full text] [CrossRef] [Medline]
- Pratap A, Neto E, Snyder P, Stepnowsky C, Elhadad N, Grant D, et al. Indicators of retention in remote digital health studies: a cross-study evaluation of 100,000 participants. NPJ Digit Med. 2020;3:21. [FREE Full text] [CrossRef] [Medline]
- Stuckless S, Parfrey P. Bias in clinical research. In: Parfrey PS, Barrett BJ, editors. Clinical Epidemiology: Practice and Methods. 3rd ed. New York, NY. Humana Press; 2021:17-34.
- Simblett S, Greer B, Matcham F, Curtis H, Polhemus A, Ferrão J, et al. Barriers to and facilitators of engagement with remote measurement technology for managing health: systematic review and content analysis of findings. J Med Internet Res. 2018;20(7):e10480. [FREE Full text] [CrossRef] [Medline]
- Bhavnani SP, Narula J, Sengupta PP. Mobile technology and the digitization of healthcare. Eur Heart J. 2016;37(18):1428-1438. [FREE Full text] [CrossRef] [Medline]
- Topol EJ. Transforming medicine via digital innovation. Sci Transl Med. 2010;2(16):16cm4. [FREE Full text] [CrossRef] [Medline]
- Whitelaw S, Mamas MA, Topol E, van Spall HGC. Applications of digital technology in COVID-19 pandemic planning and response. Lancet Digit Health. 2020;2(8):e435-e440. [FREE Full text] [CrossRef] [Medline]
- Golinelli D, Boetto E, Carullo G, Nuzzolese AG, Landini MP, Fantini MP. Adoption of digital technologies in health care during the COVID-19 pandemic: systematic review of early scientific literature. J Med Internet Res. 2020;22(11):e22280. [FREE Full text] [CrossRef] [Medline]
- See COVID-19 and flu in your community. Outbreaks Near Me. URL: https://outbreaksnearme.org/us/en-US [accessed 2023-05-20]
- We’ve empowered millions of people to take control of their own health. ZOE Health Study. URL: https://health-study.joinzoe.com/ [accessed 2023-05-20]
- Menni C, Valdes AM, Freidin MB, Sudre CH, Nguyen LH, Drew DA, et al. Real-time tracking of self-reported symptoms to predict potential COVID-19. Nat Med. 2020;26(7):1037-1040. [FREE Full text] [CrossRef] [Medline]
- Varsavsky T, Graham MS, Canas LS, Ganesh S, Capdevila Pujol J, Sudre CH, et al. Detecting COVID-19 infection hotspots in England using large-scale self-reported data from a mobile application: a prospective, observational study. Lancet Public Health. 2021;6(1):e21-e29. [FREE Full text] [CrossRef] [Medline]
- Corona datenspende. Koch-Institut R. URL: https://corona-datenspende.de/science/en/ [accessed 2023-07-15]
- Shapiro A, Marinsek N, Clay I, Bradshaw B, Ramirez E, Min J, et al. Characterizing COVID-19 and influenza illnesses in the real world via person-generated health data. Patterns (N Y). 2021;2(1):100188. [FREE Full text] [CrossRef] [Medline]
- Witt D, Kellogg R, Snyder M, Dunn J. Windows into human health through wearables data analytics. Curr Opin Biomed Eng. 2019;9:28-46. [FREE Full text] [CrossRef] [Medline]
- Chakrabarti S, Biswas N, Jones L, Kesari S, Ashili S. Smart consumer wearables as digital diagnostic tools: a review. Diagnostics (Basel). 2022;12(9):2110. [FREE Full text] [CrossRef] [Medline]
- Fiordelli M, Diviani N, Schulz PJ. Mapping mHealth research: a decade of evolution. J Med Internet Res. 2013;15(5):e95. [FREE Full text] [CrossRef] [Medline]
- Radin JM, Wineinger NE, Topol EJ, Steinhubl SR. Harnessing wearable device data to improve state-level real-time surveillance of influenza-like illness in the USA: a population-based study. Lancet Digit Health. 2020;2(2):e85-e93. [FREE Full text] [CrossRef] [Medline]
- Grzesiak E, Bent B, McClain MT, Woods CW, Tsalik EL, Nicholson BP, et al. Assessment of the feasibility of using noninvasive wearable biometric monitoring sensors to detect influenza and the common cold before symptom onset. JAMA Netw Open. 2021;4(9):e2128534. [FREE Full text] [CrossRef] [Medline]
- Lee SG, Fisher NDL. Innovative remote management solutions for the control of hypertension. Hypertension. 2023;80(5):945-955. [FREE Full text] [CrossRef] [Medline]
- Ong JL, Tandi J, Patanaik A, Lo JC, Chee MWL. Large-scale data from wearables reveal regional disparities in sleep patterns that persist across age and sex. Sci Rep. 2019;9(1):3415. [FREE Full text] [CrossRef] [Medline]
- Perez MV, Mahaffey KW, Hedlin H, Rumsfeld JS, Garcia A, Ferris T, et al. Large-scale assessment of a smartwatch to identify atrial fibrillation. N Engl J Med. 2019;381(20):1909-1917. [FREE Full text] [CrossRef] [Medline]
- About one-in-five Americans use a smart watch or fitness tracker. Pew Research Center. URL: https://www.pewresearch.org/short-reads/2020/01/09/about-one-in-five-americans-use-a-smart-watch-or-fitness-tracker/ [accessed 2023-07-20]
- Riazul Islam SM, Kwak D, Kabir MD, Hossain M, Kwak K. The internet of things for health care: a comprehensive survey. IEEE Access. 2015;3:678-708. [CrossRef]
- Radin JM, Quer G, Jalili M, Hamideh D, Steinhubl SR. The hopes and hazards of using personal health technologies in the diagnosis and prognosis of infections. Lancet Digit Health. 2021;3(7):e455-e461. [FREE Full text] [CrossRef] [Medline]
- Noah B, Keller MS, Mosadeghi S, Stein L, Johl S, Delshad S, et al. Impact of remote patient monitoring on clinical outcomes: an updated meta-analysis of randomized controlled trials. NPJ Digit Med. 2018;1:20172. [FREE Full text] [CrossRef] [Medline]
- Smuck M, Odonkor CA, Wilt JK, Schmidt N, Swiernik MA. The emerging clinical role of wearables: factors for successful implementation in healthcare. NPJ Digit Med. 2021;4(1):45. [FREE Full text] [CrossRef] [Medline]
- Lu L, Zhang J, Xie Y, Gao F, Xu S, Wu X, et al. Wearable health devices in health care: narrative systematic review. JMIR Mhealth Uhealth. 2020;8(11):e18907. [FREE Full text] [CrossRef] [Medline]
Abbreviations
EMA: ecological momentary assessment |
FDA: Food and Drug Administration |
IC: informed consent |
NIH: National Institutes of Health |
OPR: Office of Patient Recruitment |
PASC: postacute sequelae of COVID-19 |
PRO: patient-reported outcome |
PRV: prospective research volunteer |
REDCap: Research Electronic Data Capture |
WHO: World Health Organization |
Edited by D Khajeei; The proposal for this study was peer-reviewed by: National Institute on Minority Health and Health Disparities (NIMHD) Scientific Review Committee (National Institutes of Health, USA). See the Multimedia Appendix for the peer-review report;submitted 15.02.24; accepted 14.06.24; published 16.08.24.
Copyright©Sherine El-Toukhy, Phillip Hegeman, Gabrielle Zuckerman, Anirban Roy Das, Nia Moses, James Troendle, Tiffany M Powell-Wiley. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 16.08.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.