Protocol
Abstract
Background: The lack of regular physical activity (PA) in individuals with spinal cord injury (SCI) in the United States is an ongoing health crisis. Regular PA and exercise-based interventions have been linked with improved outcomes and healthier lifestyles among those with SCI. Providing people with an accurate estimate of their everyday PA level can promote PA. Furthermore, PA tracking can be combined with mobile health technology such as smartphones and smartwatches to provide a just-in-time adaptive intervention (JITAI) for individuals with SCI as they go about everyday life. A JITAI can prompt an individual to set a PA goal or provide feedback about their PA levels.
Objective: The primary aim of this study is to investigate whether minutes of moderate-intensity PA among individuals with SCI can be increased by integrating a JITAI with a web-based PA intervention (WI) program. The WI program is a 14-week web-based PA program widely recommended for individuals with disabilities. A secondary aim is to investigate the benefit of a JITAI on proximal PA, defined as minutes of moderate-intensity PA within 120 minutes of a PA feedback prompt.
Methods: Individuals with SCI (N=196) will be randomized to a WI arm or a WI+JITAI arm. Within the WI+JITAI arm, a microrandomized trial will be used to randomize participants several times a day to different tailored feedback and PA recommendations. Participants will take part in the 24-week study from their home environment in the community. The study has three phases: (1) baseline, (2) WI program with or without JITAI, and (3) PA sustainability. Participants will provide survey-based information at the initial meeting and at the end of weeks 2, 8, 16, and 24. Participants will be asked to wear a smartwatch every day for ≥12 hours for the duration of the study.
Results: Recruitment and enrollment began in May 2023. Data analysis is expected to be completed within 6 months of finishing participant data collection.
Conclusions: The JITAI has the potential to achieve long-term PA performance by delivering tailored, just-in-time feedback based on the person’s actual PA behavior rather than a generic PA recommendation. New insights from this study may guide intervention designers to develop engaging PA interventions for individuals with disability.
Trial Registration: ClinicalTrials.gov NCT05317832; https://clinicaltrials.gov/study/NCT05317832
International Registered Report Identifier (IRRID): DERR1-10.2196/57699
doi:10.2196/57699
Keywords
Introduction
Background
Physical inactivity is a significant concern among the >300,000 individuals living with spinal cord injury (SCI) in the United States [
], who are at an elevated risk of mortality due to cardiovascular diseases, diabetes, and lung disease [ - ]. Low levels of physical activity (PA) in individuals with SCI have also been associated with secondary health conditions such as pain, fatigue, and depression [ - ]. Research studies have found varying percentages of the population with SCI that perform regular PA [ - ]. On the higher end, Rauch et al [ ] found that 48.9% of 485 participants with SCI in Switzerland met World Health Organization recommendations of 2.5 hours per week of moderate-intensity or higher PA, and 18.6% were physically inactive. On the lower end, Tasiemski et al [ ] found that only 20% of 985 people with SCI in the United Kingdom performed regular PA of 2 hours per week, and 53.3% reported no regular PA. Furthermore, several other studies have indicated that most individuals with SCI do not perform regular PA [ - ].Regular PA and exercise interventions in individuals with SCI have been linked with improved cardiorespiratory fitness, quality of life, and functional independence, as well as reduced risk of cardiometabolic disease, depression, and shoulder pain [
, , , ]. Although there are significant health and quality-of-life benefits with regular PA, various barriers limit individuals with SCI from performing PA regularly [ ]. To address some of these barriers, the National Center on Health, Physical Activity, and Disability (NCHPAD) has developed a free web-based PA program for people with mobility limitations, chronic health conditions, and physical disabilities [ ]. Web-based PA programs can lead to an increase in PA level and duration of PA performed by individuals with SCI [ - ]. One of the facilitators that can promote PA during PA intervention programs is to provide people with an accurate estimate of their everyday PA level in the community [ , - ]. This information can empower individuals with knowledge about their regular PA levels, which in turn can help develop a physically active identity [ ].The PA of individuals with SCI is frequently assessed through samples of individuals who provide self-reports [
- ], which may have recall bias and social acceptability bias. To address these limitations and to better quantify PA and exercise interventions, researchers have validated sensor-based activity monitors in laboratories and community-dwelling environments [ , , ]. PA tracking can also be combined with mobile health (mHealth) technology to provide a just-in-time adaptive intervention (JITAI) for individuals with SCI as they go about everyday life. A JITAI uses mHealth technology to deliver the intervention at appropriate times and contexts to support individuals’ health behaviors [ , , ]. For example, Klasnja et al [ ] used a JITAI to provide a real-time feedback intervention aimed at improving step count in individuals without disabilities. Our team tested a pilot JITAI for its feasibility and acceptability in individuals with SCI [ ]. Results from our pilot study indicated that participants wished to have the system provide customized messages to help them further increase their PA levels. These customized messages combined with web-based PA intervention programs have the potential to impact factors such as intent to increase PA, awareness of PA benefits, reminders, and encouragement that are related to increased PA levels in individuals with SCI [ , , , ].Objectives
The overarching goal of this study is to investigate the benefits of combining an mHealth-based JITAI with the NCHPAD’s 14-week web-based PA intervention (WI) program for increasing and sustaining moderate-intensity or higher PA levels among individuals with SCI. This protocol outlines the study design for investigating the impact of integrating a JITAI with the WI program via a randomized controlled trial that integrates a 2-arm trial and a microrandomized trial (MRT). Specifically, individuals with SCI (N=196) will be randomized to either a WI program or a WI program combined with the JITAI (WI+JITAI). Within the WI+JITAI arm, an MRT [
, , ] will be used to microrandomize participants several times a day to various types of feedback and PA recommendations. The primary aim is to investigate the long-term benefits of adding a JITAI to WI. We hypothesize that the integration of a JITAI into WI will produce significantly higher PA levels than those with WI alone. The secondary aim is to investigate the benefit of just-in-time PA feedback on proximal PA. Proximal PA is defined as moderate-intensity PA within 120 minutes of a PA feedback prompt. The exploratory aim will investigate time-invariant moderators such as biological sex and level of injury and time-varying moderators such as prior PA and engagement with the JITAI to help identify subgroups of individuals with SCI who are likely to benefit the most from the integration of a JITAI with WI.Methods
Ethical Considerations
The institutional review board at Temple University has reviewed and approved this research study (protocol number 27338). The study will be executed in accordance with the ethical standards for human participants. All participants will provide written informed consent. The consent form will include the purpose of the research study, description of what participation in the study entails, and contact information of the principal investigator and the institutional review board. The consent form will be discussed with all participants by an investigator, and the participant will be offered a chance to consent at the conclusion of this discussion. Should the potential participant wish additional time to consider whether to consent, they will be given as much time as they desire. All participants will receive a copy of the consent form for their records. Verbal discussion will ensure participants understand each consent topic as it is discussed, and participants will be advised that their signature indicates their understanding and consent. It is reinforced throughout the consent form that participants are free to ask questions at any stage of the study, including before, during, or after the consent process. All participants will be informed of their right to withdraw from the study at any time. To maintain confidentiality, records and sensor data will be deidentified by assigning a case number to each participant. The study is registered on ClinicalTrials.gov (NCT05317832).
Research Design
Overview
Participants will take part in the study from their home environment in the community. The study has three phases: (1) baseline (weeks 1 and 2); (2) WI program with or without JITAI (weeks 3-16); and (3) PA sustainability (weeks 17-24). Participants will provide survey-based information at various time points during the 24-week study. Participants will be asked to wear a smartwatch every day for ≥12 hours for the duration of the study. The PA intervention for this study is informed by the capability, opportunity, and motivation (COM-B) model, which highlights that these 3 constructs should be considered when developing a behavioral intervention [
]. To our knowledge, this is the first study to optimize a JITAI that has the potential to boost PA levels using real-time feedback for individuals with SCI.Behavioral Intervention Model
The proposed intervention approach builds on the COM-B model [
]—an organizing framework for designing behavior change interventions [ - ]. An individual’s capability, opportunity, and motivation interact to generate behavior (eg, PA) that in turn influences these 3 constructs ( ) [ ]. Capability is the individual’s psychological and physical capacity to perform the desired activity, including having the necessary knowledge and skills. Motivation is the individual’s internal drive or energy that directs behavior, including conscious or analytic decision-making, as well as habitual processes and emotional responses. Opportunity captures environmental (social and physical) factors external to the individual that facilitate or undermine behavior. The solid arrows in represent potential influence between these constructs [ ]. For example, opportunity can enhance (eg, a supportive environment) or inhibit (eg, an adverse environment) motivation and capabilities [ ]. It is also possible that enacting a behavior can alter capability, motivation, and opportunity. This framework incorporates context naturally through the “opportunity” construct [ ]. For individuals with SCI, the context is characterized by physiological and environmental barriers to participate in PA [ , ] and stigma [ ], which can hinder motivation and capability to engage in PA.Conceptual Framework of the JITAI
The framework used for this proposed study (
) is adapted from Nahum-Shani et al [ ], which highlights 4 components including decision points, intervention options, tailoring variables, and decision rules. JITAIs often provide an intervention through a smartphone, wearable activity monitor, or both. The system automatically determines which intervention option, such as prompting an individual to set a goal to perform PA or prompting feedback about PA, could be helpful or especially effective. Engagement with the JITAI, that is, effort invested in the JITAI [ ], is critical for intervention effectiveness [ ]; therefore, JITAI components should be selected and designed to promote engagement [ ].NCHPAD’s WI Program
Our proposed JITAI will be offered along with NCHPAD’s 14 Weeks to a Healthier You Program [
, , ], modified to be accessible on a smartphone or tablet. This 14-week WI program was launched in 2011 by NCHPAD with funding from the Centers for Disease Control and Prevention [ ]. Since its launch, the program has been used by >45,000 people with various physical disabilities. It is the most widely recommended web-based PA program across various disabilities and state disability programs [ ]. The program’s uniqueness lies in its ability to offer tailored exercise that matches the participants’ functional capabilities. The WI program was developed with guidance from literature and practice in health behavior change and internet-based health promotion programming. In addition, preliminary evaluations by individuals with disabilities were used to update the WI program. lists motivational resource for each week of the program [ ]. The content for all weeks include an introductory video, exercise resources, motivational resources, recipes, and nutrition resources. Customizable features for all weeks include my schedule, initial assessment, badge reward system, my goals, and daily reminder.Motivational resources
- Week 1: Goal setting
- Week 2: Overcoming barriers
- Week 3: Benefits of activity
- Week 4: Weight management
- Week 5: Self-monitoring
- Week 6: Keep it fun!
- Week 7: Rewarding yourself
- Week 8: Building social support
- Week 9: Stimulus control
- Week 10: Preventing injuries
- Week 11: Self-advocacy in recreation
- Week 12: Activity in daily life
- Week 13: Avoiding overtraining
- Week 14: Keeping it up!
Integration of JITAI With WI
The integration between the WI and JITAI is designed to blend multiple evidence-based components aimed at prompting capability, motivation, and opportunity for engaging in PA among individuals with SCI (
). Capability will be enhanced by not only providing tailored information and advice for individuals with SCI via the standard WI but also by using self-regulatory techniques, operationalized by setting goals, monitoring progress, and providing timely feedback via the JITAI [ , , ]. To enhance motivation to engage in PA, the JITAI will reinforce progress by providing just-in-time feedback about the minutes of moderate-intensity PA achieved or remaining to be achieved toward the daily goal. Opportunity will be enhanced by identifying specific types of goals (tailored, standard, or goal not presented) and PA feedback (achieved, to-go, or feedback not presented) that will be most beneficial in promoting daily and proximal PA, respectively. Although the standard goal encourages the individual to perform 20 minutes of moderate-intensity PA for the day based on PA guidelines for adults with SCI [ ], a tailored goal is based on average minutes of moderate-intensity PA performed by the individual over the last 7 days. The choice of the last 7 days is based on PA guidelines for adults with SCI [ ] and our pilot study [ ] in which participants had lower PA for 1 or 2 days during the week. Although the achieved PA feedback message focuses on the PA level the person has accomplished until that moment in the day, the to-go message focuses on the remainder of the PA level the person has to accomplish to meet their designated goal. Prior research has indicated that the gain-framed messages were more likely than loss-framed messages to encourage prevention behaviors such as PA [ ]. In this study, we are interested in evaluating whether participants prefer achieved PA message (gained) or to-go message (to gain) to accomplish their goal. In addition, the participants will be reminded to engage with the WI on a regular basis.WI | WI+JITAI | |
Capability |
|
|
Motivation |
|
|
Opportunity |
|
|
aPA: physical activity.
PA Intervention Components
The PA intervention components include either the WI program or the WI program combined with JITAI for individuals assigned to the WI or WI+JITAI arms, respectively.
WI Program
Participants will access the 14-week WI program and answer questions related to their interests, needs, and abilities (
), which will be used to tailor the content (exercises and videos). Participants can monitor the WI program use on their dashboard. From this point forward, program content automatically updates every week to introduce new exercises and a weekly motivational and educational topic. Participants will receive a daily reminder, except for the day off, on the smartwatch to access the WI program ( ). Furthermore, participants will have access to the minutes of moderate-intensity PA performed over the last 7 days on the study smartphone ( ).JITAI Components
Participants in the WI+JITAI arm will have access to the JITAI components. In addition to WI program access, participants will receive just-in-time feedback and PA recommendations informed by the guidelines for adults with SCI [
]. Participants will have access to the minutes of moderate-intensity PA performed over the last 7 days on the study phone. In addition, they will have near–real-time access to minutes of moderate-intensity PA performed for the day on their smartwatch.During the 22-week intervention period, the PA feedback and recommendation messages will be delivered using microrandomization, which involves random selection of intervention options at each possible time of delivery [
, ]. The microrandomizations will assess the proximal benefits of just-in-time interventions ( and ): (1) PA recommendations by randomizing the participant with a 33% probability to a standard, tailored, or no goal within 1 to 2 hours of waking up ( ) and (2) PA feedback prompts by randomizing the participant with a 50% probability to a JITAI message or no message twice a day ( ). The first and second PA feedback prompts are randomized between 2 and 4 hours after wake-up and 6 to 8 hours after wake-up, respectively. shows the type and number of messages participants will receive during the intervention period. Within the PA feedback prompts, the participant will be randomized to an achieved or to-go message with a 25% probability per day. The participant can acknowledge seeing the JITAI message by pressing a “Got it” pop-up button that appears on their smartwatch. Furthermore, since the smartwatch’s accelerometer sensor can detect movement-based PA and not the intensity of the strength exercises, participants will respond to a short ecological momentary assessment, presented on their smartwatch at the end of the day to confirm whether they performed exercises (aerobic, strength, or both; ). The choice of 2 randomizations per day for feedback prompts was based on our pilot study [ ], in which the participants felt that 5 interruptions per day were reasonable and not distracting. The other 3 interruptions include goal-type message, WI reminder, and a short ecologic momentary assessment at the end of the day.Goal-type message (number of days in a week) | Number of JITAIa or no message per goal type (randomized) | Number and type of JITAI messages per goal type (randomized) | Number of ecological momentary assessments per goal type | ||
JITAI message | No message | JITAI (achieved) | JITAI (to go) | ||
Standard goal (2) | 2 | 2 | 1 | 1 | 2 |
Tailored goal (2) | 2 | 2 | 1 | 1 | 2 |
No goal (2) | 2 | 2 | 2 | 0 | 2 |
Day off (1) | 0 | 0 | 0 | 0 | 1 |
aJITAI: just-in-time adaptive intervention.
Personalized PA Threshold Identification
A multifaceted approach of using self-reported PA data with sensor data from the smartwatch during the baseline period will help identify personalized PA thresholds. These personalized PA thresholds are then used by the JITAI to determine whether minutes of moderate-intensity PA per day for each participant have been achieved each day for the rest of the study period. Baseline PA data are quantified using a motion summary measure that is computationally feasible on the smartwatch for real-time computation. Area under the curve (AUC) values obtained from high-pass–filtered triaxial accelerometer signals are summed each minute to obtain a single motion measure per minute, which is then further summed throughout the day. The AUC values provide a quantitative and cumulative measure of PA over time because they integrate the intensity of motion activity over time. The choice of a relatively simple measure of PA intensity is due to its low computational demands on the central processing unit, causing a reduced impact on the battery life of the smartwatch. In addition, self-reported PA data are collected through the Physical Activity Recall Assessment for people with SCI, which provides subjective insights from the participants [
]. After the baseline data collection, we will meticulously compare the self-reported PA data with AUC data to determine a new threshold value for each participant ( ) to gain a more comprehensive understanding of their actual PA levels and intensity. The rationale for this process is due to various functional deficits resulting from complete or incomplete SCI at different neurological levels (cervical, thoracic, lumbar, and sacral) [ ]. These functional deficits, in turn, lead to large biomechanical variations of upper extremity use during exercise and mobility. Moreover, developing person-specific models that are trained to recognize the types of activities each person with SCI can perform would be burdensome. Our approach of using movement data from a wrist-worn smartwatch allows us to generalize the intervention to persons with SCI without requiring them to come to a laboratory for extensive measurements.Sample Size Determination
Sample size calculation for the primary aim (a 2-arm randomized controlled trial) indicated that 82 participants are needed per group to detect at least a standardized mean difference of 0.44 [
] (considered small to moderate) in the primary outcome, with 80% power (assuming a 2-sided test with an α level of .05). On the basis of prior research [ , ] and our pilot study [ ], we anticipate a 20% dropout rate. Thus, we plan to recruit a total of 196 participants with SCI (98 participants per group). In addition, power analysis for the secondary aim (an MRT) based on 2 randomizations per day indicated that a sample size of 69 is needed to detect a difference between JITAI message and no message on the proximal PA achieved for the WI+JITAI arm [ , ]. We assumed an average proximal treatment effect for message versus no message of 0.10 (considered small) that starts with 0.12 (ie, a small effect) and decreases linearly for the 16 weeks, an α level of .05, and 80% power [ ]. We will have sufficient power for the MRT given we plan to recruit 98 individuals for the WI+JITAI arm to ensure that the primary aim is powered.Recruitment
Our collaborative research team will work with coinvestigators from Magee Rehabilitation Hospital, MossRehab Hospital, Thomas Jefferson University Hospital, and Good Shepherd Rehabilitation Network to recruit participants for this study. We have an established collaboration for the past 6 years. Participants will be recruited through a multipronged approach including (1) the clinicians identifying patients with SCI at their clinics who are eligible for the study and providing them with study flyers, (2) flyers being placed in the common areas of the outpatient clinics, and (3) flyers being distributed through their listserves. In addition, we will send flyers to local and national support groups for individuals with SCI in the United States to increase the visibility of our study.
Eligibility Criteria
Participants will be included if they (1) are aged 18 to 75 years; (2) have a traumatic (neurological level of injury at cervical level 5 and below) or nontraumatic SCI; (3) are ≥6 months after SCI; (4) use a manual or a power wheelchair as their primary means of mobility (>80% of time); (5) show readiness for PA as assessed by the Physical Activity Readiness Questionnaire; (6) can use their upper arms for exercise; (7) can use a smartphone including interacting, recharging, and carrying it with them; and (8) can use a smartwatch including interacting, recharging, and wearing it. Participants will be excluded if they (1) have any secondary complications such as pressure injuries, contractures, and infections that medically restrict their activity in any way; (2) are diagnosed with traumatic brain injury; and (3) have a history of cardiovascular disease.
Screening
Participants who contact us and indicate an interest to participate in the study will be informed about the inclusion and exclusion criteria. Participants will verbally indicate if they meet the criteria. If they meet the criteria, we will schedule a first meeting with them. If they do not qualify, we will not record or store any data.
Protocol and Assessments
Participant Meetings
All study procedures will be performed at Temple University or in the community. Our team can work with the participants remotely via Health Insurance Portability and Accountability Act–compliant video conference meeting software, such as Zoom (Zoom Video Communications), to obtain study-related information; we will send participants an Android-based smartphone and a smartwatch through postal mail. The research team can also meet with participants for a 30-minute face-to-face meeting if they prefer and are located within the greater Philadelphia region. All precautions will be taken to minimize the risks to participants and the research staff during the face-to-face meeting. Recruiting individuals who wish to remotely participate in the study will help improve the chances of including individuals with SCI who face transportation barriers, boost recruitment, and enhance retention.
The initial meeting will allow individuals with SCI to provide informed consent and answer questions about their demographics, SCI, wheelchair, and health and activity history. From prior research studies, the investigators estimate that the questionnaires will take approximately 60 to 90 minutes to complete (
). Participants will also answer questionnaires 4 to 12 indicated in at the end of weeks 2, 8, 16, and 24.Questionnaire
1. Demographics (eg, age, biological sex, gender, race, ethnicity, and marital status)
2. Spinal cord injury (SCI) and level of injury (SCI Core Data Set Form, SCI Spinal Column Injury Basic Data Set Form, Non-traumatic SCI Data Sets Version 1.0 Form, and American Spinal Cord Injury Association Impairment Scale)
3. Mobility (Assistive Mobility Devices and Orthoses Form)
4. Pressure injuries (Pressure Ulcer Scale for Healing Tool 3.0), if applicable
5. Pain (International SCI Pain Basic Data Set Version 2.0 Form)
6. Fatigue (Neuro-QOL Item Bank Version 1.0 Fatigue Short Form)
7. Function (Spinal Cord Independence Measure III)
8. Quality of life (Quality of Life Basic Data Set Version 1.0)
9. Physical activity (PA) history (Physical Activity Recall Assessment for people with SCI Survey and Leisure Time Physical Activity Questionnaire for People with SCI Survey)
10. PA behavior (SCI Physical Activity Behavior Survey)
11. Barriers to PA (Barriers to Physical Activity Questionnaire for People with Mobility Impairments)
12. Participants’ motivation (Physical Activity and Leisure Motivation Scale)
Allocation and Blinding
After the baseline data collection, participants will be randomly allocated to one of 2 study arms (WI arm or WI+JITAI arm) based on the randomization schedule established by the project biostatistician. Participants will be block randomized on the basis of their level of injury: tetraplegia (higher-level injury) versus other (lower-level injury).
Participants will be masked (single blinding) to the study arm. All participants will receive the same WI program and commercial off-the-shelf technology. Participants in both arms will have access to minutes of moderate-intensity PA performed over the last 7 days, which is designed to motivate them to use the smartwatch in the community. In addition, the participants in the WI+JITAI arm will receive randomized prompts of various types of tailored feedback and PA recommendations over the course of the study.
Participant Testing in the Community
Overview
The research team will conduct a web-based training session for all participants to introduce them to the WI program, and study-related smartphone and smartwatch. Participants will be loaned an Android-based smartphone and smartwatch. Participants will be asked to wear the smartwatch every day for ≥12 hours. Participants are expected to wear the smartwatch for at least 6 days of the week to assist with good quality data collection for the study. They will be asked to charge the smartphone and smartwatch nightly. Participants can leave the smartphone at home. Once smartphone and smartwatch setup is complete, participants will be instructed to continue with their normal daily routine for 2 weeks during baseline data collection. With regard to the WI and WI+JITAI arms, at the end of the study, the research team will send the participants a return postal packet for them to return the study-related smartphone and smartwatch.
WI Program
Participants will access the 14-week WI program. Participants will receive reminders on the smartwatch to access the WI program. Furthermore, the study team will emphasize features such as badges for completing weekly modules to promote engagement with the WI program.
WI Arm
Participants in the WI arm will take part in the WI program mentioned above. They will also have access to the minutes of moderate-intensity PA performed over the last 7 days on their study smartphone. After the WI program is completed in week 16, the participants will transition to the PA sustainability phase (weeks 17-24), which will include participants having continued access to the WI program and PA performed over the last 7 days.
WI+JITAI Arm
Participants in the WI+JITAI arm will also take part in the WI program. They will have access to minutes of moderate-intensity PA performed over the last 7 days on their study smartphone, just-in-time feedback, and PA recommendations that are informed by PA guidelines for adults with SCI [
] on their smartwatch, and near–real-time minutes of PA performed over the day on their smartwatch. After the WI program is completed in week 16, the participants will transition to the PA sustainability phase (weeks 17-24), which will include participants having continued access to the WI program and feedback and recommendations on their study smartphone and smartwatch.Compensation
Participants will receive gift cards for a total value of US $160 for completing the study. The participant incentives are provided upon completion of meetings and data collection. The incentives are divided into US $20 per meeting for the initial and final meetings of the study and US $20 for every 4-week duration of the study for a 24-week study.
Statistical Analysis
Overview
For all aims, descriptive statistics will be obtained to assess distributional assumptions, and any transformations will be applied if needed. In addition, we will examine patterns of missingness and handle this appropriately through either multiple imputation or using models that can appropriately handle missingness (eg, mixed-effects models). We will also examine whether there are any group differences on baseline covariates (eg, pain, fatigue, health, and activity history) despite randomization, and if so, we will statistically control for these variables in our models. All analysis will be performed with an α level of .05.
Primary Aim Analysis
We hypothesize that the integration of WI+JITAI will produce significantly higher PA levels over 14 weeks than the standard WI alone. Exploratory outcomes include long-term PA (measured via sensors and self-report) over 24 weeks (approximately 6 months). To test our hypothesis, we will fit a mixed-effects model in which the group indicator variable is a predictor, and the outcomes are the PA measurements at 2, 8, and 16 weeks. We will include an interaction with time in the model because we hypothesize that although PA levels may increase in both groups, they will increase more in the WI+JITAI group. We will also include a random intercept and slope for time. To evaluate long-term PA, we will include the PA levels at 24 weeks in the model.
Secondary Aim Analysis
Data from the individuals with SCI assigned to the WI+JITAI condition will be used to assess the impact of randomly provided just-in-time PA feedback on proximal PA. The analysis will address the question of whether, on average, the just-in-time PA feedback intervention has a proximal effect on moderate-intensity PA within 120 minutes of the feedback prompt. We will also assess the impact of randomly provided goal-type message for the day on daily PA level achievement. We will use a generalization of regression analysis specifically developed to ensure unbiased estimation of causal effects of time-varying treatments (eg, feedback prompts) in mHealth settings [
, ]. Since the treatment is time-varying, potential time-varying moderators, such as pain or fatigue, and potential control variables, such as PA in the 30 minutes before the randomization decision point, may be outcomes of past treatment. Because our randomization probability is constant over the course of the study, we can use generalized estimating equations in which we include availability as weights with an independence working correlation matrix and sandwich SEs as described in Boruvka et al [ ]. We use an independence correlation matrix because causal effect estimates are biased if off-diagonal elements are present [ , ]. These analyses pool time-varying, longitudinal data across all study participants. There are 2 possible intervention options at each decision point (PA feedback or no feedback). Thus, the models will include an indicator variable for PA feedback versus no feedback. In addition, we will include day in the study, as well as the interaction between day and each treatment indicator variable, and potential control variables such as PA in the 30 minutes before the randomization decision point to assess whether the proximal effect varies over the course of the study.Exploratory Analysis
Moderators will include age, biological sex, race, ethnicity, level of injury, function, mobility, pain, and fatigue. The exploratory analysis aims to identify subgroups of individuals with SCI who are likely to benefit the most from the integration of just-in-time PA feedback and recommendations with WI. We will conduct 2 moderation analyses. First, we will incorporate moderators into our primary aim models to identify subgroups of individuals with SCI who are likely to benefit the most from the integration of just-in-time PA feedback and recommendations with WI. Second, we will address potential time-varying moderators, such as prior PA and engagement with the JITAI, self-reported pain (number and type), and fatigue, which can be incorporated into the model described in the secondary analysis [
]. Engagement with JITAI will be captured by participants’ response to the “Got it” pop-up button that appears on the smartwatch when they receive a JITAI message. We will also examine potential time-invariant moderators such as biological sex and SCI level. This analysis will allow us to identify subgroups of individuals who are likely to benefit from particular types of messages (eg, tailored vs standard messages).Results
Overview
This study was funded by the Eunice Kennedy Shriver National Institute of Child Health and Human Development, National Institutes of Health (
). Recruitment and enrollment began on May 25, 2023. As of the submission of this manuscript, participant enrollment is ongoing. Since the research study involves no more than minimal risk, there will be no interim analysis, and data and safety monitoring will occur in accordance with guidelines by the Eunice Kennedy Shriver National Institute of Child Health and Human Development and the institutional review board of record. Data analysis is expected to be completed within 6 months of ending participant data collection.Dissemination Policy
We plan to disseminate our findings in the form of interdisciplinary peer-reviewed manuscripts, presentations at local rehabilitation hospitals, and presentations at national and international conferences.
Discussion
Implications
PA interventions paired with mHealth technologies that continuously measure behavior can provide novel insights about PA patterns in the community. Individuals with SCI, although generally stable in the chronic postrehabilitation phase, are at a higher risk than the general population for secondary health conditions due to physiological changes associated with injury and due to sedentary behaviors potentially related to the use of assistive technology such as wheelchairs [
, ]. Accurate, real-time measurement of PA using affordable and convenient wearable monitors will not only enable more research on existing behavior and relationships to health outcomes but also allow insight into innovative JITAIs that may help individuals with SCI become more active in everyday life. To address these needs, we will investigate whether combining a JITAI with a WI program increases and sustains PA levels among individuals with SCI in the community. The JITAI will automatically detect PA levels and provide behavior-sensitive PA recommendations and feedback to increase PA in individuals with SCI. Although existing PA-based programs often require individuals to participate in them several times a week, a JITAI can act as a constant companion that encourages individuals and assists them in attaining their daily and weekly PA goals. The JITAI will operate as people go about their everyday lives in the community; as they do so, the JITAI will provide timely and tailored encouragement, feedback, and PA interventions designed to support sustainable behavior change [ , ].Regular PA feedback has the potential to make individuals self-aware of their PA levels, which may be effective in a small percentage of individuals who are motivated to increase their PA levels [
]. To achieve long-term PA performance required to support behavior change and maintenance, there is a need to tailor PA feedback and recommendations based on an individual’s behaviors and goals. This study will focus on understanding the impact of different messages on promoting proximal PA performance. Furthermore, use of an MRT study design will allow us to assess the effect of the JITAI components on participants’ PA levels over time. MRT designs enable us to investigate the causal proximal effects of just-in-time interventions and test time-varying moderators of those effects [ , ]. On the basis of the impact of the type of messages on proximal PA, MRT results will allow us to determine the relative utility of various feedback and PA recommendation strategies.Anticipated Findings
This project will investigate a state-of-the-art JITAI-enhanced WI program, which is guided by the COM-B model [
], that highlights the importance of capability, motivation, and opportunity for behavior change. JITAIs using mHealth technology can deliver an intervention that feels dynamic and personally responsive and thus more engaging to the individual. In this study, we will test whether PA levels change with WI and JITAI-based PA recommendations and feedback prompts. We will test 3 ways of providing PA recommendations (standard goal, tailored goal, or no goal) and 3 types of feedback prompts (PA achieved, PA to-go, or PA feedback not presented) to determine whether adding the JITAI to the WI may impact PA levels and sustain changes over time. Furthermore, the study design will allow us to identify subgroups of individuals with SCI who are likely to benefit the most from the integration of JITAI with WI. The identification of such subgroups will inform the design, development, and evaluation of JITAIs for future physical rehabilitation intervention studies for individuals with and without disabilities.Limitations
One of the potential limitations of this study is that our JITAI has been developed for Android-based smartphones, which provide greater flexibility in research and are used by 53.9% of smartphone users in North America [
]. In addition, we are loaning participants study-related devices that are not personal devices. If we can show the efficacy of the JITAI with this randomized clinical trial using Android devices, the approach of using a JITAI to provide a PA intervention could be converted to other operating systems (eg, iPhone with Apple Watch). This step-wise approach is cost-effective and will test the viability of the underlying behavior change approach; future versions of the JITAI that use personal devices may further improve compliance and reduce burden. We will recruit adults with SCI between 18 and 75 years old; this age range includes 89.2% of all those with SCI [ ]. Children will not be studied due to their use of different wheelchairs during their development, and because children’s responses to and recovery from an SCI differ from those of adults. However, evaluation of JITAI in children with SCI is a potential avenue for future investigations. Another limitation concerns the use of a relatively simple measure of PA intensity. Future work might use more sophisticated, person-specific models trained to recognize the types of activities each person with SCI can perform when obtaining moderate-intensity PA.Conclusions
The JITAI has the potential to improve long-term PA performance by delivering tailored just-in-time feedback based on the person’s actual PA behavior rather than a generic PA recommendation. New insights from this study may assist intervention developers in creating more engaging PA interventions for individuals with disabilities. Our work could lead to more impactful and sustainable clinical and rehabilitation interventions for this population by demonstrating how the use of affordable, off-the-shelf consumer devices to create a JITAI may enhance existing interventions.
Acknowledgments
This work was supported by the Eunice Kennedy Shriver National Institute of Child Health and Human Development, National Institutes of Health (grant 5R01HD103904). The authors would like to thank participants with spinal cord injury for volunteering for this research study.
Data Availability
Data sharing is not applicable to this paper because no data sets were generated or analyzed during development of this study protocol. The deidentified data sets generated during the actual research study will be presented in the main manuscript and as additional supporting files.
Authors' Contributions
DLC, IN-S, MT, RJM, SSI, and SVH contributed substantially to the conception and design of the study and intervention. RLC, LAB, MS-R, MSRL, SAK-H, RJM, and SVH contributed substantially to the recruitment design of the clinical trial. HL and SSI developed and optimized the just-in-time adaptive intervention mHealth application. RLC, HL, CH, SSI, and SVH contributed substantially to the feasibility, testing, and evaluation of the just-in-time adaptive intervention mHealth application and design and development of data pipeline for collecting sensor data from this decentralized clinical trial. All authors reviewed and approved the final manuscript.
Conflicts of Interest
None declared.
Peer-review report by the CMPC - Clinical Management of Patients in Community-based Settings Study Section - National Institutes of Health (NIH), United States.
PDF File (Adobe PDF File), 131 KBReferences
- Traumatic spinal cord injury facts and figures at a glance. National Spinal Cord Injury Statistical Center. 2023. URL: https://www.nscisc.uab.edu/public/Facts%20and%20Figures%202024%20-%20Final.pdf [accessed 2024-06-01]
- The 2022 annual statistical report complete public version for the spinal cord injury model systems. National Spinal Cord Injury Statistical Center. 2022. URL: https://www.nscisc.uab.edu/public/AR2022_public%20version.pdf [accessed 2024-06-01]
- DeVivo MJ, Chen Y, Wen H. Cause of death trends among persons with spinal cord injury in the United States: 1960-2017. Arch Phys Med Rehabil. Apr 2022;103(4):634-641. [CrossRef] [Medline]
- Savic G, DeVivo MJ, Frankel HL, Jamous MA, Soni BM, Charlifue S. Causes of death after traumatic spinal cord injury-a 70-year British study. Spinal Cord. Oct 2017;55(10):891-897. [CrossRef] [Medline]
- Tawashy AE, Eng JJ, Lin KH, Tang PF, Hung C. Physical activity is related to lower levels of pain, fatigue and depression in individuals with spinal-cord injury: a correlational study. Spinal Cord. Apr 2009;47(4):301-306. [FREE Full text] [CrossRef] [Medline]
- Alschuler KN, Jensen MP, Sullivan-Singh SJ, Borson S, Smith AE, Molton IR. The association of age, pain, and fatigue with physical functioning and depressive symptoms in persons with spinal cord injury. J Spinal Cord Med. Sep 2013;36(5):483-491. [FREE Full text] [CrossRef] [Medline]
- Canori A, Amiri AM, Thapa-Chhetry B, Finley MA, Schmidt-Read M, Lamboy MR, et al. Relationship between pain, fatigue, and physical activity levels during a technology-based physical activity intervention. J Spinal Cord Med. Jul 2021;44(4):549-556. [FREE Full text] [CrossRef] [Medline]
- Rauch A, Hinrichs T, Oberhauser C, Cieza A, SwiSCI study group. Do people with spinal cord injury meet the WHO recommendations on physical activity? Int J Public Health. Jan 2016;61(1):17-27. [CrossRef] [Medline]
- Filipcic T, Sember V, Pajek M, Jerman J. Quality of life and physical activity of persons with spinal cord injury. Int J Environ Res Public Health. Aug 30, 2021;18(17):9148. [FREE Full text] [CrossRef] [Medline]
- Tasiemski T, Kennedy P, Gardner BP, Taylor N. The association of sports and physical recreation with life satisfaction in a community sample of people with spinal cord injuries. NeuroRehabilitation. 2005;20(4):253-265. [Medline]
- van der Scheer JW, Martin Ginis KA, Ditor DS, Goosey-Tolfrey VL, Hicks AL, West CR, et al. Effects of exercise on fitness and health of adults with spinal cord injury: a systematic review. Neurology. Aug 15, 2017;89(7):736-745. [CrossRef] [Medline]
- Fernhall B, Heffernan K, Jae SY, Hedrick B. Health implications of physical activity in individuals with spinal cord injury: a literature review. J Health Hum Serv Adm. 2008;30(4):468-502. [Medline]
- Soriano JE, Squair JW, Cragg JJ, Thompson J, Sanguinetti R, Vaseghi B, et al. A national survey of physical activity after spinal cord injury. Sci Rep. Mar 15, 2022;12(1):4405. [FREE Full text] [CrossRef] [Medline]
- Itodo OA, Flueck JL, Raguindin PF, Stojic S, Brach M, Perret C, et al. Physical activity and cardiometabolic risk factors in individuals with spinal cord injury: a systematic review and meta-analysis. Eur J Epidemiol. Apr 2022;37(4):335-365. [FREE Full text] [CrossRef] [Medline]
- Tweedy SM, Beckman EM, Geraghty TJ, Theisen D, Perret C, Harvey LA, et al. Exercise and sports science Australia (ESSA) position statement on exercise and spinal cord injury. J Sci Med Sport. Feb 2017;20(2):108-115. [CrossRef] [Medline]
- Williams TL, Smith B, Papathomas A. The barriers, benefits and facilitators of leisure time physical activity among people with spinal cord injury: a meta-synthesis of qualitative findings. Health Psychol Rev. 2014;8(4):404-425. [CrossRef] [Medline]
- NCHPAD 14 weeks to a healthier you! National Center on Health, Physical Activity and Disability. URL: https://www.nchpad.org/14weeks/ [accessed 2023-09-01]
- Froehlich-Grobe K, Lee J, Ochoa C, Lopez A, Sarker E, Driver S, et al. Effectiveness and feasibility of the workout on wheels internet intervention (WOWii) for individuals with spinal cord injury: a randomized controlled trial. Spinal Cord. Oct 2022;60(10):862-874. [FREE Full text] [CrossRef] [Medline]
- Bombardier CH, Dyer JR, Burns P, Crane DA, Takahashi MM, Barber J, et al. A tele-health intervention to increase physical fitness in people with spinal cord injury and cardiometabolic disease or risk factors: a pilot randomized controlled trial. Spinal Cord. Jan 2021;59(1):63-73. [FREE Full text] [CrossRef] [Medline]
- Wilroy JD, Lai B, Davlyatov G, Mehta T, Thirumalai M, Rimmer JH. Correlates of adherence in a home-based, self-managed exercise program tailored to wheelchair users with spinal cord injury. Spinal Cord. Jan 2021;59(1):55-62. [FREE Full text] [CrossRef] [Medline]
- Chemtob K, Rocchi M, Arbour-Nicitopoulos K, Kairy D, Fillion B, Sweet SN. Using tele-health to enhance motivation, leisure time physical activity, and quality of life in adults with spinal cord injury: a self-determination theory-based pilot randomized control trial. Psychol Sport Exerc. Jul 2019;43:243-252. [CrossRef]
- Tsang K, Hiremath SV, Crytzer TM, Dicianno BE, Ding D. Validity of activity monitors in wheelchair users: a systematic review. J Rehabil Res Dev. 2016;53(6):641-658. [FREE Full text] [CrossRef] [Medline]
- Nightingale TE, Rouse PC, Thompson D, Bilzon JL. Measurement of physical activity and energy expenditure in wheelchair users: methods, considerations and future directions. Sports Med Open. Dec 2017;3(1):10. [FREE Full text] [CrossRef] [Medline]
- Hiremath SV, Amiri AM, Thapa-Chhetry B, Snethen G, Schmidt-Read M, Ramos-Lamboy M, et al. Mobile health-based physical activity intervention for individuals with spinal cord injury in the community: a pilot study. PLoS One. 2019;14(10):e0223762. [FREE Full text] [CrossRef] [Medline]
- Lankhorst K, Oerbekke M, van den Berg-Emons R, Takken T, de Groot J. Instruments measuring physical activity in individuals who use a wheelchair: a systematic review of measurement properties. Arch Phys Med Rehabil. Mar 2020;101(3):535-552. [CrossRef] [Medline]
- Nahum-Shani I, Smith SN, Spring BJ, Collins LM, Witkiewitz K, Tewari A, et al. Just-in-Time Adaptive Interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Ann Behav Med. May 18, 2018;52(6):446-462. [FREE Full text] [CrossRef] [Medline]
- Klasnja P, Smith S, Seewald NJ, Lee A, Hall K, Luers B, et al. Efficacy of contextually tailored suggestions for physical activity: a micro-randomized optimization trial of HeartSteps. Ann Behav Med. May 03, 2019;53(6):573-582. [FREE Full text] [CrossRef] [Medline]
- Nooijen CF, Stam HJ, Bergen MP, Bongers-Janssen HM, Valent L, van Langeveld S, Act-Active Research Group, et al. A behavioural intervention increases physical activity in people with subacute spinal cord injury: a randomised trial. J Physiother. Jan 2016;62(1):35-41. [FREE Full text] [CrossRef] [Medline]
- Klasnja P, Hekler EB, Shiffman S, Boruvka A, Almirall D, Tewari A, et al. Microrandomized trials: an experimental design for developing just-in-time adaptive interventions. Health Psychol. Dec 2015;34S:1220-1228. [FREE Full text] [CrossRef] [Medline]
- Liao P, Klasnja P, Tewari A, Murphy SA. Sample size calculations for micro-randomized trials in mHealth. Stat Med. May 30, 2016;35(12):1944-1971. [FREE Full text] [CrossRef] [Medline]
- Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. Apr 23, 2011;6:42. [FREE Full text] [CrossRef] [Medline]
- Ojo SO, Bailey DP, Brierley ML, Hewson DJ, Chater AM. Breaking barriers: using the behavior change wheel to develop a tailored intervention to overcome workplace inhibitors to breaking up sitting time. BMC Public Health. Aug 16, 2019;19(1):1126. [FREE Full text] [CrossRef] [Medline]
- Carney R, Bradshaw T, Yung AR. Physical health promotion for young people at ultra-high risk for psychosis: an application of the COM-B model and behaviour-change wheel. Int J Ment Health Nurs. Dec 2016;25(6):536-545. [FREE Full text] [CrossRef] [Medline]
- Handley MA, Harleman E, Gonzalez-Mendez E, Stotland NE, Althavale P, Fisher L, et al. Applying the COM-B model to creation of an IT-enabled health coaching and resource linkage program for low-income Latina moms with recent gestational diabetes: the STAR MAMA program. Implement Sci. May 18, 2016;11(1):73. [FREE Full text] [CrossRef] [Medline]
- Rimmer J, Lai B. Framing new pathways in transformative exercise for individuals with existing and newly acquired disability. Disabil Rehabil. Jan 2017;39(2):173-180. [FREE Full text] [CrossRef] [Medline]
- Bailey KA, Gammage KL, van Ingen C, Ditor DS. Managing the stigma: exploring body image experiences and self-presentation among people with spinal cord injury. Health Psychol Open. Jan 2016;3(1):2055102916650094. [FREE Full text] [CrossRef] [Medline]
- Attribution 4.0 International (CC BY 4.0). Creative Commons. URL: https://creativecommons.org/licenses/by/4.0/ [accessed 2024-06-25]
- Nahum-Shani I, Shaw SD, Carpenter SM, Murphy SA, Yoon C. Engagement in digital interventions. Am Psychol. Oct 2022;77(7):836-852. [FREE Full text] [CrossRef] [Medline]
- Attribution Noncommercial 4.0 International (CC BY-NC 4.0). Creative Commons. URL: https://creativecommons.org/licenses/by-nc/4.0/ [accessed 2024-06-25]
- NCHPAD - Building healthy inclusive communities. National Center on Health Physical Activity and Disability. URL: https://www.nchpad.org/ [accessed 2023-09-23]
- Lullo C. An exploration of the use of an internet-based physical activity program by adults with disabilities. University of Illinois at Chicago. 2013. URL: https://indigo.uic.edu/articles/thesis/An_Exploration_of_the_Use_of_an_Internet-based_Physical_Activity_Program_by_Adults_with_Disabilities/10835291 [accessed 2024-06-01]
- Fox MH, Witten MH, Lullo C. Reducing obesity among people with disabilities. J Disabil Policy Stud. Dec 2014;25(3):175-185. [FREE Full text] [CrossRef] [Medline]
- Martin Ginis KA, van der Scheer JW, Latimer-Cheung AE, Barrow A, Bourne C, Carruthers P, et al. Evidence-based scientific exercise guidelines for adults with spinal cord injury: an update and a new guideline. Spinal Cord. Apr 2018;56(4):308-321. [CrossRef] [Medline]
- Gallagher KM, Updegraff JA. Health message framing effects on attitudes, intentions, and behavior: a meta-analytic review. Ann Behav Med. Feb 2012;43(1):101-116. [CrossRef] [Medline]
- Dempsey W, Liao P, Klasnja P, Nahum-Shani I, Murphy SA. Randomised trials for the Fitbit generation. Signif (Oxf). Dec 01, 2015;12(6):20-23. [FREE Full text] [CrossRef] [Medline]
- Latimer AE, Ginis KA, Craven BC, Hicks AL. The physical activity recall assessment for people with spinal cord injury: validity. Med Sci Sports Exerc. Feb 2006;38(2):208-216. [CrossRef] [Medline]
- ASIA-ISCOS-worksheet. American Spinal Injury Association, International Standards for Neurological Classification of Spinal Cord Injury. 2019. URL: https://asia-spinalinjury.org/wp-content/uploads/2019/10/ASIA-ISCOS-Worksheet_10.2019_PRINT-Page-1-2.pdf [accessed 2024-06-01]
- Vansteelandt S. On confounding, prediction and efficiency in the analysis of longitudinal and cross‐sectional clustered data. Scand J Stat. Jan 31, 2007;34(3):478-498. [CrossRef]
- Hiremath SV, Intille SS, Kelleher A, Cooper RA, Ding D. Estimation of energy expenditure for wheelchair users using a physical activity monitoring system. Arch Phys Med Rehabil. Jul 2016;97(7):1146-53.e1. [CrossRef] [Medline]
- Froehlich-Grobe K, Lee J, Aaronson L, Nary DE, Washburn RA, Little TD. Exercise for everyone: a randomized controlled trial of project workout on wheels in promoting exercise among wheelchair users. Arch Phys Med Rehabil. Jan 2014;95(1):20-28. [FREE Full text] [CrossRef] [Medline]
- Seewald NJ, Sun J, Liao P. MRT-SS calculator: an R shiny application for sample size calculation in micro-randomized trials. arXiv. Preprint posted online September 2, 2016. [FREE Full text]
- Boruvka A, Almirall D, Witkiewitz K, Murphy SA. Assessing time-varying causal effect moderation in mobile health. J Am Stat Assoc. 2018;113(523):1112-1121. [FREE Full text] [CrossRef] [Medline]
- Qian T, Yoo H, Klasnja P, Almirall D, Murphy SA. Estimating time-varying causal excursion effect in mobile health with binary outcomes. Biometrika. Sep 2021;108(3):507-527. [FREE Full text] [CrossRef] [Medline]
- Sullivan Pepe M, Anderson GL. A cautionary note on inference for marginal regression models with longitudinal data and general correlated response data. Commun Stat Simul Comput. Jan 1994;23(4):939-951. [CrossRef]
- Rimmer JH, Schiller W, Chen MD. Effects of disability-associated low energy expenditure deconditioning syndrome. Exerc Sport Sci Rev. Jan 2012;40(1):22-29. [CrossRef] [Medline]
- Jakicic JM, Davis KK, Rogers RJ, King WC, Marcus MD, Helsel D, et al. Effect of wearable technology combined with a lifestyle intervention on long-term weight loss: the IDEA randomized clinical trial. JAMA. Sep 20, 2016;316(11):1161-1171. [FREE Full text] [CrossRef] [Medline]
- Market share of mobile operating systems in North America from January 2018 to September 2023. Statista. 2023. URL: https://www.statista.com/statistics/1045192/share-of-mobile-operating-systems-in-north-america-by-month/ [accessed 2023-11-27]
Abbreviations
AUC: area under the curve |
COM-B: capability, opportunity, and motivation model |
JITAI: just-in-time adaptive intervention |
mHealth: mobile health |
MRT: microrandomized trial |
NCHPAD: National Center on Health, Physical Activity, and Disability |
PA: physical activity |
PARA-SCI: Physical Activity Recall Assessment for people with spinal cord injury |
SCI: spinal cord injury |
WI: web-based physical activity intervention |
Edited by D Khajeei; The proposal for this study was peer reviewed by the CMPC - Clinical Management of Patients in Community-based Settings Study Section - National Institutes of Health (NIH), United States. See the Multimedia Appendix for the peer-review report; submitted 24.02.24; accepted 03.05.24; published 28.06.24.
Copyright©Rachel L Carey, Ha Le, Donna L Coffman, Inbal Nahum-Shani, Mohanraj Thirumalai, Cole Hagen, Laura A Baehr, Mary Schmidt-Read, Marlyn S R Lamboy, Stephanie A Kolakowsky-Hayner, Ralph J Marino, Stephen S Intille, Shivayogi V Hiremath. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 28.06.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.