Background: Heart failure (HF) is the leading cause of hospitalization among older adults in the United States. There are substantial racial and geographic disparities in HF outcomes, with patients living in southern US states having a mortality rate 69% higher than the national average. Self-management behaviors, particularly daily weight monitoring and physical activity, are extremely important in improving HF outcomes; however, patients typically have particularly low adherence to these behaviors. With the rise of digital technologies to improve health outcomes and motivate health behaviors, sensor-controlled digital games (SCDGs) have become a promising approach. SCDGs, which leverage sensor-connected technologies, offer the benefits of being portable and scalable and allowing for continuous observation and motivation of health behaviors in their real-world contexts. They are also becoming increasingly popular among older adults and offer an immersive and accessible way to measure self-management behaviors and improve adherence. No SCDGs have been designed for older adults or evaluated to test their outcomes.
Objective: This randomized clinical trial aims to assess the efficacy of a SCDG in integrating the behavioral data of participants with HF from weight scale and activity tracker sensors to activate game progress, rewards, and feedback and, ultimately, to improve adherence to important self-management behaviors.
Methods: A total of 200 participants with HF, aged ≥45 years, will be recruited and randomized into 2 groups: the SCDG playing group (intervention group) and sensor-only group (control group). Both groups will receive a weight scale, physical activity tracker, and accompanying app, whereas only the intervention group will play the SCDG. This design, thereby, assesses the contributions of the game. All participants will complete a baseline survey as well as posttests at 6 and 12 weeks to assess the immediate effect of the intervention. They will also complete a third posttest at 24 weeks to assess the maintenance of behavioral changes. Efficacy and benefits will be assessed by measuring improvements in HF-related proximal outcomes (self-management behaviors of daily weight monitoring and physical activity) and distal outcomes (HF hospitalization, quality of life, and functional status) between baseline and weeks 6, 12, and 24. The primary outcome measured will be days with weight monitoring, for which this design provides at least 80% power to detect differences between the 2 groups.
Results: Recruitment began in the fall of 2022, and the first patient was enrolled in the study on November 7, 2022. Recruitment of the last participant is expected in quarter 1 of 2025. Publication of complete results and data from this study is expected in 2026.
Conclusions: This project will generate insight and guidance for scalable and easy-to-use digital gaming solutions to motivate persistent adherence to HF self-management behaviors and improve health outcomes among individuals with HF.
Trial Registration: ClinicalTrials.gov NCT05056129; https://clinicaltrials.gov/ct2/show/NCT05056129
International Registered Report Identifier (IRRID): DERR1-10.2196/45801
More than 6 million adults in the United States live with heart failure (HF), a condition that is the leading cause of hospitalization among older adults in the United States . Despite substantial advances in treatment and management, the current estimated annual cost is US $32 billion, which is projected to rise to US $69 billion by 2030 [ ]. There are major regional disparities among individuals diagnosed with HF in the southern United States, with a mortality rate 69% higher than the national average [ , ].
Self-management behaviors are important for patients with HF to help reduce serious adverse sequelae and outcomes . For example, weight gain is an initial warning sign of volume overload in patients with HF; by monitoring their weight daily, patients may receive prompt treatment for their weight gain, which can help avoid clinically significant exacerbations (odds ratio 0.42, 95% CI 0.23-0.76) [ , ]. Similarly, physical activity is linked to clinically significant improvements, such as improved myocardial function (P=.02) and functional capacity (P<.001) [ ] and reduced depressive symptoms [ ]. By self-managing these 2 critical elements, patients with HF experienced improved quality of life (QoL) and reduced health care use and cost in high-quality research studies [ , ]. Conversely, poor HF self-management may delay recognition of severe HF symptoms and result in more frequent hospitalizations, impaired functional status, and poorer QoL [ ].
Despite its importance, persistent adherence to critical self-management behaviors continues to remain a challenge for patients with HF [, ]. Patients have poorer adherence to weight monitoring and physical activity than to other self-management behaviors [ ]. Thus, there is a need for novel approaches to support and motivate patients with HF to self-manage these critical behaviors. Interventions that are remote, resource conservative, and can be used in home may help address the widening geographical [ , ] and racial [ ] health disparities in HF outcomes. Wearable technologies, mobile health apps, and sensor devices offer substantial promise in that they are portable, scalable, and allow for continuous observation and motivation of health behaviors in real-world contexts. Despite these benefits, the adoption of these technologies is low; abandonment is common [ ], and longitudinal studies, especially in the context of chronic health conditions, are rare. Although the potential of wearables and digital sensor technologies for HF to improve care and outcomes has been acknowledged [ ] and proven [ , ], the studies exploring their use in practice have largely been limited in size and scale [ ].
One promising approach to increasing adherence to self-management behaviors in patients with HF is to leverage the use of digital technologies such as sensor-controlled digital games (SCDGs). SCDGs synchronize data on behaviors from sensors, such as wearable devices, with a mobile gaming app, allowing game progress, rewards, incentives, and personalized feedback (eg, reduce fluid intake or contact a physician) based on real-time contextual information (eg, weight gain or concerning symptoms) . To promote change and its maintenance, SCDGs can also incorporate immersive stories [ ], active learning [ ], and social connections [ ]. SCDGs are not only affordable, portable, and scalable, but they are also enjoyable and easy to use. Furthermore, prior research has indicated that they can also contextualize health behaviors [ ], motivate behavioral changes, and improve health outcomes [ ]. Thus, SCDGs offer an immersive and accessible way to objectively measure self-management behaviors and improve adherence [ ]. Our previous research [ ] conducting an SCDG intervention with 38 adults (aged ≥55 years) with HF from Texas and Oklahoma demonstrated improvements in weight monitoring and physical activity, and the intervention showed a high rate of acceptability (92%) from participants.
In this clinical trial, we have updated the SCDG intervention and will evaluate its efficacy for improving HF outcomes by integrating behavioral data of participants with HF from weight scale and activity tracker sensors to activate game progress, rewards, and feedback.
This study is an efficacy clinical trial, using a prospective, 2-group randomized (1:1) controlled design in which an SCDG playing group with sensors and tracking apps (intervention group [IG]) will be compared with a sensor-only group (control group [CG]) that receives only the app that tracks weight monitoring and physical activity. In a sample of 200 individuals with HF, who are aged ≥45 years (n=100 per arm), benefits will be assessed by measuring improvements in HF-related proximal outcomes (self-management behaviors of daily weight monitoring and daily physical activity) and distal outcomes (HF hospitalization, QoL, and functional status) between baseline and weeks 6, 12, and 24. We will also apply mixed methods to assess IG and CG participants’ perceptions of intervention and behavior adherence.
We will enroll 200 patients in this study, 100 each in the IG and CG. To recruit patients, we are contracting with Trialfacts , a web-based recruiting company. Participants will be recruited from 7 southern states of the United States to address prominent geographic health disparities in HF [ , ]. These states are Alabama, Arkansas, Georgia, Louisiana, Mississippi, Oklahoma, and Texas, where people experience higher HF rates than the rest of the country.
Participants must be aged ≥45 years (lifetime risk for HF is high for the age group of 45-95 years) ; have been hospitalized for HF in the last 12 months (to reduce the variance in recovery from a recent HF hospitalization); and be classified as class I, II, or III per the New York Heart Association’s HF classes [ ] (thus ensuring recruitment of those who would benefit the most from self-management interventions). They must also be fluent in English, able to pass a mini–cognitive screening assessment [ ], and able to walk independently without using a walker or other assistance. Exclusion criteria include (1) having severe visual or tactile impairments (eg, legal blindness or severe arthritis), which might make using smartphones and sensor devices difficult; (2) having undergone a heart transplantation or implantation of a durable mechanical circulatory support device in the past; (3) having a history of renal failure (which adversely affects HF prognosis); or (4) being diagnosed with an end-stage or terminal illness (eg, cancer). The study is registered at ClinicalTrials.gov (NCT05056129).
Ethics Approval and Informed Consent
The protocol was approved by the Institutional Review Board of the University of Texas, Austin (STUDY00001438), on February 18, 2022. Informed consent will be obtained from all eligible participants through a phone call before baseline surveys are sent and data collection begins. After a member of the research team reads the consent form and solicits questions, participants will receive the consent form via email and be requested to provide their digitally signed consent form through the REDCap (Research Electronic Data Capture; Vanderbilt University) web-based survey database. Participants who prefer to sign a physical copy will be mailed a consent form. This approach will allow participants sufficient time to follow-up with questions and discuss the study with their family or friends before officially signing the consent form. Our team will make it clear to participants that they may decline to answer specific questions or terminate their involvement in the study at any time.
Enrollment and Randomization Procedures
Participants will be assigned to either the IG or CG through computer-automated randomization. These assignments will be stratified based on sex (male, female, or other) and age (45-64 years or ≥64 years) to ensure balance in the study design. The allocation sequence for permuted block randomization with random block sizes of 4 and 6 was created by a statistical analyst who is not connected to the participant enrollment process. The allocation sequence will be uploaded to REDCap, which will automatically assign the participants to groups when they are enrolled in the study. The research team will be blinded to assignment group or maintained in a way that ensures the separation of intervention implementation from evaluation, thus reducing any potential bias (eg, ascertainment bias) in the collection and analysis of outcome data. For example, data collectors will not be a part of the intervention delivery team. Similarly, participants will be blinded to their group assignment, as both groups use digital tools. All participants will be provided with the same informed consent form that includes general terms such as digital health tools to enable blinding of participants to their group assignment.
The SCDG, which will be used by the IG in this study, is a smartphone app called Heart Health Mountain, which is available on both iOS and Android platforms. The design of the game was guided by behavioral change mechanisms using the concepts of motivation, ability, and trigger from the Fogg behavioral model and self-determination theoretical frameworks, as described in detail in a previous study . This app has already been developed by a multidisciplinary team and tested through initial usability and feasibility studies and is described in detail elsewhere [ , ]. Several screenshots from the SCDG are pictured in .
The SCDG fosters relatedness by involving a narrative, the goal of which is to help the game avatar avoid rehospitalization using game points, earned via the participants’ demonstration of competence or ability in real-time behaviors, in game tasks that help maintain the avatar’s optimal HF health status. The participants’ real-time behaviors of weight monitoring and physical activity will be tracked by off-the-shelf sensors and an app (Withings Pulse HR tracker, Body scale, and Health Mate app; Withings app). The data from the Withings sensors will then be routed to our SCDG app.
The digital game paired with sensors will enable objective tracking of real-time behaviors such as physical activity and weight monitoring and provide personalized, contextually relevant feedback (eg, reduce fluid intake or call a physician for weight gain) as triggers to motivate engagement in and generate habit formation of HF-related self-management behaviors. The game is adaptive to real-time behaviors; for example, participants’ step goals automatically adapt each week to encourage a tolerable physical activity level based on a rank-ordered algorithm .
The CG will use the same Withings devices over the same period but will not have access to the SCDG. Real-time behaviors of weight monitoring and physical activity will be tracked by the Withings Pulse heart rate tracker, Body scale, and Health Mate app. However, the data from the Withings sensors will not be routed to the SCDG. Instead, the CG will receive the same educational content that is presented in the SCDG in a paper format by mail. This study design feature will allow us to isolate the SCDG effect from the other features of behavioral motivation.
Remote Study Procedures
All research activities will be conducted at participants’ homes. Participants will be directed to engage in research activities through remote means (email, phone call, or video calls). Participants will be asked to provide a convenient time for a research team member to contact them.
Participants in both the IG and CG will receive their Withings devices by mail, along with information on how to install the HealthMate app and connect the devices. The IG will also receive instructions on how to install the SCDG app ().
|Devices and apps||IG||CG|
|Withings weight scale and activity tracker||✓||✓|
|Withings HealthMate app for sensor data tracking||✓||✓|
|SCDGa app with progress of game, messages, and incentives tailored to participant’s real-time HFb self-management behaviors||✓|
|Standard evidence-based HF educational content [, ] embedded in SCDG||✓|
|Standard evidence-based HF educational content [, ] provided in paper format||✓|
aSCDG: sensor-controlled digital game.
bHF: heart failure.
Participants in both groups will receive remote training from a member of the study team on how to install and use the devices. This remote training (ie, over Zoom [Zoom Video Communications] or FaceTime [Apple iOS]) was also successfully provided in our feasibility study . After 3 days, both the groups will receive a follow-up email from the interventionist to summarize participants’ study tasks and provide contact information in case of troubleshooting needed while using the devices and apps.
Both groups will use the devices for 24 weeks. A dashboard was developed to track the time stamps of behavior data that were last synced by the participants to identify participants without any behavior data for >3 days. On a different page, the dashboard also shows the time stamps of the last time each participant in the IG opened the SCDG app. An unblinded team member aware of troubleshooting procedures and following a protocol to communicate similarly with participants in both groups will reach out to participants in both groups who have not had any behavior data from their devices synced in 3 days. This member would follow-up with participants in both groups daily for 3 business days. In case of no response, they will reach out to the alternative contact person listed by the participant.
Randomized Controlled Trial Data Collection
All the survey data will be collected using the REDCap web-based survey system. After completing the baseline survey, all participants will complete the first and second posttests at 6 and 12 weeks for assessment of the immediate effect of the intervention and will complete the third posttest at 24 weeks after the first week for assessment of the maintenance of behavioral changes. Survey links will be sent via text messages to participants at 4 time points through automated events programmed in the REDCap survey system. In addition, daily sensor data will be obtained from the Withings server, and the game playing data will be obtained from a backend server hosted on Amazon Web Services. The steps, weight, and game state data will also be stored in a MongoDB database. All variables will be measured at all follow-ups using the instruments described in detail in.
|Variables||Instrument or measure||Time point (weeks)|
|Sociodemographic||Sociodemographic and Upstream Risk Questionnaire [, ]||Baseline|
|Clinical||Hospital discharge summary (medications, comorbidities, and ejection fraction)||Baseline|
|Weight monitoring frequency in the past week||1-item question using Likert scale||Baseline|
|Depressive symptoms||Patient Health Questionnaire-2 [, ]a,b||Baseline and 6, 12, and 24|
|HFc self-management knowledge||30-item Atlanta Heart Failure Knowledge Test (Cronbach α=.84) d||Baseline and 6, 12, and 24|
|HF self-efficacy||6-item Section C Self-Care of HF Index (Cronbach α=.88) d||Baseline and 6, 12, and 24|
|Engagement with SCDGe and features||Backend game state logs of IGf participants; Intrinsic Motivation Inventory  and Qualitative Interviews||6, 12, and 24; 12|
|Motivation or behavior outcomes|
|Number of days of weight monitoring (primary)g||HealthMate app logs  in IG and CGh||6, 12, and 24|
|Daily physical activity steps||HealthMate app logs  in IG and CG||6, 12, and 24|
|Daily physical activity intensity (light, moderate, or intense)||HealthMate app logs  in IG and CG||6, 12, and 24|
|HF self-management behaviors||9-item European Heart Failure Self-care Behavior Scale (Cronbach α=.80) b,d||Baseline, 6, 12, and 24|
|Functional status||23-item Kansas City Cardiomyopathy Questionnaire b,d; functional status (Cronbach α=.93) [ ]; QoLi (Cronbach α=.78) [ ]||Baseline and 6, 12, and 24|
|QoL||Participant self-report||Baseline and 6, 12, and 24|
|HF hospitalization||Participant self-report and confirmed through hospitalization discharge summary and health care provider||Baseline and 6, 12, and 24|
aA total of 90% sensitivity in patients with HF and reliable prognostic prediction of mortality and rehospitalization.
bEstablished validity using correlation with other instruments or clinical ratings in known groups.
cHF: heart failure.
dEstablished reliability using interitem correlations and test-retest. Instruments take 30-55 minutes to complete when administered together.
eSCDG: sensor-controlled digital game.
fIG: intervention group.
hCG: control group.
iQoL: quality of life.
The incentive of a gift card worth US $10 will be provided for the completion of surveys at each data collection time point (baseline and 6, 12, and 24 weeks) through Tango, a digital gift card disbursement system , as a reward for their effort. All participants will retain the scale and tracker till the end of the study.
An overview of the study’s phases is mapped in.
Participant Data Protection
We will take measures to ensure the best possible protection of participant data. Each participant will receive a unique identifier as well as a pseudonym identifier to use for their Withings account so that no personal or identifying information is connected to the account. The option to share contacts, location data, or photos from the game and the Withings app will be disabled. Withings is also subject to the European Union General Data Protection Regulation, which include strict policies against sharing of data or other misuse of data without participant knowledge or consent. Participants’ unique identifiers, rather than their personal information, will be connected to their behavioral and survey data as well as any data shared or presented externally. To protect participants’ privacy, a 6-digit unique identification number and dummy email addresses will be generated for the profile information required by the HealthMate app.
Baseline demographic and clinical data will include sex (male, female, or other), race and ethnicity, marital status, age, level of education, medications, depressive symptoms, hospitalizations, and HF-relevant phenotype data such as ejection fraction and comorbidities.
The outcome measures that we will use in the study are delineated and described in the following subsections.
The primary outcome assessed will be the number of days reporting the HF self-management behavior of weight monitoring: The data collection time frame will be 6, 12, and 24 weeks. This outcome will be measured by collecting the number of days with weight-monitoring data. These measures will be collected from the sensor logs within the Withings server from the HealthMate app  for the IG and CG.
We will assess a variety of secondary outcomes in the study. These outcomes are listed below.
- Daily physical activity steps: The data collection time frame will be 6, 12, and 24 weeks. This outcome will be measured by collecting the number of daily cumulative steps days. Daily average total will be calculated weekly for 6, 12, and 24 weeks. These measures will be collected from the sensor logs within the Health Mate app [ ] for the IG and CG.
- Daily physical activity intensity: The data collection time frame will be 6, 12, and 24 weeks. This outcome will be measured by collecting the intensity level of daily physical activity. Averages will be calculated weekly for 6, 12, and 24 weeks. These measures will be collected from the sensor logs within the Health Mate app [ ] for the IG and CG.
- Self-report HF self-management behaviors: The data collection time frame will be baseline and 6, 12, and 24 weeks. This instrument will be the 9-item European Heart Failure Self-care Behavior Scale, which gives a standardized score from 0 to 100 (every item is given an equal weight), with a higher score indicating better self-care. Items are rated on a Likert scale ranging from 1 to 5. For calculating the standardized score, each item is reverse coded and then computed using the following formula: (sum of all ever-coded items − 9) × 2.7777. Cronbach α was .80 for the European Heart Failure Self-care Behavior Scale-9 and showed convergent validity with routine self-care behaviors and symptom response behaviors in the Self-Care of Heart Failure Index instrument [ ].
- HF-related QoL: The data collection time frame will be baseline and 6, 12, and 24 weeks. The instrument used will be items 13 to 15 from the Kansas City Cardiomyopathy Questionnaire (KCCQ). Values for the QoL domain range from 0 to 100, with higher scores indicating better QoL. The domain score will be transformed to a 0 to 100 range by subtracting the lowest possible scale score, dividing by the range of the scale, and multiplying by 100. Cronbach α was .78. The KCCQ is sensitive to clinical changes in HF compared with similar QoL instruments and had a significant, high correlation with the New York Heart Association HF classification (P<.001).
- HF-related functional status: The data collection time frame will be baseline and 6, 12, and 24 weeks. Items 1 to 12 on the KCCQ will be used. Values for the functional status summary score ranged from 0 to 100, with higher scores indicating a better QoL. Summary score will be transformed to a 0 to 100 range by subtracting the lowest possible scale score, dividing by the range of the scale, and multiplying by 100. Cronbach α of the KCCQ for measuring functional status was excellent at .93. The scale demonstrated criterion validity with a high correlation with the New York Heart Association HF classification and the 6-minute walk test [ ].
- Number of cardiac hospitalizations: The data collection time frame will be baseline and 6, 12, and 24 weeks. This measure will be obtained through participant self-report through REDCap surveys and will be confirmed by hospitalization discharge summary and health care provider.
- HF self-management knowledge: The data collection time frame will be baseline and 6, 12, and 24 weeks. The instrument used will be the 30-item Atlanta Heart Failure Knowledge Test [ ]. Each correct answer is scored as 1 point, with no additional weighting of items; correct responses are then summed. Incorrect or skipped questions are awarded 0 points. Total scores range from 0 to 30. Higher scores indicate better knowledge of HF. Content validity ratings on relevance and clarity ranged from 0.55 to 1.0, with 81% of the items rated from 0.88 to 1.0. Reliability by Cronbach α was .84 for patients. Construct validity was demonstrated by directly correlating knowledge with clinical and self-care outcomes including dietary sodium consumption, medication adherence, and health care use.
- HF self-efficacy: The data collection time frame will be baseline and 6, 12, and 24 weeks. The instrument used will be the 6-item Section C Self-efficacy section of the Self-Care of Heart Failure Index [ ]. Scores on the self-efficacy scale will range from 0 to 100, with higher scores reflecting better self-efficacy. To standardize scores, the following formula will be used: (sum of Section C items − 6) × 5.56. Cronbach α was .88, with good evidence of construct validity and contrasting group validity.
To assess the facilitators and barriers impacting engagement of IG and CG participants with the SCDG and sensor-only interventions for HF self-management behavior adherence, we will use the convergence triangulation mixed methods design (including both quantitative and qualitative components) . We will collect a survey informed by the Intrinsic Motivation Inventory [ ] from all 200 participants at the 12-week follow-up assessment. In parallel, we will use random sampling to invite a subset (n=40) of IG and CG participants (20 per group) to participate in qualitative phone interviews at the end of 12 weeks. Interviews will be conducted by trained study staff, audio taped, and thematically coded by participant number to protect confidentiality. Participants will receive US $10 as an incentive to participate in the qualitative interview.
Adverse Event Collection and Handling
Participants will be monitored for anticipated and unanticipated adverse events from the time they sign the study consent until 30 days after the final study visit. Participants will be provided with contact information of a research team member to inform them of any adverse events that occur. In addition, the study team will monitor the adverse events that arise during data collection. A communication protocol was developed to report adverse events to appropriate research personnel, including the development of a phone tree. Serious adverse events will be reported to the Institutional Review Board associated with the University of Texas Austin within 24 hours of being informed of the incident. Unanticipated problems will be reported by the principal investigator (KR) to the Data Safety Monitoring Committee, the funding agency, and the Institutional Review Board within 15 days of the event. The Data Safety Monitoring Committee will meet the principal investigator and study staff to review adverse events once a year and as needed to address any adverse events that need to be addressed immediately.
Should any conditions present harm to the participant if they continue with the intervention, they will either be withdrawn from the intervention or asked to take a break from the intervention until the condition subsides. These conditions will be assessed on a case-by-case basis, with the principal investigator (KR) making the final decision. All adverse events, protocol deviations, and reportable information will be entered into the REDCap database.
We have estimated the sample size for the primary outcome in our feasibility study for the 12 weeks study duration. All secondary outcomes will be examined on an exploratory basis. Analyses will be performed in an intent-to-treat manner.
Cronbach α coefficients will be computed for each multi-item scale, with Cronbach α≥.70 denoting acceptable consistency. In outcome analyses, we will control for the possible effects of the biological variables of age and sex, prespecified as potentially strong predictors of outcomes. Statistical significance will be Cronbach α=.05 for primary and secondary analyses. Descriptive statistics will be computed for study variables to assess missingness, out-of-range values, and features of variable distributions including floor and ceiling effects. For testing and quantification of treatment effect with respect to primary and secondary outcomes, the IG and CG will be compared following the intention-to-treat principle.
We expect missingness of items and other data to be minimal at baseline. Follow-up measures may be missing either because of formal dropout or failure to respond to contact from our research team. In all cases, we will assume missingness at random. For missing values at baseline, single (when <5%) or multiple (when ≥5%) imputation will be used. For more extensive missing data, especially at follow-up, we will use multiple imputation strategies when the analyses are based on generalized estimating equations  with sensitivity analyses to determine the effects of imputation. Sensitivity analyses will focus on which variables are used in imputation and on deviations from the missingness at random assumption (which must be parameterized, as this statistical assumption is not formally testable with the data) [ ]. For missing outcomes in linear mixed models, imputation is not required because the analysis is based on maximum likelihood. However, missing predictors in mixed models will require single or multiple imputation.
For the primary outcome of days with weight monitoring, binary weight-monitoring data (yes or no) will be summed over days for each of the 24 weeks during which data are collected. Data will be analyzed with a linear model for binomial-like data with an effect of time (ranging from 1 to 24) and a time-by-treatment effect. We do not need a treatment main effect owing to randomization, which implies no treatment effect at time=0. Primary outcome treatment effect at 12 weeks can then be estimated from the model as a difference in mean weight-monitoring days (out of 7) comparing the IG with the CG. The model will be fitted with generalized estimating equations , using the matrix-adjusted estimating equations method to estimate model correlation over repeated measures within a subject and using a bias-corrected sandwich variance estimator [ ]. The model will allow for overdispersion relative to the binomial variance, yielding correct statistical descriptions of the data and inference. We will consider exchangeable, exponential decay and a combination of the 2 correlation structures. Finally, (1) we mention that the linear (vs the logistic) model is valid for binomial data, especially when the binomial parameter is not near 0 or 1 and yields an interpretable treatment effect on the scale of “number of weight-monitoring days,” and (2) we will maximize power by analyzing all 24 weeks of data, although we aim to extract the 12-week mean difference as the primary contrast of interest.
For the secondary outcome of physical activity, as measured by the number of steps, data will again be aggregated (summed) by week. As the measures are counts, we will use a log link and variance proportional to the mean (as with the Poisson distribution), allowing for an overdispersion parameter. Analysis will then emulate that for the number of weight-monitoring days. The log link will yield coefficients that, when exponentiated, will be interpreted as relative mean numbers of steps, which, given the expected between-person variability, will be more interpretable than a mean difference on the natural scale. For secondary outcome measures of HF self-management knowledge, self-efficacy, HF-related functional status, and QoL measured 4 times over the multiple data collection time points, we will use linear mixed effects models  with random slopes and intercepts to capture the association over time in the repeated measures within participant, estimating the treatment effect from the model at each of 6, 12, and 24 weeks.
Sample Size and Statistical Power
For a 1:1 randomization scheme (IG:CG), we aim to recruit 100 participants per group and allow for 25% attrition (some of which will be recovered through the treatment of missing data). We would like to detect a weight-monitoring rate of at least 80% (5.6/7) of days per week, as patients with HF who completed ≥80% of weight diaries were found to have significantly reduced odds for HF-related hospitalizations compared with patients who completed <80% of weight diaries . In our planned analysis, we aim to use weekly data for weeks 1 through 24, fitting a flexible (eg, df=2) trend for the mean number of days (out of 7) in which participants complete weight monitoring, and thereby extracting the estimate at 12 weeks for each of the IG and CG. Using all 24 weeks of data represents an efficient use of data by exploiting a smooth time trend, by leveraging the positive correlation among the repeated measures on a given individual, and by offering the opportunity to handle missing time points through imputation or weighting of the nonmissing longitudinal data. For power estimation, because we are not sure about the form of the model based only on pilot data and because pilot data are relatively sparse for purposes of estimating within-subject correlation, we conservatively (in the sense that true power is expected to be greater) use aggregated pilot data just across weeks 7 to 12 (42 days) to estimate the mean and variance of â, where a is the average within-group probability of engaging in weight monitoring on any given day. Owing to the strong day-to-day correlation within subject, the total number Y of weight-monitoring days is considerably overdispersed relative to the binomial distribution, such that for a given subject in a given group, the mean of Y is 42a and the variance of Y is 42Øa(1 – a), where Ø is an overdispersion parameter. In our pilot data, we estimated Ø=17.5; these values yield 2-group power calculations comparing IG weight-monitoring rate, aIG, with CG weight-monitoring rate, aCG, under within-group sample size n=75. If aIG=0.80, then we will have 90% power to detect differences between aIG and aCG, as small as 0.14 (SD 0.12; ie, aCG as big as 0.66, SD 0.68), yielding strong power from our longitudinal design. Owing to the need to estimate the overdispersion parameter, these calculations were custom coded by our team in R (R Foundation for Statistical Computing) [ ].
Qualitative Coding and Analysis
Survey analysis will include descriptive statistics of counts and frequencies for the scale items and thematic analysis for the open-ended survey responses [, ]. Verbatim transcripts will be created; they will be coded and examined using thematic analysis and Dedoose (SocioCultural Research Consultants) [ ] software to enable examination of themes overall. Finally, the quantitative and qualitative results will be merged [ ] to provide insights on the weight monitoring, physical activity, sensor use, and SCDG-playing behaviors of participants with HF; facilitators and barriers affecting participant engagement with sensors or SCDG for HF self-management behavior adherence; as well as future improvements and design modifications of the SCDG. The facilitators and barriers affecting engagement in sensor-based digital health interventions will be published in a secondary analysis publication.
A CONSORT (Consolidated Standards of Reporting Trials) flow diagram will be reported. The clinical trial was initiated on October 24, 2022, and the first participant was enrolled on November 7, 2022. Recruitment of the last participant is anticipated in quarter 1 of 2025. Full trial results are planned to be published by 2026.
Our SCDG intervention addresses a substantial challenge, that is, to develop an affordable and scalable technology-assisted intervention to facilitate persistent adherence to self-management behaviors by adults with HF to improve QoL, functional status, and health outcomes and, ultimately, to reduce the burden of HF worldwide. We hypothesize that 12 weeks of playing the SCDG will result in greater behavioral changes in key self-management indicators of HF outcomes in adults aged >45 years compared with a CG that uses only sensors.
The recent rapid rise in the use of smartphones across demographic groups has enabled the scalability of innovative digital health interventions to promote HF self-management behaviors across diverse groups . Although interventions such as digital games for health can be easily deployed to address geographic disparities in HF outcomes experienced by populations in southern US states, there is a lack of systematic research on the effectiveness of digital game interventions to promote evidence-based self-management behaviors of individuals with HF with conflicting priorities or in unsupportive environments. Current digital health interventions with unobtrusive monitoring capabilities allow the gathering of relevant contextual data to tailor and adapt interventions without overburdening participants through cumbersome data collection [ ]. This study protocol was informed by our feasibility randomized controlled trial study, in which we demonstrated the remote implementation of a smartphone-based intervention using a digital game and sensors among participants in 18 counties in Texas and Oklahoma [ ]. Combining digital games and sensors holds the potential to offer a powerful way to improve treatment adherence [ , ]; sustain healthy behaviors; and make health care more participatory, personalized, predictive, and preventive, as defined by precision medicine [ ]. The lessons from this initial study provide a strong foundation to test our intervention with individuals with HF in 7 southern US states. Therefore, we hypothesize that 12 weeks of playing the SCDG will result in greater behavioral changes in key self-management indicators of HF outcomes in adults aged >45 years compared with a CG that uses only the sensors.
Developing a dashboard that will allow easier visualization of behavioral data from all participants will provide us with the opportunity to intervene immediately in the event of absent or unsafe levels of behavioral data. In addition, fully remote study procedures will enhance the accessibility of HF research to participants living in rural or remote areas that are far from large HF centers in cities.
Self-selection bias may be a limitation of this study as participation is voluntary, and participants already comfortable with using technology might be especially motivated to participate in digital intervention studies.
We will disseminate our study findings to target an audience that cares for patients with HF and will benefit from the lessons learned through our study. This includes disseminating our findings through (1) peer-reviewed health technology–related journals such as Games for Health Journal or Journal of Medical Internet Research and clinical journals such as Journal of Cardiovascular Nursing or Journal of Cardiac Failure; (2) annual research conferences conducted by the Heart Failure Society of America, American Heart Association, Society of Behavioral Medicine, American Medical Informatics Association, and Gerontological Society of America; (3) local and regional nursing organizations such as Texas Public Health Association’s monthly webinars and similar organizations in other southern US states; (4) scheduled continuing education sessions or monthly meetings conducted by HF clinics for their staff; and (5) local and regional support groups for patients with HF. In addition, all peer-reviewed and accepted manuscripts will be uploaded either by the investigator or by the journal (for those journals that perform this function) to the National Library of Medicine’s PubMed Central in accordance with the National Institutes of Health Public Access Policy.
Nevertheless, this project will generate insight and guidance for scalable and easy-to-use digital gaming solutions to motivate persistent adherence to HF self-management behaviors and improve health outcomes among individuals with HF.
This research was supported by the National Heart, Lung, and Blood Institute of the National Institutes of Health under award R01HL160692. The content is the sole responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Although the final data set comprising questionnaire and qualitative data will be stripped of identifiers, we believe that there remains the possibility of deductive disclosure of participants with unusual characteristics. Thus, we will make the data and associated documentation available to users only under a data-sharing agreement that provides for (1) a commitment to using the data only for research purposes and not to identify any individual participant, (2) a commitment to securing the data using appropriate computer technology, and (3) a commitment to destroying or returning the data after analyses are completed. After reviewing the purpose of the data request to ensure that it is consistent with the original project goals and verifying that the request meets approval from the Institutional Review Board, deidentified data may be shared with researchers as soon as possible but no later than within 1 year from the completion of the funded project period for the parent award or upon acceptance of the data for publication, whichever is earlier.
Conflicts of Interest
MO is the owner of Good Life Games, Inc, a company that develops health games for hire, which provided the prototype game images for this study.
Peer review report.PDF File (Adobe PDF File), 154 KB
- Virani SS, Alonso A, Benjamin E, Bittencourt MS, Callaway CW, Carson AP, American Heart Association Council on Epidemiology Prevention Statistics Committee Stroke Statistics Subcommittee. Heart disease and stroke statistics-2020 update: a report from the American heart association. Circulation 2020 Mar 03;141(9):e139-e596 [FREE Full text] [CrossRef] [Medline]
- Heidenreich PA, Albert NM, Allen LA, Bluemke DA, Butler J, Fonarow GC, American Heart Association Advocacy Coordinating Committee, Council on Arteriosclerosis‚ ThrombosisVascular Biology, Council on Cardiovascular Radiology Intervention, Council on Clinical Cardiology, Council on Epidemiology Prevention, Stroke Council. Forecasting the impact of heart failure in the United States: a policy statement from the American Heart Association. Circ Heart Fail 2013 May;6(3):606-619 [FREE Full text] [CrossRef] [Medline]
- Mujib M, Zhang Y, Feller MA, Ahmed A. Evidence of a "heart failure belt" in the southeastern United States. Am J Cardiol 2011 Mar 15;107(6):935-937 [FREE Full text] [CrossRef] [Medline]
- Liu L, Yin X, Chen M, Jia H, Eisen HJ, Hofman A. Geographic variation in heart failure mortality and its association with hypertension, diabetes, and behavioral-related risk factors in 1,723 counties of the United States. Front Public Health 2018 May 7;6:132 [FREE Full text] [CrossRef] [Medline]
- Lainscak M, Blue L, Clark AL, Dahlström U, Dickstein K, Ekman I, et al. Self-care management of heart failure: practical recommendations from the Patient Care Committee of the Heart Failure Association of the European Society of Cardiology. Eur J Heart Fail 2011 Feb;13(2):115-126 [FREE Full text] [CrossRef] [Medline]
- Jones CD, Holmes GM, Dewalt DA, Erman B, Broucksou K, Hawk V, et al. Is adherence to weight monitoring or weight-based diuretic self-adjustment associated with fewer heart failure-related emergency department visits or hospitalizations? J Card Fail 2012 Jul;18(7):576-584 [FREE Full text] [CrossRef] [Medline]
- Jones CD, Holmes GM, DeWalt DA, Erman B, Wu JR, Cene CW, et al. Self-reported recall and daily diary-recorded measures of weight monitoring adherence: associations with heart failure-related hospitalization. BMC Cardiovasc Disord 2014 Jan 31;14:12 [FREE Full text] [CrossRef] [Medline]
- Ismail H, McFarlane JR, Nojoumian AH, Dieberg G, Smart NA. Clinical outcomes and cardiovascular responses to different exercise training intensities in patients with heart failure: a systematic review and meta-analysis. JACC Heart Fail 2013 Dec;1(6):514-522 [FREE Full text] [CrossRef] [Medline]
- Tu R, Zeng Z, Zhong G, Wu W, Lu Y, Bo Z, et al. Effects of exercise training on depression in patients with heart failure: a systematic review and meta-analysis of randomized controlled trials. Eur J Heart Fail 2014 Jul;16(7):749-757 [FREE Full text] [CrossRef] [Medline]
- Piepoli MF, Conraads V, Corrà U, Dickstein K, Francis DP, Jaarsma T, et al. Exercise training in heart failure: from theory to practice. A consensus document of the heart failure association and the European association for cardiovascular prevention and rehabilitation. Eur J Heart Fail 2011 Apr;13(4):347-357 [FREE Full text] [CrossRef] [Medline]
- Strömberg A, Mårtensson J, Fridlund B, Levin LA, Karlsson JE, Dahlström U. Nurse-led heart failure clinics improve survival and self-care behaviour in patients with heart failure: results from a prospective, randomised trial. Eur Heart J 2003 Jun;24(11):1014-1023. [CrossRef] [Medline]
- van der Wal MH, Jaarsma T. Adherence in heart failure in the elderly: problem and possible solutions. Int J Cardiol 2008 Apr 10;125(2):203-208. [CrossRef] [Medline]
- Cockayne S, Pattenden J, Worthy G, Richardson G, Lewin R. Nurse facilitated Self-management support for people with heart failure and their family carers (SEMAPHFOR): a randomised controlled trial. Int J Nurs Stud 2014 Sep;51(9):1207-1213. [CrossRef] [Medline]
- Ong MK, Romano PS, Edgington S, Aronow HU, Auerbach AD, Black JT, Better Effectiveness After Transition–Heart Failure (BEAT-HF) Research Group. Effectiveness of remote patient monitoring after discharge of hospitalized patients with heart failure: the better effectiveness after transition -- heart failure (BEAT-HF) randomized clinical trial. JAMA Intern Med 2016 Mar;176(3):310-318 [FREE Full text] [CrossRef] [Medline]
- Nieuwenhuis MM, Jaarsma T, van Veldhuisen DJ, Postmus D, van der Wal MH. Long-term compliance with nonpharmacologic treatment of patients with heart failure. Am J Cardiol 2012 Aug 01;110(3):392-397 [FREE Full text] [CrossRef] [Medline]
- Lewsey SC, Breathett K. Racial and ethnic disparities in heart failure: current state and future directions. Curr Opin Cardiol 2021 May 01;36(3):320-328 [FREE Full text] [CrossRef] [Medline]
- Attig C, Franke T. Abandonment of personal quantification: a review and empirical study investigating reasons for wearable activity tracking attrition. Comput Human Behav 2020 Jan;102:223-237. [CrossRef]
- DeVore AD, Wosik J, Hernandez AF. The future of wearables in heart failure patients. JACC Heart Fail 2019 Nov;7(11):922-932 [FREE Full text] [CrossRef] [Medline]
- Alharbi M, Straiton N, Gallagher R. Harnessing the potential of wearable activity trackers for heart failure self-care. Curr Heart Fail Rep 2017 Feb;14(1):23-29. [CrossRef] [Medline]
- Cruz-Ramos NA, Alor-Hernández G, Colombo-Mendoza LO, Sánchez-Cervantes JL, Rodríguez-Mazahua L, Guarneros-Nolasco LR. mHealth apps for self-management of cardiovascular diseases: a scoping review. Healthcare (Basel) 2022 Feb 08;10(2):322 [FREE Full text] [CrossRef] [Medline]
- Bekfani T, Fudim M, Cleland JG, Jorbenadze A, von Haehling S, Lorber A, et al. A current and future outlook on upcoming technologies in remote monitoring of patients with heart failure. Eur J Heart Fail 2021 Jan 18;23(1):175-185 [FREE Full text] [CrossRef] [Medline]
- Brox E, Fernandez-Luque L, Tøllefsen T. Healthy gaming – video game design to promote health. Appl Clin Inform 2017 Dec 16;02(02):128-142. [CrossRef]
- Baranowski MT, Lu PA, Buday R, Lyons EJ, Schell J, Russoniello C. Stories in games for health: more pros or cons? Games Health J 2013 Oct;2(5):256-263 [FREE Full text] [CrossRef] [Medline]
- Beale IL, Kato PM, Marin-Bowling VM, Guthrie N, Cole SW. Improvement in cancer-related knowledge following use of a psychoeducational video game for adolescents and young adults with cancer. J Adolesc Health 2007 Sep;41(3):263-270. [CrossRef] [Medline]
- McGonigal J. Reality is Broken Why Games Make Us Better and How They Can Change the World. New York, United States: Random House; 2011.
- Vieira Á, Gabriel J, Melo C, Machado J. Kinect system in home-based cardiovascular rehabilitation. Proc Inst Mech Eng H 2017 Jan 19;231(1):40-47. [CrossRef] [Medline]
- Thompson D, Baranowski T, Buday R, Baranowski J, Thompson V, Jago R, et al. Serious video games for health how behavioral science guided the development of a serious video game. Simul Gaming 2010 Aug 01;41(4):587-606 [FREE Full text] [CrossRef] [Medline]
- Radhakrishnan K, Julien C, O'Hair M, Baranowski T, Lee G, Allen C, et al. Usability testing of a sensor-controlled digital game to engage older adults with heart failure in physical activity and weight monitoring. Appl Clin Inform 2020 Oct;11(5):873-881 [FREE Full text] [CrossRef] [Medline]
- Radhakrishnan K, Julien C, Baranowski T, O'Hair M, Lee G, Sagna De Main A, et al. Feasibility of a sensor-controlled digital game for heart failure self-management: randomized controlled trial. JMIR Serious Games 2021 Nov 08;9(4):e29044 [FREE Full text] [CrossRef] [Medline]
- TrialFacts homepage. TrialFacts. URL: https://trialfacts.com/ [accessed 2023-02-27]
- Dolgin M. Nomenclature and Criteria for Diagnosis of Diseases of the Heart and Great Vessels 9th Edition. Boston, Massachusetts, United States: Little Brown & Co; 1994.
- Borson S, Scanlan J, Brush M, Vitaliano P, Dokmak A. The mini-cog: a cognitive 'vital signs' measure for dementia screening in multi-lingual elderly. Int J Geriatr Psychiatry 2000 Nov;15(11):1021-1027. [CrossRef] [Medline]
- Radhakrishnan K, Julien C, O'Hair M, Lee G, DeMain A, Hebért Arsers E, et al. A sensor-controlled digital game for heart failure self-care based on behavioral change frameworks. In: Proceedings of the IEEE 10th International Conference on Serious Games and Applications for Health(SeGAH. 2022 Presented at: IEEE 10th International Conference on Serious Games and Applications for Health(SeGAH); Aug 10-12, 2022; Sydney, Australia. [CrossRef]
- Poirier J, Bennett WL, Jerome GJ, Shah NG, Lazo M, Yeh H, et al. Effectiveness of an activity tracker- and internet-based adaptive walking program for adults: a randomized controlled trial. J Med Internet Res 2016 Feb 09;18(2):e34 [FREE Full text] [CrossRef] [Medline]
- DeWalt DA, Schillinger D, Ruo B, Bibbins-Domingo K, Baker DW, Holmes GM, et al. Multisite randomized trial of a single-session versus multisession literacy-sensitive self-care intervention for patients with heart failure. Circulation 2012 Jun 12;125(23):2854-2862. [CrossRef]
- HFSA heart failure patient education modules. Heart Failure Society of America Homepage. URL: https://hfsa.org/hfsa-heart-failure-patient-education-modules [accessed 2020-12-23]
- Hensley C, Joseph A, Shah S, O'Dea C, Carameli K. Addressing social determinants of health at a federally qualified health center. Int Public Health J 2017;9(2):189-198.
- LaForge K, Gold R, Cottrell E, Bunce AE, Proser M, Hollombe C, et al. How 6 organizations developed tools and processes for social determinants of health screening in primary care: an overview. J Ambul Care Manage 2018;41(1):2-14 [FREE Full text] [CrossRef] [Medline]
- Rollman BL, Herbeck Belnap B, Mazumdar S, Houck PR, He F, Alvarez RJ, et al. A positive 2-item Patient Health Questionnaire depression screen among hospitalized heart failure patients is associated with elevated 12-month mortality. J Card Fail 2012 Mar;18(3):238-245 [FREE Full text] [CrossRef] [Medline]
- Piepenburg SM, Faller H, Gelbrich G, Störk S, Warrings B, Ertl G, et al. Comparative potential of the 2-item versus the 9-item patient health questionnaire to predict death or rehospitalization in heart failure. Circ Heart Fail 2015 May;8(3):464-472. [CrossRef] [Medline]
- Reilly CM, Higgins M, Smith A, Gary RA, Robinson J, Clark PC, et al. Development, psychometric testing, and revision of the Atlanta heart failure knowledge test. J Cardiovasc Nurs 2009;24(6):500-509 [FREE Full text] [CrossRef] [Medline]
- Vellone E, Riegel B, Cocchieri A, Barbaranelli C, D'Agostino F, Antonetti G, et al. Psychometric testing of the self-care of heart failure index version 6.2. Res Nurs Health 2013 Oct 07;36(5):500-511 [FREE Full text] [CrossRef] [Medline]
- McAuley E, Duncan T, Tammen VV. Psychometric properties of the intrinsic motivation inventory in a competitive sport setting: a confirmatory factor analysis. Res Q Exerc Sport 1989 Mar;60(1):48-58. [CrossRef] [Medline]
- Withings health mate: a fitness, activity and health tracker app. Withings. URL: https://www.withings.com/us/en/health-mate [accessed 2020-12-31]
- Lee CS, Lyons KS, Gelow JM, Mudd JO, Hiatt SO, Nguyen T, et al. Validity and reliability of the European heart failure self-care behavior scale among adults from the United States with symptomatic heart failure. Eur J Cardiovasc Nurs 2013 Apr 21;12(2):214-218 [FREE Full text] [CrossRef] [Medline]
- Green C, Porter CB, Bresnahan DR, Spertus JA. Development and evaluation of the Kansas city cardiomyopathy questionnaire: a new health status measure for heart failure. J Am Coll Cardiol 2000 Apr;35(5):1245-1255 [FREE Full text] [CrossRef] [Medline]
- Tango Card Homepage. Tango Card. URL: https://www.tangocard.com/ [accessed 2022-12-15]
- Creswell J, Plano Clark V. Designing and Conducting Mixed Methods Research. Thousand Oaks, California, United states: SAGE Publications; 2007.
- Ibrahim JG, Chen M, Lipsitz SR, Herring AH. Missing-data methods for generalized linear models. J Am Stat Assoc 2005 Mar;100(469):332-346. [CrossRef]
- Little R, Rubin D. Statistical Analysis With Missing Data. Hoboken, New Jersey: Wiley; 2009.
- Zeger SL, Liang K. Longitudinal data analysis for discrete and continuous outcomes. Biometrics 1986 Mar;42(1):121. [CrossRef]
- Preisser JS, Lu B, Qaqish BF. Finite sample adjustments in estimating equations and covariance estimators for intracluster correlations. Stat Med 2008 Nov 29;27(27):5764-5785. [CrossRef] [Medline]
- Bryan M, Heagerty PJ. Direct regression models for longitudinal rates of change. Stat Med 2014 May 30;33(12):2115-2136 [FREE Full text] [CrossRef] [Medline]
- R: a language and environment for statistical computing. GBIF Homepage. URL: https://www.gbif.org/tool/81287/r-a-language-and-environment-for-statistical-computing [accessed 2022-10-15]
- Braun V, Clarke V. What can "thematic analysis" offer health and wellbeing researchers? Int J Qual Stud Health Well being 2014 Oct 16;9:26152 [FREE Full text] [CrossRef] [Medline]
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006 Jan;3(2):77-101. [CrossRef]
- Dedoose Version 9.0.17, cloud application for managing, analyzing, and presenting qualitative and mixed method research data. SocioCultural Research Consultants, LLC. 2021. URL: https://www.dedoose.com/userguide/appendix [accessed 2023-04-25]
- Mobile fact sheet. Pew Research Center. URL: https://www.pewresearch.org/internet/fact-sheet/mobile [accessed 2020-12-31]
- Barnett I, Torous J, Staples P, Sandoval L, Keshavan M, Onnela J. Relapse prediction in schizophrenia through digital phenotyping: a pilot study. Neuropsychopharmacology 2018 Jul;43(8):1660-1666 [FREE Full text] [CrossRef] [Medline]
- Burke JW, McNeill MD, Charles DK, Morrow PJ, Crosbie JH, McDonough SM. Optimising engagement for stroke rehabilitation using serious games. Vis Comput 2009 Aug 27;25(12):1085-1099. [CrossRef]
- Bower KJ, Louie J, Landesrocha Y, Seedy P, Gorelik A, Bernhardt J. Clinical feasibility of interactive motion-controlled games for stroke rehabilitation. J Neuroeng Rehabil 2015 Aug 02;12:63 [FREE Full text] [CrossRef] [Medline]
- Flores M, Glusman G, Brogaard K, Price ND, Hood L. P4 medicine: how systems medicine will transform the healthcare sector and society. Personalized Med 2013 Aug;10(6):565-576. [CrossRef]
|CG: control group|
|CONSORT: Consolidated Standards of Reporting Trials|
|HF: heart failure|
|IG: intervention group|
|KCCQ: Kansas City Cardiomyopathy Questionnaire|
|QoL: quality of life|
|REDCap: Research Electronic Data Capture|
|SCDG: sensor-controlled digital game|
Edited by A Mavragani; The proposal of this paper was externally peer reviewed by the Biobehavioral Medicine and Health Outcomes Study Section (BMHO) - Risk, Prevention and Health Behavior Integrated Review Group - Center for Scientific Review (National Institutes of Health, USA). See the Multimedia Appendix for the peer-review report; submitted 27.01.23; accepted 21.03.23; published 10.05.23Copyright
©Kavita Radhakrishnan, Christine Julien, Matthew O'Hair, Rachel Tunis, Grace Lee, Angelica Rangel, James Custer, Tom Baranowski, Paul J Rathouz, Miyong T Kim. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 10.05.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.