Published on in Vol 14 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/60559, first published .
A Digital Behavior Change Intervention for Health Promotion for Adults in Midlife: Protocol for a Multidimensional Assessment Study

A Digital Behavior Change Intervention for Health Promotion for Adults in Midlife: Protocol for a Multidimensional Assessment Study

A Digital Behavior Change Intervention for Health Promotion for Adults in Midlife: Protocol for a Multidimensional Assessment Study

Protocol

1Health Promotion and Prevention Division, Santé publique France, Saint-Maurice, France

2Education and Health Promotion Laboratory, Sorbonne Paris Nord University, Villetaneuse, France

*all authors contributed equally

Corresponding Author:

Dagmar Soleymani, PhD

Health Promotion and Prevention Division

Santé publique France

12 rue due Val d'Osne

Saint-Maurice, 94415

France

Phone: 33 0171482134

Email: dagmar.soleymani@santepubliquefrance.fr


Background: To support lifelong health promotion and disease prevention, Santé publique France studied the methodology for building a social marketing scheme with a digital intervention targeting middle-aged adults, specifically socioeconomically disadvantaged groups. The digital intervention aims to encourage people aged 40-55 years to look after their health in the short and medium terms by adopting small actions relating to 8 health determinants: nutrition, physical activity, smoking, alcohol, stress, cognitive health, sleep, and environmental health. In the long term, the intervention intends to prevent frailty and reduce the burden of multimorbidities in older age, particularly for lower socioeconomic groups.

Objective: This study aims to measure behavior changes among registered users of the future website. The protocol assesses the impact of the website based on users’ implementation of small actions relating to the 8 health determinants. Specifically, it intends to evaluate the website’s performance in terms of engaging a specific population, triggering behavior change, raising awareness about a multifactorial approach to health, and encouraging user interaction with the website’s resources.

Methods: The methodology is based on clinical assessments developed alongside the website according to the functionalities offered to registered users in their personalized space. The assessment tool design draws on logic models for digital interventions, and their consistency for digital applications is verified. The target audience is clearly defined from the outset. The protocol sets out a 3-step assessment: upon registration, after 3 weeks of use, and after 10 weeks of use (end of assessment). Users are divided into 2 groups (socioeconomically disadvantaged users and others) to characterize differences and make corrections. The protocol uses a mixed assessment approach based on website traffic and user login data. Specific and identifiable behavior changes are documented by monitoring the same individuals from T0 to T2, using verbatim comments to classify them into profiles and conducting semistructured individual interviews with a sample of users.

Results: The protocol creates a multidimensional assessment of digital intervention, showing that during a given timeline, interactions with users can reveal their capabilities, opportunities, and motivations to adopt healthy lifestyles. The protocol’s principles were integrated into the development of a personal account to assess users’ behavior changes. Given the delayed launch of the website, no recruitment or effects analysis of the protocol took place.

Conclusions: As no multidimensional assessment protocol is currently available for digital behavior change interventions, our methods reveal that the different framework stages can strengthen the effect measurement, consolidate the choice of assumptions used within the logic model and steer the digital intervention toward action while reducing the burden of information. The suitability of the assessment protocol remains to be evaluated given the delayed launch of the website.

International Registered Report Identifier (IRRID): PRR1-10.2196/60559

JMIR Res Protoc 2025;14:e60559

doi:10.2196/60559

Keywords



Background

Today, expert consensus recommends that people should strengthen disease prevention actions from the age of 40 years [Dementia, disability and frailty in later life—mid-life approaches to delay or prevent onset. National Institute for Health and Care Excellence. 2015. URL: https://www.nice.org.uk/guidance/ng16 [accessed 2023-09-10] 1-Prevention of Alzheimer’s disease and related diseases (ADRD). Haut Conseil de la Santé Publique. 2017. URL: https://www.hcsp.fr/Explore.cgi/AvisRapportsDomaine?clefr=674 [accessed 2024-05-23] 3] to avoid loss of independence due to the accumulation of chronic diseases. Different studies show a correlation between the number of healthy behaviors (physical activity, diet, stop smoking, and reduction of alcohol consumption) and healthy aging. Santé publique France has been working on the planning stages of a social marketing scheme that includes a digital behavior change intervention. The digital intervention was designed in tandem with its assessment protocol in the hope that engineering feedback would improve its applicability. An overview of the literature on the assessment of digital tools for health promotion and disease prevention found proven evidence for the following: (1) the added value of a multidimensional assessment of a digital intervention [Michie S, Yardley L, West R, Patrick K, Greaves F. Developing and evaluating digital interventions to promote behavior change in health and health care: recommendations resulting from an international workshop. J Med Internet Res. 2017;19(6):e232. [FREE Full text] [CrossRef] [Medline]4,Miller S, Ainsworth B, Yardley L, Milton A, Weal M, Smith P, et al. A framework for Analyzing and Measuring Usage and Engagement Data (AMUsED) in digital interventions: viewpoint. J Med Internet Res. 2019;21(2):e10966. [FREE Full text] [CrossRef] [Medline]5], (2) the challenge of distinguishing between effect measurement and implementation measurement [Scheen B, Williams A, D'Hoore W. [The use of social media in health promotion: a review of the literature]. Université catholique de Louvain. 2019. URL: https://sites.uclouvain.be/reso/opac_css/doc_num.php?explnum_id=17983 [accessed 2024-05-23] 6] since “a crucial implication of explicitly recognizing the distinction between engagement with the technological and behavioral aspects of the intervention is that intervention usage alone cannot be taken as a valid indicator of engagement” [Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. 2016;51(5):833-842. [CrossRef] [Medline]7], (3) the importance of being able to qualify the maintenance of a target behavior over time [Pinder C, Vermeulen J, Cowan BR, Beale R. Digital behaviour change interventions to break and form habits. ACM Trans Comput Hum Interact. 2018;25(3):1-66. [FREE Full text] [CrossRef]8], and (4) the absence, to our knowledge, of a mixed quantitative and qualitative assessment protocol [Michie S, Yardley L, West R, Patrick K, Greaves F. Developing and evaluating digital interventions to promote behavior change in health and health care: recommendations resulting from an international workshop. J Med Internet Res. 2017;19(6):e232. [FREE Full text] [CrossRef] [Medline]4,Aromatario O, Van Hoye A, Vuillemin A, Foucaut AM, Crozet C, Pommier J, et al. How do mobile health applications support behaviour changes? A scoping review of mobile health applications relating to physical activity and eating behaviours. Public Health. 2019;175:8-18. [FREE Full text] [CrossRef] [Medline]9-Dagiral E, Licoppe C, Martin O, Pharabod AS. [The quantified self in question(s): a review of the social science literature on individual self-measurement]. Réseaux. 2019;216(4):17-54. [FREE Full text] [CrossRef]11].

It was precisely this gap that prompted the drafting of this assessment protocol for a nonclinical intervention. We explored the literature on assessments in the fields of medicine and medical informatics as a basis for consolidating some of our following methodological choices.

  • The framework stages to develop an assessment protocol: preliminary diagram, study design, operationalization of the methods, project schedule, execution, and conclusion [Cusack CM, Byrne C, Hook JM, McGowan J, Poon EG, Zafar A. Health information technology evaluation toolkit: 2009 Update. Agency for Healthcare Research and Quality. 2009. URL: https:/​/digital.​ahrq.gov/​sites/​default/​files/​docs/​page/​health-information-technology-evaluation-toolkit-2009-update.​pdf [accessed 2024-05-23] 12-Nykänen P, Brender J, Talmon J, de Keizer N, Rigby M, Beuscart-Zephir M, et al. Guideline for good evaluation practice in health informatics (GEP-HI). Int J Med Inform. 2011;80(12):815-827. [CrossRef] [Medline]14].
  • The lesson that an evaluable result consists of the internet user’s loyalty to the logic models used and not the loyalty necessary for a program to be effective [Hermes ED, Lyon AR, Schueller SM, Glass JE. Measuring the implementation of behavioral intervention technologies: recharacterization of established outcomes. J Med Internet Res. 2019;21(1):e11752. [FREE Full text] [CrossRef] [Medline]15]: “The distinction in digital health evaluation from traditional evaluation is that there is not always a need to evaluate health outcomes as direct effects of the digital health intervention” [Monitoring and evaluating digital health interventions: a practical guide to conducting research and assessment [Internet]. World Health Organization. 2016. URL: https://iris.who.int/bitstream/handle/10665/252183/9789241511766-eng.pdf?sequence=1 [accessed 2024-05-23] 13].
  • The decision to document the initial impact of an intervention as well as its additional impact compared to existing digital interventions by Santé publique France [Monitoring and evaluating digital health interventions: a practical guide to conducting research and assessment [Internet]. World Health Organization. 2016. URL: https://iris.who.int/bitstream/handle/10665/252183/9789241511766-eng.pdf?sequence=1 [accessed 2024-05-23] 13].
  • The decision to take into account the unexpected effects of health IT [Magrabi F, Ammenwerth E, Hyppönen H, de Keizer N, Nykänen P, Rigby M, et al. Yearb Med Inform. 2016:61-69. [FREE Full text] [CrossRef] [Medline]16].
Digital Intervention for Behavior Change in Midlife

Based on a holistic and person-centered approach, the digital intervention provides information on the main risk factors for health, taking into account the barriers to and drivers for adopting healthy behaviors as well as the specific living conditions and environments of those aged 40-55 years. This digital intervention is based on the quantified self to support behavior transformation [Zouinar M. [Theories and principles of digital self-tracking systems design from quantification to distributed self-regulation]. Réseaux. 2019;216(4):83-117. [FREE Full text] [CrossRef]17,Short C, Smit ES, Crutzen R. Measuring psychological constructs in computer-tailored interventions: novel possibilities to reduce participant burden and increase engagement. Eur Health Psychol. 2021;22(4):801-815. [FREE Full text] [CrossRef]18]. The design of the intervention is explained in a separate study (under review) that illustrates the complementary nature of the theories used in relation to the targeted behavior changes. To become familiar with the user and guide them toward behavior changes, the initial access to the site requires them to fill out a questionnaire on their lifestyle habits, which generates personalized feedback according to a traffic light system in order to introduce recommendations for protective behaviors. At this stage, the user has the option of downloading their report with an overview of the feedback in the form of a table. The next click opens a feed page with action cards and studies that the user can “like,” save to their account, and use to navigate further around the site. The personal account is designed as a self-coaching tool intended to support motivation, increase the power to act, and help the user understand health as an interaction between several health determinants applying to all life areas (Table 1).

Table 1. Personalized space of the digital intervention with the available resources and functionalities.
Sections of the personalized spaceResources or functionalities available
Home pageThe following items are displayed as a dashboard: answers to the “lifestyle habits” questionnaire, feedback in a traffic light system, feed page with action cards and study pages that can be liked, and liked actions and study pages following website navigation.
My favorite content and goalsA list of liked actions automatically categorized by determinants—users have total freedom to use drag-and-drop to modify the layout according to their needs (eg, from the easiest to the most difficult; based on a time frame) and to delete or add material; and a list of liked studies automatically categorized by determinant—users have total freedom to use drag-and-drop to modify the layout according to their needs (eg, from the easiest to the most difficult; based on a time frame) and delete or add more.
My assessmentAn option to repeat the “lifestyle habits” questionnaire to see how habits have changed with the traffic lights and feed page being updated and a history of previous questionnaires is displayed.
My successesA list of actions that have become everyday behavior.

As no gold standard questionnaire on lifestyle habits is available, the present one is a concatenation of different examples taken from the literature and pretested with a target group of midlife adults during a qualitative study.

The personalized space for registered users was leveraged to form the basis of the assessment as the users’ actions could be tracked via the content management system. The assessment could then be carried out continuously or in waves.

Conceptual Framework: Intervention Model

The first step was to identify the causes of the problem, shown in the “causal model of the problem” in Figure 1 [Brousselle A, Champagne F, Contandriopoulos A, Hartz Z. L'évaluation : concepts et méthodes. Montréal, QC. Presses de l'Université de Montréal; 2011. 19], then to translate them into an objective in the “theoretical logic” part and finally to deduce the output and intervention objectives (operational logic model), leading to 3 evaluable working hypotheses.

Figure 1. Modeling the social marketing scheme to support the adoption of healthy lifestyles in midlife (adapted from Brousselle et al [Brousselle A, Champagne F, Contandriopoulos A, Hartz Z. L'évaluation : concepts et méthodes. Montréal, QC. Presses de l'Université de Montréal; 2011. 19]). COM-B: capacities, opportunities, motivations-behavior.

The protocol aims to assess the impact of the website based on the small actions triggered among users to the different health determinants. Specifically, it is intended to evaluate the website’s performance in terms of the following objectives: (1) engaging a specific population, (2) triggering behavior change, (3) raising awareness about a multifactorial approach to health, and (4) encouraging user interaction with the website’s resources. The paper describes the methods and their relevant limits when constructing an assessment protocol for digital interventions. It questions the value of digital self-assessment and the time frame necessary to evaluate the adoption of healthy lifestyles, as no expert consensus is available on this topic. Finally, the article explores how behavior change models can strengthen the effect measurement of an assessment protocol.


Objectives of the Digital Intervention

The effect of the intervention on protective behaviors in midlife is communicated through 8 health determinants: diet, physical activity, smoking, alcohol, stress, sleep, cognitive health, and environmental health. The digital intervention is intended to help people aged 40-55 years, and in particular, socioeconomically disadvantaged people to (1) adopt multifactorial preventive actions in their daily lives; (2) increase their knowledge about lesser known determinants (stress, sleep, cognitive health, and environmental health); (3) support dialogue with health care professionals; and (4) develop psychosocial skills, especially the ability to resist social pressure.

Theory of Assessment of a Digital Intervention

The 3-pronged approach of “perceive, prepare, act,” resulting from existing digital behavior change interventions [Pinder C, Vermeulen J, Cowan BR, Beale R. Digital behaviour change interventions to break and form habits. ACM Trans Comput Hum Interact. 2018;25(3):1-66. [FREE Full text] [CrossRef]8,Mohr DC, Schueller SM, Montague E, Burns MN, Rashidi P. The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth interventions. J Med Internet Res. 2014;16(6):e146. [FREE Full text] [CrossRef] [Medline]20], correlates with the functionalities of the website—questionnaire, actions, personalized space—designed using the behavior change techniques of capacities, opportunities, motivations-behavior (COM-B) [Bernard P, Boiché J, Chevance G, Haas M, Héraud N, Latrille C. [French translation of the taxonomy (v1) of behaviour change techniques]. Guillaume Chevance, PhD. 2019. URL: http:/​/guillaumechevance.​com/​2019/​06/​07/​traduction-francaise-de-la-taxonomie-v1-des-techniques-de-changement-de-comportement [accessed 2023-09-24] 21].

Table 2 shows the indicators that can be used to answer the assessment questions.

  • The mechanisms and factors that influence the choice of one or more actions and contribute to whether they are adopted are shown in “1. goals and planning—perceive, prepare, and act” as well as in the column “prepare” when a user likes one or more actions.
  • The influence of personalized space on the adoption of actions (preferably multifactorial) and on the self-assessment of lifestyle habits can be understood on the basis of the items listed in the “act” column.
  • The factors likely to influence target users’ perception of their chosen health-promoting action are reflected in the fact that the questionnaire is repeated (2.4) and that behaviors are practiced, repeated, and changed (from 8.1 to 8.4).
Table 2. Transposing the BCTa of COM-Bb onto the digital behavior change intervention context: perceive, prepare, and act.
COM-BDigital behavior change intervention [Pinder C, Vermeulen J, Cowan BR, Beale R. Digital behaviour change interventions to break and form habits. ACM Trans Comput Hum Interact. 2018;25(3):1-66. [FREE Full text] [CrossRef]8]

Perceive (website + questionnaire)Prepare (actions)Act (personalized space)
1. Goals and planning1.6. Discrepancy between current behavior and goal (questionnaire)1.1. Goal setting (behavior)
1.4. Planning behavior
1.5. Review behavior goals (increase practice)
1.6. Discrepancy between current behavior and goal (doing the action)
1.7. Review outcome goal(s)
1.9. Commitment (to be done, etc.)
2. Feedback and monitoring2.2. Feedback on behavior (questionnaire)c2.3. Self-monitoring of behavior
2.4. Monitoring of behavior outcomes (redo the questionnaire)
3. Social support3.1. Social support (unspecified; internet resources)
3.2. Social support (practical)
3.3. Social support (emotional)
4. Shaping knowledge4.2. Information about antecedents4.1. Instruction on how to accomplish a behavior
5. Natural consequences5.1. Information about health consequences
5.2. Salience of consequences
5.5. Anticipated regret
6. Comparison of behavior6.2. Social comparison6.1. Demonstration of the behavior
7. Associations7.8. Associative learning (favorable environment and multifactorial approach)7.1. Prompts or cues
8. Repetition and substitution8.3. Habit formation8.1. Behavioral practice or rehearsal
8.2. Behavior substitution
8.3. Habit formation
8.4. Habit reversal
9. Comparison of outcomes9.1. Credible sources
9.3. Comparative imagining of future outcomes
10. Reward and threat
10.4. Social reward
11. Regulation11.3. Conserving mental resources
13. Identity13.1. Identification of self as role model
15. Self-belief
15.3. Focus on past success

aBCT: behavior change technique.

bCOM-B: capacities, opportunities, motivations-behavior.

cNot applicable.

The typology of a target user, as described earlier in the objectives, can be combined with the indicators of the perception, preparation, and action stages to complete an assessment in advance.

Mixed Assessment Protocol

Three evaluative questions emerge concerning the personalized account and, by extension, the website.

  • What mechanisms and factors influence the choice of one or more actions and contribute to the user adopting them?
  • What influence does personalized space have on the adoption of actions that are preferably multifactorial and on the self-assessment of lifestyle habits?
  • What factors are likely to influence target users’ perception of their chosen health-promoting action?

Our protocol combining quantitative and qualitative assessment is based on data collected from the personalized space, which was designed with the objective of “outsourced self-regulation” [Zouinar M. [Theories and principles of digital self-tracking systems design from quantification to distributed self-regulation]. Réseaux. 2019;216(4):83-117. [FREE Full text] [CrossRef]17], supplemented by additional questionnaires and individual interviews. The mixed assessment evaluates behavior changes made at different time points in the data collection process rather than the increase in quality of life and disability-free life expectancy. As mentioned earlier, the evaluable result is the user’s loyalty to the logic models used [Monitoring and evaluating digital health interventions: a practical guide to conducting research and assessment [Internet]. World Health Organization. 2016. URL: https://iris.who.int/bitstream/handle/10665/252183/9789241511766-eng.pdf?sequence=1 [accessed 2024-05-23] 13] and not the loyalty necessary for a program to be effective [Hermes ED, Lyon AR, Schueller SM, Glass JE. Measuring the implementation of behavioral intervention technologies: recharacterization of established outcomes. J Med Internet Res. 2019;21(1):e11752. [FREE Full text] [CrossRef] [Medline]15]. Kelders et al [Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen JEWC. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res. 2012;14(6):e152. [FREE Full text] [CrossRef] [Medline]22] described the typical components through an analysis of 83 digital interventions: modular, updated once a week, use of persuasive technologies, and potential to interact with the communicator and peers [Kohl LFM, Crutzen R, de Vries NK. Online prevention aimed at lifestyle behaviors: a systematic review of reviews. J Med Internet Res. 2013;15(7):e146. [FREE Full text] [CrossRef] [Medline]23].

The features of an assessment protocol are as follows.

  • Before the digital intervention is launched: it supports the design and modeling of digital intervention.
    • Once launched, (1) it checks whether the users of the personalized space are between the ages of 40 and 55 years, whether they are socioeconomically deprived, and whether they have a low level of literacy; (2) it creates typologies of registered users; (3) it measures the effects (ie, changes in the behavior of registered users) through evaluable criteria and indicators such as adopting and maintaining a new healthy behavior, increased knowledge, improved psychosocial skills, and improved health variables [Scheen B, Williams A, D'Hoore W. [The use of social media in health promotion: a review of the literature]. Université catholique de Louvain. 2019. URL: https://sites.uclouvain.be/reso/opac_css/doc_num.php?explnum_id=17983 [accessed 2024-05-23] 6,Getting started with program evaluation: Chapter 1: Building a logic model. Mentor. URL: https://www.mentoring.org/resource/getting-started-with-program-evaluation-1-building-a-logic-model/ [accessed 2024-09-12] 24]; and (4) it continually improves the website and personalized space to support the desire to change behavior in midlife [Short C, Smit ES, Crutzen R. Measuring psychological constructs in computer-tailored interventions: novel possibilities to reduce participant burden and increase engagement. Eur Health Psychol. 2021;22(4):801-815. [FREE Full text] [CrossRef]18,Mohr DC, Cheung K, Schueller SM, Hendricks Brown C, Duan N. Continuous evaluation of evolving behavioral intervention technologies. Am J Prev Med. 2013;45(4):517-523. [FREE Full text] [CrossRef] [Medline]25].

Recording unexpected effects [Magrabi F, Ammenwerth E, Hyppönen H, de Keizer N, Nykänen P, Rigby M, et al. Yearb Med Inform. 2016:61-69. [FREE Full text] [CrossRef] [Medline]16] sheds light on the adjustments needed in order to continually improve the intervention. Several hypotheses for these have been formulated: (1) the questionnaire does not engage users or it is never repeated; (2) the initial request does not correspond to the determinant that the user is “coached” on in their personalized space; (3) a highly disparate choice of actions makes it difficult or even impossible to implement them (no actions are adopted); and (4) actions are liked without a time objective being set.

Assessment Objectives

As stated above, the intention was to split the individuals included in the assessment into 2 groups. The 7 measurement objectives presented below apply to both groups. A detailed description of the objectives is given in

Multimedia Appendix 1

Detailed presentation of the 7 objectives of the assessment.

DOCX File , 26 KBMultimedia Appendix 1.

  • Objective 1: To assess whether the user’s profile matches the purpose of the site, namely, to reach socioeconomically disadvantaged people with a low level of health literacy and aged between 40 and 55 years at T0.
  • Objective 2: To record lifestyle habits that deviate to some extent from public health recommendations at T0, T1, and T2.
  • Objective 3: To record liked actions and articles while distinguishing actions in category A (change in behavior: diet, physical activity, smoking, and alcohol—additional contribution compared to other Santé publique France social marketing schemes) from those in category B (greater knowledge: sleep, stress, cognitive health, and environmental health—initial contribution given the absence of other Santé publique France resources). The assumption made is that the user chooses actions for category A and study pages for category B. Data are collected at T0, T1, and T2.
  • Objective 4: To assess willingness to change behavior at T0.
  • Objective 5: To assess the evolution of the behavior change between T0 to T1 and T1 to T2; to assess the frequency and routine nature of actions at T1 and T2.
  • Objective 6: To assess re-engagement at T2.
  • Objective 7: To assess lapsed connection to the personalized space before T1 and before T2 [Epstein DA, Ping A, Fogarty J, Munson SA. A lived informatics model of personal informatics. 2015. Presented at: The 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2015); September 7, 2015:731-742; Osaka, Japan. [CrossRef]26].
Assessment Time Frame

A digital behavior change intervention consists of several stages with a total average duration of approximately 10 weeks [Pinder C, Vermeulen J, Cowan BR, Beale R. Digital behaviour change interventions to break and form habits. ACM Trans Comput Hum Interact. 2018;25(3):1-66. [FREE Full text] [CrossRef]8], although there is no consensus between experts over the time frame. Engagement with the digital intervention involves registering to create an account with a personalized space and then signaling preparation for behavior change (phase 1), followed by the adoption of 1 or 2 actions (phase 2), and a phase of lapsed activity on the site (phase 3). Reengagement with the intervention (phase 4) is prompted by the need to solve a problem, renew motivation, identify a new action, and so on. [Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. 2016;51(5):833-842. [CrossRef] [Medline]7]. Split into 3 evaluable phases—T0, T1, and T2 (respectively phases 1, 2, and 4 according to Yardley et al [Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. 2016;51(5):833-842. [CrossRef] [Medline]7], in Table 3). The expected results and collection methods are presented in Table 3. It is based on the assessment work of the VERB™ campaign (in normal type) [Huhman ME, Potter LD, Nolin MJ, Judkins DR. Evaluation of the VERB™ campaign: challenges and solutions. Commun. Methods Meas. 2009;3(1-2):47-60. [CrossRef]27], the lessons learned on health information-seeking behaviors (in italics) [Longo DR. Understanding health information, communication, and information seeking of patients and consumers: a comprehensive and integrated model. Health Expect. 2005;8(3):189-194. [FREE Full text] [CrossRef] [Medline]28], the theory of small actions (in bold) [Fogg BJ. Die Tiny Habits®-Methode: Kleine Schritte, große Wirkung. Munich, Germany. btb Verlag; 2021. 29], and digital behavior change interventions (in bold and italics) [Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. 2016;51(5):833-842. [CrossRef] [Medline]7].

Table 2 presents the interaction between perceiving, preparing, and acting, which can be repeated randomly at the 3 assessment intervals set out in Table 3.

Table 3. Timing of the assessment process, evaluable results, and assessment indicators: engagement with physical activity.
Action verbsActionsOutcomesAssessment or indicators
Phase 1 (T0): use of the digital intervention

To be aware of and to understandCampaignaQuantitative posttest evaluation of social media campaigns

To accessInformation

To engage withInformationSite log-in and completion of the questionnaireLog-in data (quantitative)

To chooseA small target behaviorActions or liked content pages, account created in the subscriber space, and healthy lifestylesInteraction with the site and subscriber space data (quantitative and qualitative)
Phase 2 (T1): use of the digital intervention and engaging with behavioral change

To change inSubjective norms, beliefs, self-efficacy, and perceived behavioral controlQualitative data: questionnaires, verbatim comments, and individual interview

To useInformation

To intend to doPhysical activity

To engage withBehavior changesSite log-ins and actions in the subscriber spaceQualitative and quantitative data from the subscriber space

To chooseA small target behavior and a concatenation of smaller goalsActions or liked content pages and healthy lifestylesInteraction with the site and subscriber space data (quantitative and qualitative)
Phase 3: engaging with behavioral change

Phase 4 (T2): use of the digital intervention and engaging with behavioral change

To commit to and to maintainPhysical activityHealth outcomesLog-in data (quantitative); interaction with the site and subscriber space data (quantitative and qualitative); and qualitative data: questionnaires, verbatim comments, and individual interview

To makePhysical activityEmpowerment/ locus of control, satisfaction, activities of daily living, and health outcomes

To chooseA new small target behaviorLiked, validated actions

To re-engage withInformation if neededSite log-ins and actions in the subscriber space

aNot applicable.

Furthermore, it is particularly important to determine (1) T1 (changes related to subjective norms, beliefs, self-efficacy, and perceived control of behavior), (2) T2 (level of empowerment, degree of satisfaction, activities of daily living, and self-reported health outcomes), and (3) between T0 and T1 and then between T1 and T2, there are 4 reasons for lapsing—forgetting, having a technical problem, permanently giving up on self-quantification, and suspending usage—but these do not necessarily mean that the adopted action has been abandoned [Epstein DA, Ping A, Fogarty J, Munson SA. A lived informatics model of personal informatics. 2015. Presented at: The 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2015); September 7, 2015:731-742; Osaka, Japan. [CrossRef]26].

Assessment Methods From T0 to T2

As detailed in Figure 2 [Trottier CF, Lieffers JRL, Johnson ST, Mota JF, Gill RK, Prado CM. The impact of a web-based mindfulness, nutrition, and physical activity platform on the health status of first-year university students: protocol for a randomized controlled trial. JMIR Res Protoc. 2021;10(3):e24534. [FREE Full text] [CrossRef] [Medline]30], the assessment of the digital intervention at T0, T1, and T2 is intended to be explanatory, combining a quantitative and qualitative approach based on recording for both groups of users: (1) log-in data for the site and user account with personalized space, (2) data relating to specific and identifiable behavior changes by monitoring registered users from T0 to T2 via the content management system, (3) verbatim statements from users for classification into user profile; and (4) information about capabilities, opportunities and motivations via semistructured individual interviews with a sample of users.

Figure 2. Assessment methods from T0 to T2 (adapted from Trottier et al [Trottier CF, Lieffers JRL, Johnson ST, Mota JF, Gill RK, Prado CM. The impact of a web-based mindfulness, nutrition, and physical activity platform on the health status of first-year university students: protocol for a randomized controlled trial. JMIR Res Protoc. 2021;10(3):e24534. [FREE Full text] [CrossRef] [Medline]30]).

Self-Assessment at T0, T1, and T2

The “lifestyle habits” questionnaire is the basis of the initial self-assessment at T0, then again at T1 to visualize the changes that have taken place and finally at T2 to identify developments (Table 4). Other suggested tools at T1 are the Self-Report Habit Index [Verplanken B, Orbell S. Reflections on past behavior: a self‐report index of habit strength. J Applied Social Pyschol. 2006;33(6):1313-1330. [CrossRef]31] to assess the power of the “frequency” factor for the action performed most often and the “small actions” assessment questionnaire. At T2, the Self-Report Behavior Habit Index is intended to show whether the behavior has become routine, supplemented by the “small actions” assessment questionnaire.

Table 4. Expected outcomes and measurement tools of the assessment protocol [Park LS, Chih MY, Stephenson C, Schumacher N, Brown R, Gustafson D, et al. Testing an mHealth system for individuals with mild to moderate alcohol use disorders: protocol for a type 1 hybrid effectiveness-implementation trial. JMIR Res Protoc. 2022;11(2):e31109. [FREE Full text] [CrossRef] [Medline]32].
ObjectiveDomainsMeasuresSourceTime frameMeasuring or recording tools
First results

2. Lifestyle habitsLifestyle habits more or less comply with public health recommendationsResults of lifestyle habits questionnaireServer log filesT0, T1, and T2“Lifestyle habits” questionnaire

3. Liked actions and articlesAdopting categories A and B actions related to one or more health determinantsClassification of actions by the user (including verbatim comments)Server log filesT1, T2Classification of actions

3. Liked actions and articles: multiple health factorsUnderstanding that health depends on multiple factorsClassification of actions by the user (including verbatim comments)Server log filesT1, T2Classification of actions

4. Willingness to change behaviorStatement of wanting to change a behaviorClassification of actions by the user (including verbatim comments)Server log filesT0“Lifestyle habits” questionnaire and Lapsing assessment questionnaire

5. Evolution of behavior changeChange in one or more lifestyle habitsLifestyle habits questionnaire is repeated with one or more lifestyle habits changingServer log filesT1, T2“Lifestyle habits“ questionnaire and classification of actions

5. SRHIaFrequency of performing actionSelf-assessment by SRHIServer log filesT1SRHI

5. SRBHIbExtent to which action has become routineSelf-assessment using SRBHIServer log filesT2SRBHI

6. Re-engagementAssess re-engagementClassification of actions by the user (including verbatim comments); self-assessment by SRBHIServer log filesT2Classification of actions

7. Lapsed connectionAssess lapsed connection to the personalized spaceResults of the assessment questionnaire on lapsed connectionBy emailBefore T1 and before T2Lapsing assessment questionnaire
Mediators

Effectiveness of mediatorSelf-efficacySense of personal efficacy [Sentiment d'efficacité personnelle. Institut français d'EMDR. 2022. URL: https://www.ifemdr.fr/sentiment-defficacite-personnelle/ [accessed 2022-09-30] 33]Individual interview by group 1 and group 2 profile typeT1Sense of personal efficacy scale

Effectiveness of mediatorMotivationSituational motivation [Echelle de motivation situationnelle (SIMS). Institut français EMDR. 2022. URL: https://www.ifemdr.fr/echelle-de-motivation-situationnelle-sims/ [accessed 2022-09-30] 34]Individual interview by group 1 and group 2 profile typeT2Situational motivation scale

Effectiveness of mediatorCapability, opportunity, and motivationInformation provided by the user through the individual interviewIndividual interview by group 1 and group 2 profile typeT1, T2Interview guide

Effectiveness of mediatorFrequency of personalized space log-inQuantitative analysis of the user journeyServer log filesContinuousNumber of log-ins, liked actions and articles, incorporated or abandoned actions; time spent logged in; and interconnection between the determinants
Other results

1. User profileBiographical dataCategorized into group 1 or group 2: age, profession, level of health literacy, and absence of chronic diseaseResults of lifestyle habits questionnaire and results of the “small actions” assessment questionnaireT0“Lifestyle habits” questionnaire and “Small actions” assessment questionnaire

1. User profileRelationship between initial contribution (category B) and additional contribution (category A)Personalized space: liked actions and studiesServer log filesT0-T2Number of liked actions and articles by category

1. User profileAny difference in behaviors between group 1 and group 2Processing quantitative and qualitative data provided by registered usersServer log filesT1, T2“Lifestyle habits” questionnaire, “Small actions” assessment questionnaire, and individual interview

1. User profileRate of lapsed activity in the personalized spaceLack of log-ins to the personalized spaceServer log filesT0–T2Number of log-ins between T0 and T2 and Lapsing assessment questionnaire

aSRHI: Self-Report Habit Index.

bSRBHI: Self-Report Behavior Habit Index.

To further support the objectives mentioned earlier, an automatic assessment at T0, T1, and T2 retrieves the information provided and actions carried out by the user.

The aim of the semistructured individual interview at T1 and T2 by groups 1 and 2 profile type and sampling is to reveal the impact of the capabilities, opportunities, and motivations on behavior change by combining the methodology of the COM-B, the theoretical domains framework [Atkins L, Francis J, Islam R, O'Connor D, Patey A, Ivers N, et al. A guide to using the theoretical domains framework of behaviour change to investigate implementation problems. Implement Sci. 2017;12(1):77. [FREE Full text] [CrossRef] [Medline]35] and the tiny habits theory. Taking a human-machine interaction perspective, it is very difficult to determine whether the choice of an action is based on conscious or unconscious motivation [Pinder C, Vermeulen J, Cowan BR, Beale R. Digital behaviour change interventions to break and form habits. ACM Trans Comput Hum Interact. 2018;25(3):1-66. [FREE Full text] [CrossRef]8].

The assessment of lapsed connection to the personalized space before T1 and before T2 will be carried out via a questionnaire sent by email to the concerned users. The objective is to identify the reasons for the lack of use (with the aim of continually developing the personalized space) and the number of actions maintained without logging in.

Objectives 2, 4, and 5 make it possible to assess any unexpected effects: (1) the questionnaire is not the draw for the user or is never repeated (meaning that the user cannot view their progress in the personalized space; objective 2); (2) actions are liked, but no goal is set (objective 4); (3) a highly disparate choice of actions makes it difficult or even impossible to implement them (no actions are adopted; objective 5, criterion 1); and (4) the initial request differs from the action that the user is “coached” on in the personalized space (objective 5, criterion 2).

Assessment Population

The internet users, included in the assessment will be between the ages of 40 and 55 years, have registered to create an account on the website with a personalized space, and have carried out actions in their space during the 3 assessment stages: T0 (date of personal account creation), T1 (3 weeks after creation), and T2 (10 weeks after creation) (see Figure 3). Users will be divided into 2 groups. Group 1 will include socioeconomically deprived people and group 2 all other users. Each group will then be subdivided based on the “motivations,” “capabilities,” and “opportunities” expressed. By characterizing users into these 2 socioeconomic groups, the diversity of behaviors can be questioned, and corrections can be made to support group 1. Classification into group 1 will be based on 2 conditions: belonging to the lower socioprofessional categories and having a level of health literacy below 3.39 on domain 8 of the French Health Literacy Questionnaire [Debussche X, Lenclume V, Balcou-Debussche M, Alakian D, Sokolowsky C, Ballet D, et al. Characterisation of health literacy strengths and weaknesses among people at metabolic and cardiovascular risk: validity testing of the Health Literacy Questionnaire. SAGE Open Med. 2018;6:2050312118801250. [FREE Full text] [CrossRef] [Medline]36].

Figure 3. Assessment diagram.

When people create their personal account, in accordance with the General Data Protection Regulation in force in Europe, registered users will need to consent to the use of their quantitative and qualitative data for study purposes and agree to be contacted as part of the assessment. No sensitive medical data will be recorded, and the data from the content management system will be separated from the information collected through the personalized space. The digital security officer at Santé publique France verified the compliance of this data management approach with French data protection regulations (Commission nationale de l'informatique et des libertés).

The protocol currently allows testing in a given context and on a regional scale, for example.


This first version of the protocol responds to the objective to create a multidimensional assessment of a digital intervention based on the statement that during a given timeline, interactions with users aged 40-55 years can reveal their capabilities, opportunities, and motivations to adopt healthy lifestyles.

The assessment protocol based on the interactions with users in their personalized space of the digital behavior change intervention includes the evaluation of the following.

  • Increased capability, opportunity, and motivation to adopt a healthy lifestyle through one or more actions.
  • Improved access to information that is easy to translate into actions and to continue.
  • At least 2 actions adopted in everyday life.

However, the protocol cannot evaluate improved health promotion and disease prevention dialogue with adults in midlife in different settings or assess changes in social norms.

As the construction of the website is currently delayed, no recruitment or effects analysis of the protocol could take place. The creation of a steering committee was abandoned.


Expected Findings

As mentioned above, the protocol assesses the impact of the website based on the small behavior changes that it triggers among users in relation to different health determinants. The protocol has four aims: (1) engaging a specific population, (2) triggering behavior change, (3) raising awareness about a multifactorial approach to health, and (4) encouraging user interaction with the website’s resources. The research takes an interest in challenging the time frame necessary to evaluate the adoption of healthy lifestyles. It focuses on how the usage of behavior change models (COM-B) combined with the techniques of digital behavior change interventions [Pinder C, Vermeulen J, Cowan BR, Beale R. Digital behaviour change interventions to break and form habits. ACM Trans Comput Hum Interact. 2018;25(3):1-66. [FREE Full text] [CrossRef]8] can strengthen the effect measurement of an assessment protocol. The assessment protocol is based on typical digital functionalities such as a user account, self-evaluation of healthy lifestyles (questionnaire), and feedback to engage people with behavior change. It fosters a continuous short-term evaluation of digital behavior change interventions.

Main Results

This appears to be the first assessment protocol for digital health promotion interventions. It documents the potential of the digital intervention in various respects, supporting it on the basis of the chosen models that led to the design of the personalized space and contributing to its continued development both in terms of its technical features and written content. The mixed assessment method delivers a granular analysis that sheds light on the effectiveness and even the efficiency of the website through its personalized space. To our knowledge, our assessment protocol for a digital personalized space, designed with the aim of changing health promotion and disease prevention behaviors, is the first of its kind in the sense that it goes beyond the measurement of the implementation and expressly targets the measuring effect. According to literature reviews, the effects in question will be behavioral change, greater knowledge, improved psychosocial skills, development of a support network, and improved health variables [Scheen B, Williams A, D'Hoore W. [The use of social media in health promotion: a review of the literature]. Université catholique de Louvain. 2019. URL: https://sites.uclouvain.be/reso/opac_css/doc_num.php?explnum_id=17983 [accessed 2024-05-23] 6]. The protocol cannot be likened to assessments in investigational designs such as randomized controlled trials, which have been dismissed by some experts as unsuitable by some experts due to the complexity of health promotion interventions. The open design is considered effective “for the institutions that set it up and its flexibility matches the characteristics of health promotion interventions” [Scheen B, Williams A, D'Hoore W. [The use of social media in health promotion: a review of the literature]. Université catholique de Louvain. 2019. URL: https://sites.uclouvain.be/reso/opac_css/doc_num.php?explnum_id=17983 [accessed 2024-05-23] 6].

Limitations

The breadth of the mixed assessment may make the process of interpreting the lessons learned more complex if the power of each item of “collectible” information proves to be insufficient. The absence of an expert consensus on the duration necessary for behavior change to occur throws into question the time frame of 70 days. The weakness of the protocol relates to the lack of real application given that the launch of the website is delayed.

Conclusions

Drafting an assessment protocol is a significant aid in the design of a digital intervention. This makes it possible to consolidate the choice of hypotheses for constructing the logical models used and the objectives targeted. A protocol helps to steer the digital intervention toward the action and regularly checks that it meets the needs of its target audience. The assessment protocol meets the SMART (specific, measurable, achievable, relevant, and time-bound) criteria.

The research presented here will impact digital interventions in health promotion and disease prevention. As the protocol demonstrates, both the implementation and effects can be assessed. Health promotion and disease prevention stakeholders may prefer an assessment of the program, but this is rarely carried out. Without assessments, a digital intervention can claim to be “evidence-inspired,” although, with assessments, it is closer to “evidence-based.”

Conflicts of Interest

None declared.

Multimedia Appendix 1

Detailed presentation of the 7 objectives of the assessment.

DOCX File , 26 KB

  1. Dementia, disability and frailty in later life—mid-life approaches to delay or prevent onset. National Institute for Health and Care Excellence. 2015. URL: https://www.nice.org.uk/guidance/ng16 [accessed 2023-09-10]
  2. Transforming the future of ageing. Science Advice for Policy by European Academies. 2019. URL: https://sapea.info/topic/ageing/ [accessed 2024-12-19]
  3. Prevention of Alzheimer’s disease and related diseases (ADRD). Haut Conseil de la Santé Publique. 2017. URL: https://www.hcsp.fr/Explore.cgi/AvisRapportsDomaine?clefr=674 [accessed 2024-05-23]
  4. Michie S, Yardley L, West R, Patrick K, Greaves F. Developing and evaluating digital interventions to promote behavior change in health and health care: recommendations resulting from an international workshop. J Med Internet Res. 2017;19(6):e232. [FREE Full text] [CrossRef] [Medline]
  5. Miller S, Ainsworth B, Yardley L, Milton A, Weal M, Smith P, et al. A framework for Analyzing and Measuring Usage and Engagement Data (AMUsED) in digital interventions: viewpoint. J Med Internet Res. 2019;21(2):e10966. [FREE Full text] [CrossRef] [Medline]
  6. Scheen B, Williams A, D'Hoore W. [The use of social media in health promotion: a review of the literature]. Université catholique de Louvain. 2019. URL: https://sites.uclouvain.be/reso/opac_css/doc_num.php?explnum_id=17983 [accessed 2024-05-23]
  7. Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. 2016;51(5):833-842. [CrossRef] [Medline]
  8. Pinder C, Vermeulen J, Cowan BR, Beale R. Digital behaviour change interventions to break and form habits. ACM Trans Comput Hum Interact. 2018;25(3):1-66. [FREE Full text] [CrossRef]
  9. Aromatario O, Van Hoye A, Vuillemin A, Foucaut AM, Crozet C, Pommier J, et al. How do mobile health applications support behaviour changes? A scoping review of mobile health applications relating to physical activity and eating behaviours. Public Health. 2019;175:8-18. [FREE Full text] [CrossRef] [Medline]
  10. Neame MT, Sefton G, Roberts M, Harkness D, Sinha IP, Hawcutt DB. Evaluating health information technologies: a systematic review of framework recommendations. Int J Med Inform. 2020;142:104247. [CrossRef] [Medline]
  11. Dagiral E, Licoppe C, Martin O, Pharabod AS. [The quantified self in question(s): a review of the social science literature on individual self-measurement]. Réseaux. 2019;216(4):17-54. [FREE Full text] [CrossRef]
  12. Cusack CM, Byrne C, Hook JM, McGowan J, Poon EG, Zafar A. Health information technology evaluation toolkit: 2009 Update. Agency for Healthcare Research and Quality. 2009. URL: https:/​/digital.​ahrq.gov/​sites/​default/​files/​docs/​page/​health-information-technology-evaluation-toolkit-2009-update.​pdf [accessed 2024-05-23]
  13. Monitoring and evaluating digital health interventions: a practical guide to conducting research and assessment [Internet]. World Health Organization. 2016. URL: https://iris.who.int/bitstream/handle/10665/252183/9789241511766-eng.pdf?sequence=1 [accessed 2024-05-23]
  14. Nykänen P, Brender J, Talmon J, de Keizer N, Rigby M, Beuscart-Zephir M, et al. Guideline for good evaluation practice in health informatics (GEP-HI). Int J Med Inform. 2011;80(12):815-827. [CrossRef] [Medline]
  15. Hermes ED, Lyon AR, Schueller SM, Glass JE. Measuring the implementation of behavioral intervention technologies: recharacterization of established outcomes. J Med Internet Res. 2019;21(1):e11752. [FREE Full text] [CrossRef] [Medline]
  16. Magrabi F, Ammenwerth E, Hyppönen H, de Keizer N, Nykänen P, Rigby M, et al. Yearb Med Inform. 2016:61-69. [FREE Full text] [CrossRef] [Medline]
  17. Zouinar M. [Theories and principles of digital self-tracking systems design from quantification to distributed self-regulation]. Réseaux. 2019;216(4):83-117. [FREE Full text] [CrossRef]
  18. Short C, Smit ES, Crutzen R. Measuring psychological constructs in computer-tailored interventions: novel possibilities to reduce participant burden and increase engagement. Eur Health Psychol. 2021;22(4):801-815. [FREE Full text] [CrossRef]
  19. Brousselle A, Champagne F, Contandriopoulos A, Hartz Z. L'évaluation : concepts et méthodes. Montréal, QC. Presses de l'Université de Montréal; 2011.
  20. Mohr DC, Schueller SM, Montague E, Burns MN, Rashidi P. The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth interventions. J Med Internet Res. 2014;16(6):e146. [FREE Full text] [CrossRef] [Medline]
  21. Bernard P, Boiché J, Chevance G, Haas M, Héraud N, Latrille C. [French translation of the taxonomy (v1) of behaviour change techniques]. Guillaume Chevance, PhD. 2019. URL: http:/​/guillaumechevance.​com/​2019/​06/​07/​traduction-francaise-de-la-taxonomie-v1-des-techniques-de-changement-de-comportement [accessed 2023-09-24]
  22. Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen JEWC. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res. 2012;14(6):e152. [FREE Full text] [CrossRef] [Medline]
  23. Kohl LFM, Crutzen R, de Vries NK. Online prevention aimed at lifestyle behaviors: a systematic review of reviews. J Med Internet Res. 2013;15(7):e146. [FREE Full text] [CrossRef] [Medline]
  24. Getting started with program evaluation: Chapter 1: Building a logic model. Mentor. URL: https://www.mentoring.org/resource/getting-started-with-program-evaluation-1-building-a-logic-model/ [accessed 2024-09-12]
  25. Mohr DC, Cheung K, Schueller SM, Hendricks Brown C, Duan N. Continuous evaluation of evolving behavioral intervention technologies. Am J Prev Med. 2013;45(4):517-523. [FREE Full text] [CrossRef] [Medline]
  26. Epstein DA, Ping A, Fogarty J, Munson SA. A lived informatics model of personal informatics. 2015. Presented at: The 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2015); September 7, 2015:731-742; Osaka, Japan. [CrossRef]
  27. Huhman ME, Potter LD, Nolin MJ, Judkins DR. Evaluation of the VERB™ campaign: challenges and solutions. Commun. Methods Meas. 2009;3(1-2):47-60. [CrossRef]
  28. Longo DR. Understanding health information, communication, and information seeking of patients and consumers: a comprehensive and integrated model. Health Expect. 2005;8(3):189-194. [FREE Full text] [CrossRef] [Medline]
  29. Fogg BJ. Die Tiny Habits®-Methode: Kleine Schritte, große Wirkung. Munich, Germany. btb Verlag; 2021.
  30. Trottier CF, Lieffers JRL, Johnson ST, Mota JF, Gill RK, Prado CM. The impact of a web-based mindfulness, nutrition, and physical activity platform on the health status of first-year university students: protocol for a randomized controlled trial. JMIR Res Protoc. 2021;10(3):e24534. [FREE Full text] [CrossRef] [Medline]
  31. Verplanken B, Orbell S. Reflections on past behavior: a self‐report index of habit strength. J Applied Social Pyschol. 2006;33(6):1313-1330. [CrossRef]
  32. Park LS, Chih MY, Stephenson C, Schumacher N, Brown R, Gustafson D, et al. Testing an mHealth system for individuals with mild to moderate alcohol use disorders: protocol for a type 1 hybrid effectiveness-implementation trial. JMIR Res Protoc. 2022;11(2):e31109. [FREE Full text] [CrossRef] [Medline]
  33. Sentiment d'efficacité personnelle. Institut français d'EMDR. 2022. URL: https://www.ifemdr.fr/sentiment-defficacite-personnelle/ [accessed 2022-09-30]
  34. Echelle de motivation situationnelle (SIMS). Institut français EMDR. 2022. URL: https://www.ifemdr.fr/echelle-de-motivation-situationnelle-sims/ [accessed 2022-09-30]
  35. Atkins L, Francis J, Islam R, O'Connor D, Patey A, Ivers N, et al. A guide to using the theoretical domains framework of behaviour change to investigate implementation problems. Implement Sci. 2017;12(1):77. [FREE Full text] [CrossRef] [Medline]
  36. Debussche X, Lenclume V, Balcou-Debussche M, Alakian D, Sokolowsky C, Ballet D, et al. Characterisation of health literacy strengths and weaknesses among people at metabolic and cardiovascular risk: validity testing of the Health Literacy Questionnaire. SAGE Open Med. 2018;6:2050312118801250. [FREE Full text] [CrossRef] [Medline]


COM-B: capacities, opportunities, motivations-behaviors
SMART: specific, measurable, achievable, relevant, time-bound


Edited by A Schwartz; submitted 28.05.24; peer-reviewed by S Thongchoomsin; comments to author 16.09.24; revised version received 06.11.24; accepted 14.11.24; published 07.02.25.

Copyright

©Dagmar Soleymani, Dominique Pougheon-Bertrand, Rémi Gagnayre. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 07.02.2025.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.