This paper is in the following e-collection/theme issue:

RCTs - Pilots/Feasibility Studies (eHealth) (84) Methods and Feasibility Studies (380) Formative Studies and eHealth/mHealth Development (525) Depression and Mood Disorders; Suicide Prevention (1373) Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1534)

Published on in Vol 11, No 10 (2022): October

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/41445, first published .
Feasibility of Digital Cognitive Behavioral Therapy for Depressed Older Adults With the Moodbuster Platform: Protocol for 2 Pilot Feasibility Studies

Feasibility of Digital Cognitive Behavioral Therapy for Depressed Older Adults With the Moodbuster Platform: Protocol for 2 Pilot Feasibility Studies

Feasibility of Digital Cognitive Behavioral Therapy for Depressed Older Adults With the Moodbuster Platform: Protocol for 2 Pilot Feasibility Studies

Authors of this article:

Khadicha Amarti1, 2 Author Orcid Image ;   Mieke H J Schulte1, 2 Author Orcid Image ;   Annet Kleiboer1, 2 Author Orcid Image ;   Claire Rosalie Van Genugten1, 2 Author Orcid Image ;   Mardien Oudega3, 4 Author Orcid Image ;   Caroline Sonnenberg3, 4 Author Orcid Image ;   Gonçalo C Gonçalves5 Author Orcid Image ;   Artur Rocha5 Author Orcid Image ;   Heleen Riper1, 2, 4, 6, 7 Author Orcid Image
Article Authors Cited by (1) Tweetations (7) Metrics

    Protocol

    1Clinical Psychology Section, Department of Clinical, Neuro- and Developmental Psychology, Vrije Universiteit, Amsterdam, Netherlands

    2Amsterdam Public Health Research Institute, Vrije Universiteit, Amsterdam, Netherlands

    3Amsterdam Universitair Medisch Centrum, Vrije Universiteit, Public Health Research Institute and Neuroscience Amsterdam, Amsterdam, Netherlands

    4Department of Old Age Psychiatry, Geestelijk Gezondheidszorg inGeest Specialized Mental Health Care, Amsterdam, Netherlands

    5Institute for Systems and Computer Engineering, Technology and Science, Porto, Portugal

    6Institute of Telepsychiatry, University of Southern Denmark, Odense, Denmark

    7Faculty of Medicine, University of Turku, Turku, Finland

    Corresponding Author:

    Khadicha Amarti, MSc

    Clinical Psychology Section

    Department of Clinical, Neuro- and Developmental Psychology

    Vrije Universiteit

    De Boelelaan 1117

    Amsterdam, 1081 HV

    Netherlands

    Phone: 31 020 59 83 348

    Email: k.amarti@vu.nl


    Background: Internet-based interventions can be effective in the treatment of depression. However, internet-based interventions for older adults with depression are scarce, and little is known about their feasibility and effectiveness.

    Objective: To present the design of 2 studies aiming to assess the feasibility of internet-based cognitive behavioral treatment for older adults with depression. We will assess the feasibility of an online, guided version of the Moodbuster platform among depressed older adults from the general population as well as the feasibility of a blended format (combining integrated face-to-face sessions and internet-based modules) in a specialized mental health care outpatient clinic.

    Methods: A single-group, pretest-posttest design will be applied in both settings. The primary outcome of the studies will be feasibility in terms of (1) acceptance and satisfaction (measured with the Client Satisfaction Questionnaire-8), (2) usability (measured with the System Usability Scale), and (3) engagement (measured with the Twente Engagement with eHealth Technologies Scale). Secondary outcomes include (1) the severity of depressive symptoms (measured with the 8-item Patient Health Questionnaire depression scale), (2) participant and therapist experience with the digital technology (measured with qualitative interviews), (3) the working alliance between patients and practitioners (from both perspectives; measured with the Working Alliance Inventory–Short Revised questionnaire), (4) the technical alliance between patients and the platform (measured with the Working Alliance Inventory for Online Interventions–Short Form questionnaire), and (5) uptake, in terms of attempted and completed modules. A total of 30 older adults with mild to moderate depressive symptoms (Geriatric Depression Scale 15 score between 5 and 11) will be recruited from the general population. A total of 15 older adults with moderate to severe depressive symptoms (Geriatric Depression Scale 15 score between 8 and 15) will be recruited from a specialized mental health care outpatient clinic. A mixed methods approach combining quantitative and qualitative analyses will be adopted. Both the primary and secondary outcomes will be further explored with individual semistructured interviews and synthesized descriptively. Descriptive statistics (reported as means and SDs) will be used to examine the primary and secondary outcome measures. Within-group depression severity will be analyzed using a 2-tailed, paired-sample t test to investigate differences between time points. The interviews will be recorded and analyzed using thematic analysis.

    Results: The studies were funded in October 2019. Recruitment started in September 2022.

    Conclusions: The results of these pilot studies will show whether this platform is feasible for use by the older adult population in a blended, guided format in the 2 settings and will represent the first exploration of the size of the effect of Moodbuster in terms of decreased depressive symptoms.

    International Registered Report Identifier (IRRID): PRR1-10.2196/41445

    JMIR Res Protoc 2022;11(10):e41445

    doi:10.2196/41445

    Keywords

    iCBT; study protocol; feasibility study; acceptance; satisfaction; usability; engagement; depression severity; older adults 


    Background

    Depression is a common mental disorder that is associated with the substantial loss of a person’s well-being and quality of life [1]. Essential components of depression are depressed mood and loss of interest or pleasure in nearly all activities [2]. Depression constitutes a large and rising proportion of global disease [3] and is a major public health problem [4]. Late-life depression is the third leading contributor to the global burden of disease [5]. Late-life depression can be distinguished from adult depression in several ways. First, depressed older adults may show different or less obvious symptoms than their younger counterparts, and cognitive symptoms (eg, disorientation, memory loss, and distractibility) may be particularly prominent [6]. Cognitive impairment may mask the symptoms of late-life depression, as is often seen in vascular disease, Alzheimer dementia, and Parkinson disease [7]. Second, depression in later life is associated with increased risk of physical and psychological disability, decreased quality of life, and increased costs due to higher health care needs in general [7]. Lastly, depressive symptoms in later life increase the distress of family and friends and the burden of informal caregivers, such as spouses or other family members, which often contributes to social isolation of the older adult with depression [8].

    Late-life depression is often not recognized or treated [6]. This is unfortunate, because treatment of late-life depression is effective, and decreases not only depressive symptoms [4], but also secondary symptoms, such as pain, general functioning, and health-related quality of life [9,10]. Depending on the diagnosed type of depression and the severity of the impairment, a variety of treatment interventions can be considered for older adults, such as psychoeducation, psychotherapy, and antidepressants [11]. Although antidepressants are effective as a treatment option for older adults [12], they can put them at greater risk for adverse events compared to younger adults with depression because of multiple medical comorbidities and drug-drug interactions, and can contribute to polypharmacy, which increases with aging [13]. Psychotherapies such as problem-solving therapy, cognitive behavioral therapy (CBT), and interpersonal psychotherapy are associated with fewer risks and have benefits equal to antidepressants [13]. CBT is an especially well studied [13,14] and effective type of psychotherapy for depression in later life [15,16]. Unfortunately, only a small proportion of older adults seek psychological treatment [17]. Internet-based interventions can help bridge this treatment gap [18].

    Internet-Based CBT

    In recent years, internet-based interventions for the treatment of various common mental disorders, including depression, have been developed and evaluated [19]. These online treatments may overcome barriers that hinder access to face-to-face treatment, such as costs, long waiting lists, limited access to psychological treatment in particular neighborhoods, and the perceived stigma of seeking treatment for a psychiatric disorder [20]. Internet-based CBT (iCBT) provides the same information and teaches similar skills as traditional face-to-face CBT, but does so through the internet with structured materials [21-23]. Additionally, iCBT interventions can be provided in different ways: with therapeutic guidance (ie, guided), without human support related to the therapeutic content (ie, unguided), or in a blended format (ie, integrating online and face-to-face sessions) [24-26]. Ample research has shown that iCBT interventions for depression are effective compared to inactive and active controls. Guided iCBT outperforms unguided interventions, especially among more severely depressed individuals [19,27,28].

    Research into internet-based interventions for older depressed adults is scarce, underlining the need for more research to be able to assess the feasibility and effectiveness of these interventions for this specific group. A study by Spek et al [21] measured the effectiveness of an unguided CBT intervention for older adults (aged between 50 and 60 years) and found that it was at least as effective as face-to-face group CBT in reducing symptoms of depression. Furthermore, a randomized controlled trial (RCT) performed by Titov et al [29] supported the use of therapist-guided iCBT as an evidence-based approach to psychological treatment for older adults (aged between 60 and 76 years) with depression. Despite the fact that older adults are generally positive about internet-based interventions [30], there are hardly any digital interventions for the treatment of depression that specifically target older adults, either within the general population or in specialized mental health care outpatient clinics. Also, with the growing number of older adults in our society, there has been a large rise in the number of patients suffering from depression [31]. Furthermore, older adults are not always able to engage with traditional face-to-face interventions, as they might have limited access to health services due to physical health and constraints or due to limited mobility for other reasons, such as a lack of public transport. The need for innovative and effective digital interventions for older adults is thus a public health priority. Lastly, the study by Spek et al [21] recruited participants from the general population and provided the intervention in an unguided format. We therefore plan to evaluate the feasibility of using the intervention in a specialized mental health care outpatient clinic with a blended format and in the general population with a guided format.

    Aim of the Current Studies

    The 2 current studies aim to evaluate the feasibility of an online treatment platform (Moodbuster) that targets depressive symptoms in older adults (aged at least 55 years) in 2 settings. The first study will test the feasibility of Moodbuster with an online guided treatment format for older adults with mild to moderate depressive symptoms recruited from the general population. The second study will test the intervention in a blended treatment format by integrating face-to-face and online sessions into one treatment protocol. It will target older adults with moderate to severe depression recruited from a specialized mental health care outpatient clinic. The primary aim of both studies is to evaluate the feasibility of the online platform in terms of (1) acceptance and satisfaction, (2) usability, and (3) engagement. Secondary outcomes include depressive symptom severity, participant experience with digital technologies, technical alliance, working alliance, and uptake.


    Study Design

    A single-group, pretest-posttest design will be used in both studies. Assessments will be taken at screening (T–1), at baseline (T0), and postintervention (T1). The intervention will last 8 weeks for the group with mild to moderate depressive symptoms from the general population and 16 to 20 weeks for the group with moderate to severe depressive symptoms from the specialized mental health care outpatient clinic. Written informed consent will be obtained from all participants. Figures 1 and 2 show the participant flow for both studies.

    ‎
    Figure 1. Flowchart of the study design for the group of older adult with mild to moderate depressive symptoms. GDS: Geriatric Depression Scale.
    View this figure
    ‎
    Figure 2. Flowchart of the study design for the group of older adult with moderate to severe depressive symptoms. GDS: Geriatric Depression Scale.
    View this figure

    Participants

    General Population

    Participants with mild to moderate depressive symptoms will be recruited from the general population in the Netherlands. They will be eligible to participate if they (1) are aged at least 55 years, (2) have a Geriatric Depression Scale-15 (GDS-15) score between 5 and 10, (3) are able to work with a computer, and (4) have access to a computer with internet. Candidates will be excluded from the study if they (1) do not have adequate proficiency in the Dutch language or (2) have suicidal thoughts, assessed as having a score of 1 or higher on the 9th item of the Patient Health Questionnaire 9 (PHQ-9) [32]. Having suicidal ideation is considered an exclusion criterion to minimize the risk of an adverse event during the study period.

    Specialized Mental Health Care Service

    Participants with moderate to severe depressive symptoms will be recruited via a specialized mental health care outpatient clinic (Geestelijk gezondheidszorg [GGZ] inGeest, Amsterdam, the Netherlands). Patients who are in treatment at the clinic will be eligible to participate if they (1) are aged at least 55 years, (2) have a GDS-15 score between 8 and 15, (3) are able to work with a computer, and (4) have access to a computer with internet. Candidates will be excluded from the study if they (1) do not have adequate proficiency in the Dutch language or (2) have suicidal thoughts, assessed as having a score of 1 or higher on the 9th item of the PHQ-9 [32]. Having suicidal ideation is considered an exclusion criterion to minimize the risk of an adverse event during the study period.

    Study Intervention: Online Treatment Platform

    Moodbuster 2.0 has been developed and tested in a number of European projects. It is an innovative online and mobile solution for the treatment of adult depression and can be applied for research purposes. The platform has a patient and therapist portal (Figure 3) and can be used in unguided, guided, or blended formats and in different settings [33-35]. For the purpose of these studies, Moodbuster 2.0 has been adapted to meet the needs of depressed older adults. To make Moodbuster more aligned with the target group of older adults, the original Moodbuster modules were adjusted by making the content shorter and more relevant to older adults.

    ‎
    Figure 3. Screenshot of the patient portal of Moodbuster 2.0.
    View this figure

    Moodbuster 2.0 for older adults consists of 7 web-based CBT modules. These modules are aimed at psychoeducation, behavioral activation, cognitive therapy, problem-solving, exercise, sleep, and relapse prevention. The sleep module is a new addition we have made to the platform; it is aimed at older adults, as insomnia and other sleep-related problems are strongly associated with the persistence of depressive symptoms in older adults [1,36-38]. Texts and videos lead the user through the modules, during which exercises are performed and homework assignments are given.

    The online guided treatment for older adults from the general population includes the support of an online coach [39]. Participants receive online CBT over a period of 7 to 8 weeks. The participants are instructed to complete 1 module each week. The psychoeducation module is obligatory. We advise the participants to start with the behavioral activation and cognitive therapy modules. The problem-solving, exercise, sleep, and relapse-prevention modules are optional and are used according to the preferences of the participant. Online support for the guide consists of actively giving the participants feedback for the assignments (at the least after every completed module) using the secure messaging system included in the Moodbuster platform. Furthermore, the guide can answer any questions the participants might have.

    The blended CBT treatment that will be offered to participants with moderate to severe depressive symptoms is based on evidence-based CBT protocols implemented in routine practice [40]. The blended format provides individuals face-to-face sessions and online sessions. Participants receive treatment over a period of 16 to 20 weeks, depending on the intensity of the treatment. The therapist and patient decide together the best way to organize face-to-face sessions and online sessions. For example, they can schedule an online session after each face-to-face session or an online session after 2 face-to-face sessions. The practitioner should provide feedback for the online sessions within the face-to-face sessions.

    Study Procedure

    The participants will be recruited from the 2 target groups and settings simultaneously. Participants with mild to moderate depressive symptoms (as assessed with the GDS-15) [41] will be recruited from the general population via advertisements in digital media and an online recruitment platform, Link2Trials (Link2Trials BV). For this group the following steps will be taken: potential participants can express their interest by filling out a web form, after which they will receive an information letter and a printed informed consent form via postal mail. When the signed informed consent form is received, it will be scanned and safely stored at the department. Participants who sign the consent form will receive a link to the online screening questionnaires (T–1) through a secure electronic data capture (EDC) system and, once found eligible for participation, they will receive a link to the baseline questionnaires (T0) through Castor EDC (Castor Research Inc). Once the baseline questionnaires are completed, another email will be sent with login credentials for accessing the Moodbuster 2.0 platform. Participants are strongly advised to change their password upon the first login. Participants are advised to work through the intervention in 7 to 8 weeks (ie, 1 module per week). After a maximum of 8 weeks of participation, participants will receive another email with a link to another set of questionnaires to acquire posttreatment assessments (T1). After completing the posttreatment assessments, participants will receive an email to thank them for their participation and ask them if they wish to be informed about the study’s results. After filling in the last questionnaire, participants will be reimbursed for their participation with €30 (US $29.41). After the treatment has ended, the participants are invited to fill in an open-field questionnaire to evaluate their experience with Moodbuster.

    Patients with moderate to severe depressive symptoms will be recruited from the patient population of the specialized mental health care outpatient clinic. For this group, the following steps will be taken: patients who express interest during intake with their therapist will receive an information letter and an informed consent form at the end of the session. Patients who sign the consent form will be assessed by their therapist to confirm they have moderate to severe depressive symptoms (as assessed with the GDS-15 [41]). Once found eligible for participation, they will receive a link to the baseline questionnaires (T0) through Castor EDC. Once the baseline questionnaires are completed, another email will be sent with the login credentials for accessing the platform. The GGZ inGeest therapists will aid participants with logging in on the platform the first time they use it. Participants are strongly advised to change their password upon the first login. Also in this step, the practitioners will assist the participants with becoming familiar with the platform and answer any questions they might have. It will also be communicated that participants should contact their therapist if they feel their symptoms are suddenly deteriorating. Participants will use the platform in a blended format. The therapists will be trained on how to use the platform before the participants start the treatment. After 16 to 20 weeks of participation (depending on the duration of the treatment), the participants will receive another email with a link to another set of questionnaires to acquire posttreatment assessments (T1). After completing the posttreatment assessments, the participants will receive an email to thank them for their participation and ask them if they wish to be informed of the study’s results. After the treatment ends, 5 participants will be invited to participate in individual interviews, which will be conducted face-to-face, through videoconferencing, or by telephone, to evaluate their experience with Moodbuster.

    Assessments

    Questionnaires will be completed online for both groups. Data will be collected and managed using Castor EDC. Table 1 provides an overview of the measures employed at specific time points.

    Table 1. Measures at each assessment interval.
    QuestionnairesAimScreening (T-1)Baseline (T0)Posttreatment (T1)
    Screening

    		Geriatric Depression Scale-15Depressive symptoms✓


    		Item 9 of Patient Health Questionnaire-9Suicidal ideation✓

    Feasibility

    		Client Satisfaction Questionnaire-8Acceptability/ satisfaction

    		✓

    		System Usability ScaleaUsability

    		✓

    		Twente Engagement with eHealth Platforms ScaleEngagement
    		✓✓
    Secondary outcome measures

    		Patient Health Questionnaire-8Depressive symptoms
    		✓✓

    		Working Alliance Inventory—Short FormaWorking alliance

    		✓

    		Working Alliance Inventory Technical—Short FormTechnical alliance

    		✓

    		UptakeContinued use

    		✓

    		Digital experiencesGeneral experiences
    		✓

    		Digital Health Literacy InstrumentDigital literacy
    		✓

    aMeasure taken from from participants and practitioners.

    Screening

    Depression Severity

    The GDS-15 [41] will be used as a screener to assess depression severity, with a cutoff between 5 and 10 for the group with mild to moderate depressive symptoms and a cutoff of 11 or higher for the group with moderate to severe depressive symptoms. The GDS-15 has 15 items with the option to respond with yes or no. Total scores range from 0 to 15, with higher scores indicating higher severity of depression. The GDS-15 has been found to be a reliable and valid instrument [42].

    Suicidal Ideation

    Participants will be screened for suicidal ideation using item 9 from the PHQ-9 [32] and excluded. Item 9 of the PHQ-9 asks about thoughts of being better off dead or hurting oneself in some way over the previous 2 weeks. Response options include 0 (“not at all”), 1 (“several days”), 2 (“more than half the days”), or 3 (“nearly every day”). A higher score indicates higher suicidal ideation. Item 9 on the PHQ-9 is a robust predictor of suicide attempts and deaths regardless of age [43].

    Primary Outcome Measures

    Acceptance and Satisfaction

    Acceptance and user satisfaction will be measured with the Client Satisfaction Questionnaire-8 (CSQ-8) for internet-based interventions [44]. The CSQ-8 is composed of eight 4-point Likert-scale items with response options ranging from 1 (“does not apply to me”) to 4 (“applies to me”). Total scores range from 8 to 32, with higher scores indicating higher levels of client satisfaction. Scores between 8 and 13 indicate poor satisfaction, scores between 14 and 19 indicate fair satisfaction, scores between 20 and 25 indicate good satisfaction, and scores between 26 and 32 indicate excellent satisfaction [45]. The CSQ-8 has been found to be a reliable instrument (Cronbach α=.87) [46].

    Usability

    Usability will be measured with the System Usability Scale (SUS), which was developed by Brooke [47], and with logfile analysis. The SUS has ten 5-point Likert-scale items with response options ranging from 0 (“strongly disagree”) to 4 (“strongly agree”). Total scores are converted (by multiplying the total score by 2.5) to a scale ranging from 0 to 100, where higher scores are indicative of higher platform usability. The SUS is considered a reliable instrument (Cronbach α=.90), with scores higher than 70 indicating “good” usability [48,49].

    Engagement

    Engagement with the platform will be measured with the Twente Engagement with eHealth Technologies Scale (TWEETS), developed by Kelder and Kip [50]. The TWEETS is a 9-item self-reported scale that can be used to measure expectations of engagement, current engagement, or past engagement with digital interventions. In the current studies, expected and past engagement will be assessed. The questions are answered on a 5-point Likert scale in which higher scores indicate higher levels of treatment engagement. The total score is derived by summing the scores for each of the 9 items on a 0 to 4 scale and can range from 0 to 40. The TWEETS has shown to be a valid tool that possesses good psychometric qualities to assess engagement with eHealth technologies (Cronbach α=.87) [51].

    Secondary Outcome Measures

    Depression Severity

    Depression severity will be assessed with the Patient Health Questionnaire-8 (PHQ-8) [52]. The PHQ-8 is composed of 8 items with response options ranging from 0 (“not at all”) to 3 (“nearly every day”). Total scores range from 0 to 24, with higher scores indicating higher severity of depression. Scores between 5 and 9 indicate mild depression, scores between 10 and 14 indicate moderate depression, scores between 15 and 19 indicate moderately severe depression, and scores between 20 and 24 indicate severe depression. The PHQ-8 has been found to be a reliable and valid instrument (Cronbach α= 0.82) [52,53].

    Working Alliance

    Working alliance will be measured using the short version of the Working Alliance Inventory–Short Form (WAI-SF) [54] which assesses the therapeutic alliance between the practitioner and participant. The questionnaire covers three dimensions of working alliance: (1) therapeutic goals, (2) tasks, and (3) bond. The WAI-SF for patients has 12 items with responses on a 5-point Likert scale, ranging from 1 (“never or rarely”) to 5 (“very often”). The WAI-SF for therapists has 10 items with responses on a 5-point Likert scale ranging from 1 (“never”) to 5 (“always”). The WAI-SF has been found to be a reliable and valid instrument for both patients and therapists (Cronbach α=.86 and α=.88, respectively) [54,55].

    Technical Alliance

    Technical alliance will be measured with the Dutch Working Alliance Inventory for Online Interventions-Short Form (WAI-TECH-SF) [56]. This questionnaire assesses the therapeutic alliance between participant and online platform. The questionnaire was designed to cover three dimensions: (1) therapeutic goals, (2) tasks, and (3) bond. The WAI-TECH-SF has 12 items with responses rated on a 7-point Likert scale, ranging from 1 (“never”) to 7 (“always”). The total score ranges from 12 to 84, with higher scores indicating a better technical alliance. The WAI-TECH-SF has been found to be a reliable instrument (Cronbach α=.97) [56].

    Uptake

    Uptake refers to the degree to which a participant engages with the content of the intervention by using or not using [57] the intervention, in this case the Moodbuster 2.0 iCBT or blended CBT. This will be measured with a logfile analysis. This analysis measures logins, time spent on the platform, and number of modules attempted and completed [58]. Additionally, for the blended CBT intervention this will be measured with feedback from the therapist on the number of face-to-face sessions attended and the number of messages sent to the participants.

    Participant Experiences

    Participants’ experiences with the platform will also be explored by means of semistructured interviews. This is to gain a better understanding of participants’ satisfaction with the use of Moodbuster. Qualitative interviews allow the participants more freedom in how to respond [59]. These interviews will focus on issues such as personal experiences with the platform, self-management strategies used by the participants, and contacts between participants and practitioners or guides. For the group with mild to moderate depressive symptoms (ie, the guided group) this will be done by means of an open-ended questionnaire after the last session. For the group with moderate to severe depressive symptoms (ie, the blended therapy group) this will be done by means of a number of individual interviews. The interviews will be conducted by telephone, by video conferencing, or be face-to-face, depending on the preferences of the participant.

    Other Measures

    Demographic Information

    Demographic information will include age, sex (as assigned at birth), living situation, educational level, relationship status, daytime activities, and whether a participant has children.

    Digital Literacy

    Digital literacy is operationalized as the degree of a person’s knowledge, comfort, and perceived skills on a digital instrument such as a computer. Digital literacy will be measured using 2 subscales of the Digital Health Literacy Instrument (DHLI), developed by van der Vaart and Drossaert [60]. The 2 subscales of the DHLI that will be used are “operational skills” and “adding content.” The operational skills subscale is composed of 3 items, with response options ranging from 1 (“very easy”) to 4 (“very hard”). Total scores range from 3 to 9, with higher scores indicating a lower degree of operational skills with digital technology. The operational skills subscale has been found to be reliable (Cronbach α=.77) [60]. The adding content subscale is composed of 3 items, with response options ranging from 1 (“very easy”) to 4 (“very hard”). Total scores range from 3 to 9, with higher scores indicating a lower degree of ability to add content on a digital tool. The adding content subscale has been found to be reliable (Cronbach α=.89) [60].

    Sample Size

    Calculating the sample size for a pilot study is not standardized. Sample size can range from 15 to 100 participants and depends on the aim of the study [61]. Some studies recommend at least 12 participants [62] and other studies recommend 30 or more participants [63]. The target group from the general population is characterized by variation in both age and the nature of depressive symptoms. We will therefore recruit 30 participants from the general population. We will recruit patients receiving specialized mental health care from a smaller pool (only patients at GGZ inGeest); this population is also characterized by more severe depressive symptoms, and it will require more time to complete recruitment. Given the time frame for recruitment, we will therefore recruit 15 participants.

    Statistical Analysis

    When the data collection is completed, the data will be cleaned and assessed for accuracy. The data from participants from the general population will be analyzed separately from the data from the participants that are recruited from the specialized mental health care outpatient clinic.

    Feasibility Parameters

    Quantitative analysis will be conducted using SPSS (version 25; IBM Corp). The primary outcomes will only be assessed after the completion of the interventions (T1). Descriptive statistics (reported as means and SDs) will be calculated to examine and summarize the acceptance and satisfaction of the participants, system usability, and participant engagement with the platform.

    Secondary and Other Study Parameters

    Descriptive statistics will be also used to assess the working alliance, technical alliance, and the participants’ use of the intervention (ie, uptake). To investigate baseline differences between participants who complete the studies and those who drop out, a 2-tailed, independent-sample t test or a Mann-Whitney U test will be used. The within-group secondary outcome of depressive severity at posttreatment will be inspected for outliers and a normal distribution. For each group, the change in depression severity pre- and postintervention will be analyzed using a 2-tailed, paired-sample t test with a significance level of α<.05. Effect size will be measured using Hedges g, and will be interpreted as follows: small (0.2), medium (0.5), and high (0.8) [64].

    Qualitative Interviews

    The interviews and questionnaires will be analyzed using thematic analysis [65]. Thematic analysis is an accessible and flexible method of qualitative data analysis. It identifies and categorizes themes captured in a study. These themes are then coded and organized into meaningful themes. Lastly, interpretative analyses are conducted.

    Data Management

    All raw data will be collected and managed using Castor EDC. Paper-based documents (such as signed informed consent forms) will be stored in a keycard-secured archive at the Department of Clinical, Neuro- and Developmental Psychology, Vrije Universiteit Amsterdam. All participants will receive a random study participant code. In the studies, participants will be referred to exclusively by that participant code, and the document linking the numbers will be destroyed once the studies are completed and the results have been disseminated. FAIR (Findability, Accessibility, Interoperability and Reusability) principles of data management will be applied. After data collection is completed, data will be kept in a repository (DarkStor) that serves as an offline archive for storing sensitive information and data.

    Ethics Approval

    Ethics approval was granted by the University Medical Centre, Amsterdam (2021.0435).


    Study enrollment started in September 2022. The studies were funded in October 2019 by ZorgOnderzoek Nederland–Medische Wetenschappen (ZonMw). Few studies have studied the acceptability, satisfaction, usability, and engagement of iCBT in a guided and blended format for older adults. In our pilot studies, we expect that iCBT in a guided and blended format will prove acceptable and usable by older adults with depressive symptoms. Furthermore, we expect that symptoms of depression will decrease after following the online (guided or blended) treatment. According to the CONSORT (Consolidated Standards of Reporting Trials) guidelines [66] for reporting of feasibility studies, each objective result will be outlined, including expressions of uncertainty and estimations. Furthermore, the results of any other analysis we perform that could be of use for a future definitive trial will be reported. The manuscript will be submitted to the appropriate journals for dissemination after the final data are analyzed.


    Principal Findings

    The results of these pilot studies will show whether Moodbuster, an online depression treatment platform, is feasible for use by older adults in 2 study settings. We will measure (1) acceptance and satisfaction with the platform, (2) usability of the platform, and (3) engagement with the platform. The treatment will be evaluated in 2 target groups with 2 formats: (1) participants with mild to moderate depressive symptoms in the general population, who will use a guided format, and (2) participants with moderate to severe depressive symptoms at a specialized mental health care outpatient clinic, who will use a blended format. In these pilot studies, a possible main finding could be that older adults will find that online treatment and the use of technology are acceptable. Furthermore, we expect that the platform will be usable by the participants, as well as by the therapists and guides. Lastly, we expect that the participants will be engaged with the platform. iCBT interventions have been widely studied and have been proven effective for a variety of common mental health disorders, including depression [27,28]. Little is yet known as to whether older adults are more or less likely to benefit from internet-based interventions compared to their younger counterparts, as there are very few interventions and RCTs specifically aimed at studying iCBT interventions for older adults. This underlines the need for more research to be able to assess the feasibility and effectiveness of these interventions for this specific group.

    Strengths and Limitations

    This pilot study is a first step in the development and evaluation of a digital intervention for older adults. This approach avoids wasting resources and placing unnecessary burdens on participants, because feasibility issues will be identified and addressed prior to the main RCT. Furthermore, this study will be the first empirical study of older adults in 2 settings and in 2 different groups. We have assessed the power of our sample size according to the recommendations and guidelines for conducting pilot studies found in the existing literature. However, it might prove to be the case that our sample size is too limited, which might influence the results we obtain.

    Future Directions

    Given the limited number of studies on this topic, more research is needed to demonstrate the possibilities of online mental health care for older adults with depression in unguided, guided, and blended settings. The results of this study may provide valuable information on next steps, such as an RCT for testing the clinical effectiveness and cost-effectiveness of iCBT for depressed older adults, and may potentially lead the way to its future implementation in routine care.

    Acknowledgments

    This study was funded by ZorgOnderzoek Nederland–Medische Wetenschappen (ZonMw) (73500095005). The funder had and has no role in the intervention development; study design; collection, management, analysis, or interpretation of the data; writing of the report; or the decision to submit the report for publication. The authors would like to express their sincere thanks to Mr. Tjerk Zweers for his help with designing the recruitment material and website.

    Data Availability

    The data sets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

    Authors' Contributions

    KA is the principal investigator and pilot coordinator. KA adjusted the intervention. KA, MHJS, AK, and HR designed the study.

    Conflicts of Interest

    None declared.

    1. Cuijpers RC, Reynolds CF. Increasing the impact of prevention of depression-new opportunities. JAMA Psychiatry 2022 Jan 01;79(1):11-12. [CrossRef] [Medline]
    2. Guajardo VD, Souza BP, Henriques SG, Lucia MC, Menezes PR, Martins MA, et al. Loss of interest, depressed mood and impact on the quality of life: cross-sectional survey. BMC Public Health 2011 Oct 25;11:826 [FREE Full text] [CrossRef] [Medline]
    3. Volkert J, Schulz H, Härter M, Wlodarczyk O, Andreas S. The prevalence of mental disorders in older people in Western countries - a meta-analysis. Ageing Res Rev 2013 Jan;12(1):339-353. [CrossRef] [Medline]
    4. Snowden M, Steinman L, Frederick J. Treating depression in older adults: challenges to implementing the recommendations of an expert panel. Prev Chronic Dis 2008 Jan;5(1):A26 [FREE Full text] [Medline]
    5. Clignet F, van Meijel B, van Straten A, Cuijpers P. A qualitative evaluation of an inpatient nursing intervention for depressed elderly: the systematic activation method. Perspect Psychiatr Care 2017 Oct;53(4):280-288. [CrossRef] [Medline]
    6. Aldrich N. CDC promotes public health approach to address depression among older adults. Centers for Disease Control and Prevention.   URL: https://www.cdc.gov/aging/pdf/cib_mental_health.pdf [accessed 2022-06-18]
    7. Wright PP, Thorpe CW. Triple threat among the elderly: depression, suicide risk, and handguns. J Emerg Nurs 2016 Jan;42(1):14-18. [CrossRef] [Medline]
    8. Widera EW, Block SD. Managing grief and depression at the end of life. Am Fam Physician 2012 Aug 01;86(3):259-264 [FREE Full text] [Medline]
    9. Lin EHB, Katon W, Von Korff M, Tang L, Williams JW, Kroenke K, IMPACT Investigators. Effect of improving depression care on pain and functional outcomes among older adults with arthritis: a randomized controlled trial. JAMA 2003 Nov 12;290(18):2428-2429. [CrossRef] [Medline]
    10. Frederick JT, Steinman LE, Prohaska T, Satariano WA, Bruce M, Bryant L, Late Life Depression Special Interest Project Panelists. Community-based treatment of late life depression an expert panel-informed literature review. Am J Prev Med 2007 Sep;33(3):222-249. [CrossRef] [Medline]
    11. Espinoza R, Kaufman AH. Diagnosis and treatment of late life depression. Psychiatr Times 2014;31(10):18 [FREE Full text]
    12. Haigh EAP, Bogucki OE, Sigmon ST, Blazer DG. Depression among older adults: a 20-year update on five common myths and misconceptions. Am J Geriatr Psychiatry 2018 Jan;26(1):107-122. [CrossRef] [Medline]
    13. Kok RM, Reynolds CF. Management of depression in older adults: a review. JAMA 2017 May 23;317(20):2114-2122. [CrossRef] [Medline]
    14. Cuijpers P, Berking M, Andersson G, Quigley L, Kleiboer A, Dobson KS. A meta-analysis of cognitive-behavioural therapy for adult depression, alone and in comparison with other treatments. Can J Psychiatry 2013 Jul;58(7):376-385. [CrossRef] [Medline]
    15. Dafsari FS, Bewernick B, Biewer M, Christ H, Domschke K, Froelich L, et al. Cognitive behavioural therapy for the treatment of late life depression: study protocol of a multicentre, randomized, observer-blinded, controlled trial (CBTlate). BMC Psychiatry 2019 Dec 27;19(1):423 [FREE Full text] [CrossRef] [Medline]
    16. Cuijpers P, van Straten A, Smit F. Psychological treatment of late-life depression: a meta-analysis of randomized controlled trials. Int J Geriatr Psychiatry 2006 Dec;21(12):1139-1149. [CrossRef] [Medline]
    17. Byers AL, Arean PA, Yaffe K. Low use of mental health services among older Americans with mood and anxiety disorders. Psychiatr Serv 2012 Jan;63(1):66-72 [FREE Full text] [CrossRef] [Medline]
    18. Dworschak C, Heim E, Maercker A. Efficacy of internet-based interventions for common mental disorder symptoms and psychosocial problems in older adults: A systematic review and meta-analysis. Internet Interv 2022 Mar;27:100498 [FREE Full text] [CrossRef] [Medline]
    19. Karyotaki E, Efthimiou O, Miguel C, Bermpohl FMG, Furukawa TA, Cuijpers P, Individual Patient Data Meta-Analyses for Depression (IPDMA-DE) Collaboration, et al. Internet-based cognitive behavioral therapy for depression: a systematic review and individual patient data network meta-analysis. JAMA Psychiatry 2021 Apr 01;78(4):361-371 [FREE Full text] [CrossRef] [Medline]
    20. Webb CA, Rosso IM, Rauch SL. Internet-based cognitive-behavioral therapy for depression: current progress and future directions. Harv Rev Psychiatry 2017;25(3):114-122 [FREE Full text] [CrossRef] [Medline]
    21. Spek V, Nyklícek I, Smits N, Cuijpers P, Riper H, Keyzer J, et al. Internet-based cognitive behavioural therapy for subthreshold depression in people over 50 years old: a randomized controlled clinical trial. Psychol Med 2007 Dec;37(12):1797-1806. [CrossRef] [Medline]
    22. Riper H, Andersson G, Christensen H, Cuijpers P, Lange A, Eysenbach G. Theme issue on e-mental health: a growing field in internet research. J Med Internet Res 2010 Dec 19;12(5):e74 [FREE Full text] [CrossRef] [Medline]
    23. Cuijpers P, Kleiboer A, Karyotaki E, Riper H. Internet and mobile interventions for depression: opportunities and challenges. Depress Anxiety 2017 Jul;34(7):596-602. [CrossRef] [Medline]
    24. Rasing SPA, Stikkelbroek YAJ, Bodden DHM. Is digital treatment the holy grail? literature review on computerized and blended treatment for depressive disorders in youth. Int J Environ Res Public Health 2019 Dec 24;17(1):153 [FREE Full text] [CrossRef] [Medline]
    25. Romijn G, Batelaan N, Koning J, van Balkom A, de Leeuw A, Benning F, et al. Acceptability, effectiveness and cost-effectiveness of blended cognitive-behavioural therapy (bCBT) versus face-to-face CBT (ftfCBT) for anxiety disorders in specialised mental health care: A 15-week randomised controlled trial with 1-year follow-up. PLoS One 2021;16(11):e0259493 [FREE Full text] [CrossRef] [Medline]
    26. Riper H, Cuijpers P. Telepsychology and eHealth. In: Norcross JC, Van den Bos GR, Freedheim DK, Jrishnamurthy R, editors. APA Handbook of Clinical Psychology: Applications and Methods. Washington, DC: American Psychological Association; 2016:451-463.
    27. Karyotaki E, Ebert DD, Donkin L, Riper H, Twisk J, Burger S, et al. Do guided internet-based interventions result in clinically relevant changes for patients with depression? An individual participant data meta-analysis. Clin Psychol Rev 2018 Jul;63:80-92. [CrossRef] [Medline]
    28. Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther 2018 Jan;47(1):1-18. [CrossRef] [Medline]
    29. Titov N, Dear BF, Ali S, Zou JB, Lorian CN, Johnston L, et al. Clinical and cost-effectiveness of therapist-guided internet-delivered cognitive behavior therapy for older adults with symptoms of depression: a randomized controlled trial. Behav Ther 2015 Mar;46(2):193-205. [CrossRef] [Medline]
    30. McMurchie W, Macleod F, Power K, Laidlaw K, Prentice N. Computerised cognitive behavioural therapy for depression and anxiety with older people: a pilot study to examine patient acceptability and treatment outcome. Int J Geriatr Psychiatry 2013 Nov;28(11):1147-1156. [CrossRef] [Medline]
    31. Andreas S, Schulz H, Volkert J, Dehoust M, Sehner S, Suling A, et al. Prevalence of mental disorders in elderly people: the European MentDis_ICF65+ study. Br J Psychiatry 2017 Feb;210(2):125-131. [CrossRef] [Medline]
    32. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001 Sep;16(9):606-613 [FREE Full text] [CrossRef] [Medline]
    33. Warmerdam L, Riper H, Klein M, van den Ven P, Rocha A, Ricardo Henriques M, et al. Innovative ICT solutions to improve treatment outcomes for depression: the ICT4Depression project. Stud Health Technol Inform 2012;181:339-343. [Medline]
    34. Kleiboer A, Smit J, Bosmans J, Ruwaard J, Andersson G, Topooco N, et al. European comparative effectiveness research on blended depression treatment versus treatment-as-usual (E-COMPARED): study protocol for a randomized controlled, non-inferiority trial in eight European countries. Trials 2016 Aug 03;17(1):387 [FREE Full text] [CrossRef] [Medline]
    35. Riper H. Digital Framework for E-health Research. Differ Foundation.   URL: https://differ.science [accessed 2022-10-09]
    36. Peng Y, Hsu Y, Chou M, Chu C, Su C, Liang C, et al. Factors associated with insomnia in older adult outpatients vary by gender: a cross-sectional study. BMC Geriatr 2021 Dec 07;21(1):681 [FREE Full text] [CrossRef] [Medline]
    37. Irwin MR, Carrillo C, Sadeghi N, Bjurstrom MF, Breen EC, Olmstead R. Prevention of incident and recurrent major depression in older adults with insomnia: a randomized clinical trial. JAMA Psychiatry 2022 Jan 01;79(1):33-41 [FREE Full text] [CrossRef] [Medline]
    38. van Straten A, Lancee J. Digital cognitive behavioural therapy for insomnia: the answer to a major public health issue? Lancet Digit Health 2020 Aug;2(8):e381-e382 [FREE Full text] [CrossRef] [Medline]
    39. Kleiboer A, Donker T, Seekles W, van Straten A, Riper H, Cuijpers P. A randomized controlled trial on the role of support in internet-based problem solving therapy for depression and anxiety. Behav Res Ther 2015 Sep;72:63-71. [CrossRef] [Medline]
    40. Kooistra LC, Wiersma JE, Ruwaard J, Neijenhuijs K, Lokkerbol J, van Oppen P, et al. Cost and effectiveness of blended versus standard cognitive behavioral therapy for outpatients with depression in routine specialized mental health care: pilot randomized controlled trial. J Med Internet Res 2019 Oct 29;21(10):e14261 [FREE Full text] [CrossRef] [Medline]
    41. van Marwijk HW, Wallace P, de Bock GH, Hermans J, Kaptein AA, Mulder JD. Evaluation of the feasibility, reliability and diagnostic value of shortened versions of the geriatric depression scale. Br J Gen Pract 1995 Apr;45(393):195-199 [FREE Full text] [Medline]
    42. Pocklington C, Gilbody S, Manea L, McMillan D. The diagnostic accuracy of brief versions of the Geriatric Depression Scale: a systematic review and meta-analysis. Int J Geriatr Psychiatry 2016 Aug;31(8):837-857. [CrossRef] [Medline]
    43. Rossom RC, Coleman KJ, Ahmedani BK, Beck A, Johnson E, Oliver M, et al. Suicidal ideation reported on the PHQ9 and risk of suicidal behavior across age groups. J Affect Disord 2017 Jun;215:77-84 [FREE Full text] [CrossRef] [Medline]
    44. Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD. Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann 1979;2(3):197-207. [CrossRef] [Medline]
    45. Smith D, Roche E, O'Loughlin K, Brennan D, Madigan K, Lyne J, et al. Satisfaction with services following voluntary and involuntary admission. J Ment Health 2014 Feb 31;23(1):38-45. [CrossRef] [Medline]
    46. Boß L, Lehr D, Reis D, Vis C, Riper H, Berking M, et al. Reliability and validity of assessing user satisfaction with web-based health interventions. J Med Internet Res 2016 Aug 31;18(8):e234 [FREE Full text] [CrossRef] [Medline]
    47. Brooke J. SUS: A 'Quick and Dirty' Usability Scale. In: Usability Evaluation In Industry. Boca Raton, FL: CRC Press; 1996:4.
    48. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the System Usability Scale. Int J Hum Comput Interact 2008 Jul 30;24(6):574-594. [CrossRef]
    49. Lewis JR, Brown J, Mayes DK. Psychometric evaluation of the EMO and the SUS in the context of a large-sample unmoderated usability study. Int J Hum Comput Interact 2015 Jun 25;31(8):545-553. [CrossRef]
    50. Kelders S, Kip H. Development and initial validation of a scale to measure engagement with eHealth technologies. In: CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 2019 Presented at: Conference on Human Factors in Computing Systems; May 4-9, 2019; Glasgow, Scotland p. 1-6. [CrossRef]
    51. Kelders SM, Kip H, Greeff J. Psychometric evaluation of the TWente Engagement with Ehealth Technologies Scale (TWEETS): evaluation study. J Med Internet Res 2020 Oct 09;22(10):e17757 [FREE Full text] [CrossRef] [Medline]
    52. Kroenke K, Strine TW, Spitzer RL, Williams JBW, Berry JT, Mokdad AH. The PHQ-8 as a measure of current depression in the general population. J Affect Disord 2009 Apr;114(1-3):163-173. [CrossRef] [Medline]
    53. Pressler SJ, Subramanian U, Perkins SM, Gradus-Pizlo I, Kareken D, Kim J, et al. Measuring depressive symptoms in heart failure: validity and reliability of the patient health questionnaire-8. Am J Crit Care 2011 Mar;20(2):146-152. [CrossRef] [Medline]
    54. Hatcher RL, Gillaspy JA. Development and validation of a revised short version of the Working Alliance Inventory. Psychother Res 2006 Jan;16(1):12-25. [CrossRef]
    55. Kooistra L, Ruwaard J, Wiersma J, van Oppen P, Riper H. Working alliance in blended versus face-to-face cognitive behavioral treatment for patients with depression in specialized mental health care. J Clin Med 2020 Jan 27;9(2):347 [FREE Full text] [CrossRef] [Medline]
    56. Herrero R, Vara MD, Miragall M, Botella C, García-Palacios A, Riper H, et al. Working Alliance Inventory for Online Interventions-Short Form (WAI-TECH-SF): the role of the therapeutic alliance between patient and online program in therapeutic outcomes. Int J Environ Res Public Health 2020 Aug 25;17(17):6169 [FREE Full text] [CrossRef] [Medline]
    57. Lillevoll KR, Vangberg HCB, Griffiths KM, Waterloo K, Eisemann MR. Uptake and adherence of a self-directed internet-based mental health intervention with tailored e-mail reminders in senior high schools in Norway. BMC Psychiatry 2014 Jan 21;14:14 [FREE Full text] [CrossRef] [Medline]
    58. Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res 2009 Apr 24;11(2):e13 [FREE Full text] [CrossRef] [Medline]
    59. Edwards R, Holland J. What is Qualitative Interviewing?. London, UK: Bloomsbury Academic; 2013.
    60. van der Vaart R, Drossaert C. Development of the Digital Health Literacy Instrument: measuring a broad spectrum of health 1.0 and health 2.0 skills. J Med Internet Res 2017 Jan 24;19(1):e27 [FREE Full text] [CrossRef] [Medline]
    61. Hertzog MA. Considerations in determining sample size for pilot studies. Res Nurs Health 2008 Apr;31(2):180-191. [CrossRef] [Medline]
    62. Julious SA. Sample size of 12 per group rule of thumb for a pilot study. Pharmaceut Statist 2005 Oct;4(4):287-291. [CrossRef]
    63. Lancaster GA, Dodd S, Williamson PR. Design and analysis of pilot studies: recommendations for good practice. J Eval Clin Pract 2004 May;10(2):307-312. [CrossRef] [Medline]
    64. Cohen J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed. New York, NY: Lawrence Erlbaum Associates; 1988.
    65. Clarke V, Braun V. Thematic analysis. J Posit Psychol 2016 Dec 09;12(3):297-298. [CrossRef]
    66. Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMC Med 2010 Mar 24;8:18 [FREE Full text] [CrossRef] [Medline]

    ‎
    CBT: cognitive behavioral therapy
    CSQ-8: Client Satisfaction Questionnaire-8
    DHLI: Digital Health Literacy Inventory
    EDC: electronic data capture
    GDS: Geriatric Depression Scale
    GGZ inGeest: Geestelijk Gezondheidszorg inGeest
    iCBT: internet cognitive behavioral therapy
    PHQ-8: Patient Health Questionnaire-8
    PHQ-9: Patient Health Questionnaire-9
    RCT: randomized controlled trial
    SUS: System Usability Scale
    TWEETS: Twente Engagement with eHealth Technologies Scale
    WAI-SF: Working Alliance Inventory–Short Form
    WAI-TECH-SF: Working Alliance Inventory for Online Interventions–Short Form
    ZonMw: ZorgOnderzoek Nederland–Medische Wetenschappen

    Edited by G Eysenbach, T Leung; submitted 26.07.22; peer-reviewed by K Uludag; comments to author 24.08.22; revised version received 30.09.22; accepted 30.09.22; published 25.10.22

    Copyright

    ©Khadicha Amarti, Mieke H J Schulte, Annet Kleiboer, Claire Rosalie Van Genugten, Mardien Oudega, Caroline Sonnenberg, Gonçalo C Gonçalves, Artur Rocha, Heleen Riper. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 25.10.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.