Protocol
Abstract
Background: There is a substantial need for youth electronic mental health (e-mental health) services. In addressing this need, our team has developed a novel moderated online social therapy intervention called enhanced moderated online social therapy (MOST+). MOST+ integrates real-time, clinician-delivered Web chat counseling, interactive user-directed online therapy, expert and peer moderation, and private and secure peer-to-peer social networking. MOST+ has been designed to give young people immediate, 24-hour access to anonymous, evidence-based, and short-term mental health care.
Objective: The primary aims of this pilot study were to determine the feasibility, acceptability, and safety of the intervention. Secondary aims were to assess prepost changes in key psychosocial outcomes and collect qualitative data for future intervention refinement.
Methods: MOST+ will be embedded within eheadspace, an Australian youth e-mental health service, and will be evaluated via an uncontrolled single-group study. Approximately 250 help-seeking young people (16-25 years) will be progressively recruited to the intervention from the eheadspace home page over the first 4 weeks of an 8-week intervention period. All participants will have access to evidence-based therapeutic content and integrated Web chat counseling. Additional access to moderated peer-to-peer social networking will be granted to individuals for whom it is deemed safe and appropriate, through a three-tiered screening process. Participants will be enrolled in the MOST+ intervention for 1 week, with the option to renew their enrollment across the duration of the pilot. Participants will complete a survey at enrollment to assess psychological well-being and other mental health outcomes. Additional assessment will occur following account deactivation (ie, after participant has opted not to renew their enrollment, or at trial conclusion) and will include an online survey and telephone interview assessing psychological well-being and experience of using MOST+.
Results: Recruitment for the study commenced in October 2017. We expect to have initial results in March 2018, with more detailed qualitative and quantitative analyses to follow.
Conclusions: This is the first Australia-wide research trial to pilot an online social media platform merging real-time clinical support, expert and peer moderation, interactive online therapy, and peer-to-peer social networking. The importance of the project stems from the need to develop innovative new models for the efficient delivery of responsive evidence-based online support to help-seeking young people. If successful, this research stands to complement and enhance e-mental health services in Australia.
doi:10.2196/resprot.8813
Keywords
Introduction
Relative to the burden of disease, engagement rates with mental health services fall disappointingly below those for physical ill health [
]. This is especially true for young people aged 16 to 25 years—a period known for the peak onset of high prevalence and severe mental disorders such as depression and anxiety [ ]. Given young people’s enthusiasm for Web-based communication, the development of innovative, online psychosocial interventions may assist to improve treatment acceptability and access for young people experiencing mental ill health [ ]. Furthermore, social networking sites are rapidly becoming an essential avenue for social communication and support [ ] and are likely to be pivotal to youth engagement with mental health services [ ].Mobile and digital technologies are developing at a phenomenal rate and hold great promise for influencing and transforming treatment delivery for emerging mental health conditions [
]. These technologies can be particularly useful for young people, as individuals under 25 years are by far the greatest users of internet resources [ ]. For instance, over 95% of young Australians use the internet daily, and 97% have access to mobile phones, most of which are internet-enabled [ ].Although young people tend to nominate face-to-face support as their preferred mode of help-seeking for depression [
], a significant number indicate preference for online intervention because of the added anonymity and immediacy associated with the online environment [ ]. Given their ability to transcend geographical boundaries and provide 24-hour accessibility, online interventions have the added potential to reach young people who may not be able or inclined to seek help from traditional sources [ , ].In recent years, a range of online interventions have been successfully trialed for the management of a number of mental disorders, with research supporting the efficacy of these interventions in alleviating anxiety and depressive symptoms [
- ]. Online interventions have been reported as being as effective as face-to-face therapy [ ], and a number of countries now recommend the use of online interventions within clinical guidelines for the treatment of high prevalence mental disorders such as depression [ ].At present, electronic mental health (e-mental health) services provide either nonclinical peer-to-peer support or clinical support or online therapy with no integrated online social networking and peer support or moderation [
- ]. In 2011, Australia’s headspace—National Youth Mental Health Foundation (headspace) began providing an e-mental health service (eheadspace) to extend the enhanced primary care services that had been provided through headspace centers across Australia since 2006 [ ]. The headspace centers provide youth-friendly and low-stigma access to mental health care and have been effective in improving the mental health outcomes of those who access their services [ ]. The eheadspace service delivers online chat, email, and telephone counseling provided by qualified clinicians at no cost to the young person in an effort to support young Australians who are unable or disinclined to seek professional support in person [ ]. The eheadspace service is very popular among young Australians with over 25,000 clinical contacts per year across the country. Given the high demand and acceptability of this service, the next generation of eheadspace could harness the potential of Web 2.0 by fully integrating online professional support with high-quality, engaging, user-directed therapy and peer-to-peer social networking capability. These innovations have the potential to cater for the needs and preferences of more young people and provide a 24/7 therapeutic environment that extends beyond 1:1 clinical support to enable its scalability.We have pioneered a new model of online behavioral interventions entitled Moderated Online Social Therapy (MOST) [
- ]. The MOST model integrates (1) Peer-to-peer online social networking, (2) Individually tailored interactive psychosocial interventions focused on using and developing self-identified strengths, and (3) Involvement of expert mental health and peer moderators to ensure the safety of the intervention. This model has been successfully piloted with young people experiencing first episode psychosis (the Horyzons study [ ]) and major depression (the Rebound study [ , ]), as well as with carers of young people recovering from a first episode of psychosis (the Altitudes study [ ]) and diagnosed with anxiety or depression (the Meridian study [ ]).To meet the specific needs of young people accessing eheadspace services, the MOST model has been upgraded to integrate Web chat services provided by eheadspace within a secure online social media environment. Referred to as MOST+, this enhanced moderated online social therapy model offers short-term interventions that capitalize on anonymity, social networking, and the broad availability and comparative low cost of social media–based interventions. By supplementing Web chat and telephone services with a wider array of online support, MOST+ stands to offer young people access to multiple modes of therapy, catering to the needs of different individuals.
Primary aims of the MOST+ pilot (Trial Registration: ACTRN12617000370303) were to determine the feasibility, acceptability, and safety of the intervention for young people aged 16 to 25 years who have accessed eheadspace services for mental health support. A secondary aim of the project was to assess changes in key psychosocial outcomes (ie, psychological distress, functional impairment, satisfaction with life, mental well-being, social support and isolation, and strengths use and knowledge) from the point of engagement to post intervention.
Methods
Study Design and Setting
In this single-group prepost pilot, the MOST+ intervention is embedded within existing eheadspace services. eheadspace is a national, federally funded e-mental health service for young Australians. eheadspace provides a youth-friendly, confidential, and free internet-based mental health support and information service. The eheadspace service is professionally staffed by qualified and supervised clinicians offering synchronous Web chat, email support, and telephone-based mental health intervention to young people aged 12 to 25 years Australia-wide. Clinicians working within the MOST+ platform will be based at the eheadspace operation center. They will be allied health professionals (eg, clinical and generalist psychologists, social workers, occupational therapists, and mental health nurses) who have specialist training and experience in the delivery of e-mental health support to young people in distress. Approximately 20 eheadspace clinicians will be trained for the MOST+ study, with two or three clinicians rostered on to provide support via MOST+ per day.
Ethics, Consent, and Permissions
Research ethics approval for the MOST+ pilot was provided by the University of Melbourne Human Research Ethics Committee; Ethics ID: 1545798. All participants will be required to provide informed online consent.
Participants
Inclusion criteria for participants will reflect the real world clinical characteristics of young people accessing e-mental health support, that is, (1) Help-seeking young people with concerns about their own mental health, (2) Age of 16 to 25 years inclusive, and (3) Ability to give informed consent and comply with study procedures. By the age of 16 years, young people in Australia are considered able to make independent decisions regarding their health care [
]. An age range of 16 to 25 years reflects the agency of young people to make their own health service choices, while ensuring the age appropriateness of the therapeutic material and social networking features of the MOST+ platform. Existing eheadspace clients meeting these criteria will be eligible to use the MOST+ intervention.Consistent with current eheadspace practice, participants will not be excluded from the study on the basis of clinical characteristics. However, the following exclusions will apply for access to the social networking component of the intervention: (1) acute risk of self-harm requiring urgent intervention (ie, suicidal ideation with a current plan and intent to enact this plan) indicated by a young person in Web chat or by endorsing screening questions 7 and 8 in the registration survey; (2) an eheadspace clinician, in consultation with a supervisor, deems participation in the MOST+ social network likely to interfere with appropriate clinical management of mental health symptoms (eg, psychosis) or increase risk of harm to self or others (see
); and (3) inability to confirm age and conduct induction via research assistant (RA) telephone contact.Recruitment
Participants will be progressively recruited into the study, via an opt-in process, at point of entry to eheadspace through a link on the home page [
]. This link will be active during times when eheadspace clinicians are available on the MOST+ platform (ie, 4 PM to midnight Australia Eastern Daylight Time). Given high monthly eheadspace Web chat traffic (ie, >1000 new users aged 16-25 years), a recruitment period of approximately 4 weeks is considered adequate to ensure that the target of 250 participants is achieved. The availability of MOST+ will be highlighted on the eheadspace home page throughout the recruitment period. Study information will indicate beneficial features associated with the intervention (ie, instant access to specifically designed therapy content, potential access to social or emotional support from other help-seeking young people, clinicians, and peer moderators via the social network).Intervention
Participants will use MOST+, an interactive, purpose built online platform designed to deliver responsive evidence-based support to help-seeking young people. The intervention is designed to better meet the increasing demand for youth e-mental health support and is not intended as a replacement for recommended treatments for ongoing mental illness.
Accessing Enhanced Moderated Online Social Therapy
Only young people who indicate online that they understand and consent to study procedures will continue to the online MOST+ registration survey. This survey will assess outcomes at baseline and will consist of items administered within the registration process for standard eheadspace services, with additional questions included to assess all outcomes (see
). This will take approximately 10 min to complete. Following this survey, all users will be granted access to real-time, clinician-delivered Web chat and user-directed psychosocial interventions (ie, partial access). Additional access to moderated peer-to-peer social networking (ie, full access) will be granted based on a three-tiered screening process designed to determine the safety and appropriateness of this component of the intervention for each user. Further details of the procedures for intervention implementation are provided in .Partial Access and Strengths
Partial access will comprise access to clinician-delivered Web chat counseling between 4 PM and midnight Australia Eastern Standard Time and 24/7 access to interactive psychosocial interventions. MOST+ adopts a strengths-based approach [
] through which users are guided and prompted to identify, discuss, and exercise key personal strengths within the online social environment and in real life to foster positive mood, enhance social connectedness and self-efficacy, and build resilience. This approach is based on the novel positive psychology model which proposes that psychosocial interventions should aim to build strengths, meaning, and purpose, as well as relieve symptoms. Participants will be prompted to choose their top five strengths from a list of 24 on the MOST+ platform. Each strength is presented with an image and a short description to help participants choose those which apply to them best.Therapy Steps
Psychosocial interventions in MOST+ take the form of brief therapy comics, called “Steps,” designed to guide the user through various situations and address salient concerns for the broad population of young people seeking eheadspace services (eg, managing immediate distress, identifying depression and anxiety, accessing offline social and professional support, substance abuse, and vocational choices). Participants will also have access to short descriptions of specific actions, called “Do its,” which can be completed to practice using their personal strengths. Therapeutic content in MOST+ is informed by evidence-based psychosocial interventions developed by our group using participatory design principles [
, ]. In MOST+, content has been adapted to address salient concerns for the broad population of young people seeking eheadspace services.Measures | Assessment time point | ||
Baseline | Follow-up | ||
Self-report assessments | |||
Demographics questionnairea | ✓ | ||
Internet usage | ✓ | ||
Presenting problemsb | ✓ | ||
Kessler Psychological Distress Scale (K10)a [ | , ]✓ | ✓ | |
Functional impairmenta | ✓ | ✓ | |
3 items from the Warwick-Edinburgh Mental Wellbeing Scalea [ | ]✓ | ✓ | |
Satisfaction with Life Scalea [ | , ]✓ | ✓ | |
UCLA Loneliness Scale [ | , ]✓ | ✓ | |
Friendship Scale [ | ]✓ | ✓ | |
Strengths Use and Knowledge Scale [ | , ]✓ | ✓ | |
Patient Health Questionnaire-9 [ | ] (depression)✓ | ||
Freiburg Mindfulness Inventory [ | ]✓ | ✓ | |
Perceived Stress Scale [ | ]✓ | ✓ | |
Basic Psychological Need Satisfaction Scale [ | , ]✓ | ✓ | |
User experience assessments | |||
MOST+c usability questionnaire | ✓ | ||
Semistructured phone interview | ✓ | ||
Online usage monitoring | Throughout trial | Throughout trial |
aAssessment items included in the eheadspace Minimum Data Set (MDS).
bAssessed using six eheadspace MDS items and one additional item used to identify users who require urgent clinician-delivered Web chat on the basis of possible clinical risk.
cMOST+: enhanced moderated online social therapy.
Social Networking
In addition to this content, participants with full access will be able to communicate with other users and peer moderators in “The Café” and “Talk It Out” sections of the MOST+ platform. The “cafe” includes a Web feed (or news feed) where users and moderators can create posts to share thoughts, information, pictures, and videos and respond to other users’ posts by commenting or “liking” content. The system includes a “network” (similar to a “friends” function on Facebook) that displays personalized profiles for all active members. Users can also communicate in a collaborative problem-solving forum called “Talk It Out.” Participants can suggest topics and discuss solutions with moderators and other young people. Moderators will encourage users to define the problem, brainstorm possible solutions, identify pros and cons, and summarize possible choices. This function uses an evidence-based, problem-solving framework and has been piloted successfully within the MOST model [
].Duration of Access
Regardless of level of access, all participants will be enrolled in the MOST+ intervention for 1 week, with the option to extend their enrollment on a weekly basis across the study intervention period. Thus, participants’ period of enrollment in the intervention will range from a minimum of 1 week to a maximum of 8 weeks. Participants will be able to reactivate an expired account at any time during the study intervention period, and this will be treated as a second episode of care. Following the conclusion of the pilot study, participants will be redirected to eheadspace if they attempt to log into the MOST+ platform. See
for examples of participants’ possible enrollment time lines, with each colored line representing a different potential time line over the duration of the pilot.Acute Risk
Any signs of possible acute risk or inappropriate use of the MOST+ system will be discussed with the principal investigators (PIs). eheadspace clinical staff, in consultation with the MOST+ coordinating investigators, will decide whether to withdraw participants from the pilot, and this will be communicated to the participant by the most appropriate member of the clinical or research team. A return to partial access, with close monitoring by the MOST+ clinicians, will be implemented in preference to full withdrawal wherever possible.
Integration With eheadspace
eheadspace Web chat will be fully integrated with evidence-based therapeutic content and social networking features within MOST+. Clinicians will facilitate real-time Web chat sessions via a function within the MOST+ platform. eheadspace Web chat involves clinician-delivered online counseling in real time and is focused on reducing immediate distress, supporting positive self-care, and facilitating referral to additional supports where appropriate. Web chat may also include therapeutic interventions targeting high prevalence mental health conditions and coordinated care responses for complex and high risk clients. Wherever appropriate at the conclusion of a Web chat session, MOST+ clinicians will suggest that users complete specific, relevant content from within the online platform based on the context of their chat session. This will be bolstered outside of the live Web chat sessions by the clinicians, who will engage active users with therapeutic content by posting links within the social network, or via messaging for those participants without access to peer-to-peer social networking.
Moderation
The MOST+ social network incorporates two types of moderation: expert moderation by eheadspace clinicians and peer moderators. Moderation will follow a manualized, theory-driven model (ie, the supported accountability model), which has been successfully utilized in previous MOST studies [
, ] to encourage use of the platform through participants’ sense of accountability to a trustworthy and experienced online “coach” [ ]. MOST+ peer moderation has been informed by social cognitive theory and recent evidence from the computing and information systems field, which posit that peer moderators can model appropriate online behaviors through demonstrating desired actions and behaviors [ ].MOST+ clinicians will monitor new contributions to the network for indicators of clinical risk. The social network will be moderated by an on-duty MOST+ clinician daily. Safety checks will be undertaken during weekdays and also on weekends. MOST+ clinicians will receive initial training from experienced clinicians from the research team, and will be in close contact throughout the trial. Clinicians will receive regular supervision throughout the trial from their usual eheadspace shift supervisors.
Peer moderation will be conducted by “super users,” who will be active members of the MOST+ social network, providing guidance and peer-to-peer support and fostering hope and empowerment [
]. Their role will include welcoming new members of the social network and modeling positive engagement with the system. Super users will post content and interact with other users in The Café and guide problem-solving discussions in Talk It Out. Individuals eligible to become super users will be aged 16 to 25 years and known to be in the later stages of recovery following a recent lived experience of mental ill health, as indicated by the youth participation coordinator within Orygen, The National Centre of Excellence in Youth Mental Health. A precondition of super users’ involvement is the development of a plan indicating early warning signs. For example, a super user may identify patterns of irritability, withdrawal, and sleep disturbance as early warning signs for more significant distress.Super users are trained in how to use the MOST+ platform and employed to moderate discussions and help participants use the site. Eligible young people will be selected to become super users if they can demonstrate via an interview process that they have (1) Comprehensive self-care strategies, (2) Nominated support services or people, and (3) Self-awareness of early warning signs indicating possible wellness fluctuation. The interview process will be facilitated by an experienced youth participation coordinator at Orygen and will provide an opportunity to ensure that all selected super users have a clear understanding of their role and are eager and able to meet the time commitments involved. Consistent with the Orygen Youth Health policy for peer support workers, MOST+ super users will be treated as “reimbursed volunteers” and compensated AUS $30 per hour for training, supervision meetings, and moderation shifts.
Moderation integrity will be ensured through a detailed moderation manual. The research team will regularly review recorded Web chat sessions and contributions to the MOST+ social network to assess clinician adherence to the moderation manual and identify areas for discussion within supervision meetings.
Supervision with MOST+ peer moderators and clinicians during the course of the pilot will provide ongoing opportunities to receive feedback and collaboratively identify opportunities for further improvements to the intervention. At the conclusion of the pilot, all MOST+ clinicians and peer moderators will be invited to attend an audio-recorded focus group or individual interview that will be aimed at gaining detailed feedback on their experience of providing support within the MOST+ platform. Information gained through this process will indicate the acceptability of MOST+ from moderators’ perspectives and be used to further refine the intervention and moderator training resources before any future implementation of MOST+.
User Anonymity and Privacy
The MOST+ platform has been designed to maximize user privacy and choice within the social network. Participants are able control their level of identification within the network (ie, first name and/or photo, or complete anonymity). Should a participant become concerned about their privacy during their course of participation, they are able to “switch off” their profile to hide all of their past activity within “The Café” and anonymize their contributions to “Talk It Outs.” With the exception of the research and clinical team, user contributions to the network are viewable by current members of the network only. In addition, user activity (eg, posts and profile information) is not permanent within the network. That is, users’ accounts are renewed on a weekly basis through a user driven “opt-in” system, and all user activity is automatically hidden from the social network for those who choose not to renew their account. Although users are able to reactivate their account and regain their profile information at any point, all other user activity is permanently removed following a 4-day grace period during which users can reactivate their account. Users will be made aware that any user activity information that disappears from the social network is retained by the researchers for the purpose of analysis.
Outcomes
The primary outcome variables will be intervention feasibility, acceptability, and safety. Assessment of intervention feasibility will involve reviewing a log of participants' access to, and usage of, the MOST+ platform. Access data will include the number of participants recruited and retained through the study, participants’ level of access, reasons for maintained partial access following initial intervention enrollment, and details of any full or partial withdrawals from the intervention. Usage data will include the number of log-ins, steps completed, and contributions to Talk It Out and The Café. This is the first study piloting an intervention of this nature and scale for help-seeking young people and, as such, registration and usage rates are difficult to predict. For this reason, an a priori criterion for the number of active users that would indicate study feasibility has not been defined.
Acceptability will be assessed at follow-up using specially designed questions administered within a semistructured feedback interview. Acceptability will be considered achieved if (1) Participants provide ratings of the MOST+ platform averaging above three out of five across feedback questions regarding ease of use, relevancy, helpfulness, and overall experience; (2) At least 60% of participants report that the MOST+ intervention provided timely, relevant, and helpful support at semistructured follow-up interview; and (3) At least 80% of respondents would recommend MOST+ to other young people experiencing difficulties.
The pilot will be considered to indicate safety of the MOST+ intervention if (1) At least 90% of participants report the online intervention to be safe via semistructured feedback interview at follow-up; (2) None of the participants experience a serious adverse event as a result of their engagement with the system during their intervention period (ie, none of the participants experience a significant deterioration in mental health or self-harm in response to intervention content, as reported by the participant or determined by treating health care professionals); and (3) There are no unlawful entries into the MOST+ system detected by study programmer during the 8-week pilot.
As shown in
, all secondary outcomes will be assessed at both baseline and follow-up, with additional MOST+ user experience items assessed at follow-up. Secondary outcome variables will include self-report measures of perceived stress, psychological distress, functional impairment, mental well-being, satisfaction with life, social support and isolation, strengths use, depression, mindfulness, and components of self-determination theory. These outcomes have been chosen as they are relevant to young people’s perceptions of well-being and quality of life and may be amenable to change via the intervention. Strengths use represents a key target of MOST+ therapeutic content and will be investigated as a potential mediator of pre- to postintervention changes to other assessed indicators of psychosocial well-being. The registration survey will also include questions assessing frequency of internet use.A number of additional quantitative and qualitative intervention feedback items will be administered within a semistructured telephone interview format at follow-up to gain a detailed understanding of areas for improvement within the system. The interview questions are based on the user experience approach as described by Bargas-Avila and Hornbaek [
]. Interviews will allow the study RA to explore six themes: overall impressions of MOST+, patterns of system use, feedback on specific aspects (eg, psychosocial interventions), Web chat and moderation, interactions with other MOST+ users (if relevant), and suggestions for system improvements.Sample Size
The majority of young people who access eheadspace make use of the service on one or two occasions only, and a primary objective of MOST+ is to facilitate responsive and effective intervention within this short window. To mirror likely real-world implementation of the MOST+ model, we will also be recruiting young people to the online intervention regardless of whether they can be contacted via telephone within the first week of study enrollment (see
). Although follow-up periods will be tailored to participants’ initial period of intervention engagement, it is likely to be challenging to retain participants who have engaged only briefly and/or were unable to be contacted via telephone at enrollment. A sample size of approximately 250 participants will therefore be necessary both to provide an adequate buffer against attrition during the study and to ensure that there is a sufficient number of active users of MOST+ for the social networking aspect of the intervention to function effectively throughout the 8-week pilot.Data Collection and Management
All participants will receive one AUS $30 voucher as reimbursement for their time in completing registration and another for completing follow-up. Follow-up assessment will occur approximately 4 days after initial account deactivation (ie, 4 days after a user has opted not to renew their account for an additional week). For those participants who maintain active enrollment across the intervention period, follow-up will occur as soon as possible following conclusion of the pilot. The exact duration of follow-up cannot be estimated as the number of participants enrolled in MOST+ will not be capped. To minimize attrition, participants will receive a short service message notification that their online follow-up survey is due and will be able to complete survey items either online or via telephone. Participants who do not complete the follow-up survey will be reminded via phone call by an RA. Both baseline and follow-up assessments will be designed to minimize participant burden, while ensuring that requirements for the eheadspace Minimum Data Set (MDS; ie, routine data about each occasion of service) are met.
The MOST+ system and data generated through participants’ use of the online platform will be hosted on a secure University of Melbourne Web server. Data collected via online surveys and telephone interviews will be entered electronically and also centrally stored on a University of Melbourne Web server. At the conclusion of the study, this data will be exported and stored securely in a password protected file on the server at Orygen. In addition, data collected as part of eheadspace MDS requirements will be provided to headspace at the conclusion of the study. For each MOST+ account, clinical content collected via Web chat and surveys will be copied into an eheadspace account to ensure continuity of care should the participant continue using eheadspace services post trial.
All of the PIs will have access to the final pilot dataset for the purpose of characterizing the participant sample, characterizing the activity within the MOST+ system, and testing the study hypotheses. The study RAs will also have access to the dataset for the purpose of data entry and management. Expert moderators and eheadspace clinicians working within MOST+ will have access to individual and aggregated usage data available within the moderator interface.
Given the relatively small scale, brief duration and primary aims of assessing the feasibility, acceptability, and safety of the intervention, an independent data safety monitoring committee will not be established for this study.
Data Analysis
Frequency, duration, and patterns of use of MOST+ will be tracked in real time. Up-to-date charts will be visible on demand to MOST+ staff via the moderator interface of the online platform. This data will be aggregated into simple descriptive statistics to characterize participants’ use of the intervention. In addition, overall rates of MOST+ participation and aggregated data from the user feedback questionnaire will be compared with the a priori acceptability and safety criteria to determine success of the pilot. Supplementary paired samples t tests will be conducted to assess pre- to postintervention changes to outcomes. System usage will be examined as a covariate.
Harms
System and privacy protection will be monitored by the study programmers. All attempts, both successful and unsuccessful, to log into the site are recorded in a database table that can be monitored. This table also informs a security mechanism whereby if five incorrect log-in attempts are made from the same internet protocol (IP) address within a 1-hour period, then an email alerting the development team is sent, and log-in access to the site is blocked for that IP address for the next hour. Online safety will be monitored proactively by the MOST+ clinicians, with supervision from the senior researchers. MOST+ clinicians will have the authority to respond to users’ reports of inappropriate material within the online platform and to automated email reports of posts that include potentially offending material. eheadspace staff will respond to indications of clinical risk according to the MOST+ safety algorithm (see
).An important function of eheadspace and MOST+ is to facilitate support, containment, and appropriate referral wherever possible in instances of acute clinical risk. Successful implementation of the MOST+ clinical safety protocol will therefore be treated as appropriate use of the intervention and will not be automatically recorded as an adverse event. All activations of the safety protocol will nevertheless be recorded and reviewed by the coordinating investigators as part of ongoing monitoring of the feasibility and safety of the intervention. In addition, serious adverse events will be monitored, recorded, and reported to the study sponsor and ethics committee in accordance with Good Clinical Practice guidelines. Serious adverse events will be tracked throughout the duration of the study. Serious adverse events are defined as events that (1) Result in death, (2) Are life-threatening, (3) Require inpatient hospitalization or prolongation of existing hospitalization, (4) Result in persistent or significant disability or incapacity, or (5) Are other medically important events or reactions.
For each moderate to high-risk case, eheadspace documentation includes: (1) The facts of the case; (2) A clear opinion as to the level of risk; (3) A rationale for this opinion; (4) A statement of any consultations with carers and other involved agencies; and (5) Completion of a care plan. This reporting process will be followed by all eheadspace clinicians working within the MOST+ interface, and case notes involving activation of the MOST+ clinical safety protocol will be reviewed by the coordinating investigators.
In the event that clinical deterioration in a research participant is evident and attributable to usage of the MOST+ system, the relevant MOST+ clinician will communicate with the PIs. The investigators will subsequently inform the ethics committee. In addition, the coordinating investigators will inform the ethics committee in the unlikely event of a security breach of the online platform which compromises the privacy of participant information. The occurrence of either of these two events will be taken to indicate an unacceptable safety risk of the MOST+ system, as per the a priori intervention safety criteria.
Results
Recruitment for the study commenced in October 2017. We expect to have initial results in March 2018, with more detailed qualitative and quantitative analyses to follow.
Discussion
The aim of this project was to pilot test the next generation of eheadspace services. As such, MOST+ has been designed to harness the popularity and high demand of eheadspace by integrating a state-of-the-art online social media–based platform that weaves together attractive evidence-based, therapeutic content; peer moderation; peer-to-peer online social networking; and one-to-one online clinical support. This novel platform has the potential to deliver an enriched 24/7 youth-led therapeutic environment that caters for the needs of more young people and increases the overall scalability of clinical e-mental health services.
To date, we have developed and implemented the MOST model for individuals, in particular clinical groups, who are already in contact with mental health services [
, ]. The current research will provide valuable insights into the implementation of MOST on a platform accessible to young people whose characteristics, including location, access to face-to-face health services, and mental health concerns, may vary considerably. The flexibility required for MOST+ to be suitable and useful for individuals with a range of concerns is built into the platform. Specifically, the use of user-driven social networking and problem solving and therapy content that focuses on users’ positive traits and well-being are intended to ensure the intervention is widely applicable. Furthermore, with this flexible, online model of care, MOST+ could be implemented across cultural and geographic boundaries.By investigating feasibility, acceptability, and safety, the data from this pilot will indicate the suitability of progressing to a large randomized controlled trial to assess the clinical effectiveness and cost-effectiveness of this model. In addition, feedback from users, super users, and clinicians will inform the development of future MOST+ interventions, allowing for improvements to both content and implementation. As a first step in providing nation-wide access to integrated user-directed psychosocial interventions, peer-moderated social networking, and clinician chat, this pilot study stands to advance clinical e-mental health services in Australia.
The final trial dataset will be retained by Orygen, The National Centre of Excellence in Youth Mental Health.
Acknowledgments
The authors are grateful to headspace National Youth Mental Health Foundation for partnering in this project. They would also like to thank the super users for their valuable contributions on the MOST+ platform and the creative team of Penni Russon, Marc Pearson, Sarojini Maxwell, and Simmone Howell for their work developing and creating the therapy comics and Do Its.
This study was funded by the Young and Well Cooperative Research Centre. SR was supported by an Early Career Researcher Fellowship provided by the Society for Mental Health Research, Australia. OSE was supported via an Endeavour Research Fellowship. MAJ was supported by a Career Development Fellowship (APP1082934) from the National Health and Medical Research Council. These funding bodies had no involvement in study design; collection, management, analysis, and interpretation of data; writing of the report; or the decision to submit the report for publication. The trial sponsor was Orygen, The National Centre of Excellence in Youth Mental Health.
Authors' Contributions
MAJ and JG conceived the study, secured funding, and along with SR, led the development of the MOST+ system. SL, SB, EK, AP, and OSE provided expertise in the evaluation of the therapeutic content of the MOST+ intervention and integration within the eheadspace service. SB and EK will additionally provide supervision to the intervention clinicians. RL has overseen information system design and will oversee its implementation and evaluation. GW is responsible for the engineering of the MOST+ application. SD is responsible for the engineering and maintenance of the MOST+ application. SL oversees clinical management of the eheadspace service. He has provided advice on the integration of the MOST+ platform within eheadspace and will oversee the clinical aspects of the study. TG and IP have contributed to drafting the manuscript and SR and DM revised it critically for intellectual content. IP and DM are RAs on MOST+ and will be responsible for contacting young people in the study, administering baseline and follow-up surveys, and coordinating the procedural aspects of recruitment to the study. AR acts as study doctor and will assess adverse events over the course of the study. All authors have read and approved the final version of this protocol.
Conflicts of Interest
None declared.
References
- Prince M, Patel V, Saxena S, Maj M, Maselko J, Phillips MR, et al. No health without mental health. Lancet 2007 Sep 08;370(9590):859-877. [CrossRef] [Medline]
- Patel V, Flisher AJ, Hetrick S, McGorry P. Mental health of young people: a global public-health challenge. Lancet 2007 Apr 14;369(9569):1302-1313. [CrossRef] [Medline]
- McDermott B, Baigent M, Chanen A, Fraser L, Graetz B, Hayman N, et al. Clinical Practice Guidelines: Depression in Adolescents and Young Adults. Melbourne: beyondblue: the national depression initiative; 2011.
- Burns JM, Davenport TA, Christensen H, Luscombe GM, Mendoza JA, Bresnan A, et al. Game On: Exploring the Impact of Technologies on Young Men's Mental Health and Wellbeing, Findings From the First Young and Well National Survey. Melbourne: Young and Well Cooperative Research Centre; 2013.
- Appelbaum PS, Kopelman A. Social media's challenges for psychiatry. World Psychiatry 2014 Feb;13(1):21-23 [FREE Full text] [CrossRef] [Medline]
- Ben-Zeev D. Mobile technologies in the study, assessment, and treatment of schizophrenia. Schizophr Bull 2012 May;38(3):384-385 [FREE Full text] [CrossRef] [Medline]
- Lloyd R, Bill A. Australia Online: How Australians Are Using Computers and the Internet. Canberra: Australian Census Analytic Program, Australian Bureau of Statistics; 2004.
- Ewing S, Thomas J, Schiessl J. CCi Digital Futures Report: the Internet in Australia. Melbourne: ARC Centre of Excellence for Creative Industries and Innovation, Institute for Social Research, Swinburne University of Technology; 2008.
- Bradford S, Rickwood D. Adolescent's preferred modes of delivery for mental health services. Child Adolesc Ment Health 2012 Oct 11;19(1):39-45. [CrossRef]
- King R, Bambling M, Lloyd C, Gomurra R, Smith S, Reid W, et al. Online counselling: the motives and experiences of young people who choose the Internet instead of face to face or telephone counselling. Couns Psychother Res 2006 Sep;6(3):169-174. [CrossRef]
- King R, Bickman L, Shochet I, McDermott B, Bor B. Use of the Internet for provision of better counselling and psychotherapy services to young people, their families and carers. Psychother Aust 2010;17(1):66-74.
- Rickwood D, Webb M, Kennedy V, Telford N. Who are the young people choosing web-based mental health support? Findings from the implementation of Australia's national web-based youth mental health service, eheadspace. JMIR Ment Health 2016 Aug 25;3(3):e40 [FREE Full text] [CrossRef] [Medline]
- Calear AL, Christensen H, Mackinnon A, Griffiths KM, O'Kearney R. The YouthMood Project: a cluster randomized controlled trial of an online cognitive behavioral program with adolescents. J Consult Clin Psychol 2009 Dec;77(6):1021-1032. [CrossRef] [Medline]
- Emslie GJ, Heiligenstein JH, Hoog SL, Wagner KD, Findling RL, McCracken JT, et al. Fluoxetine treatment for prevention of relapse of depression in children and adolescents: a double-blind, placebo-controlled study. J Am Acad Child Adolesc Psychiatry 2004 Nov;43(11):1397-1405. [CrossRef] [Medline]
- Griffiths KM, Calear AL, Banfield M. Systematic review on Internet Support Groups (ISGs) and depression (1): do ISGs reduce depressive symptoms? J Med Internet Res 2009;11(3):e40 [FREE Full text] [CrossRef] [Medline]
- Van Voorhees BW, Fogel J, Reinecke MA, Gladstone T, Stuart S, Gollan J, et al. Randomized clinical trial of an Internet-based depression prevention program for adolescents (Project CATCH-IT) in primary care: 12-week outcomes. J Dev Behav Pediatr 2009 Feb;30(1):23-37. [CrossRef] [Medline]
- Kauer SD, Mangan C, Sanci L. Do online mental health services improve help-seeking for young people? A systematic review. J Med Internet Res 2014 Mar 04;16(3):e66 [FREE Full text] [CrossRef] [Medline]
- Griffiths KM. A virtual mental health community - a future scenario. Aust N Z J Psychiatry 2013 Feb;47(2):109-110. [CrossRef] [Medline]
- Christensen H, Proudfoot J, Woodward A, Hosie A, Klein B, Morgan C, et al. e-Mental Health Alliance. 2014. e-mental health services in Australia 2014: current and future URL: https://emhalliance.fedehealth.org.au/wp-content/uploads/sites/42/2014/10/e-Mental-Health-in-Australia-2014.pdf [WebCite Cache]
- Rickwood DJ, Mazzer KR, Telford NR, Parker AG, Tanti CJ, McGorry PD. Changes in psychological distress and psychosocial functioning in young people visiting headspace centres for mental health problems. Med J Aust 2015 Jun 01;202(10):537-542. [Medline]
- Alvarez-Jimenez M, Bendall S, Lederman R, Wadley G, Chinnery G, Vargas S, et al. On the HORYZON: moderated online social therapy for long-term recovery in first episode psychosis. Schizophr Res 2013 Jan;143(1):143-149. [CrossRef] [Medline]
- Gleeson JF, Alvarez-Jimenez M, Lederman R. Moderated online social therapy for recovery from early psychosis. Psychiatr Serv 2012 Jul;63(7):719. [CrossRef] [Medline]
- Gleeson J, Lederman R, Herrman H, Koval P, Eleftheriadis D, Bendall S, et al. Moderated online social therapy for carers of young people recovering from first-episode psychosis: study protocol for a randomised controlled trial. Trials 2017 Jan 17;18(1):27 [FREE Full text] [CrossRef] [Medline]
- Gleeson J, Lederman R, Koval P, Wadley G, Bendall S, Cotton S, et al. Moderated online social therapy: a model for reducing stress in carers of young people diagnosed with mental health disorders. Front Psychol 2017 Apr 03;8:485 [FREE Full text] [CrossRef] [Medline]
- Rice S, Gleeson J, Davey C, Hetrick S, Parker A, Lederman R, et al. Moderated online social therapy for depression relapse prevention in young people: pilot study of a 'next generation' online intervention. Early Interv Psychiatry 2016 Jun 17 [Epub ahead of print]. [CrossRef] [Medline]
- Rice S, Robinson J, Bendall S, Hetrick S, Cox G, Bailey E, et al. Online and social media suicide prevention interventions for young people: a focus on implementation and moderation. J Can Acad Child Adolesc Psychiatry 2016;25(2):80-86 [FREE Full text] [Medline]
- Santesteban-Echarri O, Rice S, Wadley G, Lederman R, D'Alfonso S, Russon P, et al. A next-generation social media-based relapse prevention intervention for youth depression: qualitative data on user experience outcomes for social networking, safety, and clinical benefit. Internet Interv 2017 Sep;9:65-73 [FREE Full text] [CrossRef]
- Easton M. Young people and medical procedures: whether or not young people can be competent to make medical decisions in their own interests. J Law Med 2014 Dec;22(2):442-461. [Medline]
- eheadspace. Australia: eheadspace; 2017. URL: http://www.eheadspace.org.au/ [accessed 2018-01-30] [WebCite Cache]
- Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med 2002 Aug;32(6):959-976. [Medline]
- Furukawa TA, Kessler RC, Slade T, Andrews G. The performance of the K6 and K10 screening scales for psychological distress in the Australian National Survey of Mental Health and Well-Being. Psychol Med 2003 Feb;33(2):357-362. [Medline]
- Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, et al. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): development and UK validation. Health Qual Life Outcomes 2007;5:63 [FREE Full text] [CrossRef] [Medline]
- Diener E, Emmons RA, Larsen RJ, Griffin S. The Satisfaction With Life Scale. J Pers Assess 1985 Feb;49(1):71-75. [CrossRef] [Medline]
- Pavot W, Diener E. Review of the satisfaction with life scale. Psychol Assess 1993;5(2):164-172.
- Russell D, Peplau LA, Ferguson ML. Developing a measure of loneliness. J Pers Assess 1978 Jun;42(3):290-294. [CrossRef] [Medline]
- Russell DW. UCLA Loneliness Scale (Version 3): reliability, validity, and factor structure. J Pers Assess 1996 Feb;66(1):20-40. [CrossRef] [Medline]
- Hawthorne G. Measuring social isolation in older adults: development and initial validation of the Friendship Scale. Soc Indic Res 2006 Feb 13;77(3):521-548. [CrossRef]
- Wood AM, Linley PA, Maltby J, Kashdan TB, Hurling R. Using personal and psychological strengths leads to increases in well-being over time: a longitudinal study and the development of the strengths use questionnaire. Pers Individ Dif 2011 Jan;50(1):15-19 [FREE Full text] [CrossRef]
- Govindji R, Linley PA. Strengths use, self-concordance and well-being: implications for strengths coaching and coaching psychologists. Int Coach Psychol Rev 2007;2:143-153.
- Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001 Sep;16(9):606-613 [FREE Full text] [Medline]
- Walach H, Buchheld N, Buttenmüller V, Kleinknecht N, Schmidt S. Measuring mindfulness—the Freiburg Mindfulness Inventory (FMI). Pers Individ Dif 2006 Jun;40(8):1543-1555 [FREE Full text] [CrossRef]
- Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav 1983 Dec;24(4):385-396. [Medline]
- Gagné M. The role of autonomy support and autonomy orientation in prosocial behavior engagement. Motiv Emot 2003;27(3):199-223. [CrossRef]
- Deci EL, Ryan RM. The “what” and “why” of goal pursuits: human needs and the self-determination of behavior. Psychol Inq 2000 Oct;11(4):227-268. [CrossRef]
- Seligman ME, Rashid T, Parks AC. Positive psychotherapy. Am Psychol 2006 Nov;61(8):774-788. [CrossRef] [Medline]
- Schuler D, Namioka A. Participatory Design: Principles and Practices. Hillsdale, NJ: Lawrence Erlbaum Associates Inc; 1993.
- Wadley G, Lederman R, Gleeson J, Alvarez-Jimenez M. Participatory design of an online therapy for youth mental health. 2013 Presented at: OzCHI '13 Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration; November 25-29, 2013; Adelaide, Australia URL: http://people.eng.unimelb.edu.au/reevaml/ParticipatoryDesignOnlineTherapy.pdf [CrossRef]
- Mohr DC, Cuijpers P, Lehman K. Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. J Med Internet Res 2011 Mar 10;13(1):e30. [CrossRef] [Medline]
- Bandura A. Social cognitive theory of mass communication. Media Psychology 2001 Aug;3(3):265-299. [CrossRef]
- Watson AC, Corrigan P, Larson JE, Sells M. Self-stigma in people with mental illness. Schizophr Bull 2007 Nov;33(6):1312-1318 [FREE Full text] [CrossRef] [Medline]
- Bargas-Avila JA, Hornbæk K. Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. New York: ACM; 2011 Presented at: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems; May 7-12, 2011; Vancouver, BC, Canada URL: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.455.8942&rep=rep1&type=pdf
Abbreviations
e-mental health: electronic mental health |
IP: Internet protocol |
MDS: Minimum Data Set |
MOST: moderated online social therapy |
MOST+: enhanced moderated online social therapy |
PI: principal investigator |
RA: research assistant |
SMS: short message service |
TAU: treatment ass usual |
Edited by I Montagni; submitted 30.08.17; peer-reviewed by K Ali, JJ Mira, C Vennin; comments to author 22.11.17; revised version received 03.12.17; accepted 04.12.17; published 22.02.18
Copyright©Simon Rice, John Gleeson, Steven Leicester, Sarah Bendall, Simon D'Alfonso, Tamsyn Gilbertson, Eoin Killackey, Alexandra Parker, Reeva Lederman, Greg Wadley, Olga Santesteban-Echarri, Ingrid Pryor, Daveena Mawren, Aswin Ratheesh, Mario Alvarez-Jimenez. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 22.02.2018.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.