Published on in Vol 14 (2025)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/65245, first published .
Digital Mental Health Screening, Feedback, and Referral System for Teens With Socially Complex Needs: Protocol for a Randomized Controlled Trial Integrating the Teen Assess, Check, and Heal System into Pediatric Primary Care

Digital Mental Health Screening, Feedback, and Referral System for Teens With Socially Complex Needs: Protocol for a Randomized Controlled Trial Integrating the Teen Assess, Check, and Heal System into Pediatric Primary Care

Digital Mental Health Screening, Feedback, and Referral System for Teens With Socially Complex Needs: Protocol for a Randomized Controlled Trial Integrating the Teen Assess, Check, and Heal System into Pediatric Primary Care

Protocol

1Institute for Juvenile Research, Department of Psychiatry, University of Illinois Chicago, Chicago, IL, United States

2AI.Health4All Center, College of Medicine, University of Illinois Chicago, Chicago, IL, United States

3Department of Psychiatry, Rush University Medical Center, Chicago, IL, United States

4Innovation Center, University of Illinois Chicago, Chicago, IL, United States

5Children and Family Nursing, Department of Women, RUSH University Medical Center, Chicago, IL, United States

Corresponding Author:

Colleen Stiles-Shields, PhD

Institute for Juvenile Research

Department of Psychiatry

University of Illinois Chicago

1747 W. Roosevelt Road

Chicago, IL, 60608

United States

Phone: 1 3124131128

Email: ecss@uic.edu


Background: Teens with socially complex needs—those who face multiple and potentially overlapping adversities—are disproportionately affected by several barriers to mental health screening and treatment. Pediatric primary care (PPC) is a typically low-stigmatized setting for teens that is visited at least annually. As such, implementing digital mental health tools (DMH), as low-intensity treatments in PPCs may increase the reach of such tools for teens with socially complex needs.

Objective: This study aimed to evaluate the Teen Assess, Check, and Heal (TeACH) System in comparison to a control condition while integrated into PPCs at 2 Medical Centers serving teen patients in Chicago, Illinois. Through collaboration with key players throughout the design and implementation planning phases, the TeACH System is hypothesized to increase teen patient self-reported engagement with DMH and address specific individual-level barriers to mental health care, compared with a digital psychoeducation control condition.

Methods: Eligible participants will be recruited through PPC clinics housed within the University of Illinois Chicago (UIC) and Rush University Medical Center (RUSH). Recruitment involves invitations from research staff members and primary care clinicians and staff members, as well as posting flyers with QR codes at the specified clinics. All participants complete a brief demographic survey, baseline survey, and Kiddie-Computerized Adaptive Tests Anxiety Module. Participants are randomized to receive either the control condition (digital evidence-based workbook) or the intervention (TeACH System Feedback and Resources). All randomized participants will then be invited to complete an immediate and 1-week follow-up survey. The primary outcomes assess changes in engagement with DMH (ie, likelihood to use DMH for anxiety and actual DMH use) and individual-level barriers to mental health care (ie, symptom understanding and confidence to act). Descriptive analyses will be conducted to characterize the sample and usability ratings of the TeACH System. Linear or generalized linear mixed effects regression models will examine differences in primary outcomes over time.

Results: Recruitment began in July 2024 and data collection is expected to be completed by August 2025. To date, 122 teens have assented to complete study activities, 80 have been randomized (an additional 24 teens have had subthreshold anxiety symptoms and were therefore not randomized), and 42 teens have completed the 1-week follow-up assessment.

Conclusions: This study will provide preliminary feasibility data that may inform how the TeACH System and other DMH low-intensity treatments might better engage and support teens with socially complex needs.

Trial Registration: ClinicalTrials.gov NCT05466929; https://clinicaltrials.gov/study/NCT05466929

International Registered Report Identifier (IRRID): DERR1-10.2196/65245

JMIR Res Protoc 2025;14:e65245

doi:10.2196/65245

Keywords



Background

Even before the multiple endemics occurring since 2020, pediatric mental health disorders and symptoms were the leading causes of disability and negative sequelae for youth [Murthy VH. The mental health of minority and marginalized young people: an opportunity for action. Public Health Rep. 2022;137(4):613-616. [FREE Full text] [CrossRef] [Medline]1]. For some time, mental health disorders have been the most common disease of childhood in the United States, surpassing the combined rates of multiple pediatric conditions (eg, cancer and diabetes) [Child Mind Institute.. Children?s Mental Health Report. New York. Child Mind Institute, Inc; 2015. 2-Merikangas KR, He JP, Burstein M, Swanson SA, Avenevoli S, Cui L, et al. Lifetime prevalence of mental disorders in U.S. adolescents: results from the national comorbidity survey replication--adolescent supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2010;49(10):980-989. [FREE Full text] [CrossRef] [Medline]4]. Despite the tremendous impact of mental health disorders on teens, millions do not receive mental health care [Child Mind Institute.. Children?s Mental Health Report. New York. Child Mind Institute, Inc; 2015. 2]. Anxiety is particularly untreated, as up to 80% of youth with a diagnosable anxiety disorder do not receive mental health care [Child Mind Institute.. Children?s Mental Health Report. New York. Child Mind Institute, Inc; 2015. 2,Merikangas KR, He J, Burstein ME, Swendsen J, Avenevoli S, Case B, et al. Service utilization for lifetime mental disorders in U.S. adolescents: results of the national comorbidity survey-adolescent supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2011;50(1):32-45. [FREE Full text] [CrossRef] [Medline]3,Substance Abuse and Mental Health Services Administration (SAMHSA). Results from the 2013 national survey on drug use and health: summary of findings. URL: http://www.samhsa.gov/data/sites/default/files/NSDUHresultsPDFWHTML2013/Web/NSDUHresults2013.pdf [accessed 2014-09-05] 5]. Most exposed to this failure of mental health care are teens with socially complex needs, those who face multiple and potentially overlapping adversities, such as (1) enduring adverse childhood experiences, (2) residing in a systemically excluded community that experiences disproportionate disparities in health outcomes and health care access, or (3) being minoritized due to socioeconomic status as well as racial, ethnic, gender, or sexual identity or identities [Murthy VH. The mental health of minority and marginalized young people: an opportunity for action. Public Health Rep. 2022;137(4):613-616. [FREE Full text] [CrossRef] [Medline]1,Flores G, Committee On Pediatric Research. Racial and ethnic disparities in the health and health care of children. Pediatrics. 2010;125(4):e979-e1020. [CrossRef] [Medline]6-Bounds DT, Winiarski DA, Otwell CH, Tobin V, Glover AC, Melendez A, et al. Considerations for working with youth with socially complex needs. J Child Adolesc Psychiatr Nurs. 2020;33(4):209-220. [FREE Full text] [CrossRef] [Medline]8]. Teens with socially complex needs have multiple barriers placed between them and mental health care, which the current system is failing to address [TF K, L K, K J. Human immunodeficiency virus infection in young adults: treatment of substance use disorders as a priority component of HIV prevention, care and treatment in low and middle income countries. IJHR. Sep 01, 2016:97-104. [FREE Full text] [CrossRef]9-de Haan AM, Boon AE, de Jong JT, Hoeve M, Vermeiren RR. A meta-analytic review on treatment dropout in child and adolescent outpatient mental health care. Clin Psychol Rev. 2013;33(5):698-711. [CrossRef] [Medline]15]. As such, traditional methods for reaching such teens are not working, resulting in life-long health disparities and a significant public health impact [Child Mind Institute.. Children?s Mental Health Report. New York. Child Mind Institute, Inc; 2015. 2,Flores G, Committee On Pediatric Research. Racial and ethnic disparities in the health and health care of children. Pediatrics. 2010;125(4):e979-e1020. [CrossRef] [Medline]6,Beck AF, Tschudy MM, Coker TR, Mistry KB, Cox JE, Gitterman BA, et al. Determinants of health and pediatric primary care practices. Pediatrics. 2016;137(3):e20153673. [CrossRef] [Medline]7,Koball H, Jiang Y. Basic facts about low-income children: children under 18 years. New York. National Center for Children in Poverty; 2018. 16,Braveman P, Barclay C. Health disparities beginning in childhood: a life-course perspective. Pediatrics. 2009;124 Suppl 3:S163-S175. [CrossRef] [Medline]17].

Digital Tools Implemented in Primary Care to Extend Care Capacity

Pediatric primary care (PPC) is one setting with strong potential as an environment to engage and screen teens with socially complex needs. Indeed, nearly all youth visit a PPC office annually for well-child visits as well as illnesses or injuries that necessitate care (eg, ear infection) [Bloom B, Cohen RA, Freeman G. Summary health statistics for U.S. children: National Health Interview Survey, 2010. Vital Health Stat 10. Dec 2011;(250):1-80. [FREE Full text] [Medline]18]. As such, PPC is a centralized and typically low-stigmatized setting for teens of all backgrounds. Mental health care is increasingly warranted in PPC, with the American Academy of Pediatrics recommending universal anxiety screening for all children and adolescents, aged 8-18 years, during PPC visits [Walter HJ, Bukstein OG, Abright AR, Keable H, Ramtekkar U, Ripperger-Suhler J, et al. Clinical practice guideline for the assessment and treatment of children and adolescents with anxiety disorders. J Am Acad Child Adolesc Psychiatry. 2020;59(10):1107-1124. [CrossRef] [Medline]19]. However, PPC providers report variable administration of standardized assessment measures [Bose J, Zeno R, Warren B, Sinnott LT, Fitzgerald EA. Implementation of universal adolescent depression screening: quality improvement outcomes. J Pediatr Health Care. 2021;35(3):270-277. [CrossRef] [Medline]20] and multiple barriers to mental health screening, broadly [Bose J, Zeno R, Warren B, Sinnott LT, Fitzgerald EA. Implementation of universal adolescent depression screening: quality improvement outcomes. J Pediatr Health Care. 2021;35(3):270-277. [CrossRef] [Medline]20-Acri M, Zhang S, Chomanczuk AH, O’Brien KH, De Zitella MLM, Scrofani PR, et al. Barriers and facilitators to mental health screening efforts for families in pediatric primary care. Journal of Family Social Work. 2018;21(3):191-199. [CrossRef]22]. Further, when mental health needs, such as anxiety, are screened or arise in PPC, pediatricians report multiple barriers to assessing mental health needs and connecting patients to therapy [Stiles-Shields C, Gustafson EL, Lim PS, Bobadilla G, Thorpe D, Summersett Williams FC, et al. Pre-implementation determinants for digital mental health integration in Chicago pediatric primary care. J Pediatr Psychol. 2024. [CrossRef] [Medline]23,Radez J, Reardon T, Creswell C, Lawrence PJ, Evdoka-Burton G, Waite P. Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. Eur Child Adolesc Psychiatry. 2021;30(2):183-211. [FREE Full text] [CrossRef] [Medline]24], adding to the obstacles to care noted above. Even in the case of using a collaborative care model for depression in primary care [Wisdom JP, Clarke GN, Green CA. What teens want: barriers to seeking care for depression. Adm Policy Ment Health. 2006;33(2):133-145. [FREE Full text] [CrossRef] [Medline]25], a pragmatic approach for anxiety that embraces the logistical realities that providers face in delivering mental health screening and ensuing recommendations is lacking [Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10:113. [FREE Full text] [CrossRef] [Medline]26,Reardon T, Harvey K, Baranowska M, O'Brien D, Smith L, Creswell C. What do parents perceive are the barriers and facilitators to accessing psychological treatment for mental health problems in children and adolescents? A systematic review of qualitative and quantitative studies. Eur Child Adolesc Psychiatry. 2017;26(6):623-647. [FREE Full text] [CrossRef] [Medline]27]. A potential solution to these barriers is to incorporate digital mental health tools (DMH) as a low-intensity treatment (LIT) into PPCs. LITs are patient-facing tools that may provide screening, psychoeducation, resources, or combinations of these items. Given the long-standing efficacy of LITs in digital and other delivery mechanisms for mild to moderate symptom presentations (eg, self-help books) [Cuijpers P, Schuurmans J. Self-help interventions for anxiety disorders: an overview. Curr Psychiatry Rep. 2007;9(4):284-290. [FREE Full text] [CrossRef] [Medline]28], DMH LITs have been proposed as a scalable and strategic first-line model of care in PPC and similar care environments [Lorenzo-Luaces L, Fite RE. Wider, faster, more: reenvisioning depression treatment research in the United States. Practice Innovations. 2024;9(1):19-29. [CrossRef]29].

Integrating DMH LITs into spaces that teens already visit, such as PPC, has the potential to increase mental health care reach. However, uptake and subsequent clinical outcomes will not be impacted if teens do not engage with DMH in their daily lives [Fleming T, Bavin L, Lucassen M, Stasiak K, Hopkins S, Merry S. Beyond the trial: systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. J Med Internet Res. 2018;20(6):e199. [FREE Full text] [CrossRef] [Medline]30]. One problem is a lack of implementation planning early on in the design processes for DMH [Psihogios AM, Lane-Fall MB, Graham AK. Adolescents are still waiting on a digital health revolution: accelerating research-to-practice translation through design for implementation. JAMA Pediatr. 2022;176(6):545-546. [CrossRef] [Medline]31,Stiles-Shields C, Ramos G, Ortega A, Psihogios A. Increasing digital mental health reach and uptake via youth partnerships. Npj Ment Health Res. 2023;2. [FREE Full text] [CrossRef] [Medline]32]. Also implicated in poor engagement is a failure to address the range of multilevel implementation barriers, spanning from individual-level barriers (eg, problem recognition, stigma, and confidence to act), intervention barriers (eg, usability and relevance), and systemic barriers (eg, accessibility and cost) [Radez J, Reardon T, Creswell C, Lawrence PJ, Evdoka-Burton G, Waite P. Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. Eur Child Adolesc Psychiatry. 2021;30(2):183-211. [FREE Full text] [CrossRef] [Medline]24-Reardon T, Harvey K, Baranowska M, O'Brien D, Smith L, Creswell C. What do parents perceive are the barriers and facilitators to accessing psychological treatment for mental health problems in children and adolescents? A systematic review of qualitative and quantitative studies. Eur Child Adolesc Psychiatry. 2017;26(6):623-647. [FREE Full text] [CrossRef] [Medline]27,Karyotaki E, Kleiboer A, Smit F, Turner DT, Pastor AM, Andersson G, et al. Predictors of treatment dropout in self-guided web-based interventions for depression: an 'individual patient data' meta-analysis. Psychol Med. 2015;45(13):2717-2726. [FREE Full text] [CrossRef] [Medline]33]. Interventions such as incorporating motivational interviewing [Schueller SM, Tomasino KN, Mohr DC. Integrating human support into behavioral intervention technologies: the efficiency model of support. Clinical Psychology: Science and Practice. 2017;24(1):27-45. [CrossRef]34] and usage incentivizes [Coughlin LN, Nahum-Shani I, Philyaw-Kotov ML, Bonar EE, Rabbi M, Klasnja P, et al. Developing an adaptive mobile intervention to address risky substance use among adolescents and emerging adults: usability study. JMIR Mhealth Uhealth. 2021;9(1):e24424. [FREE Full text] [CrossRef] [Medline]35-Cohen KA, Schleider JL. Adolescent dropout from brief digital mental health interventions within and beyond randomized trials. Internet Interv. 2022;27:100496. [FREE Full text] [CrossRef] [Medline]37] have improved DMH engagement, but diminish scalability [Scholten H, Granic I. Use of the principles of design thinking to address limitations of digital mental health interventions for youth: viewpoint. J Med Internet Res. 2019;21(1):e11528. [FREE Full text] [CrossRef] [Medline]38]. As such, means to target barriers must be identified and harnessed to address poor engagement, the perennial failure of DMH deployment to date.

Objectives

In this study, human-centered design methodologies and an implementation science framework [Mohr DC, Lyon AR, Lattie EG, Reddy M, Schueller SM. Accelerating digital mental health research from early design and creation to successful implementation and sustainment. J Med Internet Res. 2017;19(5):e153. [FREE Full text] [CrossRef] [Medline]39-Damschroder LJ, Reardon CM, Widerquist MA, Lowery J. The updated consolidated framework for implementation research based on user feedback. Implement Sci. 2022;17(1):75. [FREE Full text] [CrossRef] [Medline]41] were used to guide the development and implementation of the Teen Assess, Check, and Heal (TeACH System). Through the use of these methodologies and frameworks, the TeACH System was designed to target individual-level barriers to care (eg, feedback to directly respond to problem recognition, stigma, and confidence to act on symptoms), DMH intervention barriers (eg, human-centered design methodologies to optimize usability and relevance), and systemic barriers to care (eg, increase accessibility by integrating in a space already visited by teens, remove cost barrier by providing a freely accessible service and resources) [Radez J, Reardon T, Creswell C, Lawrence PJ, Evdoka-Burton G, Waite P. Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. Eur Child Adolesc Psychiatry. 2021;30(2):183-211. [FREE Full text] [CrossRef] [Medline]24-Reardon T, Harvey K, Baranowska M, O'Brien D, Smith L, Creswell C. What do parents perceive are the barriers and facilitators to accessing psychological treatment for mental health problems in children and adolescents? A systematic review of qualitative and quantitative studies. Eur Child Adolesc Psychiatry. 2017;26(6):623-647. [FREE Full text] [CrossRef] [Medline]27,Karyotaki E, Kleiboer A, Smit F, Turner DT, Pastor AM, Andersson G, et al. Predictors of treatment dropout in self-guided web-based interventions for depression: an 'individual patient data' meta-analysis. Psychol Med. 2015;45(13):2717-2726. [FREE Full text] [CrossRef] [Medline]33]. Our primary aim was to increase DMH engagement for teens with socially complex needs through: (1) engaging teens and caregivers from the systemically-excluded and underserved communities of Chicago, Illinois, to refine the TeACH System to be engaging, appropriate, and in line with cultural and user needs; and (2) integrating the TeACH System into PPCs serving teens on the West Side of Chicago. The West Side of Chicago was selected for initial implementation planning and integration evaluations as part of a larger body of research focusing on adapting DMH LITs for and with teens living in communities disproportionately inflicted with health disparities, violence exposure, and higher economic hardship (eg, [Stiles-Shields C, Reyes KM, Archer J, Lennan N, Zhang J, Julion WA, et al. mHealth uses and opportunities for teens from communities with high health disparities: a mixed-methods study. J Technol Behav Sci. 2022:1-13. [FREE Full text] [CrossRef] [Medline]42]). Through collaboration with key players throughout the design and implementation planning phases, the TeACH System was hypothesized to increase teen patient self-reported engagement with DMH and address specific individual-level barriers to mental health care, compared with a digital psychoeducation control condition. This hypothesis is being evaluated through a pilot feasibility randomized controlled trial in Chicago PPCs, comparing engagement outcomes for teens with anxiety randomized to use the full TeACH System to those who are provided access to a publicly available, digital evidence-based workbook for teens (psychoeducation control) [Free social work tools and resources: socialWorkersToolbox.com. Free Social Work Tools and resources SocialWorkersToolbox.com. The Anxiety Workbook for Teens: activities to help you deal with anxiety & worry - free social work tools and resources: SocialWorkersToolbox.Com. URL: https:/​/www.​socialworkerstoolbox.com/​the-anxiety-workbook-for-teens-activities-to-help-you-deal-with-anxiety-worry/​ [accessed 2024-06-21] 43,Schab LM. The Anxiety Workbook for Teens: activities to help you deal with anxiety and worry. California. New Harbinger Publications; 2021. 44].


Positionality

Positionality influences all aspects of a research study and is connected to the researchers’ personal and philosophical views [Creswell JW. Research Design: qualitative, quantitative, and mixed methods approaches. United States. SAGE; 2014. 45]. In recognition of this influence, the positionality of the lead author of this study has been reported elsewhere [Stiles-Shields C, Gustafson EL, Lim PS, Bobadilla G, Thorpe D, Summersett Williams FC, et al. Pre-implementation determinants for digital mental health integration in Chicago pediatric primary care. J Pediatr Psychol. 2024. [CrossRef] [Medline]23] and is similarly described: (1) author CSS is a lifelong Chicagoan, (2) trained social worker, and (3) a pediatric psychologist who believes that engaging youth with DMH and in health environments they already frequent maybe 1 path to get more resources directly to youth to use as they need and want, but that DMH will not become a panacea to disparities. As a monolingual, White woman trained in health care settings, she has biases and experiences that may impact her interpretation of findings (eg, she is comfortable in health settings; DMH has primarily been tested with individuals who have overlapping identities with her [eg, college-educated and White women] [Safavi K, Mathews SC, Bates DW, Dorsey ER, Cohen AB. Top-funded digital health companies and their impact On high-burden, high-cost conditions. Health Aff (Millwood). 2019;38(1):115-123. [CrossRef] [Medline]46]). To minimize bias, author CSS partnered with key players, by establishing interdisciplinary mentor and peer collaborator teams, to learn with teens, caregivers, and providers about their wants and needs for DMH in health care settings.

Procedures

Study Design

The study design is a pilot feasibility randomized controlled trial. The participant focus is teen patients in PPCs with anxiety. While universal anxiety screening is recommended [Walter HJ, Bukstein OG, Abright AR, Keable H, Ramtekkar U, Ripperger-Suhler J, et al. Clinical practice guideline for the assessment and treatment of children and adolescents with anxiety disorders. J Am Acad Child Adolesc Psychiatry. 2020;59(10):1107-1124. [CrossRef] [Medline]19], pediatric anxiety has a long-standing history of being underrecognized and often untreated [Emslie GJ. Pediatric anxiety-underrecognized and undertreated. N Engl J Med. 2008;359(26):2835-2836. [CrossRef] [Medline]47-Evans DL, Foa EB, Gur RE, Hendin H, O?Brien CP, Seligman MEP, et al. Treating and preventing adolescent mental health disorders: what we know and what we don't know. Jericho. Oxford University Press; 2005. 49]. Participants first answer initial screening eligibility questions (ie, age, clinic location, and ability to complete and read surveys in English), followed by completing a digital assent. While a waiver of guardian consent was obtained from the institutional review board, participants are able to “opt in” to have a guardian provide consent in English or Spanish, should they elect to do so. Following assent and optional guardian permission, participants complete a brief demographic survey, indicate their preference for future contact (ie, text message or email), and complete a brief assessment of the primary outcomes (Measures section). All participants then complete the Kiddie-Computerized Adaptive Tests (K-CAT) Anxiety Module [Gibbons RD, Kupfer DJ, Frank E, Lahey BB, George-Milford BA, Biernesser CL, et al. Computerized adaptive tests for rapid and accurate assessment of psychopathology dimensions in youth. J Am Acad Child Adolesc Psychiatry. 2020;59(11):1264-1273. [FREE Full text] [CrossRef] [Medline]50] to ensure eligibility (ie, a score >29 and indicating mild or greater anxiety symptoms). Participants who do not meet these criteria are excluded and offered access to a publicly available, digital evidence-based workbook for teens [Free social work tools and resources: socialWorkersToolbox.com. Free Social Work Tools and resources SocialWorkersToolbox.com. The Anxiety Workbook for Teens: activities to help you deal with anxiety & worry - free social work tools and resources: SocialWorkersToolbox.Com. URL: https:/​/www.​socialworkerstoolbox.com/​the-anxiety-workbook-for-teens-activities-to-help-you-deal-with-anxiety-worry/​ [accessed 2024-06-21] 43,Schab LM. The Anxiety Workbook for Teens: activities to help you deal with anxiety and worry. California. New Harbinger Publications; 2021. 44]. Participants who do meet the criteria for mild or greater symptoms of anxiety are randomized into either the control arm (digital evidence-based workbook [Free social work tools and resources: socialWorkersToolbox.com. Free Social Work Tools and resources SocialWorkersToolbox.com. The Anxiety Workbook for Teens: activities to help you deal with anxiety & worry - free social work tools and resources: SocialWorkersToolbox.Com. URL: https:/​/www.​socialworkerstoolbox.com/​the-anxiety-workbook-for-teens-activities-to-help-you-deal-with-anxiety-worry/​ [accessed 2024-06-21] 43,Schab LM. The Anxiety Workbook for Teens: activities to help you deal with anxiety and worry. California. New Harbinger Publications; 2021. 44]) or the Intervention Arm (TeACH System Feedback and Resources). Randomization is automated through the Research Electronic Data Capture (REDCap, Vanderbilt University) platform, and study staff members are blind to allocation. Following a review of these resources, all participants are invited to complete an immediate follow-up survey. One week following this interaction, participants are invited to complete the same follow-up survey. Figures 1 and Child Mind Institute.. Children?s Mental Health Report. New York. Child Mind Institute, Inc; 2015. 2 display the study design flow.

Figure 1. Participant flow through TeACH system trial in pediatric primary care K-CAT: Kiddie-Computerized Adaptive Tests.
Figure 2. Study flow diagram.
Setting and Recruitment

Eligible participants are being recruited through PPC clinics housed within the University of Illinois Chicago (UIC) and Rush University Medical Center (RUSH). Both hospital systems’ primary campuses are situated on the West Side of Chicago and serve diverse patient populations [Ansell DA, Oliver-Hightower D, Goodman LJ, Lateef OB, Johnson TJ. Health equity as a system strategy: the rush university medical center framework. NEJM Catalyst. 2021;2(5). [CrossRef]51,McCarville E, Martin MA, Pratap P, Pinsker E, Seweryn SM, Peters KE. Understanding critical factors associated with integration of community health workers into health and hospital systems. J Interprof Care. 2024;38(3):507-516. [CrossRef] [Medline]52]. Eligible participants are being recruited in clinics through (1) QR codes on displayed and circulated flyers, including sharing of the flyer by PPC pediatricians, trainees, and staff; and (2) invitation from research staff (ie, offered tablet in the clinic waiting room or while waiting in an exam room) or PPC clinicians and staff members.

Inclusion and Exclusion Criteria

For study inclusion, participants must be (1) receiving care at the specified clinics at UIC or RUSH; (2) between 13 and 17 years of age; and (3) able to speak and read in English. These inclusion criteria are determined by teen self-report (ie, answering 3 screening questions based on these criteria). Following assent and completion of a demographics and engagement survey (Measures section), final inclusion criteria are assessed based on responses to the K-CAT Anxiety Module. Namely, to be randomized, participants must also meet criteria for mild or greater symptoms of anxiety (ie, K-CAT Anxiety Module score >29) [Gibbons RD, Kupfer DJ, Frank E, Lahey BB, George-Milford BA, Biernesser CL, et al. Computerized adaptive tests for rapid and accurate assessment of psychopathology dimensions in youth. J Am Acad Child Adolesc Psychiatry. 2020;59(11):1264-1273. [FREE Full text] [CrossRef] [Medline]50]. There are no assessments for comorbidities, nor any exclusion criteria beyond not meeting the inclusion criteria noted above.

TeACH System

The TeACH System is a DMH LIT that includes teen patient-facing brief assessment, feedback, and resources for symptoms of anxiety (sample screenshots displayed in Figure 3. Increasing DMH engagement for teens with socially complex needs is the primary aim of the current iteration of the TeACH System. The mechanism to achieve this outcome includes the use of key player involvement throughout the design and implementation planning processes. Consistent with a broad spectrum of community-engaged research practices [Suarez-Balcazar Y, Harper GW, Lewis R. An interactive and contextual model of community-university collaborations for research and action. Health Educ Behav. 2005;32(1):84-101. [CrossRef] [Medline]53], involvement of teens and caregivers from the West and South Side Communities of Chicago have ranged from 1-time interviews and focus groups to co-design activities, with plans to form a community advisory board for the broader line of research led by this team [Stiles-Shields C, Reyes KM, Archer J, Lennan N, Zhang J, Julion WA, et al. mHealth uses and opportunities for teens from communities with high health disparities: a mixed-methods study. J Technol Behav Sci. 2022:1-13. [FREE Full text] [CrossRef] [Medline]42,Stiles-Shields C, Reyes KM, Lennan N, Zhang J, Archer J, Julion WA, et al. Community teens' the COVID-19 pandemic experience: implications for engagement moving forward. J Clin Psychol Med Settings. 2024;31(1):143-152. [CrossRef] [Medline]54,Gustafson E, Moscato EL, Stiles-Shields C, Psihogios AM, Guler J, Mehta T. Community-engaged research: a primer for Pediatric Psychology. J Pediatr Psychol. 2018.55]. Most relevant to the design of the current iteration of the TeACH System (eg, direct quotes described below), formative usability testing sessions were completed remotely with 10 teens (mean age 15.9, SD 0.99 years; female: n=8, 80.0%; Hispanic or Latino: n=6, 60.0%; Middle Eastern of North African: n=1, 14.3%; White: n=6, 60.0%) and 7 parents of teens (mean age 41.86, SD 8.7 years; female: n=5, 71.4%; Hispanic or Latiné: n=1, 14.3%; Middle Eastern or North African: n=1, 14.3%; Black or African American: n=4, 57.1%) from the West and South Side Communities of Chicago.

Figure 3. Sample screenshots of the TeACH system.
TeACH System Assessment

The TeACH System uses the Kiddie-Computerized Adaptive Tests (K-CAT) Anxiety Module to assess teen patient anxiety symptoms [Gibbons RD, Kupfer DJ, Frank E, Lahey BB, George-Milford BA, Biernesser CL, et al. Computerized adaptive tests for rapid and accurate assessment of psychopathology dimensions in youth. J Am Acad Child Adolesc Psychiatry. 2020;59(11):1264-1273. [FREE Full text] [CrossRef] [Medline]50]. The K-CAT Anxiety Module (youth report; ages 7 to 17 years) uses an item bank of more than 200 items, typically offering 10 questions to a teen user to predict the likelihood of a diagnosis of generalized anxiety disorder (area under the receiver operating characteristic curve=0.83). However, the module is not limited to generalized anxiety disorder and may also be used for general anxiety screening in youth [Gibbons RD, Kupfer DJ, Frank E, Lahey BB, George-Milford BA, Biernesser CL, et al. Computerized adaptive tests for rapid and accurate assessment of psychopathology dimensions in youth. J Am Acad Child Adolesc Psychiatry. 2020;59(11):1264-1273. [FREE Full text] [CrossRef] [Medline]50]. Future iterations of the TeACH System may use the full K-CAT (ie, assessing anxiety, depression, substance misuse, oppositional defiant disorder, attention-deficit/hyperactivity disorder, mania, conduct disorder, and suicidality), but the current version of the TeACH System is solely assessing anxiety. This decision was driven by input from PPC clinicians and staff members who expressed concern about follow-up mental health care, safety, and workflow disruptions around more expansive digital mental health assessments [Stiles-Shields C, Gustafson EL, Lim PS, Bobadilla G, Thorpe D, Summersett Williams FC, et al. Pre-implementation determinants for digital mental health integration in Chicago pediatric primary care. J Pediatr Psychol. 2024. [CrossRef] [Medline]23]. Participants in the current study are eligible for randomization with a score greater than 29 on the K-CAT Anxiety Module, indicating mild, or higher anxiety symptoms [Gibbons RD, Kupfer DJ, Frank E, Lahey BB, George-Milford BA, Biernesser CL, et al. Computerized adaptive tests for rapid and accurate assessment of psychopathology dimensions in youth. J Am Acad Child Adolesc Psychiatry. 2020;59(11):1264-1273. [FREE Full text] [CrossRef] [Medline]50].

TeACH System Feedback

Following the completion of the K-CAT, the TeACH System informs users that they will be provided feedback and specific resources that were informed by feedback from “teens in your community.” The feedback provides an infographic that starts by stating: “Your answer tells us that you’ve been feeling anxiety and worry lately,” followed by the validation that “You’re not alone!” Following this, 4 quotes from Chicago teens describe anxiety as: “feeling worry and uneasiness”; “It’s constant!”; “Just worrying about the future”; and “Constantly worried, stressed, and anxious about every day in life!” before proceeding to viewing resources, users are prompted that “When you are feeling symptoms of anxiety, there are resources you can use to help you feel better.” In sum, the feedback section aims to briefly address multiple individual barriers to care, including problem recognition (ie, “Your answers tell us that you’ve been feeling anxiety and worry lately.”), stigma (ie, “You’re not alone!” and quotes from “Teens from your neighborhoods”), and confidence to act (ie, “When you are feeling symptoms of anxiety, there are resources you can use to help you feel better”) [Radez J, Reardon T, Creswell C, Lawrence PJ, Evdoka-Burton G, Waite P. Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. Eur Child Adolesc Psychiatry. 2021;30(2):183-211. [FREE Full text] [CrossRef] [Medline]24-Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10:113. [FREE Full text] [CrossRef] [Medline]26].

TeACH System Resources

Following the feedback, users are asked if they would like to receive DMH resources. The resources are all freely accessible online and are presented to participants through both sample screenshots and links to their direct sources (eg, App Store, YouTube, and TikTok). All resources are grounded in evidence-based skills (eg, progressive muscle relaxation and diaphragmatic breathing) and psychoeducation (including brief videos from teens and young adults with lived experience with anxiety). If participants indicate that they do not wish to receive DMH resources, they are asked to provide a reason as to why. If they would like to receive DMH resources, they are asked what types of resources they would prefer (eg, “Breathing Techniques,” “Apps,” and “Learning More”). This checkbox selection allows teens to view the content they wish, as opposed to getting all options at once, which can be overwhelming. Users may also opt to have the resources sent to them at their preferred method of contact (ie, email or text message).

TeACH System Platform

The TeACH System is intended to be adaptable and scalable. As such, using a simple but secure platform that may be easily edited at minimal cost was ideal. UIC’s instance of REDCap was therefore selected as the platform to build and manage the TeACH System [Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)-a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377-381. [FREE Full text] [CrossRef] [Medline]56]. REDCap is housed and managed by the University, as is common across multiple university and health care systems. To enhance the aesthetic appeal and engagement of the TeACH System for teen users, the UIC Innovation Center collaborated on its development within REDCap. An interdisciplinary team of researchers applied human-centered design techniques and analysis frameworks to effectively present the survey and maintain participant interaction throughout. They used user journey maps and extensive user testing to ensure a smooth and intuitive survey flow. The team also crafted a distinct visual language for the TeACH System, incorporating contemporary graphic elements inspired by popular social media platforms, calming color choices, and clear, simple language to appeal to the teen audience and put users at ease.

Control Condition

Following screening, assent, demographic characteristic assessment, and completion of the K-CAT Anxiety Module, participants randomized to the control condition receive different feedback and resources than those allocated to interact with the full TeACH System. The control condition includes immediate feedback about anxiety symptoms (ie, “Your answers tell us that you’ve been feeling anxiety and worry lately.”). Following this, participants are queried whether they would like access to a digital resource. If they respond negatively, they are prompted to provide their reasoning. If they respond positively, they are provided with a direct link to a free download of an evidence-based workbook for teens with anxiety [Free social work tools and resources: socialWorkersToolbox.com. Free Social Work Tools and resources SocialWorkersToolbox.com. The Anxiety Workbook for Teens: activities to help you deal with anxiety & worry - free social work tools and resources: SocialWorkersToolbox.Com. URL: https:/​/www.​socialworkerstoolbox.com/​the-anxiety-workbook-for-teens-activities-to-help-you-deal-with-anxiety-worry/​ [accessed 2024-06-21] 43,Schab LM. The Anxiety Workbook for Teens: activities to help you deal with anxiety and worry. California. New Harbinger Publications; 2021. 44].

Measures

Demographics

Following assent, teens are asked to report the following demographic information: name, age, ethnicity (Hispanic or Latiné and Middle Eastern or North African), race, pronouns, gender, preferred language, the reason for visiting primary care, and preferred method for contact (ie, email or text message).

Primary Outcomes

The primary outcomes are administered within REDCap and are assessed at 3 time points for all participants: (1) baseline: following assent and before administration of the K-CAT; (2) post interaction: immediately after receiving the allocated feedback and resources; and (3) maintenance: 1 week following the interaction. The primary outcomes are discrete variables focusing on individual-level barriers to mental health care (ie, symptom understanding, confidence to act [Radez J, Reardon T, Creswell C, Lawrence PJ, Evdoka-Burton G, Waite P. Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. Eur Child Adolesc Psychiatry. 2021;30(2):183-211. [FREE Full text] [CrossRef] [Medline]24-Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10:113. [FREE Full text] [CrossRef] [Medline]26]) and engagement with DMH (ie, likelihood to use DMH for anxiety, actual DMH use). Namely, through a questionnaire created for this study, participants rate on a Likert scale (1=not at all to 5=completely): (1) anxiety understanding (ie, “I understand what anxiety is.”); (2) confidence to act (ie, “I feel confident I can do something if I feel anxiety.”); and (3) likelihood to use digital tools for anxiety (ie, “If I feel anxiety, I would use a digital tool to help (app, website, and reel or video).”). Following this, participants indicate whether they have used a digital tool for their anxiety before (ie, yes, no, and unsure).

Usability

Usability of the TeACH System and its control arm are assessed post interaction (ie, immediately after receiving the allocated feedback and resources) and 1 week after the interaction through the After Scenario Questionnaire, a 3-item measure of usability [Lewis JR. Psychometric evaluation of an after-scenario questionnaire for computer usability studies. SIGCHI Bull. 1991;23(1):78-81. [CrossRef]57].

Data Analyses

Overview

Descriptive analyses will be conducted to characterize the sample, primary outcomes, and usability ratings of the TeACH System. To assess changes in the engagement outcomes over time and account for missing data, linear or generalized linear mixed effects regression models will examine differences in responses to the baseline, postinteraction, and maintenance questionnaires. Demographic variables and existing DMH use, as well as their interactions with time, will be examined as covariates to assess differential engagement outcomes based on these variables.

Sample Size and Power

Power and sample size computations were based on previously published work [Bhaumik DK, Roy A, Aryal S, Hur K, Duan N, Normand SLT, et al. Sample size determination for studies with repeated continuous outcomes. Psychiatr Ann. 2008;38(12):765-771. [FREE Full text] [CrossRef] [Medline]58,Hedeker D, Gibbons RD, Waternaux C. Sample size estimation for longitudinal designs with attrition: comparing time-related contrasts between two groups. Journal of Educational and Behavioral Statistics. 1999;24(1):70. [CrossRef]59]. Conservative estimates of sample sizes were estimated (ie, anticipating a 15% attrition rate on the follow-up survey), which indicated that 300 patients were deemed appropriate to examine the initial TeACH System use (ie, K-CAT Anxiety module, feedback, and resources) after being invited during their PPC appointment. With an expected 15% attrition rate for the follow-up questionnaire 1 week later, we would be adequately powered for within-subjects (pre vs post using the main effect of time) and between groups comparisons (TeACH System vs Control condition using treatment by time interaction). For within-subjects comparison, our proposed sample size is overpowered such that we should exceed 90% power to detect differences generally considered to be moderate in size (d=0.5) with a sample size exceeding approximately 70 participants. To detect within-subjects differences from baseline to endpoint equivalent to d=0.34 for the engagement outcomes, we would require a sample size of approximately 136 for 95% power. As such, our proposed sample is more than adequate for the planned within-subjects comparisons. For between-group comparisons with the anticipated 15% attrition rate, we should have 95% power to detect differences generally considered moderate in size (d=0.5) with 240 participants. With our proposed sample size of 300 participants, we will have 80% power to detect smaller differences equivalent to d=0.34.

Ethical Considerations

All procedures were approved by the institutional review boards of the University of Illinois Chicago (2024-0252) and Rush University Medical Center (20051313). Further, ongoing study monitoring is being overseen by an independent Data Safety and Monitoring Board. All participants complete a digital assent and are compensated for completing a follow-up assessment with a US $15 Amazon e-gift code (see the section Study Design below).


This study received funding from the National Institute of Mental Health on September 13, 2021 (K08 MH125069), and began recruiting at UIC in July 2024 and at Rush in August 2024. Earlier funded activities informed the design and implementation planning for the current trial [Stiles-Shields C, Gustafson EL, Lim PS, Bobadilla G, Thorpe D, Summersett Williams FC, et al. Pre-implementation determinants for digital mental health integration in Chicago pediatric primary care. J Pediatr Psychol. 2024. [CrossRef] [Medline]23,Stiles-Shields C, Ramos G, Ortega A, Psihogios A. Increasing digital mental health reach and uptake via youth partnerships. Npj Ment Health Res. 2023;2. [FREE Full text] [CrossRef] [Medline]32,Stiles-Shields C, Reyes KM, Archer J, Lennan N, Zhang J, Julion WA, et al. mHealth uses and opportunities for teens from communities with high health disparities: a mixed-methods study. J Technol Behav Sci. 2022:1-13. [FREE Full text] [CrossRef] [Medline]42,Stiles-Shields C, Reyes KM, Lennan N, Zhang J, Archer J, Julion WA, et al. Community teens' the COVID-19 pandemic experience: implications for engagement moving forward. J Clin Psychol Med Settings. 2024;31(1):143-152. [CrossRef] [Medline]54]. To date, 122 teens have assented to complete study activities, 80 have been randomized (an additional 24 teens have had subthreshold anxiety symptoms and were therefore not randomized), and 42 teens have completed the one-week follow-up assessment. We expect data collection to be completed by August 2025.


Overview

The current feasibility study aims to evaluate the TeACH System in terms of (1) increasing engagement with DMH and (2) addressing individual-level barriers to mental health care. These outcomes are being examined in the context of integration in urban PPC clinics and in comparison to a control condition (ie, access to a digital workbook). The design and implementation plan for the TeACH System involved collaborative input from key players (ie, teens, caregivers, and PPC staff and clinicians) to increase the likelihood of teen engagement and acceptability in a dynamic health care setting [Stiles-Shields C, Gustafson EL, Lim PS, Bobadilla G, Thorpe D, Summersett Williams FC, et al. Pre-implementation determinants for digital mental health integration in Chicago pediatric primary care. J Pediatr Psychol. 2024. [CrossRef] [Medline]23,Stiles-Shields C, Reyes KM, Archer J, Lennan N, Zhang J, Julion WA, et al. mHealth uses and opportunities for teens from communities with high health disparities: a mixed-methods study. J Technol Behav Sci. 2022:1-13. [FREE Full text] [CrossRef] [Medline]42,Stiles-Shields C, Reyes KM, Lennan N, Zhang J, Archer J, Julion WA, et al. Community teens' the COVID-19 pandemic experience: implications for engagement moving forward. J Clin Psychol Med Settings. 2024;31(1):143-152. [CrossRef] [Medline]54].

The TeACH System stands as one of a growing number of DMH LITs being evaluated and implemented in care settings (eg, [Schleider JL, Zapata JP, Rapoport A, Wescott A, Ghosh A, Kaveladze B, et al. Single-session interventions for mental health problems and service engagement: umbrella review of systematic reviews and meta-analyses. PsyArXiv. 2024. [CrossRef]60,Lorenzo-Luaces L, Howard J. Efficacy of an unguided, digital single-session intervention for internalizing symptoms in web-based workers: randomized controlled trial. J Med Internet Res. 2023;25:e45411. [FREE Full text] [CrossRef] [Medline]61]). DMH LITs have demonstrated promise in increasing engagement for minoritized teens, compared with more intensive digital and traditional care models [Cohen KA, Schleider JL. Adolescent dropout from brief digital mental health interventions within and beyond randomized trials. Internet Interv. 2022;27:100496. [FREE Full text] [CrossRef] [Medline]37]. Amid this landscape, some unique aspects of the TeACH System situate it to adapt and scale well based on user and setting needs. First, the TeACH System is housed on a secure, stable, and editable platform (ie, REDCap [Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)-a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377-381. [FREE Full text] [CrossRef] [Medline]56]) and may therefore be adapted across iterations and for differing populations and settings. For example, screening may be expanded from self-reported anxiety only (current version) to up to 8 diagnostic categories assessed through the K-CAT (ie, anxiety, attention-deficit/hyperactivity disorder, conduct disorder, depression, mania, oppositional defiant disorder, substance use disorder, and suicidality [Gibbons RD, Kupfer DJ, Frank E, Lahey BB, George-Milford BA, Biernesser CL, et al. Computerized adaptive tests for rapid and accurate assessment of psychopathology dimensions in youth. J Am Acad Child Adolesc Psychiatry. 2020;59(11):1264-1273. [FREE Full text] [CrossRef] [Medline]50]). Second, infographics and other design features may be changed to reflect the language and design preferences of different target groups. Similarly, resources may be edited or changed based on availability (eg, open access removal of a video), population preferences, and platform safety and availability (eg, if a “TikTok ban” results in higher teen use of a different platform). Finally, the TeACH System–and any future iterations are grounded in human-centered design with input from key players to target DMH engagement. Such targeting is hypothesized to serve as a mechanism of DMH to ultimately impact clinical outcomes [Graham AK, Lattie EG, Mohr DC. Experimental therapeutics for digital mental health. JAMA Psychiatry. 2019;76(12):1223-1224. [FREE Full text] [CrossRef] [Medline]62]. In sum, the TeACH System has been designed for teens with both anxiety and socially complex needs while visiting primary care. However, future iterations may be easily adapted at any level for integration in settings youth visit regularly and trust.

Future Directions

The scope of this study is associated with specific limitations and caveats, all of which inform future research directions. First, the current iteration of the TeACH System focuses solely on anxiety. While originally aimed to include the full K-CAT assessment, the scope was limited to anxiety to meet the implementation needs of PPC clinicians and staff members [Stiles-Shields C, Gustafson EL, Lim PS, Bobadilla G, Thorpe D, Summersett Williams FC, et al. Pre-implementation determinants for digital mental health integration in Chicago pediatric primary care. J Pediatr Psychol. 2024. [CrossRef] [Medline]23]. Anxiety was also selected to establish proof of concept for this first iteration, as anxiety is highly prevalent and socially minimized by clinicians and the public, making it less likely to be effectively screened and treated. Once the TeACH System establishes initial feasibility, it can be broadened to address multiple disorders through a larger study. Second, the K-CAT demonstrates the strongest accuracy when the parent proxy report and child self-report are integrated [Gibbons RD, Kupfer DJ, Frank E, Lahey BB, George-Milford BA, Biernesser CL, et al. Computerized adaptive tests for rapid and accurate assessment of psychopathology dimensions in youth. J Am Acad Child Adolesc Psychiatry. 2020;59(11):1264-1273. [FREE Full text] [CrossRef] [Medline]50]. While the current iteration of the TeACH System is solely teen-facing, there is the potential for the TeACH System to have both caregiver and teen-facing elements in the future. Alternatively, summative feedback from this study may indicate that teens or families prefer for this to be a teen-facing tool, but with the option to inform trusted adults in their life about the indication of anxiety from the K-CAT. Further, the K-CAT is available and validated in both English and Spanish. As such, future iterations may also include cultural and linguistic adaptations to serve teens and caregivers who speak Spanish. Finally, while PPC is typically visited annually by most teens, integration in this care setting does not ensure that all teens will be reached. PPC was selected to establish feasibility for reasons detailed above, but future iterations may be adapted and integrated in other community spaces in which teens and families spend their time (eg, schools, parks, libraries, and churches).

Conclusions

LITs have a long-standing history of benefiting individuals with mild to moderate mental health symptoms [Cuijpers P, Schuurmans J. Self-help interventions for anxiety disorders: an overview. Curr Psychiatry Rep. 2007;9(4):284-290. [FREE Full text] [CrossRef] [Medline]28], implicating DMH LITs as a promising first-line approach in care settings [Lorenzo-Luaces L, Fite RE. Wider, faster, more: reenvisioning depression treatment research in the United States. Practice Innovations. 2024;9(1):19-29. [CrossRef]29]. The TeACH System represents 1 possible DMH LIT that may provide brief assessment, feedback, and resources for teen patients without unduly burdening a busy health care environment nor requiring the approval of a guardian to use. This study will provide preliminary feasibility data that may inform how the TeACH System and other DMH LITs might better engage and support teens with socially complex needs.

Acknowledgments

The team wishes to thank the clinicians, staff members, and patients at the Child and Youth Center at the University of Illinois Chicago and the Pediatric Primary Care clinics of Rush University Medical Center.

Research reported in this publication was supported by the United States National Institute of Mental Health grant (K08 MH125069). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Authors' Contributions

CST led all aspects of this work, including conceptualization, funding acquisition, methodology, and writing the original draft of the manuscript. GB, KR, and ML conducted project administration and supervision. DLS led formal analysis. CF, CA, GD, RMC, NM, GM, AT, and KMW completed visualization and design activities. ELG, WAJ, and NSK provided additional supervision.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Peer-review report from the Mental Health Services Study Section, National Institute of Mental Health Initial Review Group (NIH).

PDF File (Adobe PDF File), 92 KB

  1. Murthy VH. The mental health of minority and marginalized young people: an opportunity for action. Public Health Rep. 2022;137(4):613-616. [FREE Full text] [CrossRef] [Medline]
  2. Child Mind Institute.. Children?s Mental Health Report. New York. Child Mind Institute, Inc; 2015.
  3. Merikangas KR, He J, Burstein ME, Swendsen J, Avenevoli S, Case B, et al. Service utilization for lifetime mental disorders in U.S. adolescents: results of the national comorbidity survey-adolescent supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2011;50(1):32-45. [FREE Full text] [CrossRef] [Medline]
  4. Merikangas KR, He JP, Burstein M, Swanson SA, Avenevoli S, Cui L, et al. Lifetime prevalence of mental disorders in U.S. adolescents: results from the national comorbidity survey replication--adolescent supplement (NCS-A). J Am Acad Child Adolesc Psychiatry. 2010;49(10):980-989. [FREE Full text] [CrossRef] [Medline]
  5. Substance Abuse and Mental Health Services Administration (SAMHSA). Results from the 2013 national survey on drug use and health: summary of findings. URL: http://www.samhsa.gov/data/sites/default/files/NSDUHresultsPDFWHTML2013/Web/NSDUHresults2013.pdf [accessed 2014-09-05]
  6. Flores G, Committee On Pediatric Research. Racial and ethnic disparities in the health and health care of children. Pediatrics. 2010;125(4):e979-e1020. [CrossRef] [Medline]
  7. Beck AF, Tschudy MM, Coker TR, Mistry KB, Cox JE, Gitterman BA, et al. Determinants of health and pediatric primary care practices. Pediatrics. 2016;137(3):e20153673. [CrossRef] [Medline]
  8. Bounds DT, Winiarski DA, Otwell CH, Tobin V, Glover AC, Melendez A, et al. Considerations for working with youth with socially complex needs. J Child Adolesc Psychiatr Nurs. 2020;33(4):209-220. [FREE Full text] [CrossRef] [Medline]
  9. TF K, L K, K J. Human immunodeficiency virus infection in young adults: treatment of substance use disorders as a priority component of HIV prevention, care and treatment in low and middle income countries. IJHR. Sep 01, 2016:97-104. [FREE Full text] [CrossRef]
  10. Salloum A, Johnco C, Lewin AB, McBride NM, Storch EA. Barriers to access and participation in community mental health treatment for anxious children. J Affect Disord. 2016;196:54-61. [CrossRef] [Medline]
  11. Douthit N, Kiv S, Dwolatzky T, Biswas S. Exposing some important barriers to health care access in the rural USA. Public Health. 2015;129(6):611-620. [CrossRef] [Medline]
  12. Allen EM, Call KT, Beebe TJ, McAlpine DD, Johnson PJ. Barriers to care and health care utilization among the publicly insured. Med Care. 2017;55(3):207-214. [FREE Full text] [CrossRef] [Medline]
  13. Hacker K, Anies M, Folb BL, Zallman L. Barriers to health care for undocumented immigrants: a literature review. Risk Manag Healthc Policy. 2015;8:175-183. [FREE Full text] [CrossRef] [Medline]
  14. Stevens J, Kelleher KJ, Ward-Estes J, Hayes J. Perceived barriers to treatment and psychotherapy attendance in child community mental health centers. Community Ment Health J. 2006;42(5):449-458. [CrossRef] [Medline]
  15. de Haan AM, Boon AE, de Jong JT, Hoeve M, Vermeiren RR. A meta-analytic review on treatment dropout in child and adolescent outpatient mental health care. Clin Psychol Rev. 2013;33(5):698-711. [CrossRef] [Medline]
  16. Koball H, Jiang Y. Basic facts about low-income children: children under 18 years. New York. National Center for Children in Poverty; 2018.
  17. Braveman P, Barclay C. Health disparities beginning in childhood: a life-course perspective. Pediatrics. 2009;124 Suppl 3:S163-S175. [CrossRef] [Medline]
  18. Bloom B, Cohen RA, Freeman G. Summary health statistics for U.S. children: National Health Interview Survey, 2010. Vital Health Stat 10. Dec 2011;(250):1-80. [FREE Full text] [Medline]
  19. Walter HJ, Bukstein OG, Abright AR, Keable H, Ramtekkar U, Ripperger-Suhler J, et al. Clinical practice guideline for the assessment and treatment of children and adolescents with anxiety disorders. J Am Acad Child Adolesc Psychiatry. 2020;59(10):1107-1124. [CrossRef] [Medline]
  20. Bose J, Zeno R, Warren B, Sinnott LT, Fitzgerald EA. Implementation of universal adolescent depression screening: quality improvement outcomes. J Pediatr Health Care. 2021;35(3):270-277. [CrossRef] [Medline]
  21. Kenny J, Costello L, Kelsay K, Bunik M, Xiong S, Chiaravalloti L, et al. All hands on deck: addressing adolescent depression in pediatric primary care. J Pediatr Psychol. 2021;46(8):903-911. [CrossRef] [Medline]
  22. Acri M, Zhang S, Chomanczuk AH, O’Brien KH, De Zitella MLM, Scrofani PR, et al. Barriers and facilitators to mental health screening efforts for families in pediatric primary care. Journal of Family Social Work. 2018;21(3):191-199. [CrossRef]
  23. Stiles-Shields C, Gustafson EL, Lim PS, Bobadilla G, Thorpe D, Summersett Williams FC, et al. Pre-implementation determinants for digital mental health integration in Chicago pediatric primary care. J Pediatr Psychol. 2024. [CrossRef] [Medline]
  24. Radez J, Reardon T, Creswell C, Lawrence PJ, Evdoka-Burton G, Waite P. Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. Eur Child Adolesc Psychiatry. 2021;30(2):183-211. [FREE Full text] [CrossRef] [Medline]
  25. Wisdom JP, Clarke GN, Green CA. What teens want: barriers to seeking care for depression. Adm Policy Ment Health. 2006;33(2):133-145. [FREE Full text] [CrossRef] [Medline]
  26. Gulliver A, Griffiths KM, Christensen H. Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry. 2010;10:113. [FREE Full text] [CrossRef] [Medline]
  27. Reardon T, Harvey K, Baranowska M, O'Brien D, Smith L, Creswell C. What do parents perceive are the barriers and facilitators to accessing psychological treatment for mental health problems in children and adolescents? A systematic review of qualitative and quantitative studies. Eur Child Adolesc Psychiatry. 2017;26(6):623-647. [FREE Full text] [CrossRef] [Medline]
  28. Cuijpers P, Schuurmans J. Self-help interventions for anxiety disorders: an overview. Curr Psychiatry Rep. 2007;9(4):284-290. [FREE Full text] [CrossRef] [Medline]
  29. Lorenzo-Luaces L, Fite RE. Wider, faster, more: reenvisioning depression treatment research in the United States. Practice Innovations. 2024;9(1):19-29. [CrossRef]
  30. Fleming T, Bavin L, Lucassen M, Stasiak K, Hopkins S, Merry S. Beyond the trial: systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. J Med Internet Res. 2018;20(6):e199. [FREE Full text] [CrossRef] [Medline]
  31. Psihogios AM, Lane-Fall MB, Graham AK. Adolescents are still waiting on a digital health revolution: accelerating research-to-practice translation through design for implementation. JAMA Pediatr. 2022;176(6):545-546. [CrossRef] [Medline]
  32. Stiles-Shields C, Ramos G, Ortega A, Psihogios A. Increasing digital mental health reach and uptake via youth partnerships. Npj Ment Health Res. 2023;2. [FREE Full text] [CrossRef] [Medline]
  33. Karyotaki E, Kleiboer A, Smit F, Turner DT, Pastor AM, Andersson G, et al. Predictors of treatment dropout in self-guided web-based interventions for depression: an 'individual patient data' meta-analysis. Psychol Med. 2015;45(13):2717-2726. [FREE Full text] [CrossRef] [Medline]
  34. Schueller SM, Tomasino KN, Mohr DC. Integrating human support into behavioral intervention technologies: the efficiency model of support. Clinical Psychology: Science and Practice. 2017;24(1):27-45. [CrossRef]
  35. Coughlin LN, Nahum-Shani I, Philyaw-Kotov ML, Bonar EE, Rabbi M, Klasnja P, et al. Developing an adaptive mobile intervention to address risky substance use among adolescents and emerging adults: usability study. JMIR Mhealth Uhealth. 2021;9(1):e24424. [FREE Full text] [CrossRef] [Medline]
  36. Seng E, Prieto P, Boucher G, Vives-Mestres M. Anxiety, incentives, and adherence to self-monitoring on a mobile health platform: a naturalistic longitudinal cohort study in people with headache. Headache. 2018;58(10):1541-1555. [FREE Full text] [CrossRef] [Medline]
  37. Cohen KA, Schleider JL. Adolescent dropout from brief digital mental health interventions within and beyond randomized trials. Internet Interv. 2022;27:100496. [FREE Full text] [CrossRef] [Medline]
  38. Scholten H, Granic I. Use of the principles of design thinking to address limitations of digital mental health interventions for youth: viewpoint. J Med Internet Res. 2019;21(1):e11528. [FREE Full text] [CrossRef] [Medline]
  39. Mohr DC, Lyon AR, Lattie EG, Reddy M, Schueller SM. Accelerating digital mental health research from early design and creation to successful implementation and sustainment. J Med Internet Res. 2017;19(5):e153. [FREE Full text] [CrossRef] [Medline]
  40. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. [FREE Full text] [CrossRef] [Medline]
  41. Damschroder LJ, Reardon CM, Widerquist MA, Lowery J. The updated consolidated framework for implementation research based on user feedback. Implement Sci. 2022;17(1):75. [FREE Full text] [CrossRef] [Medline]
  42. Stiles-Shields C, Reyes KM, Archer J, Lennan N, Zhang J, Julion WA, et al. mHealth uses and opportunities for teens from communities with high health disparities: a mixed-methods study. J Technol Behav Sci. 2022:1-13. [FREE Full text] [CrossRef] [Medline]
  43. Free social work tools and resources: socialWorkersToolbox.com. Free Social Work Tools and resources SocialWorkersToolbox.com. The Anxiety Workbook for Teens: activities to help you deal with anxiety & worry - free social work tools and resources: SocialWorkersToolbox.Com. URL: https:/​/www.​socialworkerstoolbox.com/​the-anxiety-workbook-for-teens-activities-to-help-you-deal-with-anxiety-worry/​ [accessed 2024-06-21]
  44. Schab LM. The Anxiety Workbook for Teens: activities to help you deal with anxiety and worry. California. New Harbinger Publications; 2021.
  45. Creswell JW. Research Design: qualitative, quantitative, and mixed methods approaches. United States. SAGE; 2014.
  46. Safavi K, Mathews SC, Bates DW, Dorsey ER, Cohen AB. Top-funded digital health companies and their impact On high-burden, high-cost conditions. Health Aff (Millwood). 2019;38(1):115-123. [CrossRef] [Medline]
  47. Emslie GJ. Pediatric anxiety-underrecognized and undertreated. N Engl J Med. 2008;359(26):2835-2836. [CrossRef] [Medline]
  48. Strawn JR, Lu L, Peris TS, Levine A, Walkup JT. Research review: pediatric anxiety disorders-what have we learnt in the last 10 years? J Child Psychol Psychiatry. 2021;62(2):114-139. [FREE Full text] [CrossRef] [Medline]
  49. Evans DL, Foa EB, Gur RE, Hendin H, O?Brien CP, Seligman MEP, et al. Treating and preventing adolescent mental health disorders: what we know and what we don't know. Jericho. Oxford University Press; 2005.
  50. Gibbons RD, Kupfer DJ, Frank E, Lahey BB, George-Milford BA, Biernesser CL, et al. Computerized adaptive tests for rapid and accurate assessment of psychopathology dimensions in youth. J Am Acad Child Adolesc Psychiatry. 2020;59(11):1264-1273. [FREE Full text] [CrossRef] [Medline]
  51. Ansell DA, Oliver-Hightower D, Goodman LJ, Lateef OB, Johnson TJ. Health equity as a system strategy: the rush university medical center framework. NEJM Catalyst. 2021;2(5). [CrossRef]
  52. McCarville E, Martin MA, Pratap P, Pinsker E, Seweryn SM, Peters KE. Understanding critical factors associated with integration of community health workers into health and hospital systems. J Interprof Care. 2024;38(3):507-516. [CrossRef] [Medline]
  53. Suarez-Balcazar Y, Harper GW, Lewis R. An interactive and contextual model of community-university collaborations for research and action. Health Educ Behav. 2005;32(1):84-101. [CrossRef] [Medline]
  54. Stiles-Shields C, Reyes KM, Lennan N, Zhang J, Archer J, Julion WA, et al. Community teens' the COVID-19 pandemic experience: implications for engagement moving forward. J Clin Psychol Med Settings. 2024;31(1):143-152. [CrossRef] [Medline]
  55. Gustafson E, Moscato EL, Stiles-Shields C, Psihogios AM, Guler J, Mehta T. Community-engaged research: a primer for Pediatric Psychology. J Pediatr Psychol. 2018.
  56. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)-a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377-381. [FREE Full text] [CrossRef] [Medline]
  57. Lewis JR. Psychometric evaluation of an after-scenario questionnaire for computer usability studies. SIGCHI Bull. 1991;23(1):78-81. [CrossRef]
  58. Bhaumik DK, Roy A, Aryal S, Hur K, Duan N, Normand SLT, et al. Sample size determination for studies with repeated continuous outcomes. Psychiatr Ann. 2008;38(12):765-771. [FREE Full text] [CrossRef] [Medline]
  59. Hedeker D, Gibbons RD, Waternaux C. Sample size estimation for longitudinal designs with attrition: comparing time-related contrasts between two groups. Journal of Educational and Behavioral Statistics. 1999;24(1):70. [CrossRef]
  60. Schleider JL, Zapata JP, Rapoport A, Wescott A, Ghosh A, Kaveladze B, et al. Single-session interventions for mental health problems and service engagement: umbrella review of systematic reviews and meta-analyses. PsyArXiv. 2024. [CrossRef]
  61. Lorenzo-Luaces L, Howard J. Efficacy of an unguided, digital single-session intervention for internalizing symptoms in web-based workers: randomized controlled trial. J Med Internet Res. 2023;25:e45411. [FREE Full text] [CrossRef] [Medline]
  62. Graham AK, Lattie EG, Mohr DC. Experimental therapeutics for digital mental health. JAMA Psychiatry. 2019;76(12):1223-1224. [FREE Full text] [CrossRef] [Medline]


DMH: digital mental health tools
K-CAT: Kiddie Computerized Adaptive Test
LIT: low-intensity treatment
PPC: pediatric primary care
REDCap: Research Electronic Data Capture
RUSH: Rush University Medical Center
TeACH System: Teen Assess, Check, and Heal System
UIC: University of Illinois Chicago


Edited by A Schwartz; The proposal for this study was peer-reviewed by: Mental Health Services Study Section, National Institute of Mental Health Initial Review Group (NIH). See the Multimedia Appendix for the peer-review report; submitted 19.08.24; accepted 16.12.24; published 18.02.25.

Copyright

©Colleen Stiles-Shields, Gabriella Bobadilla, Karen Reyes, Erika L Gustafson, Matthew Lowther, Dale L Smith, Charles Frisbie, Camilla Antognini, Grace Dyer, Rae MacCarthy, Nicolò Martinengo, Guy Morris, Alissa Touranachun, Kimberlee M Wilkens, Wrenetha A Julion, Niranjan S Karnik. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 18.02.2025.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.