Published on in Vol 8, No 2 (2019): February

This is a member publication of Florida State University

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/11204, first published .
Adolescent Trials Network for HIV-AIDS Scale It Up Program: Protocol for a Rational and Overview

Adolescent Trials Network for HIV-AIDS Scale It Up Program: Protocol for a Rational and Overview

Adolescent Trials Network for HIV-AIDS Scale It Up Program: Protocol for a Rational and Overview

Protocol

1College of Medicine, Florida State University, Tallahassee, FL, United States

2Center for HIV Educational Studies and Training, Hunter College of the City University of New York, New York, NY, United States

3Health Psychology and Clinical Science Doctoral Program, Graduate Center of the City University of New York, New York, NY, United States

4Hackensack Meridian School of Medicine, Seton Hall University, South Orange, NJ, United States

Corresponding Author:

Sylvie Naar, PhD

College of Medicine

Florida State University

Main Campus

1115 West Call Street

Tallahassee, FL, 32306

United States

Phone: 1 248 207 2903

Email: sylvie.naar@med.fsu.edu


Background: The past 30 years have witnessed such significant progress in the prevention and treatment of HIV/AIDS that an AIDS-free generation and the end to the global AIDS epidemic are ambitious, but achievable, national and global goals. Despite growing optimism, globally, youth living with HIV are markedly less likely to receive antiretroviral therapy than adults (23% vs 38%). Furthermore, marked health disparities exist regarding HIV infection risk, with young men of color who have sex with men disproportionately affected. A large body of research has identified highly impactful facilitators of and barriers to behavior change. Several efficacious interventions have been created that decrease the rate of new HIV infections among youth and reduce morbidity among youth living with HIV. However, full benefits that should be possible based on the tools and interventions currently available are yet to be realized in youth, in large part, because efficacious interventions have not been implemented in real-world settings. Scale It Up (SIU) primarily aims to assemble research teams that will ultimately bring to practice evidence-based interventions that positively impact the youth HIV prevention and care cascades, and in turn, advance the fields of implementation science and self-management science.

Objective: This paper aims to describe the structure of the U19-SIU and the effectiveness-implementation hybrid trials, as well as other center-wide protocols and initiatives, implemented within SIU.

Methods: SIU will achieve its aims through 4 individual primary protocols, 2 center-wide protocols, and 3 cross-project initiatives.

Results: SIU was funded by National Institute for Child Health and Human Development (U19HD089875) and began in October 2016. As of November 2018, 6 SIU protocols have launched at least the first phase of work (ATN 144 SMART: Sequential Multiple Assignment Randomized Trial; ATN 145 YMHP: Young Men’s Health Project; ATN 146 TMI: Tailored Motivational Interviewing Intervention; ATN 153 EPIS: Exploration, Preparation, Implementation, Sustainment model; ATN 154 CM: Cascade Monitoring; ATN 156 We Test: Couples' Communication and HIV Testing). Further details can be found in the individual protocol papers.

Conclusions: To date, the youth HIV research portfolio has not adequately advanced the important care area of self-management. SIU protocols and initiatives address this broad issue by focusing on evaluating the effectiveness and implementation of self-management interventions. SIU is highly innovative for 5 primary reasons: (1) our research framework expands the application of “self-management”; (2) the 4 primary protocols utilize innovative hybrid designs; (3) our Analytic Core will conduct cost-effectiveness analyses of each intervention; (4) across all 4 primary protocols, our Implementation Science Core will apply implementation scales designed to assess inner and outer context factors; and (5) we shall advance understanding of the dynamics between provider and patient through analysis of recorded interactions.

International Registered Report Identifier (IRRID): DERR1-10.2196/11204

JMIR Res Protoc 2019;8(2):e11204

doi:10.2196/11204

Keywords



The last 30 years have witnessed significant progress in the prevention and treatment of HIV/AIDS. Combination antiretroviral therapy (ART) has transformed HIV infection from a rapidly debilitating, fatal disease into a manageable chronic disease with high potential for a healthy life for multiple decades [1,2]. Combinations of >25 formulations of 6 classes of ART maintain the effectiveness of drug therapy in reducing viral transmission. Combined with widely available, accurate, and rapid HIV testing, pre-exposure prophylaxis (PrEP) for individuals at high risk, and universal viral suppression for those infected, an AIDS-free generation and the end to the global AIDS epidemic are ambitious, but achievable national and global goals [3,4].

However, despite growing optimism about this potentially achievable outcome, the epidemic remains a major and increasing cause of morbidity and mortality among adolescents and young adults (hereafter called “youth”) and ethnic and racial minorities. Globally, youth living with HIV (YLH) are markedly less likely to receive ART than adults (23% vs 38%) [3,5-7]. In the United States, while the overall HIV incidence from 2003 to 2014 decreased by 25%, among youth aged 13-24 years, it has increased by 43% [8]. Moreover, among youth, new infections have not been evenly distributed. Several minority groups have been overly represented; almost three-fourths of new infections were among men who have sex with men (MSM), and over half of new infections were among African American youth [9]. Young MSM of color continue to see disproportionate HIV infection rates, and these clear disparities have guided the focus for the National HIV/AIDS Strategy for the United States [10].

For ART to be effective, YLH must develop self-management behaviors at every stage of the HIV treatment cascade—linkage to care, timely initiation of care, persistence, and adherence to ART. Similarly, youth at high-risk for HIV infection must develop self-management behaviors to be fully engaged in the HIV prevention cascade—routine HIV and sexually transmitted infections testing and PrEP knowledge, access, uptake, and adherence when warranted [10-12]. While multiple barriers across range systems affect the HIV prevention and treatment cascades for youth, self-management interventions focus on how to negotiate these barriers in their current state, developing resilience even in the face of such obstacles. A quarter century of behavioral intervention research has focused on improving self-management for primary and secondary HIV prevention. This large body of research has identified highly impactful facilitators of and barriers to behavior change and has created several efficacious interventions that decrease the rate of new HIV infections among youth and reduce morbidity among YLH. However, full benefits that should be possible based on the tools and interventions currently available have yet to be realized in youth, in large part, because efficacious interventions have not been implemented in real-world settings. As a recent systematic review concluded, “As we move towards an era of universal treatment for HIV, the clinical and public health benefits of widening access to ART for adolescents will not be realized until cost-effective and sustainable service delivery interventions are widely implemented” [13].

Despite the success of the Center for Disease Control’s (CDC’s) program for disseminating evidence-based HIV-related behavioral interventions, a growing body of literature highlights substantial barriers to the effective implementation of these interventions in real-world settings [14] particularly those addressing self-management. Even less attention has been paid to the study of the implementation of behavioral interventions in HIV care settings [15], particularly in adolescent HIV clinics and community-based organizations. The Scale It Up (SIU) U19 was funded as a National Institutes of Health cooperative agreement as part of the Adolescent Medicine Trials Network for HIV/AIDS Interventions (ATN). SIU is committed to the development and assessment of the effectiveness of theoretically and developmentally sound interventions to improve HIV prevention and care self-management and to accelerating the pace of implementation. The primary aim of SIU is to assemble research teams that will develop, test, and bring to practice theoretically and developmentally sound self-management interventions that positively impact the youth HIV prevention and care cascades. SIU protocols focus on implementing interventions that have already been shown to be culturally appropriate and efficacious in minority populations most impacted by the epidemic. By utilizing common models and methods across protocols, we hope to advance the fields of implementation science (IS) and self-management science.


Aims

SIU will achieve its aims through 4 primary study protocols (ATN 144 SMART: Sequential Multiple Assignment Randomized Trial; ATN 145 YMHP: Young Men’s Health Project; ATN 146 TMI: Tailored Motivational Interviewing Intervention; ATN 156 We Test: Couples' Communication and HIV Testing) [16-18], 2 center-wide protocols (ATN 153 EPIS and ATN 154 Cascade Monitoring; Carcone et al, under review, and Pennar et al, under review), and 3 cross-project initiatives. A substantial amount of literature underscores the importance of shortening the time from conceptualization of a research idea to service delivery. This concern has led to the development of effectiveness- implementation hybrid designs to facilitate the transition of promising interventions into practice [19]. Type 1 hybrid designs maintain a primary focus on a rigorous evaluation of the intervention but also gather data that will inform a subsequent implementation program. Type 2 hybrids place a dual focus on assessing the effectiveness of the intervention and evaluating the implementation strategy. Type 3 hybrid designs also focus on the implementation strategy and its effect of adaption and fidelity, but, in addition, assess patient-level or subject-level outcomes such as symptoms or disease progression [19,20]. The 4 SIU primary study protocols include 2 Type 1 hybrids, 1 Type 2 hybrid, and 1 Type 3 hybrid. Two additional center-wide protocols measure contextual factors and cascade outcomes across the primary studies, and the 3 cross-project initiatives address cost-effectiveness, self-management constructs, and communication science within each protocol (Figure 1).

Scale It Up Structure

SIU is organized into 3 cores as follows: Management Core (MC); Analytic Core (AC); and an Implementation Science Core (ISC). The MC includes a Recruitment and Enrollment Center that is responsible for protocol development, project management, clinical site communication, recruitment and retention, and data collection and management. Subject recruitment venues (SRVs) are both Web-based and actual physical sites (12 sites, 10 of which provide HIV care). Our SRVs were selected on the basis of the HIV incidence (as shown in Figure 2) and based on previous successful experience with the enrollment of youth into intervention trials. Virtual recruitment strategies include the following: (1) Social Media Recruitment via national ad campaigns on social media sites; (2) Geosocial Networking Apps Recruitment —staff will also recruit through ads on geosocial networking dating apps using a pop-up message shown when a user first logs in and through a message sent by the app directly to the user’s inbox; and (3) Text-based Recruitment— flyers and other recruitment materials will be distributed to HIV-related organizations and those serving youth. Using Trumpia, a popular short message service (SMS) text messaging marketing service, interested youth will text a keyword (eg, “RESEARCH”) to a 5-digit number (eg, 99-000) to learn about how to screen for the protocols.

In addition, the MC includes a Community Engagement Center, with a Youth Community Advisory Board (YCAB) consisting of youth representatives from each of the 12 physical sites within SIU. The group meets virtually on a monthly basis and convenes annual in-person meetings. The SIU research team does not take the importance of meaningful community involvement in all aspects of our research lightly [21], with several of us having devoted a substantial portion of our research careers to cultivating such relationships [22-32]. Our YCAB develops their own strategic plan for community engagement, provide commentary on summaries of the protocols before they go to the field, and are included in discussions of progress and problems. The YCAB collaborates with investigators on how to best inform the communities about the planned research, that is, posting descriptions of the research projects at each site and discussions in advance of implementation with local staff and community representatives.

Figure 1. The effectiveness-implementation hybrid designs used in Scale It Up (SIU).
View this figure
Figure 2. The HIV incidence in the United States and subject recruitment venue locations.
View this figure

The YCAB will be involved in presenting the findings so that the community can understand them and in a fashion that will reach and be beneficial to community members. Furthermore, community and ATN provider input will be especially important with regard to implementing successful interventions beyond the network.

The AC provides optimal analytic support for the protocol development with the MC, statistical analysis plans for quantitative data, and the development of new methodologies and analytic strategies to accelerate the time from idea generation to program delivery. In addition, the AC facilitates the integration of scientific efforts and resources (including empirical data) across multiple research projects in a cost-effective way by providing a virtual platform for resource coordination and sharing and provide analytic support for center-wide protocols and initiatives. Finally, the AC aims to enhance the research capacity of participating institutes or investigators in areas of adolescent HIV self-management and IS through training and mentoring in advanced and innovative research methodologies, fostering high-quality research, data sharing, and improving the scholarly productivity of the network investigators, especially early career investigators.

The ISC facilitates a unified approach to IS research by applying a unified IS model to strengthen planning and implementation. The ISC provides core measures for understanding contextual factors and assessing intervention fidelity and maintains a library of categorized research papers. The ISC develops facilitator training and support resources and tools for wide-scale intervention implementation and researchers’ strategies or commercialization models for publishing the intervention products or preparing for the next steps with the interventions. Finally, the ISC develops and maintains the SIU website both internal for the center, as well as for the public, and supports early-stage investigators to develop IS studies.

Regulatory

SIU uses a single Institutional Review Board (IRB) to accelerate the timeline of clinical research. All SRVs and investigator institutions sign reliance agreements with the IRB of record, which is located at Florida State University. While SRVs receive regular updates and notices of continuations or changes in protocol, amendments are only submitted to the IRB of record. A waiver of parental consent or assent is obtained for participants who are 15-17 years old. All clinical trials are registered on ClinicalTrials.gov, and all protocols utilize the ATN Certificate of Confidentiality. SIU utilizes a single monitoring system for all protocols to harmonize review standards across protocols. The review process of the most vulnerable protocol will be applied to all SIU protocols, thereby ensuring adequate oversight. An independent study monitoring committee consists of 3 independent experts who possess the relevant expertise (eg, HIV-related research and prevention, adolescent medicine, and sexual health) to evaluate each center protocol and who do not have a conflict of interest. The committee will review each protocol and monitor data and safety monitoring every 6 months, with additional ad-hoc reviews as necessary.


Scale It Up Protocols and Initiatives

The SIU U19 cores evaluate and prepare for implementation self-management interventions to increase the likelihood that youth will be adherent with each step of the HIV prevention and care cascades with 4 individual effectiveness- implementation hybrid trial protocols and 2 center-wide protocols that assess contextual implementation factors and cascade outcomes. Furthermore, the cross-project initiatives of cost-effectiveness analyses, analysis of a theoretically driven self-management model, and analysis of patient-provider communication are incorporated into multiple protocols.

Effectiveness-Implementation Hybrid Trials

The individual project protocols are described later in this supplement. The following is a brief synopsis of each (Figure 3).

ATN 144 is a SMART design that tests the sequencing of SMS text message cell phone support (CPS), and contingency management in youth nonadherent to ART [16]. All study procedures will be conducted over the Web or by phone so that youth need not attend a clinic to participate, and clinics only need to refer participants to the study website instead of staffing for recruitment. As a Type 1 effectiveness-implementation hybrid, while implementation context will be assessed, the focus is on the intervention effectiveness in true real-world settings (in and out of the clinic and across the nation). Youth are first randomized to 12 weeks of CPS versus SMS text messaging. Several critical issues surrounding incentives and intervention tapering are explored through a second randomization—(1) if CPS or SMS text messaging for 12 weeks is successful, does viral load (VL) suppression persist longer if the intervention dose is tapered (ie, less frequent) over the next 12 weeks versus terminating CPS and receiving standard care; (2) if CPS or SMS text messaging is not successful in the first 12 weeks, will VL suppression occur if incentives for intervention adherence are added for 12 more weeks; and (3) if CPS or SMS text messaging is not successful, will VL suppression occur if youth receive the other intervention condition (with the addition of incentives) or if they are allowed 12 more weeks within their initial condition (with the addition of incentives). Details are provided in ATN 144 SMART [16].

Figure 3. Scale It Up (SIU) overall. PreP: pre-exposure prophylaxis. STI: sexually transmitted infection.
View this figure

ATN145, the YMHP, tests a 4-session intervention integrating motivational interviewing (MI), personalized feedback, and problem-solving skills to reduce condomless anal sex (CAS) and substance use among HIV-negative young MSM (Parsons et al, under review). Previous studies have found that youth receiving YMHP reported markedly greater reductions in CAS and substance use than youth in the comparison condition, and the CDC recently rated YMHP as “Best Evidence” and included it in the compendium of Evidence-Based Interventions for HIV Prevention [33]. YMHP now requires evaluation through an effectiveness-implementation Hybrid Type 2 trial to both provide the best evidence to inform practitioners as to which approach to delivery (clinic-based or phone-based) is most effective and cost-effective prior to dissemination on a wider scale (comparative effectiveness design) while simultaneously testing a model of intervention implementation through training local supervisors and studying contextual barriers and facilitators. The trial will assess HIV prevention-focused outcomes (sexually transmitted infections, PrEP uptake) and self-management behaviors (condom use, reduction in substance use, PrEP adherence if uptake is achieved), as well as intervention fidelity. Participants complete the 4-session intervention and an immediate posttest assessment 3 months after the baseline. They are then assessed every 3 months for 12 months postintervention. Details are provided in ATN 145 YMHP (Parsons et al, under review).

ATN 146, TMI [17] addresses the training of health care providers to deliver MI, a method of communication shown to improve multiple points across the youth prevention and care cascades [27,34-45]. Pilot work to develop the TMI included tailoring initial workshop training based on innovative methods in communication science, developing efficient fidelity measurement, and preliminary testing of implementation strategies. The effect of TMI on fidelity to the original evidence-based program, and secondarily on cascade-related outcomes (see ATN 154 below), will be achieved by using a dynamic waitlist-controlled design with 150 providers nested within the 10 clinical care sites of our 12 physical SRVs, yielding 5 clusters to receive TMI. For each randomization, 2 of the clinics receive TMI, and the others remain in the wait-list condition. This will continue until the fifth cluster has been randomized to TMI. After 1 year of TMI’s external facilitation based on the dynamic adaptation process, second randomization will compare internal facilitator monitoring and coaching plus the encouragement of communities of practice to communities of practice alone. Fidelity will be assessed using ratings of standard patient interactions on a quarterly basis through the 24 months of intervention and an additional 6 months of follow-up. As a Hybrid Type 3 Implementation-Effectiveness, the primary focus is also on exploring the role of the barriers and facilitators to implementation with repeated qualitative interviews and quantitative surveys of implementation context (see ATN 153 below). Details are provided in ATN 146 TMI [17].

ATN 156, Enhancing Sexual Safety: Couples’ Communication and HIV Testing Among YMSM (We Test), is a comparative effectiveness trial of couples HIV testing and counseling (CHTC) for adolescent age (15-19 years) same-sex male couples [18]. This design tests the added benefits of adjunct intervention components delivered prior to receipt of CHTC-Assertive Communication Training (CT) videos viewed by the couple together and individually delivered MI-based Communication Skills Training (MI-CST). These target the development of communication skills necessary to participate fully in HIV prevention and sexual safety discussions inherent to CHTC. This protocol will assess a continuum of intervention packages to address the developmental needs of young MSM (CHTC; CT videos + CHTC; MI-CST + CT videos + CHTC) to identify which package optimizes outcomes while minimizing delivery cost. Participants complete the intervention session and an immediate posttest assessment 3 months after the baseline; they are then assessed every 3 months for 9 months postintervention. Details are provided in ATN 156 We Test [18].

Center-Wide Protocols and Initiatives

The 4 primary protocols, with support from the 3 cores, defacto form center-wide protocols and cross-project initiatives, exploiting synergies created by our U19 and creating value-added scientific contributions that would not be possible from individual projects alone or through traditional R01-level funding. First, individually and collectively, the 4 research protocols are guided by the same IS conceptual model. SIU employs the National Institutes of Health’s definition of implementation “the use of strategies to introduce or change evidence-based health interventions within specific settings” [46]. While implementation and dissemination models now abound, we selected an adapted version of Aaron’s EPIS model to guide our work as it is logical, evidence-based [47,48], supported by a growing number of evidence-based instruments [49], and has broad reach among youth HIV researchers (see Figure 1). Thus, ATN 153 EPIS (Carcone et al, under review), described later in this supplement, is a mixed-methods study that includes qualitative interviews and quantitative surveys with staff at 12 physical SRVs to assess barriers and facilitators of the adoption and use of evidence-based behavioral interventions in general and project-specific interventions. Anticipated factors are assessed at the baseline, factors identified during implementation are assessed at 12-18 months postbaseline, and factors identified during sustainment are assessed at 24-30 months postbaseline.

The 10 clinical care sites in SIU will provide deidentified data from electronic health records regarding demographics and HIV treatment cascade variables annually in ATN 154 Cascade Monitoring (Pennar et al, under review). These data will not only serve as outcomes of implementation but also will provide rough but rapid estimations of demographic indices and measures of response (such as new care entry and percent viral suppression) that can provide useful indicators of the epidemic at large for ATN strategic planning. In addition, we hoped to capture prevention cascade variables, but early interviews with the clinical sites determined that consistency in electronic record documentation of these variables was not sufficient for this protocol. Thus, the ATN is developing a new cross-network protocol to assess the capability of all recruitment venues to provide consistent and valid prevention and treatment cascade records and develop an intervention to achieve this end (ATN 162).

Several initiatives are represented across the protocols. First, the 3 primary protocols gathering data from youth (ATN 144 SMART, ATN 145 YMHP, and ATN 156 We Test) are guided by the same theoretical model for self-management [50]. According to the Five Components Model, self-management includes 5 essential skills—problem solving, decision making, resource utilization, forming of a patient/heath care provider partnership, and taking action [50,51]. Thus, all 3 protocols will include the following measures: (1) the BRIEF [52] to assess both problem solving and decision making; (2) Patient Activation Measure [53] in which participants rate the relationship with their providers and the degree to which they are involved in their care using a 4-point Likert scale; (3) an adapted version of the 12-item Services and Support measure utilized in ATN 004 (Healthy Choices) [54] to capture participant self-report of health care and related services (eg, emergency department care, hospitalizations, residential substance use treatment facilities, case management, and support group; resource utilization); and (4) self-reported medication adherence and condom use and viral suppression (taking action). The model will be tested utilizing Structural Equation Modeling with 820 youth.

Second, given the importance of provider-patient interactions in encouraging youth self-management, we plan to identify provider communication behaviors that predict self-management and health outcomes using innovative sequential analysis [55,56] of coded audiorecordings across all 4 primary protocols. We will use MI as a framework (eg, emphasizing autonomy and reflections of change talk) using the Minority Youth Sequential Code of Process Exchanges (MY-SCOPE), adapted from existing MI coding schemes [57]. This analysis generates transition probabilities for patient-provider communication sequences, allowing provider communication behaviors to predict subsequent youth communication and, then, later link to youth outcomes (Figure 4).

Finally, we will determine the relative cost-effectiveness of interventions within each primary protocol to assist in the implementation and rapid diffusion of effective and cost-effective interventions in the practice community. Each protocol will collect detailed resource use for the interventions using consistent methods. These data will be assigned standard cost weights developed by the AC for performing incremental cost-effectiveness analyses across studies. The use of resource use measures with standard cost values will assure that the economic analyses associated with the clinical trial meet the International Society for Pharmacoeconomics and Outcomes Research Good Practices for Economic Evaluation Alongside Clinical Trials [58]. We will use a modification of The Drug Abuse Treatment Cost Analysis Program (DATCAP) [59,60], combined with study contract and expenditure records, capturing both contractually allowed expenditures, and relevant expenditures supported from other budgets, to estimate the cost of the CPS and SMS text messaging conditions.

Figure 4. Self-management components.
View this figure

The DATCAP is a standardized instrument that estimates the economic cost of alcohol and other drug treatment programs (eg, personnel, facilities, and supplies). Client case flow data are incorporated to determine the average weekly and annual cost or client for each service type, average cost per intervention episode, and marginal cost per contact.

When available, data on sexual activity will be collected to be used with recent national estimates [61] of cost per HIV infection avoided, and/or on cost per HIV infection delayed, a more conservative measure. This will allow the estimation of potential cost savings in a reduction in new HIV infections. If warranted by study findings, we will use a previously validated Markov decision analysis model [62] to estimate the expected treatment cost savings resulting from the increase in time with suppressed VL. The resource use measures and cost data collected will be used to develop budget impact scenarios to help inform “scale up” and diffusion planning for the most cost-effective intervention combinations.


Principal Findings

A dramatic decline in HIV transmission is achievable with currently available protocols and interventions (including ART, PrEP, rapid and widespread testing); however, such decline has not yet been realized among youth. Our goal must be complete self-management as mathematical modeling indicates that even achieving 90% compliance at different points on the cascade is insufficient to curb the epidemic [11]. Self-management is critical and complex at any age, but may be especially challenging among adolescents and emerging adults as they transition from a largely dependent to a more independent status (“transition to self-management”) [63] during a developmental period marked by identity exploration, development of new social networks, increased opportunities and choices, both positive and risk-laden [64], and increased independence and risk-taking behavior [65,66]. The transition to adult health care can be abrupt and can occur with little preparation because age, rather than developmental maturity, triggers the transition. Given these developmental and systemic challenges, it is not surprising that self-management tends to deteriorate during this transitional period [54,67]. New approaches to HIV education, prevention, and treatment of youth must be integrated with issues in self-management to achieve an AIDS-free generation and/or the end of the AIDS epidemic by 2030 in the United States and globally [3,4]. To date, the youth HIV research portfolio has not adequately advanced this important care area [13]. SIU protocols and initiatives address the broad issue of persistent disproportionately high rates of HIV infection among youth and failure to engage in the HIV prevention and treatment cascades [68] by focusing on evaluating the effectiveness and implementation of self-management interventions.

SIU is highly innovative for 5 primary reasons. First, the 4 primary study protocols utilize innovative hybrid designs to capture critical information to facilitate and expedite the introduction of effective programs into practice by exploring important implementation issues while testing the effectiveness [19,20]. In keeping with the theme of expeditiously and parsimoniously assessing intervention effectiveness and moving it to practice, we shall use innovations in evaluating the intervention effectiveness, a SMART [69], 2 comparative effectiveness trials [70], and a Dynamic Wait List-controlled trial [71]. Second, our research framework expands the application of “self-management” from the management of chronic disease [72,73] to the prevention [74] and management of chronic disease, HIV/AIDS. We will test an innovative theoretical model of self-management over time among all enrolled youth in SIU protocols (N=500) using standardized measures. Third, our AC will conduct cost-effectiveness analyses of each intervention within the 4 primary study protocols, enabling us to compare the effectiveness and cost-effectiveness to further shorten the research to practice gap. Fourth, across all 4 primary protocols, our ISC will apply implementation scales designed to assess inner and outer context factors based on a strong theoretical model [47-49,75] to determine their relevance to fidelity and sustainability both for evidence-based behavioral practice in general and for interventions grounded in MI as the method of communication. Fifth, we shall advance understanding of the dynamics between the provider and patient by introducing an analytic approach from Communication Science (“sequential analysis”) to the provider-youth interaction across all 4 primary protocols through analysis of recorded interactions [76].

Limitations

Challenges experienced to date include the inexperience of SRVs in single Internal Review Board and reliance agreements, recruitment and retention difficulties when staff are participants in implementation trials, recruitment of high-risk YLH who are nonadherent to ARVs outside of the clinic setting and obtaining VL data for those youth who are not regularly attending clinic, inexperience of clinical sites in electronic health record downloads, and the need for communication systems for complex protocols with multiple moving parts.

Conclusions

In summary, the 4 SIU primary protocols, 2 center-wide protocols, 3 cross-project initiatives, and 3 supporting cores are highly integrated and carefully constructed to support the overarching themes of improved self-management on the part of YLH and at-risk youth and expeditious, but appropriate, implementation of effective prevention and treatment programs into practice in a cost-effective manner. We aspire to address specific research hypotheses concerning the HIV prevention or care cascades for youth while advancing self-management theory and IS. This agenda is dependent on the synergy of connections between these protocols, initiatives and cores and our clinical and community partners, without which these advances would not be achievable.

Given that SIU implements multiple protocols and initiatives, managing this multifaceted U19 project has proved challenging. The challenges range from recruiting participants from clinics with a smaller than expected pool to select from (both among staff and YLH) to grant transfer delays between institutions, as well as IRB and reliance agreements, which, in turn, creates a substantial bureaucratic burden. Nevertheless, these challenges did inform the cores on how to learn from and adapt to the always changing landscape of SIU. At the bureaucratic level, the cores found that maintaining close contact with IRB and financial administrators allows SIU to operate efficiently. At the clinic level, the cores learned that sites rely on ATN support for infrastructure and that even the simplest of protocols can prove difficult to implement. For example, the small pool of participants and participation from multiple sites required innovative approaches for recruitment, data collection, and interventions. As mentioned before, SIU specifically focuses on the process of improving self-management among youth (both YLH and at-risk youth). For these evidence-based practices within SIU to be effective, youth must be fully engaged in interventions at every stage of the HIV care (treatment and prevention) cascades. SIU initially seeks to implement within clinics, outside of the research context, and ultimately assess if clinics have the capacity to implement these interventions independently, thus improving health outcomes for the targeted youth populations.

Acknowledgments

This work was supported by the Eunice Kennedy Shriver National Institute of Child Health and Human Development (U19HD089875; MPI: Naar and Parsons). The content is solely the responsibility of the authors and does not represent the official views of the funding agencies. The authors would like to thank Angulique Outlaw, Monique Green-Jones, Xiaoming Li, Karin Coyle, Regina Firpo-Triplett, and Sonia Lee.

Conflicts of Interest

None declared.

  1. El-Sadr WM, Holmes CB, Mugyenyi P, Thirumurthy H, Ellerbrock T, Ferris R, et al. Scale-up of HIV treatment through PEPFAR: a historic public health achievement. J Acquir Immune Defic Syndr 2012 Aug 15;60 Suppl 3:S96-104 [FREE Full text] [CrossRef] [Medline]
  2. Kanters S, Mills EJ, Thorlund K, Bucher HC, Ioannidis JPA. Antiretroviral therapy for initial human immunodeficiency virus/AIDS treatment: critical appraisal of the evidence from over 100 randomized trials and 400 systematic reviews and meta-analyses. Clin Microbiol Infect 2014 Feb;20(2):114-122 [FREE Full text] [CrossRef] [Medline]
  3. Fauci AS, Folkers GK. Toward an AIDS-free generation. JAMA 2012 Jul 25;308(4):343-344. [CrossRef] [Medline]
  4. Joint United Nations Programme on HIV/AIDS (UNAIDS). Fast-Track - Ending the AIDS epidemic by 2030. Geneva: Joint United Nations Programme on HIV/AIDS (UNAIDS); 2014.   URL: http://www.unaids.org/en/resources/documents/2014/JC2686_WAD2014report [accessed 2019-01-10] [WebCite Cache]
  5. Porth T, Suzuki C, Gillespie A, Kasedde S, Ideleditors. Disparities and trends in AIDS mortality among adolescents living with HIV in low- and middle-income countries. In: 20th International AIDS Conference. 2014 Presented at: 20th International AIDS Conference; July 21, 2014; Melbourne, Australia.
  6. UNICEF. Children, Adolescents and AIDS. New York, NY: UNICEF; 2014.   URL: https://www.unicef.org/publications/files/Children_and_AIDS_Sixth_Stocktaking_Report_EN.pdf [WebCite Cache]
  7. United Nations. The Millennium Development Goals Report 2014. New York: United Nations; 2014 Jul 7.   URL: http://www.un.org/millenniumgoals/2014%20MDG%20report/MDG%202014%20English%20web.pdf [accessed 2019-01-10] [WebCite Cache]
  8. Frieden TR, Foti KE, Mermin J. Applying Public Health Principles to the HIV Epidemic--How Are We Doing? N Engl J Med 2015 Dec 03;373(23):2281-2287. [CrossRef] [Medline]
  9. Centers F. Vital signs: HIV infection, testing, and risk behaviors among youths - United States. MMWR Morb Mortal Wkly Rep 2012 Nov 30;61(47):971-976 [FREE Full text] [Medline]
  10. The White House Office of National AIDS Policy. National HIV/AIDS Strategy for the United States: Updated to 2020. Washington, DC: The White House Office of National AIDS Policy; 2015.   URL: https://files.hiv.gov/s3fs-public/nhas-update.pdf [accessed 2019-01-10] [WebCite Cache]
  11. Gardner EM, McLees MP, Steiner JF, Del RC, Burman WJ. The spectrum of engagement in HIV care and its relevance to test-and-treat strategies for prevention of HIV infection. Clin Infect Dis 2011 Mar 15;52(6):793-800 [FREE Full text] [CrossRef] [Medline]
  12. The White House Office of National AIDS Policy. National HIV/AIDS Strategy for the United States. Washington, DC: The White House Office of National AIDS Policy; 2010.   URL: https://obamawhitehouse.archives.gov/sites/default/files/uploads/NHAS.pdf  [WebCite Cache]
  13. MacPherson P, Munthali C, Ferguson J, Armstrong A, Kranzer K, Ferrand RA, et al. Service delivery interventions to improve adolescents' linkage, retention and adherence to antiretroviral therapy and HIV care. Trop Med Int Health 2015 Aug;20(8):1015-1032 [FREE Full text] [CrossRef] [Medline]
  14. Norton WE, Amico KR, Cornman DH, Fisher WA, Fisher JD. An agenda for advancing the science of implementation of evidence-based HIV prevention interventions. AIDS Behav 2009 Jun;13(3):424-429 [FREE Full text] [CrossRef] [Medline]
  15. Schackman BR. Implementation science for the prevention and treatment of HIV/AIDS. J Acquir Immune Defic Syndr 2010 Dec;55 Suppl 1:S27-S31 [FREE Full text] [CrossRef] [Medline]
  16. Belzer M, MacDonnell K, Ghosh S, Naar S, MacAvoy-Banerjea J, Gurung S, et al. Adaptive Antiretroviral Therapy Adherence Interventions for Youth Living with HIV Through Text Message and Cell Phone Support With and Without Incentives: Sequential Multiple Assignment Randomized Trial (SMART) Design. JMIR Res Protoc. Epub ahead of print DOT:10.2196/11183 2018 (forthcoming). [CrossRef]
  17. Naar S, MacDonnell K, Chapman J, Todd L, Gurung S, Cain D, et al. Tailored Motivational Interviewing (TMI) Implementation-Effectiveness Trial in Multidisciplinary Adolescent HIV Care Settings. JMIR Res Protoc. Epub ahead of print DOT:10.2196/11200 2018 (forthcoming). [CrossRef]
  18. Starks TJ, Feldstein ES, Lovejoy T, Gurung S, Cain D, Borkowski T, et al. Enhancing Sexual Safety: Couples' Communication and HIV Testing Among YMSM. JMIR Research Protocols. Epub ahead of print DOT:10.2196/11186 2018 (forthcoming). [CrossRef]
  19. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care 2012 Mar;50(3):217-226 [FREE Full text] [CrossRef] [Medline]
  20. Bernet AC, Willens DE, Bauer MS. Effectiveness-implementation hybrid designs: implications for quality improvement science. Implementation Sci 2013;8(Suppl 1):S2. [CrossRef]
  21. Wallerstein NB, Duran B. Using community-based participatory research to address health disparities. Health Promot Pract 2006 Jul;7(3):312-323. [CrossRef] [Medline]
  22. Galbraith J, Ricardo I, Stanton B, Black M, Feigelman S, Kaljee L. Challenges and Rewards of Involving Community in Research: An Overview of the “Focus on Kids” HIV Risk Reduction Program. Health Education Quarterly 2016 Sep 04;23(3):383-394. [CrossRef]
  23. Hightow-Weidman LB, Jones K, Wohl AR, Futterman D, Outlaw A, Phillips G, YMSM of Color SPNS Initiative Study Group. Early linkage and retention in care: findings from the outreach, linkage, and retention in care initiative among young men of color who have sex with men. AIDS Patient Care STDS 2011 Aug;25 Suppl 1:S31-S38. [CrossRef] [Medline]
  24. Naar-King S, Outlaw AY, Sarr M, Parsons JT, Belzer M, Macdonell K, Adolescent Medicine Network for HIV/AIDS Interventions. Motivational Enhancement System for Adherence (MESA): pilot randomized trial of a brief computer-delivered prevention intervention for youth initiating antiretroviral treatment. J Pediatr Psychol 2013 Jul;38(6):638-648 [FREE Full text] [CrossRef] [Medline]
  25. Nanin JE, Bimbi DS, Grov C, Parsons JT. Community reactions to a syphilis prevention campaign for gay and bisexual men in Los Angeles County. J Sex Res 2009 Nov;46(6):525-534 [FREE Full text] [CrossRef] [Medline]
  26. Nanín JE, Parsons JT, Bimbi DS, Grov C, Brown JT. Community reactions to campaigns addressing crystal methamphetamine use among gay and bisexual men in New York City. J Drug Educ 2006 Jul;36(4):297-315 [FREE Full text] [CrossRef] [Medline]
  27. Outlaw AY, Naar-King S, Parsons JT, Green-Jones M, Janisse H, Secord E. Using motivational interviewing in HIV field outreach with young African American men who have sex with men: a randomized clinical trial. Am J Public Health 2010 Apr 01;100 Suppl 1:S146-S151. [CrossRef] [Medline]
  28. Outlaw AY, Naar-King S, Tanney M, Belzer ME, Aagenes A, Parsons JT, Adolescent Medicine Trials Network for HIV/AIDS Interventions. The initial feasibility of a computer-based motivational intervention for adherence for youth newly recommended to start antiretroviral treatment. AIDS Care 2014 Jan;26(1):130-135 [FREE Full text] [CrossRef] [Medline]
  29. Outlaw AY, Phillips G, Hightow-Weidman LB, Fields SD, Hidalgo J, Halpern-Felsher B, Young MSM of Color SPNS Initiative Study Group. Age of MSM sexual debut and risk factors: results from a multisite study of racial/ethnic minority YMSM living with HIV. AIDS Patient Care STDS 2011 Aug;25 Suppl 1:S23-S29. [CrossRef] [Medline]
  30. Pachankis JE, Lelutiu-Weinberger C, Golub SA, Parsons JT. Developing an online health intervention for young gay and bisexual men. AIDS Behav 2013 Nov;17(9):2986-2998 [FREE Full text] [CrossRef] [Medline]
  31. Stanton B, Cole M, Li X, Kaljee L, Galbraith J, Cottrell L. Preventionrisk reduction among adolescents: A 16 year community-research partnership. In: Rhodes TC. editor. Focus on Adolescent Behavior Research Frontiers. Hauppauge, NY: Nova Science Publishers; 2007:A-16.
  32. Stanton B, Galbraith J, Kaljee L. The Uncharted Path from Clinic-Based to Community-Based Research. Hauppauge, NY: Nova Science Publishers; 2008:978-971.
  33. Parsons JT, Lelutiu-Weinberger C, Botsko M, Golub SA. A randomized controlled trial utilizing motivational interviewing to reduce HIV risk and drug use in young gay and bisexual men. J Consult Clin Psychol 2014 Feb;82(1):9-18 [FREE Full text] [CrossRef] [Medline]
  34. Miller W, Rollnick S. The atmosphere of change. In: Miller WR, Rollnick S. editors. Motivational interviewing: Preparing people to change addictive behavior. New York, NY: The Guilford Press; 1991:3-13.
  35. Naar-King S. In: Suarez M, editor. Motivational Interviewing with Adolescents and Young Adults. New York: Guilford Publications, Inc; 2011.
  36. Lundahl BW, Kunz C, Brownell C, Tollefson D, Burke BL. A Meta-Analysis of Motivational Interviewing: Twenty-Five Years of Empirical Studies. Research on Social Work Practice 2010 Jan 11;20(2):137-160. [CrossRef]
  37. Chen X, Murphy DA, Naar-King S, Parsons JT, Adolescent MTNFHI. A clinic-based motivational intervention improves condom use among subgroups of youth living with HIV. J Adolesc Health 2011 Aug;49(2):193-198. [CrossRef] [Medline]
  38. Naar-King S, Outlaw A, Green-Jones M, Wright K, Parsons JT. Motivational interviewing by peer outreach workers: a pilot randomized clinical trial to retain adolescents and young adults in HIV care. AIDS Care 2009 Jul;21(7):868-873. [CrossRef] [Medline]
  39. Naar-King S, Parsons JT, Murphy DA, Chen X, Harris DR, Belzer ME. Improving health outcomes for youth living with the human immunodeficiency virus: a multisite randomized trial of a motivational intervention targeting multiple risk behaviors. Arch Pediatr Adolesc Med 2009 Dec;163(12):1092-1098 [FREE Full text] [CrossRef] [Medline]
  40. Mbuagbaw L, Ye C, Thabane L. Motivational interviewing for improving outcomes in youth living with HIV. Cochrane Database Syst Rev 2012 Sep 12(9):CD009748. [CrossRef] [Medline]
  41. Bartlett J, Cheever L, Johnson M, Paauw D. A guide to primary care of people with HIV/AIDS. Rockville, MD: U.S. Department of Health and Human Services; 2004.
  42. Kahn J. Predictors of papanicolaou smear return in a hospital-based adolescent and young adult clinic. Obstetrics & Gynecology 2003 Mar;101(3):490-499. [CrossRef]
  43. Magnus M, Jones K, Phillips G, Binson D, Hightow-Weidman LB, Richards-Clarke C, YMSM of color Special Projects of National Significance Initiative Study Group. Characteristics associated with retention among African American and Latino adolescent HIV-positive men: results from the outreach, care, and prevention to engage HIV-seropositive young MSM of color special project of national significance initiative. J Acquir Immune Defic Syndr 2010 Apr 01;53(4):529-536. [CrossRef] [Medline]
  44. New York State Department of Health. Substance use and dependence among HIV-infected adolescents and young adults. New York, NY: New York State Department of Health; 2009.
  45. Centers for Disease Control Prevention, HIV/AIDS Prevention Research Synthesis Project. Compendium of HIV Prevention Interventions with Evidence of Effectiveness. Atlanta, GA: Centers for Disease Control and Prevention; Nov 1999.
  46. National Institute for Mental Health. Dissemination and Implementation Research in Health (R01). Bethesda, MD: National Institutes of Health; 2005.   URL: https://grants.nih.gov/grants/guide/pa-files/PAR-06-039.html [accessed 2018-11-26] [WebCite Cache]
  47. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health 2011 Jan;38(1):4-23 [FREE Full text] [CrossRef] [Medline]
  48. Novins DK, Green AE, Legha RK, Aarons GA. Dissemination and implementation of evidence-based practices for child and adolescent mental health: a systematic review. J Am Acad Child Adolesc Psychiatry 2013 Oct;52(10):1009-1025.e18 [FREE Full text] [CrossRef] [Medline]
  49. California Evidence-Based Clearinghouse for Child Welfare. Implementation Measures. San Diego, CA; 2018.   URL: http://www.cebc4cw.org/implementing-programs/tools/measures/ [accessed 2018-11-26] [WebCite Cache]
  50. Center for the Advancement of Health. Essential elements of self-management interventions. Washington, DC:: Center for the Advancement of Health; 2002.
  51. Grady PA, Gough LL. Self-management: a comprehensive approach to management of chronic conditions. Am J Public Health 2014 Aug;104(8):e25-e31. [CrossRef] [Medline]
  52. Roth R, Isquith P, Gioia G. PARiConnect. 2005. Behavior rating inventory of executive function-adult version (BRIEF-A)   URL: https://www.parinc.com/Products/Pkey/25
  53. King S, King G, Rosenbaum P. Evaluating Health Service Delivery to Children With Chronic Conditions and Their Families: Development of a Refined Measure of Processes of Care (MPOC−20). Children's Health Care 2004 Mar;33(1):35-57. [CrossRef]
  54. Macdonell KE, Naar-King S, Murphy DA, Parsons JT, Harper GW. Predictors of medication adherence in high risk youth of color living with HIV. J Pediatr Psychol 2010 Jul;35(6):593-601 [FREE Full text] [CrossRef] [Medline]
  55. Creswell J, Klassen A, Plano CV, Smith K. Best practices for mixed methods research in the health sciences. Bethesda, MD: National Institutes of Health; 2011.
  56. Ivankova NV. Using Mixed-Methods Sequential Explanatory Design: From Theory to Practice. Field Methods 2006 Feb 01;18(1):3-20. [CrossRef]
  57. Carcone AI, Naar S, Eggly S, Foster T, Albrecht TL, Brogan KE. Comparing thin slices of verbal communication behavior of varying number and duration. Patient Educ Couns 2015 Feb;98(2):150-155 [FREE Full text] [CrossRef] [Medline]
  58. Petrou S, Gray A. Economic evaluation alongside randomised controlled trials: design, conduct, analysis, and reporting. BMJ 2011 Apr 07;342(apr07 2):d1548-d1548. [CrossRef]
  59. French M. Drug Abuse Treatment Cost Analysis Program (DATCAP): User's Manual Eighth Edition. Miami, FL: University of Miami; 2003.
  60. French MT, Dunlap LJ, Zarkin GA, McGeary KA, Thomas McLellan A. A structured instrument for estimating the economic cost of drug abuse treatment. Journal of Substance Abuse Treatment 1997 Sep;14(5):445-455. [CrossRef]
  61. Schackman BR, Fleishman JA, Su AE, Berkowitz BK, Moore RD, Walensky RP, et al. The lifetime medical cost savings from preventing HIV in the United States. Med Care 2015 Apr;53(4):293-301 [FREE Full text] [CrossRef] [Medline]
  62. Simpson KN, Pei PP, Möller J, Baran RW, Dietz B, Woodward W, et al. Lopinavir/ritonavir versus darunavir plus ritonavir for HIV infection: a cost-effectiveness analysis for the United States. Pharmacoeconomics 2013 May;31(5):427-444. [CrossRef] [Medline]
  63. Giarelli E, Bernhardt BA, Mack R, Pyeritz RE. Adolescents' transition to self-management of a chronic genetic disorder. Qual Health Res 2008 Apr;18(4):441-457. [CrossRef] [Medline]
  64. Chambers RA, Taylor JR, Potenza MN. Developmental neurocircuitry of motivation in adolescence: a critical period of addiction vulnerability. Am J Psychiatry 2003 Jun;160(6):1041-1052 [FREE Full text] [CrossRef] [Medline]
  65. Parsons J, Halkitis P, Bimbi D, Borkowski T. Perceptions of the benefits and costs associated with condom use and unprotected sex among late adolescent college students. Journal of Adolescence 2000 Aug 23(4):377-391 [FREE Full text]
  66. Parsons J, Siegel A, Cousins J. Late adolescent risk-taking: effects of perceived benefits and perceived risks on behavioral intentions and behavioral change. J Adolesc 1997 Aug;20(4):381-392 [FREE Full text] [CrossRef] [Medline]
  67. MacDonell K, Naar-King S, Huszti H, Belzer M. Barriers to medication adherence in behaviorally and perinatally infected youth living with HIV. AIDS Behav 2013 Jan;17(1):86-93 [FREE Full text] [CrossRef] [Medline]
  68. Zanoni BC, Mayer KH. The adolescent and young adult HIV cascade of care in the United States: exaggerated health disparities. AIDS Patient Care STDS 2014 Mar;28(3):128-135 [FREE Full text] [CrossRef] [Medline]
  69. Hartlieb KB, Jacques-Tiura AJ, Naar-King S, Ellis DA, Jen KC, Marshall S. Recruitment strategies and the retention of obese urban racial/ethnic minority adolescents in clinical trials: the FIT families project, Michigan, 2010-2014. Prev Chronic Dis 2015 Feb 19;12:E22 [FREE Full text] [CrossRef] [Medline]
  70. Methodology Committee of the Patient-Centered Outcomes Research Institute (PCORI). Methodological standards and patient-centeredness in comparative effectiveness research: the PCORI perspective. JAMA 2012 Apr 18;307(15):1636-1640. [CrossRef] [Medline]
  71. Brown CH, Wyman PA, Guo J, Peña J. Dynamic wait-listed designs for randomized trials: new designs for prevention of youth suicide. Clin Trials 2006 Sep;3(3):259-271. [CrossRef] [Medline]
  72. Barlow J, Wright C, Sheasby J, Turner A, Hainsworth J. Self-management approaches for people with chronic conditions: a review. Patient Education and Counseling 2002 Oct;48(2):177-187. [CrossRef]
  73. National Institute of Nursing Research. Bethesda, MD: National Institute of Nursing Research. Self-Management: Improving Quality of Life for Individuals with Chronic Illness   URL: http://www.ninr.nih.gov/newsandinformation/iq/self-management-workshop [accessed 2018-04-20] [WebCite Cache]
  74. Lorig KR, Holman HR. Self-management education: history, definition, outcomes, and mechanisms. Ann Behav Med 2003 Aug;26(1):1-7. [CrossRef] [Medline]
  75. Aarons GA, Cafri G, Lugo L, Sawitzky A. Expanding the domains of attitudes towards evidence-based practice: the evidence based practice attitude scale-50. Adm Policy Ment Health 2012 Sep;39(5):331-340 [FREE Full text] [CrossRef] [Medline]
  76. Montague E, Chen P, Xu J, Chewning B, Barrett B. Nonverbal interpersonal interactions in clinical encounters and patient perceptions of empathy. J Participat Med 2013 Aug 14(5):e33.


AC: Analytic Core
CT: Assertive Communication Training
ART: antiretroviral therapy
ATN: Adolescent Medicine Trials Network for HIV/AIDS Interventions
CHTC: couples HIV testing and counseling
CPS: cell phone support
DATCAP: Drug Abuse Treatment Cost Analysis Program
EPIS: Exploration, Preparation, Implementation, Sustainment model
IS: implementation science
ISC: Implementation Science Core
MC: Management Core
MI: motivational interviewing
MSM: men who have sex with men
PrEP: pre-exposure prophylaxis
SIU: Scale It Up
SMART: Sequential Multiple Assignment Randomized Trial
SMS: short message service
SRV: subject recruitment venue
TMI: Tailored Motivational Interviewing Intervention
VL: viral load
YCAB: Youth Community Advisory Board
YLH: youth living with HIV
YMHP: Young Men’s Health Project


Edited by R Schnall, S Allison, I Holloway, B Mustanski, A Pettifor; submitted 31.05.18; peer-reviewed by C Rodríguez-Díaz, S Ondersma, V Nandi; comments to author 07.08.18; revised version received 02.10.18; accepted 04.10.18; published 01.02.19

Copyright

©Sylvie Naar, Jeffrey T Parsons, Bonita F Stanton. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 01.02.2019.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.