Published on in Vol 12 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/43986, first published .
Cross-Tailoring Integrative Alcohol and Risky Sexual Behavior Feedback for College Students: Protocol for a Hybrid Type 1 Effectiveness-Implementation Trial

Cross-Tailoring Integrative Alcohol and Risky Sexual Behavior Feedback for College Students: Protocol for a Hybrid Type 1 Effectiveness-Implementation Trial

Cross-Tailoring Integrative Alcohol and Risky Sexual Behavior Feedback for College Students: Protocol for a Hybrid Type 1 Effectiveness-Implementation Trial

Protocol

1Department of Health, Behavior & Society, College of Public Health, University of Kentucky, Lexington, KY, United States

2Department of Health Behavior and Health Systems, School of Public Health, The University of North Texas Health Science Center at Fort Worth, Fort Worth, TX, United States

3Klein Buendel, Inc, Golden, CO, United States

4Department of Biostatistics and Epidemiology, School of Public Health, The University of North Texas Health Science Center at Fort Worth, Fort Worth, TX, United States

5Department of Biostatistics, College of Public Health, University of Kentucky, Lexington, KY, United States

6Department of Psychiatry, College of Medicine, University of Kentucky, Lexington, KY, United States

Corresponding Author:

Anne E Ray, MEd, PhD

Department of Health, Behavior & Society

College of Public Health

University of Kentucky

151 Washington Ave

Lexington, KY, 40536

United States

Phone: 1 859 218 4944

Email: anne.ray@uky.edu


Background: Underage drinking and related risky sexual behavior (RSB) are major public health concerns on United States college campuses. Although technology-delivered personalized feedback interventions (PFIs) are considered a best practice for individual-level campus alcohol prevention, there is room for improving the effectiveness of this approach with regard to alcohol-related RSB.

Objective: The aims of this study are to (1) evaluate the impact of a brief PFI that integrates content on alcohol use and RSB and is adapted to include a novel cross-tailored dynamic feedback (CDF) component for at-risk first-year college students and (2) identify implementation factors critical to the CDF’s success to facilitate future scale-up in campus settings.

Methods: This study uses a hybrid type 1 effectiveness-implementation design and will be conducted in 3 phases. Phase 1 is a stakeholder-engaged PFI+CDF adaptation guided by focus groups and usability testing. In phase 2, 600 first-year college students who drink and are sexually active will be recruited from 2 sites (n=300 per site) to participate in a 4-group randomized controlled trial to examine the effectiveness of PFI+CDF in reducing alcohol-related RSB. Eligible participants will complete a baseline survey during the first week of the semester and follow-up surveys at 1, 2, 3, 6, and 13 months post baseline. Phase 3 is a qualitative evaluation with stakeholders to better understand relevant implementation factors.

Results: Recruitment and enrollment for phase 1 began in January 2022. Recruitment for phases 2 and 3 is planned for the summer of 2023 and 2024, respectively. Upon collection of data, the effectiveness of PFI+CDF will be examined, and factors critical to implementation will be evaluated.

Conclusions: This hybrid type 1 trial is designed to impact the field by testing an innovative adaptation that extends evidence-based alcohol programs to reduce alcohol-related RSB and provides insights related to implementation to bridge the gap between research and practice at the university level.

Trial Registration: ClinicalTrials.gov NCT05011903; https://clinicaltrials.gov/ct2/show/NCT05011903

International Registered Report Identifier (IRRID): DERR1-10.2196/43986

JMIR Res Protoc 2023;12:e43986

doi:10.2196/43986

Keywords



Overview

Despite declines over the past several decades, underage drinking and related harm continue to be major public health concerns on United States college campuses [1-3]. National data show two-thirds of college students are current drinkers, 1 in 3 reports past-month heavy-episodic drinking (more than 5 drinks in a row), and 1 in 10 reports high-intensity drinking (more than 10 drinks in a row) [1]. Greater college student alcohol consumption and heavy drinking on a given day are linked to increased sexual activity and risky sexual behavior (RSB; eg, unprotected sex and unplanned hookups) [4-9]. Alcohol-related RSB puts college students at risk for negative health outcomes (eg, sexually transmitted infections and unplanned pregnancies) and is a pathway to sexual victimization and escalated drinking [10-14]. Notably, alcohol use is implicated in approximately half of college student sexual assaults [14,15]. Given the high rates of alcohol misuse in college and the association between alcohol use and RSB, prevention efforts that reduce alcohol-related RSB have been identified as a priority area in the National Institute on Alcohol Abuse and Alcoholism (NIAAA) Strategic Plan 2017-2021 [3].

The first weeks of college are referred to as the red zone with escalations in heavy drinking [16-18] and sexual assault [19-23]. Changes in the salience of social and achievement goals and stressors during the transition to college impact alcohol use during this period [24]. Students who drink heavily prior to college are likely to escalate drinking [25], and nondrinkers or light drinkers may consume heavy amounts on occasion, increasing their risk of experiencing serious consequences [26,27]. This coincides with changes in students’ sex-related cognitions and behaviors [8,28]. Thus, effective interventions for escalated alcohol use and RSB during this critical period of risk can result in high public health and clinical impacts [29].

Technology-Delivered Personalized Feedback Interventions

NIAAA’s College Alcohol Intervention Matrix identifies technology-delivered personalized feedback interventions (PFIs) as a best practice for individual-level campus alcohol prevention [30]. PFIs typically involve a one-time, web-based assessment of an individual’s alcohol use behaviors, followed by the provision of a tailored profile based on the assessment of the individual’s drinking patterns and strategies to reduce harm [31-33]. The utilization of technology for assessment and feedback allows PFIs to retain key features of efficacious in-person brief motivational interventions without the high costs and need for trained personnel [34]. Many universities now opt for commercially developed PFIs for first-year students (eg, AlcoholEdu for College [35] and eCHECKUPTOGO [36]) [37-42].

Past work from the investigative team [32,43,44] highlights 2 important concerns with PFIs as widely implemented. First, a rather exclusive focus on the assessment and feedback of alcohol use means other health behaviors impacted by alcohol use, such as RSB, are rarely addressed [32]. To address this gap, a PFI with integrated alcohol and RSB content for sexually active, college-aged young adults who regularly drink was developed. The integrated PFI showed promise in reducing alcohol-related sexual outcomes [43]. Second, there is considerable heterogeneity in PFI effects across participants [45] and studies [44,46]. Further, PFIs tend to provide short-term intervention benefits but offer diminished protection to college students beyond 6 months [46,47]. The current intervention is designed to increase and extend the effects of the integrated alcohol and RSB PFI by incorporating repeated and dynamic assessment and feedback.

Extending PFIs With Cross-Tailored Dynamic Feedback

The prevailing approach to technology-delivered PFIs is to provide a single, point-in-time snapshot of one’s behaviors and beliefs relative to others, analogous to a “between-person” comparison, which can create initial discrepancy and enhance motivation to change [48]. However, this feedback is limited to a one-time snapshot of individual differences in risk, does not capitalize on the beneficial effects of continued monitoring, and cannot capture dynamic changes in an individual’s beliefs or behavior in response to feedback. The proposed PFI and cross-tailored dynamic feedback (CDF) adaptation (PFI+CDF) leverages semester-long diary assessments (once a day for 4 days a week over 12 weeks) to iteratively refine (ie, optimize) initial feedback. The addition of CDF has the potential to amplify the effects of PFIs through the provision of feedback linked to a user’s personal, day-to-day trajectory of a target behavior. The integration of adaptive (“just-in-time”) and dynamic feedback is designed to bolster and sustain the initial impact of the PFI by creating a unique form of self-monitoring of “within-person” trajectories. In this way, positive behavior change can be acknowledged, and the participant can be redirected when less desirable behaviors are reported. The CDF adaptation of a PFI is intended to develop discrepancy regarding alcohol-related RSB, alcohol use, and other RSB; enhance motivation to change; and boost self-efficacy in one’s ability to change. To our knowledge, dynamic optimization of intervention content with rapid deployment and evaluation has never been attempted with alcohol-related RSB interventions.

Designing for Dissemination With an Effectiveness-Implementation Hybrid Design

Over the past 3 decades, researchers have made strides to enhance brief alcohol intervention implementation through a number of key adaptations (eg, extending to different subpopulations [44], altering delivery modality [49], adding boosters [50-52], giving students a choice for intervention assignment [53], adding video content [54], and adding substance-free activities [55]). Despite these efforts, a significant proportion of college campuses do not implement evidence-based strategies [56-58]. Although PFIs are a popular choice among campuses that do implement such strategies, little is known regarding strategies they use to encourage stakeholder groups’ participation or how PFIs complement other student health efforts.

Accordingly, the current intervention study is guided by a hybrid type 1 effectiveness-implementation design to examine PFI+CDF effectiveness and related implementation factors to improve and accelerate translation. Effectiveness-implementation hybrid designs offer a dual focus on both outcomes and process, which can serve to speed up the translation of an intervention if it is effective [59,60]. Process-oriented formative evaluations will be used with stakeholders at multiple levels prior to, during, and after program implementation to better understand implementation context, and barriers and facilitators to implementation [61-64]. It is critical to identify college-specific PFI implementation gaps at both the student level and systems level for the purpose of improving PFI+CDF’s acceptance by students and achieving greater adoption on campuses. By engaging multilevel stakeholders at the outset, a “designing for dissemination” approach is followed, using feedback from members of the population of users and organizational adopters [65-68]. In this paper, we provide a description of the proposed hybrid type 1 effectiveness-implementation study protocol.


Study Design

Figure 1 provides an overview of the 3-phase, multisite hybrid type 1 effectiveness-implementation design to evaluate the effectiveness and understand the implementation of a novel PFI+CDF to reduce first-year college students’ alcohol-related RSB. Phase 1 is a focus group-guided PFI+CDF adaptation and usability test. In phase 2, first-year college students who report past-month heavy-episodic drinking (more than 4 or 5 drinks for females or males within 2 hours) or drinking at least 3 times in the past month and who are sexually active without being in a monogamous relationship will be recruited from the University of Kentucky (UK) and the University of North Texas (UNT) to participate in a 4-group randomized controlled trial (RCT) to examine the effectiveness of PFI+CDF in reducing alcohol-related RSB. PFI+CDF will have 3 other comparison conditions: a PFI followed by the 12-week dynamic feedback on general health information (PFI+GHI), a PFI without any additional exposure to intervention (PFI), and assessment-only control (AOC). In phase 3, a qualitative evaluation will be conducted with multilevel stakeholders to better understand relevant implementation factors.

Figure 1. Overview of study design. CDF: cross-tailored dynamic feedback; GHI: generic health information; PFI: personalized feedback intervention; RCT: randomized controlled trial.

Phases 1 and 3 are guided by the Consolidated Framework for Implementation Research (CFIR), a comprehensive set of constructs describing factors influencing implementation across all stages of the implementation process [69,70]. CFIR is commonly used to guide formative investigations within the context of hybrid type 1 designs [61,64]. Constructs are grouped into 5 domains in the current intervention study: intervention characteristics (ie, characteristics of PFI+CDF), outer setting (ie, context surrounding student affairs), inner setting (ie, context within student affairs), individual characteristics (ie, students and student affairs staff), and process (ie, process for implementing PFI+CDF) [69].

Adaptation (Phase 1)

Overview

Phase 1 will focus on adapting the existing integrated PFI to the enhanced PFI+CDF with the following steps: (1) focus groups with multilevel stakeholders, including students and student affairs staff; (2) building the data capture and content platform; (3) usability testing; and (4) program refinements. These 4 key iterative steps of adaptation are crucial in the systematic modification of existing evidence-based interventions to improve their effects and potential for implementation [66]. Furthermore, they ensure that the adaptation of the integrated PFI to PFI+CDF is achieved with the principle of designing for dissemination in mind [65].

Focus Groups

We will conduct focus groups with stakeholders (ie, students and student affairs personnel) to solicit their perspectives on a prototype of the proposed PFI+CDF intervention. Focus group participants will be students and student affairs professionals (eg, individuals involved with implementation of prevention programming) at UK and UNT, as well as student affairs professionals at the national level, recruited at the annual meeting of NASPA-Student Affairs Administrators in Higher Education, the premier conference in this field [71]. Recruitment and facilitation of focus groups at NASPA will ensure a national perspective on the PFI+CDF intervention.

At UK and UNT, we anticipate a single focus group for staff and 3 focus groups for students, with 5-8 participants per group (32 participants per site, 64 participants total). At NASPA, we will aim for 4 focus groups with 5-8 participants per group, for a total of 32 participants. Development of the focus group interview guide will be informed by the CFIR interview guide tool [72] and will target constructs within the intervention characteristics domain of CFIR (eg, adaptability, complexity, design quality, and relative advantage), exploring barriers and facilitators to implementation at both the student level and systems level [69,73]. Groups will last 60-90 minutes and incentives will be US $50 and US $100 gift cards for students and student affairs staff, respectively.

We will conduct a systematic thematic analysis to identify relevant themes from the qualitative data collections [74]. Focus groups will be transcribed and analyzed using NVivo [75]. A designated subset of the research team will first work independently to identify recurrent themes and important statements specific to intervention content. They will then review the independent coding together, discuss the independent coding with the entire research team, and come to a consensus about the emerging themes. The themes will be compiled into summaries and circulated to the research team to guide discussion of intervention refinement.

Data Capture and Content Development
Overview

Findings from the multilevel stakeholder focus groups will inform the development of an updated version of an existing evidence-based integrated alcohol and RSB feedback profile (PFI) and the addition of CDF content, as well as an assessment and delivery platform necessary to populate and house the PFI and CDF content.

PFI and CDF Delivery Platform

The PFI and CDF content will be housed in a website application platform that offers flexibility in reach and accessibility but is optimized for viewing across device types (eg, computer, tablet, and phone). For example, links to PFI and CDF content can be sent to participants via multiple channels (eg, SMS text message and email) to access feedback. The assessment and content platform will be built as an integrated system, essential for scale-up for several reasons: (1) survey responses inform both the PFI and CDF content and are a necessary part of the system, (2) it allows for a built-in evaluation mechanism, and (3) it creates one overall system that is portable for hosting at other sites. The underlying programming will be conducted in HTML5 to ensure flexibility for future adaptations to other platforms. The web-based app will run on common web browsers on iOS and Android smartphones, tablets, and on iOS and Windows personal computers. A backend tracking program will record user progress.

Intervention Content: PFI

Consistent with prior work, PFI content will be generated from responses to a baseline assessment and offer participants integrated feedback on both alcohol use and RSB across the following content domains: a behavioral profile, normative comparisons, blood alcohol content, expectancies, perceived risk, likelihood of engaging in future risk behaviors, and protective behavioral strategies. In addition to integrated alcohol and RSB content, the PFI will include an option to view feedback on alcohol use behaviors only, as pilot data indicated separate alcohol-focused content was necessary to reduce alcohol use not specific to sexual behavior.

Intervention Content: CDF

CDF content will be generated from weekly diary-style surveys (Friday to Monday) in which students report their alcohol use and RSB, as well as their preferences when interacting with CDF content. Participants will receive dynamic feedback on their own behaviors for 12 weeks of the fall semester, allowing them to see their behaviors over time and receive feedback on their behavior changes (ie, “within-person” feedback). Although the overall system and specific design features will be created in consultation with students and technology developers, and subsequently refined following the usability testing, it is anticipated that the CDF content will include (1) a brief and updated behavior profile, (2) normative feedback on their current weekly drinking and related sexual behavior pattern, (3) positive reinforcement for improving behaviors within weekly and monthly time frames in figures, (4) brief updated intervention content topics (eg, individual-specific protective strategies that they can use in the following week) along with an option to see a full version, and (5) alerts for potential areas for improvement and referral information, if needed.

Usability Testing and Program Refinement

Usability testing will focus on (1) soliciting feedback on users’ experience with the enhanced PFI+CDF and (2) troubleshooting the CDF diary surveys and dynamic weekly feedback methodology. The usability test will be conducted with the methodology, assessments, and timing of the RCT procedures for the PFI+CDF group (see phase 2 description below), with the exception that the testing does not need to start at the beginning of the academic year or include follow-up surveys. Participants (n=100, 50 per site) will provide standard ratings of the acceptability [76] (eg, attractiveness, comprehension, relevance, and persuasive value) and usability [77] (eg, ease and efficiency of use) of the PFI+CDF intervention and respond to open-ended questions regarding most and least liked features. We will create a summary of participants’ impressions, commonly referenced problems, and acceptability and usability ratings, and use this information for one last round of program refinement, as recommended in systematic adaptation approaches.

Effectiveness Trial (Phase 2)

Overview of RCT Design

We will conduct a multisite, 4-group RCT to evaluate the intervention (Figure 2). Participants (N=600 total, 300 per site) will be randomized to 1 of 4 groups: (1) PFI+CDF with weekly diary surveys; (2) PFI+GHI (generic health information) with weekly diary surveys; (3) PFI-only, no weekly diary surveys; and (4) AOC, no weekly diary surveys. All participants will complete a baseline survey during the first week of the semester, be randomly assigned to 1 of the 4 groups, and complete follow-up surveys at 1, 2, 3, 6, and 13 months post baseline. The staggered design allows for comparison of the enhanced PFI+CDF relative to the PFI+GHI, which may be consistent with a “treatment-as-usual” comparison group (eg, of the universities that have adopted an evidence-guided alcohol intervention program for their campus, many currently deliver commercialized alcohol-focused PFIs to incoming first-year students) [35,36]. Providing weekly GHI in the comparison group allows for an equal number of “exposures” between PFI+CDF and PFI+GHI, analogous to an attention control group, offering a clearer understanding of the overall impact of the PFI+CDF adaptation. The inclusion of 2 PFI conditions, 1 with weekly diary assessments and 1 without, allows us to control potential assessment reactivity that might result from the diary-style assessment approach. This design is intended to allow a separation of the “true” intervention effect of the CDF above and beyond the effect of assessment reactivity. The PFI-only versus AOC group comparison will provide a test of the integrated PFI that has been adapted based on stakeholder feedback.

Figure 2. Randomized controlled trial workflow diagram. CDF: cross-tailored dynamic feedback; GHI: generic health information; PFI: personalized feedback intervention.
Recruitment

Contact information for a random sample of first-year college students between the ages of 18-20 years will be drawn from the registrar’s office at each study site. Students will be sent a prenotification letter on the university letterhead describing the study and inviting their participation. The letter will inform them to check their email on the study start date for more details and be followed by an email that reiterates study details, invites their participation, and includes a web link and personal identification number to access a web-based consent form and screening survey. Other recruitment methods will supplement this recruitment from the registrar’s office, including direct emails to interested students, advertisements in newspapers, on websites and social media, and postcards and fliers distributed at various on-campus locations. Eligibility criteria are shown in Textbox 1. Eligible students will be required to give informed consent before being directed to the baseline survey. Those who decline to consent and those who are not eligible will be directed out of the survey and removed from the participant list. Students will receive email reminders over the course of the following week. We will oversample underrepresented groups (n=300, 50% non-White and n=300, 50% White students) and maintain an equal ratio of men and women at each site.

Eligibility criteria for the randomized controlled trial.

Eligibility criteria

  • First-year student
  • 18-20 years of age
  • Past 30-day heavy-episodic drinking (more than 4 or 5 drinks for females or males within 2 hours) or 3 or more drinking occasions within the past month
  • Sexually active (oral, anal, or vaginal sex within past 12 months)
  • Not in a monogamous relationship (single, not dating, or dating, not serious) or in a monogamous relationship (dating only 1 person) for less than 3 months or in a monogamous relationship but open to cheating
  • Not pregnant or planning to become pregnant
Textbox 1. Eligibility criteria for the randomized controlled trial.
Procedures

Following the baseline survey, participants randomized to 1 of the 3 PFI conditions will immediately be linked to their PFI, which will also be sent via email and SMS text message. A 2-week window is allotted at the beginning of the semester for participants to complete their baseline assessment and, if applicable, view their PFI content. Following that period, participants in the PFI+CDF and PFI+GHI will be sent prompts via email and SMS text message to complete diary surveys on Friday through Monday of each week. On Tuesdays, participants in the PFI+CDF group will receive a link to access their CDF corresponding to that week’s behavior, via text and email, and those in the PFI+GHI group will receive a link to access health topics relevant to college students guided by the American College Health Association website (eg, nutrition, mono, exercise, and immunizations) [78]. These procedures will continue for a total of 12 weeks. All participants will be asked to complete web-based 1-, 2-, 3-, 6-, and 13-month follow-up assessments and receive up to US $100 (US $15 per survey, with an additional US $10 bonus for the 13-month follow-up). Participants in the diary conditions will receive an additional payment up to US $96 (US $2 per day×4 days×12 weeks=US $96).

Intervention Assessments and Other Measures

Table 1 shows a list of self-report measures, including primary and secondary outcomes, demographics, and covariates. Primary and secondary outcomes and content-specific measures will be assessed at baseline and in all follow-up surveys. Measures will be adapted for weekly diary assessments along with items related to daily drinking context, consistent with our prior work. We anticipate baseline and follow-up surveys to be approximately 20 minutes in length, and daily surveys will be 5 minutes in length. Participants will be made aware of the importance of the data, the confidential nature of their responses, and we will follow procedures to secure their privacy.

Table 1. Self-report measures.
ConstructDescription
Primary outcomes

Alcohol-related sexual behaviorNumber of times that alcohol was consumed during or before sex, quantity of alcohol consumed before sex [79]

Alcohol-related consequences—sexualSexual consequence scale [80]
Secondary outcomes

Alcohol use behaviorDaily drinking questionnaire [81], heavy-episodic drinking, and high-intensity drinking

Alcohol-related consequences—nonsexualYoung adult alcohol consequences questionnaire [82]

Sexual behaviorFrequency of sex (including oral, vaginal, or anal), number of casual sexual partners, and number of times that a condom was used during sex [79,83]
Demographics and covariates

Background demographicsBirth sex, gender identity, sexual orientation, race and ethnicity, height and weight (for blood alcohol content calculation)

Alcohol use historyLifetime alcohol use, age of drinking and intoxication onset, and family history

Sex historyAge of first sex and history of sexual behavior

In addition to self-report measures, participant behavior analytics will be captured to help ensure intervention fidelity and be included as covariates in analyses. Analytics include (1) whether or not participants accessed their PFI, CDF, or GHI; (2) the number of times each PFI, CDF, or GHI was accessed; (3) time spent viewing each PFI, CDF, or GHI; and (4) time spent viewing each topic area within the PFI, CDF, or GHI. These data will be captured through tracking routines programmed on the website. We will examine the depth of college students’ engagement with intervention content to assess the effects of program exposure (ie, dose) based on the level of access to content (eg, ranging from students who looked at PFIs and all weekly CDF and GHI content vs those who engaged in some or none of the content) and time spent on various intervention components. These data will provide intervention acceptability metrics and allow us to control each participant’s exposure to the PFI, CDF, or GHI content in outcome analyses.

Sample Size Justification

Power analyses to detect intervention main effects were conducted using Optimal Design Plus Version 3.01 software and the “power determination approach.” Based on past research, we assumed a standardized effect size of 0.3 (a small to medium effect size) from the repeated measures RCT with 5 follow-ups over 13 months. To examine the effect of the PFI+CDF and PFI interventions, compared to the control, a minimum of 452 participants are required for a power of 0.8 at an alpha level of .05. To examine the effect of the PFI+CDF intervention (vs PFI+GHI or PFI-only intervention), at least 350 participants are required. Based on this power analysis, there is sufficient power (≥0.89) to detect a small to medium effect size for the integrated interventions (PFI+CDF, PFI+GHI, and PFI only) versus control and sufficient power to detect the small effect of the PFI+CDF intervention compared to the PFI+GHI or PFI-only intervention over time. Although the overall effect size was conservatively assumed to fall between small and medium in size, due to the fine-grained assessment approach within the time period where most changes are likely to occur, followed by a long-term 13-month follow-up assessment, we anticipate that the proposed study is sufficiently powered.

Statistical Analysis

For study phase 2, we will use a multilevel model for the main outcome analysis where the participant is defined at the highest level of the model (level 2), and observations (level 1) are nested within the participant. We will assume that the observation-level (level 1) residual error term and participant-level (level 2) intercept coefficients (ie, random effects) are each normally distributed with mean zero and a variance that is estimated from the data, while intercept and slope coefficients are multivariate normally distributed with mean zero for each, and a covariance matrix that is estimated from the data. Intervention groups will be tested as a fixed effect. Given that many outcomes of our interest are count outcomes with excessive zeros, we will utilize appropriate models to accommodate a zero-inflated outcome distribution with overdispersion [44,84]. The 2 sites can be entered as a random effect (level 3) or a fixed effect in a 2-level model. We will include an interaction term to test whether PFI+CDF is similarly effective for men and women. The intercept and growth slopes will be appropriately specified to maximize information.

We will use a parallel process growth model to test the codevelopment of correlated processes (eg, alcohol use and RSB) and a parallel process growth mediation model. This allows for the examination of 2 potentially dependent reduction trajectories, which are altered by intervention. We expect that those who reduce alcohol misuse more rapidly in response to intervention will also exhibit a trajectory in which one’s likelihood of engaging in RSB decreases, which can be tested by comparing a model where the 2 slope terms are correlated with a null model where its correlation is constrained to be zero. Intervention effects can be explicitly tested by adding intervention membership as an external covariate that changes these coupled processes. Intervention effect modifiers or moderators will be tested in a confirmatory (eg, sex) or exploratory investigations.

Implementation (Phase 3)

A qualitative postintervention assessment of intervention implementation will be conducted with multilevel stakeholders, including students and both campus- and national-level student affairs staff. The goals are to better understand (1) participating students’ experiences with the intervention; (2) barriers and facilitators to implementation, guided by CFIR; (3) potential program sustainability; and (4) necessary modifications for other sites for scale-up.

Focus group participants will be a subset of students from the PFI+CDF arm of the RCT, as well as campus- and national-level stakeholders who also participated in preimplementation focus groups. Participants in the PFI+CDF condition will be asked if they are interested in participating in a follow-up study after the 13-month follow-up. We will randomly select up to 48 students who indicate interest in participating (n=24 per site) at varying levels of engagement with the intervention (as guided by program analytic measures) for a maximum of 3 focus groups per site (5-8 participants per group). Campus student affairs staff will be contacted via phone and email for staff focus groups (1 focus group per site for student affairs staff with 5-8 participants per group). At the national level, we will conduct 4 focus groups, with 5-8 participants per group, yielding a total of up to 32 participants. All focus groups will last 60-90 minutes with US $50 and US $100 gift card incentives for students and staff, respectively. The analytic plan for phase 3 qualitative data will mirror phase 1.

Ethics Approval

The study underwent review and approval by the UK Institutional Review Board (IRB #62769), which serves as the single IRB of record for this study. All participants will sign an approved consent form in accordance with the ethical standards of Helsinki.


Recruitment and enrollment for phase 1 began in January 2022. The findings of phase 1 will inform the development and build of integrated PFI+CDF. It is anticipated that phase 2 will begin in August 2023, and phase 3 will begin in October 2024. Data will be shared in the NIAAA Data Archive twice a year (April 1 and October 1), starting from October 1, 2023. Findings will be published in peer-reviewed journals and presented at international, national, or regional professional meetings and conferences.


Overview

This project aims to fill a gap highlighted in the NIAAA Strategic Plan 2017-2021 [3] by advancing an intervention that integrates alcohol misuse and RSB. It also directly addresses the 2 primary areas of foci underlying a recent NIAAA workshop to advance the science on evidence-based brief interventions for young adult populations: (1) optimizing intervention design and (2) implementation and scale-up [85]. To the best of our knowledge, the use of dynamic feedback based on individual behavior trajectories to optimize PFI content with rapid and sustained deliveries and ongoing evaluations has never been attempted with this population and area of study. Understanding the impact of a dual-risk behavior PFI that incorporates novel, cross-tailored between- and within-person feedback profiles can help inform best practices for the delivery of prevention interventions relevant to college students. If successful, our approach could influence how PFIs are developed and delivered in other populations and settings for maximum benefit. In addition, employment of a hybrid type 1 effectiveness-implementation design for this population, behavior, and campus setting is also the first of its kind and is expected to yield broadly informative outcomes through its rigorous randomized trial design testing intervention effectiveness and multilevel stakeholder engagement pre- and postimplementation.

Limitations

There are several potential limitations that need to be acknowledged. First, the emphasis on first-year college students may be restrictive. We chose to focus on first-year students because they are at risk for alcohol use and RSB [16-26], but older students also experience alcohol-related harms. Many college campuses require students to complete a brief alcohol intervention at the start of college and often use existing commercialized PFIs, providing a built-in audience for the adapted PFI+CDF intervention [35,36]. We encourage future studies to explore PFI+CDF in other at-risk populations, such as older students and young adults not in college. Second, the PFI+CDF intervention approach is intensive and could lead to concerns about student engagement. However, our past work on integrated PFIs indicates that participants engaged with feedback content and viewed it multiple times [86]. We demonstrated that increased personalization leads to a stronger program effect, potentially mediated through increased attention to content [32]. By involving students in the design process in phase 1, we should enhance their interest [59,87,88]. Students also reported favorable reactions to the proposed study methods. Thus, we anticipate high levels of engagement, but will also examine program engagement in phase 2 analyses and phase 3 focus groups. Third, there are alternatives to a web-based app platform. Technology changes rapidly, with many other options for content delivery (eg, native mobile apps, smartwatches, social media). Our goal was to create a flexible system to deliver content in multiple ways (email and SMS text message), increasing the likelihood of engagement. Native mobile apps require more programming than web apps to operate across smartphone types and operating systems. Social media offers opportunities (eg, user-generated interaction and content) but also its own challenges (eg, spread of misinformation). Alternate delivery platforms will be explored during focus groups, and we anticipate the need for content to be portable to other platforms in future implementation.

Conclusions

This innovative, multisite hybrid effectiveness-implementation study will (1) evaluate the impact of a PFI that integrates content on alcohol use and RSB and is adapted to include an innovative CDF component for at-risk first-year college students and (2) identify implementation factors critical to its success to facilitate future scale-up in campus settings. The findings of this study will improve existing evidence-based alcohol programs and bridge the gap between research and practice at the university level.

Acknowledgments

This work was supported by the National Institute on Alcohol Abuse and Alcoholism (NIAAA) grant R01 AA028246. The content is solely the responsibility of the authors and does not represent the official views of the NIAAA or the National Institutes of Health.

Data Availability

Data sharing is not applicable to this paper as no data sets have been generated or analyzed. Once generated, this study will submit and share data with National Institute on Alcohol Abuse and Alcoholism (NIAAA) Data Archive, a data repository housed within the National Institute of Mental Health Data Archive (NDA).

Conflicts of Interest

DBB receives a salary from Klein Buendel, Inc. His spouse is an owner of Klein Buendel, Inc.

Multimedia Appendix 1

Peer-reviewer report from the Interventions to Prevent and Treat Addictions Study Section - Risk, Prevention and Health Behavior Integrated Review Group (National Institutes of Health, USA).

PDF File (Adobe PDF File), 144 KB

  1. Schulenberg JE, Patrick ME, Johnston LD, O'Malley PM, Bachman JG, Miech RA. Monitoring the Future National Survey Results on Drug Use, 1975-2020: Volume II, College Students and Adults Ages 19-60. Ann Arbor, MI: Institute for Social Research, University of Michigan; 2021.
  2. College drinking fact sheet. National Institute on Alcohol Abuse and Alcoholism. 2015.   URL: https://www.niaaa.nih.gov/publications/brochures-and-fact-sheets/college-drinking [accessed 2023-02-01]
  3. National institute on alcohol abuse and alcoholism strategic plan 2017-2021. National Institute on Alcohol Abuse and Alcoholism. 2017.   URL: https://www.niaaa.nih.gov/sites/default/files/StrategicPlan_NIAAA_optimized_2017-2020.pdf [accessed 2023-02-01]
  4. Kerr DCR, Washburn IJ, Morris MK, Lewis KAG, Tiberio SS. Event-level associations of marijuana and heavy alcohol use with intercourse and condom use. J Stud Alcohol Drugs 2015;76(5):733-737. [CrossRef] [Medline]
  5. Patrick ME, Maggs JL, Lefkowitz ES. Daily associations between drinking and sex among college students: a longitudinal measurement burst design. J Res Adolesc 2015;25(2):377-386 [FREE Full text] [CrossRef] [Medline]
  6. Kiene SM, Barta WD, Tennen H, Armeli S. Alcohol, helping young adults to have unprotected sex with casual partners: findings from a daily diary study of alcohol use and sexual behavior. J Adolesc Health 2009;44(1):73-80 [FREE Full text] [CrossRef] [Medline]
  7. Neal DJ, Fromme K. Event-level covariation of alcohol intoxication and behavioral risks during the first year of college. J Consult Clin Psychol 2007;75(2):294-306. [CrossRef]
  8. Patrick ME, Maggs JL. Does drinking lead to sex? Daily alcohol-sex behaviors and expectancies among college students. Psychol Addict Behav 2009;23(3):472-481 [FREE Full text] [CrossRef] [Medline]
  9. Kilwein TM, Looby A. Predicting risky sexual behaviors among college student drinkers as a function of event-level drinking motives and alcohol use. Addict Behav 2018;76:100-105. [CrossRef] [Medline]
  10. Satterwhite CL, Torrone E, Meites E, Dunne EF, Mahajan R, Ocfemia MCB, et al. Sexually transmitted infections among US women and men: prevalence and incidence estimates, 2008. Sex Transm Dis 2013;40(3):187-193. [CrossRef] [Medline]
  11. Testa M, Hoffman JH, Livingston JA. Alcohol and sexual risk behaviors as mediators of the sexual victimization-revictimization relationship. J Consult Clin Psychol 2010;78(2):249-259 [FREE Full text] [CrossRef] [Medline]
  12. Testa M, Livingston JA, Wang W. Dangerous liaisons: the role of hookups and heavy episodic drinking in college sexual victimization. Violence Vict 2019;34(3):492-507 [FREE Full text] [CrossRef] [Medline]
  13. Testa M, Livingston JA, Wang W, Lewis MA. Preventing college sexual victimization by reducing hookups: a randomized controlled trial of a personalized normative feedback intervention. Prev Sci 2020;21(3):388-397 [FREE Full text] [CrossRef] [Medline]
  14. Dir AL, Riley EN, Cyders MA, Smith GT. Problematic alcohol use and sexting as risk factors for sexual assault among college women. J Am Coll Health 2018;66(7):553-560 [FREE Full text] [CrossRef] [Medline]
  15. Testa M, VanZile-Tamsen C, Livingston JA, Koss MP. Assessing women's experiences of sexual aggression using the sexual experiences survey: evidence for validity and implications for research. Psychol Women Q 2016;28(3):256-265. [CrossRef]
  16. Riordan BC, Conner TS, Flett JAM, Scarf D. A brief orientation week ecological momentary intervention to reduce university student alcohol consumption. J Stud Alcohol Drugs 2015;76(4):525-529. [CrossRef] [Medline]
  17. Riordan BC, Scarf D, Conner TS. Is orientation week a gateway to persistent alcohol use in university students? A preliminary investigation. J Stud Alcohol Drugs 2015;76(2):204-211. [CrossRef] [Medline]
  18. Riordan BC, Conner TS, Thrul J, Flett JAM, Carey KB, Scarf D. Just a first-year thing? The relations between drinking during orientation week and subsequent academic year drinking across class years. Subst Use Misuse 2018;53(9):1501-1510. [CrossRef] [Medline]
  19. Cranney S. The relationship between sexual victimization and year in school in US colleges: investigating the parameters of the "red zone". J Interpers Violence 2015;30(17):3133-3145 [FREE Full text] [CrossRef] [Medline]
  20. Flack WF, Caron ML, Leinen SJ, Breitenbach KG, Barber AM, Brown EN, et al. "The red zone": temporal risk for unwanted sex among college students. J Interpers Violence 2008;23(9):1177-1196. [CrossRef] [Medline]
  21. Humphrey JA, White JW. Women's vulnerability to sexual assault from adolescence to young adulthood. J Adolesc Health 2000;27(6):419-424. [CrossRef] [Medline]
  22. Kimble M, Neacsiu AD, Flack WF, Horner J. Risk of unwanted sex for college women: evidence for a red zone. J Am Coll Health 2008;57(3):331-338. [CrossRef] [Medline]
  23. Testa M, Hoffman JH. Naturally occurring changes in women's drinking from high school to college and implications for sexual victimization. J Stud Alcohol Drugs 2012;73(1):26-33 [FREE Full text] [CrossRef] [Medline]
  24. Schulenberg JE, Maggs JL. A developmental perspective on alcohol use and heavy drinking during adolescence and the transition to young adulthood. J Stud Alcohol Suppl 2002(14):54-70. [CrossRef] [Medline]
  25. Auerbach KJ, Collins LM. A multidimensional developmental model of alcohol use during emerging adulthood. J Stud Alcohol 2006;67(6):917-925. [CrossRef] [Medline]
  26. Lee CM, Lewis MA, Neighbors C. Preliminary examination of spring break alcohol use and related consequences. Psychol Addict Behav 2009;23(4):689-694 [FREE Full text] [CrossRef] [Medline]
  27. Lewis MA, Lindgren KP, Fossos N, Neighbors C, Oster-Aaland L. Examining the relationship between typical drinking behavior and 21st birthday drinking behavior among college students: implications for event-specific prevention. Addiction 2009;104(5):760-767 [FREE Full text] [CrossRef] [Medline]
  28. LaBrie JW, Kenney SR, Millbury S, Lac A. Sexual experience and risky alcohol consumption among incoming first-year college females. J Child Adolesc Subst Abuse 2010;20(1):15-33 [FREE Full text] [CrossRef] [Medline]
  29. Spoth R, Greenberg M, Turrisi R. Preventive interventions addressing underage drinking: state of the evidence and steps toward public health impact. Pediatrics 2008;121(Suppl 4):S311-S316 [FREE Full text] [CrossRef] [Medline]
  30. Planning alcohol interventions using NIAAA’s college AIM. National Institute on Alcohol Abuse and Alcoholism. 2015.   URL: https://www.niaaa.nih.gov/sites/default/files/publications/NIAAA_College_Matrix_Booklet.pdf [accessed 2023-02-01]
  31. Miller MB, Leffingwell T, Claborn K, Meier E, Walters S, Neighbors C. Psychol Addict Behav 2013 Dec;27(4):909-920 [FREE Full text] [CrossRef] [Medline]
  32. Ray AE, Kim SY, White HR, Larimer ME, Mun EY, Clarke N, Project INTEGRATE Team. When less is more and more is less in brief motivational interventions: characteristics of intervention content and their associations with drinking outcomes. Psychol Addict Behav 2014;28(4):1026-1040 [FREE Full text] [CrossRef] [Medline]
  33. Walters ST, Neighbors C. Feedback interventions for college alcohol misuse: what, why and for whom? Addict Behav 2005;30(6):1168-1182 [FREE Full text] [CrossRef] [Medline]
  34. Cronce JM, Bittinger JN, Liu J, Kilmer JR. Electronic feedback in college student drinking prevention and intervention. Alcohol Res 2014;36(1):47-62 [FREE Full text] [Medline]
  35. AlcoholEdu for college: effective prevention education for college students. Vector Solutions. 2022.   URL: https://www.vectorsolutions.com/solutions/vector-lms/higher-education/alcoholedu-course/ [accessed 2023-02-01]
  36. eCHECKUP TO GO. San Diego State Research Foundation. 2021.   URL: https://www.echeckuptogo.com/ [accessed 2023-02-01]
  37. Croom K, Lewis D, Marchell T, Lesser ML, Reyna VF, Kubicki-Bedford L, et al. Impact of an online alcohol education course on behavior and harm for incoming first-year college students: short-term evaluation of a randomized trial. J Am Coll Health 2009;57(4):445-454. [CrossRef] [Medline]
  38. Lovecchio CP, Wyatt TM, DeJong W. Reductions in drinking and alcohol-related harms reported by first-year college students taking an online alcohol education course: a randomized trial. J Health Commun 2010;15(7):805-819. [CrossRef] [Medline]
  39. Hustad JTP, Barnett NP, Borsari B, Jackson KM. Web-based alcohol prevention for incoming college students: a randomized controlled trial. Addict Behav 2010;35(3):183-189 [FREE Full text] [CrossRef] [Medline]
  40. Walters ST, Vader AM, Harris TR. A controlled trial of web-based feedback for heavy drinking college students. Prev Sci 2007;8(1):83-88. [CrossRef] [Medline]
  41. Doumas DM, Andersen LL. Reducing alcohol use in first-year university students: evaluation of a web-based personalized feedback program. J Coll Couns 2009;12(1):18-32. [CrossRef]
  42. Walters ST, Vader AM, Harris TR, Field CA, Jouriles EN. Dismantling motivational interviewing and feedback for college drinkers: a randomized clinical trial. J Consult Clin Psychol 2009;77(1):64-73 [FREE Full text] [CrossRef] [Medline]
  43. Lewis MA, Rhew IC, Fairlie AM, Swanson A, Anderson J, Kaysen D. Evaluating personalized feedback intervention framing with a randomized controlled trial to reduce young adult alcohol-related sexual risk taking. Prev Sci 2019;20(3):310-320 [FREE Full text] [CrossRef] [Medline]
  44. Huh D, Mun E, Larimer ME, White HR, Ray AE, Rhew IC, et al. Brief motivational interventions for college student drinking may not be as powerful as we think: an individual participant-level data meta-analysis. Alcohol Clin Exp Res 2015;39(5):919-931 [FREE Full text] [CrossRef] [Medline]
  45. Mun EY, White HR, Morgan TJ. Individual and situational factors that influence the efficacy of personalized feedback substance use interventions for mandated college students. J Consult Clin Psychol 2009;77(1):88-102 [FREE Full text] [CrossRef] [Medline]
  46. Mun EY, Zhou Z, Huh D, Tan L, Li D, Tanner-Smith EE, et al. Brief Alcohol Interventions are Effective through 6 Months: Findings from marginalized zero-inflated poisson and negative binomial models in a two-step IPD meta-analysis. Prev Sci 2022. [CrossRef] [Medline]
  47. Jiao Y, Mun EY, Trikalinos TA, Xie M. A CD-based mapping method for combining multiple related parameters from heterogeneous intervention trials. Stat Interface 2020;13(4):533-549 [FREE Full text] [CrossRef] [Medline]
  48. Miller WR, Rollnick S. Motivational Interviewing: Helping People Change. New York, NY: Guilford Press; 2012.
  49. Carey KB, Scott-Sheldon LAJ, Garey L, Elliott JC, Carey MP. Alcohol interventions for mandated college students: a meta-analytic review. J Consult Clin Psychol 2016;84(7):619-632 [FREE Full text] [CrossRef] [Medline]
  50. Braitman AL, Henson JM. Personalized boosters for a computerized intervention targeting college drinking: the influence of protective behavioral strategies. J Am Coll Health 2016;64(7):509-519 [FREE Full text] [CrossRef] [Medline]
  51. Suffoletto B, Merrill JE, Chung T, Kristan J, Vanek M, Clark DB. A text message program as a booster to in-person brief interventions for mandated college students to prevent weekend binge drinking. J Am Coll Health 2016;64(6):481-489 [FREE Full text] [CrossRef] [Medline]
  52. Neighbors C, Lewis MA, Atkins DC, Jensen MM, Walter T, Fossos N, et al. Efficacy of web-based personalized normative feedback: a two-year randomized controlled trial. J Consult Clin Psychol 2010;78(6):898-911 [FREE Full text] [CrossRef] [Medline]
  53. Carey KB, DeMartini KS, Prince MA, Luteran C, Carey MP. Effects of choice on intervention outcomes for college students sanctioned for campus alcohol policy violations. Psychol Addict Behav 2013;27(3):596-603 [FREE Full text] [CrossRef] [Medline]
  54. Carey MP, Senn TE, Walsh JL, Coury-Doniger P, Urban MA, Fortune T, et al. Evaluating a brief, video-based sexual risk reduction intervention and assessment reactivity with STI clinic patients: results from a randomized controlled trial. AIDS Behav 2015;19(7):1228-1246 [FREE Full text] [CrossRef] [Medline]
  55. Murphy JG, Dennhardt AA, Martens MP, Borsari B, Witkiewitz K, Meshesha LZ. A randomized clinical trial evaluating the efficacy of a brief alcohol intervention supplemented with a substance-free activity session or relaxation training. J Consult Clin Psychol 2019;87(7):657-669 [FREE Full text] [CrossRef] [Medline]
  56. Toomey TL, Nelson TF, Winters KC, Miazga MJ, Lenk KM, Erickson DJ. Characterizing college systems for addressing student alcohol use: latent class analysis of U.S. four-year colleges. J Stud Alcohol Drugs 2013;74(5):777-786. [CrossRef] [Medline]
  57. Ringwalt CL, Paschall MJ, Gitelman AM. Alcohol prevention strategies on college campuses and student alcohol abuse and related problems. J Drug Educ 2011;41(1):99-118. [CrossRef] [Medline]
  58. Nelson TF, Toomey TL, Lenk KM, Erickson DJ, Winters KC. Implementation of NIAAA college drinking task force recommendations: how are colleges doing 6 years later? Alcohol Clin Exp Res 2010;34(10):1687-1693. [CrossRef] [Medline]
  59. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care 2012;50(3):217-226 [FREE Full text] [CrossRef] [Medline]
  60. Glasgow RE, Lichtenstein E, Marcus AC. Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health 2003;93(8):1261-1267. [CrossRef] [Medline]
  61. Johnson K, Gilbert L, Hunt T, Wu E, Metsch L, Goddard-Eckrich D, et al. The effectiveness of a group-based computerized HIV/STI prevention intervention for black women who use drugs in the criminal justice system: study protocol for E-WORTH (empowering African-American women on the road to health), a hybrid type 1 randomized controlled trial. Trials 2018;19(1):486 [FREE Full text] [CrossRef] [Medline]
  62. Smith MJ, Smith JD, Fleming MF, Jordan N, Oulvey EA, Bell MD, et al. Enhancing individual placement and support (IPS)-supported employment: a type 1 hybrid design randomized controlled trial to evaluate virtual reality job interview training among adults with severe mental illness. Contemp Clin Trials 2019;77:86-97 [FREE Full text] [CrossRef] [Medline]
  63. Claborn K, Becker S, Operario D, Safren S, Rich JD, Ramsey S. Adherence intervention for HIV-infected persons who use drugs: adaptation, open trial, and pilot randomized hybrid type 1 trial protocol. Addict Sci Clin Pract 2018;13(1):12 [FREE Full text] [CrossRef] [Medline]
  64. Arrossi S, Paolino M, Orellana L, Thouyaret L, Kohler RE, Viswanath K. Mixed-methods approach to evaluate an mHealth intervention to increase adherence to triage of human papillomavirus-positive women who have performed self-collection (the ATICA study): study protocol for a hybrid type I cluster randomized effectiveness-implementation trial. Trials 2019;20(1):148 [FREE Full text] [CrossRef] [Medline]
  65. Brownson RC, Jacobs JA, Tabak RG, Hoehner CM, Stamatakis KA. Designing for dissemination among public health researchers: findings from a national survey in the United States. Am J Public Health 2013;103(9):1693-1699. [CrossRef] [Medline]
  66. Escoffery C, Lebow-Skelley E, Haardoerfer R, Boing E, Udelson H, Wood R, et al. A systematic review of adaptations of evidence-based public health interventions globally. Implement Sci 2018;13(1):125 [FREE Full text] [CrossRef] [Medline]
  67. Elwy AR, Wasan AD, Gillman AG, Johnston KL, Dodds N, McFarland C, et al. Using formative evaluation methods to improve clinical implementation efforts: description and an example. Psychiatry Res 2020;283:112532 [FREE Full text] [CrossRef] [Medline]
  68. Kirchner JE, Smith JL, Powell BJ, Waltz TJ, Proctor EK. Getting a clinical innovation into practice: an introduction to implementation strategies. Psychiatry Res 2020;283:112467 [FREE Full text] [CrossRef] [Medline]
  69. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009;4:50 [FREE Full text] [CrossRef] [Medline]
  70. Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the consolidated framework for implementation research. Implement Sci 2016;11:72 [FREE Full text] [CrossRef] [Medline]
  71. NASPA Annual Conferences. NASPA Student Affairs Administrators in Higher Education. 2019.   URL: https://www.naspa.org/events/ [accessed 2023-02-01]
  72. CFIR research team-center for clinical management research. Consolidated Framework for Implementation Research. 2022.   URL: https://cfirguide.org/ [accessed 2023-02-01]
  73. Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the consolidated framework for implementation research. Implement Sci 2016;11:72 [FREE Full text] [CrossRef] [Medline]
  74. Crabtree BF, Miller W. Doing Qualitative Researchage. California: SAGE Publications; 2022.
  75. NVivo. QSR International Party Ltd. 2020.   URL: https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home [accessed 2023-02-01]
  76. Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci 2017;12(1):108 [FREE Full text] [CrossRef] [Medline]
  77. O’Brien HL, Cairns P, Hall M. A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. Int J Hum Comput Stud 2018;112:28-39. [CrossRef]
  78. ACHA education center. American College Health Association. 2022.   URL: https://www.acha.org/ACHA/Resources/College_Health_Topics.aspx [accessed 2022-10-01]
  79. Lewis MA, Lee CM, Patrick ME, Fossos N. Gender-specific normative misperceptions of risky sexual behavior and alcohol-related risky sexual behavior. Sex Roles 2007;57(1-2):81-90. [CrossRef]
  80. Lewis MA, Rhew IC, Fairlie AM, Swanson A, Anderson J, Kaysen D. Evaluating personalized feedback intervention framing with a randomized controlled trial to reduce young adult alcohol-related sexual risk taking. Prev Sci 2019;20(3):310-320 [FREE Full text] [CrossRef] [Medline]
  81. Collins RL, Parks GA, Marlatt GA. Social determinants of alcohol consumption: The effects of social interaction and model status on the self-administration of alcohol. J Consult Clini Psycol 1985;53(2):189-200. [CrossRef]
  82. Read JP, Kahler CW, Strong DR, Colder CR. Development and preliminary validation of the young adult alcohol consequences questionnaire. J Stud Alcohol 2006;67(1):169-177. [CrossRef] [Medline]
  83. Capaldi DM, Stoolmiller M, Clark S, Owen LD. Heterosexual risk behaviors in at-risk young men from early adolescence to young adulthood: prevalence, prediction, and association with STD contraction. Dev Psychol 2002;38(3):394-406. [CrossRef]
  84. Huh D, Mun EY, Walters ST, Zhou Z, Atkins DC. A tutorial on individual participant data meta-analysis using Bayesian multilevel modeling to estimate alcohol intervention effects across heterogeneous studies. Addict Behav 2019;94:162-170 [FREE Full text] [CrossRef] [Medline]
  85. National Institute on Alcohol Abuse and Alcoholism. Brief prevention interventions for young adults: strengthening effects. 2019 Presented at: Brief Prevention Interventions for Young Adults: Strengthening Effects; 10/10/2019; Bethesda, MD.
  86. Li X, Lewis MA, Fairlie AM, Larimer ME, Mun EY. Examining the viewing pattern of Web-delivered personalized feedback interventions aimed at reducing alcohol-related risky sexual behavior among young adults. J Am Coll Health 2022:1-8. [CrossRef] [Medline]
  87. Ray AE, Greene K, Hecht ML, Barriage SC, Miller-Day M, Glenn SD, et al. An e-learning adaptation of an evidence-based media literacy curriculum to prevent youth substance use in community groups: development and feasibility of real media. JMIR Form Res 2019;3(2):e12132 [FREE Full text] [CrossRef] [Medline]
  88. Hopfer S, Ray AE, Hecht ML, Miller-Day M, Belue R, Zimet G, et al. Taking an HPV vaccine research-tested intervention to scale in a clinical setting. Transl Behav Med 2018;8(5):745-752 [FREE Full text] [CrossRef] [Medline]


AOC: assessment-only control
CDF: cross-tailored dynamic feedback
CFIR: Consolidated Framework for Implementation Research
GHI: generic health information
IRB: Institutional Review Board
NIAAA: National Institute on Alcohol Abuse and Alcoholism
PFI: personalized feedback intervention
RCT: randomized controlled trial
RSB: risky sexual behavior
UK: University of Kentucky
UNT: University of North Texas


Edited by T Leung; This paper was peer reviewed by the Interventions to Prevent and Treat Addictions Study Section (IPTA) - Risk, Prevention and Health Behavior Integrated Review Group - Center for Scientific Review (National Institutes of Health, USA). See the Multimedia Appendix for the peer-review report; submitted 01.11.22; accepted 23.01.23; published 20.03.23

Copyright

©Anne E Ray, Eun-Young Mun, Melissa A Lewis, Dana M Litt, Jerod L Stapleton, Lin Tan, David B Buller, Zhengyang Zhou, Heather M Bush, Seth Himelhoch. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 20.03.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.