Protocol
Abstract
Background: Although pre-exposure prophylaxis (PrEP) could substantially mitigate HIV risk, sexual minority men who use stimulants commonly experience difficulties with engaging in PrEP clinical services. Motivational interviewing (MI) and contingency management (CM) reduce substance use and condomless anal sex (CAS) in this population, but these motivational enhancement interventions require modifications to promote engagement along the PrEP care continuum.
Objective: PrEP Readiness Interventions for Supporting Motivation (PRISM) is a pilot sequential multiple assignment randomized trial testing the feasibility, acceptability, and preliminary effectiveness of distinct combinations of telehealth MI and CM in 70 cisgender sexual minority men who use stimulants that are not currently taking PrEP.
Methods: A national sample was recruited via social networking applications to complete a baseline assessment and mail-in HIV testing. Those with nonreactive HIV results were randomized to receive either (1) a 2-session MI intervention focusing on PrEP use (session 1) and concomitant stimulant use or CAS (session 2) or (2) a CM intervention with financial incentives for documented evidence of PrEP clinical evaluation by a medical provider (US $50) and filling a PrEP prescription (US $50). At the 3-month follow-up assessment, participants who reported they had not filled a prescription for PrEP were randomized a second time to either (1) switch to a second-stage intervention (ie, MI+CM or CM+MI) or (2) continue with assessments only. Outcomes for both responders and nonresponders were reassessed at a 6-month follow-up. The primary outcome is documented evidence of filling a PrEP prescription over 6 months. Self-reported secondary outcomes include PrEP clinical evaluation by a medical provider, stimulant use, and CAS. Qualitative exit interviews were conducted with a subgroup of responders and nonresponders to characterize their experiences with the MI and CM interventions.
Results: Implementation of PRISM underscores challenges in reaching sexual minority men who use stimulants to optimize HIV prevention efforts. Approximately 1 in 10 (104/1060) eligible participants have enrolled. Of the 104 who enrolled, 87 (84%) completed mail-in HIV testing. We delivered 5 preliminary HIV-positive results, including posttest counseling with referrals to confirmatory testing.
Conclusions: Lessons learned from PRISM underscore the central importance of a flexible, participant-centered approach to support the engagement of sexual minority men who use stimulants. Leveraging telehealth platforms to deliver motivational enhancement interventions also expanded their reach and potential public health impact with this high-priority population. Further research is needed to determine the effectiveness of telehealth MI and CM for supporting PrEP use in sexual minority men who use stimulants.
Trial Registration: ClinicalTrials.gov NCT04205487; https://clinicaltrials.gov/study/NCT04205487
International Registered Report Identifier (IRRID): DERR1-10.2196/48459
doi:10.2196/48459
Keywords
Introduction
Sexual minority men continue to account for more than two-thirds of new HIV infections in the United States [
- ], and it is estimated that 70% of seroconversions in this population occur during receptive condomless anal sex (CAS) [ - ]. Consequently, expanded efforts are needed to optimize the benefits of pre-exposure prophylaxis (PrEP) among sexual minority men at greatest risk for HIV. The Centers for Disease Control and Prevention [ , ] has estimated that 1 in 6 sexual minority men will acquire HIV in their lifetime, including half of Black sexual minority men and one-quarter of Latino sexual minority men. Over and above these profound racial disparities, there is a resurgent epidemic of methamphetamine use among sexual minority men that is disproportionately affecting Black and Latino sexual minority men [ - ]. Although methamphetamine use appeared to decline somewhat after significant public health attention in the early- and mid-2000s [ , ], it is again on the rise [ , - ]. For over two decades, methamphetamine and other stimulant use has been identified as a prominent driver of the HIV/AIDS epidemic in sexual minority men that is associated with engagement in CAS [ , ], altered rectal immune function [ , ], and faster rates of HIV seroconversion [ - ]. The public health impact of stimulant use is evidenced by recent findings from a cohort of sexual and gender minorities who have sex with men, where 1 in 3 new HIV infections were among those reporting methamphetamine use [ ].Sexual minority men who use stimulants experience substantial barriers to navigating HIV prevention services that undermine the clinical and public health benefits of PrEP. This is evidenced by findings from one study, where sexual minority men who use methamphetamine had 5-fold greater odds of repeat prescription for postexposure prophylaxis and a 3-fold greater rate of HIV seroconversion [
]. This underscores the clear benefits of supporting the entry or re-entry of sexual minority men who use stimulants into the PrEP care continuum. Although some studies found that sexual minority men who use substances report concerns about their hypothetical ability to adhere to PrEP [ , ], actual PrEP use among sexual minority men who use substances such as methamphetamine and amyl nitrites (ie, poppers) appears to be comparable to or greater than their peers who do not use substances [ - ]. At the same time, there is growing evidence that sexual minority men who use stimulants and other substances can experience difficulties achieving prevention-effective levels of daily oral PrEP adherence [ , , ] that may serve as early indicators of greater risk for disengagement from PrEP care and discontinuing PrEP [ - ]. For example, those engaging in heavy cocaine use have nearly 3-fold greater odds of disengagement from PrEP care compared to nonusers [ ]. Taken together, there is a clear need for scalable interventions to promote the entry or re-entry of sexual minority men who use stimulants into the PrEP care continuum.The effectiveness of motivational interviewing (MI) and contingency management (CM) interventions are supported by decades of clinical research in people with substance use disorders [
], and these are the only interventions that are efficacious for reducing both substance use and CAS in sexual minority men [ - ]. MI is an evidence-based counseling intervention targeting intrinsic motivation for health behavior change [ ]. CM targets extrinsic motivation by providing tangible incentives as positive reinforcement for performing health behaviors [ ], and it has also been successfully used to promote HIV-related health behavior change in people who use substances [ - ]. Interestingly, findings from one meta-analysis of the substance use disorder treatment literature indicate that MI achieves small but durable outcomes, while CM leads to moderate short-term outcomes [ ]. PrEP Readiness Interventions for Supporting Motivation (PRISM) addresses an important gap by testing sequentially delivered MI and CM interventions for promoting entry or re-entry into the PrEP care continuum.Cognitive evaluation theory proposes that motivational processes are arranged hierarchically such that the extrinsic rewards for behavior change provided during CM could paradoxically undermine intrinsic motivation in some circumstances [
]. In cognitive evaluation theory, higher-order needs for autonomy and self-determination govern the regulation of intrinsic motivation and self-efficacy, both of which could be partially undermined by CM incentives. This underscores the need for clinical research to test if there are distinct combinations of MI and CM that optimize durable PrEP use while decreasing stimulant use and CAS among sexual minority men.This paper describes the protocol for a pilot sequential multiple assignment randomized trial (SMART [
]) testing the feasibility, acceptability, and preliminary effectiveness of the PRISM telehealth motivational enhancement interventions. The primary outcome is documented evidence of filling a PrEP prescription over 6 months. As shown in , using sequential randomization procedures allowed for a comparison of 2 first-stage interventions: MI versus CM (randomized 1:1 after baseline). Then, among those who did not fill a PrEP prescription after 3 months (ie, nonresponders), we conducted a second randomization to switch to a second-stage intervention (ie, MI+CM and CM+MI) versus continue with assessments only (also randomized 1:1 for those not on PrEP at 3 months). Because CM has been shown to yield moderate short-term effects, we hypothesize that a greater proportion of those randomized to receive CM as the first-stage intervention will have filled a PrEP prescription and report being evaluated for PrEP by a medical provider over 6 months. Because MI also targets concomitant HIV risk behaviors, we hypothesize that those randomized to receive it as the first-stage intervention will show greater reductions in self-reported stimulant use and CAS over 6 months. Finally, among nonresponders, we hypothesize that participants randomized to switch to a second-stage intervention (ie, CM+MI and MI+CM) will have greater improvements in the primary and secondary outcomes compared to those who continue with assessments only.Methods
Study Design
This pilot SMART randomized 70 HIV-negative sexual minority men who use stimulants (ie, methamphetamine, powder cocaine, or crack cocaine) that are not currently taking PrEP, and completion of the final follow-up assessments is anticipated in July 2023. Participants were recruited via social networking applications across the United States. Interested individuals were directed to a web-based screener that assessed the following inclusion criteria: (1) 18 years of age or older; (2) identified as a cisgender man; (3) reported anal sex with a man (past 6 months); (4) reported using methamphetamine, powder cocaine, or crack cocaine in the past 3 months; (5) HIV-negative or unknown serostatus; (6) met Centers for Disease Control and Prevention criteria for PrEP eligibility [
]; and (7) not currently prescribed PrEP. PrEP eligibility was operationalized as any CAS regardless of partner type or any sexually transmitted infection (past 6 months).Research Team
Master’s and doctoral-level staff were trained in assessment administration, randomization, and intervention activities. Ongoing oversight and safety monitoring were provided by the principal investigators. Fidelity monitoring and group supervision for staff delivering MI sessions were overseen by a licensed psychologist who is a member of the Motivational Interviewing Network of Trainers. Follow-up assessments were conducted by staff who were blinded to intervention conditions. One team member with graduate-level training in qualitative methods conducted qualitative exit interviews with participants.
Ethical Considerations
All procedures for this pilot SMART were approved by the University of Miami Institutional Review Board (UM IRB Study ID: MODCR00000105) with a reliance agreement from the City University of New York Graduate School of Public Health. All participants completed an informed consent before study enrollment. All pilot SMART activities were conducted using Zoom (Zoom Video Communications, Inc), which emerged as a flexible response to the COVID-19 pandemic and represents a scalable platform for reaching the broader population of sexual minority men who use stimulants with the PRISM telehealth motivational enhancement interventions. Potentially eligible participants were invited to an enrollment visit that included informed consent for the first 3 months of the pilot SMART and a baseline assessment via Zoom. Those who completed the enrollment visit received a US $50 Amazon gift card, Venmo, or Zelle cash application payment. In total, participants could make up to US $335 over the course of the pilot SMART, depending on the interventions they received. Information regarding the payment for each study activity is included in the paper where relevant. All data were stored on a Food and Drug Administration and Health Insurance Portability and Accountability Act–compliant University of Miami server, and all electronic files containing identifiable information were password-protected with access limited to institutional review board–approved study staff only.
Sequential Informed Consent
At baseline, participants provided informed consent for the first 3 months of the pilot SMART with trained staff. This consent described the first-stage randomization to MI versus CM as well as the 3-month follow-up assessment. We used sequential informed consent procedures to ensure that participants did not plan to delay filling a PrEP prescription to be eligible for the second-stage randomization and the possibility of additional incentives (eg, those initially randomized to MI would delay filling a PrEP prescription to have another chance to receive CM financial incentives). After the 3-month follow-up assessment, participants completed a second informed consent that described procedures for the second-stage randomization of nonresponders, the 6-month follow-up assessment, and qualitative exit interviews. The follow-up assessments at 3 and 6 months were completed by an independent assessor who had not previously delivered MI or CM to participants. Participants were sent a link to the self-report measures to complete on their own, and they received a US $50 Amazon gift card or cash application payment for completing each assessment.
Mail-In HIV Testing
After the baseline assessment, participants were sent a testing kit to collect a saliva sample with an OraSure HIV-1 (LOT 6691354; OraSure Technologies, Inc) testing device, with instructions on how to take the test and a prepaid return envelope to the HIV testing laboratory. Participants received a US $25 Amazon gift card or cash application payment for mailing this sample to a laboratory for HIV testing [
, ]. Participants who did not complete HIV home testing or those with reactive HIV test results were excluded prior to randomization. Participants with reactive HIV test results were provided with posttest counseling and assisted in connecting with local confirmatory testing [ ].Pilot SMART Procedures
As shown in
, participants who provided a saliva sample that was nonreactive for HIV were randomized to a first-stage intervention: (1) a 2-session MI intervention or (2) a CM where they received up to US $100 in financial incentives for taking the first step toward starting or restarting PrEP. Randomization at baseline was stratified as a function of whether participants have previously taken PrEP with the randomization schemes created in SAS (version 9.4; SAS Institute Inc) by the data manager using randomly permuted block sizes of 2, 4, and 6. The randomization schemes were administered using REDCap (Research Electronic Data Capture; Vanderbilt University) and were not viewable by staff until the moment of randomization for each participant. Randomization probabilities at each stage were 1:1. Immediately following randomization, participants received their first MI session or a brief introduction to the financial incentives they could earn during the 3-month CM period. All participants received a US $20 Amazon gift card or cash application payment for attending this first-stage randomization visit. After 3 months, participants who reported that they have not filled a PrEP prescription in the prior 3 months are classified as nonresponders. Nonresponders were randomized a second time (no stratification) to either (1) switch to a second-stage intervention (MI+CM or CM+MI) or (2) continue with assessments only. Finally, responders and nonresponders completed a final follow-up assessment at 6 months to measure the primary and secondary outcomes. Participants received a US $50 Amazon gift card or cash application payment for completing each follow-up assessment at 3 and 6 months.MI Intervention
The 2-session MI intervention simultaneously targeted PrEP use (session 1) as well as co-occurring substance use and CAS (session 2). Each session was delivered approximately 1 week apart via Zoom, and participants received a US $20 Amazon gift card or cash application payment at each session. Participants had up to 3 months to complete both MI sessions.
Session 1 focused extensively on enhancing intrinsic motivation for starting or restarting PrEP. To begin, participants were invited to tell the facilitator a bit about themselves and describe what they know about PrEP. Using elicit-provide-elicit techniques, the facilitator provided relevant information to address any gaps in knowledge about PrEP. This included topics like the effectiveness and safety of PrEP, prevention effective adherence levels for sexual minority men, different oral dosing strategies (eg, 2-1-1), navigating PrEP care, and the availability of financial support for those without insurance. Then, participants were invited to describe their thoughts and feelings about the possibility of starting PrEP with selective reinforcement of change talk by the facilitator. Using the change ruler, participants rated on a scale of 1 to 10 how important it is for them to see a medical provider to learn more about PrEP. The facilitator used this to elicit change talk by asking participants why they did not pick a lower number (eg, “Why did you pick a 3 and not a 1?”). Next, the facilitator engaged participants in the roadmap exercise, where the decision regarding whether to start PrEP was presented as a fork in the road. Participants were asked to consider what life might look like in 1-2 years if they did not start PrEP and then if they chose to start PrEP. The session ended with a summary, and participants were encouraged to examine what (if any) steps they were ready to take toward starting or restarting PrEP. Those who were actively planning to start or restart PrEP were asked to elaborate on the timeline and examine any potential barriers they might encounter in accessing PrEP care.
At the beginning of session 2, participants were asked to describe their current thoughts and feelings about starting or restarting PrEP. The facilitator selectively reinforced change talk and answered any questions participants might have about navigating PrEP care. Next, participants were introduced to the focus of session 2, concomitant stimulant use, and CAS. Participants were presented with a menu of options that reflect possible topics for the session including (1) change how I use stimulants, (2) start substance use treatment, (3) attend a self-help group, (4) abstain from stimulants, (5) fewer sex partners, (6) less sex on stimulants, (7) use condoms, and (8) get tested for HIV regularly. Participants were encouraged to identify a topic of focus for the session that they wanted to discuss at greater length. Our approach to addressing stimulant use and CAS embraces the philosophy of harm reduction such that participants were not required to be ready, willing, or able to abstain from stimulant use or use condoms every time during anal sex [
]. Instead, the facilitator assisted participants with exploring a range of possible behavior change targets such as reducing the frequency of stimulant use, changing the mode of stimulant administration (eg, snorting instead of smoking), and using condoms during receptive anal sex with casual partners. Once a behavior change target was identified, participants were encouraged to elaborate on it to reinforce change talk. Using the change ruler, participants rated on a scale of 1 to 10 how important it is for them to make this change. The facilitator used this to elicit change talk by asking participants why they did not pick a lower number (eg, “Why did you pick a 3 and not a 1?”). Next, the facilitator engaged the participant in the roadmap exercise, where the decision regarding whether to make this change was presented as a fork in the road. Participants were asked to consider what life might look like in 1-2 years if they did not make a change and then if they chose to change. The session ended with a summary, and participants were encouraged to examine what steps (if any) they were ready to take toward change. Those who were actively planning to make a change in their behavior were asked to elaborate on the timeline and examine any potential barriers they might encounter.CM Intervention
Facilitators provided a brief overview of the CM protocol and encouraged participants to ask any questions they may have about how to access PrEP in their community. Facilitators provided tailored referrals for local PrEP services [
] and web-based PrEP providers. Participants were provided financial incentives as positive reinforcement for 2 key behaviors that are crucial to PrEP care continuum entry or re-entry. First, participants received a US $50 incentive for documented evidence of completing a medical visit for PrEP clinical evaluation that includes HIV testing. Documentation can include either a note from a medical provider indicating that the participant was seen for a PrEP evaluation or laboratory results consistent with PrEP clinical evaluation (eg, HIV testing and kidney function). Second, participants who provided evidence that they filled a recent PrEP prescription for Truvada or Descovy matched to their photo identification (eg, photo of the medication bottle), received an additional US $50 incentive. Participants on Apretude as injectable PrEP were asked to provide documentation from their provider or medical record demonstrating that they received an injection to obtain the US $50 incentive. Because filling a PrEP prescription requires participants to receive a PrEP clinical evaluation by a medical provider, those who had not previously received US $50 for a PrEP clinical evaluation received US $100 when they provided evidence they filled a PrEP prescription. To provide timely positive reinforcement for these behaviors, incentives were provided via remote payment applications (eg, Venmo and Zelle) within 2 business days.Fidelity Monitoring
The procedures for monitoring the fidelity of the CM and MI intervention protocols were as follows: (1) detailed curriculum manuals for each intervention, (2) intensive training in delivering MI and CM, (3) incorporation of mock training sessions to ensure staff meet performance criteria for delivery, (4) facilitator checklists, and (5) audio taping of sessions. Audio recordings of facilitator sessions were reviewed to assess adherence to the protocol, delivery, interpersonal skills, facilitator or participant rapport, and session flow. Fidelity monitoring was also crucial to mitigate the risk of contamination (eg, possible delivery of MI counseling during CM). The first 3 participants for each staff member (MI and CM) were reviewed immediately. Staff members also participated in ongoing individual and group supervisions. Fidelity ratings of MI sessions used the MI treatment integrity protocol [
], which is the gold standard approach for monitoring the fidelity of MI. MI treatment integrity scores review 4 global categories (cultivating change talk, softening sustain talk, partnership, and empathy) and are based on a Likert-scale from 1 (low) to 5 (high) [ ].Primary Outcome
The primary outcome is verified evidence that a participant filled a PrEP prescription (ie, photo of a recently filled medication bottle) over the 6-month follow-up. For participants who did not provide evidence of a PrEP prescription as part of CM, those who reported taking PrEP were subsequently notified that they could receive an additional US $20 incentive for providing evidence of a recent PrEP prescription. We chose to implement this strategy to mitigate differential assessment of the primary outcome due to CM incentives. Participants were offered the US $20 incentive for providing evidence only after they self-reported recently filling a PrEP prescription so that it did not function as a CM incentive.
Secondary Outcomes
Participants completed self-report measures over the 6-month follow-up to assess several secondary outcomes that are described briefly below.
PrEP Clinical Evaluation
Participants were asked to indicate if they attended an appointment with a medical provider about starting PrEP in the past 3 months. Those who indicated they attended any medical appointment about starting PrEP over the 6-month follow-up were classified as completing PrEP clinical evaluation.
Stimulant Use Severity
The World Health Organization Alcohol, Smoking, and Substance Involvement Screening Test is a validated self-report measure of substance use [
, ]. We plan to examine changes in the amphetamine-type stimulant and cocaine use composite scores, which measure the severity of symptoms for stimulant use disorders. Where participants reported using multiple stimulants at a given time point, the highest mean score was selected. We will also examine changes in clinically validated cut-points for moderate and severe stimulant use disorders using the Alcohol, Smoking, and Substance Involvement Screening Test (mild=0-3; moderate=4-26; and severe=27 or greater). Again, where participants are using multiple stimulants at a given time point, the cocaine or amphetamine-type stimulant use score that reflects higher severity was selected.Receptive and Insertive CAS
Participants were asked to separately indicate the number of men with whom they had receptive or insertive anal sex “without a condom at least part of the time” in the past 3 months. If participants reported having CAS partners, they were asked to separately indicate the number of receptive and insertive CAS partners who were taking PrEP or were HIV-positive undetectable to examine the extent to which participants are biomed sorting [
].PrEP Intentions
A 3-item PrEP intentions scale assessed intentions to complete certain PrEP-related behaviors within the next 3 months (eg, “During the next 3 months, I will talk to a health care provider about PrEP.”). Responses were rated on a 4-point scale from definitely will not do (1) to definitely will (4) with higher scores indicating stronger intentions to use PrEP [
].PrEP Self-Efficacy
An 8-item scale assessed how difficult participants viewed behavior skills related to PrEP use (eg, “How difficult would it be for you to talk openly and honestly with a doctor about your sexual behaviors?”). Participants rated their responses on a 4-point scale ranging from very hard to do (1) to very easy to do (4) with higher ratings indicating greater self-efficacy for PrEP use [
].PrEP Attitudes
A 5-item scale assessed attitudes toward PrEP use (eg, “PrEP is effective at preventing HIV.”) [
]. Participants rated response options on a 5-point scale ranging from strongly disagree (1) to strongly agree (5) with higher scores indicating more positive attitudes toward PrEP use.PrEP Stigma
This 5-item scale assessed stigmatizing notions around PrEP use (eg, “People who take PrEP are promiscuous.”) [
]. Participants rated response options on a 5-point scale ranging from strongly disagree (1) to strongly agree (5) with higher scores indicating more stigmatizing views about PrEP [ ].Intent-to-Treat Analyses
Using logistic regression, we will examine the intent-to-treat effects of first-stage randomization (ie, MI vs CM) on (1) any documented evidence of filling a PrEP prescription (primary outcome) over the 6-month follow-up and (2) any self-reported PrEP clinical evaluation by a medical provider over the 6-month follow-up. These logistic regression analyses will test our primary hypothesis that it is better to start with CM versus MI. Intent-to-treat analyses of secondary outcomes involving longitudinal trajectories of continuous measures will be tested using multilevel random coefficient models (ie, hierarchical linear modeling). These analyses will test our secondary hypotheses that those randomized to receive MI as a first-stage intervention will display a greater decrease in stimulant use severity and number of CAS partners over 6 months. Finally, exploratory analyses using the methods described earlier will be conducted among nonresponders only. We hypothesize that nonresponders randomized to switch to a second-stage intervention (ie, CM+MI and MI+CM) will have greater improvements in the primary and secondary outcomes compared to those who continue with assessments only.
Power Analysis
Recent statistical modeling clearly demonstrates that it is inappropriate to use effect size estimates from a pilot trial for establishing effectiveness or informing subsequent power analyses [
]. Thus, the most appropriate focus of a pilot is to examine issues relevant to feasibility and acceptability, which do not require adequate statistical power. At the same time, we will examine the preliminary intent-to-treat effects of starting with MI versus CM in this pilot SMART. With 70 randomized participants, α=.05 (2-tailed), power=0.80, and 75% retention at 6 months, minimum detectable standardized mean differences for continuous outcomes ranged from 0.53 to 0.79 for within-subjects correlations r ranging from 0.10 to 0.80. For binary outcomes, using the same inputs as above plus small, medium, and large base rates of 10%, 25%, and 50%, respectively, raw proportion differences for r=0.10 ranged from 21% to 25% (standardized difference=0.55); and for r=0.80, the corresponding raw proportion differences ranged from 34% to 38% (standardized difference=0.80). Statistical power estimates following the second-stage randomization are dependent on the nonresponse rate.Qualitative Exit Interviews
After the 6-month follow-up assessment, participants were purposively selected for a qualitative exit interview examining their experiences with the PRISM telehealth motivational enhancement interventions received. Participants were purposively selected for in-depth qualitative interviews based on whether they were responders (n=10) or nonresponders (n=10) after 6 months. Participants invited to complete an in-depth qualitative interview received a US $50 Amazon gift card or cash application payment.
Interviews were conducted by a member of the study team that has not previously interacted with the participants at any point in the trial. Interviews were approximately 60 minutes. The interviewer completed ongoing training and supervision in qualitative methods and the pilot SMART objectives. The semistructured interview guide was tailored based on the responder status (responder at stage 1, responder at stage 2, or nonresponder at 6 months). Topics included likes and dislikes of PRISM telehealth interventions, views on the adequacy of study incentives, thoughts about PrEP, interest in injectable PrEP, and barriers and facilitators to PrEP uptake and adherence.
Qualitative Analyses
Interviews were audio recorded on Zoom with the participants’ consent and transcribed verbatim. The transcripts are reviewed for accuracy and quality assurance. A general inductive approach [
] will be used to analyze themes relating to the acceptability and feasibility of the PRISM interventions. Codes will be derived inductively starting with a thorough reading of the transcripts and identification of relevant information expressed by participants. An initial codebook will be developed by the primary data analyst after a comprehensive reading of all transcripts. Next, a random sample of 5 interviews will be selected for a second data analyst to code for interrater agreement. The 2 researchers will review and discuss any discrepancies in the coding, emergent themes, and the need for refined definitions. The researchers will accept all codes where there is agreement and come to a consensus for areas of nonagreement based on their discussions; they will revise the codebook and recode the transcripts based on the revised codebook. Next, a second random sample of 5 interviews will be selected to determine interrater agreement. When the analysts reach an interrater agreement of 85%-90% in the second round of coding, the transcript codes will be finalized [ ]. Agreement is defined as whether identical codes are applied to the selected text by both coders. Once interrater agreement is reached, all interviews will be coded by either one of the two analysts based on the final codebook following established guidelines for determining coding saturation [ ].Results
Recruitment of participants via social networking applications reached a large pool of potentially eligible participants. Although 7800 people completed the web-based screener, the large number of screeners completed yielded 1060 (14%) potential participants. Of those who screened eligible, 104 (10%) participants completed a Zoom enrollment visit. As shown in
, 87 (84%) enrolled participants provided a saliva sample for mail-in HIV testing. Notably, we identified 5 (6%) new HIV infections, and these men were provided with posttest counseling as well as referrals to confirmatory testing. Of the 82 participants with a nonreactive HIV result, 70 (85%) were randomized to a stage 1 intervention in the pilot SMART.There were no significant differences between enrolled and nonenrolled groups in race or ethnicity, age, and type of stimulants used. As shown in
, 46 (44%) of enrolled participants were ethnic minorities with an average age of 38.5 (SD 8.9) years. Most enrolled participants reported only methamphetamine use in the last 3 months (n=65, 63%), followed by couse of methamphetamine and powder or crack cocaine (n=23, 22%), and then only powder or crack cocaine use in the last 3 months (n=16, 15%). Although enrolled participants were more likely to know about “on-demand PrEP” or “event-based dosing” as an alternative to daily oral PrEP, nearly three-fourths of enrolled and nonenrolled participants expressed interest in this dosing strategy.Enrolled (n=104) | Not enrolled (n=956) | P value | |||
Age (years), mean (SD) | 38.5 (89) | 38.1 (10.1) | .69 | ||
Stimulant use (past 3 months), n (%) | .76 | ||||
Powder or crack cocaine only | 16 (15.4) | 141 (14.8) | |||
Methamphetamine only | 65 (62.5) | 630 (65.9) | |||
Powder or crack cocaine and methamphetamine | 23 (22.1) | 185 (19.4) | |||
Interested in on-demand PrEPb, n (%) | 77 (74.0) | 714 (74.7) | .89 | ||
On-demand PrEP is a good prevention choice for me, n (%) | 74 (71.2) | 671 (70.3) | .85 | ||
It would be difficult for me to use on-demand PrEP, n (%) | 9 (8.7) | 101 (10.6) | .54 | ||
Race or ethnicity, n (%) | .08 | ||||
Black or African American | 16 (15.4) | 76 (8.1) | |||
White | 58 (55.8) | 548 (58.1) | |||
Hispanic or Latino | 21 (20.2) | 212 (22.5) | |||
Other ethnic minority | 9 (8.7) | 108 (11.4) | |||
HIV status, n (%) | .30 | ||||
HIV-negative | 84 (80.8) | 729 (76.3) | |||
Unknown | 20 (19.2) | 227 (23.7) | |||
Diagnosed with a STIc (past 6 months), n (%) | 17 (16.4) | 114 (12.0) | .20 | ||
Any sex exchange for money or drugs, n (%) | 29 (28.4) | 303 (31.9) | .47 | ||
Aware of on-demand PrEP, n (%) | 73 (70.2) | 575 (60.2) | .047 | ||
Previously used on-demand PrEP, n (%) | 4 (3.9) | 25 (2.6) | .52d |
aA pooled t test was used to compare means across both groups for the continuous characteristic, age.
bPrEP: pre-exposure prophylaxis.
cSTI: sexually transmitted infection.
dChi-square test of proportions was used for all categorical characteristics except for this value, where Fisher exact test was used.
Discussion
Implementation of the pilot SMART of the PRISM telehealth motivational enhancement interventions highlights the challenges associated with launching and sustaining a national recruitment campaign to achieve our target sample size. Additionally, the onset of the COVID-19 pandemic necessitated delivery of the PRISM motivational interventions using a telehealth platform. Participant enrollment, scheduling, and completing intervention activities via telehealth as well as mail-in HIV testing efforts afforded the research team various successes, challenges, and lessons learned.
Enrolling potentially eligible participants proved to be more difficult than anticipated such that only 1 in 10 who screened eligible enrolled in the pilot SMART. This reflects the challenges in optimizing HIV prevention with sexual minority men who use stimulants, a high-priority population that is often difficult to access because many are not actively seeking services. Despite the challenges we experienced in enrolling potentially eligible participants, there were no significant differences between enrolled and nonenrolled groups in race or ethnicity, age, and type of stimulants used. Enrolled participants appear to be generally representative of the broader population of sexual minority men who use stimulants that we screened from social networking applications. Future randomized controlled trials will likely require a substantial investment of time and resources for national recruitment campaigns to examine the effectiveness of the PRISM telehealth motivational enhancement interventions.
Throughout the pilot SMART, we developed and refined strategies to support the engagement of potentially eligible participants through SMS text messages and other communications that emphasized the nonjudgmental, flexible, and participant-centered approach of our team. We devoted substantial resources to enrolling participants with multiple contacts to facilitate scheduling and often multiple missed enrollment visits. Many eligible participants did not respond to multiple attempts to contact them via text; for those who did respond, our staff reported approximately two-thirds no-show rate for scheduled Zoom enrollment visits. PRISM staff implemented procedures regarding appointment reminders that included nonjudgmental language regarding follow-ups for missed appointments (eg, “Sorry we missed each other today. Happy to reschedule for another time.”) and encouraged participants to re-establish contact. This is consistent with findings from previous studies using social media to recruit sexual minority men most vulnerable to HIV acquisition [
, ] as well as SMS text messages to enhance engagement and retention [ ].The inclusion of HIV testing provided additional successes and challenges for our staff. Staff time was required to assemble and mail HIV testing kits, resending kits as needed, as well as time spent texting reminders to participants to return their saliva specimens. Throughout implementation of the pilot SMART, we refined standard operating procedures for ensuring timely completion of mail-in HIV testing and delivery of reactive HIV results. Although mail-in HIV testing with a US $25 incentive was feasible and acceptable in this pilot SMART, conducting rapid HIV self-testing during the enrollment visit over Zoom would have removed operational barriers to completing HIV testing as a prerequisite for randomization. There were routine delays of approximately 6 weeks in receiving HIV test results from the laboratory. Because nonreactive HIV results were required prior to the randomization visit, these delays may have contributed to the attrition of some otherwise eligible participants during this waiting period.
With the onset of the COVID-19 pandemic in 2020, our team revised the pilot SMART protocol to focus on the telehealth delivery of MI and CM to national sample. Instead of in-person, local sessions, we were able to enroll sexual minority men who use stimulants from over 30 states. Recruiting a national sample also expanded the reach of the pilot SMART to test the potential benefits of delivering telehealth motivational interventions in geographic regions with varying degrees of structural stigma toward sexual minority men and different levels of access to PrEP clinical services. As some of our participants were located in rural areas, many did not have a PrEP provider available within a reasonable traveling distance. This required referrals for web-based PrEP delivery options that were the only source of PrEP access for some participants. Randomized controlled trials are needed to determine whether and how geographic region moderates the effectiveness of telehealth motivational enhancement interventions with this high-priority population.
Although the development and implementation of this pilot SMART have been successful in many ways, we do recognize some limitations. First, the sample size is underpowered because our primary focus was to estimate the feasibility and acceptability of PRISM telehealth motivational interventions. A larger trial is needed to determine the effectiveness of distinct combinations of CM and MI for PrEP use as well as concomitant changes in substance use and CAS. Implementation of mail-in HIV testing also presented some challenges, including delays in the provision of saliva samples and laboratory wait times. Future research should determine the feasibility and acceptability of at-home rapid HIV testing with posttest counseling over Zoom.
Development and implementation of the pilot SMART of the PRISM telehealth motivational enhancement interventions for sexual minority men who use stimulants have afforded our team many successes and learning experiences. Our focus on modification of the MI and CM intervention protocols for telehealth delivery during the COVID-19 pandemic expanded their reach and potential public health impact. We also gained experience with implementing a national recruitment campaign that will guide appropriate resource allocation in subsequent randomized controlled trials. Implementing a waiting period prior to randomization did not meaningfully diminish our randomization rate and highlighted the operational efficiencies of leveraging rapid HIV testing that could be used in subsequent randomized controlled trials. We anticipate dissemination of estimates of feasibility, acceptability, and preliminary effectiveness from the pilot SMART with findings from qualitative exit interviews in the coming year. Lessons learned from this pilot SMART will guide more definitive trials of behavioral interventions to optimize success along the PrEP care continuum with this high-priority population of sexual minority men who use stimulants.
Acknowledgments
This study was funded by the National Institute on Drug Abuse (R34-DA046367; AWC and CG, principal investigators).
Data Availability
The data sets generated during or analyzed during this study are available from the corresponding author on reasonable request.
Authors' Contributions
LDE served as project manager and led the writing of the paper. CG and AWC served as project principal investigators and were major contributors to the writing of the paper. RV served as intervention staff and contributed to the writing of the paper. JM served as motivational interviewing trainer and supervisor and contributed to the writing of the paper. SD served as data manager and data analyst for the paper. OV, NO, EC, SC, and MV served as trial staff and editors. SDL served as the scientific advisor for the trial and met with recently diagnosed participants to answer their questions about HIV treatment. INS served as a content expert in sequential multiple assignment randomized trial methods. All authors read and approved the final paper.
Conflicts of Interest
SDL received research support from Gilead Sciences and Merck.
References
- HIV in the United States: at a glance. Centers for Disease Control and Prevention. URL: http://www.cdc.gov/hiv/statistics/basics/ataglance.html [accessed 2023-09-01]
- HIV among gay and bisexual men. Centers for Disease Control and Prevention. URL: http://www.cdc.gov/hiv/group/msm/ [accessed 2023-09-01]
- Centers for Disease Control and Prevention. Diagnoses of HIV infection among adolescents and young adults in the United States and 6 dependant areas 2010-2014. HIV Surveill Supplemental Rep. 2016;21(3):1-58. [FREE Full text]
- HIV and all gay and bisexual men. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/hiv/group/msm/index.html [accessed 2023-09-01]
- Kelley CF, Kraft CS, de Man TJ, Duphare C, Lee HW, Yang J, et al. The rectal mucosa and condomless receptive anal intercourse in HIV-negative MSM: implications for HIV transmission and prevention. Mucosal Immunol. 2017;10(4):996-1007. [FREE Full text] [CrossRef] [Medline]
- Hladik F, McElrath MJ. Setting the stage: host invasion by HIV. Nat Rev Immunol. 2008;8(6):447-457. [FREE Full text] [CrossRef] [Medline]
- Sullivan PS, Salazar L, Buchbinder S, Sanchez TH. Estimating the proportion of HIV transmissions from main sex partners among men who have sex with men in five US cities. AIDS. 2009;23(9):1153-1162. [FREE Full text] [CrossRef] [Medline]
- Half of black gay men and a quarter of Latino gay men projected to be diagnosed within their lifetime. Centers for Disease Control and Prevention. URL: http://www.cdc.gov/nchhstp/newsroom/2016/croi-press-release-risk.html [accessed 2023-09-01]
- Hoenigl M, Chaillon A, Moore DJ, Morris SR, Smith DM, Little SJ. Clear links between starting methamphetamine and increasing sexual risk behavior: a cohort study among men who have sex with men. J Acquir Immune Defic Syndr. 2016;71(5):551-557. [FREE Full text] [CrossRef] [Medline]
- Rivera AV, Harriman G, Carrillo SA, Braunstein SL. Trends in methamphetamine use among men who have sex with men in New York City, 2004-2017. AIDS Behav. 2021;25(4):1210-1218. [FREE Full text] [CrossRef] [Medline]
- Carrico AW, Storholm ED, Flentje A, Arnold EA, Pollack LM, Neilands TB, et al. Spirituality/religiosity, substance use, and HIV testing among young black men who have sex with men. Drug Alcohol Depend. 2017;174:106-112. [FREE Full text] [CrossRef] [Medline]
- Martino RJ, Shiau S, Krause KD, Halkitis PN. Event-level patterns of methamphetamine and poly-drug use among millennial sexual minority men: the P18 cohort study. Addict Behav. 2021;117:106831. [FREE Full text] [CrossRef] [Medline]
- Pantalone DW, Bimbi DS, Holder CA, Golub SA, Parsons JT. Consistency and change in club drug use by sexual minority men in New York City, 2002 to 2007. Am J Public Health. 2010;100(10):1892-1895. [FREE Full text] [CrossRef] [Medline]
- Grov C, Parsons JT, Bimbi DS, Sex and Love v3.0 Research Team. In the shadows of a prevention campaign: sexual risk behavior in the absence of crystal methamphetamine. AIDS Educ Prev. 2008;20(1):42-55. [CrossRef] [Medline]
- Reback CJ, Shoptaw S, Grella CE. Methamphetamine use trends among street-recruited gay and bisexual males, from 1999 to 2007. J Urban Health. 2008;85(6):874-879. [FREE Full text] [CrossRef] [Medline]
- Reback CJ, Fletcher JB, Shoptaw S, Grella CE. Methamphetamine and other substance use trends among street-recruited men who have sex with men, from 2008 to 2011. Drug Alcohol Depend. 2013;133(1):262-265. [FREE Full text] [CrossRef] [Medline]
- Kuo I, Patrick R, Opoku J, Rawls A, Magnus M, Peterson J, et al. Changing pattern of crystal meth use in black and white MSM, Washington, DC, 2008-2014. Presented at: Conference on Retroviruses and Opportunistic Infections: 2017; February 13-16, 2017, 2017; Seattle, WA.
- Hood JE, Buskin SE, Golden MR, Glick SN, Banta-Green C, Dombrowski JC. The changing burden of HIV attributable to methamphetamine among men who have sex with men in King County, Washington. AIDS Patient Care STDS. 2018;32(6):223-233. [CrossRef] [Medline]
- HIV infection risk, prevention, and testing behaviors among men who have sex with men-national HIV behavioral surveillance, 20 U.S. cities, 2014. Centers for Disease Control and Prevention. 2016. URL: https://www.cdc.gov/hiv/pdf/library/reports/surveillance/cdc-hiv-surveillance-special-report-number-15.pdf [accessed 2023-09-01]
- Hammoud MA, Jin F, Maher L, Bourne A, Haire B, Saxton P, et al. Biomedical HIV protection among gay and bisexual men who use crystal methamphetamine. AIDS Behav. 2020;24(5):1400-1413. [CrossRef] [Medline]
- Nerlander LMC, Hoots BE, Bradley H, Broz D, Thorson A, Paz-Bailey G, et al. NHBS Group. HIV infection among MSM who inject methamphetamine in 8 US cities. Drug Alcohol Depend. 2018;190:216-223. [CrossRef] [Medline]
- Fulcher JA, Shoptaw S, Makgoeng SB, Elliott J, Ibarrondo FJ, Ragsdale A, et al. Brief report: recent methamphetamine use is associated with increased rectal mucosal inflammatory cytokines, regardless of HIV-1 serostatus. J Acquir Immune Defic Syndr. 2018;78(1):119-123. [FREE Full text] [CrossRef] [Medline]
- Tapia GR, Glynn TR, Miller C, Manuzak JA, Broedlow CA, Mcgaugh A, et al. Syndemics and preexposure prophylaxis are independently associated with rectal immune dysregulation in sexual minority men. AIDS. 2021;35(8):1295-1300. [FREE Full text] [CrossRef] [Medline]
- Ostrow DG, Plankey MW, Cox C, Li X, Shoptaw S, Jacobson LP, et al. Specific sex drug combinations contribute to the majority of recent HIV seroconversions among MSM in the MACS. J Acquir Immune Defic Syndr. 2009;51(3):349-355. [FREE Full text] [CrossRef] [Medline]
- Plankey MW, Ostrow DG, Stall R, Cox C, Li X, Peck JA, et al. The relationship between methamphetamine and popper use and risk of HIV seroconversion in the multicenter AIDS cohort study. J Acquir Immune Defic Syndr. 2007;45(1):85-92. [FREE Full text] [CrossRef] [Medline]
- Grov C, Westmoreland D, Morrison C, Carrico AW, Nash D. The crisis we are not talking about: one-in-three annual HIV seroconversions among sexual and gender minorities were persistent methamphetamine users. J Acquir Immune Defic Syndr. 2020;85(3):272-279. [FREE Full text] [CrossRef] [Medline]
- Oldenburg CE, Jain S, Mayer KH, Mimiaga MJ. Post-exposure prophylaxis use and recurrent exposure to HIV among men who have sex with men who use crystal methamphetamine. Drug Alcohol Depend. 2015;146:75-80. [FREE Full text] [CrossRef] [Medline]
- Oldenburg CE, Mitty JA, Biello KB, Closson EF, Safren SA, Mayer KH, et al. Differences in attitudes about HIV pre-exposure prophylaxis use among stimulant versus alcohol using men who have sex with men. AIDS Behav. 2016;20(7):1451-1460. [FREE Full text] [CrossRef] [Medline]
- Storholm ED, Volk JE, Marcus JL, Silverberg MJ, Satre DD. Risk perception, sexual behaviors, and PrEP adherence among substance-using men who have sex with men: a qualitative study. Prev Sci. 2017;18(6):737-747. [CrossRef] [Medline]
- Eaton LA, Matthews DD, Bukowski LA, Friedman MR, Chandler CJ, Whitfield DL, et al. POWER Study Team. Elevated HIV prevalence and correlates of PrEP use among a community sample of black men who have sex with men. J Acquir Immune Defic Syndr. 2018;79(3):339-346. [FREE Full text] [CrossRef] [Medline]
- Whitfield THF, Parsons JT, Rendina HJ. Rates of pre-exposure prophylaxis use and discontinuation among a large U.S. national sample of sexual minority men and adolescents. Arch Sex Behav. 2020;49(1):103-112. [CrossRef] [Medline]
- Okafor CN, Gorbach PM, Ragsdale A, Quinn B, Shoptaw S. Correlates of Preexposure Prophylaxis (PrEP) use among men who have sex with men (MSM) in Los Angeles, California. J Urban Health. 2017;94(5):710-715. [FREE Full text] [CrossRef] [Medline]
- Okafor CN, Hucks-Ortiz C, Hightow-Weidman LB, Magnus M, Emel L, Beauchamp G, et al. Brief report: associations between self-reported substance use behaviors and PrEP acceptance and adherence among black MSM in the HPTN 073 study. J Acquir Immune Defic Syndr. 2020;85(1):23-29. [FREE Full text] [CrossRef] [Medline]
- Hammoud MA, Vaccher S, Jin F, Bourne A, Maher L, Holt M, et al. HIV Pre-exposure Prophylaxis (PrEP) uptake among gay and bisexual men in Australia and factors associated with the nonuse of PrEP among eligible men: results from a prospective cohort study. J Acquir Immune Defic Syndr. 2019;81(3):e73-e84. [FREE Full text] [CrossRef] [Medline]
- Maxwell S, Gafos M, Moncrieff M, Shahmanesh M, Stirrup O. Pre-exposure prophylaxis use among men who have sex with men who have experienced problematic chemsex. Int J STD AIDS. 2020;31(5):474-480. [FREE Full text] [CrossRef] [Medline]
- Maksut JL, Gicquelais RE, Jackman KM, Eaton LA, Friedman MR, Matthews DD, et al. Injection drug use, unknown HIV positive status, and self-reported current PrEP use among black men who have sex with men attending U.S. black pride events, 2014-2017. Drug Alcohol Depend. 2020;207:107808. [FREE Full text] [CrossRef] [Medline]
- Schecke H, Lea T, Bohn A, Köhler T, Sander D, Scherbaum N, et al. Crystal methamphetamine use in sexual settings among German men who have sex with men. Front Psychiatry. 2019;10:886. [FREE Full text] [CrossRef] [Medline]
- Hambrick HR, Park SH, Schneider JA, Mayer KH, Carrico AW, Sherman SE, et al. Poppers and PrEP: use of pre-exposure prophylaxis among men who have sex with men who use inhaled nitrites. AIDS Behav. 2018;22(11):3658-3672. [FREE Full text] [CrossRef] [Medline]
- Hojilla JC, Vlahov D, Glidden DV, Amico KR, Mehrotra M, Hance R, et al. Skating on thin ice: stimulant use and sub-optimal adherence to HIV pre-exposure prophylaxis. J Int AIDS Soc. 2018;21(3):e25103. [FREE Full text] [CrossRef] [Medline]
- Grov C, Rendina HJ, John SA, Parsons JT. Determining the roles that club drugs, marijuana, and heavy drinking play in PrEP medication adherence among gay and bisexual men: implications for treatment and research. AIDS Behav. 2019;23(5):1277-1286. [FREE Full text] [CrossRef] [Medline]
- Hojilla JC, Satre DD, Glidden DV, McMahan VM, Gandhi M, Defechereux P, et al. Brief report: cocaine use and pre-exposure prophylaxis: adherence, care engagement, and kidney function. J Acquir Immune Defic Syndr. 2019;81(1):78-82. [FREE Full text] [CrossRef] [Medline]
- Scott HM, Spinelli M, Vittinghoff E, Morehead-Gee A, Hirozawa A, James C, et al. Racial/ethnic and HIV risk category disparities in preexposure prophylaxis discontinuation among patients in publicly funded primary care clinics. AIDS. 2019;33(14):2189-2195. [FREE Full text] [CrossRef] [Medline]
- Spinelli MA, Scott HM, Vittinghoff E, Liu AY, Gonzalez R, Morehead-Gee A, et al. Missed visits associated with future Preexposure Prophylaxis (PrEP) discontinuation among PrEP users in a municipal primary care health network. Open Forum Infect Dis. 2019;6(4):ofz101. [FREE Full text] [CrossRef] [Medline]
- Lundahl BW, Kunz C, Brownell C, Tollefson D, Burke BL. A meta-analysis of motivational interviewing: twenty-five years of empirical studies. Res Soc Work Pract. 2010;20(2):137-160. [CrossRef]
- Carrico AW, Zepf R, Meanley S, Batchelder A, Stall R. Critical review: when the party is over: a systematic review of behavioral interventions for substance-using men who have sex with men. J Acquir Immune Defic Syndr. 2016;73(3):299-306. [FREE Full text] [CrossRef] [Medline]
- Parsons JT, Lelutiu-Weinberger C, Botsko M, Golub SA. A randomized controlled trial utilizing motivational interviewing to reduce HIV risk and drug use in young gay and bisexual men. J Consult Clin Psychol. 2014;82(1):9-18. [FREE Full text] [CrossRef] [Medline]
- Shoptaw S, Reback CJ, Larkins S, Wang PC, Rotheram-Fuller E, Dang J, et al. Outcomes using two tailored behavioral treatments for substance abuse in urban gay and bisexual men. J Subst Abuse Treat. 2008;35(3):285-293. [FREE Full text] [CrossRef] [Medline]
- Shoptaw S, Reback CJ, Peck JA, Yang X, Rotheram-Fuller E, Larkins S, et al. Behavioral treatment approaches for methamphetamine dependence and HIV-related sexual risk behaviors among urban gay and bisexual men. Drug Alcohol Depend. 2005;78(2):125-134. [CrossRef] [Medline]
- Reback CJ, Peck JA, Dierst-Davies R, Nuno M, Kamien JB, Amass L. Contingency management among homeless, out-of-treatment men who have sex with men. J Subst Abuse Treat. 2010;39(3):255-263. [FREE Full text] [CrossRef] [Medline]
- Miller WR. Motivational interviewing: research, practice, and puzzles. Addict Behav. 1996;21(6):835-842. [CrossRef] [Medline]
- Prendergast M, Podus D, Finney J, Greenwell L, Roll J. Contingency management for treatment of substance use disorders: a meta-analysis. Addiction. 2006;101(11):1546-1560. [CrossRef] [Medline]
- Haug NA, Sorensen JL. Contingency management interventions for HIV-related behaviors. Curr HIV/AIDS Rep. 2006;3(4):154-159. [CrossRef] [Medline]
- Sorensen JL, Haug NA, Delucchi KL, Gruber V, Kletter E, Batki SL, et al. Voucher reinforcement improves medication adherence in HIV-positive methadone patients: a randomized trial. Drug Alcohol Depend. 2007;88(1):54-63. [FREE Full text] [CrossRef] [Medline]
- Petry NM, Weinstock J, Alessi SM, Lewis MW, Dieckhaus K. Group-based randomized trial of contingencies for health and abstinence in HIV patients. J Consult Clin Psychol. 2010;78(1):89-97. [FREE Full text] [CrossRef] [Medline]
- Metsch LR, Feaster DJ, Gooden L, Matheson T, Stitzer M, Das M, et al. Effect of patient navigation with or without financial incentives on viral suppression among hospitalized patients with HIV infection and substance use: a randomized clinical trial. JAMA. 2016;316(2):156-170. [FREE Full text] [CrossRef] [Medline]
- Carrico AW, Neilands TB, Dilworth SE, Evans JL, Gómez W, Jain JP, et al. Randomized controlled trial of a positive affect intervention to reduce HIV viral load among sexual minority men who use methamphetamine. J Int AIDS Soc. 2019;22(12):e25436. [FREE Full text] [CrossRef] [Medline]
- Stoner MCD, Kilburn K, Godfrey-Faussett P, Ghys P, Pettifor AE. Cash transfers for HIV prevention: a systematic review. PLoS Med. 2021;18(11):e1003866. [FREE Full text] [CrossRef] [Medline]
- Sayegh CS, Huey SJ, Zara EJ, Jhaveri K. Follow-up treatment effects of contingency management and motivational interviewing on substance use: a meta-analysis. Psychol Addict Behav. 2017;31(4):403-414. [CrossRef] [Medline]
- Deci EL, Ryan RM. Cognitive evaluation theory: preceived causality and percieved competence. In: Intrinsic Motivation and Self-Determination in Human Behavior. Boston, MA. Springer US; 1985;43-85.
- Murphy SA. An experimental design for the development of adaptive treatment strategies. Stat Med. 2005;24(10):1455-1481. [FREE Full text] [CrossRef] [Medline]
- Smith D, Koenig L, Martin M, Mansergh G, Heneine W, Ethridge SF, et al. Preexposure Prophylaxis for the Prevention of HIV Infection in the United States—2014: A Clinical Practice Guideline. Atlanta. Centers for Disease Control and Prevention; 2014;67.
- Grov C, Stief M, Westmoreland DA, MacCrate C, Mirzayi C, Nash D, et al. Together 5000 Study Team. Maximizing response rates to ads for free at-home HIV testing on a men-for-men geosocial sexual networking app: lessons learned and implications for researchers and providers. Health Educ Behav. 2020;47(1):5-13. [FREE Full text] [CrossRef] [Medline]
- Grov C, Westmoreland DA, Carneiro PB, Stief M, MacCrate C, Mirzayi C, et al. Recruiting vulnerable populations to participate in HIV prevention research: findings from the Together 5000 cohort study. Ann Epidemiol. 2019;35:4-11. [FREE Full text] [CrossRef] [Medline]
- D'Angelo AB, Morrison CA, Lopez-Rios J, MacCrate CJ, Pantalone DW, Stief M, et al. Experiences receiving HIV-positive results by phone: acceptability and implications for clinical and behavioral research. AIDS Behav. 2021;25(3):709-720. [FREE Full text] [CrossRef] [Medline]
- Carrico AW, Flentje A, Gruber VA, Woods WJ, Discepola MV, Dilworth SE, et al. Community-based harm reduction substance abuse treatment with methamphetamine-using men who have sex with men. J Urban Health. 2014;91(3):555-567. [FREE Full text] [CrossRef] [Medline]
- Siegler AJ, Wirtz S, Weber S, Sullivan PS. Developing a web-based geolocated directory of HIV pre-exposure prophylaxis-providing clinics: the PrEP locator protocol and operating procedures. JMIR Public Health Surveill. 2017;3(3):e58. [FREE Full text] [CrossRef] [Medline]
- Pierson HM, Hayes SC, Gifford EV, Roget N, Padilla M, Bissett R, et al. An examination of the motivational interviewing treatment integrity code. J Subst Abuse Treat. 2007;32(1):11-17. [FREE Full text] [CrossRef] [Medline]
- Moyers TB, Rowell LN, Manuel JK, Ernst D, Houck JM. The Motivational Interviewing Treatment Integrity code (MITI 4): rationale, preliminary reliability and validity. J Subst Abuse Treat. 2016;65:36-42. [FREE Full text] [CrossRef] [Medline]
- Newcombe DA, Humeniuk RE, Ali R. Validation of the World Health Organization Alcohol, Smoking and Substance Involvement Screening Test (ASSIST): report of results from the Australian site. Drug Alcohol Rev. 2005;24(3):217-226. [CrossRef] [Medline]
- Ali R, Humeniuk R. Validation of the Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) and pilot brief intervention: a technical report of phase II findings of the WHO ASSIST project. World Health Organization. 2006. URL: http://apps.who.int/iris/bitstream/handle/10665/43504/924159439X_eng.pdf?sequence=1 [accessed 2023-09-01]
- Newcomb ME, Mongrella MC, Weis B, McMillen SJ, Mustanski B. Partner disclosure of PrEP use and undetectable viral load on geosocial networking apps: frequency of disclosure and decisions about condomless sex. J Acquir Immune Defic Syndr. 2016;71(2):200-206. [FREE Full text] [CrossRef] [Medline]
- Walsh JL. Applying the information-motivation-behavioral skills model to understand PrEP intentions and use among men who have sex with men. AIDS Behav. 2019;23(7):1904-1916. [FREE Full text] [CrossRef] [Medline]
- Kraemer HC, Mintz J, Noda A, Tinklenberg J, Yesavage JA. Caution regarding the use of pilot studies to guide power calculations for study proposals. Arch Gen Psychiatry. 2006;63(5):484-489. [CrossRef] [Medline]
- Thomas DR. A general inductive approach for analyzing qualitative evaluation data. Am J Eval. 2006;27(2):237-246. [CrossRef]
- Creswell JW, Poth CN. Qualitative Inquiry and Research Design: Choosing Among Five Approaches. Thousand Oaks, CA. Sage Publications; 2016.
- Guest G, Bunce A, Johnson L. How many interviews are enough? An experiment with data saturation and variability. Field Methods. 2016;18(1):59-82. [CrossRef]
- Parker JN, Hunter AS, Bauermeister JA, Bonar EE, Carrico A, Stephenson R. Comparing social media and in-person recruitment: lessons learned from recruiting substance-using, sexual and gender minority adolescents and young adults for a randomized control trial. JMIR Public Health Surveill. 2021;7(12):e31657. [FREE Full text] [CrossRef] [Medline]
- Khosropour CM, Johnson BA, Ricca AV, Sullivan PS. Enhancing retention of an internet-based cohort study of men who have sex with men (MSM) via text messaging: randomized controlled trial. J Med Internet Res. 2013;15(8):e194. [FREE Full text] [CrossRef] [Medline]
Abbreviations
CAS: condomless anal sex |
CM: contingency management |
MI: motivational interviewing |
PrEP: pre-exposure prophylaxis |
PRISM: PrEP Readiness Interventions for Supporting Motivation |
REDCap: Research Electronic Data Capture |
SMART: sequential multiple assignment randomized trial |
Edited by A Mavragani; submitted 13.05.23; peer-reviewed by D Dangerfield, S John; comments to author 28.06.23; revised version received 27.07.23; accepted 15.08.23; published 13.10.23.
Copyright©Leah Davis-Ewart, Christian Grov, Rachel Verhagen, Jennifer Manuel, Michael Viamonte, Samantha Dilworth, Nicole O'Dell, Omar Valentin, Sidney Carr, Emily Cherenack, Chelsea Henderson, Susanne Doblecki-Lewis, Inbal Nahum-Shani, Adam W Carrico. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 13.10.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.