This paper is in the following e-collection/theme issue:

RCTs - Protocols/Proposals (funded, already peer-reviewed, eHealth) (353)

Published on in Vol 9, No 2 (2020): February

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/15781, first published .
A Mobile Intervention to Improve Uptake of Pre-Exposure Prophylaxis for Southern Black Men Who Have Sex With Men: Protocol for Intervention Development and Pilot Randomized Controlled Trial

A Mobile Intervention to Improve Uptake of Pre-Exposure Prophylaxis for Southern Black Men Who Have Sex With Men: Protocol for Intervention Development and Pilot Randomized Controlled Trial

A Mobile Intervention to Improve Uptake of Pre-Exposure Prophylaxis for Southern Black Men Who Have Sex With Men: Protocol for Intervention Development and Pilot Randomized Controlled Trial

Authors of this article:

Anne-Emilie Rouffiac1 Author Orcid Image ;   Laura Whiteley2 Author Orcid Image ;   Larry Brown1, 2 Author Orcid Image ;   Leandro Mena3, 4 Author Orcid Image ;   Lacey Craker1 Author Orcid Image ;   Meredith Healy1 Author Orcid Image ;   Kayla Haubrick1 Author Orcid Image
Article Authors Cited by (15) Tweetations (2) Metrics

    Protocol

    1Young Adult Behavioral Health Program, Rhode Island Hospital, Providence, RI, United States

    2Department of Psychiatry and Human Behavior, Warren Alpert Medical School of Brown University, Providence, RI, United States

    3Department of Population Health Science, University of Mississippi Medical Center, Jackson, MS, United States

    4Division of Infectious Diseases, Department of Medicine, University of Mississippi Medical Center, Jackson, MS, United States

    Corresponding Author:

    Laura Whiteley, MD

    Department of Psychiatry and Human Behavior

    Warren Alpert Medical School of Brown University

    222 Richmond Street

    Providence, RI

    United States

    Phone: 1 401 455 6375

    Email: laura_whiteley@brown.edu


    Background: The uptake of pre-exposure prophylaxis (PrEP) has been slow for young black men who have sex with men (BMSM) living in the southern United States. This is a significant issue because 8 of the 10 states with the highest rates of new HIV infections are in the South. Jackson, Mississippi (MS), the site of this project, has the second highest AIDS diagnosis rate in the nation and the highest rate of HIV infection for young, urban BMSM. This study will develop and test an engaging, interactive, and cost-effective mobile messaging intervention to improve engagement in PrEP care for BMSM aged 18 to 35 years living in Jackson, MS.

    Objective: The goals of this mixed methods study are to (1) conduct qualitative interviews with young BMSM in Jackson, MS, to understand individual, community, and structural barriers affecting engagement in PrEP-related care, (2) assemble a PrEP mobile messaging intervention that includes text messages with publicly available internet content (websites and YouTube videos) that provide factual information, motivational materials, and behavioral skills related to PrEP and HIV prevention, and (3) evaluate the preliminary efficacy of the intervention in a randomized controlled study with PrEP-eligible BMSM receiving care in STI/HIV testing clinics in Jackson, MS.

    Methods: This research protocol will be conducted in 2 phases. A development phase will involve in-depth interviews (n=30) with PrEP-eligible BMSM who receive care in STI/HIV testing clinics in MS. These interviews will allow researchers to select the texted material that will be sent out during the intervention. The second phase will consist of an unblinded, small, randomized controlled trial among 66 new participants to examine the preliminary efficacy of the intervention compared with enhanced standard of care (ESC) on attendance at a PrEP services appointment (the first step in initiating PrEP care) and receipt of a PrEP prescription, based on self-report and electronic medical records. The free, publicly available material will be sent to PrEP-eligible BMSM in 8 to 16 interactive text messages over 4 weeks. Study assessments will occur at enrollment and at 4- and 16-weeks postenrollment and can be completed online or in person. All participants will be recruited from a local clinic.

    Results: Institutional review board approval was received on January 16, 2017, and research activities, subsequently, began in February 2018. Recruitment for the study concluded in November 2019. In total, 65 participants were randomized with 33 being assigned to the intervention and 32 to ESC. Collection of follow-up data is ongoing.

    Conclusions: This PrEP mobile messaging intervention aims to increase uptake of PrEP by BMSM in the southern United States. This intervention uses interactive, tailored text messaging and appealing free Web content (publicly accessible educational websites and YouTube videos) to promote linkage to PrEP care and increase HIV preventative behaviors. A cost-effective PrEP mobile messaging intervention has great potential to improve information about PrEP, improve motivation to use PrEP, and decrease stigma and structural barriers that often prevent engagement in PrEP-related medical care.

    Trial Registration: ClinicalTrials.gov NCT03308097; https://clinicaltrials.gov/ct2/show/NCT03308097

    International Registered Report Identifier (IRRID): DERR1-10.2196/15781

    JMIR Res Protoc 2020;9(2):e15781

    doi:10.2196/15781

    Keywords

    pre-exposure prophylaxis (PrEP); HIV prevention; men who have sex with men (MSM) 


    Background

    The strategy of using antiretrovirals as a form of HIV prevention, known as pre-exposure prophylaxis (PrEP), has received considerable attention and holds tremendous promise [1,2]. Despite the advancements supporting PrEP efficacy and its availability, uptake of PrEP by many men who have sex with men (MSM) has been slow. In particular, uptake has been slow for young black MSM (BMSM) who live in the southern United States [3-8]. This is a significant issue because BMSM living in the South have particularly high rates of HIV. Eight of the ten states with the highest rates of new HIV infections are located in the South, and estimates suggest that BMSM in the South are 5 times more likely than white MSM in the South to become infected with HIV [9]. The site of this proposed project, Jackson, MS, has the highest prevalence of HIV among urban MSM living in the United States (39.5 per 100 MSM) [9]. The premise of this project is to develop a targeted mobile messaging intervention to improve linkage to PrEP care for young BMSM in Jackson, MS, who are at high risk for HIV infection. Interventions that improve linkage to PrEP care are urgently needed for BMSM in the South.

    Truvada (tenofovir disoproxil fumarate/emtricitabine) for PrEP was approved by the US Food and Drug Administration as an HIV prevention method in July 2012 for individuals aged 18 years and older and in 2018 for adolescents weighing at least 77 pounds [10]. Despite this, knowledge and access to information about PrEP remains low in many MSM communities. This has restricted linkage and uptake of PrEP and, ultimately, the effectiveness of PrEP at the community level [3-7,11-13]. To use PrEP, individuals must have accurate knowledge, understand its risks and benefits, and be willing to take it. Studies show that many high-risk individuals who would be excellent candidates for PrEP have not taken it simply because their knowledge about it is limited [3,11]. In one study conducted among young MSM in 2013, only 27% of study participants were aware of PrEP [11]. Knowledge about PrEP has increased recently [13,14]; however, some studies show that awareness remains markedly lower among men of color, those who live in southern and rural areas in the United States, and those whose primary care providers are not aware that they have sex with men [15]. Among 436 BMSM surveyed in Atlanta, GA, from January 2012 (6 months prior to PrEP approval) to March 2014 (20 months after approval), only 20.5% were aware of PrEP before approval and only 23.4% were aware of PrEP after approval [3]. Improving southern, young BMSM’s knowledge about PrEP is critical for successful linkage to PrEP care.

    Strengthening the relationships young BMSM have with providers is critical for successful PrEP uptake. Young BMSM who are at highest risk of HIV infection are historically underserved by the health care system [16-19]. Therefore, engaging patients in care is challenging and requires support for doctors and patients [19,20]. Brooks et al [6] found that heightened concerns over potential side effects to PrEP pose a significant barrier to engagement and linkage to PrEP care for BMSM. In the southern United States, homophobia, stigma, and clinician/patient communication all influence initiation of PrEP [21-23]. Eaton et al [3] surveyed 398 HIV negative BMSM at a black Gay Pride event in the southeastern United States. Among this sample, 60% agreed that they were uncomfortable talking to a health care provider about having sex with men. Race-based medical mistrust was also identified as a barrier to engaging in PrEP. Around 1 in 5 participants reported that “people of my race cannot trust doctors and health care workers” (21%), “people of my race should be suspicious of information from doctors and health care workers” (19%), and “people of my race should be suspicious of medicine” (19%). Strengthening communication and connection between medical caregivers and the young BMSM community are crucial components to improving linkage and initiation of PrEP care in the South [12,14,18,23]. Accurate information about PrEP and issues such as potential side effects will need to be shared in a method that considers a history of mistrust to effectively allay concerns among southern BMSM [18].

    Furthermore, addressing structural/economic barriers to receiving PrEP-related care is imperative for BMSM. Effective interventions to improve PrEP must assist individuals when navigating insurance companies and enrolling in medication co-pay assistance. In 2014, approximately 21% of African Americans did not have health insurance, compared with 12% of whites [24]. The situation is particularly concerning for southern BMSM since some of the highest levels of poverty in the United States are in the South. Mississippi has the highest poverty level (28%) in the United States, which directly impacts health care access. Southern states also have the most restrictive Medicaid eligibility criteria and provide fewer Medicaid benefits than other regions in the country [25]. Interventions that help navigate the economics of getting on PrEP, such as PrEP co-pay and full medication assistance programs, are essential to the successful implementation of PrEP in the South, where poverty is highest.

    Last, decreasing stigma about PrEP and HIV can improve linkage and initiation of PrEP-related care for BMSM. Participants in PrEP demonstration studies have reported that stigma affects their decision to initiate PrEP care [19,20,26-30]. Gay men have reported a fear of being labeled as promiscuous by doctors and “Truvada whores” by friends. These stigmatizing labels infer that PrEP is associated with unbridled sex and may be a barrier to care [20,27,30]. Furthermore, the only currently available PrEP method, Truvada, is the same medication used to treat those infected with HIV. In the South, where HIV-associated stigma is high and HIV is prevalent, being seen with Truvada can be perceived as being HIV-infected, which is a further barrier [19,30]. HIV-related stigma is particularly widespread in the South [11,12,20,31]. Interventions must replace negative community attitudes about individuals using PrEP with positive impressions of PrEP users as individuals who take care of themselves and others [32].

    PrEP and HIV prevention interventions for young BMSM need to be interactive, cost effective, and easily integrated into existing clinical care. We will use interactive, tailored text messaging and appealing free Web content (publicly accessible educational websites and YouTube videos) to promote linkage to PrEP care and increase HIV preventative behaviors. A cost-effective, interactive intervention that uses mobile technology is particularly compelling for use with young MSM. MSM make greater use of cell phone technologies than heterosexuals [33], and there is evidence that mobile phone teledensity (ie, number of phones per person) in black southern communities has outpaced black communities in the northeast [34-37]. On a monthly basis, young black adults in the United States spend nearly 56 hours using smartphone apps or internet browsers and 2.5 hours watching videos on their smartphones [38]. With such widespread use of mobile technologies, it is not surprising that data supports the use of mobile technology to improve health [39-41]. Meta-analyses have shown that mobile interventions are most effective when they are interactive and tailored [39-41]. The widespread appeal and use of smartphones and promising data supporting mobile messaging interventions for health promotion create a unique opportunity. Information about PrEP and HIV prevention can be delivered to young, southern BMSM during their leisure time, outside of the sexually transmitted infection (STI)/HIV clinic, and in a manner that is cost effective and easily scalable [34,35,38,42-46].

    Theoretical Framework for Intervention

    The information-motivation-behavioral skills (IMB) model is a well-established conceptualization for improving engagement in care and decreasing HIV risk behaviors. HIV prevention interventions and linkage/engagement in care interventions based on the IMB model have demonstrated efficacy [47,48]. Reviews have suggested that interventions guided by theory are more efficacious than those not driven by theory [47-50]. According to the IMB model, health information, motivation, and behavioral skills are the fundamental determinants of health behavior. For a PrEP-related intervention to be successful, a person must learn information that is directly relevant to HIV prevention and treatment with PrEP. Knowledge is a necessary but not sufficient condition for change. Personal motivation to engage in HIV preventative behavior or engage in treatment regimens (attitudes about health) and motivation (perceived social, cultural, and structural support for performing these acts) are essential for change. Finally, skills for performing healthy behaviors and a sense of self-efficacy must be easily applied to an individual’s cultural, social, and structural setting [47-50]. Engagement in PrEP care can be facilitated by accurate knowledge of medication benefits, self-efficacy for care, and structural support [51,52]. Our intervention, and the online material it is composed of, will address these factors within the IMB model and the local/geographic, structural, and racial context. The IMB model is broadly applicable and can be used to organize and guide theoretically consistent and culturally and structurally informed intervention content [53].

    Aims and Objectives

    This mixed methods study will develop an online PrEP mobile messaging intervention for PrEP-eligible BMSM at the STI/HIV testing clinics in Jackson, MS. The intervention will be created with the help of in-depth interviews with 30 young BMSM in MS that will seek to understand individual, community, and structural barriers affecting IMB factors relevant to engagement in PrEP-related care. We will then conduct a randomized controlled pilot study with 66 PrEP-eligible BMSM seen at STI/HIV testing clinics. This pilot will evaluate the preliminary efficacy of the PrEP mobile messaging intervention compared with enhanced standard of care (ESC) on improving HIV-related knowledge and attitudes, attendance at a PrEP services appointment, and receipt of a PrEP prescription. These data will provide preliminary evidence of the intervention’s impact and inform a larger randomized controlled trial (RCT), if needed, as a test of the intervention.


    Trial Registration and Institutional Review Board Approval

    The research and ethics presented in this study were approved by the institutional review board of Rhode Island Hospital and University of Mississippi Medical Center (UMMC). This study is registered on ClinicalTrials.gov (NCT03308097).

    Design

    This research protocol will be conducted in 2 phases. A development phase will involve in-depth interviews (n=30) with PrEP-eligible BMSM who receive care in STI/HIV testing clinics in MS. Interviews will be conducted by LB, LW, or a trained senior research associate in a private area of the UMMC STI/HIV testing clinic. These interviews will allow researchers to select and adapt the material that will be sent out through the PrEP mobile messaging intervention. The material will be composed of free, publicly available links to websites and YouTube videos that provide factual information, motivational materials, and behavioral skills related to PrEP and HIV prevention. The second phase will consist of a small, unblinded, parallel, randomized controlled pilot study among 66 new participants in the clinics to examine the preliminary efficacy of the intervention compared with ESC on attendance at a PrEP services appointment and receipt of a PrEP prescription. Participants will be randomized using the block randomization method designed to randomize subjects into groups that result in equal sample sizes (1:1). This method is used to ensure a balance in sample size across groups over time. Blocks will be small and balanced with 6 participants assigned to each block. Blocks will be generated using an internet application and saved on a secure drive accessible only to Rhode Island Hospital staff. A research assistant at Rhode Island Hospital will randomize participants after they are enrolled by UMMC staff. The intervention material will be sent to PrEP-eligible BMSM in 8 to 16 interactive text messages over 4 weeks. Study assessments will occur at enrollment and at 4 and 16 weeks postenrollment.

    Participants

    Young BMSM, aged 18 to 35 years, who visit the STI/HIV testing clinics in Jackson, MS, and who are eligible for PrEP according to current treatment guidelines [54] will be eligible for enrollment in each phase of the study according to the following criteria: (1) English speaking, (2) eligible to receive prophylactic antiretroviral treatment, (3) not enrolled in another PrEP-related study or HIV prevention study, and (4) able to give consent/assent and not impaired by cognitive or medical limitations as per clinical assessment. Clinical assessment will occur by members of the proposed research team, as they have substantial prior clinical (medical and psychiatric) and research experience in care of young adults and adults. While having a smartphone or computer is not an eligibility criterion, participants without regular access to this technology must be willing to come to the clinic twice a week if they are randomized to the intervention arm to access intervention content. There will not be overlap between subjects in the developmental and RCT phases. We are enrolling only BMSM between the ages of 18 to 35 years, because they are the subgroup most at risk for acquiring HIV in Jackson, MS. Limiting the study to young BMSM will allow for the development of a mobile intervention that is targeted, acceptable, and engaging for this specific population.

    Description of Intervention Content

    The PrEP mobile messaging intervention employs graphics, characters, and video content specifically chosen to be appealing to young BMSM. Text messages and accompanying Web content will target IMB constructs. These IMB-consistent messages and content all aim to increase knowledge and engagement in PrEP care and decrease HIV risk behaviors. Examples of the IMB-informed texts include: “Do you want to see a cool website with more information about PrEP? Check out this website” which provides information, “Hear from Dr. Mena, who works in Jackson. You can take PrEP and still have fun” which enhances motivation, and “Hear tips for taking PrEP each day and how to get PrEP easily in Jackson” which teaches behavioral skills.

    Interviews will ensure that the intervention material is relevant to community context (eg, stigma, structural barriers). Currently, the intervention is composed of 8 text messages with 1 to 2 links to publicly available Web content in each message. Participants will be sent 2 text messages per week over 4 weeks. The timing and length of the texts and Web activities are based on the timing and length of the efficacious Center for AIDS Research HIV prevention project reviewed in preliminary studies [55]; however, the length and frequency of the intervention and intervention activities will be assessed and edited during the development stage. Each text message will have a link to Web information, quizzes, and games focused on providing facts about PrEP and HIV transmission and prevention and on correcting misperceptions about HIV and PrEP. Videos that are publicly available online and that specifically address engagement in PrEP-related care and HIV prevention information deficits identified with BMSM will be part of the modules. Pictures and graphics have been selected to appeal to BMSM. Young, black male role models are used to impart information and address attitudes, stigma, and social norms concerning engagement with providers, PrEP, and HIV risk. Accurate information will reduce PrEP misconceptions that fuel stigma. Videos that show BMSM discussing the positive aspects of PrEP for them, their partners, and their communities will also help reduce stigma. The intervention will also address structural barriers. Mobile-ready information has been selected to help participants navigate health insurance, medication assistance programs, and co-pay assistance programs. Figure 1 shows sample text messages with pictures of accompanying IMB Web content.

    Preliminary material will either be confirmed or adapted following in-depth interviews with 30 BMSM eligible for PrEP seen at STI/HIV testing clinics in Jackson, MS. Thus, these interviews finalize the links and digital material that will be sent out by the mobile messaging intervention during the RCT.

    ‎
    Figure 1. Preliminary intervention text messages developed from publicly available internet content.
    View this figure

    Developmental Phase Qualitative Interviews

    Qualitative interviews will be conducted by LB, LW, or a trained senior research associate, who have experience with interviews used to develop behavioral interventions and health care provider training. Interviews will be digitally recorded and recordings uploaded to a secure file location on the Rhode Island Hospital server that will only be accessible to project staff.

    Developmental phase participants will be recruited from the UMMC STI/HIV testing clinics. They will be screened for eligibility by UMMC research assistants by phone or in person. Those eligible and interested will arrive the day of the focus group or interview, and research staff will review the consent form with them. Those who sign the consent form will proceed with the interview.

    Interview questions were developed to reflect the IMB model. Questions focus on the relevance and utility of the presented content and its appeal and will solicit suggestions for potential improvements. Feedback will be elicited after exposure to mobile material in a secure clinical space at the UMMC STI/HIV testing clinics. We will ask about general reaction to the preliminary Web content and all texted queries. Participants will be asked about the acceptability and relevance of texts and mobile content, actions, and graphics as they relate to race, culture, and structural factors. We will also concentrate on deeper, or more complex, emerging themes. For example, if there are particular barriers to engagement in PrEP care, such as misconceptions about the perceived risk of HIV, more content will target this misperception [56-58]. If other barriers to engagement in PrEP-related care, such as misinformation about side effects or mistrust of the medical community, are identified, more content will target these issues. For example, participants will be asked “As a black, gay male, how worried are you about getting HIV? How effective do you think PrEP is at preventing someone from getting HIV?” and “How comfortable do you feel talking to your doctor about sex, HIV, and PrEP?” After viewing preliminary Web content, participants will be asked, “Which parts of this website or YouTube video would influence how concerned you are about HIV?” “Do any parts of this website or video help you feel prepared to start PrEP?” “Do any parts of this website help you to know how to pay for PrEP?” and “How could these messages be made more relevant to you, your friends, and your partners?” Major topics and subtopics from the interviews will be coded. Additional codes will be generated for topics that invariably arise and that may have significance to the project. Qualitative data will be analyzed using the qualitative software package NVivo version 11 (QSR International). In order to maintain scientific adequacy and confirmability, we will perform semistructured interviews on a sufficient number of participants from each relevant subgroup defined by age (divided at 25 years); level of interest in starting PrEP; and identifying as gay, bisexual, or neither until there is redundancy in themes and general feedback. All interviews will focus on how sexual orientation, race, stigma, culture, age, and structural factors influence IMB for the major targets of the intervention.

    After the first 15 qualitative interviews, another draft preliminary PrEP mobile messaging intervention will be assembled. This draft intervention will be assessed with another group of young BMSM using the similar qualitative procedures. Interviews will continue until thematic redundancy is achieved. These iterative design efforts will provide an intervention that is culturally acceptable and theoretically informed. Throughout the developmental phase, members of the research team will iteratively review and assess the clinical utility of all intervention components via the BMSM participants’ qualitative feedback and audiotaped session materials. The team will assess the strengths and weaknesses of intervention components and indicate revisions. Specifically, we will assess the intervention content’s accuracy and suitability, ability of the intervention content to engage MSM, and ability to target STI/HIV-related behavioral change with material and techniques consistent with the IMB model. Additionally, the team will review the intervention material for relevance, conceptual clarity, and potential technological problems.

    Pilot Randomized Controlled Trial

    Overview

    We will evaluate the impact of the IMB mobile PrEP/HIV intervention compared with ESC in an RCT with 66 newly recruited BMSM. Recruitment will take place at local STI/HIV testing clinics using flyers and word of mouth. Flyers list the eligibility criteria and provide contact information of the UMMC research assistant they can contact if they would like to participate in a study to test a new mobile messaging tool that provides information about PrEP. Those interested in participation will be screened either in person or over the phone by research assistants in MS. Those interested and meeting all eligibility requirements will be scheduled to complete consent and baseline assessment if it does not occur on the same day. Research staff will then go over the consent form (Multimedia Appendix 1) in a private area of the STI/HIV testing clinic, and participants will fill out the consent and locator forms. Participants will then complete the baseline survey and be placed in either the intervention or ESC group using computerized, block randomization. We will compare conditions on attendance at a PrEP services appointment and receipt of a PrEP prescription at 16 weeks using data from the electronic medical record and by self-report. Conditions will also be compared by self-report on PrEP and HIV-related knowledge, attitudes, skills, and risk behaviors at baseline, 4 weeks (immediately postintervention), and 16 weeks.

    Pre-Exposure Prophylaxis Mobile Messaging Intervention

    Participants in the intervention will receive text messages with intervention content over 4 weeks on their smartphones. Mobile phones will not be provided by the researchers; therefore, participants must have their own working smartphone or computer or be willing to come into the clinic regularly to access content to be eligible to participate. The intervention is composed of 8 to 16 texts with links to Web content. Texts will be sent twice a week over 4 weeks by a research assistant using the Health Insurance Portability and Accountability Act (HIPAA)-compliant Study Management and Retention Toolkit (SMART) developed by Emory University [59]. While there is minimal human involvement in the intervention, participants have the option to contact research staff by phone or SMART if they have any questions or concerns. Based on feedback from the developmental phase, intervention content was selected to be less tailored to the population and more diverse and inclusive. Videos were also included that were perceived as more accurate representations of social interactions in the south. The preliminary timing and length of the texts and Web activities are based on the timing and length of the efficacious Center for AIDS Research HIV prevention project reviewed in preliminary studies (PI: LW). Each mobile link sent to participants will take between 5 and 10 minutes to read, listen to, or interact with. Participants can engage with text message material on their phones at any place that is convenient and comfortable.

    Enhanced Standard of Care Condition

    The impact of the intervention will be compared with ESC. At both STI/HIV testing clinics in which subjects are recruited, the medical director and his staff assess patients for PrEP eligibility and HIV risk (as defined by the Centers for Disease Control and Prevention [CDC] guidelines) [54]. Feedback is given to each patient on their current risk behavior and future plans (personal risk summary). Patients are given a CDC informational handout with basic PrEP facts; shown a brief, 5-minute, free/publicly available online video about PrEP; and given contact information for the clinic care coordinator. These procedures are consistent with CDC guidelines for PrEP, and because of the handout, personal risk summary, and video, the procedure can be considered ESC. The medical director and his team have used the handout and video for the past 2 years. The video is colorful, informative, and well received but has not been chosen with specific qualitative feedback from BMSM. Patients in both conditions will receive the ESC clinical encounter described here and be followed for assessments. Only patients in the IMB mobile messaging intervention will receive the additional 8 to 16 text messages (Figure 2).

    ‎
    Figure 2. Study flow diagram of the randomized controlled trial phase.
    View this figure

    Measures and Assessments

    Assessments

    Assessments will occur at baseline, immediately postintervention (4 weeks), and 3 months postintervention (16 weeks) and will take 45 minutes to complete.

    Measures

    A computer self-interview using Research Electronic Data Capture (REDCap) will be used to assess behavior since it is confidential, allows for complex branching/skip patterns, and detects greater rates of risk behavior [60]. Participants will be emailed the REDCap surveys 2 days prior to their appointments, but they may also opt to complete the surveys on a computer at the UMMC STI/HIV testing clinics. Standard items will be administered to gather demographic data (including age, educational level, sexual orientation, socioeconomic status, race, ethnicity, and stability of housing). The measures below will be used to evaluate HIV- and PrEP-related knowledge, attitudes, and behavior (see Table 1 for linkage between constructs and intervention).

    Table 1. Linkage between constructs, intervention foci, and assessment instruments.
    IMBa construct Description of constructIntervention fociAssessment instruments
    InformationPrEPb and HIV risk knowledgeIncreased HIV/PrEP knowledge, perceived vulnerability to HIV/STIsHIV/PrEP Knowledge Scales
    MotivationRisk attitudes, intentions, and self-efficacy for starting PrEP and engaging in PrEP-related medical careImproved motivation for PrEP and related medical care, increased motivation for safer sex, decreased perceived structural and stigma barriersIMB PrEP Care Motivation Scale, Self-Efficacy for PrEP Care, Rollnick’s Readiness Ruler
    BehaviorAttendance at PrEP prevention appointment, sexual riskPrEP prevention appointment, safer sex skillsAttendance at PrEP services appointment, receipt of PrEP prescription, and sexual risk self-report

    aIMB: information-motivation-behavioral skills.

    bPrEP: pre-exposure prophylaxis.

    Outcomes

    Primary Outcome

    With participant consent, staff at the STI/HIV testing clinic will abstract from the electronic medical record any PrEP services appointment and any PrEP prescription received around 20 weeks (4 weeks after final assessment). Participants will also be asked to self-report if they are currently taking PrEP for each assessment. This study is occurring in the only two PrEP clinics in Jackson, and both are affiliated with UMMC. Participants are recruited from the STI/HIV clinics run by the same medical staff. PrEP is unavailable elsewhere in Mississippi, so virtually no one will begin PrEP at another location. While study inclusion criteria do not restrict to only those living in Jackson, MS, we anticipate that accessibility to the recruitment sites will lead to a predominately local sample.

    Secondary Outcomes

    The following self-report scales on secondary outcomes will be asked on all three questionnaires. We will assess how responses to these measures change over time.

    HIV/Sexually Transmitted Infection and Pre-Exposure Prophylaxis Knowledge

    The HIV Knowledge Scale assesses knowledge about issues such as risks for HIV using 18 items with true, false, or do not know response options. Test-retest reliability (r=.73) and internal consistency (reliability coefficient=.90) were both satisfactory in studies with at-risk young adults [61]. The STI Knowledge Questionnaire uses similar response options with 10 items assessing risk for and treatment of sexually transmitted infections. Test-retest reliability (r=.88) and internal consistency (reliability coefficient=.86) were both satisfactory in studies with at-risk young adults [62]. Because there is no PrEP knowledge scale with published psychometrics, we will use a 15-item questionnaire to assess knowledge (true/false/don’t know) based on facts from the CDC and the San Francisco AIDS Foundation websites concerning PrEP. The items will be tested for readability and relevance with the target population in the qualitative phase of the study. Items will be revised if needed for the RCT portion of this study.

    Personal and Social Motivational Readiness for Pre-Exposure Prophylaxis Care

    Rollnick’s Readiness Ruler [63] will be used to assess motivation for engaging in PrEP care. Respondents rate how ready they are to (1) attend a PrEP services appointment, (2) begin PrEP, and (3) go to PrEP-related medical appointments on a scale from 1=not ready to 10=ready to engage. Participants will also complete the 10-item, Likert-style IMB PrEP Motivation Scale from the LifeWindows Project Team. It has been modified to assess personal and social (culture and structure) motivations for PrEP rather than antiretroviral therapy and is used in our ongoing study of PrEP adherence (1R34 MH104068) in consultation with Dr Jeffery Fisher, one of the developers of the IMB model [64].

    Pre-Exposure Prophylaxis and Appointment Self-Efficacy

    This measure was developed based on Bandura’s theory of self-efficacy [65] and was shown to have strong reliability (alpha>.80) [66]. The instrument consists of Likert-style items (with 5 response options). Three items assess self-efficacy for taking PrEP as prescribed and attending PrEP-related medical appointments. The IMB PrEP Behavioral Skills Scale has 14 Likert-style items (modified to address PrEP rather than antiretroviral therapy). This measure assesses information, motivation, and perception of behavioral ability to perform the necessary PrEP skills. It has an internal consistency of .90 when used with infected adults [64].

    Risk Behavior Assessment

    The risk behavioral assessment (used in LB’s other federally funded projects) is a reliable and valid computer-assisted structured interview assessing self-reported sexual behaviors. It assesses types of sexual behavior (ie, anal, oral, vaginal) in the past 3 months, frequency of sex, age of sexual debut, and number and gender of partners. Additional questions cover use of barrier method contraception, sex with high-risk partners, transactional sex, reasons for condom nonuse, frequency and quantity of substance use, and having sex while using alcohol and drugs [67].

    Statistical Analysis

    Hypothesis One

    The PrEP mobile messaging intervention, developed with participant feedback, will be judged by participants to be feasible, appealing, relevant, and useful. Intervention links that receive a mean score of less than 30 on the session evaluation form or less than 24 on the client satisfaction questionnaire will be discarded.

    Hypothesis Two

    A total of 66 participants will be randomized to 2 conditions. Those in the IMB PrEP mobile messaging intervention condition will show improvements in each of the IMB domains: information (HIV and PrEP knowledge), motivation (motivational readiness for PrEP and medical care, improved self-efficacy, and improved attitudes for PrEP and medical treatment), and behavior (HIV risk behavior score and engagement in PrEP). Information, motivation, and HIV risk scores will be evaluated at 4 and 16 weeks using linear mixed-effect models, which will account for the 3 assessments (0, 4, and 16 weeks) being nested within individuals [68,69]. We will test for differences in linear change over time between intervention and control groups on each outcome variable. For the PrEP uptake outcome, we will evaluate difference between conditions in the proportion of participants who engaged in PrEP (attended a PrEP medical visit, received a PrEP prescription, or self-reported starting PrEP). Propensity scores (ie, inverse probability of treatment weighting) will be used to account for any imbalance in baseline characteristics between conditions [70]. Hierarchical linear modeling analyses are robust if missing data amount is small. If missing data amount is larger, last observation carried forward techniques will be used for missing scale data. Outcomes such as engaging in PrEP care (attending a PrEP medical visit or receiving a PrEP prescription) can be obtained from the medical record regardless of subject attrition.

    As this is an intervention development study and the impact of the experimental intervention is not known, there may not be adequate power to determine the efficacy of the IMB PrEP mobile messaging intervention, and pilot studies are not designed to provide accurate estimates of effect sizes upon which to base large trials [71]. Nevertheless, the small pilot RCT may provide a signal of impact on its major outcomes. We conservatively assume that retention of 66 participants over 16 weeks is 85% based on previous clinic trials. Power analyses were run with Optimal Design 3.01 (open source, University of Michigan) [72]. The model assumed 3 assessments nested within cases. The hierarchical linear modeling analyses with alpha of 0.05 and power of 0.80 will be able to detect an effect size of 0.38 SD for change in the information and motivation outcomes. If the alpha is 0.10 (as is appropriate in exploratory research), then the power is 0.80 to detect an effect size of 0.34 SD. Power to detect a difference in the proportion of participants beginning PrEP by 16 weeks is 0.80 if 10% of the ESC group begin PrEP (similar to our preliminary studies) and 39% of the intervention group begin PrEP. Because chart review will extend to 24 weeks, actual power should be somewhat greater.

    Incentives

    For their involvement in this study, developmental phase participants will receive $50 gift cards as an incentive. During the RCT, subjects will receive $50 gift cards for completing the baseline assessment and $40 for the 4- and 16-week assessments. Participants who confirm contact information and research appointments prior to the 4- and 16-week assessments will receive an additional $10 per appointment. Receipts for this payment are offered to participants should they deem it necessary.

    Ethical Considerations

    To protect participants from potential risk of breach in confidentiality, the following measures will be taken. Participant research data will be identified by numeric ID only and any records containing potentially identifying information will be kept separate from any research data. All research data (written records and audiotapes of program sessions) will be kept in a locked file, and electronic data will be password-protected. All of the study-related materials will only be accessible to research staff. All data collection will take place in secure and supervised clinical settings or with HIPAA-compliant software (REDCap). All study personnel have completed training and received certification in Human Subjects Research Protection (Collaborative Institutional Training Initiative Program) and HIPAA regulations and will continue to renew this training in compliance with hospital policies.

    To further protect the privacy of the study participants, we will obtain a Certificate of Confidentiality from the US Department of Health and Human Services. With this certificate in place, the researchers cannot be forced to turn over identifying information about a study participant in any federal, state, or local criminal, administrative, legislative, or other proceedings. This certificate does not prevent a study participant from volunteering to turn over their research information nor does it prevent researchers from providing research-related information to others when requested by the study participant.


    This is an ongoing study. The developmental interviews took place from February to April 2018. Recruitment for the RCT phase began in November 2018 and closed in November 2019. Follow-up data is still being collected. Therefore, analysis of the RCT has yet to begin.

    Based on input from the qualitative interviews, content was selected to be more diverse and inclusive and less tailored to young BMSM. Participant preference for videos that more accurately reflected social interactions in the South was also considered when choosing content for the RCT. Furthermore, interview participants were asked what time of day they would want to receive the texts, so texts are sent between 11 am and 4 pm. There have been no significant changes to the videos and links that are given as intervention content since the beginning of the study. However, in the initial protocol, participants were to receive follow-up queries on days they received content asking them to rate the links. Lack of participant interest in responding to queries led the team to remove this from procedures. Currently, there are no prompts to remind participants to engage with content.

    At the conclusion of recruitment, 65 participants were randomized in total (33 to the intervention and 32 to ESC). The goal was to randomize 33 participants to each arm of the study (66 in total). However, three individuals who completed baseline were withdrawn from the study prior to randomization. Demographics for the 68 participants, taken at baseline, are presented in Table 2. The average age of participants is 23.9 years. Individuals predominately identify as male; black, African American, or Haitian; and not of Hispanic or Latino descent, which reflects the eligibility criteria. Most of the sample received a high school diploma or General Educational Diploma and are either currently employed or a student. While yearly income ranges from less than $10,000 to $79,999, many participants make less than $40,000.

    Of those who have been randomized, 3 were withdrawn from the study, 2 were removed from the intervention arm for seroconverting during the trial, and 1 was removed from the ESC arm for no longer self-identifying as an MSM. Until follow-up concludes, we cannot determine the effect of treatment assigned on the desired outcomes.

    Table 2. Pre-exposure prophylaxis mobile randomized controlled trial demographics (n=68).
    VariableValue
    Age in years, mean (SD)23.9 (4.8)
    Gender identity, n (%)

    		Male67 (99)

    		Gender nonconforming1 (2)
    Race, n (%)

    		American Indian or Alaskan Native3 (4)

    		Black, African American, or Haitian62 (91)

    		Multiracial3 (4)
    Hispanic or Latino, n (%)

    		Yes1 (2)

    		No67 (99)
    Highest level of education, n (%)

    		Some high school1 (2)

    		High school graduate or GEDa42 (62)

    		College degree or higher20 (29)

    		Other5 (7)
    Employment status, n (%)

    		Employed full-time28 (41)

    		Employed part-time13 (19)

    		Student13 (19)

    		Disabled/unable to work1 (2)

    		Unemployed13 (19)
    Annual income, n (%)b

    		$0-$9,99928 (47)

    		$10,000-$19,99911 (18)

    		$20,000-$29,9999 (15)

    		$30,000-$39,9997 (12)

    		$40,000-$49,9993 (5)

    		$50,000-$59,9990 (0)

    		$60,000-$69,9991 (2)

    		$70,000-$79,9991 (2)

    aGeneral Educational Diploma.

    bEight participants (12%) did not provide information on annual income.


    Review

    The PrEP mobile messaging intervention aims to inform BMSM in the southern United States on the purpose and beneficial impacts of PrEP while reducing stigma about this method of HIV prevention. Through digital material aligned with an IMB theoretical framework, the intervention attempts to motivate participants to engage in PrEP-related care. This cost-effective, easy-to-use, interactive PrEP/HIV prevention mobile messaging intervention could provide BMSM in the southern United States with the information and motivation they need to schedule a PrEP services appointment and take preventative measures in the high-risk environment of the South. No other study has sought to improve this aspect of PrEP-related care, yet attendance at a PrEP services appointment is a crucial first step in the prevention timeline.

    Moreover, the intervention is cost effective and easily adapted and tailored to participants. Free and publicly available online content will be selected through in-depth interviews. Selected online material will address information, motivation, behavioral skills, cultural barriers (such as stigma), and structural barriers (such as payment). In this way, the PrEP/HIV prevention mobile messaging intervention is made to be more effective for its target population.

    Despite being developed for BMSM, the addition of diverse and inclusive material based on developmental feedback allows the intervention to be generalizable to other populations. Furthermore, the protocol’s low cost and ease of use would make the intervention easy to apply in routine settings outside of a small RCT. However, to do so would likely require a shift from the SMART platform to local agencies sending texted information by cellphone. More individuals would then need to be trained on the protocol.

    Limitations

    Some limitations should be noted regarding this protocol. This trial is unblinded, which may lead participants to alter how they report on study outcomes since they are aware of their treatment group. They may also be more or less inclined to seek out additional information or be lost to follow-up. While the follow-up questionnaire asks participants how many of the links or videos they watched, this report may be inaccurate due to social desirability bias. Therefore, it will be difficult to ascertain if results are biased due to nonuse of intervention content.

    Conclusion

    With the large numbers of youth possessing smartphones, the PrEP mobile messaging intervention is a promising route in the effort to increase PrEP uptake for BMSM living in the southern United States. Digital systems cross geographic and interpersonal barriers and can engage at-risk populations. The results of this study can signify the role that interactive digital interventions can play in HIV prevention and clinical care.

    Acknowledgments

    This study was funded by the National Institute of Mental Health (R34MH111342). This study was also supported by the Providence/Boston Center for AIDS Research (P30AI042853).

    Conflicts of Interest

    LM has received honoraria for advisory boards and speaker bureau participation from Gilead Sciences, ViiV Healthcare, and Merck, and his institution has received grants from these companies. Members of the study team are not associated with the creators of many of the intervention links; however, team members were responsible for the creation of some intervention links that provide local resources and information.

    ‎
    Multimedia Appendix 1

    Consent to participate in research.

    PDF File (Adobe PDF File), 91 KB
    ‎
    Multimedia Appendix 2

    Peer-reviewer report from the National Institutes of Health.

    PDF File (Adobe PDF File), 151 KB
    1. Mayer KH. Antiretroviral chemoprophylaxis: state of evidence and the research agenda. Clin Infect Dis 2014 Jul;59 Suppl 1:S47-S51. [CrossRef] [Medline]
    2. Grant R, Lama J, Anderson P, McMahan V, Liu A, Vargas L, iPrEx Study Team. Preexposure chemoprophylaxis for HIV prevention in men who have sex with men. N Engl J Med 2010 Dec 30;363(27):2587-2599 [FREE Full text] [CrossRef] [Medline]
    3. Eaton LA, Driffin DD, Bauermeister J, Smith H, Conway-Washington C. Minimal awareness and stalled uptake of pre-exposure prophylaxis (PrEP) among at risk, hiv-negative, black men who have sex with men. AIDS Patient Care STDS 2015 Aug;29(8):423-429 [FREE Full text] [CrossRef] [Medline]
    4. Barash EA, Golden M. Awareness and use of HIV pre-exposure prophylaxis among attendees of a Seattle Gay Pride event and sexually transmitted disease clinic. AIDS Patient Care STDS 2010 Nov;24(11):689-691. [CrossRef] [Medline]
    5. Pebody R. Rapid rise in PrEP awareness in US gay men, but only 5% have used PrEP. 2016.   URL: http:/​/www.​aidsmap.com/​Rapid-rise-in-PrEPawareness-in-US-gay-men-but-only-5-have-used-PrEP/​page/​3042435/​ [accessed 2016-03-10]
    6. Brooks RA, Landovitz RJ, Regan R, Lee S, Allen VC. Perceptions of and intentions to adopt HIV pre-exposure prophylaxis among black men who have sex with men in Los Angeles. Int J STD AIDS 2015 Dec;26(14):1040-1048 [FREE Full text] [CrossRef] [Medline]
    7. Flash C, Landovitz R, Giler RM, Ng L, Magnuson D, Wooley SB, et al. Two years of Truvada for pre-exposure prophylaxis utilization in the US. J Int AIDS Soc 2014;17(4 Suppl 3):19730 [FREE Full text] [Medline]
    8. Kruger RA. Moderating Focus Groups. Thousand Oaks: Sage Publications; 1998.
    9. Rosenberg ES, Grey JA, Sanchez TH, Sullivan PS. Rates of prevalent HIV infection, prevalent diagnoses, and new diagnoses among men who have sex with men in US states, metropolitan statistical areas, and counties, 2012-2013. JMIR Public Health Surveill 2016 May 17;2(1):e22 [FREE Full text] [CrossRef] [Medline]
    10. American Academy of Pediatrics. Food and Drug Administration Update: HIV-1 PrEP drug can be part of strategy to prevent infection in at-risk adolescents. 2018.   URL: https:/​/www.​fda.gov/​files/​science%20&%20research/​published/​HIV-PrEP-drug-can-be-part-of-strategy-to-prevent-infection-in-at-risk-adolescents.​pdf [accessed 2019-10-15]
    11. Bauermeister JA, Meanley S, Pingel E, Soler JH, Harper GW. PrEP awareness and perceived barriers among single young men who have sex with men. Curr HIV Res 2013 Oct;11(7):520-527 [FREE Full text] [Medline]
    12. Mayer KH, Oldenburg C, Novak DS, Krakower D, Mimiaga MJ. Differences in PrEP knowledge and use in U.S. MSM users of a popular sexual networking site surveyed in August 2013 and January 2014. 2014 Oct Presented at: Proceedings of the HIV Research for Prevention Conference; 2014; Cape Town p. A91-A92. [CrossRef]
    13. Delaney K, Sanchez T, Bowles K, Oraka E, DiNenno E, Sullivan P. Awareness and use of PrEP appear to be increasing among internet samples of US MSM. 2015 Presented at: Proceedings of the Conference on Retroviruses and Opportunistic Infections; 2015; Seattle p. 23-26.
    14. Tripathi A, Whiteside YO, Duffus WA. Perceptions and attitudes about preexposure prophylaxis among seronegative partners and the potential of sexual disinhibition. South Med J 2013 Oct;106(10):558-564. [CrossRef] [Medline]
    15. Ervin J, McAllaster C. Southern HIV/AIDS Strategy Initiative.: Duke University; 2016. We Have The Tools To End HIV: Benefits, Barriers, and Solutions to Expanded Utilization of Pre-exposure Prophylaxis (PrEP) in the US Deep South   URL: https:/​/southernaids.​files.wordpress.com/​2016/​03/​we-have-the-tools-to-end-hiv-benefits-barriers-and-solutions-to-expanded-utilization-of-pre-exposure-prophylaxis-prep-in-the-us-deep-south.​pdf [accessed 2016-06-01]
    16. Thompson HS, Valdimarsdottir HB, Winkel G, Jandorf L, Redd W. The group-based medical mistrust scale: psychometric properties and association with breast cancer screening. Prev Med 2004 Feb;38(2):209-218. [CrossRef] [Medline]
    17. Shelton RC, Winkel G, Davis SN, Roberts N, Valdimarsdottir H, Hall SJ, et al. Validation of the group-based medical mistrust scale among urban black men. J Gen Intern Med 2010 Jun;25(6):549-555 [FREE Full text] [CrossRef] [Medline]
    18. Gamble VN. Under the shadow of Tuskegee: African Americans and health care. Am J Public Health 1997 Nov;87(11):1773-1778. [Medline]
    19. Mahajan AP, Sayles JN, Patel VA, Remien RH, Sawires SR, Ortiz DJ, et al. Stigma in the HIV/AIDS epidemic: a review of the literature and recommendations for the way forward. AIDS 2008 Aug;22 Suppl 2:S67-S79 [FREE Full text] [CrossRef] [Medline]
    20. Smit PJ, Brady M, Carter M, Fernandes R, Lamore L, Meulbroek M, et al. HIV-related stigma within communities of gay men: a literature review. AIDS Care 2012;24(4):405-412 [FREE Full text] [CrossRef] [Medline]
    21. Ricks JM, Geter A, Mcgladrey M, Crosby RA, Mena LA, Ottmar JM. I don't have a problem with it, but other guys do: an exploration of condom negotiation among young black men who have sex with men in the south. J Black Sex Relatsh 2014;1(2):1-14 [FREE Full text] [CrossRef] [Medline]
    22. MacCarthy S, Mena L, Chan PA, Rose J, Simmons D, Riggins R, et al. Sexual network profiles and risk factors for STIs among African-American sexual minorities in Mississippi: a cross-sectional analysis. LGBT Health 2015 Sep;2(3):276-281 [FREE Full text] [CrossRef] [Medline]
    23. Brock JB, Mena LA. Pre- and post-exposure prophylaxis and the changing paradigm of HIV prevention. J Miss State Med Assoc 2015 Jun;56(6):156-160. [Medline]
    24. Buchmueller TC, Levinson ZM, Levy HG, Wolfe BL. Effect of the Affordable Care Act on racial and ethnic disparities in health insurance coverage. Am J Public Health 2016 Aug;106(8):1416-1421. [CrossRef] [Medline]
    25. DeNavas-Walt C, Proctor BD, Smith JC. Income, poverty, and health insurance coverage in the United States: 2012—current population reports. 2012. United States Census Bureau   URL: https://www.census.gov/prod/2013pubs/p60-245.pdf [accessed 2015-12-21]
    26. Auerbach JD, Hoppe TA. Beyond getting drugs into bodies: social science perspectives on pre-exposure prophylaxis for HIV. J Int AIDS Soc 2015;18(4 Suppl 3):19983 [FREE Full text] [CrossRef] [Medline]
    27. Duran D. Huffington Post. 2012. Truvada whores?   URL: http://www.huffingtonpost.com/david-duran/truvadawhores_b_2113588.html [accessed 2015-12-21]
    28. Sobo J. Frontiers Media. 2012. Does taking PrEP make me a whore?   URL: https://www.frontiersmedia.com/channel-my-life-on-prep/2012/11/29/does-taking-prepmake-me-a-whore/ [accessed 2015-12-21]
    29. An Z, McLaughlin M, Hou J, Nam Y, Hu C, Park M, et al. Social network representation and dissemination of pre-exposure prophylaxis (PrEP): a semantic network analysis of HIV prevention drug on Twitter. Soc Comput Soc Media 2014;8531:160-169 [FREE Full text] [CrossRef]
    30. Villareal D. Towleroad. 2014. HIV testing counselor sells “Truvada whore” shirts for AIDS charity   URL: https://www.towleroad.com/2014/03/hiv-testing-counselor-sells-truvada-whore-shirts-for-aids-charity/ [accessed 2014-10-30]
    31. Meditz AL, MaWhinney S, Allshouse A, Feser W, Markowitz M, Little S, et al. Sex, race, and geographic region influence clinical outcomes following primary HIV-1 infection. J Infect Dis 2011 Feb 15;203(4):442-451 [FREE Full text] [CrossRef] [Medline]
    32. Golub SA, Gamarel KE, Rendina HJ, Surace A, Lelutiu-Weinberger CL. From efficacy to effectiveness: facilitators and barriers to PrEP acceptability and motivations for adherence among MSM and transgender women in New York City. AIDS Patient Care STDS 2013 Apr;27(4):248-254 [FREE Full text] [CrossRef] [Medline]
    33. Community Marketing, Inc. 2012. The LGBT Community Survey   URL: http://www.communitymarketinginc.com/documents/CMI_6th_LGBT_Community_Survey_USv1.pdf [accessed 2012-05-12]
    34. Nielsen Report. 2015. Multifacted connections: African-American media usage outpaces across platforms   URL: https:/​/www.​nielsen.com/​us/​en/​insights/​article/​2015/​multifaceted-connections-african-american-media-usage-outpaces-across-platforms/​ [accessed 2015-12-21]
    35. Nielsen Report. 2013. Resilient, receptive, and relevant: the African American consumer   URL: http://nnpa.org/wp-content/uploads/2013/06/African-American-Consumer-Report-2013.pdf [accessed 2015-12-21]
    36. Horrigan J. Mobile access to data and information. Washington: Pew Internet and American Life Project; 2008.   URL: https://www.pewresearch.org/internet/2008/03/05/mobile-access-to-data-and-information-2/ [accessed 2013-08-01]
    37. The Economist. 2009. Mobile marvels: a special report on telecoms in emerging markets   URL: http://www.economist.com/node/14483896 [accessed 2013-04-12]
    38. Smith A. African Americans and technology use: a demographic portrait. Washington: Pew Internet and American Life Project; 2014.   URL: http://www.pewinternet.org/2014/01/06/african-americans-and-technology-use/ [accessed 2015-08-16]
    39. Finitsis DJ, Pellowski JA, Johnson BT. Text message intervention designs to promote adherence to antiretroviral therapy (ART): a meta-analysis of randomized controlled trials. PLoS One 2014;9(2):e88166 [FREE Full text] [CrossRef] [Medline]
    40. Head KJ, Noar SM, Iannarino NT, Grant HN. Efficacy of text messaging-based interventions for health promotion: a meta-analysis. Soc Sci Med 2013 Nov;97:41-48. [CrossRef] [Medline]
    41. Lustria ML, Noar SM, Cortese J, Van Stee SK, Glueckauf RL, Lee J. A meta-analysis of web-delivered tailored health behavior change interventions. J Health Commun 2013;18(9):1039-1069. [CrossRef] [Medline]
    42. Swendeman D, Rotheram-Borus MJ. Innovation in sexually transmitted disease and HIV prevention: internet and mobile phone delivery vehicles for global diffusion. Curr Opin Psychiatry 2010 Mar;23(2):139-144 [FREE Full text] [CrossRef] [Medline]
    43. US smart phone use in 2015. Washington: Pew Internet and American Life Project; 2015.   URL: http://www.pewinternet.org/files/2015/03/PI_Smartphones_0401151.pdf [accessed 2015-12-21]
    44. Baranowski T, Buday R, Thompson DI, Baranowski J. Playing for real: video games and stories for health-related behavior change. Am J Prev Med 2008 Jan;34(1):74-82 [FREE Full text] [CrossRef] [Medline]
    45. Schunk DH. Vicarious influences on self-efficacy for cognitive skill learning. J Soc Clin Psychol 1986 Sep;4(3):316-327. [CrossRef]
    46. Thompson D, Baranowski T, Buday R, Baranowski J, Thompson V, Jago R, et al. video games for health how behavioral science guided the development of a serious video game. Simul Gaming 2010 Aug 1;41(4):587-606 [FREE Full text] [CrossRef] [Medline]
    47. Fisher J, Fisher W, Shuper P. The information-motivation-behavioral skills model of HIV preventive behavior. In: DiClemente RJ, Crosby RA, Kegler MC, editors. Emerging Theories in Health Promotion Practice and Research. San Francisco: Jossey-Bass; 2009:21-63.
    48. Fisher W, Fisher J, Harman J. The information-motivation-behavioral skills model: a general social psychological approach to understanding and promoting health behavior. In: Suls J, Wallston KA, editors. Social Psychological Foundations of Health and Illness. United Kingdom: Blackwell Publishers; 2003:82-106.
    49. Fisher JD, Amico KR, Fisher WA, Harman JJ. The information-motivation-behavioral skills model of antiretroviral adherence and its applications. Curr HIV/AIDS Rep 2008 Nov;5(4):193-203. [Medline]
    50. Fisher JD, Fisher WA, Bryan AD, Misovich SJ. Information-motivation-behavioral skills model-based HIV risk behavior change intervention for inner-city high school youth. Health Psychol 2002 Mar;21(2):177-186. [Medline]
    51. Young I, McDaid L. How acceptable are antiretrovirals for the prevention of sexually transmitted HIV? A review of research on the acceptability of oral pre-exposure prophylaxis and treatment as prevention. AIDS Behav 2014 Feb;18(2):195-216 [FREE Full text] [CrossRef] [Medline]
    52. Gilmore HJ, Liu A, Koester KA, Amico KR, McMahan V, Goicochea P, et al. Participant experiences and facilitators and barriers to pill use among men who have sex with men in the iPrEx pre-exposure prophylaxis trial in San Francisco. AIDS Patient Care STDS 2013 Oct;27(10):560-566 [FREE Full text] [CrossRef] [Medline]
    53. Bandura A. Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs: Prentice-Hall; 1986.
    54. Centers for Disease Control and Prevention. 2014. Preexposure prophylaxis for the prevention of HIV infection in men who have sex with men: a clinical practice guideline   URL: https://www.cdc.gov/hiv/pdf/risk/prep/cdc-hiv-prep-guidelines-2017.pdf [accessed 2015-12-18]
    55. Whiteley LB, Brown LK, Curtis V, Ryoo HJ, Beausoleil N. Publicly available internet content as a HIV/STI prevention intervention for urban youth. J Prim Prev 2018 Aug;39(4):361-370. [CrossRef] [Medline]
    56. Romer D, Sznitman S, DiClemente R, Salazar LF, Vanable PA, Carey MP, et al. Mass media as an HIV-prevention strategy: using culturally sensitive messages to reduce HIV-associated sexual behavior of at-risk African American youth. Am J Public Health 2009 Dec;99(12):2150-2159 [FREE Full text] [CrossRef] [Medline]
    57. Romero LM, Galbraith JS, Wilson-Williams L, Gloppen KM. HIV prevention among African American youth: how well have evidence-based interventions addressed key theoretical constructs? AIDS Behav 2011 Jul;15(5):976-991. [CrossRef] [Medline]
    58. Resnicow K, DiIorio C, Davis R. Culture and the development of HIV prevention and treatment programs. In: Edgar T, Noar SM, Freimuth VS, editors. Communication Perspectives on HIV/AIDS for the 21st Century. New York: Routledge; 2008:193-220.
    59. Rosenberg E, Sullivan P. Study management and retention toolkit (SMART). 2019.   URL: http://emoryott.technologypublisher.com/tech/Study_Management_and_Retention_Toolkit_(SMART) [accessed 2019-12-24]
    60. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009 Apr;42(2):377-381 [FREE Full text] [CrossRef] [Medline]
    61. Carey MP, Schroder KEE. Development and psychometric evaluation of the brief HIV Knowledge Questionnaire. AIDS Educ Prev 2002 Apr;14(2):172-182 [FREE Full text] [Medline]
    62. Jaworski BC, Carey MP. Development and psychometric evaluation of a self-administered questionnaire to measure knowledge of sexually transmitted diseases. AIDS Behav 2007 Jul;11(4):557-574 [FREE Full text] [CrossRef] [Medline]
    63. Rollnick S, Miller W, Butler C. Motivational Interviewing In Health Care: Helping People Change Behavior. New York: Guilford Press; 2008.
    64. Fisher JD, Fisher WA, Amico KR, Harman JJ. An information-motivation-behavioral skills model of adherence to antiretroviral therapy. Health Psychol 2006 Jul;25(4):462-473. [CrossRef] [Medline]
    65. Koenig LJ, Lyles C, Smith DK. Adherence to antiretroviral medications for HIV pre-exposure prophylaxis: lessons learned from trials and treatment studies. Am J Prev Med 2013 Jan;44(1 Suppl 2):S91-S98. [CrossRef] [Medline]
    66. Parsons JT, Rosof E, Mustanski B. Patient-related factors predicting HIV medication adherence among men and women with alcohol problems. J Health Psychol 2007 Mar;12(2):357-370 [FREE Full text] [CrossRef] [Medline]
    67. Brown LK, Hadley W, Stewart A, Lescano C, Whiteley L, Donenberg G, Project STYLE Study Group. Psychiatric disorders and sexual risk among adolescents in mental health treatment. J Consult Clin Psychol 2010 Aug;78(4):590-597 [FREE Full text] [CrossRef] [Medline]
    68. Raudenbush S, Bryk A. Hierarchical Linear Models: Applications and Data Analysis Methods. 2nd Edition. Thousand Oaks: Sage Publications; 2002.
    69. Singer J, Willett J. Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence. New York: Oxford University Press; 2003.
    70. Austin PC, Stuart EA. Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies. Stat Med 2015 Dec 10;34(28):3661-3679 [FREE Full text] [CrossRef] [Medline]
    71. Kraemer HC, Mintz J, Noda A, Tinklenberg J, Yesavage JA. Caution regarding the use of pilot studies to guide power calculations for study proposals. Arch Gen Psychiatry 2006 May;63(5):484-489. [CrossRef] [Medline]
    72. Spybrook J, Raudenbush S, Liu X, Congdon R, Martínez A. Optimal design for longitudinal and multilevel research: documentation for the “Optimal Design” software. Ann Arbor: University of Michigan School of Education, Hierarchical Models Project; 2006.   URL: https:/​/pdfs.​semanticscholar.org/​968e/​e295121b114db964b384456237e7d7263e0b.​pdf?_ga=2.​20326136.​176014247.​1571672879-476726669.​1571672879 [accessed 2019-12-24]

    ‎
    BMSM: black men who have sex with men
    CDC: Centers for Disease Control and Prevention
    ESC: enhanced standard of care
    HIPAA: Health Insurance Portability and Accountability Act
    IMB: information-motivation-behavioral skills
    MSM: men who have sex with men
    PrEP: pre-exposure prophylaxis
    REDCap: Research Electronic Data Capture
    RCT: randomized controlled trial
    SMART: Study Management and Retention Toolkit
    STI: sexually transmitted infection
    UMMC: University of Mississippi Medical Center

    Edited by C Hoving; submitted 06.08.19; peer-reviewed by L Elopre, AM Navarra, A McNaghten; comments to author 09.10.19; revised version received 22.10.19; accepted 22.11.19; published 20.02.20

    Copyright

    ©Anne-Emilie B. Rouffiac, Laura Whiteley, Larry Brown, Leandro Mena, Lacey Craker, Meredith Healy, Kayla Haubrick. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 20.02.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.