Protocol
Abstract
Background: Pharmacies can implement multiple strategies, including medication disposal programs (eg, disposal boxes, deactivation products, and mail-back envelopes) and offering over-the-counter naloxone, to prevent nonmedical opioid use and overdose. The quantity of opioid prescriptions dispensed in the United States is so high that every other adult could receive one opioid prescription per year. Many of these opioids go unused and are kept in homes rather than disposed of after ceasing use. The primary source of prescription opioids for nonmedical use is relatives or friends, which suggests that the diversion of excess and retained prescription opioids contributes significantly to nonmedical use. Naloxone is a life-saving medication that works as an opioid antagonist to reverse the effects of opioids and restore normal breathing to a person experiencing an overdose. All 50 US states have passed laws (eg, statewide standing orders) that allow pharmacists to distribute naloxone without an individual patient prescription, and the US Food and Drug Administration approved the first over-the-counter naloxone medication in March 2023. Individual and neighborhood characteristics are associated with nonmedical opioid use and overdose. It is essential to ensure that pharmacy-based overdose prevention practices are widely available to all individuals.
Objective: : This study aims to assess the extent to which disposal programs and same-day naloxone have been implemented in pharmacies across the United States and examine neighborhood characteristics in implementation. We hypothesize that as neighborhood disadvantage and the proportion of Black or African American residents in a neighborhood increase, the likelihood of a pharmacy having a disposal program or same-day naloxone decreases. We also hypothesize differences in medication disposal programs and same-day naloxone availability by retailer chain and type of pharmacy.
Methods: A secret shopper caller protocol will be used to identify pharmacies that have implemented a medication disposal program and have naloxone available on the same day without a prescription. We will conduct disproportionate stratified random sampling with the strata being pharmacy chains to maximize the likelihood of sampling corporations and independent pharmacies. The goal is to obtain a final sample of 1000 pharmacies. Neighborhood characteristics will be appended to the secret shopper data. To explore neighborhood and pharmacy characteristics associated with the availability of medication disposal programs and same-day naloxone, we will use logistic regression. This protocol represents the entire structure of the secret shopper caller approach.
Results: Data collection was completed in the spring of 2024. The expected results will be published in 2025.
Conclusions: This will be the first study to examine national estimates of medication disposal programs, same-day naloxone availability at pharmacies, and the geographic characteristics associated with their implementation.
International Registered Report Identifier (IRRID): DERR1-10.2196/64344
doi:10.2196/64344
Keywords
Introduction
Overdose Prevention at Community Pharmacies
Community pharmacists are essential members of frontline patient care. Their role in the overdose epidemic is critical in the defense against substance use disorder and opioid overdose [
, ]. Pharmacists are trained about substance use disorder during their educational instruction and can enhance their knowledge through continuing education on overdose prevention and opioid use disorder interventions [ ]. It has been reported that the majority of pharmacists feel comfortable consulting about overdose prevention methods [ ]. To address the opioid crisis, pharmacies have participated in prescription drug monitoring programs, implemented medication disposal programs, and dispensed naloxone and other medications for opioid use disorder [ ].Medication Disposal Programs
Despite efforts in the United States to reduce the number of opioid prescriptions through prescribing guidelines [
, ] and drug monitoring programs [ , ], about 39.5 opioid prescriptions were dispensed per 100 persons in 2022 [ ]. Many opioid medications go unused; a meta-analysis of postoperative opioid consumption for acute pain by US adults found that 61% [ ] of medications remain after treatment. Among individuals who use prescription opioids inappropriately, most obtain them from family or friends, with or without their knowledge [ ]. Thus, medication diversion is the primary source of prescription opioids for misuse. Facilitating the secure disposal of opioid medication during and after treatment is needed to prevent medication diversion.The US Food and Drug Administration (FDA) endorses multiple methods to dispose of unused prescription opioids when they are no longer needed, including take-back days, disposal boxes, mail-back programs, and deactivation kits [
, ]. As of 2014, pharmacies have been able to offer these services to their customers [ ]. Two studies examined the availability of medication disposal boxes in Kentucky and North Carolina [ , ]. In Kentucky, 144 medication disposal boxes had been implemented in community pharmacies as of 2020, with about 50% of counties having at least one box [ ]. While rural counties in Kentucky had higher opioid dispensing rates than urban counties, they were less likely to have a medication disposal box [ ]. In North Carolina, 350 (13.5%) pharmacies had implemented a medication disposal box as of 2021 [ ]. The only study of national estimates of medication disposal box availability was conducted by the US Government Accountability Office in 2017. This assessment examined the list of authorized collectors from the US Drug Enforcement Administration (DEA) and found that 3% of pharmacies and other entities eligible to collect unused prescription drugs had registered with the DEA to implement a disposal box. A limitation of this study is that it relied on the DEA’s list of authorized collectors, which is not a reliable indicator of active medication disposal boxes [ , ]. To our knowledge, no studies have examined pharmacy participation in the distribution of mail-back envelopes or deactivation kits.Broad access to medication disposal programs has been linked to reductions in opioid-related overdose deaths. One study found that communities with drug take-back programs had a decline in opioid overdose deaths, highlighting the role of these programs in limiting the availability of prescription opioids for misuse [
]. Various state and local studies have found a positive relationship between the number of medication disposal locations and decreased prescription drug misuse [ - ]. For instance, a study conducted in New York State demonstrated that increased drug take-back locations were associated with a reduction in prescription opioid misuse [ ]. These findings underscore the importance of increasing access to safe disposal options as part of broader strategies to combat opioid misuse. Further studies are needed to establish the full impact on population-level outcomes related to misuse and overdose.Same-Day Access to Naloxone at Pharmacies
In 2023, the number of opioid-related drug overdoses in the United States decreased, rather than rose, for the first time since 2018 [
]. While there was a decrease in opioid-related deaths from 2022 to 2023, the number of deaths in 2023 (n=81,083) [ ] was significantly higher than in 2018 (n=46,802) [ ]. The provisional Centers for Disease Control and Prevention (CDC) data revealed that the decrease in opioid-related deaths was uneven across demographic groups, with Black individuals experiencing only a 6% reduction, Hispanic individuals having a 3% decrease, and American Indian or Alaska Native populations seeing a 2% increase. Naloxone is an opioid antagonist that is available as a nasal spray or injection [ ]. Naloxone has been identified as a critical tool in combating the overdose epidemic in the United States [ , ]. During the last two decades, naloxone access has progressed from requiring a prescription to a standing order and recently to over-the-counter availability [ ]. Studies that examined naloxone laws (layperson access) and opioid mortality have found that a decrease in opioid mortality occurs when naloxone is more accessible [ - ].In 2023, the FDA approved the nasal spray naloxone for over-the-counter status [
]. This action theoretically should improve access to naloxone nationwide and will eliminate the need for a standing order or even a prescription. Previous studies that focused on naloxone availability with a standing order found that independent pharmacies, compared with chain pharmacies, were less likely to have same-day availability of naloxone [ - ]. Speculation has occurred that the status change of naloxone from prescription to over-the-counter may cause an increase in the price, thus adding a barrier to access [ , ]. Studies before the status change found that the out-of-pocket cost of naloxone varied greatly, with independent pharmacies charging more than community pharmacies [ , ].Socioeconomic Disparities
There are existing individual and neighborhood differences associated with nonmedical opioid use and related harms [
]. A systematic review found that 34 out of 37 studies published between 2000 and 2018 identified at least one characteristic linked to opioid overdose. The studies indicated that individual and neighborhood disadvantages, such as neighborhood-level poverty rates, median household income, county-level unemployment rates, neighborhood-level educational attainment, neighborhood-level dilapidated housing structures, and population-level criminal justice system involvement, were associated with higher opioid overdose rates [ ]. Researchers have also identified socioeconomic and racial or ethnic differences in both the distribution of pharmacies [ - ] and the dispensing of opioid analgesics [ - ]. When individuals are not able to manage their pain with prescribed opioids, they may resort to diverting medications or the use of alternative sources of opioids (fentanyl and heroin) [ ]. These differences may hinder the adoption of diversion programs and overdose prevention efforts. Pharmacy-based overdose prevention practices must be widely available to all individuals to not exacerbate documented differences.Objective
The overall objective is to assess the extent to which disposal programs and same-day naloxone have been implemented in pharmacies across the United States and examine place-based health disparities in implementation. Based on previous research [
, , - ], we hypothesize that as neighborhood disadvantage (hyp1) and the proportion of Black or African American residents in a neighborhood (hyp2) increase, the likelihood of a pharmacy having a disposal box or same-day naloxone decreases. We also hypothesize differences by retailer chain (hyp3) and type of pharmacy (ie, large chain, midsize chain, or independent; hyp4), following previous research indicating large differences in how pharmacy chains implement underage tobacco sales policies [ ] and disposal programs in North Carolina [ ].Methods
Overview
This study uses a secret shopper caller protocol design and will be conducted at Wake Forest University School of Medicine and East Carolina University.
Participants
Eligibility
Pharmacies are eligible to be included in the study if they are listed on the 2023 list of active licensed pharmacies from Hayes Directories, Inc and have a physical location. Nonretail, compounding, and veterinarian pharmacies will be excluded.
Sample Size
The sample size is 1000 pharmacies from across the United States.
Sample
We have obtained the most recent list (October 2023) of active licensed pharmacies from Hayes Directories, Inc. The Hayes list provides the name, phone number, fax, street address, and if it is part of a chain (ie, 8 or more locations) of retail community pharmacies (N=56,451). We will conduct a disproportionate stratified random sampling with the strata being pharmacy chains to maximize the likelihood of sampling diverse corporations and independent pharmacies. We will classify pharmacies into corporate chains with over 1000 store locations in the Hayes Directories, Inc list, including subsidiaries and brands (eg, some Walgreens operate as Duane Reade). We will identify eight strata based on the number of pharmacies in our database: (1) CVS, (2) Walgreens, (3) Walmart, (4) Rite Aid, (5) Kroger, (6) Albertsons, (7) Publix, and (8) other retail pharmacies. With 8 strata, 125 pharmacies per stratum will allow us to reach our goal of 1000 pharmacies across the United States. We will oversample 25 stores per stratum in case there is a need for replacement, for a total of 1200 pharmacies.
Data Collection and Measures
Procedure
A total of 3 data collectors, “secret shoppers,” will be trained to call pharmacies posing as individuals who either need to dispose of medicine or obtain naloxone. The secret shoppers consist of one graduate student and two upper-level, 4th-year undergraduate students. Calls will be made rather than in-person store visits so that it is feasible to assess a sample of pharmacies across the nation. This also reflects the real-life scenario of community members calling pharmacies to determine available services before they visit the pharmacy. Secret shoppers will use a semistructured script when asking pharmacies about disposal programs and same-day naloxone. Training of the secret shoppers will consist of a 2-hour session in which data collectors will learn the script, make practice calls to pharmacies not within the sampling frame (up to 10 pharmacies per data collector), and agree on standard responses to potential questions. Separate calls will be made to query the availability of disposal programs and same-day naloxone. During and after each call, data collectors will fill out a secure REDCap (Research Electronic Data Capture; Vanderbilt University) [
, ] survey about their experience with the pharmacy staff they corresponded with on the call. The codebooks for the medication disposal program ( ) and same-day naloxone without a prescription ( ) have been included.Primary Outcomes
There are two primary outcomes: (1) availability of a medication disposal box and (2) same-day naloxone. The two primary outcomes are distinct and do not occur within the same phone call. Each outcome represents a separate call type, addressing different aspects of the study. This will allow the secret shopper to capture the nuanced dynamics of the study’s focus more accurately. The availability of a medication disposal box will be assessed with the following question posed by a secret shopper: “Hi, I have some Vicodin that I need to get rid of. I heard some pharmacies will take back medications or give you something to dispose of them at your home. Does your pharmacy do this?” The secret shopper will code if the pharmacist responds, “Yes, disposal box.” Other potential options that can be recorded include “no”; “yes, give it directly to the pharmacist”; “yes, other option”; and “yes, but no additional information was provided.” To assess same-day availability of naloxone without a prescription, the caller will ask, “Hi, I am calling to find out if I can get Narcan today?” and “Do I need a prescription?” If the pharmacist states that they have naloxone available that day and that a prescription was not needed, the pharmacy will be coded as having same-day naloxone without a prescription.
Other Measures
Using the secret shopper caller protocol, we will also collect data on where the medication disposal box and naloxone are located in the store, where they could dispose of their medication if the pharmacy would not take it back, where else they could get naloxone, and the cost of naloxone.
We will obtain neighborhood characteristics at the census block group and tract level for the sampled pharmacies from Social Explorer (a subscription service for census and other data) and the University of Wisconsin’s Neighborhood Atlas (
). We will use data from the 2022 (most recent) five-year estimates from the US Census Bureau’s American Community Survey, a multiyear probability-based estimate suitable for use with small area units. The Neighborhood Atlas’s Area Deprivation Index is publicly available and created at the block group level, providing a more localized measure of neighborhood disadvantage. Rurality will be defined based on the US Department of Agriculture’s Rural-Urban Commuting Area Codes [ ]. We will obtain county-level drug overdose rates for the most recent year available from the CDC’s National Vital Statistics System.Variable (type or form) | Source | Level | |||
Outcome | |||||
Availability of a medication disposal box (yes vs no) | Secret Shopper | Store | |||
Availability of same-day naloxone without a prescription (yes vs no) | Secret Shopper | Store | |||
Predictors and covariates | |||||
Pharmacy characteristics | |||||
Corporate owner (top 7 pharmacy chains by number of stores exceeding 1000) | Hayes | Store | |||
Type (chain, food, independent, and medical) | Hayes | Store | |||
Neighborhood resources—Bernard framework’s economic domain | |||||
Area Deprivation Index | University of Wisconsin Neighborhood Atlas | Block group | |||
Percentage of the population living under the federal poverty line (ratio scaled ×10, eg, 12%=1.2) | ACSa | Tract | |||
Percentage of the population age ≥16 years that is unemployed (ratio scaled ×10, eg, 12%=1.2) | ACS | Tract | |||
Neighborhood structure—Bernard framework’s physical domain | |||||
Area Deprivation Index | University of Wisconsin Neighborhood Atlas | Block group | |||
Percentage of housing structures that are vacant (ratio, scaled ×10, eg, 12%=1.2) | ACS | Tract | |||
Percentage of housing structures that are renter occupied (ratio scaled ×10, eg, 12%=1.2) | ACS | Tract | |||
Rurality or urbanicity (rural-urban commuting area codes) | USDAb | Tract | |||
Neighborhood composition—Bernard framework’s institutional domain | |||||
Percentage of the population identifying American Indian or Alaska Native as their race (ratio, scaled ×10, eg, 12%=1.2) | ACS | Tract | |||
Percentage of the population identifying Black or African American as their race (ratio, scaled ×10, eg, 12%=1.2) | ACS | Tract | |||
Percentage of the population identifying Latino or Hispanic as their ethnicity, of any race (ratio, scaled ×10, eg, 12%=1.2) | ACS | Tract | |||
Percentage of the population identifying White as their sole race, of any ethnicity (ratio, scaled ×10, eg, 12%=1.2) | ACS | Tract | |||
County overdose deaths | |||||
County-level drug overdose deaths | CDC’sc National Vital Statistics System | County |
aACS: American Community Survey.
bUSDA: US Department of Agriculture.
cCDC: Centers for Disease Control and Prevention.
Data Management and Ethics
We will implement protections to limit any ability to link data with individuals. We will not collect information that identifies the pharmacists or pharmacy staff whom we speak to on the calls. The only identifiable information will be the pharmacies in our sample. To minimize the likelihood of a breach in confidentiality, data will be collected and stored in REDCap, a secure web application for building and managing surveys, and on a secure and encrypted storage system maintained by Wake Forest University School of Medicine IT Security. Public access to deidentified data will be made public after the study has concluded.
Data Analysis
Geocoding and Spatial Data
After address cleaning and standardization, we will use Environmental Systems Research Institute, Inc’s geocoding service to geocode drop box locations and use the resulting latitude and longitude to “spatially join” pharmacy locations with a shapefile of census geographies to obtain a Federal Information Processing Standards code in ArcGIS Desktop 10.6.1 (Esri). The Federal Information Processing Standards code will allow us to link data to standard area units such as block groups, tracts, and counties in a single dataset and provide a unique ID for each level of nested area units.
Statistical Analyses
Analysis for Availability Estimates
To provide weighted estimates based on the availability of a medication disposal box and same-day naloxone nationally and for each stratum, weighing will be based on the percentage of corporate pharmacies in our sample compared with the total population. Using procedures that account for the stratified survey design, we will estimate the proportion and 95% CI to describe availability nationally and in each stratum for each outcome. Analyses will be conducted using SAS 9.4 (SAS Institute).
Analysis for Logistic Regression Models
To explore neighborhood and pharmacy characteristics associated with availability, we will use logistic regression with robust SEs where the availability of medication disposal boxes and same-day naloxone without a prescription are the outcomes. The stratified survey design will be accounted for when fitting the logistic regression model. Robust SEs will be used to account for potential correlation due to pharmacies being in the same state. We will initially fit unadjusted models for each characteristic of interest and then will fit multivariable models that include characteristics of interest and any available potential confounders for the associations of interest. Analyses will be conducted using SAS 9.4. Estimates will be presented as odds ratios with 95% CIs.
Statistical Power
Power for Availability Estimates
With 8 strata in a stratified random sample, a sample of 1000 should provide a relative SE of 11.7% for the population estimate (ie, we would expect to be 95% certain that the national estimate was within ±3.1 percentage points of the estimate). Individual strata would have an average relative SE of 25% and <±10 percentage points for each stratum.
Power for Logistic Regression Models
The total sample size (N=1000) was determined by a logistic regression power analysis. Initial parameter estimates in the Monte Carlo simulations (using MPlus 8; Muthén and Muthén) were based on a previous study of medication disposal programs at pharmacies in North Carolina [
]. The unconditional and conditional models achieved power of over 0.80 with two-tailed α=.05. The minimum detectable effect size was estimated at level 1 to be 0.17 with a small, medium, or large intraclass correlation coefficient (ICC) value and was estimated at level 2 to be 0.48 for a small ICC value, 0.50 for a medium ICC value, and 0.43 for a large ICC value [ ].Ethical Considerations
Informed consent was waived for this study. The consent process would reveal the secret shopper caller protocol and potentially result in the collection of inaccurate data [
]. Data will not be collected or recorded in a manner that would identify human participants. This protocol has been approved by the Wake Forest University School of Medicine Institutional Review Board (00105728).Results
Data for this study were collected from January to April 2024. As of April 2024, the sample consists of 1108 pharmacies. Expected publication of the results is the summer of 2025.
Discussion
Contributions to the Literature
The overall objective of this study is to assess the extent to which disposal programs and same-day naloxone have been implemented in pharmacies across the United States and examine neighborhood characteristics related to their implementation. Our central hypothesis is that same-day naloxone will be more readily available at chain pharmacies than at independent pharmacies. The availability of medication disposal programs and same-day naloxone will be assessed using a secret shopper approach. Furthermore, we hypothesize that as neighborhood disadvantage and the proportion of Black and African American residents in a neighborhood increase, the likelihood of a pharmacy having a disposal program or same-day naloxone will decrease.
Next Steps
As part of the larger study, following the completion of the secret shopper caller study, interviews will be conducted with a sample of 60 pharmacy managers whose pharmacies were assessed in the secret shopper study. The objective of these interviews is to develop preliminary approaches grounded in implementation science frameworks to improve the implementation of medication disposal programs and same-day naloxone at community pharmacies.
Use of a Secret Shopper Protocol to Assess Public Health Interventions at Pharmacies
The use of a secret shopper caller protocol allows for unbiased and direct observations of overdose prevention service quality and compliance within community pharmacies [
]. An evaluation of how well pharmacy staff adhere to protocols, policies, and laws regarding overdose prevention can be determined. Similar approaches have also been used to assess other public health interventions at community pharmacies [ ]. This method allows for real-time feedback and identification of areas needing improvement, ensuring that interventions are delivered effectively and consistently.Limitations
There are several limitations to the secret shopper study. One limitation is that callers only speak with one pharmacy staff member, who may not represent all pharmacy staff. For this study, we documented whether the staff member revealed their role in the pharmacy and, if so, what their role was. To limit uncertainty, a future study could add a specific question in the secret shopper script to confirm whether the interaction was with a pharmacist. Another potential limitation is that the secret shoppers will only speak English during interactions, which restricts the findings to English-speaking populations. Future research could address this limitation by incorporating multilingual secret shoppers. We expect that additional limitations may be identified during study completion, and these will be identified and described in the results-oriented paper upon completion of the study.
Conclusion
Upon successful completion of the study, we will have estimates of the availability of disposal programs and same-day naloxone at pharmacies across the United States and identify place-based health disparities associated with their implementation.
Acknowledgments
Funding for this research reported in this publication was supported by the National Institute on Drug Abuse of the National Institutes of Health under award R03DA055783 for the period from August 15, 2023, to July 31, 2025. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The authors attest that no generative artificial intelligence technology was used in the generation of text, figures, or other informational content for this manuscript.
Data Availability
The datasets generated or analyzed during this study are available from the corresponding author on reasonable request.
Authors' Contributions
KLE was responsible for the conceptualization, methodology, investigation, resource management, data curation, and writing of the original draft, as well as the review and editing. She also provided supervision, project administration, and funding acquisition. BL contributed to the investigation, writing the original draft, as well as the review and editing. KF conducted the investigation and contributed to writing the original draft, review, and editing. JM participated in the investigation, review, and editing. RLG handled formal analysis and contributed to the review and editing. DMK worked on formal analysis and both the original draft, review, and editing. LAE was responsible for conceptualization, methodology, investigation, writing the original draft, review, and editing, along with funding acquisition.
Conflicts of Interest
None declared.
Mystery caller data collection form for medication disposal programs.
PDF File (Adobe PDF File), 40 KBMystery caller data collection form for naloxone.
PDF File (Adobe PDF File), 40 KBReferences
- Compton WM, Jones CM, Stein JB, Wargo EM. Promising roles for pharmacists in addressing the U.S. opioid crisis. Res Social Adm Pharm. 2019;15(8):910-916. [FREE Full text] [CrossRef] [Medline]
- Vadiei N, Eldridge LA, Meyerson BE, Agley J. "The gatekeepers in prevention": community pharmacist perceptions of their role in the opioid epidemic. Subst Abus. 2022;43(1):319-327. [CrossRef] [Medline]
- Thomas K, Muzyk AJ. Surveys of substance use disorders education in US pharmacy programs. Ment Health Clin. 2018;8(1):14-17. [FREE Full text] [CrossRef] [Medline]
- Meyerson BE, Agley JD, Jayawardene W, Eldridge LA, Arora P, Smith C, et al. Feasibility and acceptability of a proposed pharmacy-based harm reduction intervention to reduce opioid overdose, HIV and hepatitis C. Res Social Adm Pharm. 2020;16(5):699-709. [FREE Full text] [CrossRef] [Medline]
- Dowell D, Ragan KR, Jones CM, Baldwin GT, Chou R. CDC clinical practice guideline for prescribing ppioids for pain - United States, 2022. MMWR Recomm Rep. 2022;71(3):1-95. [FREE Full text] [CrossRef] [Medline]
- Dowell D, Haegerich TM, Chou R. CDC guideline for prescribing opioids for chronic pain - United States, 2016. MMWR Recomm Rep. 2016;65(1):1-49. [CrossRef] [Medline]
- Fink DS, Schleimer JP, Sarvet A, Grover KK, Delcher C, Castillo-Carniglia A, et al. Association between prescription drug monitoring programs and nonfatal and fatal drug overdoses: a systematic review. Ann Intern Med. 2018;168(11):783-790. [FREE Full text] [CrossRef] [Medline]
- Finley EP, Schneegans S, Tami C, Pugh MJ, McGeary D, Penney L, et al. Implementing prescription drug monitoring and other clinical decision support for opioid risk mitigation in a military health care setting: a qualitative feasibility study. J Am Med Inform Assoc. 2018;25(5):515-522. [FREE Full text] [CrossRef] [Medline]
- Opioid dispensing rate maps. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/overdose-prevention/data-research/facts-stats/opioid-dispensing-rate-maps.html [accessed 2024-06-05]
- Schirle L, Stone AL, Morris MC, Osmundson SS, Walker PD, Dietrich MS, et al. Leftover opioids following adult surgical procedures: a systematic review and meta-analysis. Syst Rev. 2020;9(1):139. [FREE Full text] [CrossRef] [Medline]
- Key substance use and mental health indicators in the United States: results from the 2022 National Survey on Drug Use and Health. Substance Abuse and Mental Health Services Administration. Center for Behavioral Health Statistics and Quality; 2023. URL: https://www.samhsa.gov/data/sites/default/files/reports/rpt42731/2022-nsduh-nnr.pdf [accessed 2025-04-15]
- Where and how to dispose of unused medicines. Food and Drug Administration (FDA). URL: http://www.fda.gov/consumers/consumer-updates/where-and-how-dispose-unused-medicines [accessed 2020-01-24]
- Huang LC, Johnson JE, Bleicher J, Blumling AN, Savarise M, Wetter DW, et al. Promoting disposal of left-over opioids after surgery in rural communities: a qualitative description study. Health Educ Behav. 2023;50(2):281-289. [FREE Full text] [CrossRef] [Medline]
- Secure and Responsible Drug Disposal Act of 2010. 21 CFR Parts 1300, 1301, 1304, 1305, 1307, and 1317. U.S. Drug Enforcement Administration. 2014. URL: http://www.deadiversion.usdoj.gov/fed_regs/rules/2014/2014-20926.pdf [accessed 2014-09-09]
- Egan KL, Johnston CA, Jackson JT, Foster SE, Lee JGL. Rates and correlates of medicine disposal program implementation at pharmacies in North Carolina: a longitudinal study, 2016-2021. J Am Pharm Assoc (2003). 2022;62(4):1329-1337. [FREE Full text] [CrossRef] [Medline]
- Miracle DK, Smith N, Slavova S, Stinson LK, Roberts MF, Rock P, et al. Drug disposal deserts: an assessment of receptacle availability in Kentucky community pharmacies. J Rural Health. 2024;40(1):208-214. [CrossRef] [Medline]
- Egan KL, Wolfson M, Dudley WN, Francisco VT, Strack RW, Wyrick DL, et al. Diffusion of medication drop-boxes in North Carolina from 2007 to 2016. Addict Behav. 2018;86:44-50. [FREE Full text] [CrossRef] [Medline]
- Bohnert ASB, Valenstein M, Bair MJ, Ganoczy D, McCarthy JF, Ilgen MA, et al. Association between opioid prescribing patterns and opioid overdose-related deaths. JAMA. 2011;305(13):1315-1321. [FREE Full text] [CrossRef] [Medline]
- National Prescription Drug Take-Back Day. U.S. Drug Enforcement Administration. 2020. URL: https://www.deadiversion.usdoj.gov/drug_disposal/takeback/index.html [accessed 2025-04-15]
- Rudd RA, Aleshire N, Zibbell JE, Gladden RM. Increases in drug and opioid overdose deaths--United States, 2000-2014. MMWR Morb Mortal Wkly Rep. 2016;64(50-51):1378-1382. [FREE Full text] [CrossRef] [Medline]
- Pennsylvania Department of Health.. Evaluation of Pennsylvania's prescription drug take-back programs: impact on opioid-related overdose deaths. J Public Health Manag Pract. 2019;25(3):264-271. [FREE Full text]
- Kraner JC, Gilden DE, Chaulk P. The impact of drug take-back programs on prescription drug misuse: evidence from New York state. Substance Use & Misuse. 2016;51:1580-1587. [FREE Full text]
- U.S. overdose deaths decrease in 2023, first time since 2018. National Center for Health Statistics. 2024. URL: https://www.cdc.gov/nchs/pressroom/nchs_press_releases/2024/20240515.htm [accessed 2024-06-16]
- National Center for Health Statistics. U.S. overdose deaths decrease in 2023, first time since 2018. Centers for Disease Control and Prevention. May 15, 2024. URL: https://www.cdc.gov/nchs/pressroom/nchs_press_releases/2024/20240515.htm [accessed 2024-05-15]
- Wilson N, Kariisa M, Seth P, Smith HIV, Davis NL. Drug and opioid-involved overdose deaths - United States, 2017-2018. MMWR Morb Mortal Wkly Rep. 2020;69(11):290-297. [FREE Full text] [CrossRef] [Medline]
- Naloxone DrugFacts. NIDA. 2022. URL: https://nida.nih.gov/publications/drugfacts/naloxone [accessed 2024-06-16]
- Razaghizad A, Windle SB, Filion KB, Gore G, Kudrina I, Paraskevopoulos E, et al. The effect of overdose education and naloxone distribution: an umbrella review of systematic reviews. Am J Public Health. 2021;111(8):1516-1517. [CrossRef] [Medline]
- Smart R, Grant S. Effectiveness and implementability of state-level naloxone access policies: expert consensus from an online modified-Delphi process. Int J Drug Policy. 2021;98:103383. [FREE Full text] [CrossRef] [Medline]
- FDA approves first over-the-counter naloxone nasal spray. Food and Drug Administration (FDA). URL: https://www.fda.gov/news-events/press-announcements/fda-approves-first-over-counter-naloxone-nasal-spray [accessed 2024-06-15]
- Rees DI, Sabia JJ, Argys LM, Latshaw J, Dave D. With a little help from my friends: the effects of naloxone access and good samaritan laws on opioid-related deaths. National Bureau of Economic Research. Cambridge, MA. National Bureau of Economic Research; 2017. URL: https://www.nber.org/system/files/working_papers/w23171/w23171.pdf [accessed 2025-04-17]
- McClellan C, Lambdin BH, Ali MM, Mutter R, Davis CS, Wheeler E, et al. Opioid-overdose laws association with opioid use and overdose mortality. Addict Behav. 2018;86:90-95. [CrossRef] [Medline]
- Cataife G, Dong J, Davis CS. Regional and temporal effects of naloxone access laws on opioid overdose mortality. Subst Abus. 2021;42(3):329-338. [CrossRef] [Medline]
- Egan KL, Foster SE, Knudsen AN, Lee JGL. Naloxone availability in retail pharmacies and neighborhood inequities in access. Am J Prev Med. 2020;58(5):699-702. [CrossRef] [Medline]
- Eldridge LA, Agley J, Meyerson BE. Naloxone availability and dispensing in Indiana pharmacies 2 years after the implementation of a statewide standing order. J Am Pharm Assoc (2003). 2020;60(3):470-474. [CrossRef] [Medline]
- Stone RH, Hur S, Young HN. Assessment of naloxone availability in Georgia community pharmacies. J Am Pharm Assoc (2003). 2020;60(2):357-361. [FREE Full text] [CrossRef] [Medline]
- Gravlee E, Ramachandran S, Cafer A, Holmes E, McGregor J, Jordan T, et al. Naloxone accessibility under the state standing order across mississippi. JAMA Netw Open. 2023;6(7):e2321939. [FREE Full text] [CrossRef] [Medline]
- Lai RK, Friedson KE, Reveles KR, Bhakta K, Gonzales G, Hill LG, et al. Naloxone accessibility without an outside prescription from U.S. community pharmacies: a systematic review. J Am Pharm Assoc (2003). 2022;62(6):1725-1740. [CrossRef] [Medline]
- Evoy KE, Hill LG, Davis CS. Considering the potential benefits of over-the-counter naloxone. Integr Pharm Res Pract. 2021;10:13-21. [FREE Full text] [CrossRef] [Medline]
- Murphy SM, Morgan JR, Jeng PJ, Schackman BR. Will converting naloxone to over-the-counter status increase pharmacy sales? Health Serv Res. 2019;54(4):764-772. [FREE Full text] [CrossRef] [Medline]
- Guadamuz JS, Alexander GC, Chaudhri T, Trotzky-Sirr R, Qato DM. Availability and cost of naloxone nasal spray at pharmacies in philadelphia, pennsylvania, 2017. JAMA Netw Open. 2019;2(6):e195388. [FREE Full text] [CrossRef] [Medline]
- Marley G, Annis IE, Ostrach B, Egan K, Delamater PL, Bell R, et al. Naloxone accessibility by standing order in North Carolina community pharmacies. J Am Pharm Assoc (2003). 2024;64(3):102021. [FREE Full text] [CrossRef] [Medline]
- van Draanen J, Tsang C, Mitra S, Karamouzian M, Richardson L. Socioeconomic marginalization and opioid-related overdose: a systematic review. Drug Alcohol Depend. 2020;214:108127. [FREE Full text] [CrossRef] [Medline]
- Guadamuz JS, Alexander GC, Zenk SN, Qato DM. Assessment of pharmacy closures in the United States from 2009 through 2015. JAMA Intern Med. 2020;180(1):157-160. [FREE Full text] [CrossRef] [Medline]
- Qato DM, Zenk S, Wilder J, Harrington R, Gaskin D, Alexander GC. The availability of pharmacies in the United States: 2007-2015. PLoS One. 2017;12(8):e0183172. [FREE Full text] [CrossRef] [Medline]
- Guadamuz JS, Wilder JR, Mouslim MC, Zenk SN, Alexander GC, Qato DM. Fewer pharmacies in Black And Hispanic/Latino neighborhoods compared with White or diverse neighborhoods, 2007-15. Health Aff (Millwood). 2021;40(5):802-811. [CrossRef] [Medline]
- Morrison RS, Wallenstein S, Natale DK, Senzel RS, Huang LL. "We don't carry that"--failure of pharmacies in predominantly nonwhite neighborhoods to stock opioid analgesics. N Engl J Med. 2000;342(14):1023-1026. [CrossRef] [Medline]
- Samuel CA, Corbie-Smith G, Cykert S. Racial/ethnic disparities in pain burden and pain management in the context of opioid overdose risk. Curr Epidemiol Rep. 2019;6:275-289. [CrossRef]
- McDonald DC, Carlson K, Izrael D. Geographic variation in opioid prescribing in the U.S. J Pain. 2012;13(10):988-996. [FREE Full text] [CrossRef] [Medline]
- Stoicea N, Costa A, Periel L, Uribe A, Weaver T, Bergese SD. Current perspectives on the opioid crisis in the US healthcare system: a comprehensive literature review. Medicine. 2019;98(20):e15425. [CrossRef] [Medline]
- Bernard P, Charafeddine R, Frohlich KL, Daniel M, Kestens Y, Potvin L. Health inequalities and place: a theoretical conception of neighbourhood. Soc Sci Med. 2007;65(9):1839-1852. [CrossRef] [Medline]
- Kind AJH, Buckingham WR. Making neighborhood-disadvantage metrics accessible - the neighborhood atlas. N Engl J Med. 2018;378(26):2456-2458. [FREE Full text] [CrossRef] [Medline]
- Williams DR, Collins C. Racial residential segregation: a fundamental cause of racial disparities in health. Public Health Rep. 2001;116(5):404-416. [FREE Full text] [CrossRef]
- Lee JGL, Schleicher NC, Leas EC, Henriksen L. US food and drug administration inspection of tobacco sales to minors at top pharmacies, 2012-2017. JAMA Pediatr. 2018;172(11):1089-1090. [FREE Full text] [CrossRef] [Medline]
- Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377-381. [FREE Full text] [CrossRef] [Medline]
- Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208. [FREE Full text] [CrossRef] [Medline]
- Rural-urban commuting area codes. Economic Research Service, U.S. Department of Agriculture. URL: https://www.ers.usda.gov/data-products/rural-urban-commuting-area-codes/ [accessed 2023-08-10]
- Arend MG, Schäfer T. Statistical power in two-level models: a tutorial based on Monte Carlo simulation. Psychol Methods. 2019;24(1):1-19. [CrossRef] [Medline]
- Rankin KA, Mosier-Mills A, Hsiang W, Wiznia DH. Secret shopper studies: an unorthodox design that measures inequities in healthcare access. Arch Public Health. 2022;80(1):226. [FREE Full text] [CrossRef] [Medline]
- Björnsdottir I, Granas AG, Bradley A, Norris P. A systematic review of the use of simulated patient methodology in pharmacy practice research from 2006 to 2016. Int J Pharm Pract. 2020;28(1):13-25. [CrossRef] [Medline]
Abbreviations
CDC: Centers for Disease Control and Prevention |
DEA: Drug Enforcement Administration |
FDA: Food and Drug Administration |
ICC: intraclass correlation coefficient |
REDCap: Research Electronic Data Capture |
Edited by T Leung; submitted 15.07.24; peer-reviewed by KE Cain, BD Hallowell, GT Marley; comments to author 29.11.24; revised version received 12.03.25; accepted 15.03.25; published 10.06.25.
Copyright©Kathleen L Egan, Briana Lewis, Kayleigh Fields, James McMillian III, Rachel L Graves, David M Kline, Lori Ann Eldridge. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 10.06.2025.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.