This paper is in the following e-collection/theme issue:

Formative Studies and eHealth/mHealth Development (524) Web-based and Mobile Health Interventions (3297) Methods and Feasibility Studies (379) Usability Evaluation Case Studies (191) Alcohol Abuse, Alcoholism Prevention and Recovery (300)

Published on in Vol 5, No 1 (2016): Jan-Mar

Assessing the Usability of Web-Based Alcohol Education for Older Adults: A Feasibility Study

Assessing the Usability of Web-Based Alcohol Education for Older Adults: A Feasibility Study

Assessing the Usability of Web-Based Alcohol Education for Older Adults: A Feasibility Study

Authors of this article:

Arlene Fink1 Author Orcid Image ;   Lorna Kwan1 Author Orcid Image ;   Dan Osterweil2 Author Orcid Image ;   Jenna Van Draanen1 Author Orcid Image ;   Alexis Cooke1 Author Orcid Image ;   John C. Beck3 Author Orcid Image
Article Authors Cited by (5) Tweetations (1) Metrics

    Original Paper

    1Arlene Fink Associates, Pacific Palisades, CA, United States

    2David Geffen School of Medicine, Division of Geriatrics and Gerontology, University of California, Los Angeles, Los Angeles, CA, United States

    3David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, United States

    Corresponding Author:

    Arlene Fink, PhD

    Arlene Fink Associates

    1562 Casale Road

    Pacific Palisades, CA, 90272

    United States

    Phone: 1 3104544296

    Fax:1 3104541944

    Email: arlene.fink@gmail.com


    Background: Older adults can experience unfavorable health effects from drinking at relatively low consumption levels because of age-related physiological changes and alcohol’s potentially adverse interactions with declining health, increased medication-use and diminishing functional status. At the same time, alcohol use in older adults may be protective against heart disease, stroke, and other disorders associated with aging. We developed “A Toast to Health in Later Life! Wise Drinking as We Age,” a web-based educational intervention to teach older adults to balance drinking risks and benefits.

    Objective: To examine the intervention’s feasibility in a sample of community-dwelling current drinkers ≥55 years of age and examine its effects on their quantity and frequency of alcohol use, adherence to standard drinking guidelines, and alcohol-related risks.

    Methods: Participants were recruited in person, by mail and by telephone between September and October 2014 from a community-based social services organization serving Los Angeles County. Once enrolled, participants were randomly assigned to the intervention or to a control group. The conceptual frameworks for the intervention were the Health Belief Model, models of adult learning, and the US Department of Health and Human Services guidelines for designing easy-to-use websites. The intervention’s content focuses on the relationship between drinking and its effects on older adults’ medical conditions, use of medications, and ability to perform daily activities. It also addresses quantity and frequency of alcohol use, drinking and driving and binge drinking. The control group did not receive any special intervention. Data on alcohol use and risks for both groups came from the online version of the Alcohol-Related Problems Survey and were collected at baseline and four weeks later. Data on usability were collected online from the intervention group immediately after it completed its review of the website.

    Results: The 49 intervention and 47 control participants did not differ at baseline in age, ethnicity, medication use, medical conditions, or alcohol use and both groups were mostly female, college-educated, and in good health. Of the intervention participants, 94% (46/49) had little or no difficulty using the website, with 67% (33/49) reporting that they will change the way they think about drinking because of their exposure to the education. At the 4-week follow-up, the intervention group reported drinking less (P=.02). No changes between groups were found in quantity and frequency, adherence to recommended guidelines, or risk status.

    Conclusions: Community-dwelling older adults are receptive to online alcohol education. To be most effective, the education should be included as a component of a larger effort consisting of screening and counseling preferably in a health care setting.

    JMIR Res Protoc 2016;5(1):e11

    doi:10.2196/resprot.4545

    Keywords

    alcohol; older adults; elderly; web-based; education; online alcohol education 


    Over 40% of US adults 65 to 74 years of age and 30% of adults 75 years and older are current drinkers [1,2]. Although the quantity and frequency of alcohol use tends to decline with age [1,3] consumption appears to be declining more slowly than in previous generations [4]. Older adults can experience unfavorable health effects even at relatively low consumption levels because of age-related physiological changes [5,6] and alcohol’s potentially adverse interactions with chronic illness, increased medication-use and diminishing functional status [2-3,6,7].

    Alcohol is implicated in many medical problems common in older adults including hypertension [8-11], depression [12,13], breast cancer [14-16], and fractures [17,18]. More than 60% of older adults regularly use medications [19], many of which, such as nonsteroidal anti-inflammatory drugs (NSAIDs), anticoagulants, and sedatives, have the potential to interact adversely with alcohol [7,20-22]. In addition, baby-boomers may have patterns of substance use that differ from previous cohorts resulting in a greater likelihood of combined alcohol and recreational drug use leading to increased risk for emergency department use and hospitalization [23-25]. Binge drinking (more than 4 or 5 drinks at one sitting), which greatly increases the chances of injury to self or others due to car crashes, violence, and suicide [26], is a serious problem in older adults who drink less intensely per occasion than their younger counterparts but binge more frequently than any other age group [26].

    About 14.5% of older adults drink in excess of the National Institute on Alcohol Abuse and Alcoholism’s (NIAAA) recommended limits [27], placing them at risk for alcohol-related problems. When health and drinking patterns are taken into account, about half of all drinkers 65 years of age or older may be at risk for experiencing alcohol-related harm even if they drink within recommended limits [2]. Considering that the number of older adults will increase to more than 20% of the US population by 2030 [28], the number of older people with alcohol-related risks and problems will increase even if drinking prevalence remains constant.

    Accurate evaluations of alcohol-related problems in older persons are somewhat complicated by evidence that moderate consumption may have beneficial effects on cardiovascular functioning, stroke-prevention and all-cause mortality [29-36]. When compared to abstention, light to moderate drinking, such as 1 to 6 drinks weekly, is associated with a lower risk of incident dementia [37], congestive heart failure [38], rheumatoid arthritis [39], and diabetes [40,41].

    Research and education tend to focus on alcohol use disorders, especially among younger people, and older adults usually do not have direct access to pertinent instruction that emphasizes drinking’s potential benefits and risks that are specific to aging. Nor are data available on whether online alcohol education is usable by and acceptable to older adults, or if it can influence their drinking risks.

    In response to the need for age-appropriate alcohol education, we developed and evaluated the feasibility of “A Toast to Health in Later Life! Wise Drinking as We Age,” a Web-based program to educate older adults about the risks and potential benefits of drinking associated with aging. The Internet has been recognized for many years as an important mechanism for supplementing direct medical care [42-45]. Older adults are active Web users, with nearly 80% of persons 55 to 64 years and 60% of those 65 and older going online at least once a day [46]. Over two-thirds of seniors in their 70s are Internet users, and more than half use broadband [47].

    People use the Internet because of several favorable features: the convenience of being able to search quickly for information at any time, unlimited access to inexpensive information, self-pacing, and user anonymity when searching for subject-sensitive health information [48-52]. This study evaluated “A Toast to Health in Later Life’s” feasibility and influence on alcohol use and risks for alcohol-related problems in a sample of older current drinkers living independently in the community.


    Participants and Setting

    Participants were eligible for this study if they (1) were 55 years of age or older; (2) had 1 or more drinks containing alcohol in the past 3 months; (3) had an email account and were willing to share their email address so that staff could provide links to the educational program and study assessments; (4) were comfortable using the Internet; (5) had access to high-speed Internet; and (6) were willing to spend about 10 to 30 minutes on 2 separate occasions 4 weeks apart to complete an online alcohol education program and answer online questions in English about alcohol and health. Participants were recruited between September and October 2014 at a non-profit community-based social services organization located in Santa Monica, California and serving Los Angeles County. A trained study site coordinator used a combination of methods to recruit participants. These included in-person contacts with potential participants, mailings, and phone messages to the organization’s database of volunteers and users. The organization’s Chief Executive Officer also emailed qualified staff and colleagues with information about the study and requested their participation. Interested persons responded directly to the study’s site coordinator and the CEO was not told who responded.

    Study Design

    The study site coordinator screened interested participants for their eligibility using a standardized script. Using a random number generator [53], we produced 200 numbers in random order. These numbers were allocated to each eligible study participant in the sequential order that they were generated. Participants with odd numbers were assigned to the intervention group, and those with even numbers were allocated to the control group. For example, the first 4 randomly generated numbers were 136, 172, 187, and 61. This meant that the first 2 eligible participants were assigned to the control group, whereas the next 2 participants were assigned to receive “A Toast to Health in Later Life!”

    Participants in the intervention group received the URL for “A Toast to Health in Later Life!”, a study user name, and a password. Once in the site, intervention participants were given the choice of watching a video or reading a transcript that explained the study’s purposes and methods. If still interested, they clicked “submit” and were automatically directed to the informed consent form. After consenting, participants were automatically directed to the baseline survey, which collected information on drinking, health, medication use, functional status, lifestyle, and demographics. Participants were sent back to “A Toast to Health in Later Life!” automatically upon survey completion.

    We programmed the website so that participants were required to review the entire site. Once they completed the review, however, participants were able to go back to any section that interested them. Intervention participants were given a brief post-survey focusing on the site’s usability.

    Control group participants completed the same online informed consent and baseline survey as the intervention group. They were offered access to the site after the completion of data collection.

    The study’s site coordinator emailed a link to the follow-up survey to all participants 4 weeks after each completed a baseline survey. Intervention and control participants completed identical follow-up surveys. Participants were reimbursed $35 after they completed all required data collection activities.

    Conceptual Frameworks

    The conceptual frameworks for this study and for use in guiding website content, questionnaire development, data collection and data analysis were The Health Belief Model, models of adult learning, and the US Department of Health and Human Services (DHSS) guidelines for designing easy-to-use websites [54].

    We selected The Health Belief Model because it provides a framework for specifying personal and situational factors likely to influence health behavior [55], and it is among the most rigorously studied and commonly used models to study how education changes behavior [55-59]. According to the model, changing behavior is contingent upon several key factors including knowledge of the problem and its consequences and self-efficacy to do something about the problem. Throughout the website, we included facts (“Did You Know?”) and practice exercises to reinforce learning. To strengthen self-efficacy, the site provides separate pages on how to cut down on drinking, how to speak to a doctor or other health professional about alcohol, and where to go for help. We used selected behavior change techniques, such as instruction on how to perform a behavior and demonstration of the behavior [60,61] to reinforce knowledge and self-efficacy.

    To encourage learning, we relied on theories of adult learning which are often derived from or based on Knowles’ theory, which he called “andragogy” [62,63]. Knowles’ theory distinguishes adult from other learning in its emphasis on active learning, self-pacing, and problem-centered concepts [64,65]. The Internet is well suited to active learning and self-pacing. To facilitate active learning, “A Toast to Health in Later Life!” includes practice exercises and feedback.

    We used DHSS guidelines [54] for easy-to-use websites (eg, keeping navigation simple and consistent; minimizing scrolling) to guide the website’s development and separated the graphics arts component of Web development from the technical one so as to ensure that the site’s graphics were colorful and age appropriate regardless of any technical challenge. The 2 study team geriatricians (JCB and DO), who have expertise in educating older learners, independently reviewed the website twice to make certain that it conformed to DHSS’ usability criteria.

    The Intervention

    Content

    “A Toast to Health in Later Life! Wise Drinking as We Age” is a Web-based education program that aims to teach older adults how to balance the benefits and risks of drinking. The website was developed by the study’s team of alcohol researchers (AF and JCB), experts in geriatric medicine and education (JCB and DO), a computer programming expert (GY), and a Web designer (MR).

    The website’s intellectual content is derived from work done in connection with The Alcohol-Related Problems Survey (ARPS). The ARPS is a screening and education system that provides older adults and their physicians with tailored feedback on their alcohol-related risks based on their responses to a survey of alcohol use and health [66-73]. The ARPS system includes an educational component, which was developed with the assistance of over 200 community-dwelling older adults and then tested for usability in primary care practice with more than100 participants [74,75]. The study’s geriatricians (JCB and DO) adapted the ARPS’ educational content to “A Toast to Health in Later Life!” and used their expert knowledge and clinical experience to ensure the timeliness and relevance of the subject matter across the aging spectrum.

    “A Toast to Health in Later Life!’” contains 9 sections, each of which provides information to achieve specific instructional objectives based on the ARPS’ framework and content. For example, one objective is “to describe the relationship between drinking and medical conditions, medication use, and functional status in older adults.” This objective is addressed throughout the site, but is emphasized in Section 1 of the website, “Thinking about Drinking and Aging.” Sample content includes a statement such as: “Alcohol affects the workings of common medicines like high blood pressure medicines, pain killers, and antihistamines. Alcohol can also worsen or cause health problems such as cancer, heart disease, and depression. Also, some older people have problems walking, sleeping, or remembering things. Alcohol complicates the care of these problems.”

    Figure 1 contains a screenshot showing a portion of the content for the instructional objective, “to compare nonhazardous (wise), hazardous (risky) and harmful drinking.”

    ‎
    Figure 1. Screenshot from "A Toast to Health in Later Life! Wise Drinking as We Age". Content for one instructional objective.
    View this figure
    The Control

    The control group did not receive any special intervention. Comparable patient education for older adults was not available, and we did not have the resources to develop an alternative and test it for feasibility and comparability.

    Website Pilot Test

    We conducted a 3-phase pilot test of the website among 21 people. The pilot test’s purpose was to produce a website that was appropriate in content and usability and ready for a more comprehensive feasibility test. Participants in all phases of the pilot test met the same eligibility criteria as participants in the main feasibility study. The study’s site yielded 17 participants, and 4 were recruited through personal contact. In the first phase of the pilot, we tested a prototype of the website on 5 older adults because evidence suggests that the best results come from testing no more than 5 users, and running as many small tests as you can [76]. The test asked participants to review the site without assistance. The study team (AF and JCB) then interviewed them in person or on the phone about the site’s usability, appropriateness, and potential benefit. We revised the site based on participants’ advice and retested it on 5 additional people who stated that they found the site easy to navigate, they learned from it, and they were confident that they could answer questions about alcohol use and aging. In the third phase of the pilot test, 4 people reviewed the website and answered questions about usability, while an additional 7 people reviewed the website and completed all study instruments.

    Access to the Site

    Access to the website required a user name (email address) and password (a-zA-z0-9) that was provided by the System Administrator. The System Administrator could grant System Administrator Privileges to others.

    “A Toast to Health in Later Life!” was developed in Microsoft Razor MVC3 running under IIS.  It is a dynamic website that presents information to users based on their progress through the site and their security profile.  Beginning and end study surveys were hosted by Survey Monkey and embedded in the site's pages. The surveys were accessible to both the intervention and control groups, although the control group was not able to access any of the content pages.

    Outcomes and Measures

    Demographics

    We used standard questions to ask participants at baseline about their sex, race and ethnicity, birthdate, and education. Participants were asked to rate their health status as being excellent, very good, good, fair, or poor.

    Alcohol Use and Risks

    To measure their alcohol-related use and risks, all participants completed the ARPS at baseline and 4 weeks after enrollment into the study. Since its development in the 1990’s, the ARPS and its derivatives have been used with thousands of older adults in community and research settings to study alcohol’s use and risks [2,67,77,78]. The ARPS’ development, psychometric properties, and research use are well-documented [2,67,68,70,71,79]. A sample question from the ARPS is given in Figure 2.

    The ARPS uses terminology [80,81] to classify alcohol-related health risk into 3 categories: harmful (consumption that may exacerbate or complicate existing alcohol-related problems), hazardous (consumption that poses risks of future harm for individuals with specific medical conditions, functional status, or symptoms, taking specific medications, or engaging in risky behaviors such as smoking), and nonhazardous (neither harmful nor hazardous and potentially beneficial).

    The ARPS’ scoring algorithms have been updated with the system’s continued use in the United States and in other countries [82,83]. The algorithms first consider a person’s reported quantity and frequency of consumption in relation to each of 63 factors (eg, medication use, binge drinking). The specific consumption patterns that confer risk vary substantially depending on the factor being considered. A sample of the tables and specifications for scoring the ARPS can be found in Multimedia Appendix 1.

    To determine if NIAAA recommendations for older drinkers were exceeded [27], women and men 65 years of age and older who reported drinking 7 or more drinks weekly were considered at risk. All men under 65 years who drank 14 or more weekly drinks were also considered at risk.

    ‎
    Figure 2. Sample question from the Alcohol-Related Problems Survey (ARPS).
    View this figure
    Usability

    The intervention participants were automatically directed to a usability survey immediately upon completing their website review. The survey asked if participants learned about alcohol and health; if they were confident they could now answer questions about alcohol and health; and if they were confident, whether the website contributed to their confidence. We also asked participants if the website changed the way they now think about drinking, if they had any difficulty using the website and if they would recommend it to others.

    Ethics and Informed Consent

    Eligible participants were asked to complete online consent after they were given the opportunity to listen to and read an overview of the study’s purposes and procedures. The informed consent took the form of an information sheet with the following categories: the study’s purposes and methods, a description of participant expectations, a discussion of possible risks or discomforts associated with participation, a discussion of possible benefits, payment for participation, measures used to protect privacy, whom to contact if questions arose, rights as a research subject, and participants’ right to quit the study at any time. Participants who clicked on submit after reading information sheet were automatically directed to the study’s baseline survey. Participants were free to close their browsers at any time, thus leaving the study, but intervention participants who completed the baseline survey and also agreed to continue, clicked on a link that automatically directed them to the study’s website. Entry to all study materials was protected by password and all responses were collected over secured, encrypted SSL/TLS connections. An independent Institutional Review Board (US Office of Human Subjects Research IRB #0000667) approved this study. A copy of the informed consent form can be found in Multimedia Appendix 2.

    Data Analysis

    Analyses of outcome data were based on the per-protocol method which is commonly used in feasibility studies because of their exploratory nature. Thus, data were analyzed for the 47 control and 49 intervention group participants who provided complete data on all outcome measures.

    The outcomes were measured 4 weeks after enrollment and included (1) the quantity and frequency of drinking as assessed by the ARPS; (2) the percentage of participants drinking above NIAAA recommended levels; (3) the percentage of participants who were harmful, hazardous and nonhazardous drinkers as assessed by the ARPS; and (4) whether participants report changing their drinking amount in the past 4 weeks as indicated by their answers to survey questions.

    Baseline characteristics are reported for the intervention and control groups. Categorical data are reported as frequencies (percentages), continuous data are reported as means and standard deviations (SD), and non-normally distributed data are reported as medians and ranges. We used Chi-square tests (or Fisher’s exact tests) for categorical data and t tests for continuous data (or Wilcoxon-Mann-Whitney tests for non-normally distributed data) to analyze differences between the 2 groups. To determine any changes from baseline to follow-up, we used Chi-square tests (or Fisher’s exact tests) to test group distributions at baseline versus follow-up. As a sensitivity analysis, we excluded participants who were nonhazardous at baseline to compare changes among hazardous and harmful drinkers. We also ran paired data analyses with McNemar’s test (or Bowker’s test of symmetry as appropriate) to determine any changes from baseline to follow-up within the intervention and control groups.

    All tests were 2-sided, and statistical significance was set at .05. All analyses were conducted with SAS 9.4 (SAS Institute).


    Study Participants

    Over the study’s 3-month recruitment period, we screened 137 interested participants (Figure 3), 20 of whom were not eligible for participation. There were no differences between control and intervention groups in enrollment or attrition. Of the 112 participants who were randomized, 91.0% (51/56) of the control and 89.0% (50/56) of the intervention group completed the baseline assessment. No differences were found in sources of recruitment for participants who completed the baseline assessment, with 72.5% (37/51) of the control and 72.0% (36/50) of the intervention having been recruited from the study site’s volunteers. Four weeks after enrollment, 92.0% (47/51) of the control and 98.0% (49/50) of the intervention group completed all study measures.

    The intervention and control groups did not differ in gender; age; education; ethnicity; or alcohol use at baseline, and they were mostly female; college educated; and in good health.

    Table 1. Intervention and control participant baseline characteristics.

    		Intervention Group (n=49)
    n (%)    		Control Group (n=47)
    n (%)    		P
    Sex (Female)34 (69.4)33 (70.2).93
    Education, % College or more39 (79.6)41 (87.2).33
    Health status, % Excellent or very good37 (75.5)31 (66.0).30
    Race: White44 (89.8)42 (89.4).99a
    Ethnicity: Hispanic3 (6.1)3 (6.4)
    Doctor ever told you have hypertension21 (42.9)21 (44.7).86
    Doctor ever told you have breast cancer (♀)4 (11.8)5 (15.2).74a
    Doctor ever told you have depression6 (12.2)8 (17.0).51
    Falls were a problem in the past 12 months6 (12.5)8 (17.0).53
    Daily NSAIDsc13 (26.5)12 (25.5).91a
    Daily high blood pressure medicine20 (40.8)17 (36.2).64
    Daily take an anticoagulant1 (2.1)1 (2.2).99a
    Weekly sedative, narcotic or tranquillizer11 (22.5)8 (17.0).50
    Ever drank 4 or more drinks at one sitting in past 12 months8 (16.3)11 (23.4).38

    a Fisher exact test

    b Wilcoxon-Mann-Whitney test

    c NSAID: Nonsteroidal anti-inflammatory drug

    On average, participants in each group were 70 years of age and White. In the intervention group 42.9% (21/49) participants reported that their doctor told them they had hypertension and 40.8% (20/49) were taking antihypertensives. Similarly, 44.7% (21/47) of the controls reported having been told they had hypertension, and 36.2% (12/47) were using antihypertensives. Of the 13 intervention participants 26.5% (13/49), and 12 controls 25.5% (12/47) used NSAID’s daily. Weekly drinking varied widely, with members of the intervention group drinking from 0 to 28 drinks, and members of the control group drinking from 0 to 21 drinks. Of the intervention group, 16.3%) (8/49) of the intervention and 23.4% (11/47) of the control group participants drank 4 or more drinks at one sitting in the past 12 months.

    ‎
    Figure 3. Participant flow chart.
    View this figure

    Drinking Quantity and Frequency

    Drinking quantity did not change over time for the intervention (P=.31) or control group (P=.56) (Table 2).

    At baseline, 89.8% (44/49) of the intervention and 97.8% (46/47) of the control group drank 2 drinks or less when they drank, and at follow-up, 96.0% (47/49) of the intervention and 93.6% (44/47) of the control group drank 2 drinks or less. Similarly, the frequency with which study participants drank did not change significantly from baseline to follow up for the intervention (P=.99) or the control group (P=.67). Paired data analyses yielded similar results for quantity and frequency of drinking (all P-values >.05).

    Adherence to NIAAA Recommended Weekly Limits

    The proportion of participants who exceeded NIAAA’s recommended weekly limits did not significantly change over time in the intervention (P=.99) or control (P=.53) group (Table 3). At follow-up, 30.6% (15/49) of the intervention and 48.9% (23/47) of the control group’s drinking exceeded the NIAAA’s limits. No differences were found in the paired data analyses.

    Table 2. Quantity and frequency of drinking.
    Quantity/FrequencyInterventionControl


    		Baseline (n=49)
    n (%)    		Follow-up (n=49)
    n (%)    		PBaseline (n=47)
    n (%)    		Follow-up (n=47)
    n (%)    		P
    Quantity







    		3 or more drinks per daya5 (10.2)2 (4.1%).31b1 (2.1%)3 (6.4%).56bd

    		2 drinks per day9 (18.4)14 (28.6%)
    		16 (34.0%)18 (38.3% )

    		1 drink or less35 (71.4)33 (67.4%)
    		30 (63.8%)26 (55.3%)
    Frequency







    		Drinks daily or almost dailyc15 (30.6)14 (28.6).99b18 (38.3)18 (38.3).67d

    		Drinks 4 or 5 times a week4 (8.2)5 (10.2)
    		6 (12.8)9 (19.2)

    		Drinks 2 or 3 times a week or less30 (61.2)30 (61.2)
    		23 (48.9)20 (42.6)

    a No differences in quantity between the groups at baseline (P=.09) or follow-up (P=.54).

    b Fisher’s exact test

    c No differences in frequency between groups at baseline (P=.46) or follow-up (P=.17).

    dP-values for the paired data analyses (Bowker\'s test of symmetry) between baseline and follow-up for quantity is .26 for the intervention group and .26 for the control group; for frequency, the P-value is .80 for the intervention group and .36 for the control group.

    Table 3. Participants who passed and failed to meet NIAAA’sa recommended weekly limits.b
    ResultInterventionControl
    Baseline(n=49)
    n (%)    		Follow-up(n=49)
    n (%)    		P (by time)Baseline (n=47)
    n (%)    		Follow-up (n=47)
    n (%)    		P (by time)
    NIAAA failc15 (30.6)15 (30.6).99d20 (42.6)23 (48.9).53d
    NIAA pass34 (69.4)34 (69.4)
    		27 (57.4)24 (51.1)

    a NIAAA: The National Institute on Alcohol Abuse and Alcoholism

    b 7 drinks weekly for all women and men 65 years of age and older; 14 drinks weekly for men under 65 years of age

    c No differences between groups at baseline (P=.22) or follow-up (P=.67).

    dP-values for the paired sample analyses (McNemar’s test) between baseline and follow-up are .99 (100% agreement) for the intervention group and .26 for the control group.

    Change in Drinking Risk

    At baseline, 44.9% (22/50) of intervention and 66.7% (31/51) of control group were harmful or hazardous drinkers (Table 4). No changes occurred from baseline to follow-up for either group in any category. There were also no differences in the risk categories between intervention and control at either baseline or follow-up (P=0.12 and P=0.11, respectively). This remained true in the sensitivity analysis where we excluded the participants that were nonhazardous drinkers at baseline (P=0.94 at baseline and P=0.58 at follow-up) (data not shown).

    Table 4. Drinking risk.
    Risk levelInterventionControl

    		Baselinea (n=49)
    n (%)    		Follow-upa (n=49)
    n (%)    		PBaselinea (n=47)
    n (%)    		Follow-upa (n=47)
    n (%)    		P
    Harmfulc13 (26.5)16 (32.7).6318 (38.3)21 (44.7).74b
    Hazardousd9 (18.4)6 (12.2)
    		13 (27.7)10 (21.3)
    Non-hazardouse27 (55.1)27 (55.1)
    		16 (34.0)16 (34.0)

    a No differences in risk category at baseline (P=.12) or follow-up (P=.11).

    bP-values for the paired data analyses (Bowker’s test of symmetry) between baseline and follow-up are .73 for the intervention and .72 for the control group.

    c Problems are likely

    d At-risk for problems

    e No known risks

    Change in Drinking From Baseline to Follow-up

    Participants were asked if they changed their drinking in the past 4 weeks, and if so, whether they drank more, the same, or less. Table 5 shows that although intervention group did not differ from control group at baseline (P=.74), the intervention group differed significantly from the control group at follow-up (P=.02), with intervention participants reporting that they drank less.

    Table 5. Participants reported change in drinking in the past 4 weeks.

    		BaselinePFollow-upP

    		Baselinea (n=49)
    n (%)    		Follow-upa (n=47)
    n (%)    		.74Baselinea (n=49)
    n (%)    		Follow-upa (n=47)
    n (%)    		.02b
    Less6 (12.2)4 (8.5)
    		13 (26.3)4 (8.5)
    Same0 (0.0)0 (0.0)
    		0 (0.0)0 (0.0)
    More43 (87.8)36 (73.5)
    		37 (73.5)43 (91.5)

    aThe Fisher exact test P value for the control group from baseline to follow-up is .99.

    bP value for the paired data analyses (McNemar’s test or Bowker’s test of symmetry) is .02 for the intervention group from baseline to follow-up; for the control group, the P-value is .99.

    Usability

    On average, the 49 intervention participants spent between 10 and 20 minutes on the website. The majority (93.9%, 46/49) reported having little or no difficulty using the site (Table 6). Most also reported (96.0%, 47/49) reported that they learned from the website, and 75.5% (37/49) stated being very or somewhat confident that they can answer questions about alcohol and health. A large proportion (77.6%, 38/49) indicated that the website helped them to become more confident in their ability to answer questions, and 93.9% (46/49) definitely or probably would recommend the site to others. Finally, 67.3% (33/49) said the use of the site will change the way they think about drinking.

    Table 6. Intervention participants’ report on the usability of “A Toast to Health in Later Life!” (n=49).
    Usability characteristicn (%)
    Difficulty using the site


    		Rated “No difficulty”36 (73.5)

    		Rated “Little difficulty”10 (20.4)
    Learned from the site


    		Rated “A great deal”32 (65.3)

    		Rated “A little”15 (30.6)
    Confident can answer questions about alcohol


    		Rated “Very”12 (24.5)

    		Rated “Somewhat”25 (51.0)
    Website increased confidence


    		Rated “Definitely”18 (36.7)

    		Rated “Probably”20 (40.8)
    Recommend to others


    		Rated “Definitely”30 (61.2)

    		Rated “Probably”16 (32.7)
    Change the way you think about drinking


    		Rated “Some”32 (65.3)

    		Rated “Much”1 (2.0)

    Principal Results

    We developed and tested the feasibility of a “Toast to Health in Later Life!” with older adults who were comfortable using the Internet and lived independently within the community. Most intervention participants had little or no difficulty navigating the website and recommended it to others. The participants reported that they learned from the site, could now confidently answer questions about alcohol and aging, and agreed that the information they gathered will change the way they think about drinking. Intervention participants reported drinking significantly less than controls 4 weeks after study enrollment.

    Despite the intervention group’s favorable review of the website, and their perception that they drank less because of it, we found no difference between the intervention and control participants in their quantity and frequency of drinking, adherence to NIAAA weekly drinking guidelines, or drinking risks over the study’s 4-week data collection period.

    There are several explanations for the discrepancy between participants’ favorable perceptions and the study’s statistical findings. First, notwithstanding the site’s appeal to participants, the study may not have provided the supportive resources necessary for them to change their drinking behavior. Other successful efforts to reduce hazardous and harmful drinking in older adults have provided access to screening, personalized feedback, health care provider advice and other services in addition to education. In Project GOAL [84], one of the first studies to target older adults, physicians used a work-book to give advice to patients, included a second reinforcement visit with the physician, and provided 2 follow-up calls from a clinic nurse 2 weeks after each physician visit. These features probably contributed to its success in reducing both 7-day alcohol use and binge drinking.

    Using the ARPS screening and education system, a study of 665 older adults and 23 physicians in the same community as the present study provided screening and personalized feedback to patients and their physicians in addition to patient education. Patients significantly reduced harmful drinking at follow-up from a statistically expected 21% in usual care to 16% and increased nonhazardous drinking from 52% expected in usual care to 58% over a 12-month period [67].

    Another study of 1186 community-dwelling older drinkers and 31 primary care providers [77] succeeded in reducing at-risk drinking as defined by a measure based on the ARPS. In addition to providing participants with educational materials, this study also provided participants with personalized reports, drinking diaries, physician advice during office visits, and telephone counseling delivered by a health educator. Similarly, a study [78] which included 631 older at-risk drinkers, also using measures derived from the ARPS algorithms, found that its multi-faceted intervention among older at-risk drinkers in primary care did not reduce the proportions of at-risk or heavy drinkers but the intervention was found to reduce the amount of drinking at 12 months [77]. This study’s participants were given personalized reports, a booklet on alcohol and aging, a drinking diary, and received advice from a primary care provider and telephone counseling from a health educator.

    These studies took place in medical rather than community settings. The presence and support of health personnel is likely to have motivated participants, encouraging them to change their drinking behavior. The effective use of health personnel to motivate patients has been shown in clinical settings for problems such as preventive health care use, health behaviors, and control of diabetes and hyperlipidemia [85,86].

    Another possible explanation of the present study’s inability to detect differences in quantity and frequency and in risks is that its brief duration may have been insufficient for change to occur. Many participants may not have seen a health care provider over the study’s 4-week data collection period, eliminating the potential for alcohol-related discussions on how to make changes in lifestyle or medication-use. Further, participants may not have encountered situations, such as a party or other festive occasion, in which to change their drinking pattern. Additionally, intervention participants may have reported drinking less because they perceived it to be the socially desirable or expected response.

    Limitations

    This study’s findings must be interpreted cautiously. The study was an initial test of the website, and there were no comparable studies on which to base sample size calculations. Thus, we cannot be sure if the number of participants was sufficient to detect a true difference between groups. Further, we did not compare “A Toast to Health in Later Life’s feasibility with alternative approaches or programs designed to educate older people about the benefits and risks of alcohol drinking because, to our knowledge, none was available. In fact, it was the lack of existing age-appropriate education that was the impetus for developing and testing “A Toast to Health in Later Life.” We might have developed our own alternative version of the content (eg, audio or print), but that would have necessitated a systematic test of the feasibility and comparability of this new program (eg, for literacy level and age relevance of content), and we did not have the resources to conduct such a study. Instead we took the approach advocated by some researchers who have stated that even if evaluations find that one intervention is superior to an alternative intervention, they cannot claim that the superior treatment should be the new standard because the intervention has not been shown to be superior to the care commonly given by practitioners [87].

    This study’s sample included nonhazardous drinkers who may not have had an incentive to change their drinking patterns, raising questions about the appropriateness of including them in the study. We included these participants because previous research has shown that nonhazardous drinking older adults may become risky drinkers over time. In a study of community-dwelling older drinkers, for example, 20 of 112 (18%) of nonhazardous drinkers who did not receive an intervention became hazardous or harmful consumers over the study's 12-month period [67]. Also, because this study aimed to test the website’s feasibility, we considered all current drinkers to be eligible, and the sensitivity analysis did not change the study’s findings. Given that there is evidence that without intervention, some older drinkers may increase their risks, it seems prudent to educate all older drinkers regardless of their current risk. Future research should consider evaluating the effectiveness of patient education in preventing alcohol-related risks in older people as well as reducing those that already exist. Enthusiasm for the applicability of the study’s findings must also be tempered by the fact that the participants were selected because they were comfortable using the Internet. In the United States, nearly 60% of persons 65 and older use the Internet, with persons 55 years and older using it even more frequently [47,88]. These statistics may not apply to other US samples or nations, thereby limiting the feasibility of “A Toast to Health in Later Life” among many older adults.

    Conclusions

    This study was designed to test “A Toast to Health in Later Life’s!” feasibility and determine if education has the potential to change older adults’ drinking behavior. We found that the site is usable and acceptable in a White, healthy, and well-educated sample of older people. We do not know if older adults with other demographic characteristics will react to the website in the same positive way. But in terms of its drinking, the study’s sample was comparable to other older adults [2,67] in its frequency of drinking risks and failure to adhere to NIAAA drinking limits. This finding supports the suggestion that the website’s objectives and content are appropriate for a more general US population.

    Despite the study’s limitations in setting, duration, and sample characteristics, it is the first that we know of to provide evidence that older adults are willing and able to use online education to learn about alcohol use and aging. Its findings also suggest that for alcohol education to be most effective, it should be included as a component of a larger effort consisting of screening, education and counseling preferably in a health care setting. In the United States, Medicare reimburses health providers who screen older patients and counsel those who are at-risk but do not meet the criteria for alcohol use disorders. Given how many preventive activities are expected of primary care providers [89], online education programs, such as “A Toast to Health in Later Life!” can be used to supplement counseling, possibly ameliorating the health care provider’s burdens especially with respect to sensitive topics such as alcohol use. Important next steps consist of testing the usefulness of “A Toast to Health in Later Life!” or other Web-based alcohol education programs in larger studies on relatively diverse older populations and also evaluating their effectiveness and cost-effectiveness.

    Acknowledgments

    This study was funded by the National Institute of Alcohol Abuse and Alcoholism, Grant 1R43AA022014-01.

    The authors are most grateful to the 117 people who graciously spent their time to assist us in developing and evaluating “A Toast to Health in Later Life! Wise Drinking as We Age.” The best aspects of the program are directly attributable to them. We also are indebted to Ms. Grace Cheng-Braun, the Chief Executive of WISE & Healthy Aging, who was instrumental in recruiting people and was a great support throughout the study. The project was completely dependent upon the superb work of Erica Simunovic who implemented the randomization and recruited and kept track of the participants.

    Mr Grant Yano did outstanding work in constructing the website and helping us to maintain equilibrium throughout the pilot test and evaluation. Mr Marc Roseboro did the graphics with utmost respect for his audience.

    Authors' Contributions

    AF was responsible for the study’s conceptualization and quality. She contributed significantly to the study’s design, data collection, data analysis, and reporting. LK was responsible for the statistical analysis and writing the results and findings. DO was instrumental in conceptualizing the study and in reviewing the website’s content and the study’s findings. JVD supervised the randomization procedure and data collection and contributed to the writing. AC assisted in data collection and writing. JCB contributed to the study’s conceptualization and quality and oversaw the production of the website and its intellectual quality. He also participated in data collection and in writing this manuscript.

    Conflicts of Interest

    Arlene Fink Associates has received SBIR grants in the area of Web-based alcohol interventions and owns the intellectual property of the application discussed. None of the authors except AF is employed by Arlene Fink Associates, holds equity or stock options or benefits in any other way from the publication of this article. AF owns 100% of Arlene Fink Associates and may benefit from publication of this article. JCB has access to all data and acts as independent guarantor for this study. Other authors have no conflicts of interest to declare.

    ‎

    Multimedia Appendix 1

    A portion of the tables and specifications for the Alcohol-Related Problems Survey.

    PDF File (Adobe PDF File), 206KB
    ‎

    Multimedia Appendix 2

    Informed consent.

    PDF File (Adobe PDF File), 51KB
    1. Schiller J, Lucas J, Peregoy J. Vital and Health Statistics Internet. 2012. Summary health statistics for US adults: National Health Interview Survey, 2011   URL: http://www.cdc.gov/nchs/data/series/sr_10/sr10_256.pdf [accessed 2015-03-20] [WebCite Cache]
    2. Wilson SR, Knowles SB, Huang Q, Fink A. The prevalence of harmful and hazardous alcohol consumption in older U.S. adults: data from the 2005-2008 National Health and Nutrition Examination Survey (NHANES). J Gen Intern Med 2014 Feb;29(2):312-319 [FREE Full text] [CrossRef] [Medline]
    3. Adams WL, Cox NS. Epidemiology of problem drinking among elderly people. Int J Addict 1995;30(13-14):1693-1716. [Medline]
    4. Moore AA, Gould R, Reuben DB, Greendale GA, Carter MK, Zhou K, et al. Longitudinal patterns and predictors of alcohol consumption in the United States. Am J Public Health 2005 Mar;95(3):458-465. [CrossRef] [Medline]
    5. Coble YD, Davis RM, Head CA, Howe JP, Karlan MS, Kennedy WR, et al. Alcoholism in the elderly. JAMA 1996 Mar 13;275(10):797-801. [CrossRef]
    6. Dufour M, Fuller RK. Alcohol in the elderly. Annu Rev Med 1995;46:123-132. [CrossRef] [Medline]
    7. Moore AA, Whiteman EJ, Ward KT. Risks of combined alcohol/medication use in older adults. Am J Geriatr Pharmacother 2007 Mar;5(1):64-74 [FREE Full text] [Medline]
    8. Klatsky AL. Alcohol and cardiovascular disease--more than one paradox to consider. Alcohol and hypertension: does it matter? Yes. J Cardiovasc Risk 2003 Feb;10(1):21-24. [CrossRef] [Medline]
    9. Klatsky AL, Friedman GD, Armstrong MA. The relationships between alcoholic beverage use and other traits to blood pressure: a new Kaiser Permanente study. Circulation 1986 Apr;73(4):628-636. [Medline]
    10. Fuchs FD, Chambless LE, Whelton PK, Nieto FJ, Heiss G. Alcohol consumption and the incidence of hypertension: The Atherosclerosis Risk in Communities Study. Hypertension 2001 May;37(5):1242-1450 [FREE Full text] [Medline]
    11. Taylor B, Irving HM, Baliunas D, Roerecke M, Patra J, Mohapatra S, et al. Alcohol and hypertension: gender differences in dose-response relationships determined through systematic review and meta-analysis. Addiction 2009 Dec;104(12):1981-1990. [CrossRef] [Medline]
    12. Devanand DP. Comorbid psychiatric disorders in late life depression. Biol Psychiatry 2002 Aug 1;52(3):236-242. [Medline]
    13. Forlani M, Morri M, Belvederi MM, Bernabei V, Moretti F, Attili T, et al. Anxiety symptoms in 74+ community-dwelling elderly: associations with physical morbidity, depression and alcohol consumption. PLoS One 2014;9(2):e89859 [FREE Full text] [CrossRef] [Medline]
    14. Chen WY, Colditz GA, Rosner B, Hankinson SE, Hunter DJ, Manson JE, et al. Use of postmenopausal hormones, alcohol, and risk for invasive breast cancer. Ann Intern Med 2002 Nov 19;137(10):798-804. [Medline]
    15. Smith-Warner SA, Spiegelman D, Yaun SS, van den Brandt PA, Folsom AR, Goldbohm RA, et al. Alcohol and breast cancer in women: a pooled analysis of cohort studies. JAMA 1998 Feb 18;279(7):535-540. [Medline]
    16. Neilsen NR, Gronbaek M. Interactions between intakes of alcohol and postmenopausal hormones on risk of breast cancer. International Journal of Cancer 2008;122(5):1109-1113. [CrossRef]
    17. Bikle DD, Stesin A, Halloran B, Steinbach L, Recker R. Alcohol-induced bone disease: relationship to age and parathyroid hormone levels. Alcohol Clin Exp Res 1993 Jun;17(3):690-695. [Medline]
    18. Schnitzler CM, Menashe L, Sutton CG, Sweet MB. Serum biochemical and haematological markers of alcohol abuse in patients with femoral neck and intertrochanteric fractures. Alcohol Alcohol 1988;23(2):127-132. [Medline]
    19. Chrischilles EA, Foley DJ, Wallace RB, Lemke JH, Semla TP, Hanlon JT, et al. Use of medications by persons 65 and over: data from the established populations for epidemiologic studies of the elderly. J Gerontol 1992 Sep;47(5):M137-M144. [Medline]
    20. Adams WL. Interactions between alcohol and other drugs. Int J Addict 1995;30(13-14):1903-1923. [Medline]
    21. Adams WL. Potential for adverse drug-alcohol interactions among retirement community residents. J Am Geriatr Soc 1995 Sep;43(9):1021-1025. [Medline]
    22. Lieber CS. Medical disorders of alcoholism. N Engl J Med 1995 Oct 19;333(16):1058-1065. [CrossRef] [Medline]
    23. Patterson TL, Jeste DV. The potential impact of the baby-boom generation on substance abuse among elderly persons. Psychiatr Serv 1999 Sep;50(9):1184-1188. [CrossRef] [Medline]
    24. Substance Abuse and Mental Health Services Administration. SAMHSA.gov. 2011. The TEDS Report: Older Adult Admissions Reporting Alcohol as a Substance of Abuse: 1992 and 2009   URL: http://archive.samhsa.gov/data/2k11/WEB_TEDS_021/TEDS021OlderAlcUseWeb.pdf [accessed 2015-03-20] [WebCite Cache]
    25. Hankin A, Daugherty M, Bethea A, Haley L. The emergency department as a prevention site: a demographic analysis of substance use among ED patients. Drug Alcohol Depend 2013 Jun 1;130(1-3):230-233. [CrossRef] [Medline]
    26. Centers for Disease Control. 2012. Binge Drinking   URL: http://www.cdc.gov/mmwr/preview/mmwrhtml/su6203a13.htm [accessed 2015-11-30] [WebCite Cache]
    27. National Institute on Alcohol Abuse and Alcoholism. NIH: National Institute on Alcohol Abuse and Alcoholism. 2007. Helping Patients Who Drink Too Much: A Clinician's Guide Update 2005   URL: http://pubs.niaaa.nih.gov/publications/Practitioner/CliniciansGuide2005/clinicians_guide.htm [WebCite Cache]
    28. United States Census Bureau. Census.gov. Newsroom Archive   URL: http://www.census.gov/newsroom/releases/archives/2020_census/ [accessed 2015-03-20] [WebCite Cache]
    29. Stampfer MJ, Colditz GA, Willett WC, Speizer FE, Hennekens CH. A prospective study of moderate alcohol consumption and the risk of coronary disease and stroke in women. N Engl J Med 1988 Aug 4;319(5):267-273. [CrossRef] [Medline]
    30. Klatsky AL, Armstrong MA, Friedman GD. Alcohol and mortality. Ann Intern Med 1992 Oct 15;117(8):646-654. [Medline]
    31. Thun MJ, Peto R, Lopez AD, Monaco JH, Henley SJ, Heath CW, et al. Alcohol consumption and mortality among middle-aged and elderly U.S. adults. N Engl J Med 1997 Dec 11;337(24):1705-1714. [CrossRef] [Medline]
    32. Valmadrid CT, Klein R, Moss SE, Klein BE. The risk of cardiovascular disease mortality associated with microalbuminuria and gross proteinuria in persons with older-onset diabetes mellitus. Arch Intern Med 2000 Apr 24;160(8):1093-1100. [Medline]
    33. Mukamal KJ, Conigrave KM, Mittleman MA, Camargo CA, Stampfer MJ, Willett WC, et al. Roles of drinking pattern and type of alcohol consumed in coronary heart disease in men. N Engl J Med 2003 Jan 9;348(2):109-118. [CrossRef] [Medline]
    34. Mukamal KJ, Maclure M, Muller JE, Sherwood JB, Mittleman MA. Prior alcohol consumption and mortality following acute myocardial infarction. JAMA 2001 Apr 18;285(15):1965-1970. [Medline]
    35. Sacco RL, Elkind M, Boden-Albala B, Lin IF, Kargman DE, Hauser WA, et al. The protective effect of moderate alcohol consumption on ischemic stroke. JAMA 1999 Jan 6;281(1):53-60. [Medline]
    36. Jayasekara H, MacInnis RJ, Hodge AM, Hopper JL, Giles GG, Room R, et al. Alcohol consumption for different periods in life, intake pattern over time and all-cause mortality. J Public Health (Oxf) 2015 Dec;37(4):625-633. [CrossRef] [Medline]
    37. Mukamal KJ, Kuller LH, Fitzpatrick AL, Longstreth WT, Mittleman MA, Siscovick DS. Prospective study of alcohol consumption and risk of dementia in older adults. JAMA 2003 Mar 19;289(11):1405-1413. [Medline]
    38. Beulens JWJ, Rimm EB, Ascherio A, Spiegelman D, Hendriks HFJ, Mukamal KJ. Alcohol consumption and risk for coronary heart disease among men with hypertension. Ann Intern Med 2007 Jan 2;146(1):10-19. [Medline]
    39. Jin Z, Xiang C, Cai Q, Wei X, He J. Alcohol consumption as a preventive factor for developing rheumatoid arthritis: a dose-response meta-analysis of prospective studies. Ann Rheum Dis 2014 Nov;73(11):1962-1967. [CrossRef] [Medline]
    40. de VF, Dekker JM, Groeneveld WJA, Nijpels G, Stehouwer CDA, Bouter LM, et al. Moderate alcohol consumption is associated with lower risk for incident diabetes and mortality: the Hoorn Study. Diabetes Res Clin Pract 2002 Jul;57(1):53-60. [Medline]
    41. Howard AA, Arnsten JH, Gourevitch MN. Effect of alcohol consumption on diabetes mellitus: a systematic review. Ann Intern Med 2004 Feb 3;140(3):211-219. [Medline]
    42. Baker L, Wagner TH, Singer S, Bundorf MK. Use of the Internet and e-mail for health care information: results from a national survey. JAMA 2003 May 14;289(18):2400-2406. [CrossRef] [Medline]
    43. Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the Internet: caveant lector et viewor--Let the reader and viewer beware. JAMA 1997 Apr 16;277(15):1244-1245. [Medline]
    44. Kassirer JP. The next transformation in the delivery of health care. N Engl J Med 1995 Jan 5;332(1):52-54. [CrossRef] [Medline]
    45. Purcell GP, Wilson P, Delamothe T. The quality of health information on the internet. BMJ 2002 Mar 9;324(7337):557-558 [FREE Full text] [Medline]
    46. American Association of Retured Persons. 2009. Bulletin Poll: Internet Use   URL: http://www.aarp.org/home-garden/housing/info-12-2009/bulletin_poll__internet.html [accessed 2015-03-20] [WebCite Cache]
    47. Smith A. Pew Research Center - Internet, Science & Tech. 2014 Apr 3. Older Adults and Technology Use   URL: http://www.pewinternet.org/files/2014/04/PIP_Seniors-and-Tech-Use_040314.pdf [accessed 2015-12-01] [WebCite Cache]
    48. Bansil P, Keenan NL, Zlot AI, Gilliland JC. Health-related information on the Web: results from the HealthStyles Survey, 2002-2003. Prev Chronic Dis 2006 Apr;3(2):A36 [FREE Full text] [Medline]
    49. Cline RJ, Haynes KM. Consumer health information seeking on the Internet: the state of the art. Health Educ Res 2001 Dec;16(6):671-692 [FREE Full text] [Medline]
    50. Rice R. Influences, usage, and outcomes of Internet health information searching: multivariate results from the Pew surveys. Int J Med Inform 2006 Jan;75(1):8-28. [CrossRef] [Medline]
    51. Anderson J, Rainey M, Eysenbach G. The impact of CyberHealthcare on the physician-patient relationship. J Med Syst 2003 Feb;27(1):67-84. [Medline]
    52. Lieberman DZ, Huang SW. A technological approach to reaching a hidden population of problem drinkers. Psychiatr Serv 2008 Mar;59(3):297-303. [CrossRef] [Medline]
    53. Random.org. 2015.   URL: https://www.random.org/ [accessed 2015-08-21] [WebCite Cache]
    54. Office of Disease Prevention and Health Promotion. U.S. Department of Health and Human Services. Health Literacy Online: A Guide to Writing and Designing Easy-to-Use Health Web Sites   URL: http://health.gov/healthliteracyonline/2010/Web_Guide_Health_Lit_Online.pdf [accessed 2015-03-20] [WebCite Cache]
    55. Glanz K, Rimer BK, Lewis FM. Health Behavior and Health Education: Theory, Research, and Practice. San Francisco: Jossey-Bass; 2002.
    56. Becker MH. The health belief model and personal health behavior. Health Educ Monogr 1974;2:324-473.
    57. Harrison JA, Mullen PD, Green LW. A meta-analysis of studies of the Health Belief Model with adults. Health Educ Res 1992 Mar;7(1):107-116. [Medline]
    58. Janz N, Champion V, Strecher V. The health belief model. In: Glanz K, Rimer BK, Lewis FM, editors. Health Behavior and Health Education, 3rd edition. San Francisco: Jossey-Bass; 2002.
    59. Rosenstock IM. Why people use health services. Milbank Mem Fund Q 1966 Jul;44(3):Suppl:94-Suppl127. [Medline]
    60. Yang C, Maher J, Conroy D. Implementation of behavior change techniques in mobile applications for physical activity. Am J Prev Med 2015 Apr;48(4):452-455. [CrossRef] [Medline]
    61. Cane J, Richardson M, Johnston M, Ladha R, Michie S. From lists of behaviour change techniques (BCTs) to structured hierarchies: comparison of two methods of developing a hierarchy of BCTs. Br J Health Psychol 2015 Feb;20(1):130-150. [CrossRef] [Medline]
    62. Knowles M. Andragogy in Action. San Francisco: Jossey-Bass; 1984.
    63. Knowles MS, Holton E, Swanson RA. The adult learner: the definitive classic in adult education and human resource development. Amsterdam: Elsevier; 2005.
    64. Dick W, Carey L. The Systematic Design of Instruction. 4th edition. New York: Harper and Collins; 1996.
    65. Leshin C, Pollock J, Reigeluth C. Instructional Design Strategies and Tactics. Englewood Cliffs, N.J: Educational Technology Publications; 1992.
    66. Wilson S, Fink A, Verghese S, Beck J, Nguyen K, Lavori P. Adding an alcohol-related risk score to an existing categorical risk classification for older adults: sensitivity to group differences. J Am Geriatr Soc 2007 Mar;55(3):445-450. [CrossRef] [Medline]
    67. Fink A, Elliott MN, Tsai M, Beck JC. An evaluation of an intervention to assist primary care physicians in screening and educating older patients who use alcohol. J Am Geriatr Soc 2005 Nov;53(11):1937-1943. [CrossRef] [Medline]
    68. Moore AA, Beck JC, Babor TF, Hays RD, Reuben DB. Beyond alcoholism: identifying older, at-risk drinkers in primary care. J Stud Alcohol 2002 May;63(3):316-324. [Medline]
    69. Fink A, Tsai MC, Hays RD, Moore AA, Morton SC, Spritzer K, et al. Comparing the alcohol-related problems survey (ARPS) to traditional alcohol screening measures in elderly outpatients. Arch Gerontol Geriatr 2002 Feb;34(1):55-78. [Medline]
    70. Fink A, Morton SC, Beck JC, Hays RD, Spritzer K, Oishi S, et al. The alcohol-related problems survey: identifying hazardous and harmful drinking in older primary care patients. J Am Geriatr Soc 2002 Oct;50(10):1717-1722. [Medline]
    71. Moore AA, Hays RD, Reuben DB, Beck JC. Using a criterion standard to validate the Alcohol-Related Problems Survey (ARPS): a screening measure to identify harmful and hazardous drinking in older persons. Aging (Milano) 2000 Jun;12(3):221-227. [Medline]
    72. Fink A, Morton S, Beck J, Hays R, Spritzer K, Oishi S, et al. The alcohol related problems survey: comparisons to existing alcohol screening measures in an elderly ambulatory population. J Am Geriatr Soc 1999;49(7):S11.
    73. Moore AA, Morton SC, Beck JC, Hays RD, Oishi SM, Partridge JM, et al. A new paradigm for alcohol use in older persons. Med Care 1999 Feb;37(2):165-179. [Medline]
    74. Nguyen K, Fink A, Beck JC, Higa J. Feasibility of using an alcohol-screening and health education system with older primary care patients. J Am Board Fam Pract 2001;14(1):7-15 [FREE Full text] [Medline]
    75. Fink A, Beck JC, Wittrock MC. Informing older adults about non-hazardous, hazardous, and harmful alcohol use. Patient Educ Couns 2001 Nov;45(2):133-141. [Medline]
    76. Nielsen Norman Group. 2000. Why You Only Need to Test With 5 Users   URL: http://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/ [accessed 2015-11-30] [WebCite Cache]
    77. Ettner SL, Xu H, Duru OK, Ang A, Tseng C, Tallen L, et al. The effect of an educational intervention on alcohol consumption, at-risk drinking, and health care utilization in older adults: the Project SHARE study. J Stud Alcohol Drugs 2014 May;75(3):447-457 [FREE Full text] [Medline]
    78. Moore AA, Blow FC, Hoffing M, Welgreen S, Davis JW, Lin JC, et al. Primary care-based intervention to reduce at-risk drinking in older adults: a randomized controlled trial. Addiction 2011 Jan;106(1):111-120 [FREE Full text] [CrossRef] [Medline]
    79. Moore AA, Morton SC, Beck JC, Hays RD, Oishi SM, Partridge JM, et al. A new paradigm for alcohol use in older persons. Med Care 1999 Feb;37(2):165-179. [Medline]
    80. Saunders J, Aasland O. World Health Organization Collaborative Project on the Identification and Treatment of Persons With Harmful Alcohol Consumption. Report on Phase I Development of a Screening Instrument. Geneva: World Health Organization; 1987. Phase 1 report   URL: http://apps.who.int/iris/bitstream/10665/62031/1/WHO_MNH_DAT_86.3.pdf [accessed 2015-12-01] [WebCite Cache]
    81. Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption--II. Addiction 1993 Jun;88(6):791-804. [Medline]
    82. Bright S, Singh D, Fink A. International use of screening tools that measure 'standard drinks': whose standard? Addiction 2011 May;106(5):1022-1023. [CrossRef] [Medline]
    83. Bright SJ, Fink A, Beck JC, Gabriel J, Singh D. Development of an Australian version of the Alcohol-Related Problems Survey: a comprehensive computerised screening tool for older adults. Australas J Ageing 2015 Mar;34(1):33-37. [CrossRef] [Medline]
    84. Fleming MF, Manwell LB, Barry KL, Adams W, Stauffacher EA. Brief physician advice for alcohol problems in older adults: a randomized community-based trial. J Fam Pract 1999 May;48(5):378-384. [Medline]
    85. Willard-Grace R, Chen EH, Hessler D, DeVore D, Prado C, Bodenheimer T, et al. Health coaching by medical assistants to improve control of diabetes, hypertension, and hyperlipidemia in low-income patients: a randomized controlled trial. Ann Fam Med 2015 Mar;13(2):130-138 [FREE Full text] [CrossRef] [Medline]
    86. Dapp U, Anders JAM, von Renteln-Kruse W, Minder CE, Meier-Baumgartner HP, Swift CG, et al. A randomized trial of effects of health risk appraisal combined with group sessions or home visits on preventive behaviors in older adults. J Gerontol A Biol Sci Med Sci 2011 May;66(5):591-598. [CrossRef] [Medline]
    87. Thompson BT, Schoenfeld D. Usual care as the control group in clinical trials of nonpharmacologic interventions. Proc Am Thorac Soc 2007 Oct 1;4(7):577-582 [FREE Full text] [CrossRef] [Medline]
    88. Fox S. Pew Internet and American Life Project. Washington, DC: Pew Research Center. Internet, Science & Tech; 2001 Jan 24. Wired seniors   URL: http://www.pewinternet.org/2001/09/09/wired-seniors/ [accessed 2015-08-21] [WebCite Cache]
    89. Yarnall KSH, Pollak KI, Østbye T, Krause KM, Michener JL. Primary care: is there enough time for prevention? Am J Public Health 2003 Apr;93(4):635-641. [CrossRef]

    ‎
    ARPS: Alcohol-Related Problem Survey
    DHSS: Department of Health and Human Services
    NIAAA: National Institute of Alcohol Abuse and Alcoholism
    NSAID: Nonsteroidal anti-inflammatory drug

    Edited by G Eysenbach; submitted 17.04.15; peer-reviewed by A Luquiens, F Hamilton; comments to author 28.07.15; revised version received 21.08.15; accepted 02.11.15; published 01.02.16

    Copyright

    ©Arlene Fink, Lorna Kwan, Dan Osterweil, Jenna Van Draanen, Alexis Cooke, John C. Beck. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 01.02.2016.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.