Protocol
Abstract
Background: Increasing evidence has promoted the clinical utility of self-reported memory problems for detecting early impairment associated with Alzheimer disease (AD). However, previous studies investigating memory problems often conflated the types of problems (ie, retrospective and prospective) with their features (ie, frequency and consequences). This bias limits the specificity of traditional measures of memory problems and minimizes their ability to detect differential trajectories associated with cognitive decline. In this study, we use a novel measure of self-reported memory problems that uses daily reports of memory lapses to disentangle types from features for analyzing the impact of each dimension in two longitudinal data sets. Furthermore, this study explores the individual difference factors of age and gender as potential moderators of the relationships between self-reported memory lapses and objective cognitive decline.
Objective: The aim of this study is to describe the protocol for a secondary data analysis project that explores the relationship between experiences of daily memory lapses and their associations with cognitive decline in middle-aged and older adults.
Methods: This study uses multilevel, coordinated analyses across two measurement burst data sets to examine the links between features and consequences of memory lapses (retrospective and prospective) and their association with objective cognitive decline. This study’s sample (N=392; aged 50-85 years; n=254, 64.8% women) is drawn from two ongoing, nationally funded research studies: The Effects of Stress on Cognitive Aging, Physiology, and Emotion study and the Einstein Aging Study. Both studies assess the daily experience of memory lapses, including the type as well as the emotional and functional outcomes, and objective measures of cognition, such as processing speed and episodic memory. We will use multilevel modeling to test our conceptual model demonstrating that differences in frequency and types of memory lapses show differential trends in their relationships with cognitive decline and that these relationships vary by the age and gender of participants.
Results: This project was funded in August 2019. The approval for secondary data analysis was given by the institutional review board in February 2020. Data analysis for this project has not yet started.
Conclusions: The early and accurate identification of individuals most at risk for cognitive decline is of paramount importance. Previous research exploring self-reported memory problems and AD is promising; however, limitations in measurement may explain previous reports of inconsistences. This study addresses these concerns by examining daily reports of memory lapses, how these vary by age and gender, and their relationship with objective cognitive performance. Overall, this study aims to identify the key features of daily memory lapses and the differential trajectories that best predict cognitive decline to help inform future AD risk screening tools.
International Registered Report Identifier (IRRID): DERR1-10.2196/25233
doi:10.2196/25233
Keywords
Introduction
Background
Alzheimer disease (AD) is insidious in its onset, with clinically detectable cognitive decline only emerging late in the trajectory [
, ]. Once an individual reaches a diagnostic threshold of cognitive impairment, the functional ability is already negatively affected and a critical period for intervention has been missed [ , ]. Therefore, the period during which cognitive testing is within normal limits but subtle cognitive changes are noticed by older adults, particularly in complex real-world environments, is a crucial target for the prevention or delay of AD onset in individuals at highest risk [ , ]. Self-reports of memory decline, particularly episodic memory, are the earliest and most central deficit of AD [ , ], appearing up to 15 years before objective cognitive deficits [ ], and are of high clinical relevance due to the associated functional consequences [ ]. Furthermore, report of a cognitive concern is a required criterion for diagnosing mild cognitive impairment (MCI), and problems with memory are specifically associated with the highest risk of progression from MCI to AD [ ].Self-reported Memory Problems and AD Risk
A growing body of evidence demonstrates the importance of memory problem reports in the risk profile for cognitive decline and AD. Cognitively intact older adults who report memory problems are up to four times more likely to develop AD over time than their peers who do not endorse problems [
- ]. Although several longitudinal studies demonstrate an increased risk of AD among older adults with self-reported memory problems, associations between objective cognition and reported memory problems are inconsistent [ , ]. Individuals who report memory problems are a decidedly heterogeneous group; only a subgroup is actually experiencing very early, subtle changes in their objective cognitive functioning that may indicate AD [ ]. To distinguish insidious AD symptomology from memory problems because of other causes, it is important to better characterize the earliest cognitive symptoms, specifically examining the relationships between specific features of different types of reported memory problems (eg, prospective and retrospective memory lapses; ) and objective cognitive outcomes, and to further consider how age and gender (potential contributors to self-schemas that may influence reporting) affect these relationships.Daily Self-reported Memory Problems
Traditional measures of memory problems (eg, “Do you have problems with your memory?”) are inherently prone to response bias as they often require respondents to report experiences or changes with their memory functioning over long time periods or record a momentary snapshot of global functioning [
]. Historically, these measures do not distinguish between two important features of memory problems: the occurrence (ie, frequency) of problems and their consequences, namely, emotional (eg, worry, sadness) or functional (eg, reduction in activities). First, it is critical to understand how often individuals have memory problems. The frequency of memory problems, particularly in daily life, is related to the objective measures of memory and is higher in individuals with amnestic MCI than in healthy controls [ , ]. In addition, better cardiovascular fitness is associated with fewer forgetting episodes through the hippocampal volume, thereby suggesting a role for brain health in the experience of forgetting [ ]. However, the frequency of memory problems is difficult to estimate accurately, given the extended time frames for reporting. Current measures tend to include consequences in questions about the frequency of memory problems, conflating the two and potentially reducing the predictive validity of reported memory problems on objective cognitive outcomes and the risk for AD. When self-reports of memory problems co-occur with general concerns about memory [ ] or lower performance in independent activities of daily living (IADL) [ , , ], the risk of future cognitive decline and AD is higher than with memory problem reports alone. Self-reported problems with remembering appointments and managing finances are better predictors of cognitive decline than other types of cognitive problems, such as paying attention to a television program [ , ]. Importantly, memory lapses associated with higher levels of consequences may also indicate that an individual is beginning to experience more severe memory problems, that is, memory problems associated with greater functional impairment. Memory problems of consequence may be better early indicators of cognitive decline. Assessing memory problems in naturalistic settings using a method that can uncouple occurrence from exposure would allow earlier detection of impaired memory. However, traditional memory lapse measures do not dissociate the consequences of memory problems from the frequency of their occurrence.In addition to failing to separate frequencies and consequences, few measures assess different types of memory problems. Lab-based work suggests that self-reports of retrospective memory problems, or forgetting events from the past, may reflect decrements in the episodic memory, whereas self-reports of prospective memory problems, or forgetting future intentions, may be more closely related to executive functioning deficits [
, ]. Furthermore, prospective memory is associated with several factors key to successful aging, including IADL performance [ , ], quality of life [ ], and medication adherence [ ]. Although some multi-item assessments include both retrospective and prospective memory problems (eg, memory functioning questionnaire [ ] and prospective and retrospective memory questionnaire [ ]), these are rarely implemented in large population-based studies examining cognitive decline [ , ]. Given the evidence supporting the differential relationship of memory problem type (ie, retrospective vs prospective) with a variety of cognitive [ , ] and functional outcomes [ , ], it is important to examine how the frequency and consequences of different types of memory problems affect long-term cognitive performance.Influences of Age and Gender on Self-reported Memory Problems
Another important factor influencing the association between self-reported memory problems and objective cognitive decline is variation because of individual differences. Age and gender are primary nonmodifiable risk factors for AD, but neither of these have been extensively examined for their potential impact on the expression of reported memory problems or their cognitive outcomes [
]. Most research exploring self-reported memory problems is focused exclusively on older adults (ie, ≥65 years) because of the increase in AD risk with age. However, AD neuropathology is known to accumulate over years or even decades before diagnosis [ ]. Cognitively intact middle-aged adults who report experiencing memory lapses exhibit structural brain differences consistent with AD as well as poorer memory performance than their peers [ , ]. Age may also play an important role in reports of memory problems because cognitive demands vary at different life stages (eg, before and after retirement), and different meaning is attributed to memory problems during middle age compared with later in life [ ]. Depending on the operationalization of memory problems (eg, frequency and consequences), some studies have found no age effects [ , ], others have found an increase in self-reported memory lapses with age [ , ], and other have found differing nonlinear relationships across middle- and older age [ , ]. Thus, examining the features (ie, frequency and consequences) of different types (ie, retrospective and prospective) of memory problems is key to explicating these aging-related trends.Although some memory problem features may increase with age, it is unclear how specific memory problems change over time or whether there are differential consequences from middle age to the oldest ages [
]. Older adults may be prone to reporting more serious consequences to memory problems considering increases in frequency over time [ ]. Changes in memory performance may elicit anxiety regarding possible cognitive decline or AD or cause a loss of confidence in the ability to perform household activities or IADL [ ]. In contrast, it is also possible that the consequences of memory problems decrease with aging, as individuals adapt to changing memory performance and develop appropriate compensation strategies [ ]. Changes in memory are expected events among older adults [ ]; therefore, they may be less emotionally and functionally burdened by their forgetting than their younger counterparts.Regarding gender differences, women have a different risk profile for cognitive decline compared with men, including up to twice the risk of developing AD over their lifetime [
] and a more precipitous decline after the onset of a clinically identifiable deficit [ , ]. Gender differences in the rates of self-reported memory lapses are largely unknown; one early study found a higher prevalence in women [ ] and another study found a higher prevalence in men [ ]. Recent evidence suggests that women may report a greater frequency of memory lapses than men with similar objective cognitive performance [ ]. This result may be attributed to a greater overall somatic symptom reporting by women [ ]; however, it is critical to distinguish differential symptom reporting in women from illness or disease risk. Major depressive disorder, for example, is more common in women, but profiles of depressive symptom reporting demonstrate no gender differences [ ]. The potential differences in the frequency and consequences of reported memory problems by gender are unknown, as are their associations with cognitive decline and AD.Conceptual Framework
The conceptual model guiding this study (
) is based on the identified need to disentangle two different aspects of memory problems: occurrence (ie, frequency) from functional and emotional impacts (ie, consequences), and gauge their unique contributions to the prediction of objective cognitive decline. This conceptual model additionally includes the key individual difference measures of age and gender, which may affect the expression and strength of the relationship between memory problems and cognitive performance. We propose to separate these features of memory problems by measuring memory lapses that occur on a daily basis using intensive, diary assessments that allow participants to provide more details about the memory lapses as they occur in their natural environment.Study Aims
The overall aims of this study are to examine how features of different types of memory lapses relate to objective cognitive performance and whether these associations depend on age or gender. Using a construct-level replication framework across two longitudinal data sets, we will examine the following aims:
- Aim 1: To test whether the frequency or consequences of different types of daily memory lapses (retrospective and prospective) predict decline in cognitive performance. We hypothesize that the consequences of memory lapses, rather than frequency, will better predict future cognitive decline.
- Aim 2: To identify age and gender differences in frequency and consequences of different types of daily memory lapses. We hypothesize that older adults will report more frequent memory lapses but rate these lapses as lower in consequences relative to middle-aged adults. For gender, we hypothesize that women will report more frequent memory lapses and rate memory lapses as having greater consequences compared with men.
- Aim 3: To test whether age or gender moderates the predictive utility of frequency or consequences of different types of daily memory lapses on cognitive decline. We hypothesize that age and gender will moderate the relationship between memory lapses and objective cognitive decline such that cognitive decline will be greatest for women and older adults reporting memory lapses with the highest level of consequences.
Methods
Overview
We will use multilevel modeling (MLM) in coordinated analyses in two measurement burst data sets funded by the National Institute on Aging (NIA): the Effects of Stress on Cognitive Aging, Physiology, and Emotion (ESCAPE) study [
] and the Einstein Aging Study (EAS) [ ]. These data sets include intensive measurement components that are repeated multiple times across longer time frames, providing both daily data to capture the features of different types of daily memory lapses and long-term cognitive change on objective assessments ( presents an overview of data collection protocols in ESCAPE and EAS). Critically, the application of MLM to intensive measurement designs such as ESCAPE and EAS permits the evaluation of within-person (ie, differences at the day level) and between-person variations (eg, individual differences), with the key addition of modeling developmental change. As participants in these ongoing studies are evaluated repeatedly across years, MLM can further address differences in developmental trajectories, including identifying the profiles of those individuals most at risk for developing cognitive impairment.Sample Characteristics
Participants in this study must meet the following criteria for inclusion: age 50 years or older, no clinically significant objective memory impairment (ie, MCI or dementia) at baseline, and completion of at least two burst assessments for the longitudinal analysis (
shows the flowchart of the current analytical sample in this study). The samples and design characteristics of the data sets are listed in . The ESCAPE and EAS data sets are recruited through systematic random sampling using a sampling frame from registered voter lists from Bronx, New York, and collected at an academic institution [ ].Characteristics | ESCAPEa | EASb | |||
Sample description | |||||
Total sample, n | 157 | 235 | |||
Age (years), range | 50-65 | 60-85 | |||
Gender: women, n (%) | 99 (63.1) | 155 (65.9) | |||
Race: Black, n (%) | 44 (28.0) | 87 (37.0) | |||
Study design | |||||
Daily assessments: possible days, n | 14 | 14 | |||
Possible bursts, n | 4 | 4 | |||
Possible number of occasions. n | 8792 | 13,160 |
aESCAPE: Effects of Stress on Cognitive Aging, Physiology, and Emotion.
bEAS: Einstein Aging Study.
Designs and Procedures of Selected Data Sets
The included data sets are uniquely suited to our planned analyses because of the use of a measurement burst design and inclusion a measure of daily memory lapses that can be separated into frequency, emotional consequences, and functional consequences by retrospective and prospective memory lapses. Participants in both studies completed electronic daily diaries using a study-provided smartphone that guided participants through data collection and provided a date and time stamp for each observation. These time stamps were critical to assuring that diaries were completed as instructed rather than at the end of the diary period (ie, backward filling) [
, ]. Each study also included extensive cognitive testing (traditional and ambulatory) and a questionnaire battery for physical health and psychological well-being. The primary differences among the study designs were the selection of lab-based assessments for cognition ( ), psychological well-being, and physical health. ESCAPE finalized the collection in 2019, and data collection in the EAS is ongoing.The daily diary design of these projects specifically supports our measurement approach for daily memory lapses. Participants report on their experiences with memory lapses at the end of the day report, and for any memory lapses experienced, they provide additional details on the impact of that lapse. Reporting at the end of the day, rather than over longer time windows, reduces a recall bias in reporting and allows a greater recollection of experiences and their impact.
Objective cognition measures by study.
Episodic memory
- Effects of Stress on Cognitive Aging, Physiology, and Emotion (ESCAPE) study
- Paired Associates
- Spatial Location Memory
- Auditory Verbal Learning Test
- Einstein Aging Study (EAS)
- Logical Memory
- Craft Story
- Benson Complex Figure
Working memory
- ESCAPE
- Operation Span
- Backward Letter Span
- EAS
- Backward Number Span
Other cognition
- ESCAPE
- Shipley Vocabulary
- Ravens Progressive Matrices
- EAS
- Trails A/B
- Digit Symbol
- Wechsler Adult Intelligence Scale Vocabulary
- Multilingual Naming Test
- WAIS-III Block Design
Ethics Approval and Consent to Participate
Data collection in the EAS and ESCAPE data sets was approved by the institutional review board at the Albert Einstein College of Medicine, and participants provided written informed consent for participation. This study was approved by the Pennsylvania State University Institutional Board (STUDY00012793 [ESCAPE] and STUDY00017272 [EAS]). Informed consent for this project was waived by the institutional review board because of the exclusive use of secondary data sets.
Measures
Memory Lapses
Both data sets include a measure of daily memory lapses. Retrospective memory lapses are represented by lapses for names, words, past events or information, and where something was placed. Prospective memory lapses are represented by lapses for medications, appointments, chores, and finishing something that was started. For both types of lapses, the participants are asked two follow-up questions. The first asks about emotional consequences (ie, “How much did this bother you?”) and the second asks about functional consequences (ie, “How much did this interfere with your activities?”). Both questions are rated on a visual analog scale ranging from 0 to 100.
Objective Cognition
Both data sets include a number of lab-based measures of objective cognition as well as novel ambulatory assessments of cognitive performance. The lab-based assessments include measures of episodic memory, working memory, executive functioning [
, ], vocabulary [ - ], spatial memory [ ], and fluid intelligence [ ].Ambulatory objective cognitive tests were administered remotely via smartphones (
). Participants completed several trials of these tests up to five times each day at a pseudorandomly determined time (spaced approximately 2-3 hours apart). At each assessment, the participants completed a processing speed and spatial memory test. The processing speed test uses the reaction time as an outcome. The spatial memory test uses an accuracy measure that quantifies the distance between the original and the participant’s indicated locations of the dots. The reliability of these assessments exceeds 0.95.Covariates
Both studies include a detailed medical history questionnaire that can be used to identify medical conditions that may impact memory functioning, including endocrine disorders (eg, diabetes), cardiovascular diseases (eg, hypertension), and chronic inflammation (eg, arthritis), as well as the measures of depressive and anxiety symptoms to account for contributions of other psychological symptoms that are related to memory impairment.
Availability of Data and Materials
The EAS and ESCAPE data sets are available from the Albert Einstein College of Medicine, but restrictions apply to the availability of these data. These data sets were used under license for this study, and so they are not publicly available. However, data are available under reasonable request from the authors and with permission of the principal investigators of EAS and ESCAPE as well as their affiliated organizations.
Analysis Plan
We will use three-level MLM to examine which features of daily memory lapses (frequency or consequences of retrospective or prospective lapses) predict future cognitive decline (aim 1); the impact of age and gender on the frequency and consequences of different types of daily memory lapses (aim 2); and, finally, whether age or gender moderates the predictive utility of the frequency or consequences of daily memory lapses on cognitive decline (aim 3). MLM is appropriate when observations are nested, such as in this study’s data sets (days in bursts and bursts in persons) [
]. The MLM approach offers an advantage over other types of analytic models for repeated measures data (eg, repeated measures analysis of variance) for two reasons. First, MLM allows us to make use of all available data through maximum likelihood estimation methods rather than excluding individuals who fail to complete some surveys or who drop out of the study at later waves. Second, we can also test for individual differences among our relationships of interest by including random effects. We will explicitly test the underlying hypothesis that the consequences of memory problems that individuals experience in their everyday lives are the most informative for predicting future cognitive decline. Although the frequency of memory lapses is a necessary condition for the consequences of those lapses, we hypothesize that frequent memory lapses are not a sufficient predictor of cognitive decline over time. Analyses will be conducted by JM and JRT with assistance from NLH.General Approach to Analysis
Across both data sets, we will begin by examining daily correlates of memory lapses to identify the potential confounds in the daily assessments that should be accounted for across analyses. Significant daily predictors of memory lapses will be incorporated into primary analytic models to control for other processes that influence the daily reporting of memory lapses. Potential daily covariates uncovered in the literature include daily stress [
] and physical activity [ ].Operationalization of Daily Memory Lapses
Measures of daily memory lapses across both data sets follow the same general structure with minor differences, allowing us to draw equivalent operationalizations of frequency and consequences across different memory lapse types. For the frequency of memory lapses, we will compute the total number of memory lapses over the daily diary period separately for each type of memory lapse (ie, prospective and retrospective). To measure consequences, we will use both the average and the maximum ratings across the daily diary period. In addition, we will separately examine the emotional and functional consequences for each of the different types of memory lapses.
Operationalization of Objective Cognitive Performance
Data from lab-based cognitive tests (eg, Shipley Vocabulary) will be scored using standardized methods. Moreover, data from ambulatory cognitive tests will be used to create scores reflecting each of the following indicators: average performance, upper quintile performance, lower quintile performance, and intraindividual variability. For all objective cognitive performance–based tests, we will first remove any anticipatory (<150 milliseconds) or delayed (>3 SDs above the mean) responses from distributions by examining response times for all trials [
]. After detrending the remaining data for practice effects as in our previous work [ ], we will compute the average, lowest quintile, and highest quintile scores for each task for each individual at each burst. We will also compute residualized and raw intraindividual SDs as the indicators of variability in cognitive performance [ - ].Approach to Coordinated Analysis
Coordinated analysis was selected for this study as it permits the efficient replication of results across data sets to generate stronger substantive conclusions. Moreover, it allows fitting individual models within each data set, testing of covariates, and comparison of the effects of interest across different samples and contexts [
- ]. Using equivalent parameterization ensures that models’ effects reflect the same underlying constructs across data sets and standardized estimates will promote the comparison of effects across data sets. We will conduct data set–specific follow-up analyses that focus on additional measures of cognitive performance to ensure the replicability of findings across different operationalizations. All cognitive data will be examined for practice effects before analysis.Aim 1
Using MLM, we will first examine whether the frequency or consequences of different types of memory lapses covary with cognitive performance over time. This analysis addresses whether at assessments when an individual has a higher frequency of memory lapses (or reports higher levels of consequences), do they have poorer cognitive performance? Next, to test the prospective prediction hypothesis, we will use autoregressive MLM models to test the temporal relationships and determine whether changes in daily memory lapses from previous occasions predict future changes in cognitive performance over time. All models will examine the different features and types of memory lapses.
Aim 2
Potential contributor differences in the experience of daily memory lapses are the individual’s age and gender. We will explicitly examine the associations of age and gender with frequency and the consequences of different types of daily memory lapses. When the frequency of memory lapses of different types is the outcome, we will use multilevel Poisson regression models. Poisson regression is the most appropriate when the outcome is count data and when the counts are not normally distributed [
]. Both emotional and functional consequences were rated on a Likert scale and can be appropriately represented using a normal distribution [ ].Aim 3
For our third aim, we will include age and gender as the moderators of the predictive utility of frequency and consequences of daily memory lapses for predicting changes in cognitive performance. We will extend the analyses in aim 1 to include an interaction term between age at baseline (or gender) and frequency, as well as age at baseline (or gender) and consequences, to predict cognitive performance. We will then examine age and gender moderation for the frequency and consequences of the different types of memory lapses.
Results
This project was funded by the NIA in August 2019 (see
for reviews of current protocol) and was approved by the Pennsylvania State University Institutional Review Board (STUDY00012793 [ESCAPE] and STUDY00017272 [EAS]). Data analysis for this study has not yet begun, but data cleaning and preliminary analyses are expected to be completed by January 2021. All aim-specific analyses are expected to be completed by April 2023.Discussion
Principal Findings
The early and accurate identification of individuals most at risk for cognitive decline, functional impairment, and increased risk of AD is critical for an early intervention. Older adults who report memory problems but do not have objective memory impairment are at a substantially higher risk of AD than those who do not report problems [
, ]. Despite previous work showing that reports of memory problems are sensitive to subtle cognitive decline [ , ], there are potential biases in traditional measures, such as perceptions of normative and nonnormative aging, which limit the clinical utility of these measures in the early detection of cognitive impairment. For example, younger adults are more likely to attribute forgetfulness to emotional difficulties or stress than older adults [ ], whereas older adults are more likely to view memory problems as a normal part of aging and less concerning [ , ]. Alternatively, self-reported memory problems may be more salient to older adults [ ], particularly given that the fear about AD is common among those who report memory problems [ ] and/or have had a family experience with AD [ , ]. Differences between men and women follow a similar, contradictory pattern: some studies have found that women report more memory problems than men [ , ], whereas other studies found that reports of memory problems among men may be more predictive of functional impairment [ , , ]. The lack of consistency between these results can likely be attributed to issues with traditional measures of self-reported memory problems that require individuals to recollect memory problems over months or years, aggregate these experiences, and report on them without distinguishing the frequency of experiences from the outcomes associated with the experience (eg, impacts on emotional and daily functioning) [ , , ]. To increase the specificity of self-reported memory problems, we must refine our measures to account for the frequency and consequences of different types of memory problems.This study addresses these previous limitations in memory problem assessment by using daily diary data collected in two NIA-funded longitudinal daily diary studies and a novel measure of daily memory lapses. This measure includes retrospective and prospective types of memory lapses and is collected daily over multiple bursts for both studies, which permits the investigation of frequency of occurrence and consequences without relying upon recollection and minimizes potential bias. By disentangling the components of self-reported memory lapses (ie, features and consequences) using daily measures, this project seeks to improve the specificity of memory lapse measures for predicting cognitive decline over time; measures that capture these additional characteristics of memory lapses may be more sensitive for detecting subtle cognitive decline earlier in the aging trajectory. A major strength of this study is the inclusion of potential modifiers of age and sex. Given the conflicting evidence regarding the relationship between self-reported memory lapses and objective measures of cognitive decline, the examination of these individual difference measures is necessary to identify the indicators of future cognitive risk and model varying developmental trajectories. Finally, the design of this study, using two large, representative data sets with up to 30,000 days of data, provides the opportunity for both coordinated analysis and direct construct-level replication.
Conclusions
This study addresses the urgent need [
] to identify the indicators of future cognitive decline risk to inform the development of noninvasive AD risk screening tools and novel intervention targets. Identifying the components associated with the accurate prediction of reported memory problems is necessary to improve assessment specificity and the clinical utility of self-reported memory problems as a symptom. Daily measurements can capture different types of memory lapses that occur, their frequency, and their emotional and functional consequences. Examining these experiences earlier in the aging trajectory and considering individual differences (eg, gender) will establish more sensitive indicators of those adults most at risk, before the onset of functional decrements associated with cognitive decline. Early, easy-to-implement tools for the detection of AD risk are a key component of reducing individual and societal burden. These tools can provide the time needed for patients and families to plan for the future and mobilize resources, evidence to guide the enrichment of samples for future research, and the opportunity to develop tools for use in early intervention trials.Acknowledgments
The authors would like to thank Martin Sliwinski for his contributions to this proposal. The authors would also like to thank the research teams and participants of the ESCAPE study and EAS. This work was supported by the NIA (grant R01AG062605; principal investigator: JM). The funder has no role in the study design, data collection, analysis, interpretation, or preparation of manuscripts. This study uses data previously collected by two studies: EAS (grant R01AG12448, grant R01AG02672, and grant AG003949) and ESCAPE (grant R01AG039409, grant R01AG042595, grant P01AG03949, and grant CTSA1UL1TR001073).
Authors' Contributions
JM and NLH conceptualized the study and drafted the manuscript. JRT drafted and revised the manuscript. All authors approved the final manuscript.
Conflicts of Interest
None declared.
Overview of data collection protocols in the Effects of Stress on Cognitive Aging, Physiology, and Emotion study and Einstein Aging Study.
PNG File , 30 KB
Redacted National Institute on Aging peer review of this protocol.
PDF File (Adobe PDF File), 5758 KBReferences
- Rabin LA, Smart CM, Amariglio RE. Subjective cognitive decline in preclinical Alzheimer's disease. Annu Rev Clin Psychol 2017 May 08;13(1):369-396. [CrossRef] [Medline]
- Reisberg B, Prichep L, Mosconi L, John ER, Glodzik-Sobanska L, Boksay I, et al. The pre-mild cognitive impairment, subjective cognitive impairment stage of Alzheimer's disease. Alzheimers Dement 2008 Jan;4(1 Suppl 1):98-108 [FREE Full text] [CrossRef] [Medline]
- Clare L, Woods RT. Cognitive training and cognitive rehabilitation for people with early-stage Alzheimer's disease: a review. Neuropsychol Rehabil 2004 Sep;14(4):385-401. [CrossRef]
- Clare L, Wilson BA, Carter G, Hodges JR. Cognitive rehabilitation as a component of early intervention in Alzheimer's disease: a single case study. Aging Ment Health 2003 Jan 09;7(1):15-21. [CrossRef] [Medline]
- Qiu C, Kivipelto M, von Strauss E. Epidemiology of Alzheimer's disease: occurrence, determinants, and strategies toward intervention. Dialogues Clin Neurosci 2009;11(2):111-128 [FREE Full text] [Medline]
- Kirova AM, Bays RB, Lagalwar S. Working memory and executive function decline across normal aging, mild cognitive impairment, and Alzheimer's disease. Biomed Res Int 2015:--- [FREE Full text] [CrossRef] [Medline]
- Budson AE. Understanding memory dysfunction. Neurologist 2009 Mar;15(2):71-79. [CrossRef] [Medline]
- Gold CA, Budson AE. Memory loss in Alzheimer's disease: implications for development of therapeutics. Expert Rev Neurother 2008 Dec 09;8(12):1879-1891 [FREE Full text] [CrossRef] [Medline]
- Albert MS, DeKosky ST, Dickson D, Dubois B, Feldman HH, Fox NC, et al. The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement 2011 May 22;7(3):270-279 [FREE Full text] [CrossRef] [Medline]
- Kaup AR, Nettiksimmons J, LeBlanc ES, Yaffe K. Memory complaints and risk of cognitive impairment after nearly 2 decades among older women. Neurology 2015 Oct 28;85(21):1852-1858. [CrossRef]
- Abner EL, Kryscio RJ, Caban-Holt AM, Schmitt FA. Baseline subjective memory complaints associate with increased risk of incident dementia: the PREADVISE trial. J Prev Alzheimers Dis 2015 Mar;2(1):11-16 [FREE Full text] [CrossRef] [Medline]
- Rönnlund M, Sundström A, Adolfsson R, Nilsson L. Subjective memory impairment in older adults predicts future dementia independent of baseline memory performance: Evidence from the Betula prospective cohort study. Alzheimers Dement 2015 Nov 07;11(11):1385-1392. [CrossRef] [Medline]
- Reisberg B, Shulman MB, Torossian C, Leng L, Zhu W. Outcome over seven years of healthy adults with and without subjective cognitive impairment. Alzheimers Dement 2010 Jan;6(1):11-24 [FREE Full text] [CrossRef] [Medline]
- van Oijen M, de Jong FJ, Hofman A, Koudstaal PJ, Breteler MM. Subjective memory complaints, education, and risk of Alzheimer's disease. Alzheimers Dement 2007 Apr 31;3(2):92-97. [CrossRef] [Medline]
- Mendonça MD, Alves L, Bugalho P. From subjective cognitive complaints to dementia: who is at risk?: a systematic review. Am J Alzheimers Dis Other Demen 2016 Mar 03;31(2):105-114 [FREE Full text] [CrossRef] [Medline]
- Crumley JJ, Stetler CA, Horhota M. Examining the relationship between subjective and objective memory performance in older adults: a meta-analysis. Psychol Aging 2014 Jun;29(2):250-263. [CrossRef] [Medline]
- Riedel-Heller SG, Matschinger H, Schork A, Angermeyer MC. Do memory complaints indicate the presence of cognitive impairment? Results of a field study. Eur Arch Psychiatry Clin Neurosci 1999 Aug 13;249(4):197-204. [CrossRef] [Medline]
- Blackburn DJ, Wakefield S, Shanks MF, Harkness K, Reuber M, Venneri A. Memory difficulties are not always a sign of incipient dementia: a review of the possible causes of loss of memory efficiency. Br Med Bull 2014 Dec 01;112(1):71-81. [CrossRef] [Medline]
- Robinson MD, Clore GL. Belief and feeling: evidence for an accessibility model of emotional self-report. Psychol Bull 2002 Nov;128(6):934-960. [CrossRef] [Medline]
- Nicholas CR, Dowling NM, Racine AM, Clark LR, Berman SE, Koscik RL, et al. Longitudinal assessment of self- and informant-subjective cognitive complaints in a sample of healthy late-middle aged adults enriched with a family history of Alzheimer’s disease. J Int Neuropsychol Soc 2017 Jul 11;23(8):617-626. [CrossRef]
- Tam JW, Schmitter-Edgecombe M. Event-based prospective memory and everyday forgetting in healthy older adults and individuals with mild cognitive impairment. J Clin Exp Neuropsychol 2013 Feb 18;35(3):279-290 [FREE Full text] [CrossRef] [Medline]
- Szabo AN, McAuley E, Erickson KI, Voss M, Prakash RS, Mailey EL, et al. Cardiorespiratory fitness, hippocampal volume, and frequency of forgetting in older adults. Neuropsychology 2011 Sep;25(5):545-553 [FREE Full text] [CrossRef] [Medline]
- Jessen F, Wiese B, Bachmann C, Eifflaender-Gorfer S, Haller F, Kölsch H, German Study on Aging‚ Cognition, Dementia in Primary Care Patients Study Group. Prediction of dementia by subjective memory impairment: effects of severity and temporal association with cognitive impairment. Arch Gen Psychiatry 2010 Apr 01;67(4):414-422. [CrossRef] [Medline]
- Luck T, Luppa M, Matschinger H, Jessen F, Angermeyer MC, Riedel-Heller SG. Incident subjective memory complaints and the risk of subsequent dementia. Acta Psychiatr Scand 2015 Apr 09;131(4):290-296. [CrossRef] [Medline]
- Marshall GA, Zoller AS, Kelly KE, Amariglio RE, Locascio JJ, Johnson KA, et al. Everyday cognition scale items that best discriminate between and predict progression from clinically normal to mild cognitive impairment. Curr Alzheimer Res 2014 Oct 13;11(9):853-861 [FREE Full text] [CrossRef] [Medline]
- Marshall GA, Zoller AS, Lorius N, Amariglio RE, Locascio JJ, Johnson KA, et al. Functional activities questionnaire items that best discriminate and predict progression from clinically normal to mild cognitive impairment. Curr Alzheimer Res 2015 May 26;12(5):493-502 [FREE Full text] [CrossRef] [Medline]
- Zimprich D, Kliegel M, Rast P. The factorial structure and external validity of the prospective and retrospective memory questionnaire in older adults. Eur J Ageing 2011 Mar 3;8(1):39-48 [FREE Full text] [CrossRef] [Medline]
- Rönnlund M, Sundström A, Adolfsson R, Nilsson L. Self-reported memory failures: associations with future dementia in a population-based study with long-term follow-up. J Am Geriatr Soc 2015 Sep 17;63(9):1766-1773. [CrossRef] [Medline]
- Pirogovsky E, Woods SP, Vincent Filoteo J, Gilbert PE. Prospective memory deficits are associated with poorer everyday functioning in Parkinson's disease. J Int Neuropsychol Soc 2012 Jul 30;18(6):986-995. [CrossRef]
- Schmitter-Edgecombe M, Woo E, Greeley DR. Characterizing multiple memory deficits and their relation to everyday functioning in individuals with mild cognitive impairment. Neuropsychology 2009 Mar;23(2):168-177. [CrossRef] [Medline]
- Woods SP, Weinborn M, Li YR, Hodgson E, Ng AR, Bucks RS. Does prospective memory influence quality of life in community-dwelling older adults? Aging Neuropsychol Cogn 2015 Mar 26;22(6):679-692 [FREE Full text] [CrossRef] [Medline]
- Woods SP, Weinborn M, Maxwell BR, Gummery A, Mo K, Ng AR, et al. Event-based prospective memory is independently associated with self-report of medication management in older adults. Aging Ment Health 2014 Jan 13;18(6):745-753 [FREE Full text] [CrossRef] [Medline]
- Zelinski EM, Gilewski MJ, Anthony-Bergstone CR. Memory functioning questionnaire: concurrent validity with memory performance and self-reported memory failures. Psychol Aging 1990 Sep;5(3):388-399. [CrossRef] [Medline]
- Crawford J, Smith G, Maylor E, Della Sala S, Logie R. The Prospective and Retrospective Memory Questionnaire (PRMQ): normative data and latent structure in a large non-clinical sample. Memory 2003 May 21;11(3):261-275. [CrossRef] [Medline]
- Reid LM, Maclullich AM. Subjective memory complaints and cognitive impairment in older people. Dement Geriatr Cogn Disord 2006 Nov 3;22(5-6):471-485. [CrossRef] [Medline]
- Rabin LA, Smart CM, Crane PK, Amariglio RE, Berman LM, Boada M, et al. Subjective cognitive decline in older adults: an overview of self-report measures used across 19 international research studies. J Alzheimers Dis 2015 Sep 24;48(s1):63-86. [CrossRef]
- Woods SP, Weinborn M, Velnoweth A, Rooney A, Bucks RS. Memory for intentions is uniquely associated with instrumental activities of daily living in healthy older adults. J Int Neuropsychol Soc 2011 Oct 28;18(1):134-138. [CrossRef]
- Tomita T, Sugawara N, Kaneda A, Okubo N, Iwane K, Takahashi I, et al. Sex-specific effects of subjective memory complaints with respect to cognitive impairment or depressive symptoms. Psychiatry Clin Neurosci 2014 Mar 30;68(3):176-181 [FREE Full text] [CrossRef] [Medline]
- Braak H, Braak E. Neuropathological stageing of Alzheimer-related changes. Acta Neuropathol 1991 Sep;82(4):239-259. [CrossRef]
- Schultz SA, Oh JM, Koscik RL, Dowling NM, Gallagher CL, Carlsson CM, et al. Subjective memory complaints, cortical thinning, and cognitive dysfunction in middle-aged adults at risk for AD. Alzheimers Dement (Amst) 2015 Mar 01;1(1):33-40 [FREE Full text] [CrossRef] [Medline]
- Perrotin A, La Joie R, de La Sayette V, Barré L, Mézenge F, Mutlu J, et al. Subjective cognitive decline in cognitively normal elders from the community or from a memory clinic: differential affective and imaging correlates. Alzheimers Dement 2017 May 28;13(5):550-560. [CrossRef] [Medline]
- Commissaris C, Ponds R, Jolles J. Subjective forgetfulness in a normal Dutch population: possibilities for health education and other interventions. Patient Educ Couns 1998 May;34(1):25-32. [CrossRef]
- Papaliagkas V, Papantoniou G, Tsolaki M, Moraitou D. Self-report instruments of cognitive failures as screening tools for Subjective Cognitive Impairment in older adults. Hell J Nucl Med 2017;20 Suppl:58-70. [Medline]
- Rowell SF, Green JS, Teachman BA, Salthouse TA. Age does not matter: memory complaints are related to negative affect throughout adulthood. Aging Ment Health 2016 Dec 25;20(12):1255-1263 [FREE Full text] [CrossRef] [Medline]
- Jonker C, Geerlings MI, Schmand B. Are memory complaints predictive for dementia? A review of clinical and population-based studies. Int J Geriat Psychiatry 2000 Nov;15(11):983-991. [CrossRef]
- Mitchell AJ. Is it time to separate subjective cognitive complaints from the diagnosis of mild cognitive impairment? Age Ageing 2008 Sep 16;37(5):497-499. [CrossRef] [Medline]
- Westoby CJ, Mallen CD, Thomas E. Cognitive complaints in a general population of older adults: prevalence, association with pain and the influence of concurrent affective disorders. Eur J Pain 2009 Oct;13(9):970-976. [CrossRef] [Medline]
- Begum A, Dewey M, Hassiotis A, Prince M, Wessely S, Stewart R. Subjective cognitive complaints across the adult life span: a 14-year analysis of trends and associations using the 1993, 2000 and 2007 English Psychiatric Morbidity Surveys. Psychol Med 2013 Sep 27;44(9):1977-1987. [CrossRef]
- Hill N, Mogle J, Kitko L, Gilmore-Bykovskyi A, Wion R, Kitt-Lewis E, et al. Incongruence of subjective memory impairment ratings and the experience of memory problems in older adults without dementia: a mixed methods study. Aging Ment Health 2018 Aug 12;22(8):972-979. [CrossRef] [Medline]
- Verhaeghen P, Geraerts N, Marcoen A. Memory complaints, coping, and well-being in old age: a systemic approach. Gerontologist 2000 Oct;40(5):540-548. [CrossRef] [Medline]
- Hahn EA, Lachman ME. Everyday experiences of memory problems and control: the adaptive role of selective optimization with compensation in the context of memory decline. Aging Neuropsychol Cogn 2015 Mar 06;22(1):25-41 [FREE Full text] [CrossRef] [Medline]
- Diehl M, Wahl H, Barrett AE, Brothers AF, Miche M, Montepare JM, et al. Awareness of aging: theoretical considerations on an emerging concept. Dev Rev 2014 Jun 01;34(2):93-113 [FREE Full text] [CrossRef] [Medline]
- Seshadri S, Wolf PA, Beiser A, Au R, McNulty K, White R, et al. Lifetime risk of dementia and Alzheimer's disease. The impact of mortality on risk estimates in the Framingham Study. Neurology 1997 Dec 01;49(6):1498-1504. [CrossRef] [Medline]
- Chapman RM, Mapstone M, Gardner MN, Sandoval TC, McCrary JW, Guillily MD, et al. Women have farther to fall: gender differences between normal elderly and Alzheimer's disease in verbal memory engender better detection of Alzheimer's disease in women. J Int Neuropsychol Soc 2011 Apr 13;17(4):654-662. [CrossRef]
- Lin KA, Choudhury KR, Rathakrishnan BG, Marks DM, Petrella JR, Doraiswamy PM, Alzheimer's Disease Neuroimaging Initiative. Marked gender differences in progression of mild cognitive impairment over 8 years. Alzheimers Dement (N Y) 2015 Sep 01;1(2):103-110 [FREE Full text] [CrossRef] [Medline]
- Gagnon M, Dartigues JF, Mazaux JM, Dequae L, Letenneur L, Giroire JM, et al. Self-reported memory complaints and memory performance in elderly French community residents: results of the PAQUID Research Program. Neuroepidemiology 1994 Jun 16;13(4):145-154. [CrossRef] [Medline]
- Sundermann EE, Edmonds EC, Delano-Wood L, Galasko DR, Salmon DP, Rubin LH, et al. Sex influences the accuracy of subjective memory complaint reporting in older adults. J Alzheimers Dis 2018 Jan 09;61(3):1163-1178. [CrossRef]
- Barsky AJ, Peekna HM, Borus JF. Somatic symptom reporting in women and men. J Gen Intern Med 2001 Apr;16(4):266-275. [CrossRef]
- Bogner HR, Gallo JJ. Are higher rates of depression in women accounted for by differential symptom reporting? Soc Psychiatry Psychiatr Epidemiol 2004 Mar 1;39(2):126-132 [FREE Full text] [CrossRef] [Medline]
- Scott SB, Graham-Engeland JE, Engeland CG, Smyth JM, Almeida DM, Katz MJ, et al. The Effects of Stress on Cognitive Aging, Physiology and Emotion (ESCAPE) Project. BMC Psychiatry 2015 Jul 03;15(1):146 [FREE Full text] [CrossRef] [Medline]
- Katz MJ, Derby CA, Wang C, Sliwinski MJ, Ezzati A, Zimmerman ME, et al. Influence of perceived stress on incident amnestic mild cognitive impairment: results From the Einstein Aging Study. Alzheimer Dis Assoc Disord 2016;30(2):93-98 [FREE Full text] [CrossRef] [Medline]
- Smyth JM, Smyth JM. Ecological momentary assessment research in behavioral medicine. J Happiness Stud 2003;4(1):35-52. [CrossRef]
- Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR. Patient compliance with paper and electronic diaries. Control Clin Trials 2003 Apr;24(2):182-199. [CrossRef]
- Tombaugh TN. Trail Making Test A and B: normative data stratified by age and education. Arch Clin Neuropsychol 2004 Mar;19(2):203-214. [CrossRef]
- Tombaugh TN, Kozak J, Rees L. Normative data stratified by age and education for two measures of verbal fluency: FAS and Animal Naming. Arch Clin Neuropsychol 1999 Feb 01;14(2):167-177. [CrossRef]
- Shipley WC. A self-administering scale for measuring intellectual impairment and deterioration. J Psychol 1940 Apr;9(2):371-377. [CrossRef]
- Wechsler D. Wechsler Adult Intelligence Scale--Fourth Edition (WAIS-IV). APA PsycTests 2008:1. [CrossRef]
- Ivanova I, Salmon DP, Gollan TH. The multilingual naming test in Alzheimer's disease: clues to the origin of naming impairments. J Int Neuropsychol Soc 2013 Jan 08;19(3):272-283. [CrossRef]
- Wechsler D. Wechsler memory scale (WMS-III) Vol. 14. San Antonio, TX: Psychological Corporation; 1997:-.
- Raven J. The Raven's progressive matrices: change and stability over culture and time. Cogn Psychol 2000 Aug;41(1):1-48. [CrossRef] [Medline]
- Hox J, Moerbeek M, van de Schoot R. Multilevel Analysis: Techniques and Applications, Third Edition. London, United Kingdom: Routledge; 2017:1-364.
- Neupert SD, Almeida DM, Mroczek DK, Spiro III A. Daily stressors and memory failures in a naturalistic setting: findings from the VA Normative Aging Study. Psychol Aging 2006 Jun;21(2):424-429. [CrossRef] [Medline]
- Whitbourne SB, Neupert SD, Lachman ME. Daily physical activity: relation to everyday memory in adulthood. J Appl Gerontol 2008 Jun 11;27(3):331-349 [FREE Full text] [CrossRef] [Medline]
- Ratcliff R. Methods for dealing with reaction time outliers. Psychol Bull 1993 Nov;114(3):510-532. [CrossRef] [Medline]
- Munoz E, Sliwinski MJ, Scott SB, Hofer S. Global perceived stress predicts cognitive change among older adults. Psychol Aging 2015 Sep;30(3):487-499 [FREE Full text] [CrossRef] [Medline]
- Stawski RS, MacDonald SW, Brewster PW, Munoz E, Cerino ES, Halliday DW. A comprehensive comparison of quantifications of intraindividual variability in response times: a measurement burst approach. J Gerontol B Psychol Sci Soc Sci 2019 Feb 15;74(3):397-408 [FREE Full text] [CrossRef] [Medline]
- Phibbs S, Stawski RS, MacDonald SW, Munoz E, Smyth JM, Sliwinski MJ. The influence of social support and perceived stress on response time inconsistency. Aging Ment Health 2019 Feb 24;23(2):214-221. [CrossRef] [Medline]
- Munoz E, Stawski RS, Sliwinski MJ, Smyth JM, MacDonald SW. The ups and downs of cognitive function: neuroticism and negative affect drive performance inconsistency. J Gerontol B Psychol Sci Soc Sci 2020 Jan 14;75(2):263-273 [FREE Full text] [CrossRef] [Medline]
- Stawski RS, Scott SB, Zawadzki MJ, Sliwinski MJ, Marcusson-Clavertz D, Kim J, et al. Age differences in everyday stressor-related negative affect: a coordinated analysis. Psychol Aging 2019 Mar;34(1):91-105 [FREE Full text] [CrossRef] [Medline]
- Piccinin AM, Muniz-Terrera G, Clouston S, Reynolds CA, Thorvaldsson V, Deary IJ, et al. Coordinated analysis of age, sex, and education effects on change in MMSE scores. J Gerontol B Psychol Sci Soc Sci 2013 May 02;68(3):374-390 [FREE Full text] [CrossRef] [Medline]
- Hofer SM, Piccinin AM. Integrative data analysis through coordination of measurement and analysis protocol across independent longitudinal studies. Psychol Methods 2009 Jun;14(2):150-164 [FREE Full text] [CrossRef] [Medline]
- Snijders TAB, Bosker R. Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling. London: SAGE Publications; 1999:1-272.
- Mogle J, Muñoz E, Hill NL, Smyth JM, Sliwinski MJ. Daily memory lapses in adults: characterization and influence on affect. J Gerontol B Psychol Sci Soc Sci 2019 Jan 01;74(1):59-68 [FREE Full text] [CrossRef] [Medline]
- Kaup AR, Byers AL, Falvey C, Simonsick EM, Satterfield S, Ayonayon HN, et al. Trajectories of depressive symptoms in older adults and risk of dementia. JAMA Psychiatry 2016 May 01;73(5):525-531 [FREE Full text] [CrossRef] [Medline]
- Dark-Freudeman A, West RL, Viverito KM. Future selves and aging: older adults' memory fears. Educ Gerontol 2006 Feb;32(2):85-109. [CrossRef]
- Hodgson LG, Cutler SJ. Looking for signs of Alzheimer's disease. Int J Aging Hum Dev 2016 Jul 22;56(4):323-343. [CrossRef]
- Ostergren JE, Heeringa SG, de Leon CF, Connell CM, Roberts JS. The influence of psychosocial and cognitive factors on perceived threat of Alzheimer's disease. Am J Alzheimers Dis Other Demen 2017 Aug 13;32(5):289-299 [FREE Full text] [CrossRef] [Medline]
- Holmen J, Langballe EM, Midthjell K, Holmen TL, Fikseaunet A, Saltvedt I, et al. Gender differences in subjective memory impairment in a general population: the HUNT study, Norway. BMC Psychol 2013 Oct 25;1(1):1. [CrossRef]
- Cavanaugh JC, Feldman JM, Hertzog C. Memory beliefs as social cognition: a reconceptualization of what memory questionnaires assess. Rev Gen Psychol 1998 Mar 01;2(1):48-65. [CrossRef]
- Yates JA, Clare L, Woods RT. Subjective memory complaints, mood and MCI: a follow-up study. Aging Ment Health 2017 Mar 02;21(3):313-321 [FREE Full text] [CrossRef] [Medline]
Abbreviations
AD: Alzheimer disease |
EAS: Einstein Aging Study |
ESCAPE: Effects of Stress on Cognitive Aging, Physiology, and Emotion |
IADL: independent activities of daily living |
MCI: mild cognitive impairment |
MLM: multilevel modeling |
NIA: National Institute on Aging |
Edited by G Eysenbach; peer reviewed by A Naidu and C Entwistle; externally peer reviewed by the National Institute on Aging. See the Multimedia Appendices for the peer-review report; submitted 23.10.20; accepted 13.04.21; published 14.05.21
Copyright©Jacqueline Mogle, Nikki L Hill, Jennifer R Turner. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 14.05.2021.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.