This paper is in the following e-collection/theme issue:

Formative Studies and eHealth/mHealth Development (515) Mobile Health (mhealth) (2748) Usability of Apps and User Perceptions of mHealth (892) mHealth for Symptom and Disease Monitoring, Chronic Disease Management (1301) Patient-Reported Outcome Measures (PROMs) (274)

Published on in Vol 1, No 2 (2012): Jul-Dec

Initial Evaluation of an Electronic Symptom Diary for Adolescents with Cancer

Initial Evaluation of an Electronic Symptom Diary for Adolescents with Cancer

Initial Evaluation of an Electronic Symptom Diary for Adolescents with Cancer

Authors of this article:

Christina Baggott1 ;   Faith Gibson2, 3 ;   Beatriz Coll4 ;   Richard Kletter5 ;   Paul Zeltzer5 ;   Christine Miaskowski1
Article Authors Cited by (64) Tweetations (1) Metrics

    Original Paper

    1University of California, San Francisco, Department of Physiological Nursing, San Francisco, CA, United States

    2London South Bank University, Department of Children's Nursing Health & Social Care, London, United Kingdom

    3Great Ormond Street Hospital for Children, London, United Kingdom

    4San Francisco Unified School District, San Francisco, CA, United States

    5GoMed Solutions, Los Angeles, CA, United States

    Corresponding Author:

    Christina Baggott, PhD, RN, PNP-BC

    University of California, San Francisco

    Department of Physiological Nursing

    2 Koret Way Box 0610

    San Francisco, CA,

    United States

    Phone: 1 415 476 4320

    Fax:1 415 476 8899

    Email: christina.baggott@ucsf.edu


    Background: The delivery of optimal care depends on accurate communication between patients and clinicians regarding untoward symptoms. Documentation of patients’ symptoms necessitates reliance on memory, which is often imprecise. We developed an electronic diary (eDiary) for adolescents and young adults (AYAs) with cancer to record symptoms.

    Objective: The purpose of this paper is to describe the utility of an eDiary designed for AYAs with cancer, including dependability of the mobile application, the reasons for any missing recorded data, patients’ adherence rates to daily symptom queries, and patients’ perceptions of the usefulness and acceptability of symptom data collection via mobile phones.

    Methods: Our team developed an electronic symptom diary based on interviews conducted with AYAs with cancer and their clinicians. This diary included daily severity ratings of pain, nausea, vomiting, fatigue, and sleep. The occurrence of other selected physical sequelae was assessed daily. Additionally, patients selected descriptors of their mood. A 3-week trial of the eDiary was conducted with 10 AYA cancer patients. Mobile phones with service plans were loaned to patients who were instructed to report their symptoms daily. Patients completed a brief questionnaire and were interviewed to elicit their perceptions of the eDiary and any technical difficulties encountered.

    Results: Overall adherence to daily symptom reports exceeded 90%. Young people experienced few technical difficulties and reported benefit from daily symptom reports. Symptom occurrence rates were high and considerable inter- and intra-patient variability was noted in symptom and mood reports.

    Conclusions: We demonstrated the utility of an eDiary that may contribute insight into patients’ symptom patterns to promote effective symptom management.

    JMIR Res Protoc 2012;1(2):e23

    doi:10.2196/resprot.2175

    Keywords

    mHealth, eHealth, patient-reported outcomes, symptom assessment, adolescent, cancer 


    Adolescents and young adults (AYAs) with cancer experience numerous sequelae during treatment [1-5], which are associated with decrements in their quality of life [6]. Accurate communication between young people and their clinicians about these symptoms is crucial for the delivery of optimal supportive care. Furthermore, accurate symptom assessment during clinical trials is needed to advance the science of supportive care in oncology.

    Current practices to determine symptom occurrence in clinical trials require that patients accurately recall their symptoms during clinic visits over the prior 1 to 6 weeks and report them to their clinicians. Clinicians then record this information in the medical record and researchers abstract the information to a database for analysis. Omissions or errors at any of these steps result in an underreporting or misrepresentation of symptom occurrence. Moreover, recent data suggests that the accuracy of symptom appraisal and recall depends on the use of short recall periods [7].

    Alternatively, symptom diaries in paper format that are completed daily can be used to circumvent the challenges described above. However, patient adherence with these diaries is low, ranging from 11% to 56% [8-12]. In addition, adherence with paper diary entries is markedly low when real time data entry is checked electronically (eg, with light sensors to determine when the diary was opened) against the paper submission. In one study, 90% (approximately 36/40) of patients reported temporal adherence with paper diary entries. However, the true adherence level was 11% when the actual time that diary entries were written was monitored electronically. Many patients recorded entries just prior to returning the diary, known as “parking lot entries” [11]. Data based on inaccurate symptom recall may lead to inappropriate conclusions when symptom management studies are based on poorly recalled data [13].

    The collection of AYAs’ symptom data in real-time using electronic diaries (eDiaries) could avoid poorly recalled data. Patients’ and clinicians’ interests in using eDiaries are high [14, 15]. The portability of these devices and availability of audible prompts may promote adherence with data entry. In a review of 62 studies that used electronic pain diaries [15], the overall adherence with diary entries was 83%. Factors that promoted adherence to eDiaries included the following: shorter diaries, having a user’s manual, financial compensation, and reminder alarms [15].

    While initial eDiary research involved the use of personal digital assistants [14, 16-20], mobile phones are now also used for collecting a variety of data. Typically, the frequency of symptom assessment using eDiaries ranges from 1 to 12 times per day [21]. Entries can be triggered by random alerts, symptom events, or at predetermined schedules. Mobile phone diaries have been used by child and adult patients to monitor symptoms, alert clinicians about severe symptoms [22], or to deliver self-care interventions based on symptom assessments [23]. The term ecological momentary assessment (EMA) is used to describe the collection of real-time data from individuals in naturalistic settings. In pediatrics, EMA has been instrumental in the study of physical activity [24-30], affective mood disorders [31-34], evaluation of alcohol and illicit drug use [35], and smoking cessation [36]. These studies included multiple evaluations per day, as frequent as every 15 minutes, among relatively healthy individuals. No such studies were conducted with hospitalized AYAs.

    AYAs with cancer have unique needs related to frequent and complex exacerbations of their disease- and treatment-related symptoms that could affect their abilities to maintain eDiaries. The lack of an eDiary geared to the symptoms and developmental needs of AYAs with cancer prompted us to develop a mobile application, titled the Mobile Oncology Symptom Tracker (mOST). To do so, we assembled a multidisciplinary team of 2 nurses and 3 software developers from GoMed Solutions, one of whom is a pediatric oncologist. We elicited input from 15 AYA oncology patients from two University-affiliated children’s hospitals in the inpatient or clinic settings. Semi-structured interviews were used to determine their use of technology, and ideas on the types of symptoms to monitor, frequency of reporting, and preferences for icons and graphics. In addition, clinicians and research experts were consulted during the development of the application. The symptoms selected for daily monitoring were those that occur frequently during treatment of cancer [4]. Assessment of these symptoms was done using modifications of valid and reliable instruments when possible (Multimedia Appendix 1). Considering the complex demands placed on patients undergoing cancer therapy, we designed the application to collect symptom data as a single end-of-day (EOD) entry to minimize patient burden. This single entry aims to capture the majority of the day’s ratings, and the daily component circumvents issues related to poor recall associated with entries that are made on subsequent days. Entries could be made between 3 pm and midnight at the convenience of the patient. A team of researchers and developers used the application for 2 weeks to evaluate its functionality prior to clinical testing.

    The purpose of this paper is to describe the utility of mOST tested on a group of 10 oncology patients, ages 13 to 21. The specific aims of this pilot study were to determine the dependability of the mobile application, the reasons for any missing entries and patients’ adherence rates to daily symptom queries for multiple symptom reporting. In addition, patients’ perceptions of the usefulness and acceptability of symptom data collection via mobile phones were evaluated after a 3-week trial assessment period.


    Participants

    In this descriptive, longitudinal study, we evaluated a mobile phone-based electronic symptom diary in a convenience sample of AYAs with cancer. Patients were eligible to participate if they were 13 to 21 years of age, could understand English, gave assent or consent to participate, had not participated in the prior application development interviews, and were receiving chemotherapy (for initial therapy, relapsed, or refractory disease). The study was approved by the Human Subjects Committee at the University of California, San Francisco.

    Eligible patients were identified with assistance from pediatric oncology clinics and in-patient advanced practice nurses. Research staff approached these patients to determine interest in the study. If patients expressed interest, the research staff informed them of the study procedures, risks, and benefits. Patients 18 years of age or older and the parents/guardians of younger patients signed written, informed consent. Younger patients gave written assent. Between March and April, 2011, 11 out of 13 patients approached agreed to participate in the study (response rate of 85%). Patients who refused were too busy or too ill to participate.

    Procedures

    Patients completed a demographic form that included their age, race/ethnicity, primary diagnosis, date of diagnosis, number of relapses, prior mobile phone use, and approximate household income. An 8 GB iPhone 3GS, charger, and earphones were loaned to each participant during the study. The monthly service plan included: 450 minutes of peak time voice minutes, and unlimited data, text messaging, and evenings/weekend calling. The mOST application was downloaded on each phone. Patients received an instructions booklet and a tutorial on the application and phone use, expectations of the frequency of symptom reporting, and methods to notify research staff of system malfunctions. They were instructed to report their symptoms at the end of the day. A single daily report was designed to minimize patient burden. Patients could only access the system between 3 pm and midnight, as reports earlier in the day might not accurately reflect all of their experiences for the day. They could program 2 reminder messages to input daily entries with audible alerts, customizable for text choice and time selection. Data were delivered to a secure website, listed by study number only, and could be downloaded to database and statistical packages for analysis. The dates and times of data submission and data upload were coded.

    Symptom Assessments

    Severity ratings of 5 disease or treatment-related symptoms were assessed daily: pain, nausea, vomiting, fatigue, and sleep quality. A body diagram was used to indicate the location(s) of any pain experienced. A visual analog scale (VAS) was selected to assess pain intensity (ie, no pain or worst pain) based on a consensus statement compiled by pediatric pain researchers [37]. We selected the Color Analog Scale (CAS) as the VAS for this study due to its excellent psychometric properties [38, 39]. However, pain scales that include face icons (ie, faces pain scales) were preferred by pediatric and adolescent patients in a prior study [40] and by many of the AYAs we interviewed during the software development period. We included the Faces Pain Scale-Revised (FPS-R), a valid and reliable pediatric pain measure [41], as well as a VAS to assess pain, with the consideration that no additional burden was placed on participants. The FPS-R appeared as 6 faces on the bottom of the mOST screen. When a patient tapped a face, the selection enlarged and filled most of the screen. Patients then responded to the statement, “drag the slider to show your average pain level in your <body part> since midnight”, using the CAS.

    Validity of the CAS was previously evaluated by eliciting pain ratings from 30 children in an emergency department (ED) who reported pain [39]. Initial median pain ratings were higher than those obtained after analgesic administration, 6 centimeter (cm) and 3.1 cm, respectively. Median scores of 30 children without pain were 0 cm, compared to median ratings of 7.0 cm from children who reported severe pain. In addition, correlations between CAS scores and the FPS-R were positive and strong (ie, 0.89) [39]. In another study, reliability of the CAS was evaluated by obtaining 2 pain ratings on the CAS from patients in a pediatric ED, 1 minute apart. The intraclass correlation coefficient in this study was high (r=0.97, 95% CI 0.95-0.98) [38]. Previously, strong positive correlations were noted between FPS-R scores and children’s pain ratings on a VAS. The validity of the FPS-R was evaluated by eliciting pain reports from children after routine ear piercing [41]. In this study, similar correlations were noted in hospitalized children who experienced painful conditions [41]. Additional reports of the psychometric properties of the FPS-R are summarized in a review by Tomlinson and colleagues [42]

    To assess nausea, we included the Pediatric Nausea Assessment Tool (PeNAT), a valid and reliable instrument to assess nausea among pediatric oncology patients [43]. In previous evaluations, PeNAT scores varied significantly among children admitted for different therapies (ie, children with cancer admitted for routine chemotherapy, children receiving conditioning therapy for hematopoietic stem cell transplants, children with cancer admitted for febrile neutropenia, and children without cancer admitted to the general pediatrics unit). Moderate correlation was noted among children’s PeNAT scores and their emetic episodes as well as with parental reports of their nausea. Test-retest reliability, measured by the collection of patient entries 1 hour apart, revealed moderate correlations between the 2 entries [43]. This tool was selected for the eDiary, with faces depicted in a similar fashion as the FPS-R. We used the PeNAT in conjunction with a VAS to assess the degree of nausea in this early stage of application development to collect correlative assessment data and to explore the optimal assessment tool for the application.

    No single-item validated instruments were available to assess vomiting, fatigue, or sleep among AYA patients. The number of vomiting episodes was assessed with the single forced-choice query of: none, 1 time, or 2 or more times. Fatigue was assessed with 2 queries from the Fatigue Scale-Adolescent [44] (“my body has felt tired” and “my mind has felt worn out”) using a VAS format to collect data on physical fatigue (not tired or most tired) and mental fatigue, (not worn out or most worn out) respectively. Sleep quality was assessed with a single query in a VAS format (terrible or great) in conjunction with patient estimates of bedtime and wake time. All VAS scales on the application were in CAS format and transformed to a 0-100 scale, with higher values indicating more severe symptoms.

    The occurrence of diarrhea, constipation, fever, numbness/tingling, mouth sores, dizziness, and headaches were assessed daily. These symptoms were included due to their frequent occurrence among pediatric oncology patients and their variability during treatment [4]. Patients could select symptoms from a list and highlight the text by swiping the printed text with one finger from left to right or type in other conditions. In addition, patients selected descriptors for their current mood - the choices included were angry, scared, frustrated, lonely, anxious, irritable, worried, happy, confident, and hopeful. Both positive and negative terms to describe mood were selected for inclusion based on their frequent reports in clinical encounters.

    Patients received $1 credit towards a department store gift card for each diary entry. In addition, those who completed ≥ 90% of the assessments in a 21-day period were given a $50 gift card. If patients attempted to report symptoms but experienced a system error, the attempt was also applied towards the gift card credits.

    Post Use Evaluation

    The principal investigator or research assistant conducted 10 to 15 minute interviews with patients at the completion of their evaluation period to obtain their perceptions about using mOST and any technical difficulties they experienced. In addition, they were asked to carry out a “think-aloud” exercise [45] where they provided the rationales for the actions they made on mOST as they did them. These interviews were audio recorded and transcribed verbatim. All patient identifiers were removed from the transcripts. A brief questionnaire was completed at the time of the interview to elicit patients’ experiences with the application.

    Data Analysis

    Descriptive statistics were used to characterize demographic and clinical characteristics as well as rates of symptom occurrence. The total number of system errors was calculated during the 21-day study period. Data entry adherence rates were determined by calculating the number of symptom reports over the 21 days of the study. One-way analysis of variance was used to evaluate the differences in patients’ weekly adherence rates. The interview transcripts were analyzed by 2 researchers, with verification by 1 of the senior investigators.


    Patient Characteristics

    The demographic and clinical characteristics of the AYAs who participated are described in Table 1. A patient completed 2 entries just prior to being notified that her tumor had progressed. Because she required emergency surgery followed by a transfer to the pediatric intensive care unit (PICU), she was withdrawn from the study. Another patient completed 13 daily entries prior transfer to the PICU due to complications following hematopoietic stem cell transplantation. Her symptom reports are included in this analysis but she was not interviewed. All study phones were returned at the completion of the study, but several had misplaced the phone chargers or earphones.

    The patients’ baseline technology use is described in Table 2. All but 2 (a 15 year old male and a 20 year old male who was homeless), of the AYAs owned a mobile phone with service plans primarily paid for by their parents. Daily use of the phones for voice calls and text messaging was common but not uniform. All patients owned a computer and only 1 did not have home Internet access. Most patients (80 %) had a social networking account.

    Table 1. Demographic and clinical characteristics of participants (N=10).
    Characteristica,bn (%)
    Gender

    		Male6 (60%)

    		Female4 (40%)
    Race/Ethnicity

    		Hispanic White3 (30%)

    		Non-Hispanic White1 (10%)

    		African American1 (10%)

    		Hispanic-Other or not specified5 (50%)
    Diagnosis

    		Leukemia/Lymphoma6 (60%)

    		Bone tumor3 (30%)

    		Sarcoma-other1 (10%)
    Number of prior relapses

    		None5 (50%)

    		One or more5 (50%)
    Setting

    		Inpatient4 (40%)

    		Outpatient4 (40%)

    		Both2 (20%)

    aAge in years (SD) = 18.2 (2.9)

    bTime since initial diagnosis in months (SD)= 12.2 (15.3)

    Table 2. Technology use among participants.
    QuestionResponsen (%)
    Do you have a mobile phone?Yes8 (80%)
    No2 (20%)
    Who pays for the service?Self2 (20%)
    Parents6 (60%)
    Not applicable2 (20%)
    How often do you use your phone for voice calls?Daily4 (40%)
    4-6 days/week2 (20%)
    2-3 days/week2 (20%)
    Not applicable2 (20%)
    How often do you use your phone for text messaging?Daily5 (50%)
    4-6 days/week2 (20%)
    2-3 days/week1 (10%)
    Not applicable2 (20%)
    Do you have a computer at home?Yes10 (100%)
    No0 (0%)
    Do you have Internet access at home?Yes9 (90%)
    No1 (10%)
    Is Internet access WiFi enabled?Yes5 (50%)
    No2 (20%)
    Not applicable1 (10%)
    Not sure2 (20%)
    Do you have a page on Facebook or MySpace?Yes8 (80%)
    No2 (20%)

    Dependability of the Mobile Application

    On day 14 of our data collection period, we noted a system malfunction that occurred if patients skipped a day of diary entries. On the subsequent day, the application did not function. During the “beta-testing” period, testers skipped data entries and did not experience this malfunction. An interim solution was devised in which patients deleted the application and reloaded it from a website. Subsequently, we monitored the database daily. If patients missed an entry, we contacted them and provided instructions on how to reload the application. A total of 3 episodes of system malfunction occurred over the study period. The software malfunction was rectified by the end of the study. An error message appeared at the time of upload for 3 patients, but that the entry was transmitted the next time the application was opened.

    Reasons for Missing Data

    One patient missed an eDiary entry when he felt too ill to enter data. He missed the subsequent day due to the system malfunction and a third day when he went out of town and left the phone at home. Another patient missed a data entry on a day he discovered that his leukemia had relapsed. He missed 4 consecutive entries during a period when we attempted to reach him. He then reloaded the application and maintained full adherence until the end of his study period. A third patient missed 2 entries due to forgetfulness. A 4th patient reported full adherence to the data entries, but we noted missing data on 1 day with 2 entries the subsequent day, all uploaded on the third day. This finding likely represented Internet access difficulties, but we coded her data as missing a day to be conservative in adherence estimations.

    Adherence

    Adherence can be calculated by assessing different causation end points. When data were counted as missing only for omitted entries due to forgetfulness and illness-related concerns of mild to moderate levels (ie, giving credit for days of system error and time spent in the PICU), the overall adherence rate for daily symptom reports during the 21 day study was 97%. When days of system malfunction were included as missing data, the adherence rate was 95%. When all days of missing data were used in the calculation, including the 8 days when a patient spent was in the PICU, the adherence rate was 91%. Adherence rates did not vary among the 3 weeks (F2,27=1.016, P =.38).

    Usefulness

    The data collected were used to delineate the potential utility of the eDiary to clinicians and researchers. Summaries of the symptoms and moods reported by individual patients are listed in Tables 3 and 4, respectively. Additional physical symptoms typed in and added by patients were: jaw pain, numb chin, bloody stools, bone ache, lightheaded, tinnitus, stomachache, and itchiness. Two patients wrote in symptoms already evaluated on the application (ie, “fatigue, tiredness” and “queasy nauseous”). Additional mood descriptors reported by patients were: giggly, bored, overwhelmed, and blah. In addition, trajectories reported by one patient of the severity of mental fatigue and nausea over the 3-week course are depicted in Figure 1 along with his mean values for each symptom over the 21 day study period, as exemplars of symptom variability over time. Considerable inter-patient and intra-patient variability were noted in the symptom and mood reports. The ability to collect this variability in patients’ experiences supports the usefulness of the eDiary.

    Acceptability

    In an exit interview, one patient with peripheral neuropathy noted that the highlighting feature was difficult to master. Others stated that the highlighting feature was simple to use. The body diagram used to describe pain locations was divided into 9 regions–head/neck, hands, arms, chest, abdomen, upper back, lower back/pelvis, legs, and feet. Difficulties with pinpointing the precise location of pain were mentioned by 4 patients (eg, the indicator to depict neck pain showed up on the head).

    Patients rated the application as either “easy” (2/9, 22%) or “very easy” (7/9, 78%) to use. Daily entries were generally completed in less than 2 minutes. One patient had mild visual deficits and mentioned that the print was difficult to read at times. However, she was able to read the screens out loud during the “think-aloud” exercise. All other patients reported that the print size posed no difficulties. In the exit survey, patients were asked to select or write in adjectives to describe the application. They could select more than 1 descriptor. All of the selected words had a positive connotation (ie, 67% rewarding, 78% valuable, 78% educational, 67% interesting). No one selected challenging, frustrating, time consuming, worthless, confusing, or difficult to describe mOST. All patients who were questioned (n=7) reported that they would recommend the application to others. Selected quotations regarding why they would recommend the application to others are included in Table 5. Patients’ preferences for the use of the VAS or faces scales to rate pain and nausea were fairly evenly divided. Those who preferred the VAS appreciated the opportunity to select a more precise level of pain or nausea, compared to only a few options on the faces scales. Those who preferred the faces scales commented that the diagrams depicted how they were feeling.

    Table 3. Patients’ reports of physical symptoms.
    SymptomPercentage of days each patient reported symptomsMean of symptom occurrence rates% of patients reporting symptoms
    Patient

    		12345678910


    		InpatientBoth in and outpatientOutpatient
    Fatigue-Physicala100100100864321906239564100
    Fatigue-Mentala959288814816905244562100
    Nauseab1001006524954775029385790
    Headache9554298129055222764490
    Painc8169654338010024333680
    Dizzy5246242429030517332690
    Numb6281005010000051060
    Constipation2906501005501101050
    Diarrhea2992655000001450
    Mouth sores03905005193901150
    Fever031610000005540

    aOccurrence rate based on percentage of days that VAS score >30 on 0-100 scale

    bOccurrence rate based on percentage of days that patients selected face 2, 3, or 4 on the Pediatric Nausea Assessment Tool (PeNAT)

    cOccurrence rate based on percentage of days that patients selected face 2, 3, 4, 5, or 6 on the Faces Pain Scale-Revised (FPS-R)

    Table 4. Patients’ selection of mood descriptors.
    Mood descriptorPercentage of days each patient selected mood descriptorsMean of mood occurrence rates% of patients reporting mood
    Patient
    12345678910
    InpatientBoth in and outpatientOutpatient
    Positive mood descriptors
    Hopeful38065863326543229141100
    Happy6715820622655233243790
    Confident5215128653701017863190
    Negative mood descriptors
    Frustrated62235310431610033863490
    Irritable0461252381615556713190
    Worried0465910191140100812880
    Anxious388650195101011952690
    Sad04647571011056332180
    Angry1902451450011481380
    Scared0312405005024950
    Lonely001833000000520
    Table 5. Participants’ reasons for recommending the use of the mOST application to others.
    ParticipantQuotation
    18 year old, Hispanic female“…it\'s a good idea to keep like, to keep a list of how you\'re feeling"
    20 year old Hispanic male“…it kind of like channels whatever you have wrong with you like out…”
    21 year old Hispanic male“… because it really helps to see how you\'ve been doing too actually, not just like, you know, go on day by day. But it does help you see and reflect on how you\'re doing. And if you did something the other day that helped, will help you make you feel better and so on. “
    19 year old Hispanic female“…because "It’s a good app and it just makes you -- I know for me it makes me feel better because I can keep track of my symptoms, kind of like a self-comforting type of thing because you know what you’re going through and you’re not scared. And eventually if this does go to where the doctors can see it, it’d be even better because you know that your physician is seeing it and the communication’s there.”
    ‎
    Figure 1. Mental fatigue and nausea ratings for participant 5. Mental fatigue rating in response to the statement “My mind has felt worn out” on a 0-100 VAS, where higher values indicate more severe fatigue. Nausea rating is response to nausea query on a 0-100 VAS, where higher values indicate more severe nausea. Dashed line represents mean values over the 21-day study period.
    View this figure

    This study is the first to demonstrate that the use of an eDiary on a mobile phone platform is a feasible method to collect daily symptom data from AYAs with cancer. The adherence rates in this study (>91%) greatly exceed those associated with pen and paper diaries [8-12], and did not vary significantly over the 3-week period. Patients reported that the application was simple to use and that they would recommend its use to others. The daily collection of patients’ symptom experiences may be very useful in pediatric oncology, as it opens new doors to study symptom trajectories in this population. With this technology, researchers can evaluate daily symptom reports and potentially discover patterns that may lead to a better understanding of the etiology of various symptoms. This level of assessment of symptoms may increase our ability to identify those at highest risk for unrelieved symptoms and immediately intervene to relieve suffering.

    Not all diseases or treatment-related symptoms experienced by cancer patients warrant daily monitoring. However, many symptoms are labile, particularly during chemotherapy [4]. Weekly or monthly averages of such symptoms provide an incomplete picture of the patient’s experience. Daily symptom reports provide clinicians with the information they need to intervene at an early stage and to encourage patients to monitor changes in symptom severity following an intervention. This variability cannot be appreciated when researchers report only group means. Mobile technology allows for the expeditious collection of daily symptom reports, avoiding the burden placed on AYAs when maintaining a paper diary.

    Researchers can evaluate within-subject changes using the statistical process of multilevel modeling [46, 47]. In addition, with daily symptom reports, a more accurate evaluation of symptom clusters may be possible when temporal co-occurrence is confirmed. Through the use of an eDiary, one can evaluate changes in patients’ mood descriptors to determine the relationships among a variety of mood states and physical symptoms and timing of therapies.

    Daily reports may not be sufficiently frequent among a group of critically ill patients. Broderick and colleagues [13] compared symptom data collected multiple times per day with EMA to subsequent patient recall with varying recall periods. Although patients had difficulties accurately recalling events more than 2 days in the past, EOD reports were deemed sufficient. The average of the day’s EMA reports strongly correlated with those recalled at the EOD [13]. However, the collection of EMA symptom ratings may be an advantageous option to evaluate symptom management strategies for some highly variable symptoms, such as novel treatments for nausea or pain.

    EMA trials which involve frequent assessments throughout the day have been conducted among AYA patients with chronic pain [20], diabetes [48], and among healthy college students to assess smoking[ 49] and alcohol use [49]. However, to our knowledge, no studies have been done with AYA patients with cancer. One must weigh the potential for improved temporal resolution of symptom patterns with the potential for increased patient burden and subsequent decrements in adherence to monitoring. However, research on the effects of frequent monitoring on adherence with symptom reporting is lacking.

    The use of mobile phones to collect symptom characteristics offers many advantages over pen-and-paper diaries for AYAs with cancer. AYAs are extremely comfortable with technology and may become more fully engaged in their care when they are empowered to track symptoms in a manner that resonates with them. AYA may prefer eDiaries to report sensitive information. In one study, adolescents reported more sexual behavior using a computer assessment compared with paper forms [50]. Thus, the use of electronic data collection may lead to more accurate and complete symptom profiles. Data collected electronically are date and time stamped to assure temporal accuracy. In contrast, reports of back filling (ie, entering data at a later date) and even forward filling (ie, entering data for future dates) of pen and paper diaries exist [51]. Electronic diaries place minimal burden on patients and clinicians can be alerted to serious concerns in real-time. In addition, eDiaries have the potential for seamless integration with web portals and electronic health records for in-depth evaluation and dissemination.

    Currently our team is further evaluating the psychometrics of the mOST application. In this study, patients complete the eDiary daily over a 3-week course. On day 8 of the study they complete a series of symptom questionnaires and a quality of life measure (ie, the Pediatric Quality of Life Inventory) using a 1-week recall. Their daily eDiary responses during the first week will be compared to their recall of events reported on the symptom measures. Once the validity and reliability of the instrument are established, we plan to incorporate it into mHealth symptom intervention studies among AYA patients with cancer.

    Although the use of mobile phones in research is considered an expensive endeavor, older models of phones are often available free of charge or for nominal fees. Mobile phone use among young people has been prevalent for many years and the age for acquiring smartphones is rapidly decreasing [52]. Mobile technology developers are often able to design applications that are device and platform agnostic and can be used on most phones. Thus researchers and clinicians can offer symptom assessment tools for use on patients’ own devices for very little cost. In addition, direct data entry from mobile devices eliminates the potential costs of data entry and validation by staff.

    The limitations of this study need to be acknowledged. These limitations include the use of a convenience sample of only 10 patients and a relatively short trial period of 21 days. The patients received a relatively high incentive of up to $71 for their participation in the study, an acceptable practice in the United States considering the patients’ 3-week commitment to the study, but not standard in all countries [53]. In 2002, Institutional Review Board members were surveyed to determine their recommendations for pediatric incentives in research. The maximum allowed payment to children varied widely from $10-$1000, with a median of $100 [54]. The incentives in our study may have promoted improved adherence with daily reporting. The evaluation of the impact of study incentives on patient adherence is an appropriate subject for future investigation, along with the investigation of non-monetary interventions to promote prolonged engagement with technology. Despite these limitations, to our knowledge, this study is the first evaluation of an eDiary on mobile phones for AYAs with cancer. The 21st century is an age in which technology is expected to revolutionize the collection of patient-reported outcomes and that may lead to important improvements in symptom management.

    Acknowledgments

    We would like to thank the patients and their families who helped assisted in this project and the clinic and inpatient staff who supported us in many ways.

    This work was supported by a grant from the National Institute of Nursing Research (1P30NR011934-01, PI: Miaskowski) and an American Cancer Society Institutional Research Grant Program. Dr. Baggott is funded by an American Cancer Society Mentored Research Scholar Award (MRSG 12-01-PCSM). Dr. Miaskowski is funded by an American Cancer Society as a Clinical Research Professor.

    Conflicts of Interest

    Mr. Richard Kletter and Dr. Paul Zeltzer developed the software for GoMed Solutions, and thus declare a potential conflict of interest.

    ‎

    Multimedia Appendix 1

    mOST screen shots.

    PDF File (Adobe PDF File), 193KB
    1. Collins JJ, Byrnes ME, Dunkel IJ, Lapin J, Nadel T, Thaler HT, et al. The measurement of symptoms in children with cancer. J Pain Symptom Manage 2000 May;19(5):363-377. [Medline]
    2. Yeh CH, Chiang YC, Chien LC, Lin L, Yang CP, Chuang HL. Symptom clustering in older Taiwanese children with cancer. Oncol Nurs Forum 2008 Mar;35(2):273-281. [CrossRef] [Medline]
    3. Tseng, TH, Cleeland, CS, Wang, XS, Lin, CC. Assessing cancer symptoms in adolescents with cancer using the Taiwanese version of the M. D. Anderson Symptom Inventory. Cancer Nurs 2008;31(3):E9-16. [Medline]
    4. Baggott C, Dodd M, Kennedy C, Marina N, Matthay KK, Cooper BA, et al. Changes in children's reports of symptom occurrence and severity during a course of myelosuppressive chemotherapy. J Pediatr Oncol Nurs 2010;27(6):307-315. [CrossRef] [Medline]
    5. Woodgate RL, Degner LF. Expectations and beliefs about children's cancer symptoms: perspectives of children with cancer and their families. Oncol Nurs Forum 2003;30(3):479-491. [CrossRef] [Medline]
    6. Baggott CR, Dodd M, Kennedy C, Marina N, Matthay KK, Cooper B, et al. An evaluation of the factors that affect the health-related quality of life of children following myelosuppressive chemotherapy. Support Care Cancer 2011 Mar;19(3):353-361 [FREE Full text] [CrossRef] [Medline]
    7. Moskowitz DS, Young SN. Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology. J Psychiatry Neurosci 2006 Jan;31(1):13-20 [FREE Full text] [Medline]
    8. Walker I, Sigouin C, Sek J, Almonte T, Carruthers J, Chan A, et al. Comparing hand-held computers and paper diaries for haemophilia home therapy: a randomized trial. Haemophilia 2004 Nov;10(6):698-704. [CrossRef] [Medline]
    9. Palermo TM, Valenzuela D, Stork PP. A randomized trial of electronic versus paper pain diaries in children: impact on compliance, accuracy, and acceptability. Pain 2004 Feb;107(3):213-219. [Medline]
    10. Jamison RN, Raymond SA, Levine JG, Slawsby EA, Nedeljkovic SS, Katz NP. Electronic diaries for monitoring chronic pain: 1-year validation study. Pain 2001 Apr;91(3):277-285. [Medline]
    11. Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR. Patient non-compliance with paper diaries. BMJ 2002 May 18;324(7347):1193-1194 [FREE Full text] [Medline]
    12. Burke LE, Sereika SM, Music E, Warziski M, Styn MA, Stone A. Using instrumented paper diaries to document self-monitoring patterns in weight loss. Contemp Clin Trials 2008 Mar;29(2):182-193 [FREE Full text] [CrossRef] [Medline]
    13. Broderick JE, Schwartz JE, Vikingstad G, Pribbernow M, Grossman S, Stone AA. The accuracy of pain and fatigue items across different reporting periods. Pain 2008 Sep 30;139(1):146-157 [FREE Full text] [CrossRef] [Medline]
    14. Dale O, Hagen KB. Despite technical problems personal digital assistants outperform pen and paper when collecting patient diary data. J Clin Epidemiol 2007 Jan;60(1):8-17. [CrossRef] [Medline]
    15. Morren M, van Dulmen S, Ouwerkerk J, Bensing J. Compliance with momentary pain measurement using electronic diaries: a systematic review. Eur J Pain 2009 Apr;13(4):354-365. [CrossRef] [Medline]
    16. Gibson F, Aldiss S, Taylor RM, Maguire R, McCann L, Sage M, et al. Utilization of the Medical Research Council evaluation framework in the development of technology for symptom management: the ASyMS-YG Study. Cancer Nurs 2010;33(5):343-352. [CrossRef] [Medline]
    17. Stinson JN, Petroz GC, Tait G, Feldman BM, Streiner D, McGrath PJ, et al. e-Ouch: usability testing of an electronic chronic pain diary for adolescents with arthritis. Clin J Pain 2006;22(3):295-305. [CrossRef] [Medline]
    18. Stinson JN. Improving the assessment of pediatric chronic pain: harnessing the potential of electronic diaries. Pain Res Manag 2009;14(1):59-64 [FREE Full text] [Medline]
    19. Stinson JN, Stevens BJ, Feldman BM, Streiner D, McGrath PJ, Dupuis A, et al. Construct validity of a multidimensional electronic pain diary for adolescents with arthritis. Pain 2008 Jun;136(3):281-292. [CrossRef] [Medline]
    20. Stinson JN, Petroz GC, Stevens BJ, Feldman BM, Streiner D, McGrath PJ, et al. Working out the kinks: testing the feasibility of an electronic pain diary for adolescents with arthritis. Pain Res Manag 2008;13(5):375-382 [FREE Full text] [Medline]
    21. Broderick JE, Schwartz JE, Schneider S, Stone AA. Can End-of-Day Reports Replace Momentary Assessment of Pain and Fatigue? J Pain 2009;10(3):274-281. [Medline]
    22. Kollmann A, Riedl M, Kastner P, Schreier G, Ludvik B. Feasibility of a mobile phone-based data service for functional insulin treatment of type 1 diabetes mellitus patients. J Med Internet Res 2007;9(5):e36 [FREE Full text] [CrossRef] [Medline]
    23. Hung SH, Tseng HC, Tsai WH, Lin HH, Cheng JH, Chang YM. Care for Asthma via Mobile Phone (CAMP). Stud Health Technol Inform 2007;126:137-143. [Medline]
    24. Gorely T, Marshall SJ, Biddle SJ, Cameron N. The prevalence of leisure time sedentary behaviour and physical activity in adolescent girls: an ecological momentary assessment approach. Int J Pediatr Obes 2007;2(4):227-234. [CrossRef] [Medline]
    25. Dunton GF, Whalen CK, Jamner LD, Floro JN. Mapping the social and physical contexts of physical activity across adolescence using ecological momentary assessment. Ann Behav Med 2007 Oct;34(2):144-153. [CrossRef] [Medline]
    26. Biddle SJ, Gorely T, Marshall SJ, Cameron N. The prevalence of sedentary behavior and physical activity in leisure time: A study of Scottish adolescents using ecological momentary assessment. Prev Med 2009 Feb;48(2):151-155. [CrossRef] [Medline]
    27. Gorely T, Biddle SJ, Marshall SJ, Cameron N. The prevalence of leisure time sedentary behaviour and physical activity in adolescent boys: an ecological momentary assessment approach. Int J Pediatr Obes 2009;4(4):289-298. [CrossRef] [Medline]
    28. Rofey DL, Hull EE, Phillips J, Vogt K, Silk JS, Dahl RE. Utilizing Ecological Momentary Assessment in pediatric obesity to quantify behavior, emotion, and sleep. Obesity (Silver Spring) 2010 Jun;18(6):1270-1272 [FREE Full text] [CrossRef] [Medline]
    29. Dunton GF, Intille SS, Wolch J, Pentz MA. Investigating the impact of a smart growth community on the contexts of children's physical activity using Ecological Momentary Assessment. Health Place 2012 Jan;18(1):76-84. [CrossRef] [Medline]
    30. Dunton GF, Intille SS, Wolch J, Pentz MA. Children's perceptions of physical activity environments captured through ecological momentary assessment: a validation study. Prev Med 2012 Aug;55(2):119-121. [CrossRef] [Medline]
    31. Axelson DA, Bertocci MA, Lewin DS, Trubnick LS, Birmaher B, Williamson DE, et al. Measuring mood and complex behavior in natural environments: use of ecological momentary assessment in pediatric affective disorders. J Child Adolesc Psychopharmacol 2003;13(3):253-266. [CrossRef] [Medline]
    32. Nock MK, Prinstein MJ, Sterba SK. Revealing the form and function of self-injurious thoughts and behaviors: A real-time ecological assessment study among adolescents and young adults. J Abnorm Psychol 2009 Nov;118(4):816-827. [CrossRef] [Medline]
    33. Silk JS, Forbes EE, Whalen DJ, Jakubcak JL, Thompson WK, Ryan ND, et al. Daily emotional dynamics in depressed youth: a cell phone ecological momentary assessment study. J Exp Child Psychol 2011 Oct;110(2):241-257 [FREE Full text] [CrossRef] [Medline]
    34. Forbes EE, Stepp SD, Dahl RE, Ryan ND, Whalen D, Axelson DA, et al. Real-world affect and social context as predictors of treatment response in child and adolescent depression and anxiety: an ecological momentary assessment study. J Child Adolesc Psychopharmacol 2012 Feb;22(1):37-47. [CrossRef] [Medline]
    35. Kashdan TB, Ferssizidis P, Collins RL, Muraven M. Emotion differentiation as resilience against excessive alcohol use: an ecological momentary assessment in underage social drinkers. Psychol Sci 2010 Sep;21(9):1341-1347. [CrossRef] [Medline]
    36. Van Zundert RM, Boogerd EA, Vermulst AA, Engels RC. Nicotine withdrawal symptoms following a quit attempt: an ecological momentary assessment study among adolescents. Nicotine Tob Res 2009 Jun;11(6):722-729. [CrossRef] [Medline]
    37. McGrath PJ, Walco GA, Turk DC, Dworkin RH, Brown MT, Davidson K, PedIMMPACT. Core outcome domains and measures for pediatric acute and chronic/recurrent pain clinical trials: PedIMMPACT recommendations. J Pain 2008 Sep;9(9):771-783. [CrossRef] [Medline]
    38. Bulloch B, Garcia-Filion P, Notricia D, Bryson M, McConahay T. Reliability of the color analog scale: repeatability of scores in traumatic and nontraumatic injuries. Acad Emerg Med 2009 May;16(5):465-469. [CrossRef] [Medline]
    39. Bulloch B, Tenenbein M. Validation of 2 pain scales for use in the pediatric emergency department. Pediatrics 2002 Sep;110(3):e33. [Medline]
    40. de Tovar C, von Baeyer CL, Wood C, Alibeu JP, Houfani M, Arvieux C. Postoperative self-report of pain in children: interscale agreement, response to analgesic, and preference for a faces scale and a visual analogue scale. Pain Res Manag 2010;15(3):163-168 [FREE Full text] [Medline]
    41. Hicks CL, von Baeyer CL, Spafford PA, van Korlaar I, Goodenough B. The Faces Pain Scale-Revised: toward a common metric in pediatric pain measurement. Pain 2001 Aug;93(2):173-183. [Medline]
    42. Tomlinson D, von Baeyer CL, Stinson JN, Sung L. A systematic review of faces scales for the self-report of pain intensity in children. Pediatrics 2010 Nov;126(5):e1168-e1198 [FREE Full text] [CrossRef] [Medline]
    43. Dupuis LL, Taddio A, Kerr EN, Kelly A, MacKeigan L. Development and validation of the pediatric nausea assessment tool for use in children receiving antineoplastic agents. Pharmacotherapy 2006 Sep;26(9):1221-1231. [CrossRef] [Medline]
    44. Mandrell BN, Yang J, Hooke MC, Wang C, Gattuso JS, Hockenberry M, et al. Psychometric and clinical assessment of the 13-item reduced version of the fatigue scale-adolescent instrument. J Pediatr Oncol Nurs 2011;28(5):287-294. [CrossRef] [Medline]
    45. Kushniruk AW, Patel VL. Cognitive and usability engineering methods for the evaluation of clinical information systems. J Biomed Inform 2004 Feb;37(1):56-76. [CrossRef] [Medline]
    46. Hox, J. Multilevel Analysis: Techniques and Applications. Mahwah, NJ: Erlbaum Associates; 2002.
    47. Singer, J. D. and J. B. In: Willett, Applied Longitudinal Data Analysis: Modeling Change and Event Occurence. New York: Oxford University Press; 2003.
    48. Franklin VL, Waller A, Pagliari C, Greene SA. A randomized controlled trial of Sweet Talk, a text-messaging system to support young people with diabetes. Diabet Med 2006 Dec;23(12):1332-1338. [CrossRef] [Medline]
    49. Weitzel JA, Bernhardt JM, Usdan S, Mays D, Glanz K. Using wireless handheld computers and tailored text messaging to reduce negative consequences of drinking alcohol. J Stud Alcohol Drugs 2007 Jul;68(4):534-537. [Medline]
    50. Turner CF, Ku L, Rogers SM, Lindberg LD, Pleck JH, Sonenstein FL. Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 1998 May 8;280(5365):867-873 [FREE Full text] [Medline]
    51. Stone AA, Shiffman S, Schwartz JE, Broderick JE, Hufford MR. Patient compliance with paper and electronic diaries. Control Clin Trials 2003 Apr;24(2):182-199. [Medline]
    52. ComScore Data Mine. 2011. US Smartphone Audience Growth by Age Segment   URL: http://www.comscoredatamine.com/2011/09/u-s-smartphone-audience-growth-by-age-segment/ [accessed 2012-12-08] [WebCite Cache]
    53. Rice M, Broome ME. Incentives for children in research. J Nurs Scholarsh 2004;36(2):167-172. [Medline]
    54. Weise KL, Smith ML, Maschke KJ, Copeland HL. National practices regarding payment to research subjects for participating in pediatric research. Pediatrics 2002 Sep;110(3):577-582. [Medline]

    ‎
    AYA: adolescent and young adult
    CAS: color analog scale
    ED: emergency department
    eDiary: electronic diary
    EMA: ecological momentary assessment
    EOD: end-of-day
    FPS-R: faces pain scale-revised
    mOST: mobile oncology symptom tracker
    PeNAT: pediatric nausea assessment tool
    VAS: visual analog scale

    Edited by G Eysenbach; submitted 15.05.12; peer-reviewed by E Jacob, M Diefenbach; comments to author 09.06.12; revised version received 18.07.12; accepted 04.10.12; published 11.12.12

    Copyright

    ©Christina Baggott, Faith Gibson, Beatriz Coll, Richard Kletter, Paul Zeltzer, Christine Miaskowski. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 11.12.2012.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.