Protocol
Abstract
Background: Predictive theoretical models suggest that health knowledge works in conjunction with motivation and behavioral skills to influence adolescents’ obesogenic behavior. However, most of the existing adolescent interventions target these variables in isolation. Furthermore, health literacy (HL), a precursor to health knowledge, is necessary for translating health knowledge into behavior and is negatively related to adolescents’ obesity status. However, HL has not been included in obesity interventions targeting adolescents.
Objective: This study aims to pilot the feasibility of a 2-armed web-based obesity prevention intervention in school settings and assess the preliminary effectiveness of adding an HL module to an obesity prevention intervention for adolescents.
Methods: This web-based pilot feasibility study will take place in the Northeastern United States. Participants will be adolescents (aged 13-16 years) attending school, and recruitment will be conducted through flyers to parents and adolescents in participating classes or advisory groups at the school. The intervention includes 2 arms: an experimental arm that will receive an HL module and 3 obesity prevention modules and a comparison arm that will receive a vaping module and 3 obesity prevention modules. A blinded randomized procedure will be used to allocate classrooms and advisory groups to the experimental and comparison arms. The intervention will be fully web-based. Participants will complete measures of their HL and obesogenic behavior–related health knowledge, motivation, and behaviors at 3 time points (baseline, 1 month after the intervention, and 3 months after the intervention) via web-based surveys. The primary outcomes will be the measures of study feasibility (recruitment, retention, completion, and treatment fidelity rates). Secondary outcomes will be preliminary efficacy, as measured by logistic and linear regressions and calculation of effect sizes. Descriptive statistics will be calculated for all measures at each time point.
Results: This study was approved by the City University of New York Institutional Review Board in August 2020. As of June 2022, the web-based intervention design is complete and ready for use. Recruitment, data collection, and intervention implementation are scheduled to begin in September 2022. These results are expected to be published in 2023.
Conclusions: This study’s feasibility findings will inform changes to the intervention content and randomized controlled trial design. The study’s efficacy findings will inform the sample size for the full-scale randomized controlled trial and the preliminary utility of the intervention.
Trial Registration: ClinicalTrials.gov NCT04252677; https://clinicaltrials.gov/ct2/show/NCT04252677
International Registered Report Identifier (IRRID): PRR1-10.2196/40191
doi:10.2196/40191
Keywords
Introduction
Background
Children and adolescents are increasingly experiencing obesity-related chronic degenerative diseases, which were once categorized as adult health problems [
]. For example, in the United States, there was a 30.5% increase in type 2 diabetes diagnoses in adolescents from 2001 to 2009 [ ], and more recent data suggest a 7.1% annual increase in diagnoses [ ]. A diagnosis of type 2 diabetes in childhood is related to the risk of kidney, nerve, and eye diseases and an increased risk of renal failure and other life-threatening and life-altering complications in young adulthood [ ]. Similar to type 2 diabetes, other life-threatening adult chronic health issues such as cancer and heart disease are associated with obesity [ - ] and adolescent health behaviors [ ]. Approximately 34% of adolescents in the United States are overweight or obese [ , ]. Furthermore, adolescents’ obesity prevention health behaviors are low: approximately 42% and 41% eat <1 fruit and vegetable daily, respectively, and approximately 77% are physically active for <60 minutes per day [ ]. The prevalence rates of fruit and vegetable consumption and sufficient physical activity (PA) are lower among adolescents with low family income [ ] and those who identify as racial and ethnic minorities [ ]. The prevalence rates of these behaviors must be improved to reduce current and future chronic disease risks in adolescents.There are several obesity prevention interventions targeting determinants of obesogenic behaviors, including adolescents’ social support and motivation [
- ], behavioral skills [ - ], attitudes [ , ], environment [ , , ], and health knowledge [ , ]. However, their impacts on adolescents’ obesogenic behaviors have been mixed. Furthermore, most of these interventions did not address all the aforementioned determinants in a single study design. Single determinant–focused interventions likely underestimate the role of individual-context interrelationships, the interrelatedness of the determinants, and the role of adolescent developmental attributes in health decision-making. Importantly, individuals’ decision-making is complex as multiple determinants of health behaviors are either deliberately or unintentionally integrated during the decision-making process. Therefore, although adolescents may prefer or lean in on certain types of information and determinants, interventions targeting adolescents’ obesity prevention behaviors should integrate multiple determinants, including knowledge and skills, and incorporate the impact of developmental characteristics and contextual influences on long-term change.This intervention borrows elements from 3 existing interventions that address multiple determinants in a single design: New Moves [
, ], Go Girls! [ ], and the Dutch Obesity Intervention in Teenagers (DOiT) [ ]. The school-based New Moves intervention aimed to improve adolescents’ diet- and PA-related knowledge, attitudes, beliefs, skills, and self-efficacy, as well as provide strategies for improving social support [ , ]. The community-based Go Girls! intervention aimed to improve knowledge, self-efficacy, social support, motivation, and behavioral skills for healthy eating and PA [ ]. The school-based DOiT intervention aimed to increase adolescents’ knowledge, awareness, behavioral skills, social support, habits, and self-efficacy regarding energy intake and output [ , ]. All 3 studies reported significant postintervention improvements in obesogenic-related behaviors.These studies included activities that could be adapted for a web-based platform and provided a strong basis for our intervention. However, similar to other adolescent obesity prevention interventions, the New Moves, Go Girls!, and DOiT interventions do not include building adolescents’ general skills for transferring knowledge into behavior (ie, health literacy [HL]). HL “entails people’s knowledge, motivation and competences to access, understand, appraise, and apply health information in order to make judgments and make decisions in everyday life concerning health care, disease prevention and health promotion to maintain or improve quality of life during the life course” [
]. In adults, HL is positively related to engagement in preventive health behaviors, the interpretation of health messages, and medical adherence [ - ]. Although HL is understudied in adolescents, existing research links HL to adolescents’ health behaviors [ ] and health decision-making [ , ]. We hypothesize that the inclusion of correlates of health decision-making in health behavior interventions during a critical transitional time to health decision-making independence for adolescents may significantly improve intervention outcomes. To the best of our knowledge, the direct impact of HL on adolescent health behavior change interventions has not yet been examined.Objectives
The findings of this pilot study and future full-scale randomized controlled trial (RCT) will inform the inclusion of HL in health behavior interventions for adolescents and the inclusion of HL in the health education curriculum for adolescents. Furthermore, given its digital format, this intervention may easily be disseminated in schools as part of the adolescents’ health curriculum. The main goal of this study is to develop and preliminarily evaluate a web-based obesity prevention intervention for adolescents with and without HL. This study distinguishes between HL and health knowledge; these 2 concepts tend to be inaccurately substituted in some research literature. However, HL is a precursor to health knowledge [
]; that is, HL is the skill needed to access, understand, and use health information for specific behaviors. Despite this, HL is understudied and rarely addressed in health behavior interventions. This study seeks to fill this gap. Aim 1 of this study is to modify and use successful components of existing obesity interventions in an interactive web-based platform with an added-on HL component. Aim 2 of this study is a 2-arm randomized clinical trial of the adapted web-based obesity prevention intervention for adolescents with and without an HL component. The purpose of this pilot RCT is to determine the feasibility and preliminary effectiveness of the intervention in informing the full-scale RCT. Specifically, the primary objectives of this study are to (1) assess the acceptability of the intervention for adolescents; (2) determine the elements of the intervention with the highest adolescent engagement; and (3) determine the suitability and appropriateness of the intervention modality and implementation in school settings by examining the recruitment, retention, completion, and fidelity rates. The secondary objectives of this study are to measure the preliminary efficacy of the intervention to improve obesogenic behaviors and HL and collect data to calculate effect sizes and power analyses to inform the sample size needed for the full-scale RCT to determine whether adding an HL component to a web-based obesity prevention intervention improves adolescents’ obesity prevention behaviors more than an obesity prevention intervention alone.Methods
Trial Design
The trial design elements are reported to be consistent with the CONSORT (Consolidated Standards for Reporting Trials) guidance for pilot and feasibility studies (
) [ ] and the CONSORT-EHEALTH (Consolidated Standards for Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth; ) [ ]. This study is a parallel randomized controlled pilot trial and feasibility study with 1:1 classroom allocation to 2 study arms (experimental and comparison groups). shows the outline of the study flow.Participants
A total of 76 adolescents aged between 13 and 16 years attending high school in Boston, Massachusetts, United States, will be recruited for the study. The other inclusion criterion is parental permission to participate. Adolescents who are already participating in interventions related to healthy eating, PA, and obesity prevention or treatment or who have medical conditions that prevent them from engaging in PA or require adherence to extremely restricted diets (eg, ketogenic diet) will be excluded from the study. The proposed sample distribution for the study is at least 30 male and 30 female adolescents so that comparisons can be made across sexes, given the difference in obesogenic behaviors based on sex. In addition, 80% of the sample is expected to come from racial and ethnic minority groups, given that the study will be conducted in a multiethnic geographic location and school setting.
Recruitment and Consent
Responsive survey design methodology [
] will be used to ensure that the proposed sample is recruited. Specifically, we will monitor participant enrollment and establish timelines for changing or adding recruitment strategies to ensure that the proposed sample is recruited. In responsive survey design methodology, the least costly recruitment strategy is used first, and more expensive and time-consuming strategies are used to augment the inexpensive strategies to enroll hard-to-recruit participants. For the first phase of recruitment, school administrators will give study flyers to students and email them to parents of students in participating classes. The emailed flyers will include a Qualtrics link (Qualtrics) for parents to access the web-based parent permission form and a brief demographic survey. Parents will select yes or no to indicate whether they agree for their adolescent to participate in the study. The class or advisory group with the highest rate of returned parent forms (regardless of whether permission was granted or denied) will receive a class prize (eg, donation to the class field trip fund) at the end of the first 2 weeks of the recruitment period. The characteristics of the enrolled participants will be monitored to determine progress in recruiting the desired sample with regard to sex and racial and ethnic minority status. At the 2-week time point during phase 1 recruitment, the second phase of recruitment will be initiated in an attempt to achieve the desired sample. In phase 2, adolescents whose parents did not complete the permission form on the web will be given a study flyer with a QR code for parents to access the Qualtrics link. A paper permission form, demographic survey, and an empty envelope will also be attached to the flyer. Parents who complete the paper permission form will be asked to put it in the envelope, seal the envelope, and have their adolescents return the envelope to their teacher. At each phase of recruitment, teachers will also make announcements about the study in class, encouraging students to have their parents complete the permission forms. Recruitment will end 2 weeks after the initiation of phase 2 recruitment. The class with the highest increase in returned consent forms at the end of the second phase of recruitment will be incentivized with a class prize (eg, donations to their class trip and dance). The phase 1 recruitment strategy will be ongoing throughout the 4 weeks of recruitment as parents will be sent weekly reminder emails to complete the permission form and demographic survey. These procedures are consistent with several national studies (eg, the National Survey of Family Growth [ , ] and the National Survey of College Graduates [ ]). Active monitoring of participant enrollment will occur throughout the 4 weeks of study recruitment and enrollment. To ensure that participation is voluntary and not coerced, incentives will be attached to the return of consent forms rather than study enrollment. All recruitment and consent materials will be available in English, Spanish, and Haitian Creole to accommodate Haitian Creole–speaking and Spanish-speaking parents with limited English language proficiency. Adolescent assent will be obtained on the web before data collection on the first page of the web-based survey. Adolescents who select no to assent will be exited out of the survey, and those who select yes will be able to see the survey. It should be noted that parental permission and adolescent assent are specific to the data collection related to the study. Adolescents who do not assent or obtain parental permission will still be required by their teachers to participate in the intervention as part of their class curriculum but will not complete surveys.Intervention
Both study arms will receive 3 obesity prevention modules. However, the first study arm (ie, the comparison group) will also receive 1 module on vaping, whereas the second study arm (ie, the experimental group) will receive a module on HL. Obesity prevention modules will be administered after the vaping and HL modules. The intervention modules will be delivered using a web-based platform. The platform allows for a mix of didactic strategies, including informational videos, interactive practice activities and games, and self-assessments. Responses to assessments, activities, and games will be used to provide tailored feedback and reports. The intervention will be fully web based.
presents the objectives of the intervention modules, lesson objectives, and sample activities. It should be noted that all content was developed by the author and her team, and the content is hosted using the Dynamic e-Learning Platform, a web-based platform developed by the 3C Institute [ ], which uses a mix of didactic instructions with self-assessments, demonstration videos, and interactive practice activities to apply learned skills.Modules or lessons | Objectives | Activities | |
Introduction | N/Ab | N/A | |
Goal planning | To guide adolescents as they make one eating and one physical activity goal that is specific, measurable, attainable, relevant, and time based |
| |
Getting the Skills Down module (HLc; experimental group only) | To improve adolescents’ functional, interactive, critical, and media HL | N/A | |
Lesson 1: Reading Labels (functional HL) | To demonstrate how to read and use nutrition and medicine labels |
| |
Lesson 2: Talking to Other People About Health (interactive HL) | To provide and reinforce skills for gathering health information from others and discussing health concerns with others, including friends, family, and health care providers |
| |
Lesson 3: Choosing Good Sources for Health Information (media HL) | To equip adolescents with skills to evaluate sources of information for reliability, accuracy, and intent and teach adolescents how to use multiple sources of information in health decision-making |
| |
Lesson 4: Using Health Information to Help Yourself and Others (critical HL) | To provide and reinforce skills for applying health information to improve personal and community health, educate adolescents about the role of social determinants of health in health decision-making, and provide suggestions on how to advocate for others |
| |
Getting the Truth module (vaping; comparison group only) | To improve adolescents’ knowledge of the effects of vaping and provide strategies for preventing and seeking help when vaping is implicated | N/A | |
Lesson 1: Vaping Devices and Vaping | To explain what vaping is, how vapes work, and the effect of vaping on the body |
| |
Lesson 2: Beliefs and Attitudes about Nicotine Products | To challenge common beliefs and attitudes about nicotine products and vaping specifically |
| |
Lesson 3: Refusing and Avoiding Vaping | To suggest strategies for refusing offers to vape and avoiding situations where friends vape |
| |
Lesson 4: Recognizing Addiction and Getting Help | To provide tips on how to recognize when oneself or a peer is addicted to vaping and how to get help |
| |
Getting the Facts Straight module | To improve adolescents’ health knowledge about obesity prevention, healthy eating, physical activity, and sedentary behavior | N/A | |
Lesson 1: The Facts about Healthy Eating | To improve and reinforce adolescents’ knowledge about what is required in a healthy diet and how to distinguish between healthy and unhealthy foods |
| |
Lesson 2: The Facts about Physical Activity | To inform adolescents about the recommendations for different types of physical activity and what is considered physical activity |
| |
Lesson 3: Eating, Exercise, and Mood | To help adolescents recognize the connections between their eating, physical activity, and mood and provide proactive strategies to ensure that mood is not negatively affected by poor eating and activity choices |
| |
Getting the Mind Ready module | To improve adolescents’ personal and social motivations for engaging in obesity prevention behaviors | N/A | |
Lesson 1: What Motivates You? | To encourage adolescents to think about what may motivate them to engage in healthy eating and physical activity and provide opportunities for self-reflection on what motivates adolescents |
| |
Lesson 2: Social Support | To describe how people in adolescents’ lives can support their health goals and provide strategies for identifying and using sources of social support |
| |
Lesson 3: You Can Do This! | To provide adolescents with practical strategies for staying motivated |
| |
Get Going module | To address socioeconomic (and other) barriers to preventive health by reinforcing doable behavioral skills within the socioeconomic constraints experienced by adolescents | N/A | |
Lesson 1: Setting Yourself Up to Make Healthy Choices | To provide adolescents with skills for making healthy eating and physical activity choices from the options available to them |
| |
Lesson 2: Using the 3 Rs to Make Healthy Choices | To explain how adolescents may use the 3 Rs (replace, reduce, and remove) when making decisions about healthy eating and physical activity |
| |
Lesson 3: Practice Making Healthy Choices | To practice knowledge and skills learned throughout the 3 obesity modules in the intervention |
|
aTailored feedback was provided based on adolescents’ responses to the activities and questions throughout the intervention.
bN/A: not applicable.
cHL: health literacy.
dFITT: frequency, intensity, type, and time.
eSMART: Specific, Measurable, Achievable, Relevant, and Time-bound.
This intervention is informed by the relational developmental systems framework, the Information-Motivation-Behavioral Skills (IMB) model, adolescents’ inputs, and prior studies. The relational developmental systems framework, which is a developmental science framework, centers on the mutually influential relationships between individuals and contexts, as well as the plasticity of the relationships as the individual or context changes [
]. Research that applies a relational developmental systems framework seeks to answer what important characteristics of individuals (eg, motivation, autonomy, health identity, health knowledge, and HL), among individuals of what status (eg, adolescents and low income), and in relation to what elements of the context (eg, family, peers, and neighborhood) are likely to be associated with what aspects of adaptive functioning (eg, healthy eating and PA). As such, this intervention is designed to account for and intervene in the mutually influential relationship of adolescents’ individual and developmental characteristics, social determinants of health, health knowledge, and HL on health behaviors. The relational developmental systems framework is complementary to the more predictive IMB model [ ]. The IMB model includes 3 critical determinants of the performance of health behaviors: health-related information (facts and beliefs), motivation (personal attitudes and social support), and behavioral skills (objective skills and confidence in performing the behavior). Information and motivation support behavioral skills that influence behavior ( , arrows a-c). However, information and motivation may directly affect behavior when only basic skills are required ( , arrows d-e). Health behaviors ultimately predict health outcomes ( , arrow f).The relational developmental systems framework was used to determine the variables that were explored in the IMB model. Given that the health-related information and behavioral skills constructs in the IMB model are specific to health behavior and that HL is a precursor to health knowledge [
] and likely independently influences motivation, behavioral skills, and behavior, HL was included as a separate construct in the model (dashed lines in ). We expect HL to directly predict information, motivation, behavioral skills, and health behaviors ( , arrows g-j) and indirectly predict health behaviors through information (g→d and g→a→c), motivation (j→e and j→b→c), and behavioral skills (i→c). Therefore, improvements are expected in the experimental conditions for all variables in the model compared with the comparison group.Regarding specific content, initial focus groups with adolescents informed the initial content of the HL modules, whereas prior obesity prevention intervention studies informed the content for the obesity prevention modules. In a preintervention development study by the author, adolescents participated in multiple focus groups where they described how they viewed HL, how they knew they were using HL, and what type of HL skills they felt they lacked [
, ]. Analyses of adolescents’ responses resulted in the development of the IMB model for the use of HL in health decision-making in adolescents [ ]. The conceptual underpinnings of the IMB model for the use of HL in health decision-making in adolescents and specific focus group findings were used to determine which key features of HL should be included in the intervention and how to present the content in a way that matches the context in which adolescents view themselves as engaging in HL. The obesity prevention modules were informed by the successful components of New Moves [ , ], Go Girls! [ ], and DOiT [ ].Regarding acceptability and usability, adolescents participated in cognitive interviews while completing the HL and behavior skills modules. This was done before building out the other modules of the intervention. The feedback provided on the HL and behavior skills modules was used to revise the modules and was applied to the development of the remaining intervention modules.
For this feasibility study, all adolescents in the participating classes or advisory group will access the intervention on school computers during their homeroom or advisory periods. The intervention will be provided in lieu of class activities and will be solely web based. Specifically, teachers will only be involved in instructing adolescents to log into the web-based platform, and all other activities of the intervention will occur via the web-based platform. Adolescents will complete 1 lesson per homeroom or advisory period with 1 to 2 lessons per week, depending on their class schedule. The intervention website includes a contact us button so that students can report any concerns or comments. This will be closely monitored by research staff, who will work to resolve issues as quickly as possible.
Outcomes
Primary Feasibility Outcome Measures
According to Bowen et al [
], the assessment of study feasibility involves answering 3 main questions across 8 key areas of focus. Although Bowen et al [ ] suggested asking whether it can work, does work, and will work, this feasibility study mostly focused on the first 2 questions (whether it can work and does work). The third question (whether it will work) is better aligned with the activities of a full-scale RCT. provides a further explanation of the 8 areas of focus, as they relate to this study.Feasibility as applied to this study.
Acceptability: satisfaction, suitability, and attractiveness of the intervention
- Can it work?: In the prepilot activities, qualitative feedback on session components was solicited and used to modify the intervention for suitability and attractiveness.
- Does it work?: The pilot intervention will assess recruitment, completion, retention, and treatment fidelity rates as measures of satisfaction, suitability, and attractiveness of intervention.
Demand: likeliness of using the intervention
- Can it work?: In the prepilot activities, adolescents’ risk and protective factors for obesogenic behaviors were considered in intervention development to ensure that the skills reinforced in the intervention would be generalizable across settings.
- Does it work?: The longitudinal study design will provide preliminary data on the retention of skills learned in the intervention. Web analytic data collected during the intervention (eg, time spent on modules and resources accessed through intervention) will determine the likeliness of using the intervention.
Implementation: successful delivery
- Can it work?: In the prepilot activities, participants were observed engaging with intervention content, and their comments were used to make content and stylistic changes to improve the utility and likelihood of prolonged engagement with the content.
- Does it work?: A pre-post follow-up design allows for the determination of the 3-month success rate of the intervention in changing obesity-related knowledge, motivation, and behavior. Participants’ progress on goals will also be a marker of success.
Practicality: deliver intervention within confines of current resources
- Can it work?: Participants’ usability observations and intervention evaluations will be used to assess feasibility, with participants serving as key informants.
- Does it work?: Postmodule evaluations will provide data to inform the next steps to improve the reach and effectiveness of the intervention (eg, need for tangible support such as fitness videos and fresh food boxes). Cost analyses will be conducted.
Expansion: expand to provide new service
- Can it work and does it work?: For future project goals and next steps, a randomized controlled trial with a representative sample powered to detect significant changes should be implemented. Future projects should also expand to include language and other cultural adaptations for specific groups (eg, Mexican, Haitian, and Dominican).
Limited efficacy: potential for success in a controlled environment
- Does it work?: The pilot design allows for assessing the potential for success in a controlled environment and calculation of effect size to develop larger efficacy trials.
Adaptation: implementation in new population
- Can it work and does it work?: For future project goals and next steps, the effectiveness of intervention in other settings (eg, libraries) need to be assessed, and feasibility and effectiveness in different populations after cultural and language modifications need to be evaluated.
Integration: successful integration into existing settings
- Can it work and does it work?: For future project goals and implications, the intervention should be integrated into schools and community organizations, and the sustainability in its current form must be monitored.
Secondary and Preliminary Efficacy Outcome Measures
Participants’ demographics (eg, age, sex, gender, family income, race, ethnicity, and grades) and other characteristics (eg, home and neighborhood environment characteristics) will be collected at baseline. Secondary measures will be collected at each time point and will serve as measures of the preliminary efficacy of the intervention.
outlines the secondary measures used in this study.Measure | Topics assessed | Psychometric properties |
Dietary screener questionnaire | Healthy and unhealthy food consumption | Good convergence with 24-hour dietary recalls [ | ]
National Youth Physical Activity and Nutrition Study | Healthy and unhealthy food consumption | Validity and reliability established [ | , ]
Youth activity profile | Physical and sedentary activity | Cross-validated with objective measures of physical activity and resulted in similar group estimates acquired from objective measures [ | ]
Godin and Shephard Leisure-Time Physical Activity Questionnaire | Metabolic equivalents for leisure time physical activity | Validity and reliability established [ | ]
Newest vital signs | Functional health literacy | Cronbach α=.76; criterion validity r=0.59 [ | ]
Assessments of adolescent health literacy | Functional, interactive, and critical health literacy | Wright sample-independent reliability ≥0.80; good convergent and criterion validity [ | ]
Adolescent media health literacy scales | Media health literacy | Wright sample-independent reliability ≥0.80; good convergent and criterion validity [ | ]
Electronic Health Literacy | Digital health literacy | Cronbach α=.88 [ | ]
Canadian Assessment of Physical Literacy (modified for the study) | Physical activity knowledge | Validity and reliability established across multiple groups [ | ]
General Nutrition Questionnaire for Adults (modified for the study) | Healthy eating knowledge | Cronbach α≥.70; good construct validity [ | ]
Regulation of Eating Behaviors Scale (modified for the study) | Healthy eating attitudes | Cronbach α≥.79; good construct validity [ | ]
Psychosocial constructs for adolescent fruit and vegetables and dietary fat intake | Social motivation for healthy and unhealthy eating; diet-related self-efficacy | Cronbach α≥.61 [ | ]
Psychosocial constructs for adolescent physical activity and sedentary behavior | Social motivation for physical and sedentary activity; physical activity self-efficacy | Cronbach α≥.67 [ | ]
aAll measures will be administered at baseline, posttest, and 3-month follow-up time points.
Data Collection
Data collection will be completed on the web using the Qualtrics survey platform. After a team member verbally explains the assent form, adolescents will be provided with a link where the first page will include the written assent form. After providing assent, adolescents will be routed to the survey. For the posttest and follow-up measures, adolescents will complete surveys 1 month and 3 months after the completion of the intervention. Similar to the baseline, data collection will be completed on the web using the Qualtrics survey platform.
Adolescents will be randomly selected to complete qualitative interviews at the end of the intervention to gather feedback on usability, acceptability, and suggestions for changes. All data collection will be performed while the adolescents are in school. Data files and other electronic study records will be stored in password-protected folders on a restricted-use server. Identifiable information will be kept separate from survey data; identifiable information will be deleted after the 3-month follow-up data collection is complete, and the data will be linked to the 2 other time points. Paper study materials will be scanned, and the scanned files will be stored in the same way as the electronic data. The paper study materials will be shredded after they are scanned.
Sample Size
The sample size was based on power calculations computed using the preliminary data. Preliminary data suggested that a sample of 60 participants (30 per group) would be sufficient. We plan to enroll and randomize 76 participants to allow a 20% dropout rate at the 3-month follow-up. The sample size is sufficient to calculate feasibility metrics and preliminary efficacy and inform future power calculations for a more complex full-scale RCT.
Randomization and Blinding
Sequence Generation
Classrooms and advisory groups will be randomly assigned to the experimental and comparison groups, with 2 classrooms and advisory groups per condition. Simple randomization will be performed using a random number computer program. Specifically, a blinded research team member who is not involved in providing assent and has no knowledge of the students in the classes and advisory groups will assign each classroom and advisory group a number from 1 to 4, and then, a computerized random number generator will be used to assign the classroom and advisory group to the conditions.
Allocation Concealment Mechanism
Randomization and intervention condition allocation will occur after the assent and baseline measure data collection. This information will be communicated to the teachers so that they are aware of the content that the adolescents will receive. It is not possible to conceal allocation to adolescents as it will be obvious whether they received the HL or vaping modules.
Blinding
Participants will not be explicitly made aware of whether they are in the experimental or comparison group. However, it is not possible to blind them to their condition as the experimental condition is obvious.
Statistical Methods
Data Analysis
Regarding the metrics mentioned in
, the recruitment rate will be assessed by calculating the percentage of adolescents enrolled in the study from the pool of adolescents approached for participation. The completion rate will be assessed by calculating the percentage of adolescents who complete the intervention from those who enroll. Retention rates will be assessed by calculating the percentage of participants who complete all elements of the study (intervention and data collection) compared with the number of participants who enroll. Treatment fidelity will be assessed using web analytics data gathered during the intervention. The median time spent on each intervention task will be calculated, and participants who spend <3 median absolute deviations below the median will be assumed to have not engaged with the content enough to be fully exposed to the treatment. Treatment fidelity percentages will be calculated based on users meeting a priori thresholds. On the basis of intervention research in adolescents [ - ], the conservative acceptable targets are as follows: recruitment=50%, completion=70%, retention=50%, and treatment fidelity=80%. Descriptive and content analyses will be conducted for quantitative and qualitative evaluation data, respectively.Descriptive analyses will be calculated for all variables in
. The 2 study groups will be compared in terms of baseline variables to assess whether a balance was achieved through randomization. Changes in continuous outcome variables from the pretest time point to 3 months will be compared between groups using linear regression, adjusted for sex and any potential confounders that are found to be unbalanced between groups at baseline. Binary outcome variables (outcome improved vs not improved) will be compared between groups using logistic regression, adjusted for sex and any potential confounders that are found to be unbalanced between groups at baseline. For each outcome, we will also analyze the time points together in the same model using linear and logistic mixed-effects models with random subject-specific intercepts and slopes. This will permit the analysis of all participants, including those who drop out. Mixed models can accommodate missingness at random.Group differences in the change in metabolic equivalents and number of fruits and vegetables, as well as the SDs of the changes in each group, will be used to calculate the sample size for the full-scale RCT.
Power
This study is powered based on fruit and vegetable consumption and PA outcomes. Assuming 30 participants per group, an independent-sample 2-sided t test, within-subject correlation of 0.5, and α=.025, there will be 80% power to detect a difference between groups on the change in the metabolic equivalents (PA) and fruit and vegetable consumption from the pretest time point to the 3-month follow-up of whether the true difference is 0.8 (PA) or 1.2 (fruits and vegetables) SDs or larger (ie, effect size 0.8). These calculations are based on preliminary data [
]. The data used in this study will be used to perform the power calculations.Ethics Approval and Consent to Participate
All study procedures were approved by the City University of New York Institutional Review Board (2020-0575-PHHP) and will be conducted in accordance with the approved application. Data will only be used from participants with signed parent permission forms and who will assent to participate.
Results
The study has received institutional review board approval. Recruitment for the trial has not yet begun. Data collection is expected to begin in September 2022. The results are expected to be submitted for publication in an updated manuscript in June 2023. Feasibility and primary efficacy results will be reported according to the CONSORT guidelines [
] after the 3-month follow-up data are collected and analyzed.Discussion
Principal Findings
Interventions to improve adolescents’ health behaviors have yielded mixed results, and HL may be a key missing element in improving the efficacy and effectiveness of existing interventions. However, to the best of our knowledge, this is the first intervention study to test the utility of adding HL to health behavior interventions for adolescents. The findings of this study will inform the inclusion of HL as an intervention component, as well as the extent to which the principles of HL and adolescents’ HL levels are considered in interventions designed for adolescents. Furthermore, the use of a digital platform (rather than in person) to implement the intervention is novel, and this study will provide evidence and preliminary data for using digital platforms for HL interventions. This is critical as interventions using digital platforms extend the reach and use of the intervention modules, as geography, personnel, and time constraints minimally affect implementation.
As an intervention similar to this one has not been conducted before, the range of feasibility constructs assessed in this pilot RCT will determine the optimal procedures for the full-scale RCT, as well as the dissemination of the intervention beyond the full-scale RCT. The information gathered from the feasibility constructs will also inform how other similar research questions are addressed in similar settings. For example, a digital intervention on adolescent substance use prevention and HL may use a similar methodology. Obtaining objective fidelity measures provides useful data on what might work in the intervention format beyond the subjective evaluation tools.
Limitations
A strength of this pilot and feasibility study is the inclusion of outcome measures to facilitate power calculations for a full-scale RCT. However, the small sample size means that preliminary efficacy is mostly useful for calculating RCT sample needs rather than making strong inferences about the utility of the intervention. Another limitation of this study is the use of schools. Schools are an isolated portion of the adolescent population as they exclude adolescents who may be homeschooled or out of school for other reasons. These excluded adolescents may have different HL, health behavior change needs, and access to resources; therefore, the efficacy and effectiveness of the intervention for these adolescents cannot be determined from this study. Furthermore, blinding could not be implemented. This may affect the results as adolescents in different conditions may discuss and compare what they are doing in their conditions, and this can lead to information seeking and knowledge acquisition, which conflates the findings.
Conclusions
This study is the first step toward addressing the HL needs of adolescents within the context of health behavior interventions. The findings of this study could inform the design and content of future health behavior interventions designed for adolescents.
Acknowledgments
The author would like to acknowledge the support of her research team who provided feedback on the intervention components. The author would also like to acknowledge the many adolescents who willingly participated in the focus groups and provided feedback on the intervention components. The author is grateful for the support of the schools that agreed to participate in this study without reservation.
This project was funded by the National Institutes of Health (grant numbers 1R21DK117345, 1K12HD092535, and L30DK126209). The funders had no influence on the intervention content and will not influence the interpretation of the results.
Data Availability
Data sharing is not applicable to this paper, as no data sets will be generated or analyzed during the study.
Authors' Contributions
This study was designed by SAF, and all manuscript drafts and revisions were completed by SAF.
Conflicts of Interest
None declared.
CONSORT (Consolidated Standards for Reporting Trials) 2010 extension for pilot and feasibility trials checklist.
PDF File (Adobe PDF File), 241 KB
CONSORT-eHEALTH (Consolidated Standards for Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth) checklist (V 1.6.1).
PDF File (Adobe PDF File), 1304 KB
Peer review by the Center for Scientific Review Special Emphasis Panel - Small Grants for New Investigators to Promote Diversity in Health-Related Research (National Institutes of Health, USA).
PDF File (Adobe PDF File), 124 KBReferences
- Gordon-Larsen P, Nelson MC, Popkin BM. Longitudinal physical activity and sedentary behavior trends: adolescence to adulthood. Am J Prev Med 2004 Nov;27(4):277-283. [CrossRef] [Medline]
- Dabelea D, Mayer-Davis EJ, Saydah S, Imperatore G, Linder B, Divers J, SEARCH for Diabetes in Youth Study. Prevalence of type 1 and type 2 diabetes among children and adolescents from 2001 to 2009. JAMA 2014 May 07;311(17):1778-1786 [FREE Full text] [CrossRef] [Medline]
- Mayer-Davis EJ, Lawrence JM, Dabelea D, Divers J, Isom S, Dolan L, SEARCH for Diabetes in Youth Study. Incidence trends of type 1 and type 2 diabetes among youths, 2002-2012. N Engl J Med 2017 Apr 13;376(15):1419-1429 [FREE Full text] [CrossRef] [Medline]
- Dean H, Flett B. Natural history of type 2 diabetes diagnosed in childhood: long term follow-up in young adult years. Diabetes 2002 Jun 1;51:A24-A25.
- Juonala M, Magnussen CG, Berenson GS, Venn A, Burns TL, Sabin MA, et al. Childhood adiposity, adult adiposity, and cardiovascular risk factors. N Engl J Med 2011 Nov 17;365(20):1876-1885. [CrossRef] [Medline]
- Tirosh A, Shai I, Afek A, Dubnov-Raz G, Ayalon N, Gordon B, et al. Adolescent BMI trajectory and risk of diabetes versus coronary disease. N Engl J Med 2011 Apr 07;364(14):1315-1325 [FREE Full text] [CrossRef] [Medline]
- Fuemmeler BF, Pendzich MK, Tercyak KP. Weight, dietary behavior, and physical activity in childhood and adolescence: implications for adult cancer risk. Obes Facts 2009;2(3):179-186 [FREE Full text] [CrossRef] [Medline]
- Halfon N, Verhoef PA, Kuo AA. Childhood antecedents to adult cardiovascular disease. Pediatr Rev 2012 Mar;33(2):51-61. [CrossRef] [Medline]
- Ogden CL, Carroll MD, Kit BK, Flegal KM. Prevalence of obesity and trends in body mass index among US children and adolescents, 1999-2010. JAMA 2012 Mar 01;307(5):483-490 [FREE Full text] [CrossRef] [Medline]
- Ogden CL, Carroll MD, Kit BK, Flegal KM. Prevalence of childhood and adult obesity in the United States, 2011-2012. JAMA 2014 Mar 26;311(8):806-814 [FREE Full text] [CrossRef] [Medline]
- Merlo CL, Jones SE, Michael SL, Chen TJ, Sliwa SA, Lee SH, et al. Dietary and physical activity behaviors among high school students - youth risk behavior survey, United States, 2019. MMWR Suppl 2020 Aug 21;69(1):64-76 [FREE Full text] [CrossRef] [Medline]
- Watts AW, Mason SM, Loth K, Larson N, Neumark-Sztainer D. Socioeconomic differences in overweight and weight-related behaviors across adolescence and young adulthood: 10-year longitudinal findings from Project EAT. Prev Med 2016 Jun;87:194-199 [FREE Full text] [CrossRef] [Medline]
- Kann L, McManus T, Harris WA, Shanklin SL, Flint KH, Queen B, et al. Youth risk behavior surveillance - United States, 2017. MMWR Surveill Summ 2018 Jun 15;67(8):1-114 [FREE Full text] [CrossRef] [Medline]
- Smith JJ, Morgan PJ, Plotnikoff RC, Dally KA, Salmon J, Okely AD, et al. Rationale and study protocol for the 'active teen leaders avoiding screen-time' (ATLAS) group randomized controlled trial: an obesity prevention intervention for adolescent boys from schools in low-income communities. Contemp Clin Trials 2014 Jan;37(1):106-119. [CrossRef] [Medline]
- Singh AS, Chin A Paw MJ, Kremers SP, Visscher TL, Brug J, van Mechelen W. Design of the Dutch Obesity Intervention in Teenagers (NRG-DOiT): systematic development, implementation and evaluation of a school-based intervention aimed at the prevention of excessive weight gain in adolescents. BMC Public Health 2006 Dec 16;6:304 [FREE Full text] [CrossRef] [Medline]
- Resnicow K, Yaroch AL, Davis A, Wang DT, Carter S, Slaughter L, et al. GO GIRLS!: results from a nutrition and physical activity program for low-income, overweight African American adolescent females. Health Educ Behav 2000 Oct;27(5):616-631 [FREE Full text] [CrossRef] [Medline]
- Neumark-Sztainer DR, Friend SE, Flattum CF, Hannan PJ, Story MT, Bauer KW, et al. New moves-preventing weight-related problems in adolescent girls a group-randomized study. Am J Prev Med 2010 Nov;39(5):421-432 [FREE Full text] [CrossRef] [Medline]
- Spruijt-Metz D, Nguyen-Michel ST, Goran MI, Chou CP, Huang TT. Reducing sedentary behavior in minority girls via a theory-based, tailored classroom media intervention. Int J Pediatr Obes 2008;3(4):240-248 [FREE Full text] [CrossRef] [Medline]
- Sallis JF, McKenzie TL, Conway TL, Elder JP, Prochaska JJ, Brown M, et al. Environmental interventions for eating and physical activity: a randomized controlled trial in middle schools. Am J Prev Med 2003 Apr;24(3):209-217. [CrossRef] [Medline]
- Luepker RV, Perry CL, McKinlay SM, Nader PR, Parcel GS, Stone EJ, et al. Outcomes of a field trial to improve children's dietary patterns and physical activity. The Child and Adolescent Trial for Cardiovascular Health. CATCH collaborative group. JAMA 1996 Mar 13;275(10):768-776. [CrossRef] [Medline]
- Neumark-Sztainer D, Story M, Hannan PJ, Rex J. New Moves: a school-based obesity prevention program for adolescent girls. Prev Med 2003 Jul;37(1):41-51. [CrossRef] [Medline]
- Singh AS, Chin A Paw MJ, Brug J, van Mechelen W. Dutch obesity intervention in teenagers: effectiveness of a school-based program on body composition and behavior. Arch Pediatr Adolesc Med 2009 Apr;163(4):309-317. [CrossRef] [Medline]
- Sørensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, (HLS-EU) Consortium Health Literacy Project European. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health 2012 Jan 25;12:80 [FREE Full text] [CrossRef] [Medline]
- Aaby A, Friis K, Christensen B, Rowlands G, Maindal HT. Health literacy is associated with health behaviour and self-reported health: a large population-based study in individuals with cardiovascular disease. Eur J Prev Cardiol 2017 Nov;24(17):1880-1888 [FREE Full text] [CrossRef] [Medline]
- Miller TA. Health literacy and adherence to medical treatment in chronic and acute illness: a meta-analysis. Patient Educ Couns 2016 Jul;99(7):1079-1086 [FREE Full text] [CrossRef] [Medline]
- Zhang NJ, Terry A, McHorney CA. Impact of health literacy on medication adherence: a systematic review and meta-analysis. Ann Pharmacother 2014 Jun;48(6):741-751. [CrossRef] [Medline]
- White RO, Chakkalakal RJ, Presley CA, Bian A, Schildcrout JS, Wallston KA, et al. Perceptions of provider communication among vulnerable patients with diabetes: influences of medical mistrust and health literacy. J Health Commun 2016;21(sup2):127-134 [FREE Full text] [CrossRef] [Medline]
- Yin HS, Dreyer BP, Vivar KL, MacFarland S, van Schaick L, Mendelsohn AL. Perceived barriers to care and attitudes towards shared decision-making among low socioeconomic status parents: role of health literacy. Acad Pediatr 2012;12(2):117-124 [FREE Full text] [CrossRef] [Medline]
- Fleary SA, Joseph P, Pappagianopoulos JE. Adolescent health literacy and health behaviors: a systematic review. J Adolesc 2018 Jan;62:116-127. [CrossRef] [Medline]
- Fleary SA, Joseph P. Adolescents' health literacy and decision-making: a qualitative study. Am J Health Behav 2020 Jul 01;44(4):392-408 [FREE Full text] [CrossRef] [Medline]
- Joseph P, Fleary AS. "The way you interpret health": adolescent definitions and perceptions of health literacy. J Sch Health 2021 Aug;91(8):599-607. [CrossRef] [Medline]
- Baker DW, Gazmararian JA, Williams MV, Scott T, Parker RM, Green D, et al. Functional health literacy and the risk of hospital admission among Medicare managed care enrollees. Am J Public Health 2002 Aug;92(8):1278-1283. [CrossRef] [Medline]
- Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, PAFS consensus group. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. BMJ 2016 Oct 24;355:i5239 [FREE Full text] [CrossRef] [Medline]
- Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011 Dec 31;13(4):e126 [FREE Full text] [CrossRef] [Medline]
- Tourangeau R, Michael Brick J, Lohr S, Li J. Adaptive and responsive survey designs: a review and assessment. J R Stat Soc A 2016 Mar 10;180(1):203-223 [FREE Full text] [CrossRef]
- Wagner J, West BT, Kirgis N, Lepkowski JM, Axinn WG, Ndiaye SK. Use of paradata in a responsive design framework to manage a field data collection. J Off Stat 2012;28(4):477-499 [FREE Full text]
- Kirgis NG, Lepkowski JM. Design and management strategies for paradata-driven responsive design: illustrations from the 2006–2010 national survey of family growth. In: Kreuter F, editor. Improving Surveys with Paradata: Analytic Uses of Process Information. Hoboken, NJ, USA: Wiley Online Library; 2010:121-144.
- Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, et al. How we design feasibility studies. Am J Prev Med 2009 May;36(5):452-457 [FREE Full text] [CrossRef] [Medline]
- Research-based products and services for behavioral health. 3C Institute. URL: https://www.3cisd.com [accessed 2022-06-22]
- Lerner RM, Schmid Callina K. Relational developmental systems theories and the ecological validity of experimental designs. Human Dev 2014 Jan 30;56(6):372-380 [FREE Full text] [CrossRef]
- Fisher WA, Fisher JD, Harman J. The information-motivation-behavioral skills model: a general social psychological approach to understanding and promoting health behavior. In: Suls J, Wallston KA, editors. Social Psychological Foundations of Health and Illness. Hoboken, NJ, USA: Wiley Online Library; 2003:82-106.
- Dietary Screener Questionnaire in the NHANES 2009-10: Background. National Cancer Institute Epidemiological and Genomics Research Program. 2015. URL: https://epi.grants.cancer.gov/nhanes/dietscreen/ [accessed 2020-11-20]
- 2010 National Youth Physical Activity and Nutrition. Centers for Disease Control and Prevention. 2010 Nov 30. URL: https://www.cdc.gov/healthyyouth/data/yrbs/nypans.htm [accessed 2020-07-20]
- Eaton DK, Olsen EO, Brener ND, Scanlon KS, Kim SA, Demissie Z, et al. A comparison of fruit and vegetable intake estimates from three survey question sets to estimates from 24-hour dietary recall interviews. J Acad Nutr Diet 2013 Sep;113(9):1165-1174 [FREE Full text] [CrossRef] [Medline]
- Saint-Maurice PF, Kim Y, Hibbing P, Oh AY, Perna FM, Welk GJ. Calibration and validation of the youth activity profile: the FLASHE study. Am J Prev Med 2017 Jun;52(6):880-887 [FREE Full text] [CrossRef] [Medline]
- Godin G. The Godin-Shephard leisure-time physical activity questionnaire. Health Fit J Can 2011;4(1):18-22 [FREE Full text] [CrossRef]
- Weiss BD, Mays MZ, Martz W, Castro KM, DeWalt DA, Pignone MP, et al. Quick assessment of literacy in primary care: the newest vital sign. Ann Fam Med 2005;3(6):514-522 [FREE Full text] [CrossRef] [Medline]
- Fleary SA, Freund KM, Nigg CR. Development and validation of assessments of adolescent health literacy: a Rasch measurement model approach. BMC Public Health 2022 Mar 25;22(1):585 [FREE Full text] [CrossRef] [Medline]
- Fleary SA. Development and validation of the adolescent media health literacy scales: Rasch measurement model approach. JMIR Pediatr Parent 2022 Apr 15;5(2):e35067 [FREE Full text] [CrossRef] [Medline]
- Norman CD, Skinner HA. eHEALS: the eHealth literacy scale. J Med Internet Res 2006 Nov 14;8(4):e27 [FREE Full text] [CrossRef] [Medline]
- The Canadian Assessment of Physical Literacy - Second Edition. Healthy Active Living and Obesity Research Group. 2017. URL: https://www.capl-eclp.ca/ [accessed 2020-07-30]
- Parmenter K, Wardle J. Development of a general nutrition knowledge questionnaire for adults. Eur J Clin Nutr 1999 Apr;53(4):298-308. [CrossRef] [Medline]
- Pelletier LG, Dion S, Lévesque C. Can self-determination help protect women against sociocultural influences about body image and reduce their risk of experiencing bulimic symptoms. J Soc Clin Psychol 2004 Feb;23(1):61-88. [CrossRef]
- Hagler AS, Norman GJ, Radick LR, Calfas KJ, Sallis JF. Comparability and reliability of paper- and computer-based measures of psychosocial constructs for adolescent fruit and vegetable and dietary fat intake. J Am Diet Assoc 2005 Nov;105(11):1758-1764. [CrossRef] [Medline]
- Norman GJ, Sallis JF, Gaskins R. Comparability and reliability of paper- and computer-based measures of psychosocial constructs for adolescent physical activity and sedentary behaviors. Res Q Exerc Sport 2005 Sep;76(3):315-323. [CrossRef] [Medline]
- Peralta LR, Jones RA, Okely AD. Promoting healthy lifestyles among adolescent boys: the Fitness Improvement and Lifestyle Awareness Program RCT. Prev Med 2009 Jun;48(6):537-542. [CrossRef] [Medline]
- Maynard M, Baker G, Harding S. Exploring childhood obesity prevention among diverse ethnic groups in schools and places of worship: recruitment, acceptability and feasibility of data collection and intervention components. Prev Med Rep 2017 Feb 24;6:130-136 [FREE Full text] [CrossRef] [Medline]
- Wilson AJ, Jung ME, Cramp A, Simatovic J, Prapavessis H, Clarson C. Effects of a group-based exercise and self-regulatory intervention on obese adolescents' physical activity, social cognitions, body composition and strength: a randomized feasibility study. J Health Psychol 2012 Nov;17(8):1223-1237. [CrossRef] [Medline]
- Fleary SA, Joseph P, Chang H. Applying the information-motivation-behavioral skills model to explain adolescents' fruits and vegetables consumption. Appetite 2020 Apr 01;147:104546 [FREE Full text] [CrossRef] [Medline]
Abbreviations
CONSORT: Consolidated Standards for Reporting Trials |
CONSORT-EHEALTH: Consolidated Standards for Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth |
DOiT: Dutch Obesity Intervention in Teenagers |
HL: health literacy |
IMB: Information-Motivation-Behavioral Skills |
PA: physical activity |
RCT: randomized controlled trial |
Edited by T Leung; This paper was peer reviewed by the Center for Scientific Review Special Emphasis Panel - Small Grants for New Investigators to Promote Diversity in Health-Related Research (National Institutes of Health, USA). See the Multimedia Appendices for the peer-review report; submitted 09.06.22; accepted 24.06.22; published 16.08.22
Copyright©Sasha A Fleary. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 16.08.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.