Published on in Vol 13 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/55613, first published .
Digital Gamification Tool (Let’s Control Flu) to Increase Vaccination Coverage Rates: Proposal for Algorithm Development

Digital Gamification Tool (Let’s Control Flu) to Increase Vaccination Coverage Rates: Proposal for Algorithm Development

Digital Gamification Tool (Let’s Control Flu) to Increase Vaccination Coverage Rates: Proposal for Algorithm Development

Proposal

1NOVA Center for Global Health, NOVA Information Management School, Universidade Nova de Lisboa, Lisbon, Portugal

2Department of International Health, Care and Public Health Research Institute, Faculty of Health, Medicine and Life Sciences, Maastricht University, Maastricht, Netherlands

3Department of Health Policy and Management, Harvard T.H. Chan School of Public Health, Harvard University, Boston, MA, United States

Corresponding Author:

Henrique Lopes, PhD

NOVA Center for Global Health

NOVA Information Management School

Universidade Nova de Lisboa

Campus de Campolide

Lisbon, 1070-312

Portugal

Phone: 351 962499020

Email: hlopes@novaims.unl.pt


Background: Influenza represents a critical public health challenge, disproportionately affecting at-risk populations, including older adults and those with chronic conditions, often compounded by socioeconomic factors. Innovative strategies, such as gamification, are essential for augmenting risk communication and community engagement efforts to address this threat.

Objective: This study aims to introduce the “Let’s Control Flu” (LCF) tool, a gamified, interactive platform aimed at simulating the impact of various public health policies (PHPs) on influenza vaccination coverage rates and health outcomes. The tool aligns with the World Health Organization’s goal of achieving a 75% influenza vaccination rate by 2030, facilitating strategic decision-making to enhance vaccination uptake.

Methods: The LCF tool integrates a selection of 13 PHPs from an initial set proposed in another study, targeting specific population groups to evaluate 7 key health outcomes. A prioritization mechanism accounts for societal resistance and the synergistic effects of PHPs, projecting the potential policy impacts from 2022 to 2031. This methodology enables users to assess how PHPs could influence public health strategies within distinct target groups.

Results: The LCF project began in February 2021 and is scheduled to end in December 2024. The model creation phase and its application to the pilot country, Sweden, took place between May 2021 and May 2023, with subsequent application to other European countries. The pilot phase demonstrated the tool’s potential, indicating a promising increase in the national influenza vaccination coverage rate, with uniform improvements across all targeted demographic groups. These initial findings highlight the tool’s capacity to model the effects of PHPs on improving vaccination rates and mitigating the health impact of influenza.

Conclusions: By incorporating gamification into the analysis of PHPs, the LCF tool offers an innovative and accessible approach to supporting health decision makers and patient advocacy groups. It enhances the comprehension of policy impacts, promoting more effective influenza prevention and control strategies. This paper underscores the critical need for adaptable and engaging tools in PHP planning and implementation.

International Registered Report Identifier (IRRID): RR1-10.2196/55613

JMIR Res Protoc 2024;13:e55613

doi:10.2196/55613

Keywords



Influenza Epidemiology and Public Health Impact

Influenza is an infectious respiratory disease caused by an airborne virus. There are 4 identified types of influenza viruses, with types A and B being responsible for most of the seasonal influenza epidemics that occur annually [1,2]. The influenza virus can cause mild to severe disease, with risk groups (older people, pregnant women, young children, and individuals with chronic health conditions and autoimmune diseases) being more susceptible to severe forms of the disease [1].

The World Health Organization (WHO) estimates that annual influenza epidemics result in approximately 1 billion infections, 3 to 5 million cases of severe illness, and between 290 and 650,000 deaths [3]. The severity of influenza depends on multiple factors, including the virulence of the virus strain and the level of preexisting immunity in the population [1]. Influenza is also responsible for the worsening of previous health conditions in the individual and has consequences on different domains of individual health [4], such as cardiovascular [5], neurological, renal, respiratory, and diabetic complications.

However, despite the large number of respiratory infections worldwide, it is difficult to estimate the proportion of hospitalizations attributable to influenza across countries or over time [6]. During influenza outbreaks, health systems experience increased demand for services due to an influx of patients seeking medical care. This surge in patient demand can strain health care resources, including hospital beds, medical staff, and supplies [7]. As a result, the pressure on health systems during influenza outbreaks has an impact on access to care for other patients who require medical attention for non–influenza-related conditions, especially those at risk for complications [8].

Another study, published in 2023, which carried out a meta-analysis to improve understanding of the estimates of hospitalizations associated with influenza, concluded that seasonal influenza epidemics result in 3.2 million hospitalizations per year globally [9]. A study that evaluated 10 influenza seasons (between 2008 and 2018) in Portugal to estimate the clinical and economic costs of influenza reported that, on average, hospitalizations due to influenza were 11.6 cases per 100,000 inhabitants [10].

Vaccination for Influenza Prevention

Vaccination against influenza began in the early 1940s, marking a considerable advancement in public health with the introduction of trivalent vaccines [11]. This approach evolved, and in 2012, quadrivalent vaccines were introduced [11], offering broader protection against the influenza virus. The WHO is currently deliberating on the possibility of returning to trivalent vaccines [12], showcasing the ongoing evolution and reassessment of strategies to combat influenza. The effectiveness of the influenza vaccine, which varies between 40% and 60% in the general population, depends on various factors, including patient characteristics such as age and underlying health conditions, as well as the match between the circulating influenza viruses and the seasonal influenza vaccination administered [13].

Recognizing influenza as a considerable global public health challenge, the WHO has advocated for annual influenza vaccination as the most effective measure to combat the influenza. Priority is notably given to older population groups, who face an increased risk of severe influenza disease. However, the effectiveness of influenza vaccinations in these groups is compromised by immune senescence, leading to diminished antibody responses. In response, higher-dose influenza antigen vaccines have been developed, enhancing the immune response and proving to be more effective in preventing influenza infections [14], hospitalizations, and reducing mortality rates [15] compared with standard-dose vaccines.

This targeted approach to vaccination aligns with the WHO’s Global Influenza Strategy 2019 to 2030 [16], which recommends a goal of increasing vaccination coverage rates (VCRs) for influenza to 75% by 2030, a goal also echoed by the European Union (EU) in a 2009 Council Recommendation [17]. This 75% target applies especially to older adults, extending as well to other high-risk groups, including persons with chronic conditions and health workers, advocating for comprehensive coverage to mitigate the impact of influenza. Despite concerted efforts, reaching this target has been challenging; as of 2018, influenza vaccination coverage among people aged ≥65 years was <50% in most EU countries, averaging only 39% across these nations and indicating that no country had yet met the 75% coverage target [18].

VCRs are crucially impacted by social inequalities, including financial, cultural, and linguistic barriers [19,20]. Evidence from a broad range of studies highlights this correlation, pointing out a concerning lack of data on VCRs among specific susceptible groups in various countries. The situation is further complicated by the interaction between multimorbidity and social exclusion, creating a vicious cycle where social inequality exacerbates health disparities, thereby deepening social vulnerabilities [21-23]. This interconnection between social determinants and health outcomes underscores the necessity of addressing these challenges holistically to enhance VCRs and strengthen the global response to influenza.

In this context, health management strategies implemented by health and governance authorities, alongside other health decision makers, are pivotal. Public health policies (PHPs) play a key role in managing potential risks by preempting and mitigating their impacts. Vaccination-related PHPs exemplify this approach effectively; by fostering immunity within the community, they not only reduce the likelihood of disease transmission but also ensure that any infections are less severe. This diminishes the demand for hospitalization and decreases mortality risk. Such policies, therefore, are not merely preventive measures but also crucial interventions that address the root causes of health inequities, aiming to break the cycle of multimorbidity and social exclusion by ensuring equitable access to vaccination and health care services.

Gamification Strategies in Public Health

In the realm of scenario planning and policy development, traditional methodologies have steadily evolved to incorporate advanced technological capabilities, facilitating a more integrated and dynamic approach to learning and assessment. The advent of gamification, defined as the integration of game design elements in nongaming contexts to bolster engagement [24], represents a substantial leap forward in this evolution.

At its core, gamification uses game design elements in nongaming scenarios to augment engagement levels. As delineated in the study by Brangier and Marache-Francisco [25], the gamification design process is anchored in the principles of human-computer interaction, underscoring the importance of user-centric design and interaction. This approach to gamification has gained traction across various sectors, including education, health care, marketing, and human resources, evidencing its versatility and widespread applicability.

However, a substantial fraction of gamification initiatives stumble, primarily due to flawed design strategies. This underscores the criticality of a well-articulated design process, attuned to the nuances of user engagement and interaction dynamics. Moreover, the aspect of measurement emerges as a pivotal consideration in gamification, advocating for a dynamic approach toward redesigning gamified experiences through real-time feedback and user data analytics. However, the adoption of metrics as a quantification tool remains inconsistently applied across gamification frameworks, highlighting an area ripe for further exploration and standardization [24].

The application of gamification in educational contexts, particularly for fostering sustainable behaviors, stands out as a promising approach. Despite existing knowledge gaps, empirical evidence attests to the efficacy of gamification in elevating motivation, engagement, and satisfaction among learners. This enhanced learning environment, in turn, cultivates a fertile ground for the dissemination of sustainability principles and other educational content, demonstrating the transformative potential of gamification as a methodological tool in learning scenarios [26].

These advancements have rendered the simultaneous quantitative and qualitative modeling of policies affecting various facets of the health system and wider society not only feasible but also widely accessible. This confluence of technology and methodology paves the way for an enriched understanding and assessment of policies through sophisticated simulations that blend numerical data with narrative contexts, thereby facilitating a holistic view of potential outcomes and impacts.

Despite this growing interest in the integration of game-like elements into learning scenarios, especially within the health sector, focused design frameworks for health education through gamification remain underdeveloped. This area presents a unique opportunity for pioneering health-specific frameworks that emphasize prototyping, experimentation, measurement, and continuous iteration. Such frameworks are crucial for refining gamification strategies to ensure their effectiveness and relevance in the use of gamification in the health sector [27].

Adopting gamification in PHP decision-making introduces a complex landscape of ethical implications that warrant careful consideration. Despite its potential to enhance public health initiatives by promoting behavior change and increasing engagement being considerable, it also raises concerns regarding data privacy, and informed consent.

Data privacy emerges as a critical concern, as gamification strategies often rely on collecting and analyzing personal health information to personalize interventions and track progress. The ethical management of this data is paramount. According to the study by Mittelstadt et al [28], ensuring data protection and privacy in digital health interventions requires robust encryption methods and transparent data handling policies. Without stringent safeguards, there is a risk of unauthorized access to sensitive information, potentially leading to misuse.

Informed consent is another cornerstone of ethical considerations in gamification. Participants must be fully aware of how their data will be used, the nature of the gamified intervention, and its potential risks and benefits. As Thaler and Sunstein [29] argue in “Nudge,” while gamification can guide behavior in beneficial ways, it must not manipulate or coerce participants. Ensuring that consent is informed and voluntary preserves autonomy and respects individual decision-making.

Gamification can oversimplify complex policy issues if interpreted verbatim without critical thinking. Especially if used as a game of health policy–related challenges and not a way of rehearsing ideas, there is a risk of reducing nuanced issues to overly simplistic solutions. This oversimplification can lead to misinterpretations and misapplications of policy measures, potentially undermining the effectiveness of interventions and disregarding the intricacies of health outcomes. In addition, given that gamification strategies often use rewards, incentives, and competition to drive behavior, its use in health-related contexts may impact individuals’ autonomy and decision-making if it is not framed in critical thinking. Therefore, in the development of this tool, under no circumstances does the individual receive any form of retribution for use or performance.

The “Let’s Control Flu” Tool

In the intricate balance between ethical considerations and the exploratory potential of gamification, the “Let’s Control Flu” (LCF) tool emerges as a digital, interactive tool designed to support policy decision-making specific to influenza. The LCF tool aims to help enhance VCRs and fulfill the objectives outlined in the WHO’s Global Influenza Strategy 2019 to 2030. Rooted in the qualitative framework suggested in the study by Kassianos et al [30], this project seeks to align VCR achievements with the benchmarks established by the WHO and the Council of Europe. The LCF tool demystifies the creation of epidemiological scenarios, eliminating the need for users to possess in-depth knowledge of epidemiological modeling techniques or to engage with complex data sets, such as extensive statistical series. This user-friendly approach facilitates a more accessible and informed decision-making process for policy makers striving to combat influenza through increased vaccination uptake.

The LCF tool innovatively applies gamification principles to assist stakeholders in understanding the nuances of different PHPs regarding influenza vaccination. It achieves this by providing a simulated environment where users can experiment with various policy scenarios, thus offering insights into the potential impact on VCRs before their implementation. This simulation enables stakeholders to grasp the intricacies, trade-offs, and consequences of their policy decisions, fostering a deeper understanding and facilitating more informed choices about the PHPs to be adopted and executed. The engaging and interactive presentation of information within the LCF tool simplifies the comprehension of policy impacts, encouraging decisions backed by data-driven insights.

The limitations sector of this paper acknowledges the constraints and challenges faced by the LCF tool. Despite its innovative approach and initial success, the tool’s effectiveness and applicability are subject to ongoing evaluation and refinement. Originally piloted in Sweden, the LCF tool’s application has proven successful, marking an important first step in its practical use. Following this initial implementation, efforts are underway to broaden the tool’s application across 3 additional European countries. This expansion is aimed at enhancing the tool’s robustness and increasing its relevance across different geographic contexts, thereby contributing valuable insights to the global effort to improve influenza vaccination coverage through informed policy making.


Overview

The development of the tool was underpinned by an integrated epidemiological model, encapsulating the burden of influenza disease alongside the predictive impacts of selected PHPs on targeted populations. Initial steps in tool development involved a critical reduction in the number of policies under consideration: on the basis of the foundational work by Kassianos et al [30], the scope was narrowed from 42 to 13 policies, spanning across the 5 pillars identified in their research (Multimedia Appendix 1). This refinement was necessitated by the current state of knowledge, which does not allow for a discrete modeling of the effects attributable to each of the 42 PHPs initially proposed. Consequently, a strategy was used to merge closely related PHPs into coherent bundles, maintaining the original pillar-based categorization to ensure methodological orthogonality.

To ascertain the robustness and reliability of the model, we used a rigorous selection criterion for the scientific literature included in our analysis. Detailed in Textboxes 1 and 2, the inclusion and exclusion criteria were designed to encompass only the most pertinent and high-quality studies. In adherence to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, we executed a systematic and comprehensive literature review. The PRISMA flowchart (Figure 1) delineates our methodical approach to the selection of publications, underscoring the scrutiny at each phase of article identification, screening, and inclusion. It is pertinent to note the exclusion of data from 2021 and 2022 to mitigate the confounding effects of the COVID-19 pandemic on the influenza landscape [31].

Textbox 1. Inclusion criteria for scientific works included in the model.

Inclusion criteria

  • Only pre-post intervention or controlled studies were included, enabling the effects of the policy to be effectively assessed independently of any background (and potentially not described) policies already in place.
  • Studies were included whenever they contained data on one or more of the populations of interest for the model (children, health professionals; pregnant women; older adults, including adults aged ≥65 years and adults aged between 50 and 64 years; and high-risk patients).
  • Studies reporting seasonal vaccination uptake were included, as opposed to pandemic influenza vaccination. This restriction was placed to ensure comparability of studies used to inform the model (ie, avoid pooling data for seasonal and pandemic influenza, as the coverage may not be comparable).
Textbox 2. Exclusion criteria for scientific works included in the model.

Exclusion criteria

  • Reviews were not included.
  • Articles in any other language than English.
Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flowchart of systematic literature review process. TLR: targeted literature review.

The interventions delineated in the included studies were meticulously aligned with the PHP categories identified in the study by Kassianos et al [30]. To ensure the validity and accuracy of the model construction, a National Advisory Board (NAB) comprising 4 eminent epidemiologists and public health experts from the Swedish health system was constituted. The board’s formation was predicated on their prior contributions to scientific literature and health authority reports over the last decade, ensuring their expertise was both relevant and current. The NAB was instrumental in the validation process, meticulously verifying the model-generated values and endorsing the results. This process was crucial, particularly in instances where the scientific literature did not provide ecologically valid data to substantiate the selection of proxies necessary for the tool’s development.

Public Health Policies

The set of 13 PHPs incorporated into the LCF model maintained the original categorization into 5 pillars proposed by Kassianos et al [30], each targeting different aspects of public health to enhance vaccination rates and mitigate the health impacts of influenza.

Pillar 1: Health Authority Accountability and Strengthening the Influenza Program

VCRs targets set at national and regional levels for recommended population: To boost influenza vaccination rates [32], policies set targets at national and regional levels for specific population groups [33]. In Sweden, eg, this policy was implemented nationwide. Strategies programs [34-36] include educating individuals about vaccine benefits, improving vaccine accessibility, and offering incentives for vaccination, all aimed at increasing vaccine uptake.

Funding of influenza vaccinations for all recommended groups: To enhance influenza vaccine access, reduce the burden of disease, and prevent influenza-related deaths, immunization programs [37-41], intervention campaigns, and strategies [32,42-50] can be created. In addition, funds may be allocated to cover the cost of influenza shots for vulnerable groups, such as older adults, children, health care workers, and individuals with underlying health conditions. By doing so, public health officials improve vaccine accessibility and safeguard those with a higher risk of flu complications.

Nationwide regular monitoring of patient VCR at vaccination site and at health care professional (HCP) level by health authorities: Regular tracking of vaccine uptake in designated health facilities such as clinics, hospitals, and pharmacies [51,52] allows for monitoring immunization program effectiveness and identifying areas of improvement. By monitoring immunization coverage rates, public health authorities can use data to enhance programs and achieve desired health outcomes for the population.

HCP VCR as part of performance criteria in hospitals: Boosting vaccine uptake among health care workers and minimizing disease transmission through vaccination. This policy mandates that health worker immunization coverage rates be used as a performance criterion in health care facilities, including hospitals and primary care settings [53]. It encourages health care workers to get vaccinated, prioritizing their well-being and minimizing disease spread among patients, thereby fostering a safer and healthier environment for all.

Sustainable procurement system to ensure appropriate vaccine supply: Ensuring consistent and reliable availability of necessary vaccines for all individuals in need [54], irrespective of their location or financial circumstances. This policy aims to establish a procurement system that effectively manages vaccine acquisition, storage, and distribution to health units, considering cost, quality, and sustainability factors.

Pillar 2: Facilitated Access to Vaccination

Access to multiple vaccination settings: Enhancing vaccine access and reducing barriers to vaccination ensures that individuals can receive vaccines in various locations, including hospitals [48,53,55-57], clinics [36,58], pharmacies [39,59-62], schools [43,52,63-70], and other settings [46,71]. By doing this, public health authorities increase convenience and improve the chances of individuals getting vaccinated.

Call-to-action communications to target groups by multiple stakeholders: This policy targets influenza-related stakeholders, including public health agencies, health professionals, schools, and community organizations. Various methods such as email [69,70,72-74], SMS text messages [75-81], phone calls, health apps, and others [49,82] are used to remind target groups about the importance of vaccination. The objective is to boost vaccine uptake by reminding individuals in target groups of vaccination’s significance and encouraging them to get vaccinated [83-86].

HCP pop-up notification or SMS text message to population to vaccinate eligible patients: Health care providers use pop-up notifications or SMS text messages to remind eligible patients of the importance of vaccination and encourage them to get vaccinated [84,85,87-89], thus increasing vaccine uptake.

Pillar 3: HCP Accountability and Engagement

Regular HCP education and training: This policy ensures HCPs, including doctors, nurses, and other professionals, receive ongoing education and updates on new technologies, medical advancements, and changes in vaccination practices [33,34,48,65,77,87-94]. Its objective is to equip HCPs with the necessary knowledge and skills to deliver safe, effective, and high-quality care to patients.

Fair and specific HCP compensation per vaccination: Establishing a system where health professionals receive fair compensation for administering vaccines [95]. This aims to incentivize HCPs to administer vaccines and ensure they are adequately rewarded for their time and efforts. Fair compensation not only supports HCPs but also encourages their dedication to protecting public health.

Mandatory HCP vaccination: Mandating or strongly recommending that health care workers receive specific vaccines as part of their job [35,36,53,96-106]. This policy aims to safeguard public health by minimizing the transmission of communicable diseases in health care settings such as clinics or hospitals, particularly to patients with weakened immune systems. By requiring or strongly recommending vaccination for HCPs, the policy aims to prevent them from being carriers of diseases that could be transmitted to their patients.

Pillar 4: Awareness of the Burden and Severity of the Disease

Coordinated multistakeholder awareness and communication campaigns: This policy promotes immunization through collaboration and coordination among various stakeholders, including government agencies, hospitals and other health organizations [33,34,46,47,52,57,68-71,77,83,86-89,91,97,105, 107-110], health professionals [32,41,42,58,65,72,111,112], community organizations, schools, and universities [43,113], as well as the media [105,114]. Its goal is to deliver a cohesive message about the importance of immunization, reaching a wide audience with information on the benefits of immunization and how to access it. By addressing concerns, dispelling misinformation, and creating a supportive environment [115,116], the policy aims to enhance vaccine uptake.

Pillar 5: Belief in Influenza Vaccination Benefits

Positive media coverage of vaccines: The policy promotes a positive approach to vaccine promotion, highlighting the benefits of vaccination and countering negative or misleading information. It aims to foster a vaccine-friendly environment by showcasing the safety, efficacy, and importance of vaccines through various media channels, such as news articles, public service announcements, and other media content [41]. The policy’s purpose is to boost vaccine uptake by offering accurate information, debunking myths, and empowering the public to make informed decisions about vaccination.

Model Design

The model categorizes the population into 6 age groups—12 to 14, 15 to 34, 35 to 49, 50 to 64, and >65 years—and identifies 5 key target groups: children (aged 0-14 years), older adults (aged >65 years), health professionals, pregnant women, and high-risk patients (aged 15-64 years with ≥1 chronic condition). This segmentation acknowledges the critical challenge of chronic undervaccination in high-risk patients, which poses substantial barriers to achieving optimal health outcomes and protection against influenza and its complications [117].

To assess the impact of PHPs on these target groups, the model simulates 7 health outcomes over a 10-year horizon (2022-2031), including influenza infections averted, hospitalizations averted, influenza-related general practitioner visits averted, workdays lost (productivity impact), influenza-related deaths averted, hospitalizations averted due to cardiovascular complications, and deaths averted due to cardiovascular complications. These outcomes are evaluated both across the total population and within each target group, providing a comprehensive overview of PHP effectiveness in mitigating influenza-related morbidity and mortality.

In the development of the epidemiological model, weights were assigned to each policy across different target groups and specified time frames using a multifaceted approach. This methodology enabled a rigorous, evidence-based evaluation of PHPs’ impact on VCRs, accounting for the variability and complexity of policy effects across different demographic and risk groups. It encompassed the following:

  1. Policy effects derived from the literature: weights were calculated as weighted averages for each policy and target group based on a comprehensive review of the existing literature. This approach ensures that the model’s parameters are grounded in empirical evidence, reflecting the documented effects of PHPs on VCRs.
  2. Imputation from similar policies or different target groups: in instances of incomplete data for a specific policy within a target group, weights were imputed based on the relative effects of the most analogous policies available. Alternatively, effects documented for the same policy in different target groups were adjusted and applied, facilitating a coherent extrapolation of policy impacts.
  3. Projected increases for subsequent years: for policy effects lacking data beyond the first year, a conservative projection was applied, assuming a 10% increase in the second year and a 20% increase for the third year onward. This assumption is based on the initial year’s effect, providing a structured approach to model the temporal dynamics of policy impacts.
  4. Integration of expert opinions: insights and recommendations were solicited from the NAB to inform the weighting process, particularly in areas where empirical data were sparse or ambiguous. This inclusion of expert judgment ensures that the model remains adaptable and relevant to current public health contexts, incorporating the nuanced understanding of seasoned professionals in the field.

When policy effects were extrapolated from the literature, the inherent challenges associated with integrating qualitative findings directly into quantitative models led to the necessity of generating temporary proxies to bridge the gap between qualitative insights and the quantitative demands of the model. This process was initiated with comprehensive discussions within the scientific coordination team of the project, after which the proposed proxies underwent a rigorous phase of deliberation and validation by the NAB, ensuring that the proxies accurately reflect the intended policy effects. The final step in this process involved the validation of the proxies by the project’s external scientific adviser, who evaluated their suitability and alignment with the model’s objectives and the underlying empirical evidence. This layered approach to proxy generation and validation ensured the model’s integrity and the reliability of its projections, accommodating instances where direct quantitative data had been lacking.

In scenarios where explicit data concerning the uncertainty of parameters was unavailable, our approach entailed the adjustment of these parameters through the application of suitable statistical distributions, premised on an SE estimated at 10% of the base-case value. This procedure was designed to embed a quantifiable measure of uncertainty into the model, thereby ensuring a broader and more realistic spectrum of potential outcomes.

The model was also designed with a flexible, modular structure, making it easy to update with new scientific findings without having to change its core algorithm. This flexibility is crucial for continually improving the model, allowing regular updates to its parameters and data. The modular design also supports replacing preliminary estimates with actual, up-to-date information, which improves the model’s accuracy and relevance as new research becomes available.

Figure 2 showcases the compartmental model designed to elucidate the dynamics among vaccination strategies, influenza transmission, and consequent health outcomes. This model delineates the population into distinct compartments, primarily focusing on the age-stratified cohort of noninfected individuals who are initially unvaccinated. Upon the application of vaccination policies, a transition of these individuals into the vaccinated cohort is anticipated, contingent upon their noninfection status, which predicates the absence of health complications or influenza-induced mortality, thereby facilitating a cyclic annual assessment. In the event of influenza infection, the model accounts for resultant health implications, including hospital admissions, general practitioner consultations, loss in work productivity, and cardiovascular complications, using a formulaic approach that integrates vaccine efficacy and age-specific infection rates. Identical principles extend to the unvaccinated population who contract the virus, after which the model delineates 3 potential pathways postinfection: mortality attributable to influenza, mortality from alternate causes, or recovery. The recovery probabilities are quantified through a formula that encapsulates influenza-associated mortality rates across different age groups.

Figure 2. Graphic representation of the model adopted to estimate the effect of the 13 elected public health policies. VCR: vaccination coverage rate.

The Operational Functionality of the Tool

The design of this tool prioritized accessibility and user-friendliness, targeting a wide audience that spans HCPs, the public, and patient advocacy groups. By facilitating an interactive platform, it enables users to easily simulate the impact of selecting from the 13 distinct PHPs on various health outcomes within specific target groups, for any year between 2022 and 2031.

Upon the selection of policies, a prioritization mechanism is applied where the weight of each subsequent policy decreases fractionally to reflect its comparative impact on the overall scenario. This methodology underscores the varying significance of individual policies and their synergistic effects when combined. This system also incorporates a realistic element of societal resistance to change, adjusting the cumulative weight of selected PHPs to reflect this factor.

Furthermore, the tool bases its analysis on existing PHPs within a country, recognizing prior efforts and their varying degrees of success. The simulation outcomes represent the scenario of maximum policy efficacy, acknowledging that complete population compliance is an ideal rather than a constant reality due to people’s inherent resistance to change. The possibility of achieving perfect policy implementation is speculated for future contexts, suggesting that even in such ideal conditions, there is potential for further enhancement. This could be achieved through the adoption of new communication and educational strategies leveraging emerging technologies, adapting to changing societal contexts, and more effectively engaging target populations.

Ethical Considerations

The LCF project was initiated at the Catholic University of Portugal; was subject to the code of ethics NR/R/1419/2015 at the time; and was later transferred, together with the team, to the NOVA-IMS Faculty of the Universidade Nova de Lisboa, where it was subject to the supervision of its ethics committee, in accordance with the Universidade Nova de Lisboa code of ethics (approval 15464/2014) published on December 19, 2014. Access to data was only granted to published and public material, and there was no access to personal data or any other data that could be used to identify someone.

Democratizing Access and Combating Misinformation

The development of this tool democratizes access to complex epidemiological scenario modeling, allowing users without advanced technical knowledge of PHPs and health impact modeling to explore the potential effects of different health policy scenarios. This capability not only streamlines the decision-making process for health policy but also upholds the principle of technological transparency, ensuring that the underlying mechanisms and assumptions of the tool are clear and understandable.

The dedicated website [118] hosting the LCF tool serves as an educational resource, offering scientifically accurate information about influenza and vaccination in accessible terms. This approach is instrumental in combating misinformation and reducing vaccine hesitancy, thereby supporting global efforts to lessen the impact of seasonal and pandemic influenza [119]. In this context, it is also relevant to acknowledge the differences between vaccine resistance and vaccine hesitancy [120,121], where vaccine resistance often stems from deeply rooted ideological, religious, or philosophical beliefs and, in contrast, vaccine hesitancy is typically driven by fear and doubts, frequently fueled by misinformation or distorted news. Recognizing these differences is crucial for tailoring intervention strategies effectively, as in contexts where vaccine resistance is prevalent due to entrenched beliefs, efforts may need to focus on long-term engagement and education; conversely, in areas where hesitancy predominates, addressing misinformation and building trust through transparent communication may prove more effective. Understanding these nuances is essential for optimizing the impact of our approach across diverse populations, as applying this tool in different legal and cultural contexts may face increased inertia from the public.


The LCF project, initiated in February 2021, is projected to conclude in December 2024. The phase focused on model creation and its implementation in the pilot country, Sweden, occurred from May 2021 to May 2023.

The pilot phase of the project was concluded successfully and revealed positive outcomes on the Swedish population. For example, the use of the tool to simulate the comprehensive application of all 13 PHPs across various target populations for the year 2025 provided insightful projections, as the results demonstrate a substantial potential increase in the national influenza VCR, from 18.6% (1,940,964/1,042,283,400) to 28.4% (2,962,903/1,042,294,300). This comprehensive approach revealed increases in VCRs across all specified target populations: older adults experienced a substantial increase to 75% (1,636,707/218,227,600) increase, as well as in high-risk patients who also achieved 75% (825,076/110,010,100), pregnant women’s VCR went up to 57.3% (61,894/10,804,700), and health workers saw an increase to 53.1% (276,466/52,085,500). Children VCR went up to 0.8% (15,907/179,057,900) rise, representing an increase of 50% from the baseline value, knowing that high-risk children are vaccinated. Moreover, the anticipated health benefits from this full-scale policy implementation are considerable, including the avoidance of 21,935 influenza infections and 277 hospitalizations. In addition, there would be 5871 fewer physician visits, a reduction of 19,829 workdays lost due to influenza, 38 lives saved from influenza-related deaths, 62 hospitalizations prevented due to cardiovascular complications, and ultimately, 8 fewer deaths from cardiovascular issues related to influenza.


Principal Findings

Gamification is an innovative approach that can play a considerable role in improving PHP decision-making. By using gaming mechanics and design, gamification can make complex information and issues more accessible and engaging, leading to a greater understanding of public health challenges, namely for health policy makers who come from outside the professional health sphere and need support tools for their decision-making that provide them with a decision that is best supported by science. Gamification can also create opportunities for active participation and collaboration, allowing individuals to actively shape PHPs and decisions. In addition, gamification can facilitate the collection of real-time data and feedback, providing valuable insights into the impact of PHPs and informing decision-making processes.

By combining play with the need for informed policy decisions, gamification has the potential to positively impact public health and help ensure that policies are both effective and evidence based and also helps to address social determinants of health by engaging disadvantaged communities and increasing their access to health information and resources. Through interactive experiences, gamification can help to break down barriers and increase health literacy, which can lead to better health outcomes. Furthermore, gamification can foster a sense of community and collaboration among individuals, which can help to build a shared understanding of the importance of public health and create a culture of health.

Limitations

In this paper, we delineate several principal limitations inherent to the use of gamification strategies within the realm of predictive modeling. First, we must acknowledge the ethical and methodological implications posed by gamification: these methodologies do not offer precise forecasts of future events but rather serve as heuristic guides. They project potential futures predicated on historical data, presuming all other variables remain constant (ceteris paribus). This deterministic nature inherently restricts the model’s ability to predict future impacts with absolute certainty.

Second, the foundation of such modeling lies in data analysis, which encounters substantial challenges regarding the availability and quality of data. This is particularly pronounced at the local level, where the procurement and qualification of data sources, often designed for disparate purposes within complex ecosystems, necessitate the generation of proxy measures. Despite the rigorous and meticulous process of producing and validating these proxies, they introduce inherent risks and uncertainties into the modeling efforts.

Third, we must consider the impact of abrupt contextual shifts that can fundamentally disrupt the health care management landscape, thereby breaching the fundamental principles of modeling. The COVID-19 pandemic serves as a striking example, illustrating how populations initially compliant with national vaccination strategies may suddenly exhibit resistance due to widespread disinformation campaigns. This phenomenon has led to a decline in VCRs for numerous vaccines, culminating in the resurgence of diseases such as polio in locations such as London and New York, a scenario deemed inconceivable a decade ago.

In addition, our model does not account for the influence of other policies that may directly or indirectly affect health outcomes. These include frameworks for occupational health, such as specific recommendations and obligations within various work contexts, as well as the management of health issues within institutions focused on older adult care. Furthermore, the model does not incorporate the integration of health issues into broader economic and policy areas, commonly referred to as Health in All Policies. Despite being endorsed by the EU since 2011, Health in All Policies has seen limited practical implementation. Such policy integration could have a considerable impact on vaccination rates, not only for influenza but also for other vaccines administered throughout an individual’s life. Consequently, our model does not capture this dynamic aspect of health management that extends beyond the specific scope of influenza vaccination.

Given these limitations, we advocate for the periodic reassessment of the modeling framework, recommending an annual (or, ideally, biannual) review. This process is intended to incorporate the latest bibliographic resources and replace proxy measures with evidence-based values. Such a practice not only ensures the model’s ongoing refinement but also contributes to the accumulation of evidence necessary for evaluating health impacts in the context of vaccination policy development or modification.

Conclusions

The field of work on increasing VCRs lends itself well to gamification because (1) general trust in vaccines has been deeply shaken by misinformation and fake news during the COVID-19 pandemic, and it is possible to demonstrate the immense advantages that good vaccine coverage provides; (2) in particular, influenza is one of the diseases with the highest pandemic potential, and only through vaccination against the disease will it be possible to mitigate its potential effects; and (3) the entire community, from policy makers, often disconnected from health issues, to the most susceptible citizen, can understand how and where the benefits of influenza vaccination work.

The journey toward improving VCRs globally is not solely a medical challenge but a multifaceted endeavor that requires addressing the underlying social determinants of health. The intertwined relationship between social inequalities and multimorbidity highlights a critical area for intervention. As evidenced, these disparities in social, financial, cultural, and linguistic domains not only hinder equitable access to vaccination but also exacerbate the vulnerability of marginalized communities, thereby impeding the overall effectiveness of influenza vaccination efforts. Therefore, it is imperative that strategies to enhance VCRs also focus on increasing literacy, especially in health-related matters. Empowering individuals with knowledge and understanding of the importance of vaccination can drive more informed decisions, leading to higher uptake rates. In addition, concerted efforts to combat social inequalities are paramount. By creating more inclusive health systems and policies that actively address the barriers faced by disadvantaged groups, a way can be paved for a more equitable distribution of health resources, including vaccines. Ultimately, enhancing health literacy and addressing social inequalities stand as potential catalysts for boosting VCRs, thereby strengthening the global response to influenza and enhancing public health outcomes for all communities.

The design and implementation of the LCF tool have shown promising results in facilitating a broad and user-friendly approach to evaluating PHPs impacts on influenza VCRs and health outcomes. Its capacity to simulate the effects of various PHPs, considering both individual significance and collective synergy, highlights the tool’s utility in strategic health planning. Furthermore, the tool’s acknowledgment of societal resistance and its foundation on existing PHPs underscore the complexity of health policy efficacy. By offering a platform for dynamic scenario testing, the tool not only assesses current strategies but also identifies opportunities for enhancement, reinforcing the importance of continual innovation and adaptability in public health initiatives. This approach underscores the evolving nature of health strategies and the critical need for responsive, technology-driven solutions to meet public health challenges effectively.

In our interpretation, we see potential for developing the tool in several directions: (1) through its application in other legal and cultural contexts; (2) giving it new capabilities, namely the possibility of cost assessment; (3) adapting the tool to other human vaccination contexts, namely those with low or very low VCRs, as is generally the case with adult vaccination; and (4) developing the gamification capacity used in this context for other public health situations, namely in the prevention of chronic diseases.

Acknowledgments

The authors would like to thank Hans Winberg, Matti Sällberg, Toomas Timpka, and Armin Spreco for their work and contributions to the National Advisory Board for Sweden.

The “Let’s Control Flu” project received funding from Sanofi; however, the research was conducted independently of the sponsoring company.

Authors' Contributions

HL and RBL contributed to the conceptualization. HL and CH contributed to data curation, formal analysis, investigation, resources, and software. RBL contributed to funding acquisition. HL contributed to methodology, project administration, and validation. HL and RA contributed to supervision. CH contributed to the visualization. HL, CH, RBL, and RA contributed to writing—original draft. HL, CH, RBL, and RA contributed to writing—review and editing.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Public health policies of the “Let’s Control Flu” model, organized by Pillar, based on the study by Kassianos et al.

DOCX File , 17 KB

  1. Krammer F, Smith GJ, Fouchier RA, Peiris M, Kedzierska K, Doherty PC, et al. Influenza. Nat Rev Dis Primers. Jun 28, 2018;4(1):4. [CrossRef] [Medline]
  2. Seasonal influenza - annual epidemiological report for 2022/2023. European Centre for Disease Prevention and Control. URL: https:/​/www.​ecdc.europa.eu/​en/​publications-data/​seasonal-influenza-annual-epidemiological-report-20222023 [accessed 2024-12-08]
  3. WHO launches new global influenza strategy. World Health Organization. URL: https://www.who.int/news/item/11-03-2019-who-launches-new-global-influenza-strategy [accessed 2024-01-08]
  4. Macias AE, McElhaney JE, Chaves SS, Nealon J, Nunes MC, Samson SI, et al. The disease burden of influenza beyond respiratory illness. Vaccine. Mar 15, 2021;39 Suppl 1:A6-14. [FREE Full text] [CrossRef] [Medline]
  5. Omidi F, Zangiabadian M, Shahidi Bonjar AH, Nasiri MJ, Sarmastzadeh T. Influenza vaccination and major cardiovascular risk: a systematic review and meta-analysis of clinical trials studies. Sci Rep. Nov 19, 2023;13(1):20235. [FREE Full text] [CrossRef] [Medline]
  6. Johnson EK, Sylte D, Chaves SS, Li Y, Mahe C, Nair H, et al. Hospital utilization rates for influenza and RSV: a novel approach and critical assessment. Popul Health Metr. Jun 14, 2021;19(1):31. [FREE Full text] [CrossRef] [Medline]
  7. 2023-2024 preliminary in-season burden estimates. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/flu/about/burden/preliminary-in-season-estimates.htm [accessed 2024-12-08]
  8. Fleming DM, Elliot AJ. The impact of influenza on the health and health care utilisation of elderly people. Vaccine. Jul 08, 2005;23 Suppl 1:S1-S9. [CrossRef] [Medline]
  9. Paget J, Staadegaard L, Wang X, Li Y, van Pomeren T, van Summeren J, et al. Global and national influenza-associated hospitalisation rates: estimates for 40 countries and administrative regions. J Glob Health. Jan 27, 2023;13:04003. [FREE Full text] [CrossRef] [Medline]
  10. Froes F, Carmo M, Lopes H, Bizouard G, Gomes C, Martins M, et al. Excess hospitalizations and mortality associated with seasonal influenza in Portugal, 2008-2018. BMC Infect Dis. Sep 07, 2022;22(1):726. [FREE Full text] [CrossRef] [Medline]
  11. Barberis I, Myles P, Ault SK, Bragazzi NL, Martini M. History and evolution of influenza control through vaccination: from the first monovalent vaccine to universal vaccines. J Prev Med Hyg. Sep 2016;57(3):E115-E120. [FREE Full text] [Medline]
  12. WHO trivalent recommendations expected to reshape global influenza vaccine market. Clinical Trials Arena. URL: https:/​/www.​clinicaltrialsarena.com/​analyst-comment/​who-trivalent-recommendations-expected-to-reshape-global-influenza-vaccine-market/​ [accessed 2024-12-08]
  13. Vaccine effectiveness: how well flu vaccines work. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/flu/vaccines-work/vaccineeffect.htm [accessed 2024-01-08]
  14. Wilkinson K, Wei Y, Szwajcer A, Rabbani R, Zarychanski R, Abou-Setta AM, et al. Efficacy and safety of high-dose influenza vaccine in elderly adults: a systematic review and meta-analysis. Vaccine. May 15, 2017;35(21):2775-2780. [CrossRef] [Medline]
  15. Lee JK, Lam GK, Shin T, Samson SI, Greenberg DP, Chit A. Efficacy and effectiveness of high-dose influenza vaccine in older adults by circulating strain and antigenic match: an updated systematic review and meta-analysis. Vaccine. Mar 15, 2021;39 Suppl 1:A24-A35. [FREE Full text] [CrossRef] [Medline]
  16. Global influenza strategy 2019-2030. World Health Organization. 2019. URL: https://iris.who.int/handle/10665/311184 [accessed 2024-04-29]
  17. Council recommendation. Official Journal of the European Union. URL: https://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2009:348:0071:0072:EN:PDF [accessed 2024-04-29]
  18. Vaccination against influenza among people aged 65 and over. OECD/European Union. 2020. URL: https://www.oecd-ilibrary.org/sites/804e5c3b-en/index.html?itemId=/content/component/804e5c3b-en [accessed 2024-03-08]
  19. Spetz M, Lundberg L, Nwaru C, Li H, Santosa A, Leach S, et al. The social patterning of COVID-19 vaccine uptake in older adults: a register-based cross-sectional study in Sweden. Lancet Reg Health Eur. Apr 2022;15:100331. [FREE Full text] [CrossRef] [Medline]
  20. Reid JA, Mabhala MA. Correction to: ethnic and minority group differences in engagement with COVID-19 vaccination programmes - at Pandemic Pace; when vaccine confidence in mass rollout meets local vaccine hesitancy. Isr J Health Policy Res. Oct 28, 2021;10(1):60. [FREE Full text] [CrossRef] [Medline]
  21. Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet. Jul 07, 2012;380(9836):37-43. [FREE Full text] [CrossRef] [Medline]
  22. Multiple long-term conditions (multimorbidity) and inequality- addressing the challenge: insights from research. National Institute for Health and Care Research (NIHR). URL: https:/​/evidence.​nihr.ac.uk/​collection/​multiple-long-term-conditions-multimorbidity-and-inequality-addressing-the-challenge-insights-from-research/​ [accessed 2024-04-29]
  23. Katikireddi SV, Niedzwiedz CL, Dundas R, Kondo N, Leyland AH, Rostila M. Inequalities in all-cause and cause-specific mortality across the life course by wealth and income in Sweden: a register-based cohort study. Int J Epidemiol. Jun 01, 2020;49(3):917-925. [FREE Full text] [CrossRef] [Medline]
  24. Mora A, Riera D, Gonzalez C, Arnedo-Moreno J. A literature review of gamification design frameworks. In: Proceedings of the 7th International Conference on Games and Virtual Worlds for Serious Applications. 2015. Presented at: VS-Games '15; September 16-18, 2015:1-8; Skovde, Sweden. URL: https://ieeexplore.ieee.org/document/7295760 [CrossRef]
  25. Brangier E, Marache-Francisco C. Process of gamification. From the consideration of gamification to its practical implementation. In: Proceedings of the 6th International Conference on Advances in Human oriented and Personalized Mechanisms, Technologies, and Services. 2013. Presented at: CENTRIC '13; October 27-November 1, 2013:2013; Venice, Italy. URL: https:/​/www.​researchgate.net/​publication/​255708104_Process_of_Gamification_From_The_Consideration_of_Gamification_To_Its_Practical_Implementation
  26. Oliveira RP, de Souza CG, Reis A, de Souza WM. Gamification in e-learning and sustainability: a theoretical framework. Sustainability. Oct 28, 2021;13(21):11945. [CrossRef]
  27. Mora A, Riera D, González C, Arnedo-Moreno J. Gamification: a systematic review of design frameworks. J Comput High Educ. May 23, 2017;29(3):516-548. [CrossRef]
  28. Mittelstadt BD, Allo P, Taddeo M, Wachter S, Floridi L. The ethics of algorithms: mapping the debate. Big Data Soc. Dec 01, 2016;3(2):205395171667967. [CrossRef]
  29. Thaler RH, Sunstein CR. Nudge: The Final Edition. Yale, MI. Yale University Press; 2021.
  30. Kassianos G, Banerjee A, Baron-Papillon F, Hampson AW, McElhaney JE, McGeer A, et al. Key policy and programmatic factors to improve influenza vaccination rates based on the experience from four high-performing countries. Drugs Context. Jan 05, 2021;10:1-13. [FREE Full text] [CrossRef] [Medline]
  31. Mondal P, Sinharoy A, Gope S. The influence of COVID-19 on influenza and respiratory syncytial virus activities. Infect Dis Rep. Feb 14, 2022;14(1):134-141. [FREE Full text] [CrossRef] [Medline]
  32. Friedl A, Aegerter C, Saner E, Meier D, Beer JH. An intensive 5-year-long influenza vaccination campaign is effective among doctors but not nurses. Infection. Feb 29, 2012;40(1):57-62. [CrossRef] [Medline]
  33. McGinnis JM, Jones R, Hillis C, Kokus H, Thomas H, Thomas J, et al. A pneumococcal pneumonia and influenza vaccination quality improvement program for women receiving chemotherapy for gynecologic cancers at a major tertiary cancer Centre. Gynecol Oncol. Apr 2021;161(1):236-243. [CrossRef] [Medline]
  34. Ofstead CL, Amelang MR, Wetzler HP, Tan L. Moving the needle on nursing staff influenza vaccination in long-term care: results of an evidence-based intervention. Vaccine. Apr 25, 2017;35(18):2390-2395. [CrossRef] [Medline]
  35. Perlin JB, Septimus EJ, Cormier SB, Moody JA, Hickok JD, Bracken RM. Developing a program to increase seasonal influenza vaccination of healthcare workers: lessons from a system of community hospitals. J Healthc Qual. 2013;35(6):5-15. [CrossRef] [Medline]
  36. Podczervinski S, Stednick Z, Helbert L, Davies J, Jagels B, Gooley T, et al. Employee influenza vaccination in a large cancer center with high baseline compliance rates: comparison of carrot versus stick approaches. Am J Infect Control. Mar 01, 2015;43(3):228-233. [FREE Full text] [CrossRef] [Medline]
  37. Badmus D, Menzies R. Using general practice data to monitor influenza vaccination coverage in the medically at risk: a data linkage study. BMJ Open. Sep 17, 2019;9(9):e031802. [FREE Full text] [CrossRef] [Medline]
  38. Frawley JE, McManus K, McIntyre E, Seale H, Sullivan E. Uptake of funded influenza vaccines in young Australian children in 2018; parental characteristics, information seeking and attitudes. Vaccine. Jan 10, 2020;38(2):180-186. [CrossRef] [Medline]
  39. Isenor JE, O'Reilly BA, Bowles SK. Evaluation of the impact of immunization policies, including the addition of pharmacists as immunizers, on influenza vaccination coverage in Nova Scotia, Canada: 2006 to 2016. BMC Public Health. Jun 26, 2018;18(1):787. [FREE Full text] [CrossRef] [Medline]
  40. Rajaram S, Steffey A, Blak B, Hickman M, Christensen H, Caspard H. Uptake of childhood influenza vaccine from 2012-2013 to 2014-2015 in the UK and the implications for high-risk children: a retrospective observational cohort study. BMJ Open. Aug 01, 2016;6(8):e010625. [FREE Full text] [CrossRef] [Medline]
  41. Baxter D. Approaches to the vaccination of pregnant women: experience from Stockport, UK, with prenatal influenza. Hum Vaccin Immunother. Jun 03, 2013;9(6):1360-1363. [FREE Full text] [CrossRef] [Medline]
  42. Borgey F, Henry L, Lebeltel J, Lescure P, Le Coutour X, Vabret A, et al. Effectiveness of an intervention campaign on influenza vaccination of professionals in nursing homes: a cluster-randomized controlled trial. Vaccine. Feb 28, 2019;37(10):1260-1265. [CrossRef] [Medline]
  43. Gargano LM, Pazol K, Sales JM, Painter JE, Morfaw C, Jones LM, et al. Multicomponent interventions to enhance influenza vaccine delivery to adolescents. Pediatrics. Nov 2011;128(5):e1092-e1099. [FREE Full text] [CrossRef] [Medline]
  44. Jiménez-García R, Rodríguez-Rieiro C, Hernández-Barrera V, Lopez de Andres A, Rivero Cuadrado A, Rodriguez Laso A, et al. Effectiveness of age-based strategies to increase influenza vaccination coverage among high risk subjects in Madrid (Spain). Vaccine. Apr 05, 2011;29(16):2840-2845. [CrossRef] [Medline]
  45. Jiménez-García R, Herńndez-Barrera V, Rodríguez-Rieiro C, de Andrés AL, Miguel-Diez JD, Trujillo IJ, et al. Are age-based strategies effective in increasing influenza vaccination coverage?: the Spanish experience. Hum Vaccin Immunother. Feb 27, 2012;8(2):228-233. [CrossRef] [Medline]
  46. Lin CJ, Nowalk MP, Zimmerman RK. Estimated costs associated with improving influenza vaccination for health care personnel in a multihospital health system. Jt Comm J Qual Patient Saf. Feb 2012;38(2):67-72. [CrossRef] [Medline]
  47. Llupià A, Mena G, Olivé V, Quesada S, Aldea M, Sequera VG, et al. Evaluating influenza vaccination campaigns beyond coverage: a before-after study among health care workers. Am J Infect Control. Aug 2013;41(8):674-678. [CrossRef] [Medline]
  48. Mustafa M, Al-Khal A, Al Maslamani M, Al Soub H. Improving influenza vaccination rates of healthcare workers: a multipronged approach in Qatar. East Mediterr Health J. Jun 14, 2017;23(4):303-310. [FREE Full text] [CrossRef] [Medline]
  49. Honda H, Sato Y, Yamazaki A, Padival S, Kumagai A, Babcock H. A successful strategy for increasing the influenza vaccination rate of healthcare workers without a mandatory policy outside of the United States: a multifaceted intervention in a Japanese tertiary care center. Infect Control Hosp Epidemiol. Nov 02, 2013;34(11):1194-1200. [CrossRef] [Medline]
  50. Lin CJ, Nowalk MP, Raymund M, Sweeney PM, Zimmerman RK. Association of state laws and healthcare workers' influenza vaccination rates. J Natl Med Assoc. Feb 2016;108(1):99-102. [CrossRef] [Medline]
  51. McAuliffe K, Peddecord KM, Wang W, Ralston K, Deguire M, Waters-Montijo K, et al. Influenza vaccination and its association with clinic use of evidence-based practices and individual patient characteristics, San Diego County, 2009. J Public Health Manag Pract. 2013;19(2):178-186. [CrossRef] [Medline]
  52. Tielsch Goddard A, Borkowski V, Konesky A, Bennhoff A. Taking action on asthma: increasing influenza vaccination rates in pediatric asthma through quality improvement. J Pediatr Health Care. Nov 2019;33(6):653-662. [CrossRef] [Medline]
  53. Drees M, Wroten K, Smedley M, Mase T, Schwartz JS. Carrots and sticks: achieving high healthcare personnel influenza vaccination rates without a mandate. Infect Control Hosp Epidemiol. Jun 27, 2015;36(6):717-724. [CrossRef] [Medline]
  54. Wilsdon T, Lawlor R, Li L, Rafila A, García Rojas A. The impact of vaccine procurement methods on public health in selected European countries. Expert Rev Vaccines. Feb 28, 2020;19(2):123-132. [CrossRef] [Medline]
  55. Maffeo M, Luconi E, Castrofino A, Campagnoli EM, Cinnirella A, Fornaro F, et al. 2019 Influenza vaccination campaign in an Italian research and teaching hospital: analysis of the reasons for its failure. Int J Environ Res Public Health. May 30, 2020;17(11):3881. [FREE Full text] [CrossRef] [Medline]
  56. Oguz MM. Improving influenza vaccination uptake among healthcare workers by on-site influenza vaccination campaign in a tertiary children hospital. Hum Vaccin Immunother. Mar 19, 2019;15(5):1060-1065. [FREE Full text] [CrossRef] [Medline]
  57. Vimercati L, Bianchi FP, Mansi F, Ranieri B, Stefanizzi P, de Nitto S, et al. Influenza vaccination in health-care workers: an evaluation of an on-site vaccination strategy to increase vaccination uptake in HCWs of a South Italy Hospital. Hum Vaccin Immunother. Jul 25, 2019;15(12):2927-2932. [FREE Full text] [CrossRef] [Medline]
  58. Huth K, Benchimol EI, Aglipay M, Mack DR. Strategies to improve influenza vaccination in pediatric inflammatory bowel disease through education and access. Inflamm Bowel Dis. Aug 2015;21(8):1761-1768. [CrossRef] [Medline]
  59. Atkins K, van Hoek AJ, Watson C, Baguelin M, Choga L, Patel A, et al. Seasonal influenza vaccination delivery through community pharmacists in England: evaluation of the London pilot. BMJ Open. Feb 16, 2016;6(2):e009739. [FREE Full text] [CrossRef] [Medline]
  60. Buchan SA, Rosella LC, Finkelstein M, Juurlink D, Isenor J, Marra F, et al. Public Health Agency of Canada/Canadian Institutes of Health Research Influenza Research Network (PCIRN) Program DeliveryEvaluation Group. Impact of pharmacist administration of influenza vaccines on uptake in Canada. CMAJ. Jan 30, 2017;189(4):E146-E152. [FREE Full text] [CrossRef] [Medline]
  61. Drozd EM, Miller L, Johnsrud M. Impact of pharmacist immunization authority on seasonal influenza immunization rates across states. Clin Ther. Aug 2017;39(8):1563-80.e17. [FREE Full text] [CrossRef] [Medline]
  62. Isenor JE, Alia TA, Killen JL, Billard BA, Halperin BA, Slayter KL, et al. Impact of pharmacists as immunizers on influenza vaccination coverage in Nova Scotia, Canada. Hum Vaccin Immunother. May 03, 2016;12(5):1225-1228. [FREE Full text] [CrossRef] [Medline]
  63. Benjamin-Chung J, Arnold BF, Kennedy CJ, Mishra K, Pokpongkiat N, Nguyen A, et al. Evaluation of a city-wide school-located influenza vaccination program in Oakland, California, with respect to vaccination coverage, school absences, and laboratory-confirmed influenza: a matched cohort study. PLoS Med. Aug 18, 2020;17(8):e1003238. [FREE Full text] [CrossRef] [Medline]
  64. Calder K, Bidwell S, Brunton C, Pink R. Evaluation of the Canterbury under-18 seasonal influenza vaccination programme. N Z Med J. Jul 18, 2014;127(1398):19-27. [Medline]
  65. Frisina PG, Ingraffia ST, Brown TR, Munene EN, Pletcher JR, Kolligian J. Increasing influenza immunization rates among healthcare providers in an ambulatory-based, university healthcare setting☆. Int J Qual Health Care. Nov 30, 2019;31(9):698-703. [CrossRef] [Medline]
  66. Kawai S, Nanri S, Ban E, Inokuchi M, Tanaka T, Tokumura M, et al. Influenza vaccination of schoolchildren and influenza outbreaks in a school. Clin Infect Dis. Jul 15, 2011;53(2):130-136. [CrossRef] [Medline]
  67. Pannaraj PS, Wang HL, Rivas H, Wiryawan H, Smit M, Green N, et al. School-located influenza vaccination decreases laboratory-confirmed influenza and improves school attendance. Clin Infect Dis. Aug 01, 2014;59(3):325-332. [FREE Full text] [CrossRef] [Medline]
  68. Squeri R, Riso R, Facciolà A, Genovese C, Palamara MA, Ceccio C, et al. Management of two influenza vaccination campaign in health care workers of a university hospital in the South Italy. Ann Ig. 2017;29(3):223-231. [FREE Full text] [CrossRef] [Medline]
  69. Szilagyi PG, Schaffer S, Rand CM, Goldstein NP, Vincelli P, Hightower AD, et al. School-located influenza vaccinations for adolescents: a randomized controlled trial. J Adolesc Health. Feb 2018;62(2):157-163. [CrossRef] [Medline]
  70. Szilagyi PG, Schaffer S, Rand CM, Goldstein NP, Hightower AD, Younge M, et al. Impact of elementary school-located influenza vaccinations: a stepped wedge trial across a community. Vaccine. May 11, 2018;36(20):2861-2869. [CrossRef] [Medline]
  71. Heinrich-Morrison K, McLellan S, McGinnes U, Carroll B, Watson K, Bass P, et al. An effective strategy for influenza vaccination of healthcare workers in Australia: experience at a large health service without a mandatory policy. BMC Infect Dis. Feb 06, 2015;15(1):42. [FREE Full text] [CrossRef] [Medline]
  72. Barbara A, Mariani M, de Waure C, Anzelmo V, Piccoli B, Cambieri A, et al. A campaign aimed at increasing seasonal influenza vaccination coverage among post graduate medical residents in an Italian teaching hospital. Hum Vaccin Immunother. Jan 16, 2019;15(4):967-972. [FREE Full text] [CrossRef] [Medline]
  73. Lehmann BA, Chapman GB, Franssen FM, Kok G, Ruiter RA. Changing the default to promote influenza vaccination among health care workers. Vaccine. Mar 08, 2016;34(11):1389-1392. [FREE Full text] [CrossRef] [Medline]
  74. Nehme EK, Delphia M, Cha EM, Thomas M, Lakey D. Promoting influenza vaccination among an ACA health plan subscriber population: a randomized trial. Am J Health Promot. Jul 2019;33(6):916-920. [CrossRef] [Medline]
  75. Bianchi FP, Rizzo LA, de Nitto S, Stefanizzi P, Tafuri S. Influenza vaccination coverage among splenectomized patients: an Italian study on the role of active recall in the vaccination compliance. Hum Vaccin Immunother. May 07, 2019;15(11):2644-2649. [FREE Full text] [CrossRef] [Medline]
  76. Hofstetter AM, Vargas CY, Camargo S, Holleran S, Vawdrey DK, Kharbanda EO, et al. Impacting delayed pediatric influenza vaccination: a randomized controlled trial of text message reminders. Am J Prev Med. Apr 2015;48(4):392-401. [CrossRef] [Medline]
  77. Kaufman J, Attwell K, Tuckerman J, O'Sullivan J, Omer SB, Leask J, et al. Feasibility and acceptability of the multi-component P3-MumBubVax antenatal intervention to promote maternal and childhood vaccination: a pilot study. Vaccine. May 19, 2020;38(24):4024-4031. [CrossRef] [Medline]
  78. Regan AK, Bloomfield L, Peters I, Effler PV. Randomized controlled trial of text message reminders for increasing influenza vaccination. Ann Fam Med. Nov 2017;15(6):507-514. [FREE Full text] [CrossRef] [Medline]
  79. Stockwell MS, Kharbanda EO, Martinez RA, Vargas CY, Vawdrey DK, Camargo S. Effect of a text messaging intervention on influenza vaccination in an urban, low-income pediatric and adolescent population: a randomized controlled trial. JAMA. Apr 25, 2012;307(16):1702-1708. [CrossRef] [Medline]
  80. Yeung KH, Tarrant M, Chan KC, Tam WH, Nelson EA. Increasing influenza vaccine uptake in children: a randomised controlled trial. Vaccine. Sep 05, 2018;36(37):5524-5535. [FREE Full text] [CrossRef] [Medline]
  81. Yudin MH, Mistry N, de Souza LR, Besel K, Patel V, Blanco Mejia S, et al. Text messages for influenza vaccination among pregnant women: a randomized controlled trial. Vaccine. Feb 01, 2017;35(5):842-848. [CrossRef] [Medline]
  82. Schmidtke KA, Nightingale PG, Reeves K, Gallier S, Vlaev I, Watson SI, et al. Randomised controlled trial of a theory-based intervention to prompt front-line staff to take up the seasonal influenza vaccine. BMJ Qual Saf. Mar 05, 2020;29(3):189-197. [FREE Full text] [CrossRef] [Medline]
  83. Gattis S, Yildirim I, Shane AL, Serluco S, McCracken C, Liverman R. Impact of pharmacy-initiated interventions on influenza vaccination rates in pediatric solid organ transplant recipients. J Pediatric Infect Dis Soc. Dec 27, 2019;8(6):525-530. [CrossRef] [Medline]
  84. Humiston SG, Bennett NM, Long C, Eberly S, Arvelo L, Stankaitis J, et al. Increasing inner-city adult influenza vaccination rates: a randomized controlled trial. Public Health Rep. Jul 01, 2011;126 Suppl 2(Suppl 2):39-47. [FREE Full text] [CrossRef] [Medline]
  85. Hurley LP, Beaty B, Lockhart S, Gurfinkel D, Breslin K, Dickinson M, et al. RCT of centralized vaccine reminder/recall for adults. Am J Prev Med. Aug 2018;55(2):231-239. [CrossRef] [Medline]
  86. Kamali T, Foo C, OYong K, Terashita D. Influenza vaccination coverage of health care personnel in Los Angeles County Hospitals, 2016–2017. Am J Public Health. May 2020;110(5):693-695. [CrossRef]
  87. Nowalk MP, Lin CJ, Hannibal K, Reis EC, Gallik G, Moehling KK, et al. Increasing childhood influenza vaccination: a cluster randomized trial. Am J Prev Med. Oct 2014;47(4):435-443. [FREE Full text] [CrossRef] [Medline]
  88. Nowalk MP, Moehling KK, Zhang S, Raviotta JM, Zimmerman RK, Lin CJ. Using the 4 Pillars to increase vaccination among high-risk adults: who benefits? Am J Manag Care. Nov 2017;23(11):651-655. [FREE Full text] [Medline]
  89. Zimmerman RK, Nowalk MP, Lin CJ, Hannibal K, Moehling KK, Huang H, et al. Cluster randomized trial of a toolkit and early vaccine delivery to improve childhood influenza vaccination rates in primary care. Vaccine. Jun 17, 2014;32(29):3656-3663. [FREE Full text] [CrossRef] [Medline]
  90. Costantino C, Restivo V, Gaglio V, Lanza GL, Marotta C, Maida CM, et al. Effectiveness of an educational intervention on seasonal influenza vaccination campaign adherence among healthcare workers of the Palermo University Hospital, Italy. Ann Ig. 2019;31(1):35-44. [FREE Full text] [CrossRef] [Medline]
  91. Lin CJ, Nowalk MP, Zimmerman RK, Moehling KK, Conti T, Allred NJ, et al. Reducing racial disparities in influenza vaccination among children with asthma. J Pediatr Health Care. May 2016;30(3):208-215. [FREE Full text] [CrossRef] [Medline]
  92. O'Leary ST, Pyrzanowski J, Brewer SE, Sevick C, Miriam Dickinson L, Dempsey AF. Effectiveness of a multimodal intervention to increase vaccination in obstetrics/gynecology settings. Vaccine. Jun 06, 2019;37(26):3409-3418. [CrossRef] [Medline]
  93. Riphagen-Dalhuisen J, Burgerhof JG, Frijstein G, van der Geest-Blankert AD, Danhof-Pont MB, de Jager HJ, et al. Hospital-based cluster randomised controlled trial to assess effects of a multi-faceted programme on influenza vaccine coverage among hospital healthcare workers and nosocomial influenza in the Netherlands, 2009 to 2011. Euro Surveill. Jun 27, 2013;18(26):20512. [FREE Full text] [CrossRef] [Medline]
  94. Guanche Gacell H, Villanueva Arias A, Guilarte García E, Rubiera Jiménez R, Nonato Alfonso R. A successful strategy for improving the influenza immunization rates of health care workers without a mandatory policy. Int J Occup Environ Med. Jul 01, 2015;6(3):184-186. [FREE Full text] [CrossRef] [Medline]
  95. Norbury M, Fawkes N, Guthrie B. Impact of the GP contract on inequalities associated with influenza immunisation: a retrospective population-database analysis. Br J Gen Pract. Jul 01, 2011;61(588):e379-e385. [CrossRef]
  96. Edwards F, Masick KD, Armellino D. Impact of the flu mask regulation on health care personnel influenza vaccine acceptance rates. Am J Infect Control. Oct 01, 2016;44(10):1154-1157. [CrossRef] [Medline]
  97. Huynh S, Poduska P, Mallozzi T, Culler F. Mandatory influenza vaccination of health care workers: a first-year success implementation by a community health care system. Am J Infect Control. Oct 2012;40(8):771-773. [CrossRef] [Medline]
  98. Kim H, Lindley MC, Dube D, Kalayil EJ, Paiva KA, Raymond P. Evaluation of the impact of the 2012 Rhode Island health care worker influenza vaccination regulations: implementation process and vaccination coverage. J Public Health Manag Pract. 2015;21(3):E1-E9. [FREE Full text] [CrossRef] [Medline]
  99. Ksienski DS. Mandatory seasonal influenza vaccination or masking of British Columbia health care workers: year 1. Can J Public Health. Jul 11, 2014;105(4):e312-e316. [FREE Full text] [CrossRef] [Medline]
  100. LaVela SL, Hill JN, Smith BM, Evans CT, Goldstein B, Martinello R. Healthcare worker influenza declination form program. Am J Infect Control. Jun 2015;43(6):624-628. [CrossRef] [Medline]
  101. Leibu R, Maslow J. Effectiveness and acceptance of a health care-based mandatory vaccination program. J Occup Environ Med. Jan 2015;57(1):58-61. [CrossRef] [Medline]
  102. Miller BL, Ahmed F, Lindley MC, Wortley PM. Increases in vaccination coverage of healthcare personnel following institutional requirements for influenza vaccination: a national survey of U.S. hospitals. Vaccine. Nov 21, 2011;29(50):9398-9403. [CrossRef] [Medline]
  103. Hämäläinen A, Patovirta RL, Mauranen E, Hämäläinen S, Koivula I. Support among healthcare workers for the new mandatory seasonal influenza vaccination policy and its effects on vaccination coverage. Ann Med. Dec 22, 2021;53(1):384-390. [FREE Full text] [CrossRef] [Medline]
  104. Kitt E, Burt S, Price SM, Satchell L, Offit PA, Sammons JS, et al. Implementation of a mandatory influenza vaccine policy: a 10-year experience. Clin Infect Dis. Jul 15, 2021;73(2):e290-e296. [CrossRef] [Medline]
  105. Costantino C, Restivo V, Tramuto F, Casuccio A, Vitale F. Influenza vaccination of healthcare workers in Italy: could mandatory vaccination be a solution to protect patients? Future Microbiol. Jun 2019;14:45-49. [CrossRef] [Medline]
  106. Harris KM, Uscher-Pines L, Han B, Lindley MC, Lorick SA. The impact of influenza vaccination requirements for hospital personnel in California: knowledge, attitudes, and vaccine uptake. Am J Infect Control. Mar 2014;42(3):288-293. [CrossRef] [Medline]
  107. Ho HJ, Tan Y, Cook AR, Koh G, Tham TY, Anwar E, et al. Increasing influenza and pneumococcal vaccination uptake in seniors using point-of-care informational interventions in primary care in Singapore: a pragmatic, cluster-randomized crossover trial. Am J Public Health. Dec 2019;109(12):1776-1783. [CrossRef] [Medline]
  108. Lanoix JP, El Samad Y, Schmit JL, Legrain A, Joseph C, Smail A, et al. Effect of motivational team on influenza vaccination coverage among health care workers. Infect Dis (Lond). Apr 24, 2019;51(4):302-304. [CrossRef] [Medline]
  109. Roca B, Herrero E, Resino E, Torres V, Penades M, Andreu C. Impact of education program on influenza vaccination rates in Spain. Am J Manag Care. Dec 01, 2012;18(12):e446-e452. [FREE Full text] [Medline]
  110. Wong VW, Fong DY, Lok KY, Wong JY, Sing C, Choi AY, et al. Brief education to promote maternal influenza vaccine uptake: a randomized controlled trial. Vaccine. Oct 17, 2016;34(44):5243-5250. [CrossRef] [Medline]
  111. Conte A, Quattrin R, Filiputti E, Cocconi R, Arnoldo L, Tricarico P, et al. Promotion of flu vaccination among healthcare workers in an Italian academic hospital: an experience with tailored web tools. Hum Vaccin Immunother. Oct 02, 2016;12(10):2628-2633. [FREE Full text] [CrossRef] [Medline]
  112. Cozza V, Alfonsi V, Rota MC, Paolini V, Ciofi degli Atti ML. Promotion of influenza vaccination among health care workers: findings from a tertiary care children's hospital in Italy. BMC Public Health. Jul 24, 2015;15(1):697. [FREE Full text] [CrossRef] [Medline]
  113. Li A, Chan YH, Liew MF, Pandey R, Phua J. Improving influenza vaccination coverage among patients with COPD: a pilot project. Int J Chron Obstruct Pulmon Dis. 2019;14:2527-2533. [FREE Full text] [CrossRef] [Medline]
  114. Venci DP, Slain D, Elswick BM, Sarwari AR, Ross AL, Smithmyer A, et al. Inclusion of social media-based strategies in a health care worker influenza immunization campaign. Am J Infect Control. Aug 2015;43(8):902-903. [CrossRef] [Medline]
  115. Frew PM, Saint-Victor DS, Owens LE, Omer SB. Socioecological and message framing factors influencing maternal influenza immunization among minority women. Vaccine. Mar 26, 2014;32(15):1736-1744. [CrossRef] [Medline]
  116. Frew PM, Kriss JL, Chamberlain AT, Malik F, Chung Y, Cortés M, et al. A randomized trial of maternal influenza immunization decision-making: a test of persuasive messaging models. Hum Vaccin Immunother. Aug 02, 2016;12(8):1989-1996. [FREE Full text] [CrossRef] [Medline]
  117. Oakley S, Bouchet J, Costello P, Parker J. Influenza vaccine uptake among at-risk adults (aged 16-64 years) in the UK: a retrospective database analysis. BMC Public Health. Sep 24, 2021;21(1):1734. [FREE Full text] [CrossRef] [Medline]
  118. Home page. Let's Control Flu. URL: https://letscontrolflu.com/ [accessed 2024-03-08]
  119. Schmid P, Rauber D, Betsch C, Lidolt G, Denker ML. Barriers of influenza vaccination intention and behavior - a systematic review of influenza vaccine hesitancy, 2005 - 2016. PLoS One. Jan 26, 2017;12(1):e0170550. [FREE Full text] [CrossRef] [Medline]
  120. Peters MD. Addressing vaccine hesitancy and resistance for COVID-19 vaccines. Int J Nurs Stud. Jul 2022;131:104241. [FREE Full text] [CrossRef] [Medline]
  121. Dubé È, Ward JK, Verger P, MacDonald NE. Vaccine hesitancy, acceptance, and anti-vaccination: trends and future prospects for public health. Annu Rev Public Health. Apr 01, 2021;42:175-191. [FREE Full text] [CrossRef] [Medline]


EU: European Union
HCP: health care professional
LCF: Let’s Control Flu
NAB: National Advisory Board
PHP: public health policy
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
VCR: vaccination coverage rate
WHO: World Health Organization


Edited by S Ma; submitted 18.12.23; peer-reviewed by A McCallum, B Bunt; comments to author 07.03.24; revised version received 27.03.24; accepted 20.06.24; published 10.09.24.

Copyright

©Henrique Lopes, Ricardo Baptista-Leite, Catarina Hermenegildo, Rifat Atun. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 10.09.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.