Protocol
Abstract
Background: Weight gain following smoking cessation is a well-documented concern, often attributed to the absence of nicotine’s metabolic influence. The adoption of Electronic Nicotine Delivery Systems (ENDS) has been used to achieve smoking cessation, with claims of aiding weight control. However, existing reviews present conflicting conclusions on ENDS’ impact on weight status, necessitating a rigorous evaluation.
Objective: We aim to conduct a systematic review with meta-analysis to assess the actual impact of ENDS on weight status in individuals who have ceased or reduced conventional smoking. The primary goal is to provide clinicians with evidence-based insights into the potential effects of ENDS use as a smoking substitute on weight control.
Methods: Adhering to PRISMA-P (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols) guidelines, our systematic review will analyze randomized and nonrandomized controlled trials, clinical trials (quasi-experimental), and prospective or retrospective cohort studies on the weight status effects of ENDS among individuals who have either quit or reduced smoking. Searches will include PubMed, Scopus, and Cochrane Library, covering the period from 2010 to January 2024. A gray literature search and supplementary searches will be performed. Data will be extracted independently by 2 reviewers and quality assessments will be conducted concurrently. Quality assessments will use Joanna Briggs Institute tools, 2020 version, along with bias assessments for internal validity and reporting bias based on the Catalogue of Bias. The included studies will be examined for any internal data reporting discrepancies by using Puljak’s checklist. Meta-analysis and subgroup analyses (ie, general ENDS usage, ENDS use coupled with a reduction in smoking exceeding 50%, and exclusive ENDS use for achieving smoking cessation) are planned. Certainty of evidence will be evaluated using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) framework.
Results: The protocol has been registered in PROSPERO (CRD42023494974) and the entire systematic review is expected to be completed by April 2024. The main goal of this review is to retrieve all current human research studies investigating the influence of ENDS on weight management among individuals who have quit or reduced smoking. Furthermore, the review will assess the quality of these studies and examine potential biases to identify the most dependable evidence available. Dissemination strategies will include traditional journal publications, social media announcements, and a white paper. The latter, available for download and distributed at conferences, aims to reach a broad audience, including clinicians and ENDS users.
Conclusions: The review will address the importance of informing health care professionals and patients about the current and robust evidence regarding the effects of transitioning to ENDS for smoking cessation on weight status.
Trial Registration: PROSPERO CRD42023494974; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=494974
International Registered Report Identifier (IRRID): PRR1-10.2196/56324
doi:10.2196/56324
Keywords
Introduction
Background
The phenomenon of weight gain following smoking cessation is a well-documented concern in scientific research [
]. Typically, individuals who quit smoking experience an average weight increase ranging from 4.67 to 4.8 kg after 1 year, with more than 10% experiencing a rise exceeding 10 kg [ , ]. This weight gain can primarily be attributed to the lack of nicotine’s influence on metabolic processes, which includes appetite suppression and alterations to both lipolysis and lipogenesis [ , ].In the past few years, there has been a notable increase in the adoption of Electronic Nicotine Delivery Systems (ENDS), commonly known as e-cigarettes, among individuals attempting to cease tobacco use [
]. Some who use ENDS do so for weight loss or weight management. The use of ENDS for weight loss was most prevalent among individuals with eating disorders, at 32% (n=178) [ ]. This usage drops considerably in the general ENDS-using population. In the United States, 15% (13/84) of college students and 13.5% (62/459) of adults reported using ENDS for weight control [ , ]. Among US military recruits, 5.1% (11/223) of males and 6.0% (4/61) of females have used ENDS for this purpose [ ]. In England, the figure stands at 4.6% (18/394) of current ENDS users [ ].Observational studies have also noted the practice of using vaping as a dietary substitution, where individuals vape flavored liquids to mitigate food cravings. This behavior, while less prevalent in England [
], has been reported in various surveys and interviews conducted in the United States [ , ].Commercial entities have recognized these consumer patterns, resulting in the development and marketing of vaping products that claim to support weight loss. Numerous patents have been filed globally, and several companies have marketed vapor devices that propose to offer benefits such as fat burning, appetite suppression, and rapid weight loss [
, ]. These claims, often promoted through online sites and aggressive marketing strategies [ , ], are claims that have not been verified.Previous Reviews
Recent reviews assert that there is insufficient evidence to draw definitive conclusions on the impact of ENDS on weight control in people who have ceased or reduced conventional smoking. The systematic review of Hod et al [
] of human and in vitro studies concluded that ENDS use is prevalent among the obese, although the authors state that causality cannot be determined due to the cross-sectional design of human studies. Moreover, the data are conflicting, with in vivo studies suggesting weight loss effects, but in vitro studies do not support this claim Thus, the authors underlined the need for further investigation to determine the impact of ENDS on weight control [ ]. Another review by Hartmann-Boyce et al [ ] found 2 ENDS studies, 1 involving ENDS as an adjunct to nicotine replacement therapy and the other comparing them to varenicline, both with wide CIs at all measurement time points. The CIs of weight change (kg) at the end of the treatment and 12 months encompassed both clinically significant weight loss and weight gain [ ]. Therefore, the authors stated that “data are needed on whether using e-cigarettes to quit smoking affects post-cessation weight change” [ ].Research Question
Given the rise of ENDS as an alternative to traditional smoking, and their associated perceived benefits for weight control, we aim to rigorously evaluate the actual impact of ENDS on weight status in individuals who have ceased or reduced conventional smoking. For this purpose, we intend to conduct a systematic review with meta-analysis to analyze human clinical studies that provide longitudinal data on body weight among participants who have replaced cigarette smoking with ENDS use.
Population, Intervention, Comparator, and Outcomes Criteria
The research strategy follows the Population, Intervention, Comparator, and Outcome (PICO) approach as follows: population—adults who smoke cigarettes, intervention—complete or partial substitution of ENDS for cigarettes, comparator—within-subject changes baseline to the end of the study, and outcomes—changes in body weight.
Objectives
We will conduct a systematic review with a meta-analysis to critically assess and synthesize available human studies on the weight status effects of ENDS among individuals who have either quit or reduced smoking. Our goal is to critically evaluate and synthesize the available evidence to offer clinicians high-quality insights into the potential effects of ENDS use as a substitute for smoking, specifically concerning weight control. Thus, our aim is to equip clinicians with robust evidence to enhance their treatment recommendations and strategies for individuals who smoke, aiding them in making informed decisions and plans.
Methods
Overview
In adherence to the PRISMA-P (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols) requirements [
], this protocol is registered with PROSPERO (CRD42023494974), and any deviations will be transparently reported within the review. The review team (GRMLR, MAQ, LF, EA, and RP), led by RP, has substantial expertise in conducting literature reviews and an expert background in tobacco control, tobacco harm reduction, and ENDS.Database Search and Secondary Searches
The databases to be included are PubMed, Scopus, and CENTRAL Cochrane Library. Using the keywords specific to each database (ie, weight, BMI, “body mass index,” “electronic cigarette,” “e-cigarette,” and “electronic nicotine”), searches will be performed in the title and abstract fields in PubMed, and in the title, abstract, and keywords in Scopus. Cochrane Library will be searched for trials. The search will include the period from 2010 to January 2024, in line with the date of the first peer-reviewed research studies on ENDS. Language restrictions will not be applied. In compliance with PRISMA-P, the search strategy example is detailed in
. Retrievals will be downloaded into EndNote (Clarivate), and duplicates will be removed.A secondary search of the existing reviews, conducted independently by 2 reviewers, will be conducted to identify any additional studies. Next, the references of the included studies will be scrutinized to identify additional studies. Finally, the included studies will be citation chased (ie, snowball search) through Google Scholar. The studies excluded during the thorough full-paper review will be documented.
The list of selected studies will be forwarded to 2 medical experts to validate that all pertinent studies have been included. In addition, a comprehensive gray literature search will be conducted on the websites of 16 weight-related medical organizations (
).Inclusion and Exclusion Criteria
The selected study designs will include randomized and nonrandomized controlled trials, clinical trials (quasi-experimental), and prospective or retrospective cohort studies. The initial exclusion will be based on titles and abstracts reviewed. Exclusion criteria will be by publication types (ie, editorials, letters, commentaries, protocols, narrative reviews, conference abstracts, and dissertations), study designs (ie, vitro, animal studies, inhalation toxicology, biomarker studies, surveys, and qualitative studies), adolescent populations, and studies lacking baseline or follow-up weight data. A total of 2 reviewers will independently conduct the exclusion process, with any discrepancies resolved through discussion.
The next process will involve a thorough review of full papers, guided by 3 inclusion criteria, including study designs, availability of data before and after testing participants who substituted ENDS for smoking, and outcome data on weight. All 3 criteria will have to be satisfied for a study to be included.
Review team members will undergo training on the inclusion criteria through analysis of 3 included studies. Two independent reviewers will then conduct the inclusion and exclusion assessments on the studies, resolving any disparities through discussion. The objective is to attain a high level of agreement between reviewers on the study selection process. The project leader will make the final decision regarding the inclusion and assessment of the studies.
Data Extraction
Using a standardized form derived from Joanna Briggs Institute (JBI) and Cochrane Collaboration inventories [
, ], data extraction will be conducted by 2 reviewers independently, followed by cross-checking for accuracy. The full data extraction form is provided in . The data extraction form includes bibliographic details, study population demographics, intervention descriptions, and weight measurements. The form will be pilot-tested and revised as necessary.In cases where the published data are insufficient or absent, an email requesting additional details will be sent to the corresponding author. Findings from the included studies will be reported in a dual format. First, individual studies will be summarized with a concise narrative description. Second, study tables will be formulated incorporating elements derived from the data extraction and quality assessments (refer to the subsequent section).
Quality Assessment and Risk of Bias
Quality assessments will use JBI tools, 2020 version [
], along with bias assessments for internal validity and reporting bias based on the Catalogue of Bias [ ] ( ). Examination of studies for any internal data reporting discrepancies will be conducted using the checklist proposed by Puljak et al [ ] ( ). The data extraction forms will be pilot-tested and revised if necessary. The comprehensive evaluation of study quality will involve calculating an overall rating through a rubric that integrates the JBI score and biases checklist. The overall study quality will be categorized according to the Cochrane guidelines—low risk of bias, some concerns, and high risk of bias [ ]. Quality assessment will be conducted concurrent with the data extraction, and 2 reviewers will independently perform assessments. Discrepancies will be resolved through discussion or decided by the project leader.No studies will be excluded on the basis of their quality assessment or bias. Studies deviating from the JBI quality assessment criteria or exhibiting biases will be documented in the study table. These limitations will be explicitly identified during the data analysis and referenced in the discussion section of the review.
Data Analysis and Synthesis
Studies will be categorized by risk of bias, and summaries will include study design, participant and intervention characteristics, and main findings. A meta-analysis of change scores is planned, where the change score is defined as mean kg at the end of the study minus mean kg at the baseline. Three subgroup analyses will be performed, focusing on (1) general ENDS usage, (2) ENDS use coupled with a reduction in smoking exceeding 50%, and (3) exclusive ENDS use with the goal of smoking cessation. Publication bias will be assessed if a minimum of 10 studies are included.
Grading of Recommendations Assessment, Development, and Evaluation
Certainty of evidence will be evaluated using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) framework [
].Results
The protocol has been registered in PROSPERO (CRD42023494974) and the entire systematic review is expected to be completed by April 2024. The primary objective of this review is to compile all existing human research studies concerning the impact of ENDS on weight control in people who ceased or reduced smoking. In addition, the review will rigorously evaluate the quality of these studies and scrutinize potential biases to emphasize the most reliable and available evidence. The planned review will also identify studies that may exhibit reporting bias, thereby enabling a more accurate representation of the effects of ENDS on weight control within the ongoing discourse on tobacco harm reduction.
Discussion
Principal Findings
This protocol is intended to provide the methodological framework for a systematic review and meta-analysis of the actual impact of ENDS on weight status in individuals who have ceased or reduced conventional smoking.
Many research protocols lack comprehensive planning for dissemination and knowledge translation activities beyond the conventional approach of publishing the review in a peer-reviewed journal and presenting findings at conferences. Naturally, this review will be disseminated through these traditional channels. Following an approach previously described [
], some additional strategies will be adopted. Briefly, upon acceptance, the project protocol will be published in JMIR Research Protocols and the final review with meta-analysis will be published in a peer-reviewed journal. In addition, efforts will be made to translate the review’s abstract into several languages. To enhance visibility, the availability of the review will be disseminated via social media platforms.A white paper will be produced and made available for download on a dedicated website, and we anticipate disseminating it to medical associations and distributing it at conferences. The goal is to ensure the widespread of findings among clinicians and individuals currently using or considering ENDS. Given that a significant number of physicians and health care providers harbor misconceptions regarding the health impacts of nicotine [
, ], the white paper will incorporate a dedicated section focusing on nicotine. Infographics drawn from the white paper will be disseminated to current and potential ENDS users via user advocacy organizations [ ]. Traditional review publication methods may not effectively reach the stakeholders who will benefit from clear and accessible updated sources of information. The objective of these activities is to ensure broad dissemination of the review findings to multiple audiences.It is crucial to acknowledge the potential limitations arising from both the number and the quality of the studies that will be included in this systematic review. The limited quantity of available studies can restrict the scope and depth of conclusions drawn, leading to gaps in understanding and potentially biasing the overall assessment. Furthermore, the quality of the studies significantly impacts the reliability of the review’s conclusions. If the included studies exhibit methodological flaws, biases, or insufficient rigor, the overall evidence may be weakened, resulting in tentative or inconclusive findings.
Conclusions
In conclusion, tobacco consumption constitutes a significant public health burden. Electronic cigarettes may represent a viable option for those attempting to quit smoking. Furthermore, there is a growing interest in these devices due to their potential benefits for weight control, especially for counteracting the short-term weight gain associated with smoking cessation. Therefore, it is essential to inform both patients and health care professionals about the most current and robust evidence regarding the effects of switching to electronic cigarettes for smoking cessation on weight status. This review, including meta-analysis, aims to contribute to this objective.
Acknowledgments
This investigator-initiated study was sponsored by ECLAT srl, a research-based spin-off company of the University of Catania, with the help of a grant from the Foundation for a Smoke-Free World, Inc a US nonprofit 501(3)(c) private foundation and a bursary from the Dipartimento di Medicina Clinica e Sperimentale at the University of Catania Italy (Bando N 1355 2020 Borsa di Ricerca). The contents, selection, and presentation of facts, as well as any opinions expressed herein are the sole responsibility of the authors and under no circumstances shall be regarded as reflecting the positions of the funders.
Data Availability
Data sharing is not applicable to this study as no data sets were generated or analyzed during this study.
Authors' Contributions
GRMLR, MAQ, and RP designed the study and wrote the original draft. LF and EA contributed to the study and reviewed the final study for accuracy and completeness. All authors have read and approved the final study.
Conflicts of Interest
GRMLR, MAQ, LF, and EA declare no conflicts of interest. RP is full tenured professor of Internal Medicine at the University of Catania (Italy) and Medical Director of the Institute for Internal Medicine and Clinical Immunology at the same University. He has received grants from Unbiased Biomarkers for the Prediction of Respiratory Disease Outcomes (U-BIOPRED) and AIR-PROM (Airway Disease Predicting Outcomes through Patient Specific Computational Modelling), Integral Rheumatology and Immunology Specialists Network (IRIS), Foundation for a Smoke Free World, Pfizer, GlaxoSmithKline, CV Therapeutics, NeuroSearch A/S, Sandoz, Merk Sharp and Dohme, Boehringer Ingelheim, Novartis, Arbi Group srl, Duska Therapeutics, Forest Laboratories, Ministero dell Universita’ e della Ricerca (MUR) Bando Piano Nazionale di Ripresa e Resilienza (PNRR) 3277/2021 (CUP E63C22000900006) and 341/2022 (CUP E63C22002080006), funded by NextGenerationEU of the European Union (EU), and the ministerial grant PON REACT-EU 2021 GREEN- Bando 3411/2021 by Ministero dell Universita’ e (MUR)—PNRR EU Community. He is founder of the Center for Tobacco Prevention and Treatment (CPCT) at the University of Catania and of the Center of Excellence for the Acceleration of Harm Reduction at the same university. He receives consultancy fees from Pfizer, Boehringer Ingelheim, Duska Therapeutics, Forest Laboratories, CV Therapeutics, Sermo Inc, GRG Health, Clarivate Analytics, Guidepoint Expert Network, and Gerson Lehrman Group (GLG) Group. He receives textbooks royalties from Elsevier. He is also involved in a patent application for ECLAT srl. He is a pro bono scientific advisor for Lega Italiana Anti Fumo (LIAF) and the International Network of Nicotine Consumers Organizations (INNCO); and he is Chair of the European Technical Committee for Standardization on “Requirements and test methods for emissions of electronic cigarettes” (CEN/TC 437; WG4).
(A) Sample PubMed bibliographic search. (B) Weight medical organizations grey literature search. (C) Data extraction form. (D) Data discrepancies form. (E) Bias report. (F) PRISMA-P 2015 checklist.
DOCX File , 39 KBReferences
- Pebley K, Bursac Z, Klesges RC, Ebbert JO, Womack CR, Graber J, et al. A randomized controlled trial to reduce post-cessation weight gain. Int J Obes (Lond). 2023;47(6):471-478. [FREE Full text] [CrossRef] [Medline]
- Aubin HJC, Farley A, Lycett D, Lahmek P, Aveyard P. Weight gain in smokers after quitting cigarettes: meta-analysis. BMJ. 2012;345:e4439. [FREE Full text] [CrossRef] [Medline]
- Jackson SE, Brown J, Aveyard P, Dobbie F, Uny I, West R, et al. Vaping for weight control: a cross-sectional population study in England. Addict Behav. 2019;95:211-219. [FREE Full text] [CrossRef] [Medline]
- Driva S, Korkontzelou A, Tonstad S, Tentolouris N, Katsaounou P. The effect of smoking cessation on body weight and other metabolic parameters with focus on people with type 2 diabetes mellitus. Int J Environ Res Public Health. 2022;19(20):13222. [FREE Full text] [CrossRef] [Medline]
- Harris KK, Zopey M, Friedman TC. Metabolic effects of smoking cessation. Nat Rev Endocrinol. 2016;12(5):299-308. [FREE Full text] [CrossRef] [Medline]
- Carpenter MJ, Heckman BW, Wahlquist AE, Wagener TL, Goniewicz ML, Gray KM, et al. A naturalistic, randomized pilot trial of e-Cigarettes: uptake, exposure, and behavioral effects. Cancer Epidemiol Biomarkers Prev. 2017;26(12):1795-1803. [FREE Full text] [CrossRef] [Medline]
- Morean ME, L'Insalata A. Electronic cigarette use among individuals with a self-reported eating disorder diagnosis. Int J Eat Disord. 2018;51(1):77-81. [CrossRef] [Medline]
- Napolitano MA, Lynch SB, Stanton CA. Young adult e-Cigarette users: perceptions of stress, body image, and weight control. Eat Weight Disord. 2020;25(2):487-495. [CrossRef] [Medline]
- Morean ME, Wedel AV. Vaping to lose weight: predictors of adult e-Cigarette use for weight loss or control. Addict Behav. 2017;66:55-59. [CrossRef] [Medline]
- Fahey MC, Little MA, Klesges RC, Talcott GW, Richey PA, Mehmet K, et al. Use of tobacco for weight control across products among young adults in the U.S. military. Subst Use Misuse. 2021;56(1):153-161. [FREE Full text] [CrossRef] [Medline]
- Kechter A, Ceasar RC, Simpson KA, Schiff SJ, Dunton GF, Bluthenthal RN, et al. A chocolate cake or a chocolate vape? Young adults describe their relationship with food and weight in the context of nicotine vaping. Appetite. 2022;175:106075. [CrossRef] [Medline]
- Goldberg RL, Cataldo JK. Using an e-Cigarette is like eating tofu when you really want meat. Am J Health Behav. 2018;42(5):54-64. [FREE Full text] [CrossRef] [Medline]
- Singh H, Kennedy RD, Lagasse LP, Czaplicki LM, Cohen JE. E-cigarettes and weight loss-product design innovation insights from industry patents. Nicotine Tob Res. 2018;20(8):1010-1014. [FREE Full text] [CrossRef] [Medline]
- Lose your cravings!. perfectvapordiet. URL: https://www.perfectvapordiet.com/index.php [accessed 2023-06-23]
- Basáñez T, Majmundar A, Cruz TB, Allem JP, Unger JB. e-Cigarettes are being marketed as "Vitamin delivery" devices. Am J Public Health. 2019;109(2):194-196. [CrossRef] [Medline]
- Hod R, Nor NHM, Maniam S. Systematic review on e-Cigarette and its effects on weight gain and adipocytes. PLoS One. 2022;17(7):e0270818. [FREE Full text] [CrossRef] [Medline]
- Hartmann-Boyce J, Theodoulou A, Farley A, Hajek P, Lycett D, Jones LL, et al. Interventions for preventing weight gain after smoking cessation. Cochrane Database Syst Rev. 2021;10(10):CD006219. [FREE Full text] [CrossRef] [Medline]
- Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;350:g7647. [FREE Full text] [CrossRef] [Medline]
- Aromataris E, Munn Z. JBI manual for evidence synthesis. 2020. URL: https://synthesismanual.jbi.global [accessed 2024-01-05]
- Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M, et al. Cochrane handbook for systematic reviews of interventions version 6.1. Cochrane Training. 2020. URL: https://training.cochrane.org/handbook/archive/v6.1 [accessed 2024-01-05]
- Critical appraisal tools. JBI Global. 2020. URL: https://jbi.global/critical-appraisal-tools [accessed 2023-12-15]
- Catalogue of bias. Centre for Evidence Based Medicine. 2019. URL: https://catalogofbias.org/ [accessed 2023-12-13]
- Puljak L, Riva N, Parmelli E, González-Lorenzo M, Moja L, Pieper D. Data extraction methods: an analysis of internal reporting discrepancies in single manuscripts and practical advice. J Clin Epidemiol. 2020;117:158-164. [FREE Full text] [CrossRef] [Medline]
- Balshem H, Helfand M, Schünemann HJ, Oxman AD, Kunz R, Brozek J, et al. GRADE guidelines: 3. rating the quality of evidence. J Clin Epidemiol. 2011;64(4):401-406. [FREE Full text] [CrossRef] [Medline]
- O'Leary R, Qureshi MA, La Rosa GRM, Vernooij RWM, Odimegwu DC, Bertino G, et al. Respiratory and cardiovascular health effects of e-Cigarette substitution: protocol for two living systematic reviews. JMIR Res Protoc. 2021;10(5):e29084. [FREE Full text] [CrossRef] [Medline]
- Manderski MTB, Steinberg MB, Wackowski OA, Singh B, Young WJ, Delnevo CD. Persistent misperceptions about nicotine among US physicians: results from a randomized survey experiment. Int J Environ Res Public Health. 2021;18(14):7713. [FREE Full text] [CrossRef] [Medline]
- Shi R, Feldman R, Liu J, Clark PI. The dilemma of correcting nicotine misperceptions: nicotine replacement therapy versus electronic cigarettes. Health Commun. 2021;36(14):1856-1866. [FREE Full text] [CrossRef] [Medline]
Abbreviations
ENDS: electronic nicotine delivery systems |
GRADE: Grading of Recommendations Assessment, Development, and Evaluation |
JBI: Joanna Briggs Institute |
PICO: Population, Intervention, Comparator, and Outcome |
PRISMA-P: Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols |
Edited by A Mavragani; The proposal for this study was reviewed and funded by the Center of Excellence for the Acceleration of Harm Reduction, University of Catania.submitted 12.01.24; accepted 01.02.24; published 26.03.24.
Copyright©Giusy Rita Maria La Rosa, Maria Ahmed Qureshi, Lucia Frittitta, Erika Anastasi, Riccardo Polosa. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 26.03.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.