Protocol
Abstract
Background: Bedside ultrasonography, also known as point-of-care ultrasound (PoCUS), is a promising technological tool that enhances clinical assessment, enriching diagnostic capabilities and clinical reasoning. Its use in nursing spans various patient populations and health care settings, providing nurses with a valuable health assessment tool to improve care quality and patient safety. Despite its growing integration into clinical practice, PoCUS training has mainly focused on physicians, leaving a gap for trained nurses who demonstrate similar proficiency in conducting scans and interpreting images. Previous research highlights the value of digital tools in PoCUS training, showing their role in improving professionals’ and students’ knowledge, image interpretation skills, and clinical acumen.
Objective: This study aimed to (1) establish an assessment instrument gauging nurses’ competency milestones in PoCUS and evaluate its content and appearance validity, (2) develop a series of 5 educational videos focused on PoCUS and assess their content and appearance validity, and (3) construct an online learning environment tailored to nurses’ PoCUS training needs and evaluate its content and appearance validity.
Methods: We will conduct a methodological study of technological production guided by Rogers’ diffusion of innovations theory. Subproject 1 will design and validate a comprehensive assessment tool for evaluating nurses’ competency milestones in PoCUS use. For this purpose, a scoping review will be conducted. The review will be based on JBI Collaboration guidelines and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extended for Scoping Reviews (PRISMA-ScR) checklist. Subproject 2 involves an evaluation of content and appearance validity for a series of 5 educational videos on PoCUS, designed specifically for nurses about applying peripherally inserted central catheter lines, inserting nasogastric feeding tubes, assessing gastric residual volume, assessing pressure injuries and soft tissue conditions, and assessing muscle mass to monitor patient nutritional status. In subproject 3, a comprehensive online learning environment dedicated to PoCUS training for nurses will be developed and validated. The launch of an online learning environment represents a cornerstone of our dissemination strategy, scheduled to coincide with the inaugural Brazilian PoCUS symposium for nurses, an event organized by the project members. This platform will serve as a pivotal resource for continuous learning and professional development.
Results: Subproject 1 will start in the second half of 2024 and is expected to be completed by mid-2025. Subproject 2 is currently ongoing and is expected to be completed in early 2026. Subproject 3 is set to begin in early 2025 and is planned to be completed by 2026.
Conclusions: Through these concerted efforts, the project aims to bridge the existing gap in PoCUS training for nurses, thereby fostering their proficiency and enhancing patient care outcomes.
International Registered Report Identifier (IRRID): PRR1-10.2196/58030
doi:10.2196/58030
Keywords
Introduction
Background
Mitigating harm in health care settings is a fundamental duty and responsibility of nurses. The nursing process, with its structured stages, serves as a critical tool in minimizing patient risk by enabling nurses to systematically prioritize health needs and devise outcome-focused care plans [
]. Furthermore, the nursing process embodies the clinical methodology of the nursing profession, enhancing decision-making capabilities and fostering effective communication within the multidisciplinary health care team [ ].The initial phase of the nursing process involves a thorough and accurate data collection or nursing assessment [
, ]. This foundational step is crucial for establishing a comprehensive understanding of the patient’s current health status, which in turn, guides the identification of nursing diagnoses and the determination of outcomes that are responsive to nursing interventions. In this context, nurses leverage technological advancements to bolster their assessments and decision-making processes.Among these technologies, point-of-care ultrasound (PoCUS) stands out as a particularly promising tool. PoCUS enhances clinical assessments by providing immediate, real-time imaging support for clinical reasoning and diagnosis [
]. This cost-effective and reliable modality generates internal body images using sound waves, with the procedure involving the application of a transducer on the skin’s surface. PoCUS has gained widespread adoption for bedside diagnostics and treatment guidance, offering rapid and efficient solutions [ , ].Defined as both a portable bedside tool for immediate diagnostic or therapeutic use and a means for the instantaneous acquisition, interpretation, and clinical integration of ultrasound images by health care professionals, PoCUS has transcended its traditional medical confines. Research indicates its use and competency extend to nonmedical professionals [
- ], broadening its application across various clinical settings and care phases, from diagnostic screening to procedure guidance and monitoring [ - ].The integration of PoCUS into clinical practice has been transformative, equating its diagnostic accuracy with that of conventional imaging methods like x-rays and computerized tomography scans. Its routine application not only reduces the reliance on more invasive tests and patient radiation exposure but also contributes to cost-effective patient care [
, ]. This has led to the proposition of ultrasound as the “fifth pillar” of physical examination, augmenting the traditional quartet of inspection, palpation, percussion, and auscultation [ ].In nursing, the application of PoCUS is diverse, spanning across patient populations [
] and health care levels, from primary [ ] to critical [ , ] and emergency care [ , ]. Its use in bedside nursing facilitates the early detection of physiological dysfunctions, thereby enabling more timely and informed clinical decisions crucial for lifesaving interventions [ ]. Furthermore, PoCUS complements the physical examination [ , , ], aids clinical reasoning [ ], supports nursing diagnoses, monitors sensitive outcome indicators, and guides invasive procedures [ , ].In Brazil, the Federal Nursing Council has formally recognized the role of nurses in using bedside ultrasound through Technical Opinion 0052/2021/CTLN/DGEP/COFEn, with specific stipulations regarding its use and the requirement for specialized training. This regulatory endorsement underscores the evolving scope of nursing practice and the integration of advanced technologies like PoCUS in enhancing patient care and outcomes [
].Despite the increasing recognition of PoCUS as an invaluable tool within nursing practices, a notable gap persists in the literature concerning specialized PoCUS training programs tailored specifically for nurses. While the deployment of PoCUS across various levels of health care underscores its versatility and critical role in enhancing patient care, the existing body of research predominantly focuses on its clinical applications and diagnostic capabilities, rather than on educational frameworks or curricula designed to equip nurses with the requisite skills and knowledge. This discrepancy highlights an educational void, where detailed, nurse-specific training methodologies; competency standards; and assessment criteria remain underexplored. Therefore, this lack of dedicated research into structured PoCUS training programs for nurses not only impedes the standardization of PoCUS proficiency among nurses but also limits the potential for its full integration into nursing care practices. Addressing this gap is essential for ensuring that nurses are adequately prepared to use PoCUS effectively, thereby maximizing its benefits for patient assessment, diagnosis, and management within the nursing scope of practice.
Primary Objectives
The primary objectives of this study were to (1) design and validate a comprehensive assessment instrument for evaluating nurses’ competency milestones in PoCUS use, (2) develop and disseminate a series of structured educational videos tailored for nurses on the application of PoCUS, and (3) establish a comprehensive online learning environment dedicated to PoCUS training for nurses.
Secondary Objectives
This study also aimed to (1) conduct a comprehensive analysis of content and appearance validity for the PoCUS competency assessment tool tailored for nurses; (2) undertake a rigorous evaluation of content and appearance validity for a series of 5 educational videos on PoCUS designed specifically for nurses about applying peripherally inserted central catheter (PICC) lines, inserting nasogastric feeding tubes, assessing gastric residual volume, assessing pressure injuries and soft tissue conditions, and assessing muscle mass to monitor patient nutritional status; and (3) assess the content and appearance validity of the online learning environment dedicated to PoCUS training for nurses.
Methods
Subproject 1
To achieve the first general and specific objectives, subproject 1 was proposed.
Objective
The main objective of this subproject is to establish an assessment tool gauging nurses’ competency milestones in PoCUS and evaluate its content and appearance validity.
This endeavor will undertake a thorough investigation into both the content and appearance validity of the proposed tool, ensuring that it precisely captures the competencies it purports to measure. By adopting a systematic methodology, the study aspires to forge a robust and credible framework for the evaluation of nurses’ proficiency in using PoCUS, making a substantial contribution to the discipline. This endeavor is predicated on the premise that the assessment tool accurately mirrors the quintessential abilities and knowledge indispensable for efficacious clinical application.
In the context of this study, competence is delineated as the consistent and adept execution of a task, seamlessly integrating it into everyday clinical practice. Drawing on the scholarly work of Kumar et al [
], the competency domains identified for effective PoCUS use to encompass a spectrum include (1) the acquisition of foundational knowledge, (2) the practical application of this knowledge, (3) the demonstration of technical and procedural adeptness, (4) the seamless integration of these skills into clinical routines, and (5) the process of certification and recertification to ensure ongoing proficiency and adherence to evolving standards. This comprehensive approach underscores the multifaceted nature of competence in PoCUS, highlighting the importance of a well-rounded and continuous learning process. Through this study, we aim to establish an evaluative mechanism that not only assesses but also promotes the growth of these critical competencies among nurses, thereby enhancing the quality of patient care through the proficient use of PoCUS.Study Design
To curate items for each domain of the proposed assessment tool, a comprehensive scoping review will be orchestrated. The scoping review will be conducted following the JBI Collaboration guidelines and reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extended for Scoping Reviews (PRISMA-ScR) checklist [
, ].Data Source
This review will leverage a wide array of databases to ensure a thorough exploration of the subject matter. These databases include but are not limited to Cochrane, CINAHL, Embase, PubMed, PsycINFO, Scopus, ERIC, and Scielo. In addition to these repositories, an extensive search of the gray literature will be conducted, encompassing resources such as Google Scholar, as well as repositories of theses and dissertations, to capture a broad spectrum of insights and evidence.
The scoping review will be characterized by its inclusivity, imposing no restrictions on the time frame or language of the studies considered. The inclusion criteria are designed to embrace primary research studies, including review articles, randomized controlled trials, cohort studies, and cross-sectional analyses, while excluding surveys, case reports, textbook chapters, conference proceedings, ongoing research, editorials, and comments. The process of determining relevant descriptors and keywords will be a collaborative effort with a librarian from the University of São Paulo who specializes in systematic reviews, ensuring a comprehensive and targeted search strategy.
Given the objective to acquire a holistic understanding of the field and pinpoint gaps in the existing body of research, the quality of the studies will not be appraised. This process will commence with 2 independent reviewers evaluating studies for inclusion based on their titles and abstracts, adhering to predefined eligibility criteria. In instances where titles and abstracts do not provide sufficient information for preliminary selection, full texts will be examined.
Reference Manager
The Rayyan Systems platform will further a double-blind selection process of articles, ensuring an unbiased and efficient review. Discrepancies in the selection process will be reconciled through discussion with a third reviewer.
For organization and analysis, selected articles will be managed using EndNote (version X9, Clarivate Analytics), which will assist in the removal of duplicates and promote the analytical process [
, ].Data Extraction
The data extraction will encompass a diverse range of information, including but not limited to, the name of the instrument, authorship details, the country of development, language, publication year, constructs measured, target population, mode of instrument application, scale content and item number, response formats, and scoring methods (
). Furthermore, a detailed examination of the psychometric properties of each instrument will be conducted, with findings presented in tabular format. Additional data pertaining to the objectives, design, interventions, participants, sample sizes, and outcomes of the studies will also be extracted and systematically organized in tables, enhancing the clarity and accessibility of the evidence synthesized [ ].The review will be registered with PROSPERO (International Prospective Register of Systematic Reviews) in the second semester of 2024.
Drawing upon the comprehensive insights garnered from the scoping review, a designed assessment tool will be developed to evaluate nurses’ competency milestones throughout their PoCUS training journey. This tool will be intricately aligned with the competency domains delineated by Kumar et al [
], ensuring a robust framework that encapsulates essential skills and knowledge. Following its development, the instrument will be subjected to a validation process, involving an evaluation by a professional proficient in Portuguese and a panel of nurses who boast significant experience in PoCUS-related care, education, and research. The Delphi technique [ ], renowned for its structured communication process and consensus-building capabilities, will be used to expedite this evaluation, ensuring a comprehensive and iterative assessment.Given the nascent stage of PoCUS use among Brazilian nurses and the limited pool of experts in this domain, the selection of experts will leverage the snowball sampling technique [
]. This method is particularly suited to the context, allowing for the identification and recruitment of key informants through the networks of initial participants, thereby ensuring a panel enriched with specialized knowledge and experience. Participants who do not return the completed assessment tools within a stipulated 30-day period will be considered nonresponsive and thus excluded from the study.The recruitment of experts will be conducted through intentional nonprobabilistic sampling, emphasizing the deliberate selection of individuals based on their expertise and experience in PoCUS. Upon their voluntary agreement to partake in the research, evidenced by written consent, these experts will embark on a critical evaluation of the assessment tool. Their scrutiny will focus on the clarity of indicators, their theoretical relevance, and practical applicability, using a dichotomous scale of “agree” or “disagree” for each item. This systematic evaluation process is designed to ensure that each item on the assessment tool is clear, relevant, and practically applicable to the context of nursing practice.
To ascertain the content validity of the tool, the content validity ratio (CVR) for each indicator will be calculated. The CVR, a statistical measure of content validity, will serve as a quantitative gauge of the extent to which the items are deemed essential by the panel of experts [
]. The acceptance threshold for the CVR will be determined based on the number of experts participating in the assessment, adhering to established methodological standards. This validation process aims to establish an accepted assessment tool that accurately reflects the competencies necessary for effective PoCUS application by nurses, thereby contributing to the enhancement of training and practice in this evolving domain [ , ].Subproject 2
To achieve the second general and specific objectives, subproject 2 was proposed.
Objective
The main objective of this subproject is to develop a series of 5 educational videos focused on PoCUS and assess their content and appearance validity.
Study Design
This methodological investigation uses a cross-sectional design, underpinned by the theoretical perspectives of Fleming et al [
]. It is set to unfold at the Ribeirão Preto College of Nursing, University of São Paulo, an institution renowned for its Nursing Practice Simulation Center, a state-of-the-art recording studio, and a dedicated multimedia team.Given the emergent status of PoCUS expertise among Brazilian health care professionals, experts will be identified through a snowball sampling technique [
], ensuring a comprehensive representation of knowledge in this nascent field. Participants who fail to return their assessments within a 30-day window will be respectfully excluded from the study, emphasizing the importance of timely feedback. Recruitment will be intentional and nonprobabilistic, targeting individuals who demonstrate a profound understanding and experience in PoCUS. Those agreeing to partake in the study will be required to sign an informed consent form, marking their voluntary commitment to this scholarly endeavor.The research is structured into distinct phases, each designed to ensure the elaboration and validation of high-quality educational content.
Phase I: Preproduction
This initial phase involves a narrative literature review focused on the procedural skills necessary for the ultrasound-guided insertion of PICC lines and nasogastric feeding tubes. In addition, it will explore the use of ultrasound in assessing gastric residual volume, pressure injuries and soft tissue conditions, and muscle mass, particularly in relation to patient nutritional status. This comprehensive review will span several databases including CINAHL, Embase, LILACS, PubMed, and Scopus, without constraints on publication date or language. Furthermore, textbooks and both national and international guidelines will be consulted to ensure a thorough understanding of the subject matter, including content about the physical principles of ultrasound.
Phase II: Production
Informed by the insights gathered in phase I, this phase involves the development of scripts and storyboards for the educational videos, adhering to the best practices as recommended by Fleming et al [
]. PoCUS experts, including physicians and nurses, will be invited to contribute to this creative process, ensuring the content’s relevance and accuracy. Following previous studies [ - ], the Delphi technique [ ] will be used to refine the scripts and storyboards, with participants providing their expertise through a structured, iterative consultation process.To evaluate the content validity evidence of the scripts and storyboards for the educational videos, a tool, refined from Ferreira’s [
] methodology, will be used ( ). This comprehensive tool encompasses 6 pivotal categories, namely objectives, content, relevance, environment, verbal language, and inclusion of topics, ensuring a holistic assessment of the educational materials. Each category will be scrutinized using a nuanced 4-point Likert scale, where a rating of 4 signifies “strongly agree,” 3 denotes “agree,” 2 indicates “disagree,” and 1 represents “strongly disagree.” In addition, the tool thoughtfully includes a section for experts to articulate their detailed opinions and constructive suggestions on each evaluated item, fostering a rich, collaborative refinement process.Upon the completion of this assessment by the panel of experts, a collaborative scheduling process will be initiated with the multimedia department of Ribeirão Preto College of Nursing, University of São Paulo, to plan the filming sessions. These sessions will take place in the Nursing Practice Simulation Center, ensuring a conducive environment for high-quality video production. The filming will necessitate the use of a portable ultrasound device, equipped with both linear and convex transducers, to accurately depict the procedures. In addition, simulators will be used to promote the realistic demonstration of the insertion of PICC lines and nasogastric tubes, guided by ultrasound technology. To further enhance the realism and educational value of the videos, volunteers will be recruited to portray patients, providing authentic scenarios for the nurses. These nurses will demonstrate the invasive procedures using simulators or clinical assessments using volunteers, showcasing practical applications of the skills being taught.
Phase III: Postproduction
This final phase focuses on the editing and polishing of the educational videos. The Ribeirão Preto College of Nursing, University of São Paulo, multimedia department will lend their expertise in video editing, using advanced software to enhance the educational content with graphic animations, text, images, and sound. Professional voice-over narration will be recorded to accompany the visuals, ensuring clarity and engagement. Upon completion, the videos will undergo a validation process, assessing both content and appearance validity with the help of PoCUS experts and audiovisual technicians.
Throughout this process, the project will leverage the Moodle system of the University of São Paulo [
] to enhance communication and collaboration among the experts. This online learning environment will host the scripts, storyboards, and validation tools, providing a centralized platform for the validation process. To evaluate the appearance of the educational materials, the study will implement the Instrument for Appearance Validity of Educational Technology in Health (IVATES) [ ] ( ). This tool comprises 12 targeted questions, each measured against a detailed 5-point Likert scale for nuanced feedback. The scale ranges from 1, indicating “completely disagree,” to 5, representing “completely agree,” allowing experts to precisely express their assessment of the educational content’s effectiveness and aesthetic appeal.To tailor this tool specifically for the unique demands of this study, thoughtful adaptations will be made. Notably, the original term “illustrations” will be substituted with “video segments” to better reflect the multimedia nature of the content being evaluated. Similarly, “figures” will be replaced with “images” to more accurately describe the visual elements used within the educational videos. In addition, a pivotal modification will be made to question 12, which will now focus on “assistance in teaching-learning procedures.” This change shifts the emphasis from assessing attitudinal changes to evaluating the direct educational impact of the videos, aligning the instrument more closely with the study’s objectives.
Data Analysis
Data characterizing PoCUS experts will be stored in the University of São Paulo Moodle platform for subsequent download into Microsoft Excel spreadsheets. They will then be transferred to the SPSS (version 26.0; IBM Corp). Descriptive statistics will be used for analysis, including measures of central tendency and dispersion for quantitative variables, and absolute and relative frequencies for categorical variables. Data normality will be checked using the Shapiro-Wilk test, with a distribution considered normal when P>.05.
During the evaluation stage of the video’s content validity, the CVR will be calculated according to Ayre and Scally [
]. The CVR ranges from –1 to +1, with positive values indicating that more than half of the experts deemed the item essential. Ayre and Scally [ ] proposed a table with minimum CVR values based on the number of experts, to determine an item’s acceptability at a 5% significance level.For the evaluation of the appearance of the videos, the appearance validity index (AVI) will be used, where the AVI for each item (AVI-I) will be calculated by dividing the number of experts who rate the item as 4 or 5 by the total number of participants. For the total AVI (AVI-T), the sum of the AVI-I values will be divided by the total number of items. An item with an AVI≥0.78 will be considered excellent; values between 0.60 and 0.77 will indicate the need for adjustments to improve the appearance of the educational health technology; an item with an AVI<0.60 will be classified as unsatisfactory, and the material will need to be revised starting from the key point of the item. The AVI-T should be ≥0.90 [
]. Data analysis will be conducted by a statistician from the Ribeirão Preto College of Nursing, University of São Paulo.Subproject 3
Objective
The main objective of this subproject is to construct an online learning environment tailored to nurses’ PoCUS training needs and evaluate its content and appearance validity.
Study Design
This cutting-edge methodological study in nursing education is grounded in the seminal work of Rogers’ [
] diffusion of innovations theory. At the heart of this theory is the concept of innovation, defined as a novel idea, practice, knowledge, or object that is perceived as new by an individual or community and is integrated into their practices, leading to significant behavioral transformations. For such innovations to gain widespread acceptance and integration, they should be disseminated through effective communication channels that ensure easy accessibility. A prime example of this is the online learning environment, which transcends the traditional constraints of time and space, thereby promoting a seamless and impactful implementation of innovative educational strategies.The process of adopting an innovation is delineated into five distinct stages [
]: (1) knowledge, the stage at which an individual gains awareness and understanding of the innovation; (2) persuasion, the stage where an individual develops a favorable attitude towards the innovation; (3) decision, the critical juncture at which an individual decides whether to embrace or reject the innovation; (4) implementation, the phase where the individual actively starts using the innovation, signifying a behavioral shift; and (5) confirmation, the final stage where the individual reaffirms their commitment to the innovation and fully integrates it into their practice. This study will delve into the initial 3 stages to uncover the dynamics of innovation adoption within the context of nursing education.To further the development of the online learning environment, the instructional design will adhere to the comprehensive “ADDIE” model, which encompasses 5 pivotal phases: analyze, design, develop, implement, and evaluate [
].Analysis Phase
Recognizing the nascent yet growing importance of ultrasound use in nursing, this phase will be addressed through subprojects 1 and 2, laying the groundwork for an informed instructional strategy.
Design Phase
The online learning environment will be crafted with learning objectives that span a broad spectrum of ultrasound applications in nursing. These objectives will include (1) mastering ultrasound-guided PICC line insertion, (2) learning ultrasound-guided nasogastric tube insertion techniques, (3) conducting qualitative and quantitative assessments of gastric residual volume to avert bronchopulmonary aspiration through PoCUS, (4) evaluating pressure injuries and soft tissue conditions using PoCUS, and (5) assessing muscle mass to monitor patient nutritional status with a focus on PoCUS.
Development Phase
The online learning environment will be structured into 5 comprehensive modules, each designed to address the learning objectives outlined. These modules will incorporate instructional videos that elucidate basic ultrasound principles and demonstrate procedural techniques essential for effective examinations, developed as part of subproject 2. To enrich the learning experience, the modules will also include recommended additional readings, anatomical landmark flashcards for quick recognition, educational quizzes to reinforce key concepts, pre- and post–self-assessment tests to gauge learning progress, and clinical case studies. These case studies are designed to foster clinical reasoning skills, with a strong emphasis on the nursing process and the integration of standardized nursing language systems, including NANDA International, Inc [
], Nursing Outcomes Classification (NOC) [ ], and Nursing Interventions Classification (NIC) [ ]. The modules will be created by experts in PoCUS and nursing education.Implementation
During the implementation phase, the online learning environment will be evaluated through both content and appearance validity evidence analysis, ensuring its educational efficacy and user engagement. The content validity will be assessed by a panel of physicians and nurses, each boasting expertise in the relevant subject matter. This evaluation will be expedited through the use of the content validity index (CVI) [
, ], with experts being carefully selected through intentional nonprobabilistic sampling methods to ensure a comprehensive and informed review process. Similarly, the appearance validity will be scrutinized by professionals well-versed in the domain, using the IVATES tool [ ] ( ) to guarantee a thorough appraisal of the online learning environment’s instructional design and content relevance.In a strategic move to enhance the evaluation process, this project will incorporate the evaluation tool developed by Ferreira [
] ( ), which categorizes the assessment criteria into 6 distinct domains: objectives, content, relevance, environment, verbal language, and inclusion of topics. Each category will be evaluated using a 4-point Likert scale, ranging from “strongly agree” to “strongly disagree,” providing a nuanced framework for feedback. In addition, this tool thoughtfully allows experts to articulate their reasoning for any disagreements, further enriching the feedback with detailed insights and constructive suggestions for each evaluated item.Evaluation Phase
Upon the completion of the content and appearance validity evidence analysis by the panel of experts, the online learning environment will transition to a pilot testing phase, engaging a select group of nurses to interact with and evaluate the system. Their experiences and perceptions will be captured through the System Usability Scale, Brazilian version [
] ( ), an instrument comprising 10 items, scored on a scale from “strongly disagree” to “strongly agree.” This scale not only aligns semantically, idiomatically, conceptually, and culturally with its original English counterpart but also demonstrates exceptional reliability and structural construct validity, ensuring a credible and comprehensive assessment of the online learning environment’s usability.Data Analysis
The content validity evidence for the online learning environment will be quantitatively assessed through the calculation of the CVI, with items receiving scores of 4 or 5 by experts deemed positively validated. The criteria for validity will follow established benchmarks, with a CVI≥0.78 indicating excellent validity, scores between 0.60 and 0.77 classified as good, and scores <0.59 considered poor [
, ].To determine the overall usability score derived from the application of the System Usability Scale, Brazilian version [
], a calculation process will be used. For odd-numbered statements, the score assigned by the evaluator will be reduced by 1, whereas for even-numbered statements, it will be reduced by 5. The aggregated individual scores will then be multiplied by 2.5 to obtain the total scale value. This final score will speed a nuanced interpretation of the online learning environment’s usability, ranging from the worst imaginable scenario to an ideal scenario, thus providing a comprehensive understanding of the user’s perception and the system’s overall performance. Data analysis will be conducted by a statistician from the Ribeirão Preto College of Nursing, University of São Paulo.Ethical Considerations
The project was submitted for ethical review to the Research Ethics Committee of the Ribeirão Preto College of Nursing, University of São Paulo, in November 2023 (Institutional Review Board approval 78296623.2.0000.5393). This submission underscores our commitment to conducting the study in strict adherence to Resolution 466, dated December 12, 2012, issued by the National Council of Ethics in Research of the Ministry of Health. In addition, all participants will be furnished with an informed consent form (
).It is important to note that participation in this study will not entail any financial burden on the participants, nor will it offer any direct monetary incentives. The anticipated risks associated with participation are deemed minimal, primarily concerning the potential inconvenience due to the time investment required for engaging with the research tools. To alleviate any potential discomfort, we will offer participants the flexibility to complete the tools at their own pace, in multiple sittings if preferred.
In the event of any unforeseen harm arising from participation in the study, we are fully prepared to uphold the participants’ rights to compensation, in alignment with the prevailing legal standards of the country. This assurance is extended by both the research team and the sponsoring institution, highlighting our commitment to participant welfare.
Furthermore, we acknowledge the inherent risks associated with the digital environment, particularly the limitations of current technologies that may impede our ability to ensure absolute confidentiality and the potential risk of data breaches. Participants will, therefore, be advised to retain a copy of all electronic communications for their records. In an effort to mitigate these risks, upon the conclusion of the study, all collected data will be securely transferred to a password-protected computer, accessible solely to the project team members. Subsequently, all data stored on the online platform will be permanently erased.
While the direct involvement of specialists in this study may not yield immediate personal gains, it is anticipated to offer significant indirect and long-term professional benefits. The educational materials developed, including videos and the online learning environment, are expected to substantially enhance nurses’ comprehension of the subject matter, thereby promoting future scholarly endeavors. Furthermore, the potential benefits of this study extend beyond the immediate academic community, promising to effectuate enduring improvements in nursing care for adult patients across all health care settings. This endeavor thus represents a commitment to ethical research conduct, participant protection, and the advancement of nursing education and patient care on a broader scale.
Results
Subproject 1 will start in the second half of 2024 and is expected to be completed by mid-2025. Subproject 2 is currently ongoing and is expected to be completed in early 2026. Subproject 3 is set to begin in early 2025 and is planned to be completed by 2026.
Discussion
Expected Findings
Previous studies have highlighted the importance of PoCUS in clinical settings, particularly in enhancing diagnostic accuracy [
, , , ] and patient outcomes [ - ]. However, there has been a lack of standardized tools to assess nurses’ competency in using PoCUS. This study builds on the foundational work of researchers like Fleming et al [ ], who have emphasized the need for structured educational materials and competency assessments. By incorporating a scoping review and expert consultations, this research addresses the gaps identified in previous studies and will offer a validated assessment tool [ , ].The results will be showcased through presentations at undergraduate and master’s thesis defenses, marking a significant contribution to the academic discourse. Furthermore, to ensure the findings are accessible to a diverse audience, they will be published in esteemed journals within the field. A deliberate focus will be placed on journals indexed in prestigious databases such as the ISI Web of Science and Scopus, with publications available in Portuguese, English, and Spanish.
The strengths of this study include its comprehensive methodology, which uses a scoping review following JBI Collaboration guidelines to ensure a thorough exploration of the subject matter. The involvement of PoCUS experts, including physicians and nurses, in the development of scripts and storyboards enhances the content’s relevance and accuracy. In addition, the iterative validation process, which uses the Delphi technique for refining educational materials, ensures that the content is rigorously evaluated and validated by experts. However, there are limitations to consider. The study is conducted within a specific institutional context (Ribeirão Preto College of Nursing, University of São Paulo), which may limit the generalizability of the findings to other settings. The development and validation processes are resource-intensive, requiring significant time and expert involvement. Furthermore, the reliance on expert opinions in the Delphi technique may introduce bias, although this is mitigated through structured, iterative consultations [
].Subproject 2 focuses on the creation and validation of 5 educational videos specifically designed for nurses. The expected results from this subproject include the development of high-quality, validated educational videos that can be integrated into nursing curricula. These videos aim to enhance nurses’ practical skills and confidence in using PoCUS, ultimately improving patient care. The results will be showcased through presentations at undergraduate and master’s thesis defenses and will be published in esteemed journals. Summarizing key findings and insights will be produced and disseminated through YouTube, complemented by strategic promotions through social media channels such as Facebook (Meta) and Instagram (Meta), as well as on the official websites of the participating universities. Recognizing the importance of linguistic diversity and inclusivity, one of the videos will be specially crafted in Spanish to cater to the Spanish-speaking audience. This initiative will be bolstered by the support from Sigma (Latin America and Caribbean Region), leveraging the unique position of a Chilean group member who is currently a master’s student in the Fundamental Nursing Graduate Program at Ribeirão Preto College of Nursing, University of São Paulo.
Subproject 3 aims to construct and evaluate evidence of content and appearance validity for an online learning environment tailored to nurses’ PoCUS training needs. This potent education resource is designed to foster clinical reasoning skills with a strong emphasis on the nursing process and the integration of standardized nursing language. The evaluation phase will involve pilot testing the online learning environment with a select group of nurses, capturing their experiences and perceptions through the System Usability Scale, Brazilian version. The results from this subproject will provide valuable insights into the usability and effectiveness of the online learning environment in enhancing PoCUS training for nurses.
Future research should focus on assessing the long-term impact of these educational videos and the online learning environment on nursing practice and patient outcomes. In addition, exploring the implementation of these educational resources in diverse health care settings will help evaluate their effectiveness and adaptability. Investigating the integration of advanced technologies, such as online reality and artificial intelligence, to enhance the educational experience is another promising area for future research.
To ensure the findings are accessible to a diverse audience, the results will be disseminated through multiple channels. Academic publications in esteemed journals indexed in prestigious databases such as ISI Web of Science and Scopus will be pursued. The results will also be presented at undergraduate and master’s thesis defenses, as well as at national and international conferences. Workshops and training sessions will be organized for nurses and health care professionals to share the validated assessment tool, educational videos, and online learning environment. In addition, online platforms and social media will be used to reach a broader audience and facilitate knowledge sharing and collaboration. Key findings and insights will be disseminated through YouTube and promoted through social media channels such as Facebook and Instagram, as well as on the official websites of the participating universities.
Conclusions
The anticipated outcomes of this research underscore its potential to significantly enhance the competency of nurses in using PoCUS through the development and validation of a robust assessment tool. By addressing the current gaps in standardized competency evaluations, this study aims to elevate the quality of nursing education and clinical practice. The creation of high-quality educational videos and a tailored online learning environment is expected to provide nurses with practical, accessible, and engaging resources that foster both skill acquisition and confidence in PoCUS procedures. These educational interventions are poised to improve patient care outcomes by ensuring that nurses are well equipped to perform PoCUS with proficiency.
Furthermore, the dissemination of the findings through various academic and public channels will promote widespread adoption and integration of these resources into nursing curricula globally. The iterative validation process involving PoCUS experts ensures the relevance and accuracy of the educational content, while the use of advanced methodologies like the Delphi technique and structured scoping reviews guarantees a rigorous evaluation framework.
In conclusion, this research protocol not only aims to fill a critical void in PoCUS competency assessment but also aspires to set a new standard in nursing education. By leveraging innovative educational tools and methodologies, the study promises to contribute to the ongoing professional development of nurses and ultimately enhance patient care across diverse health care settings. The commitment to ethical research conduct and participant protection further strengthens the study’s foundation, ensuring that the outcomes are both scientifically sound and socially responsible.
Acknowledgments
This research was supported by the Unified Scholarship Program of the Office of the Dean of Undergraduate Studies at the University of São Paulo, which provided scholarships to the undergraduate students involved in the project. In addition, we acknowledge the Coordination for the Improvement of Higher Education Personnel (CAPES) for providing a scholarship to the master’s student associated with this research project.
We hereby declare that the research project was submitted to the São Paulo Research Foundation (FAPESP) for funding acquisition in March 2024.
In addition, we hereby declare that we used ChatGPT (OpenAI) [
] solely for the purpose of enhancing English writing proficiency.Authors' Contributions
FG contributed to the conceptualization of ideas and the formulation or evolution of overarching research goals and aims. AMS performed the supervision (oversight and leadership responsibility) for the research activity planning and execution, including mentorship external to the core team. RMB contributed to the data curation and management activities to annotate (produce metadata), scrub data, and maintain research data (including software code, where it is necessary for interpreting the data itself) for initial use and later reuse. VBS handled the project administration (management and coordination responsibility) for the research activity planning and execution. MGM and MSR contributed to writing—review and editing and the preparation, creation, and presentation of the published work by those from the original research group, specifically critical review, commentary, or revision (including pre- or postpublication stages). PRdP performed the investigation by conducting a research and investigation process, specifically performing the experiments or data and evidence collection. FGC contributed to the methodology (development or design of methodology) and creation of models. SANR performed the validation (verification), whether as a part of the activity or separately, of the overall replication or reproducibility of results, experiments, and other research outputs.
Conflicts of Interest
None declared.
Data extraction tool.
PDF File (Adobe PDF File), 35 KBValidation of the educational video script tool.
PDF File (Adobe PDF File), 81 KBIVATES (Instrument for Appearance Validity of Educational Technology in Health) tool.
PDF File (Adobe PDF File), 225 KBSystem Usability Scale, Brazilian version.
PDF File (Adobe PDF File), 108 KBInformed consent forms.
PDF File (Adobe PDF File), 153 KBReferences
- Gimenes FRE, Baysari M, Walter S, Moreira LA, Carvalho REFLD, Miasso AI, et al. Are patients with a nasally placed feeding tube at risk of potential drug-drug interactions? A multicentre cross-sectional study. PLoS One. Jul 31, 2019;14(7):e0220248. [FREE Full text] [CrossRef] [Medline]
- do Prado PR, Silveira RCCP, Vettore MV, Fossum M, Vabo GL, Gimenes FRE. Nursing interventions to prevent corneal injury in critically ill sedated and mechanically ventilated patients: a systematic review of interventions. Intensive Crit Care Nurs. 2023;78:103447. [CrossRef] [Medline]
- Alfaro-Lefevre R. Aplicação Do Processo De Enfermagem: uma Ferramenta Para o Pensamento Crítico. Porto Alegre, Brazil. Artmed; 2014.
- Parecer de Câmara Técnica N° 0052/2021/CTLN/DGEP/COFEN. Atuação do Enfermeiro com Ultrassom a beira do leito e no ambiente do Pré-Hospitalar [Article in Portuguese]. COFEN: Conselho Federal de Enfermagem. Sep 3, 2021. URL: https://www.cofen.gov.br/parecer-de-camara-tecnica-n-o-0052-2021-ctln-dgep-cofen/ [accessed 2024-02-14]
- Totenhofer R, Luck L, Wilkes L. Point of care ultrasound use by registered nurses and nurse practitioners in clinical practice: an integrative review. Collegian. 2021;28(4):456-463. [CrossRef]
- Szabó GV, Szigetváry C, Szabó L, Dembrovszky F, Rottler M, Ocskay K, et al. Point-of-care ultrasound improves clinical outcomes in patients with acute onset dyspnea: a systematic review and meta-analysis. Intern Emerg Med. 2023;18(2):639-653. [FREE Full text] [CrossRef] [Medline]
- Itoh T, Gorga S, Hashikawa A, Cranford J, Thomas J, Hatton C, et al. Point-of-care ultrasound for pediatric endotracheal tube placement confirmation by advanced practice transport nurses. Air Med J. 2020;39(6):448-453. [CrossRef] [Medline]
- Yamada T, Ehara J, Funakoshi H, Endo K, Kitano Y. Effectiveness of point of care ultrasound (POCUS) simulation course and skills retention for Japanese nurse practitioners. BMC Nurs. 2023;22(1):21. [FREE Full text] [CrossRef] [Medline]
- Rath KA, Bonomo JB, Ballman K. Point-of-care ultrasonography for advanced practice providers: a training initiative. The Journal for Nurse Practitioners. 2023;19(2):104435. [CrossRef]
- Burton SO, Donovan JK, Jones SL, Meadley BN. Can non-physician providers use ultrasound to aid in establishing peripheral IV access in patients who are difficult to cannulate? A scoping review. Prehosp Disaster Med. 2022;37(4):535-546. [FREE Full text] [CrossRef] [Medline]
- Corcoran E, Hopkins P, Fisher R, Wong A, Rose L. Intensive care nurse-led point of care ultrasound in the assessment and management of the critically ill COVID-19 patient: a single centre case series. Nurs Crit Care. 2023;28(5):781-788. [FREE Full text] [CrossRef] [Medline]
- Baker K, Brierley S, Kinnear F, Isoardi K, Livesay G, Stieler G, et al. Implementation study reporting diagnostic accuracy, outcomes and costs in a multicentre randomised controlled trial of non-expert lung ultrasound to detect pulmonary oedema. Emerg Med Australas. 2020;32(1):45-53. [CrossRef] [Medline]
- Ünlüer EE, Karagöz A, Oyar O, Vandenberk N, Kiyançiçek S, Budak F. Lung ultrasound by emergency nursing as an aid for rapid triage of dyspneic patients: a pilot study. Int Emerg Nurs. 2014;22(4):226-231. [CrossRef] [Medline]
- Díaz-Gómez JL, Mayo PH, Koenig SJ. Point-of-care ultrasonography. N Engl J Med. 2021;385(17):1593-1602. [CrossRef] [Medline]
- Valla FV, Tume LN, Jotterand Chaparro C, Arnold P, Alrayashi W, Morice C, et al. Gastric point-of-care ultrasound in acutely and critically ill children (POCUS-ped): a scoping review. Front Pediatr. 2022;10:921863. [FREE Full text] [CrossRef] [Medline]
- Pontet J, Yic C, Díaz-Gómez JL, Rodriguez P, Sviridenko I, Méndez D, et al. Impact of an ultrasound-driven diagnostic protocol at early intensive-care stay: a randomized-controlled trial. Ultrasound J. 2019;11(1):24. [FREE Full text] [CrossRef] [Medline]
- Brower CH, Baugh CW, Shokoohi H, Liteplo AS, Duggan N, Havens J, et al. Point-of-care ultrasound-first for the evaluation of small bowel obstruction: national cost savings, length of stay reduction, and preventable radiation exposure. Acad Emerg Med. 2022;29(7):824-834. [FREE Full text] [CrossRef] [Medline]
- Maw AM, Huebschmann AG, Mould-Millman NK, Dempsey AF, Soni NJ. Point-of-care ultrasound and modernization of the bedside assessment. J Grad Med Educ. 2020;12(6):661-665. [FREE Full text] [CrossRef] [Medline]
- Narula J, Chandrashekhar Y, Braunwald E. Time to add a fifth pillar to bedside physical examination: inspection, Palpation, percussion, auscultation, and insonation. JAMA Cardiol. 2018;3(4):346-350. [CrossRef] [Medline]
- Lucenti E, Lavelli L, de Luca W, Beretta M. Ultrasound applied to nursing in the emergency medical service (EMS): a scoping review. IJ. 2022;1(1):37-47. [CrossRef]
- Schoch M, Bennett PN, Currey J, Smith V, Orellana L, Hutchinson AM. Point-of-care ultrasound-guided cannulation versus standard cannulation in hemodialysis vascular access: a controlled random order crossover pilot feasibility study. J Vasc Access. 2023;24(5):1140-1149. [CrossRef] [Medline]
- Rigobello MCG, Elias Junior J, Bonacim CAG, Silveira RCDCP, Bonardi FC, Nunes RS, et al. Accuracy of the combined method (auscultation and pH measurement) and ultrasonography for confirmation of gastric tube placement: a study protocol for a prospective study. BMJ Open. 2020;10(9):e036033. [FREE Full text] [CrossRef] [Medline]
- Kumar A, Kugler J, Jensen T. Evaluation of trainee competency with point-of-care ultrasonography (POCUS): a conceptual framework and review of existing assessments. J Gen Intern Med. 2019;34(6):1025-1031. [CrossRef] [Medline]
- Peters MDJ, Godfrey C, McInerney P, Khalil H, Larsen P, Marnie C, et al. Best practice guidance and reporting items for the development of scoping review protocols. JBI Evid Synth. 2022;20(4):953-968. [CrossRef] [Medline]
- Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for Scoping Reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467-473. [FREE Full text] [CrossRef] [Medline]
- Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al. Cochrane Handbook for Systematic Reviews of Interventions. London. Cochrane; 2019.
- Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. PLoS Med. 2021;18(3):e1003583. [CrossRef] [Medline]
- Chen Q, Huang C, Castro AR, Tang S. Instruments for measuring nursing research competence: a protocol for a scoping review. BMJ Open. 2021;11(2):e042325. [FREE Full text] [CrossRef] [Medline]
- Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401-409. [CrossRef] [Medline]
- Atkinson R, Flint J. Accessing hidden and hard-to-reach populations: snowball research strategies. 2001. URL: https://sru.soc.surrey.ac.uk/SRU33.PDF [accessed 2024-09-17]
- Ayre C, Scally A. Critical values for Lawshe’s content validity ratio. Measurement and Evaluation in Counseling and Development. 2014;47(1):79-86. [CrossRef]
- Almanasreh E, Moles R, Chen TF. Evaluation of methods used for estimating content validity. Res Social Adm Pharm. 2019;15(2):214-221. [CrossRef] [Medline]
- Fleming SE, Reynolds J, Wallace B. Lights... camera... action! a guide for creating a DVD/video. Nurse Educ. 2009;34(3):118-121. [CrossRef] [Medline]
- Nascimento TS, de Souza Neto VL, Bottura Leite de Barros AL, Lopes CT, de Lima Lopes J. Development and validation of an educational video on nasopharyngeal and oropharyngeal suctioning. Nurse Educ Pract. 2021;56:103217. [CrossRef] [Medline]
- Campos DCD, Silva LFD, Reis AT, Góes FGB, Moraes JRMMD, Aguiar RCBD. Development and validation of an educational video to prevent falls in hospitalized children. Text & Context Nursing. URL: https://www.scielo.br/j/tce/a/d9Tszkbt4QWhKWr3V8X7sMp/?format=pdf&lang=en [accessed 2024-09-17]
- Magnabosco P, Godoy SD, Mendes IAC, Raponi MBG, Toneti BF, Marchi-Alves LM. Production and validation of an educational video on the use of the Z-track technique. Rev Bras Enferm. 2023;76(2):e20220439. [FREE Full text] [CrossRef] [Medline]
- Ferreira MVF. Dressing of Central Venous Catheters: Supports for Nursing Teaching and Care. Ribeirão Preto, Brazil. Universidade de São Paulo, Ribeirão Preto; 2013.
- Disciplinas da USP: ambiente virtual de apoio à graduação e pós-graduação. Universidade de São Paulo, e-Disciplinas. 2024. URL: https://edisciplinas.usp.br/acessar/ [accessed 2024-09-23]
- Souza ACCD, Moreira TMM, Borges JWP. Development of an appearance validity instrument for educational technology in health. Rev Bras Enferm. 2020;73(suppl 6):e20190559. [FREE Full text] [CrossRef] [Medline]
- Rogers EM. Diffusion of Innovations. New York, NY. Free Press; 2003.
- Patel SR, Margolies PJ, Covell NH, Lipscomb C, Dixon LB. Using instructional design, analyze, design, develop, implement, and evaluate, to develop e-learning modules to disseminate supported employment for community behavioral health treatment programs in New York State. Front Public Health. 2018;6:113. [FREE Full text] [CrossRef] [Medline]
- Herdman TH, Lopes CT, Kamitsuru S. Diagnóstico De Enfermagem Da NANDA-I: Definições e Classificações 2021-2023. Porto Alegre, Brazil. Artmed; 2021:544.
- Moorhead S. Classificação dos Resultados De Enfermagem (NOC). 6th ed. São Paulo, Brazil. GEN Guanabara Koogan; 2020.
- Butcher HK. NIC Classificação Das Intervenções de Enfermagem. 7th ed. Rio de Janeiro, Brazil. Guanabara Koogan; 2020.
- Lourenço DF, Valentim EC, Lopes MHBDM. Translation and cross-cultural adaptation of the System Usability Scale to Brazilian Portuguese. Aquichan. 2022;22(2):1-16. [CrossRef]
- Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459-467. [CrossRef] [Medline]
- Spampinato MD, Luppi F, Cristofaro E, Benedetto M, Cianci A, Bachechi T, et al. Diagnostic accuracy of point of care ultrasound (POCUS) in clinical practice: a retrospective, emergency department based study. J Clin Ultrasound. 2024;52(3):255-264. [CrossRef] [Medline]
- Concannon E, McHugh S, Healy DA, Kavanagh E, Burke P, Clarke Moloney M, et al. Diagnostic accuracy of non-radiologist performed ultrasound for abdominal aortic aneurysm: systematic review and meta-analysis. Int J Clin Pract. 2014;68(9):1122-1129. [CrossRef] [Medline]
- Balmuth EA, Luan D, Jannat-Khah D, Evans A, Wong T, Scales DA. Point-of-care ultrasound (POCUS): assessing patient satisfaction and socioemotional benefits in the hospital setting. PLoS One. 2024;19(2):e0298665. [FREE Full text] [CrossRef] [Medline]
- Szabó GV, Szigetváry C, Szabó L, Dembrovszky F, Rottler M, Ocskay K, et al. Point-of-care ultrasound improves clinical outcomes in patients with acute onset dyspnea: a systematic review and meta-analysis. Intern Emerg Med. 2023;18(2):639-653. [FREE Full text] [CrossRef] [Medline]
- Mosier JM, Stolz U, Milligan R, Roy-Chaudhury A, Lutrick K, Hypes CD, et al. Impact of point-of-care ultrasound in the emergency department on care processes and outcomes in critically ill nontraumatic patients. Crit Care Explor. 2019;1(6):e0019. [FREE Full text] [CrossRef] [Medline]
- Aakjær Andersen C, Brodersen J, Davidsen AS, Graumann O, Jensen MBB. Use and impact of point-of-care ultrasonography in general practice: a prospective observational study. BMJ Open. 2020;10(9):e037664. [FREE Full text] [CrossRef] [Medline]
- ChatGPT. OpenAI. URL: https://chatgpt.com/ [accessed 2024-10-17]
Abbreviations
AVI: appearance validity index |
AVI-I: appearance validity index for each item |
AVI-T: total appearance validity index |
CVI: content validity index |
CVR: content validity ratio |
IVATES: Instrument for Appearance Validity of Educational Technology in Health |
NIC: Nursing Interventions Classification |
NOC: Nursing Outcomes Classification |
PICC: peripherally inserted central catheter |
PoCUS: point-of-care ultrasound |
PRISMA-ScR: Preferred Reporting Items for Systematic Reviews and Meta-Analyses extended for Scoping Reviews |
PROSPERO: International Prospective Register of Systematic Reviews |
Edited by A Mavragani; submitted 03.03.24; peer-reviewed by F Meza; comments to author 24.05.24; revised version received 13.07.24; accepted 22.08.24; published 23.10.24.
Copyright©Fernanda Raphael Escobar Gimenes, Angelita Maria Stabile, Rodrigo Magri Bernardes, Vinicius Batista Santos, Mayra Gonçalves Menegueti, Patricia Rezende do Prado, Mauricio Serra Ribeiro, Flavia Giron Camerini, Soraia Assad Nasbine Rabeh. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 23.10.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.