This paper is in the following e-collection/theme issue:

Systematic Review Protocols (242) e-Learning and Medical Education (645) Nursing (87) Reviews in Medical Education (52) Nursing Education and Training (107) Reviews in Nursing (15)

Published on in Vol 10, No 1 (2021): January

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/25126, first published .
Technology-Supported Guidance Models Stimulating the Development of Critical Thinking in Clinical Practice: Protocol for a Mixed Methods Systematic Review

Technology-Supported Guidance Models Stimulating the Development of Critical Thinking in Clinical Practice: Protocol for a Mixed Methods Systematic Review

Technology-Supported Guidance Models Stimulating the Development of Critical Thinking in Clinical Practice: Protocol for a Mixed Methods Systematic Review

Authors of this article:

Jaroslav Zlamal1 Author Orcid Image ;   Edith Roth Gjevjon1 Author Orcid Image ;   Mariann Fossum2 Author Orcid Image ;   Marianne Trygg Solberg1 Author Orcid Image ;   Simen Alexander Steindal1 Author Orcid Image ;   Camilla Strandell-Laine3 Author Orcid Image ;   Marie Hamilton Larsen1 Author Orcid Image ;   Fredrik Solvang Pettersen1 Author Orcid Image ;   Andréa Aparecida Gonçalves Nes1 Author Orcid Image
Article Authors Cited by (3) Tweetations (1) Metrics

    Protocol

    1Lovisenberg Diaconal University College, Oslo, Norway

    2University of Agder, Kristiansand, Norway

    3Novia University of Applied Sciences, Åbo, Finland

    Corresponding Author:

    Jaroslav Zlamal, MHP

    Lovisenberg Diaconal University College

    Lovisenberggata 15b

    Oslo, 0456

    Norway

    Phone: 47 95963522

    Email: Jaroslav.Zlamal@ldh.no


    Background: Critical thinking is an essential skill that nursing students need to develop. Technological tools have opened new avenues for technology-supported guidance models, but the challenges and facilitators of such guidance models, as well as how they stimulate the development of critical thinking, remain unclear.

    Objective: We developed a protocol for a mixed methods systematic review to investigate the use of technology-supported guidance models that stimulate the development of critical thinking in nursing education clinical practice.

    Methods: A convergent integrated design following the Joanna Briggs Institute Manual for Evidence Synthesis will be employed. A pair of authors will select the articles by screening titles and abstracts, and the methodological quality of the articles included in the review will be assessed by a pair of authors according to checklists for specific study designs. The data will be extracted using the standardized Joanna Briggs Institute mixed methods data extraction form and following a convergent integrated approach. The thematic synthesis for data transformation will be used.

    Results: Development of a comprehensive systematic search strategy was completed in October 2020. The database searches were performed on October 21, 2020. As of January 2021, analysis and synthesis is ongoing. Completion of this review is expected by January 2021.

    Conclusions: By combining evidence from studies with varied methodological approaches, the results should provide broad insight into the use of technology-supported guidance models for clinical practice in nursing education with a focus on the development of nursing students’ critical thinking. The results of this mixed methods systematic review can also be used to develop or improve current technology-supported guidance models for clinical practice in nursing education.

    International Registered Report Identifier (IRRID): PRR1-10.2196/25126

    JMIR Res Protoc 2021;10(1):e25126

    doi:10.2196/25126

    Keywords

    critical thinking; technology; guidance models; nursing education; clinical practice 


    Background

    Critical thinking is an essential element of the skill set of all health professionals as it enables them to address complex problems and make informed evidence-based decisions [1,2].

    This is especially true in the nursing profession as nurses provide complex, prolonged care to a diverse group of patients [3]. Thus, critical thinking is a prerequisite for being able and enabled to provide safe qualified care [4,5], and it is a key component of undergraduate nursing students’ emerging competencies [6,7]. Clinical practice is an essential part of the nursing curriculum [8] and is the setting best suited to developing nursing students’ necessary skills, such as critical thinking, for their future role as nurses [7].

    Critical thinking is a broad concept, and terms such as clinical decision making, analytical thinking, creative thinking, problem solving, reflective thinking, diagnostic reasoning, and clinical judgement are often used interchangeably to describe critical thinking [9]. Nursing has often adopted definitions of critical thinking that are different from those used in other disciplines [10]. In the consensus definition of critical thinking, cognitive skills such as information seeking, knowledge transformation, logical reasoning, and application of standards are highlighted [11].

    In addition to cognitive skills, self-awareness, creativity, and risk taking are also deemed important [10]. According to Facione [12], critical thinking is a judgement that is purposeful and self-regulatory and that results in a process of interpretation, analysis, evaluation, and inference.

    Clinical practice is an ideal context in which to develop critical thinking [5,13]. This skill is facilitated by a nurse preceptor (a registered nurse working in clinical practice) who, by posing questions, examining problems, and contemplating different ways of thinking about a patient’s situation, stimulates the development of students’ critical thinking [14,15]. Other strategies to stimulate critical thinking among nursing students involve the use of problem-based learning, case-based learning, and concept mapping [9]. A guidance model (a framework of procedures, meetings, and cooperation) between health care and educational institutions is also often used to facilitate the acquisition of nursing students’ competencies in clinical practice [16].

    Novel technologies afford new opportunities for supporting nursing students in clinical practice and developing their critical thinking [17,18], but the use of educational technologies in nursing education lacks a solid evidence base [19], and a wide range of technological tools has been adopted without clear recommendations about their use in nursing education [20].

    In a meta-analysis, Ismail et al [17] reviewed available research on how technological tools, such as mobile technology, might improve nursing students’ critical thinking. Most of the studies in that meta-analysis [17] reported that the use of mobile technology improved critical thinking but that the actual effectiveness of mobile technology in the development of critical thinking remains unclear. Mobile apps incorporate several strategies, such as cooperative learning and problem-based learning, but the mobile apps and strategies in the meta-analysis were not situated in the clinical education and guidance of nursing students.

    Another study, conducted by Lee et al [19], reviewed the use of mobile technology in nursing education and noted that mobile technology is still immature in this field; technology is often used for quickly accessing evidence-based information, submitting various requirements to educational institutions, and communicating with nurse educators, yet its potential to support the development of competencies is unclear.

    Regarding guidance models, Jayasekara et al [21] identified 4 clinical educational models used in clinical practice: the clinical education unit model, the standard facilitation model, the collaborative clinical placement model, and the mentor-arranged clinical placement model. None of these approaches includes the use of technological tools.

    In conclusion, the existing systematic reviews and meta-analyses are limited to the development of critical thinking in nursing education (both in and outside clinical practice) without the use of technological tools [9,22,23]. Consequently, a systematic literature review is needed that focuses on critical thinking as a competency and on its development in clinical practice in nursing education through guidance and the use of technology. This focus can be informed by evidence from various types of studies; therefore, a mixed methods systematic review is appropriate. Mixed methods systematic reviews are suitable for answering complex questions because the methodology allows the inclusion, integration, and discussion of qualitative, quantitative, or mixed methods primary studies [24]. To the best of our knowledge, no earlier reviews or protocols of reviews have appraised existing studies on technology-supported guidance models that aim to stimulate critical thinking among nursing students in clinical practice.

    Aim

    This study outlines a mixed methods systematic review with an overall aim of synthesizing available knowledge about various technology-supported guidance models that employ technological tools in clinical practice to stimulate the development of critical thinking among nursing students.

    Review Questions

    Which technology-supported guidance models are used to stimulate the development of critical thinking in the context of clinical practice in nursing education?

    What is known about the challenges and facilitators of such technology-supported guidance models?


    Design

    This mixed methods systematic review will be guided by the Joanna Briggs Institute Manual for Evidence Synthesis and will have a convergent integrated design [24]. The convergent integrated design involves the transformation, integration, and synthesis of data from primary qualitative, quantitative, or mixed methods studies [24]. The reporting of this systematic mixed methods review protocol is guided by the PRISMA-P (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist [25].

    Eligibility Criteria

    We will include evidence that addresses preregistration or undergraduate nursing students in clinical practice; further details on the inclusion and exclusion criteria are provided in Table 1.

    Table 1. Inclusion and exclusion criteria.
    CriterionInclusionExclusion
    Study populationPreregistration nursing students or undergraduate nursing studentsNursing students studying at the master’s or PhD degree level; postregistration nursing students; student paramedics; students of midwifery, physiotherapy or occupational therapy; medical students; dental students
    Phenomenon of interestTechnological tools used in clinical practice and technology-assisted guidance models or technology-supported guidance models or guidance models or mentoring or tutoring or preceptorship in clinical practice or clinical educational modelsTechnology-assisted guidance models; clinical educational models; guidance models; mentoring, tutoring, or preceptorship outside clinical practice, in clinical labs and as a preparation for clinical practice; simulation or technology use in conjunction with simulation.
    ContextClinical practice in hospitals, nursing homes, community health care, or other health care institutions and settingsOutside clinical practice, such as in classes for preparation for clinical practice, simulation sessions and training in a clinical laboratory
    Type of studyQualitative, quantitative, and mixed methods studies using experimental, quasi-experimental, or nonexperimental design published in peer-reviewed journalsAny type of systematic or nonsystematic review, non–peer-reviewed articles, conference proceedings, comments or opinion articles, official guidelines, national nursing curriculums, editorials, abstracts and doctoral theses
    Type of outcomeCritical thinking, clinical decision making, analytical thinking, creative thinking, problem solving, reflective thinking, diagnostic reasoning, clinical judgementAll other outcomes

    Search Strategy

    A systematic, comprehensive search strategy will be built through an initial search in MEDLINE and CINAHL by an experienced research librarian, the first author, and the last author using subject terms, Medical Subject Heading terms, CINAHL headings, and text words. The search strategy includes terms chosen based on an initial search and discussion within the review team. The search will be limited to publications in English, Slovak, Hungarian, Czech, Spanish, Portuguese, Finnish, Norwegian, Swedish, and Danish. To capture the studies most relevant to current and emerging technologies in nursing education, the search strategy will be limited to articles published from January 1, 2010 through December 31, 2020.

    The search strategy will be tested and retested [26] in the initial databases before it is peer reviewed by a second research librarian. The search strategy will then be applied to CINAHL, Cochrane Trials, Embase, ERIC, MEDLINE, PsycINFO, and Web of Science. An example of the MEDLINE search strategy is provided in Multimedia Appendix 1.

    In addition, forward and backward reference searches will be conducted. A search for unpublished studies and other grey literature will not be included. The rationale for not conducting a search for grey literature is the lack of a standard, accepted systematic procedure for such searches [27]. This lack of a standard procedure, combined with the surfeit of sources of grey literature, could produce a search with unsystematic and random results.

    Data Management

    Records will be managed through EndNote (Clarivate Analytics) [28], and Rayyan (Qatar Computing Research Institute) [29] will be used to facilitate the screening, blinding, organization, and storage of the publications for the study selection process.

    Selection Process

    Titles and abstracts will be screened independently by pairs of authors (AAGN and JZ, ERG and MF, MHL and CS-L, SAS and MTS) based on the inclusion and exclusion criteria for the review. From this selection, the full-text articles will be assessed independently by pairs of authors against the inclusion and exclusion criteria for the review. The final decision on whether to include or exclude articles will be made by consensus between the team of authors. An overview of the selection process that will be used is shown in a PRISMA [30] flow diagram (Figure 1).

    ‎
    Figure 1. PRISMA [29] flow diagram of the selection process that will be used.
    View this figure

    Assessment of Methodological Quality

    Studies eligible for inclusion will be critically assessed for their methodological quality. The critical assessment will be conducted by pairs of authors (AAGN and JZ, ERG and MF, MHL and CS-L, SAS and MTS) according to checklists specific to the study design. The tools used to assess the methodological quality of the studies are shown in Table 2. If required, authors will be contacted for additional data or to provide missing data. During the review process, if a pair of authors disagrees on the assessment of the methodological quality of the articles, either the disagreement will be resolved by discussion between the pair, or another author (the first or last author) will independently appraise the quality of the study.

    All studies, regardless of the results of the assessment of methodological quality, will be included in the data extraction and synthesis, but the results of the assessment of methodological quality will be elaborated on in discussion, and the results will be displayed in appropriate tables.

    Table 2. Checklist for the assessment of methodological quality.
    Type of studyChecklist or tool
    Cohort studiesJoanna Briggs Institute Checklist for Cohort Studies [31]
    Case-control studiesJoanna Briggs Institute Checklist for Case Control Studies [32]
    Qualitative studiesJoanna Briggs Institute Checklist for Qualitative Research [33]
    Cross-sectional studiesAppraisal Tool for Cross-Sectional Studies [34]
    Mixed methods studiesMixed Methods Appraisal Tool [35]
    Quasi-experimental studiesJoanna Briggs Institute Checklist for Quasi-Experimental Studies [36]
    Randomized controlled trialsCochrane Risk-of-Bias Tool [37]

    Data Extraction and Data Items

    Quantitative and qualitative data will be extracted by pairs of authors (AAGN and JZ, ERG and MF, MHL and CS-L, SAS and MTS) from studies that meet the inclusion criteria using the standardized Joanna Briggs Institute mixed methods data extraction form and following a convergent integrated approach [24]. The extracted data will include population, phenomenon of interest, type of study, methods, context, time period and outcomes. Quantitative data will include percentage or average (for descriptive studies) and significant and nonsignificant results (for analytical studies). Qualitative data will include themes and subthemes with, for example, supporting quotations from participants. Qualitative data will be assigned a level of credibility (unequivocal, credible, or not supported) according to the Joanna Briggs Institute Manual for Evidence Synthesis [24].

    Outcomes

    The primary outcome is critical thinking, as defined by Facione [12], as well as synonyms of the term critical thinking, as defined in Table 1.

    Data Transformation, Synthesis, and Integration

    To facilitate combining qualitative and quantitative data, quantitative data will first be transformed into qualitized data. The process of qualitizing data refers to converting quantitative data into themes through textual description of quantitative data in relation to the review question [24]. This will be accomplished by thematic analysis [24]. NVivo (version 12; QSR International) [38] will be used to store and synthesize data. We will use thematic synthesis for data synthesis and integration. Qualitized and qualitative data are assembled according to similar meanings [24]; coding themes are coded and codes are grouped by similarity to develop encompassing themes that will answer the review question. In that manner,

    Confidence in the Cumulative Evidence

    According to the Joanna Briggs Institute Manual for Evidence Synthesis, the assessment of the certainty of evidence using GRADE (Grading of Recommendations Assessment, Development and Evaluation) is not recommended for mixed methods systematic reviews [24].


    A comprehensive systematic search strategy was developed by a research librarian in MEDLINE and CINAHL and reviewed by a second research librarian (completed in October 2020). Initial database searches were performed on October 21, 2020, and resulted in 7307 publications. After the removing 3861 duplicates, we began screening the titles and abstracts of 3446 publications in addition to conducting manual searches and contacting researchers in this field. From the results of this selection, we will assess the full-text articles. We anticipate that the review will be completed by January 2021. Table 3 provides a detailed timeline of the stages of this mixed methods review. The results should clarify the feasibility and reliability of the technological guidance models used in clinical nursing education.

    Table 3. Timeline of completion of the stages of mixed methods review.
    Stage of the reviewDate of completion
    Building a comprehensive search strategyOctober 2020
    Application of the search strategy in databasesNovember 2020
    Screening search results from databasesNovember 2020
    Assessment of methodological qualityDecember 2020
    Data extractionDecember 2020
    Data transformation, synthesis, and integrationJanuary 2021

    General

    In this mixed methods systematic review, we will discuss the contribution of technology to guidance models that are employed in nursing education clinical practice settings, focusing on the stimulation and development of critical thinking among nursing students.

    Significance of the Results

    Technology is an important part of nursing education that has the potential to significantly improve it, especially in clinical practice [18]. Earlier research shows that various technological tools have been implemented in nursing education with varied degrees of use, but their implementation and use in nursing clinical practice sometimes appear unsystematic [20]. This study’s results will enable the improvement of current or the further development of new technology-supported guidance models, which may benefit nursing students, nurse educators, and health care institutions.

    Limitations of the Review

    One of the limitations of this study is the exclusion of unpublished studies and other grey literature. Such material can potentially benefit a systematic review, but the challenges of searching for grey literature and including its findings [27] outweigh its benefits for this study. By choosing a mixed methods systematic review with an integrated convergent design, however, we have facilitated a comprehensive synthesis of peer-reviewed empirical evidence. This approach makes possible broad novel insight into the use, challenges, and facilitators of technology-supported guidance models in nursing clinical practice [24].

    Acknowledgments

    This study is financed by Lovisenberg Diaconal University College and Diku Norwegian Agency for International Cooperation and Quality Enhancement in Higher Education. The funding body has no involvement in any part of the process of this protocol or the final manuscript of the review.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Example of the MEDLINE search strategy.

    DOCX File , 17 KB
    1. Papp KK, Huang GC, Lauzon Clabo LM, Delva D, Fischer M, Konopasek L, et al. Milestones of critical thinking: a developmental model for medicine and nursing. Acad Med 2014 May;89(5):715-720 [FREE Full text] [CrossRef] [Medline]
    2. Sommers CL. Measurement of critical thinking, clinical reasoning, and clinical judgment in culturally diverse nursing students - literature review. Nurse Educ Pract 2018 May;30:91-100. [CrossRef] [Medline]
    3. Mishra S. Respect for nursing professional: silence must be heard. Indian Heart J 2015;67(5):413-415 [FREE Full text] [CrossRef] [Medline]
    4. Kermansaravi F, Navidian A, Kaykhaei A. Critical thinking dispositions among junior, senior and graduate nursing students in Iran. Procedia - Social and Behavioral Sciences 2013 Jul;83:574-579. [CrossRef]
    5. Paul SA. Assessment of critical thinking: a Delphi study. Nurse Educ Today 2014 Nov;34(11):1357-1360. [CrossRef] [Medline]
    6. Hunter S, Pitt V, Croce N, Roche J. Critical thinking skills of undergraduate nursing students: description and demographic predictors. Nurse Educ Today 2014 May;34(5):809-814. [CrossRef] [Medline]
    7. Immonen K, Oikarainen A, Tomietto M, Kääriäinen M, Tuomikoski A, Kaučič BM, et al. Assessment of nursing students' competence in clinical practice: a systematic review of reviews. Int J Nurs Stud 2019 Dec;100:103414. [CrossRef] [Medline]
    8. Warne T, Johansson U, Papastavrou E, Tichelaar E, Tomietto M, Van den Bossche K, et al. An exploration of the clinical learning experience of nursing students in nine European countries. Nurse Educ Today 2010 Nov;30(8):809-815. [CrossRef] [Medline]
    9. Peixoto T, Peixoto N. Critical thinking of nursing students in clinical teaching: an integrative review. Rev Enf Ref 2017 Jun 14;IV Série(13):125-138. [CrossRef]
    10. Yildirim B, Özkahraman S, Karabudak S. The critical thinking teaching methods in nursing students. International Journal of Business and Social Science 2011;2(24). [CrossRef]
    11. Scheffer BK, Rubenfeld MG. A consensus statement on critical thinking in nursing. J Nurs Educ 2000 Nov;39(8):352-359. [Medline]
    12. Facione P. Critical thinking: a statement of expert consensus for purposes of educational assessment and instruction. Insight Assessment. 1990.   URL: https:/​/www.​researchgate.net/​publication/​242279575_Critical_Thinking_A_Statement_of_Expert_Consensus_for_Purposes_of_Educational_Assessment_and_Instruction [accessed 2020-08-15]
    13. Nehrir B, Vanaki Z, Mokhtari Nouri J, Khademolhosseini SM, Ebadi A. Competency in nursing students: a systematic review. International Journal of Travel Medicine and Global Health 2016;4(1):3-11. [CrossRef]
    14. Lima S, Jordan HL, Kinney S, Hamilton B, Newall F. Empirical evolution of a framework that supports the development of nursing competence. J Adv Nurs 2016 Apr;72(4):889-899. [CrossRef] [Medline]
    15. Myrick F. Preceptorship and critical thinking in nursing education. J Nurs Educ 2002 Apr;41(4):154-164. [Medline]
    16. Struksnes S, Engelien RI, Bogsti WB, Moen Ö, Nordhagen SS, Solvik E, et al. Nurses' conceptions of how an alternative supervision model influences their competence in assessment of nursing students in clinical practice. Nurse Educ Pract 2012 Mar;12(2):83-88. [CrossRef] [Medline]
    17. Ismail N, Harun J, Md Salleh S, Megat M. Supporting student`s critical thinking with a mobile learning environment: a meta-analysis. 2016 Presented at: 10th International Technology, Education and Development Conference; March 7-9; Valencia, Spain p. 3746-3755. [CrossRef]
    18. Kim JH, Park H. Effects of smartphone-based mobile learning in nursing education: a systematic review and meta-analysis. Asian Nurs Res (Korean Soc Nurs Sci) 2019 Feb;13(1):20-29 [FREE Full text] [CrossRef] [Medline]
    19. Lee H, Min H, Oh S, Shim K. Mobile technology in undergraduate nursing education: a systematic review. Healthc Inform Res 2018 Apr;24(2):97-108 [FREE Full text] [CrossRef] [Medline]
    20. O'Connor S, Andrews T. Mobile technology and its use in clinical nursing education: a literature review. J Nurs Educ 2015 Mar;54(3):137-144. [CrossRef] [Medline]
    21. Jayasekara R, Smith C, Hall C, Rankin E, Smith M, Visvanathan V, et al. The effectiveness of clinical education models for undergraduate nursing programs: a systematic review. Nurse Educ Pract 2018 Mar;29:116-126. [CrossRef] [Medline]
    22. Kantek F, Yildirim N. The effects of nursing education on critical thinking of students: a meta-analysis. FNJN 2019 Apr 09;27(1):17-25. [CrossRef]
    23. Menezes SSCD, Corrêa CG, Silva RDCGE, Cruz DDAMLD. Clinical reasoning in undergraduate nursing education: a scoping review. Rev Esc Enferm USP 2015 Dec;49(6):1037-1044 [FREE Full text] [CrossRef] [Medline]
    24. Lizarondo L, Stern C, Carrier J. Mixed methods systematic reviews. JBI Manual for Evidence Synthesis. 2020.   URL: https://synthesismanual.jbi.global/ [accessed 2020-09-15]
    25. Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 2015 Jan 02;349:g7647 [FREE Full text] [Medline]
    26. Kable AK, Pich J, Maslin-Prothero SE. A structured approach to documenting a search strategy for publication: a 12 step guideline for authors. Nurse Educ Today 2012 Nov;32(8):878-886. [CrossRef] [Medline]
    27. Paez A. Gray literature: an important resource in systematic reviews. J Evid Based Med 2017 Aug;10(3):233-240. [CrossRef] [Medline]
    28. Endnote. Clarivate Analytics. 2020.   URL: https://endnote.com/ [accessed 2020-10-10]
    29. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev 2016 Dec 05;5(1):210 [FREE Full text] [CrossRef] [Medline]
    30. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
    31. Critical appraisal checklist for cohort studies. Joanna Briggs Institute. 2017.   URL: https:/​/joannabriggs.​org/​sites/​default/​files/​2019-05/​JBI_Critical_Appraisal-Checklist_for_Cohort_Studies2017_0.​pdf [accessed 2020-09-10]
    32. Critical appraisal checklist for case control studies. Joanna Briggs Institute. 2017.   URL: https:/​/joannabriggs.​org/​sites/​default/​files/​2019-05/​JBI_Critical_Appraisal-Checklist_for_Case_Control_Studies2017_0.​pdf [accessed 2020-09-10]
    33. Critical appraisal checklist for qualitative research. Joanna Briggs Institute. 2017.   URL: https:/​/joannabriggs.​org/​sites/​default/​files/​2019-05/​JBI_Critical_Appraisal-Checklist_for_Qualitative_Research2017_0.​pdf [accessed 2020-09-07]
    34. Downes MJ, Brennan ML, Williams HC, Dean RS. Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS). BMJ Open 2016 Dec 08;6(12):e011458 [FREE Full text] [CrossRef] [Medline]
    35. Pluye P, Hong QN. Combining the power of stories and the power of numbers: mixed methods research and mixed studies reviews. Annu Rev Public Health 2014;35:29-45. [CrossRef] [Medline]
    36. Critical appraisal checklist for quasi-experimental studies. Joanna Briggs Institute. 2017.   URL: https://joannabriggs.org/sites/default/files/2019-05/JBI_Quasi-Experimental_Appraisal_Tool2017_0.pdf [accessed 2020-09-11]
    37. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 2019 Aug 28;366:l4898. [CrossRef] [Medline]
    38. NVivo. QSR International. 2020.   URL: https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home [accessed 2020-10-10]

    Edited by G Eysenbach; submitted 19.10.20; peer-reviewed by IV George, C Mather, I Shubina; comments to author 10.11.20; revised version received 22.11.20; accepted 24.11.20; published 19.01.21

    Copyright

    ©Jaroslav Zlamal, Edith Roth Gjevjon, Mariann Fossum, Marianne Trygg Solberg, Simen Alexander Steindal, Camilla Strandell-Laine, Marie Hamilton Larsen, Fredrik Solvang Pettersen, Andréa Aparecida Gonçalves Nes. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 19.01.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.