Published on in Vol 11, No 5 (2022): May

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/34071, first published .
Toward More Inclusive Networks and Initiatives in Innovation Ecosystems: Protocol for a Systematic Review

Toward More Inclusive Networks and Initiatives in Innovation Ecosystems: Protocol for a Systematic Review

Toward More Inclusive Networks and Initiatives in Innovation Ecosystems: Protocol for a Systematic Review

Protocol

1Discovery Foundation, Heraklion, Crete, Greece

2FAME Laboratory, Department of Physical Education and Sport Science, University of Thessaly, Trikala, Greece

Corresponding Author:

Andreas D Flouris, PhD

FAME Laboratory

Department of Physical Education and Sport Science

University of Thessaly

Karies, TEFAA

Trikala, 42100

Greece

Phone: 30 2431047072

Email: andreasflouris@gmail.com


Background: Expanding the cooperation and enlarging the participation of more diverse stakeholders within innovation ecosystems will increase their efficiency and capacity to contribute at local, regional, and national levels.

Objective: This paper presents the protocol for a systematic review that will identify “opening-up” strategies of innovation ecosystems for increasing the participation of more diverse innovation stakeholders, particularly from low-innovation countries, during the ecosystem formation period.

Methods: An algorithmic search in 4 databases (Web of Science, Cochrane Library, Scopus, and Social Science Research Network) will be applied based on the PerSPecTIF (perspective, setting, phenomenon of interest/problem, environment, optional comparison, time/timing, and findings) methodology, the Cochrane guidelines for qualitative evidence synthesis, and the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Selection criteria for eligibility include peer-reviewed articles published after December 31, 1999, and containing original data. No restrictions will be placed on the article language and study region, design, or methodology. Methodological strengths and limitations will be assessed using the Critical Appraisal Skills Programme tool. The thematic synthesis method will be adopted, and the GRADE-CERQual tool will be used to assess confidence.

Results: A preliminary search in Web of Science revealed 2758 records. This work is part of the ANGIE project, which was funded by the European Union’s Horizon 2020 research and innovation program (grant 952152) in January 2021. We anticipate that the results of this systematic review will be published in spring 2022.

Conclusions: We anticipate that the outcomes of this systematic review will outline the best practices used by initiatives and networks, as well as their impacts on creating larger and more inclusive ecosystems.

Trial Registration: OSF Registries osf.io/hc62k 10.17605/OSF.IO/HC62K

International Registered Report Identifier (IRRID): PRR1-10.2196/34071

JMIR Res Protoc 2022;11(5):e34071

doi:10.2196/34071

Keywords



The “innovation ecosystem” is an umbrella term used to describe the common efforts of different stakeholders to achieve innovation [1,2]. Suppliers provide key parts and technologies that are complemented by products and services provided by a variety of other actors, while customers establish demand and capabilities. In this process of joint value creation, companies gain a competitive advantage by appreciating the overall value of the products and services delivered to customers [1,3-5]. Themes including cooperation between actors, creation and acquisition of value by organizations, and ecosystem leadership have received increasing interest from both practitioners and scholars [6]. Nevertheless, the activities and processes taking place during the ecosystem genesis and expansion phases have received limited attention and many relevant knowledge gaps remain [7,8]. Therefore, there is an urgent need to increase our understanding regarding the formation of innovation ecosystems at their early stage and the formation of roles within these structures of collaboration [2].

Expanding the cooperation and enlarging the participation of more diverse stakeholders within innovation ecosystems will undoubtedly increase their efficiency and capacity to contribute at local, regional, and national levels [9,10]. It will also allow innovation ecosystems to capitalize on opportunities arising from lower costs, improved expertise, as well as new markets and technologies [11-13]. Nevertheless, this topic has received limited attention to date despite having a significant impact not only on policies aiming to promote the economic welfare of sectors, regions, and countries but also on innovation research and practice. Therefore, it is crucial to identify effective methods of “opening-up” for innovation ecosystems to broaden the participation of innovation stakeholders, particularly from low-innovation countries and during the ecosystem formation period. This period of ecosystem evolution is the most fragile, as described in recent research [2,7,8]. Therefore, external provision of the necessary conditions, resources, and activities during this period will have the highest impact. Opening-up strategies include collaborative innovation strategies; network-, market-, and crowd-based innovation strategies [14,15]; and any other activities aiming to increase the ecosystem’s inclusiveness by enlarging the participation of more diverse innovation actors and broadening the participation among different types of stakeholders [16-19].

The aim of this systematic review will be to identify opening-up strategies of innovation ecosystems for increasing the participation of more diverse innovation stakeholders, particularly from low-innovation countries, during the ecosystem formation period. The available evidence on this issue has not been summarized to date to provide a comprehensive understanding of how inclusive innovation ecosystems are formed. The research question expressed via the PerSPecTIF (perspective, setting, phenomenon of interest/problem, environment, optional comparison, time/timing, and findings) statement [20] is presented in Table 1.

Table 1. Question formulation based on the PerSPecTIF (perspective, setting, phenomenon of interest/problem, environment, optional comparison, time/timing, and findings) framework [20] for qualitative evidence syntheses.
ElementsQuestion formulation
PerFrom the perspective of innovation stakeholders
SParticularly from low-innovation countries
PWhat are the strategies for “opening-up”
eWithin innovation ecosystems
(c)N/Aa
TiUp to and including ecosystem formation
F In relation to increasing the participation of more diverse innovation stakeholders

aNot applicable


Overview

The planned systematic review will be conducted according to the current Cochrane guidelines for qualitative evidence synthesis [21] and will be reported in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines [22]. The relevant PRISMA 2020 checklist [22] can be found in Multimedia Appendix 1. The review team includes members trained in systematic review methodology. The protocol has been registered in the Open Science Foundation registry. In case any amendments to this protocol are made during the review process, changes and related reasons will be reported in the final article.

We employed the feasible, interesting, novel, ethical, and relevant (FINER) approach [23] to test the applicability of the research question expressed via the PerSPecTIF statement. The outcome of the FINER approach is presented below:

  • Feasible: There is an adequate number of studies for inclusion in the systematic review, since a preliminary algorithmic search in the Web of Science database retrieved 2758 records. Also, the technical expertise of the review team, the dedicated time, and the available funding guarantee its successful completion.
  • Interesting: The research questions are interesting, as the systematic review is aiming to provide vital information on opening-up strategies of innovation ecosystems to increase the participation of more diverse innovation stakeholders, particularly from low-innovation countries, during the ecosystem formation period. It is crucial to understand these strategies during the genesis of the ecosystem because it is the most fragile during this period of its evolution. Therefore, external provision of the necessary conditions, resources, and activities during this period will have the highest impact.
  • Novel: The systematic review will not only confirm previous findings but will also produce new findings for increasing the participation of more diverse innovation stakeholders to be used for future policies and actions.
  • Ethical: There are no ethical concerns regarding the current systematic review process, as it will be entirely based on published evidence accumulation.
  • Relevant: The research questions are relevant to current knowledge, practices, and policies pertaining to innovation.

Inclusion Criteria

Studies investigating opening-up strategies of innovation ecosystems for increasing the participation of more diverse innovation stakeholders will be included. We will consider observational studies that provide original data, independently of the design and methodology adopted.

Exclusion Criteria

We will exclude narrative reviews, systematic reviews, perspectives, opinion articles, and other publications that do not include original data.

Years Considered

The selected scientific databases will be searched from January 1, 2000, to present. All searches will be updated prior to submission of the final manuscript, in case the date of the initial search is more than 12 months older than the date of submission [24,25]. New records will be screened and evaluated based on the inclusion and exclusion criteria set above.

Publication Language

We anticipate a large body of the literature on the topic of this systematic review to be in English. No articles will be excluded based on language, but our search will be conducted using English terms. Articles in languages other than the ones spoken by the coauthors of this study (English, Greek, and German) will be translated into English using Google Translate following previous methodologies [26]. If Google Translate does not generate a good translation or if we are in doubt about the translation generated for a non-English manuscript, the paper will be assessed by a native speaker.

Search Strategy

We will perform a keyword algorithmic search in scientific databases that focus on research topics relevant to our research question. These databases are as follows: Web of Science [27], Cochrane Library [28], Scopus [29], and Social Science Research Network [30].

The search algorithm will be built according to the PerSPecTIF statement [20] described in Table 1 and will be adjusted to the environment of each database. An example of translating the PerSPecTIF statement to appropriate indexing terms based on existing guidelines [21] is shown in Table S1 (Multimedia Appendix 2). A preliminary search on the Web of Science database using these search terms revealed a total of 1301 records. The algorithm is also provided in Multimedia Appendix 2.

In the algorithmic searching we will use Booleans (ie, OR, AND, NEXT, etc) and possibly truncations as well as wildcard characters (*, ?). Finally, we will also check the reference lists of the included studies for potential eligible publications that did not appear in the initial search approach. To comply with the Multi Engine Command Instrument Rating (MECIR) requirement and Conduct of Systematic Reviews in Toxicology and Environmental Health Research (COSTER) recommendations regarding the updating of the searches within 12 months prior to publication of a systematic search [24,25], we will rerun all searches shortly before the final analyses, and any further relevant studies identified will be retrieved for inclusion.

The above-mentioned pilot algorithm was judged by the review team as applicable and appropriate to be used in the official searching procedure. As such, 2 members of the review team, GN and EM, independently conducted the official searching in the selected scientific databases (from the date of their inception to October 2021). The search algorithm was “translated” from one database to another so that it is compatible with the corresponding website’s search engine. ADF confirmed no disagreement between the team members GN and EM in applying the algorithms in all 3 databases.

Study Selection

The retrieved studies from the searching procedure will be managed using the Rayyan online platform [31]. Two reviewers (GN and ADF) with previous experience in conducting systematic reviews will independently screen the retrieved publications for eligibility. A third reviewer (EM) will act as a referee and resolve any potential conflicts. Then, all reviewers will share their notes to confirm and finalize the selection of studies. All 3 reviewers will be provided with written instructions on the selection process and will undergo pilot testing of the systematic review selection procedures on a small subset of the records retrieved. The methodology of the selection process is as follows:

  1. The first step includes removing duplicated papers that will arise from the searching procedure.
  2. The second step includes checking the publications against the eligibility criteria based on titles and abstracts. At this stage, we will exclude records that are not relevant and do not fulfil 1 or more of the inclusion criteria listed above.
  3. The third step includes checking the full texts of the remaining publications against the eligibility criteria. This step will result in the final list of the eligible publications.

A PRISMA flow diagram will be created to describe in detail the procedures of searching and selection of publications in this systematic review [22,32]. A full list of the excluded articles will be provided in the final systematic review paper.

Data Extraction

For each eligible publication, an individual data extraction form will be incorporated. Two review team members will independently extract data from the eligible publications and a referee- investigator will make an ultimate decision in case of a disagreement between review team members. A priori pilot data extraction will be used so that the 2 review team members agree on including missing data that were not initially considered or data that do not need to be extracted. Each team member will extract their data in an Excel spreadsheet (Microsoft Corp). In cases where the presented data are unclear in the articles’ full text, the data extraction review team members will contact the corresponding authors via email to retrieve them.

Assessment of Methodological Strengths and Limitations

According to the existing guidelines [21], we will assess methodological strengths and limitations as a marker of study rigour using the Critical Appraisals Skills Programme (CASP) tool [33]. CASP is a previously published, commonly used, and validated tool to assess methodological strengths and limitations of qualitative studies [21]. Also, it has shown an interrater agreement of >92% [34]. According to the existing guidelines [21], the aim of this assessment will not be to calculate total quality scores but to provide evidence for a discussion on the studies, their “risk to rigour,” as well as whether their methodological limitations may have affected the systematic review findings.

Data Synthesis

We will use the thematic synthesis method to produce syntheses that can subsequently be integrated with an intervention review or analysis.

Assessing Confidence

Based on the existing guidelines [21], we will use the GRADE-CERQual tool to assess confidence in the qualitative synthesized findings. This tool evaluates 4 components (relevance, methodological limitations, adequacy, and coherence) to provide an overall assessment of confidence in the synthesized qualitative findings.


As indicated above, a preliminary search in the Web of Science database revealed 2758 records. This confirms that the systematic search procedure will generate adequate information to achieve the objective of this review. This work is part of the ANGIE project, which was funded by the European Union’s Horizon 2020 research and innovation program (grant 952152). The ANGIE project was initiated in January 2021. We anticipate that the results of this systematic review will be published in spring 2022.


It is anticipated that the outcomes of this systematic review will outline the best practices used by initiatives and networks, as well as their impacts on creating larger and more inclusive ecosystems with a shared, clearly defined purpose. Additionally, this systematic review will shed light on the steps that innovation ecosystems take to implement a solid opening-up strategy, with the goal of enlarging and broadening the participation and commitment of more stakeholders and encouraging collaborative partnering.

Overall, this systematic review aims to uncover the strategies used by previous and existing ecosystems to become inclusive, fostering the participation of stakeholders at all levels of innovation capacity and taking into consideration gender equality and diversity. Even actors who are moderate and modest innovators can be instrumental, particularly in the early phase of an ecosystem formation [9,10]. Therefore, identifying opening-up strategies of innovation ecosystems for increasing the participation of more diverse innovation stakeholders, particularly from low-innovation countries, during the ecosystem formation period will increase the involvement of different stakeholders and maximize an ecosystem’s innovation potential.

Acknowledgments

This work is part of the ANGIE project and has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement 952152.

Authors' Contributions

All authors contributed equally to drafting, writing, and reviewing this protocol.

Conflicts of Interest

None declared.

Multimedia Appendix 1

PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist.

PDF File (Adobe PDF File), 198 KB

Multimedia Appendix 2

Describing literature search strategy.

DOCX File , 34 KB

  1. Gomes LADV, Facin ALF, Salerno MS, Ikenami RK. Unpacking the innovation ecosystem construct: Evolution, gaps and trends. Technol Forecast Soc Change 2018 Nov;136:30-48. [CrossRef]
  2. Dedehayir O, Mäkinen SJ, Roland Ortt J. Roles during innovation ecosystem genesis: a literature review. Technol Forecast Soc Change 2018 Nov;136:18-29. [CrossRef]
  3. Arena M, Azzone G, Piantoni G. Uncovering value creation in innovation ecosystems: paths towards shared value. EJIM 2021 Nov 09;25(6):432-451. [CrossRef]
  4. Ketonen-Oksi S, Valkokari K. Innovation ecosystems as structures for value co-creation. TIM Review 2019 Feb 28;9(2):25-35 [FREE Full text] [CrossRef] [Medline]
  5. Adner R, Kapoor R. Value creation in innovation ecosystems: how the structure of technological interdependence affects firm performance in new technology generations. Strat Mgmt J 2010 Mar;31(3):306-333. [CrossRef]
  6. Durst S, Poutanen P. Success factors of innovation ecosystems: a literature review. In: CO-CREATE 2013 : The Boundary-Crossing Conference on Co-Design in Innovation. Espoo, Finland: Aalto University Publication series SCIENCE + TECHNOLOGY; 2013 Presented at: CO-CREATE 2013; July 16-19; Espoo, Finland p. 27-38.
  7. Dias Sant´Ana T, de Souza Bermejo PH, Moreira MF, de Souza WVB. The structure of an innovation ecosystem: foundations for future research. MD 2020 Feb 26;58(12):2725-2742. [CrossRef]
  8. Dedehayir O, Seppänen M. Birth and expansion of innovation ecosystems: a case study of copper production. J Technol Manag 2015 Jul;10(2):145-154. [CrossRef]
  9. Hollanders H, Es-Sadki N. Regional Innovation Scoreboard 2021. European Commission. 2021.   URL: https://ec.europa.eu/docsroom/documents/46032/attachments/1/translations/en/renditions/native [accessed 2022-04-19]
  10. Jewell C. Global innovation index 2021: tracking innovation through the COVID-19 crisis. Wipo Magazine. 2021 Sep.   URL: https://www.wipo.int/wipo_magazine/en/2021/03/article_0002.html [accessed 2022-04-19]
  11. Gu Y, Hu L, Zhang H, Hou C. Innovation ecosystem research: emerging trends and future research. Sustainability 2021 Oct 16;13(20):11458. [CrossRef]
  12. Zahra SA, Nambisan S. Entrepreneurship in global innovation ecosystems. AMS Rev 2011 May 19;1(1):4-17. [CrossRef]
  13. Gamidullaeva L. Towards combining the innovation ecosystem concept with intermediary approach to regional innovation development. MATEC Web Conf 2018 Oct 15;212. [CrossRef]
  14. Saebi T, Foss NJ. Business models for open innovation: matching heterogeneous open innovation strategies with business model dimensions. Eur Manag J 2015 Jun;33(3):201-213. [CrossRef]
  15. Adner R. Match your innovation strategy to your innovation ecosystem. Harv Bus Rev 2006 Apr;84(4):98-107; 148. [Medline]
  16. Pollitzer E, Schraudner M. Integrating gender dynamics into innovation ecosystems. Sociology and Anthropology 2015 Nov;3(11):617-626. [CrossRef]
  17. Alsos G, Haugum M, Ljunggren E. Gender equality in regional entrepreneurial ecosystems: the implementation of policy initiatives. In: Entrepreneurial Ecosystems and Growth of Women’s Entrepreneurship: A Comparative Analysis. Cheltenham, UK: Edward Elgar Publishing; Jun 30, 2017:221-243.
  18. Barabino GA. Reframing innovation. Technol Innov 2019 Aug 05;20(4):361-366. [CrossRef]
  19. Karlsson C, Rickardsson J, Wincent J. Diversity, innovation and entrepreneurship: where are we and where should we go in future studies? Small Bus Econ 2019 Oct 24;56(2):759-772. [CrossRef]
  20. Booth A, Noyes J, Flemming K, Moore G, Tunçalp Ö, Shakibazadeh E. Formulating questions to explore complex interventions within qualitative evidence synthesis. BMJ Glob Health 2019;4(Suppl 1):e001107 [FREE Full text] [CrossRef] [Medline]
  21. Noyes J, Booth A, Cargo M, Flemming K, Harden A, Harris J, et al. Chapter 21: Qualitative evidence. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al, editors. Cochrane Handbook for Systematic Reviews of Interventions (version 62). London, UK: Cochrane; Feb 01, 2021:1-189.
  22. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021 Mar 29;372:n71 [FREE Full text] [CrossRef] [Medline]
  23. Farrugia P, Petrisor BA, Farrokhyar F, Bhandari M. Practical tips for surgical research: research questions, hypotheses and objectives. Can J Surg 2010 Aug;53(4):278-281 [FREE Full text] [Medline]
  24. Higgins J, Lasserson T, Chandler J, Tovey D, Thomas J, Flemyng E, et al. Methodological Expectations of Cochrane intervention reviews (MECIR). In: MECIR Manual. London, UK: Cochrane; Feb 24, 2021.
  25. Whaley P, Aiassa E, Beausoleil C, Beronius A, Bilotta G, Boobis A, et al. Recommendations for the conduct of systematic reviews in toxicology and environmental health research (COSTER). Environ Int 2020 Oct;143:105926 [FREE Full text] [CrossRef] [Medline]
  26. Hansen MRH, Jørs E, Sandbæk A, Kolstad HA, Schullehner J, Schlünssen V. Exposure to neuroactive non-organochlorine insecticides, and diabetes mellitus and related metabolic disturbances: Protocol for a systematic review and meta-analysis. Environ Int 2019 Jun;127:664-670 [FREE Full text] [CrossRef] [Medline]
  27. Web of Science.   URL: https://apps.webofknowledge.com [accessed 2022-04-20]
  28. Cochrane Library.   URL: https://www.cochranelibrary.com/ [accessed 2022-04-20]
  29. Scopus.   URL: https://www.scopus.com [accessed 2022-04-20]
  30. SSRN.   URL: https://www.ssrn.com [accessed 2022-04-19]
  31. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev 2016 Dec 05;5(1):210 [FREE Full text] [CrossRef] [Medline]
  32. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol 2009 Oct;62(10):e1-34 [FREE Full text] [CrossRef] [Medline]
  33. Making sense of evidence: 10 questions to help you make sense of qualitative research. CASP: Critical Appraisal Skills Programme.   URL: https://casp-uk.net/wp-content/uploads/2018/01/CASP-Qualitative-Checklist-2018.pdf [accessed 2022-04-19]
  34. Kordzadeh A, Parsa AD. A systematic review of distal revascularization and interval ligation for the treatment of vascular access-induced ischemia. J Vasc Surg 2019 Oct;70(4):1364-1373 [FREE Full text] [CrossRef] [Medline]


CASP: Critical Appraisal Skills Programme
COSTER: Conduct of Systematic Reviews in Toxicology and Environmental Health Research
FINER: feasible, interesting, novel, ethical, and relevant
MECIR: Multi Engine Command Instrument Rating
PerSPecTIF: perspective, setting, phenomenon of interest/problem, environment, optional comparison, time/timing, and findings
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses


Edited by T Leung; submitted 05.10.21; peer-reviewed by W Barletta, G Estey, S Burns; comments to author 06.02.22; revised version received 14.03.22; accepted 30.03.22; published 25.05.22

Copyright

©Georgia Ntina, Eirini Mavromanolaki, Andreas D Flouris. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 25.05.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.