Published on in Vol 5, No 2 (2016): Apr-Jun

Why We Belong - Exploring Membership of Healthcare Professionals in an Intensive Care Virtual Community Via Online Focus Groups: Rationale and Protocol

Why We Belong - Exploring Membership of Healthcare Professionals in an Intensive Care Virtual Community Via Online Focus Groups: Rationale and Protocol

Why We Belong - Exploring Membership of Healthcare Professionals in an Intensive Care Virtual Community Via Online Focus Groups: Rationale and Protocol

Proposal

1Agency for Clinical Innovation, Intensive Care Coordination and Monitoring Unit, Chatswood, Australia

2University of Technology Sydney, Faculty of Health, Sydney, Australia

3University of Syndey, Sydney Nursing School, Sydney, Australia

4University of San Francisco, School of Nursing and Health Professions, San Francisco, CA, United States

5Oxford Brookes University, Faculty of Health and Life Sciences, Oxford, United Kingdom

6NHS Foundation Trust, Oxford University Hospitals Foundation Trust, Oxford, United Kingdom

7University of New England, School of Health, Armidale, Australia

Corresponding Author:

Kaye Rolls, B AppSc, RN

Agency for Clinical Innovation

Intensive Care Coordination and Monitoring Unit

Sage Building, Albert Avenue

Chatswood, 2067

Australia

Phone: 61 +61294644666

Fax:61 61294644728

Email: kaye.d.rolls@student.uts.edu.au


Background: Many current challenges of evidence-based practice are related to ineffective social networks among health care professionals. Opportunities exist for multidisciplinary virtual communities to transcend professional and organizational boundaries and facilitate important knowledge transfer. Although health care professionals have been using the Internet to form virtual communities for many years, little is known regarding “why” they join, as most research has focused on the perspective of “posters,” who form a minority of members.

Objective: Our aim was to develop a comprehensive understanding of why health care professionals belong to a virtual community (VC).

Methods: A qualitative approach will be used to explore why health care professionals belong to an intensive care practice-based VC, established since 2003. Three asynchronous online focus groups will be convened using a closed secure discussion forum. Participants will be recruited directly by sending emails to the VC and a Google form used to collect consent and participant demographics. Participants will be stratified by their online posting behaviors between September 1, 2012, and August 31, 2014: (1) more than 5 posts, (2) 1-5 posts, or (3) no posts. A question guide will be used to guide participant discussion. A moderation approach based on the principles of focus group method and e-moderation has been developed. The main source of data will be discussion threads, supported by a research diary and field notes. Data analysis will be undertaken using a thematic approach and framed by the Diffusion of Innovation theory. NVivo software will be used to support analyses.

Results: At the time of writing, 29 participants agreed to participate (Focus Group 1: n=4; Focus Group 2: n=16; Focus Group 3: n=9) and data collection was complete.

Conclusions: This study will contribute to a growing body of research on the use of social media in professional health care settings. Specifically, we hope results will demonstrate an enhancement of health care professionals’ social networks and how VCs may improve knowledge distribution and patient care outcomes. Additionally, the study will contribute to research methods development in this area by detailing approaches to understand the effectiveness of online focus groups as a data collection method for qualitative research methods.

JMIR Res Protoc 2016;5(2):e99

doi:10.2196/resprot.5323

Keywords



Contemporary organizational [1] and learning theories [2] that highlight learning and behavior are influenced by social networks [3,4]. Many of the current challenges of evidence-based practice [3] are related to the ineffective social networks [5] created by professional and organizational boundaries [6,7]. While there is significant potential within multidisciplinary virtual communities (VC) to facilitate the transfer of research and best practice [6,8] and support the professional development of clinicians [9], at this time we know little of why health care professionals (HCPs) join or how they use a VC. The purpose of this paper is to present a research protocol for a study that aims to develop an understanding of why HCPs join a practice-based VC and how they use it.

Influence of Local Social Networks on Clinical Practice

For 30 years, evidence-based practices have been viewed as the gold standard. However, significant clinical practice variation and evidence-practice gaps persist [10-12]. According to Rogers’ Diffusion of Innovation theory [13], the adoption of an innovation, such as new practices, research, or technologies, is mediated by characteristics of the innovation, an individual’s adoption style and their social network, the broader social context, and time (see Figure 1 and Multimedia Appendix 1). Access to novel information requires a heterogeneous social network (where members may not have similar values and characteristics) where communication channels cross organizational and/or professional boundaries [14]. Furthermore, trials and final adoption decisions are strongly influenced by opinion leaders and peers [13,15-18]. However, current research suggests that the preferred information sources of many clinicians are a function of perceived credibility and ease of access [19-21] and that professional networks shape and limit clinical behaviors [4]. If clinicians do not have communication channels beyond local networks, they will not have access to novel knowledge and may be under the illusion that local practices reflect the majority [22]. Social media have the potential to improve HCP social networks by creating multidisciplinary VCs that facilitate knowledge exchange regardless of geography or time [6-8].

Figure 1. Diffusion of Innovation 5, 13.
View this figure

Virtual Community Use by Health Care Professionals

Health care professionals have been using VCs since the early 1990s with long-term success stories including (1) Critical care mailing list launched in 1994 [23], (2) NurseNet founded in 1993 [24], and (3) MEDLIB started 1991 [25]. These VCs were created using early social media technologies including listserv and discussion forums [26]. The advent of Web 2.0 and the newer technologies of social networking and microblogging platforms have expanded the possibilities of professional networking and perhaps virtual communities [8]. While reasons for establishing a discrete VC vary, the most common motivation was to create a professional forum where relevant professional and academic issues may be discussed and knowledge shared [27-39]. Unfortunately at this time, membership of many health care VCs is often homophilic (ie, the tendency to associate with individuals who share similar values and characteristics [13]) where members are commonly from a single health care discipline and usually work in a specific clinical specialty area [25,31,37,40-42]. Additionally there are limited population-based data describing how different types of HCPs are using the variety of social media platforms. In 2011, as few as 1.7% of emergency physicians were using Twitter [43] and 13.4% of Korean emergency physicians were using a Facebook page [44], whereas up to 20% of intensive care nurses [14], occupational health practitioners [45], or nurse practitioners [34] were using a professional listserv established for their use. These differences in uptake, and that each technology will be seen as an innovation, indicate a possible mediating factor related to the social medium itself [46] as well as the influence of peers [14,47].

The most common online activities undertaken by VC members are the solicitation and supply of experiential domain-specific knowledge [30,45,48]; however, 60-89% of members rarely post online [42,45,48,49]. A limited number of studies suggest that HCPs view VCs as valuable knowledge portals, enabling members to remain clinically current [50] with relevant and quality information [49,51], develop workplace resources [41], and benchmark practice [41,50]. This suggests HCPs use VCs to establish virtual professional networks [13] to enhance access to colleagues and best practice knowledge.

A reliance on readily available data and use of online observation has limited our understanding of how or why HCP use social media because this gathers data on a limited number of members. Given this, what motivates HCPs to join a VC, and what do they value that influences them to remain members? The absorption and diffusion of knowledge or innovation into and around an organization is the role of boundary spanners (eg, nursing unit managers or project officers) [52] and knowledge brokers (eg, nurses in education or advanced practice roles) [53]. Do these individuals see membership as part of personal professional development or as a tool for their substantive position, as preliminary data suggest [41]? Additionally, understanding these phenomena will assist health care leaders in understanding how to develop VC to optimally leverage social media to improve knowledge diffusion and patient care.

Online Focus Groups

Focus groups are used by researchers to gather qualitative data on specific group experiences by capitalizing on group dynamics to synergistically develop a deeper, richer understanding of a phenomenon of interest [54,55]. Moreover, the collective conversation between participants facilitates the gathering of individual and group voices, which may uncover an understanding not available via other data collection modes (eg, surveys or interviews) and democratizes the research by decentering the researcher [54]. A moderator guides participants through a discussion commonly using a guide based on the core research questions and objectives and evolves as data emerge [55]. While face-to-face focus groups are acknowledged as a strong method for gathering qualitative data [55], there can be significant logistical challenges, such as convening the focus group on a specific date and time and at a location that facilitates maximal participation. Online or virtual focus groups are becoming more common as they enable participation of geographically distributed and time-poor individuals and are less expensive to conduct [55,56]. Online focus groups have been used to examine a diverse range of health-related questions, with considerable variation in methods used across studies (see Table 1). While the term “virtual focus group” is more commonly used, we use the term “online focus group” to avoid confusion with the term “virtual community.”

Table 1. Use of virtual focus groups in healtha.
Author, year, countryAimFocus group + participantsRunning the virtual focus group (VFG)Data analysis
Alonzo, 2009, USA [61]What motivates associate degree and diploma-prepared RN to pursue a baccalaureate degree through an RN-to-BSN program4 VFG (2-6 participants); nurses; 2 weeksAsynchronous using discussion forum and a question guide (11)Inductive content analysis
Synnot, 2014, Australia [62]Compare face-to-face and VFG for people with multiple sclerosis & relatives regarding needs, experiences, preferences, and values when integrating evidence-based health information into their decision making about the management of their health4 face-to-face (27participants); 1 VFG (33 participants) over 2 monthsAsynchronous using discussion forum; 10-question guideThematic analysis
Hanson, 2011, USA [63]To explore fieldwork educator motivations for working with students and the kind of support needed from the academic institution (occupational therapists enrolled in master’s program)2 VFG based on stratification to pediatric & adult practice settings (10 participants); over 2 weeks; credit incentives for participationAsynchronous using discussion forum; all questions posted at start with instructions for students to respond to each question plus 2 peer responsesContent analysis
Tates, 2009, Netherlands [64]Determine what constitutes good quality of communication with a diagnosis of childhood cancer, in terms of participation and role delineation from their point of view3 VFG grouped by type (7 current patients, 11 parents of these patients; 18 survivors)Asynchronous using discussion forum; daily questions over 1 weekNot described
Harmsen, 2013, Holland [65]Gain insight into factors that influence parents to not vaccinate their children8 VFG; 5 non-vaccinators (n=39; 7-9); 3 partial (n=21; 7 each); running over 5 daysAsynchronous using discussion forum; predetermined topics introduced daily with open questions; anonymousThematic analysis
Murray, 2001, International [66]To test method and gather data to inform interviews; part of a mixed methods study to gather data & test method2 VFG ‒ Educators and listserv experts (N not provided); 4 weeksAsynchronous using listservNot explained
Adler, 2002, USA [67]VFG as mode of data collection; lived experience of women confined to best rest because at risk of preterm labor; value of VFG as peer support1 FG (7); 4 weeksAsynchronous using listserv; Question guide – 6 (semistructured, open ended)Content analysis for thematic coding
Kenny, 2005, Australia [51]Whether active engagement and group interaction could be captured in an online environment in an EN conversion program1 FG with census sampleAsynchronous using Web CT starting with one question; ran for 2 monthsThematic analysis
Pechak, 2002, USA [68]Develop recommendations for implantation of ICE in physical therapist education to promote ethical practice1 VFG (5 participants); followed by 3 delphi rounds (19 participants)Synchronous using Blackboard; anonymous; highly structured feedback on predetermined scriptNot described
Levine, 2011, USA [69]Involve youth of color in design of programmatic content and formats for an Internet intervention for sex education4 synchronous FG (7,5,4,2 participants); 1 asynchronous (18 participants)Synchronous using chat room (4 by 1 hr); switched to asynchronous due to low numbers – 7 days with daily questions (9 in total)Not described
Brubaker, 2012, USA [70]Gather information about women’s knowledge and attitudes regarding research participation2 FG grouped by research-experience or research-naive (12 in total); study protocol also include 14 face-to-face FGSynchronous using semistructured discussion guides
Tuttas, 2014, USA [71]Capture travel nurses’ perceptions of boarding experiences4 FG (2-5 participants); registered nursesSynchronous using Web conferencing and a question guide (5 questions); over 45-60 minutesQualitative content analysis

aBSN‒baccalaureate science nursing; EN‒enrolled nurse; FG‒focus group; ICE ‒international clinical education; RN‒registered nurse; VFG‒virtual focus group.

Two modes of online focus groups are possible: synchronous and asynchronous. The synchronous mode closely matches face-to-face groups where participants meet in real time using chat rooms or discussion boards. While this mode may promote a more dynamic discussion with high levels of feedback, an individual’s typing speed, connection bandwidth, and thought speed may impact users’ ability to effectively participate [55]. Asynchronous groups have been conducted using either listserv or discussion forum technology, providing participants with time to consider their posts or responses, and enable posting at a time of their convenience. Other advantages of the asynchronous mode include immediate creation of a threaded discussion facilitating review by members as well as data collection and analysis [55,57]. Study credibility is enhanced [58] by participant-controlled, real-time data collection. While the asynchronous mode may facilitate the development of more reflexive answers [56], large participant numbers may create two methodological issues: (1) the quality of interaction, and therefore data, may be limited because the volume of posts is off-putting and/or too high for participants to review properly, and (2) moderation is more challenging. A high volume of data also may make data analysis more difficult.

As noted above, considerable variation exists regarding how researchers structure online focus groups (see [55]. In addition, most VC members do not actively post online and the decision to post is complex [59,60]. Focus group participants may be more inclined to disclose their experiences and opinions where they feel they share values and beliefs with other group members and there is no group hierarchy [61]. This homogeneity along with efficient moderation can lead to effective group interactions resulting in quality data [55]. The ideal moderator understands both the context of the research and the cultural world of participants [62,63]. However, effective online moderation requires additional skills and interventions that socialize participants to the online space and encourages posting [64]. Two other important considerations are that the platform chosen is user-friendly (ie, easy to access and use and esthetically pleasing) [65] and the posts are confidential [66].

A key component of a focus group is the discussion guide that frames and focuses discussions and ensures collection of rich in-depth data [55,62]. Questions should reflect the study questions and funnel discussions through introductory, transition, and key questions to ensure consistent data where multiple groups are used and aid data analysis [67]. Introductory questions encourage participation and provide participants and researchers with an understanding of individual perspectives [55]. These are similar to activities undertaken as part of an e-moderation process to support effective online learning, including establishing an effective group, introduction of the research phenomena, and induction of participants to the online environment [64].

Focus Groups and Virtual Communities

While focus groups are frequently used to collect data for qualitative or mixed-methods studies, only two studies [31,68] were identified that examined HCP experiences of virtual communities or computer-mediated communication. In a mixed-methods study exploring how and why occupational therapists used a virtual community of practice (VCoP), two face-to-face focus groups (stratified by use or not of the VCoP) were used to develop a survey instrument [31]. In earlier work [68], two online asynchronous focus groups were convened using listserv technology to explore current practice and future potential of text-based computer-mediated communication as a mechanism for qualified nurses to meet their formal and informal continuing professional development needs. In this latter study, questions were introduced at the beginning of the focus group, with the author later reflecting that this was overwhelming for some participants [69]. While listserv technology is the most straightforward and accessible of all VC platforms, it may not result in a chronologically ordered discussion thread. This may be difficult for both the participants and moderator to follow the discussion, especially those with multiple posts, and could therefore limit interaction and conversation development with probable negative effects on data. Data analysis is also more complicated because of difficulties in understanding the chronology and/or evolution of a discussion.

The aim of this study is to explore why HCPs belong to an intensive care practice-based VC. The main objectives are to (1) understand why members join and remain members, (2) identify what purpose the VC serves in in their professional lives, (3) identify how a member uses the VC, and (4) identify how they have used the knowledge or resources shared on the VC.


A qualitative approach will be used to collect data using three asynchronous online focus groups, with participants allocated to a group based on their posting behaviors in the past 2 years. The study is framed by the Diffusion of Innovations theory [13]. A summary of the protocol is provided inFigure 2.

Figure 2. Study protocol summary.
View this figure

Ethics

Approval has been granted by a University Human Research Ethics Committee (UTS HREC REF NO. 2014000378). Participant confidentially will be ensured using two measures: (1) a group rule, covering non-disclosure of participant names or sharing the content of posts, will be developed and participants will be asked to agree to it on participant registration, and (2) focus groups will be convened within a secure website using a closed, password-protected discussion forum with any social media sharing function disabled. These layers are designed to protect participant anonymity and prevent forum posts from being searchable via the Web [66].

Setting

The VC is a professional listserv established in 2003 by an Australian state health department to reduce the sense of professional isolation and improve knowledge distribution between the 43 intensive care units [51]. By mid-2014, there were more than 1700 members from more than 225 health care facilities, universities, and industry partners, spread throughout several countries with most being Australian intensive care clinicians and nursing being the largest professional group. Analysis of the social network of the VC suggests that it is highly valued by members because the majority of HCP who join choose to remain members for extended periods and recommend the VC to colleagues [14]. The VC would be classified as a VC with an interdisciplinary culture and stable membership, a medium geographic distribution, and an open and voluntary enrollment [70].

Participants and Sample

A purposive sampling method will be used to recruit between 24 and 36 participants for the three focus groups. The sample size is based on recruiting 8-12 participants per group, which is the current recommendation for both traditional [55] and online [65] focus groups. Members of the VC will be invited to participate via a recruitment email posted to the VC, providing all participant information, and an invitation to contact the research team for further information, and a link to the online recruitment form (Google forms). The online recruitment form will include participant information, consent, participant demographics, and a short survey covering group rules (see Multimedia Appendix 2). Once a potential participant has completed the online registration and consent, their posting behavior will be checked, they will be assigned to a focus group, and they will be notified of the details regarding this focus group.

To develop an understanding of a range of member types, we chose to undertake three focus groups based the online activity of a VC member. Participants will be purposely assigned to a focus group based on their posting activities on the VC in the last 2 years (onlist posting) (September 1, 2012, to August 31, 2014): (1) more than five times, (2) five times or less, and (3) not posted. We will not cap the number of participants as dropouts or inabilities to participate have been identified as limitations by previous researchers [71,72]. The only exclusion criteria will be non-availability over the 3-week time frame for each focus group.

Recruitment challenges are anticipated. As the majority of VC members do not post, this reduces the number of potential candidates for the posting groups particularly for Groups 1 and 2. A review of 12 months of activity identified at least 25 members eligible for focus Groups 1 and 2. While there are a high number of potential members for the non-posting group, these members are reluctant to post for a variety of reasons, especially about how their contribution might be received by members of the virtual community. We hope that by convening focus groups where the shared characteristic is posting, behaviors will create an online space where individual members feel comfortable and confident that their contributions will be met in a positive and supportive environment [56].

Moderation

The approach to moderation of the focus groups is based on principles from moderating traditional focus groups [55] and facilitating learning online or e-moderating [62-64]. The first author will be the moderator and is an experienced intensive care nurse and was the previous moderator of the VC. Author 4 will be a non-participant observer. To facilitate access to and understanding of the focus group platform, a “how-to” guide has been developed as an important component of providing access and motivation to post in an online forum [64].

Running the Online Focus Groups

The focus groups will be run over 3 weeks using a closed discussion forum (IPBoard version 3, Invision, Powerboard) hosted on a secure jurisdictional health department website. The focus groups will be held consecutively, which will allow for refinement of the question guide based on data from a previous group [73]. This approach was developed to enable optimal participation and interaction, safeguarding participant confidentiality, facilitating moderation and effective data collection. The host site was chosen as it was accessible and useable across fixed and mobile technologies. A discussion forum was chosen for a number of reasons. Discussion forums are asynchronous and create a chronological electronic record where participants will be able to review what has been posted, have time to consider and formulate a response, and then post at a time convenient to them [57]. This should promote a more egalitarian focus group as all participants will have the opportunity to provide input. This enhances participant control and may encourage more detailed and reflective answers, and thus potentially richer data [55]. As the discussion moves forward, a record is created providing participants with chronological discussion points and data collection is facilitated through the development of discussion threads.

Question Guide and Discussion Schedule

A question guide (see Table 2) was developed with questions based on the research questions and the theoretical framework of diffusion of innovations [13]. A schedule will be developed with new questions posted every 2-3 days depending on how the discussion is developing. To facilitate visibility of the study and new questions, an email using a standardized subject heading will be sent to participants alerting them to new content. The moderator will access the forum at least twice each day for promoting interaction (eg, reviewing posts, answering questions, or adding additional questions to clarify participants’ views) [71,72], regularly thank and encourage participants, and re-inforce the value of posting [64].

Table 2. Question guide.
Type of questionQuestionsPossible aspect of diffusion of innovationa,b
Introductory questionPlease introduce yourself and tell the group about your professional role and experience.
Transition questionYou were invited to this focus group because you are a member of ICUConnect. Could you explain what prompted you to join?Type of adopter; homophily; influence of peers
Do you use any other social media or online communities for professional networking and development?Type of adopter; external orientation; interconnectedness; Innovation characteristics of social media
Key questionWhat do you value most about ICUConnect?Access to colleagues (homophily), external orientation; interconnectedness; Innovation characteristics of social media
What are the least valuable aspects of ICUConnect?Innovation characteristics of social media
What advantages or disadvantages does ICUConnect have over other social media?See above
Current research indicates that there are active users of virtual communities (individuals who post) and passive users (individuals who mainly read &/or share). How would you describe how you use ICUConnect?Type of innovator: role of individual in local social network
Do you share ICUConnect posts with other professional colleagues?Role of individual in local social network; external orientation
Is there a post in the past 3 months that has been of high relevance to you?Knowledge (innovation) on IC-VC is credible
Have you been able to use any posts from the last 6 months of discussions?As above
Concluding questionAre there any other important aspects of ICUConnect that we have not discussed?As above

a[5,13].

bSee Figure 1 and Multimedia Appendix 1.

Data Analyses

Study data will include (1) demographic data describing participant characteristics, (2) categorical data describing discussion forum participation, (3) discussion threads documenting focus group discussion, and (4) field notes. Discussion threads will be extracted from the Forums using NCapture (QRS International). NVivo (QRS International) will be used to manage data analyses. A research diary and field notes will be maintained to support analyses. Initial analyses will be conducted by KR, supported by scheduled reviews with the research team to evaluate progress and reach consensus regarding themes and other interpretations. Analysis of the discussion threads will be undertaken using a thematic approach [74], framed by the diffusion of innovation [13]. Thematic analysis is a 6-phase process allowing the researcher to systematically identify, analyze, and report patterns found in qualitative data [74]. During Phase 1, KR will be immersed in the data through active reading of discussion threads and looking for meanings or patterns. This familiarization will commence during data collection because of the dual role of researcher-moderator. DE also will be familiar with the data in his role as researcher-participant observer. During Phase 2, the initial codes will be generated; these codes will be theory driven and will represent the most basic element of the raw data that is meaningful. Additionally, code descriptors will be developed to ensure systematic coding. In Phase 3, we will look for themes by grouping codes into candidate themes. In Phase 4, we will refine this list of themes by reviewing the coded extracts and looking for a coherent pattern within each theme and ensure there is sufficient data to support it. Once we have achieved this, we will move on to developing the thematic map, which reflects how well the themes represent the data as a whole. Re-reading the whole dataset is essential, and some recoding may be required at this point. During Phase 5, we will define and refine the themes by identifying the essence of the theme and determining which aspect of the data it captures. This involves developing a detailed analysis of each theme and its associated subthemes. In the last phase, we will provide a written report of our analyses.

Diffusion of innovation [13] was chosen as the theoretical lens because the research team felt it was a better match for both the broad problem of inadequate social networks limiting knowledge diffusion in health care and the current gaps in the literature. While other behavioral models, including theory of reasoned action [75], theory of planned behavior [75], and technology acceptance model [46], have been used and produced important insights, they are focused on an individual’s behavior.

Study Quality

Rigor in qualitative research is a contentious area [58,76,77]. The preferred terms of “trustworthiness” or “confirmability” reflect accuracy and comprehensiveness in how data were collected, analyzed, and reported. For this study, several strategies will be used. Credibility of data will be enhanced as participants have direct control over their contributions that will be recorded in real time, and by use of NVivo software as the major study file repository for the research diary, field notes, and data, thus establishing a clear audit trail [78]. A “thick” description of the research context will be provided by describing the participants (using the recruitment survey), virtual community, and research process (p. 69 [58]). Auditability will be supported by field notes, recording impressions arising from focus groups, and NVivo to manage data analyses. Data credibility will be enhanced by presenting preliminary themes to participants for early review (member checking) [56].

Field notes record what the researcher experiences during data collection and includes (1) both a description of and reflection on what occurred, (2) a reflective journal that includes personal thoughts and feelings, and (3) any insights, judgments, and interpretations made in the field [76,78]. Field notes will facilitate both data collection (eg, aid in development of elaboration and clarification questions) and analysis (eg, through the development of preliminary themes).

Researcher Bias and Relationship With Participants

The potential for bias in qualitative research may be significant when the research team fails to understand and then manage their assumptions and biases. In addition, where there is an unequal or prior relationship between the research team and participants, data collected may not reflect the reality of participant experience. In this study, KR was a long-term moderator of the VC and DE is a member. However, the other authors are not members or associated with the VC. To manage any potential for bias during data collection and analyses, a number of procedures will be implemented: (1) KR withdrew from the moderator role several months prior to VC members’ being aware of the research (all stages of the study), (2) to minimize coercion in all communications, KR will describe participants in a passive research guise and will not make any direct communications with individual members, (3) KR will undergo a bracketing process prior to the first focus group, outlining the researcher position by documenting any assumptions and therefore identifying potential sources of bias [79,80], and forming part of the research diary, (4) assumptions will be revisited during data analyses, (5) during focus group moderation, the roles as researcher (KR) and non-participant observer (DE) will be explicitly described, (6) to minimize bias and enhance credibility, all researchers will be responsible for data analysis, and (7) member checking will be undertaken by posting preliminary results in the discussion forums for participants to provide feedback.


At the time of writing, 29 VC community members have been recruited and the focus groups were conducted October to December 2014 with these participants. Table 3 shows focus group recruitment outcomes and professional roles of participants. There was mixed participation across the focus groups (3, 9, and 7 respectively), which may create challenges for data analyses.

Table 3. Focus group recruitment outcomes.
Type of memberFocus group 1: Frequent posters (>5)Focus group 2: Low posters (1-5)Focus group 3: Non postersTotal
Clinical nurse-internala
426
Clinical nurse-externalb
112
Knowledge broker nursec3429
Clinical unit managerd1214
Academic nursee
415
Physiotherapist

11
Physician
1
1
Bureaucratf

11
Total416929
Post range6-191-4 (mode 1; median 1)

aClinical nurse‒internal provides clinical services within a clinical unit.

bClinical nurse‒external provides clinical services across multiple clinical unit.

cKnowledge broker job role could include advanced practice, education, research, or practice development.

dClinical unit manager manages a defined ward or clinical area.

eAcademic nurse is employed by a tertiary education institution.

fBureaucrat is employed in a non-clinical or managerial role in health service.


Principal Considerations

Like the rest of the community, HCPs are adopting social media platforms, although uptake varies considerably [14,34,43,44]. Despite positive attitudes towards social media, this has not translated to significant professional use [81]. There are some data suggesting this is influenced by individual characteristics [46], peers [46,82], and perceptions of the platform as an innovation [46]. At this time, however, the research base on why or how HCPs use these communities or social media is limited because online observation reveals the perspective of a minority of VC members [25,27,32,42,45,49,83] and measurement [25,36,44,49,84-87] and sample [31,49,84,88-92] bias in surveys. It has been suggested that a comprehensive understanding of VCs requires a mixed-methods approach that includes a member survey, content analysis, and social network analysis [93]. Social network analysis has revealed that members have more complex reading than posting behaviors [39]; however, this will not reveal member motivations and will be limited to platforms where these data are available.

The aim of this study is therefore to develop a comprehensive understanding of why members belong to an intensive care practice-based virtual community for HCPs. This includes understanding why they join and remain members, identifying the purpose of the VC in their professional lives, and understanding how they use the VC, and what they do or how they use the knowledge or resources obtained. By using focus groups, we will be able to examine the experiences of all types of VC members, leading to a more complete understanding of why HCPs join and use social media. By using the diffusion of innovation as a theoretical lens, we also examine the phenomena from several perspectives including social media as an innovation, the VC as an IC-VC, VC member adopter type, and VC as a social network. We hope to show that VC membership enhances the professional (social) networks of HCPs and access to valuable knowledge, to improve clinical practice, and by extension patient outcomes.

There are a number of possible benefits arising from this study. The study will provide data about participation in this VC, particularly as a method to support evidence-based practice and professional development [8] and address patient care challenges [6]. As this VC is part of a jurisdictional health department initiative, the health system and broader community may benefit by demonstrating the viability and value of social media to improve the social networks of intensive clinicians and as a knowledge diffusion and adoption initiative. Findings may also allow the development of a survey instrument to gather data from a larger sample of VC members and on other VCs. This study will also contribute understanding on the efficacy of online focus groups as a data collection method for qualitative research methods.

Strengths and Limitations

There are several strengths and limitations of this study. Two elements limit generalizability to the broader population of HCPs, namely the qualitative design using focus groups and the Australian intensive care setting. However, in the current literature, generalizability of surveys is hampered by sampling bias [31,49,84,88-92]. Our design leverages the advantages of online focus groups with learnings from virtual tertiary education [64] to facilitate participation by a broad range of members thus providing an extensive understanding of the experiences of all types of members, especially the non-posting majority. Our recruitment has been moderately successful in gaining adequate participants for the low and non-posting focus groups but not for the high-posting group [65]. This may limit the quality and quantity of data arising from this focus group.

Conclusions

This study aims to contribute to the growing body of research on the use of social media; specifically we hope it will demonstrate this by enhancing access to social networks for HCPs. VCs may improve collegiality, data sharing, knowledge distribution, and ultimately patient care and health outcomes. Additionally, the study will contribute to qualitative research methods by evaluating the utility of online focus groups as a data collection approach.

Authors' Contributions

KR, MH, DJ, and DE conceived the study design and approved the manuscript.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Description of terms used in Diffusion of Innovations framework.

PDF File (Adobe PDF File), 35KB

Multimedia Appendix 2

Online recruitment - demographics and group rules.

PDF File (Adobe PDF File), 34KB

  1. Drucker PF. The new society of organizations. Harvard Business Review 1992(Sept-Oct):95-104.
  2. Wenger E. Communities of practicesocial learning systems. In: Starkey K, Tempest S, McKinlay A, editors. How organisations learn: Managing the search for knowledge. Thomson Learning: London; 2004:238-258.
  3. Borgatti SP, Halgin DS. On Network Theory. Organization Science 2011 Oct;22(5):1168-1181. [CrossRef]
  4. Dopson S, FitzGerald L, Ferlie E, Gabbay J, Locock L. No magic targets! Changing clinical practice to become more evidence based. Health Care Manage Rev 2002;27(3):35-47. [Medline]
  5. Kyriakidou O, Bate P, Peacock R, Greenhalgh T, MacFarlane F. Diffusion of innovations in health service organisations: a systematic literature review. Malden, MA: Blackwell; 2005.
  6. McGowan B. #SocialQI: simple solutions for improving your healthcare. Sioux Falls, SD: No Limit Publishing; 2012.
  7. Currie G, White L. Inter-professional Barriers and Knowledge Brokering in an Organizational Context: The Case of Healthcare. Organization Studies 2012 Oct 22;33(10):1333-1361. [CrossRef]
  8. Burrell AR, Elliott D, Hansen MM. ICT in the ICU: using Web 2.0 to enhance a community of practice for intensive care physicians. Crit Care Resusc 2009 Jun;11(2):155-159. [Medline]
  9. Barnett S, Jones SC, Bennett S, Iverson D, Bonney A. General practice training and virtual communities of practice - a review of the literature. BMC Fam Pract 2012;13:87 [FREE Full text] [CrossRef] [Medline]
  10. Hewson-Conroy KM, Burrell AR, Elliott D, Webb SAR, Seppelt IM, Taylor C, et al. Compliance with processes of care in intensive care units in Australia and New Zealand--a point prevalence study. Anaesth Intensive Care 2011 Sep;39(5):926-935. [Medline]
  11. Melnyk BM, Fineout-Overholt E, Gallagher-Ford L, Kaplan L. The state of evidence-based practice in US nurses: critical implications for nurse leaders and educators. J Nurs Adm 2012 Sep;42(9):410-417. [CrossRef] [Medline]
  12. Oborn E, Barrett MG, Racko G. Knowledge translation in healthcare: a review of the literature.: Cambridge University; 2010.   URL: https://www.jbs.cam.ac.uk/fileadmin/user_upload/research/workingpapers/wp1005.pdf [WebCite Cache]
  13. Rogers E. Diffusion of innovations. New York: Free Press; 2003.
  14. Rolls KD, Hansen M, Jackson D, Elliott D. Analysis of the social network development of a virtual community for Australian intensive care professionals. Comput Inform Nurs 2014 Nov;32(11):536-544. [CrossRef] [Medline]
  15. Granovetter M. The strength of weak ties: a network theory revisited. In: Marsden P, Lin N, editors. Social Structure and Network Analysis. New York: John Wiley and Sons; 1982:105-130.
  16. Fleuren M, Wiefferink K, Paulussen T. Determinants of innovation within health care organizations: literature review and Delphi study. Int J Qual Health Care 2004 Apr;16(2):107-123 [FREE Full text] [CrossRef] [Medline]
  17. Locock L, Dopson S, Chambers D, Gabbay J. Understanding the role of opinion leaders in improving clinical effectiveness. Soc Sci Med 2001 Sep;53(6):745-757. [Medline]
  18. Valente T. Diffusion of Innovations and Policy Decision-Making. J Communication 1993 Mar;43(1):30-45. [CrossRef]
  19. Marshall AP, West SH, Aitken LM. Preferred information sources for clinical decision making: critical care nurses' perceptions of information accessibility and usefulness. Worldviews Evid Based Nurs 2011 Dec;8(4):224-235. [CrossRef] [Medline]
  20. Curran JA, Murphy AL, Sinclair D, McGrath P. Factors influencing rural and urban emergency clinicians' participation in an online knowledge exchange intervention. Rural Remote Health 2013;13(1):2175 [FREE Full text] [Medline]
  21. Kostagiolas P, Korfiatis N, Kourouthanasis P, Alexias G. Work-related factors influencing doctors search behaviors and trust toward medical information resources. International Journal of Information Management 2014;34(2):80-88. [CrossRef]
  22. Lerman K, Yan X, Wu XZ. The Majority Illusion in Social Networks. Social and Information Networks 2015. [CrossRef]
  23. DeWitt AL, Gunn SR, Hopkins P, Streat S. Critical care medicine mailing list: growth of an online forum. BMJ 2004 May 15;328(7449):1180 [FREE Full text] [CrossRef] [Medline]
  24. Murray PJ. Nurses' computer-mediated communications on NURSENET. A case study. Comput Nurs 1996;14(4):227-234. [Medline]
  25. Schoch NA, Shooshan SE. Communication on a listserv for health information professionals: uses and users of MEDLIB-L. Bull Med Libr Assoc 1997 Jan;85(1):23-32 [FREE Full text] [Medline]
  26. Paton C, Luquel L. IMIA Social Media Working Group.   URL: https://imiasocialmedia.wordpress.com/about/ [accessed 2015-02-14] [WebCite Cache]
  27. Berman Y. Discussion groups on the Internet as sources of information: the case of social work. Aslib Proceedings 1996 Feb;48(2):31-36. [CrossRef]
  28. Roberts C, Fox N. General practitioners and the Internet: modelling a 'virtual community'. Fam Pract 1998 Jun;15(3):211-215 [FREE Full text] [Medline]
  29. Cervantez Thompson Teresa L. You've got mail: rehabilitation nurses on the RehabNurse-L LISTSERV. Rehabil Nurs 2002;27(4):146-151. [Medline]
  30. Long S, de Jonge JD, Ziviani J, Jones A. Paediatricots: Utilisation of an Australian list serve to support occupational therapists working with children. Aust Occup Ther J 2009 Feb;56(1):63-71. [CrossRef] [Medline]
  31. Hoffmann T, Desha L, Verrall K. Evaluating an online occupational therapy community of practice and its role in supporting occupational therapy practice. Aust Occup Ther J 2011 Oct;58(5):337-345. [CrossRef] [Medline]
  32. Thomas R, James S. Informal communications networking health professionals: a study of gp-uk. Health Informatics Journal 1999;5(2):74-81. [CrossRef]
  33. Valaitis RK, Akhtar-Danesh N, Brooks F, Binks S, Semogas D. Online communities of practice as a communication resource for community health nurses working with homeless persons. J Adv Nurs 2011 Jun;67(6):1273-1284. [CrossRef] [Medline]
  34. Widemark E. Community and Learning: A Virtual Community of Practice for Nurse Practitioners. In: Education. Ann Arbor, MI: Capella University; 2009.
  35. Foong DPS, McGrouther DA. An Internet-based discussion forum as a useful resource for the discussion of clinical cases and an educational tool. Indian J Plast Surg 2010 Jul;43(2):195-197 [FREE Full text] [CrossRef] [Medline]
  36. Watson DAR. Ozbug: an email mailing list for physicians that works. Intern Med J 2003 Nov;33(11):532-534. [Medline]
  37. Smith C. A Longitudinal Study of the Culture of MEDLIB-L. J Hosp Librarianship 2004 Mar 24;4(1):29-43. [CrossRef]
  38. Reutzel TJ, Patel R. Medication management problems reported by subscribers to a school nurse listserv. J Sch Nurs 2001 Jun;17(3):131-139. [Medline]
  39. Stewart SA, Abidi SSR. Applying social network analysis to understand the knowledge sharing behaviour of practitioners in a clinical online discussion forum. J Med Internet Res 2012;14(6):e170 [FREE Full text] [CrossRef] [Medline]
  40. Hara N, Foon Hew K. Knowledge‐sharing in an online community of health‐care professionals. Info Technology & People 2007 Aug 28;20(3):235-261. [CrossRef]
  41. Thompson TL, Penprase B. RehabNurse-L: an analysis of the rehabilitation nursing LISTSERV experience. Rehabil Nurs 2004;29(2):56-61. [Medline]
  42. Brooks F, Scott P. Knowledge work in nursing and midwifery: an evaluation through computer-mediated communication. Int J Nurs Stud 2006 Jan;43(1):83-97. [CrossRef] [Medline]
  43. Lulic I, Kovic I. Analysis of emergency physicians' Twitter accounts. Emerg Med J 2013 May;30(5):371-376. [CrossRef] [Medline]
  44. Kim C, Kang BS, Choi HJ, Lee YJ, Kang GH, Choi WJ, et al. Nationwide online social networking for cardiovascular care in Korea using Facebook. J Am Med Inform Assoc 2014;21(1):17-22 [FREE Full text] [CrossRef] [Medline]
  45. Morken T, Bull N, Moen BE. The activity on a Norwegian Occupational Health mailing list 1997-2006. Occup Med (Lond) 2009 Jan;59(1):56-58 [FREE Full text] [CrossRef] [Medline]
  46. McGowan BS, Wasko M, Vartabedian BS, Miller RS, Freiherr DD, Abdolrasulnia M. Understanding the factors that influence the adoption and meaningful use of social media by physicians to share medical information. J Med Internet Res 2012;14(5):e117 [FREE Full text] [CrossRef] [Medline]
  47. Gagnon M, Desmartis M, Labrecque M, Car J, Pagliari C, Pluye P, et al. Systematic review of factors influencing the adoption of information and communication technologies by healthcare professionals. J Med Syst 2012 Feb;36(1):241-277 [FREE Full text] [CrossRef] [Medline]
  48. Macdonald L, MacPherson DW, Gushulak BD. Online communication as a potential travel medicine research tool: analysis of messages posted on the TravelMed listserv. J Travel Med 2009;16(1):7-12. [CrossRef] [Medline]
  49. Rodriguez-Recio FJ, Sendra-Portero F. Analysis of the Spanish-speaking mailing list RADIOLOGIA. Eur J Radiol 2007 Jul;63(1):136-143. [CrossRef] [Medline]
  50. Hew KF, Hara N. An online listserv for nurse practitioners: a viable venue for continuous nursing professional development? Nurse Educ Today 2008 May;28(4):450-457. [CrossRef] [Medline]
  51. Rolls K, Kowal D, Elliott D, Burrell AR. Building a statewide knowledge network for clinicians in intensive care units: knowledge brokering and the NSW Intensive Care Coordination and Monitoring Unit (ICCMU). Aust Crit Care 2008 Feb;21(1):29-37. [CrossRef] [Medline]
  52. Long JC, Cunningham FC, Braithwaite J. Bridges, brokers and boundary spanners in collaborative networks: a systematic review. BMC Health Serv Res 2013;13:158 [FREE Full text] [CrossRef] [Medline]
  53. Gerrish K, Guillaume L, Kirshbaum M, McDonnell A, Tod A, Nolan M. Factors influencing the contribution of advanced practice nurses to promoting evidence-based practice among front-line nurses: findings from a cross-sectional survey. J Adv Nurs 2011 May;67(5):1079-1090. [CrossRef] [Medline]
  54. Denzin NK, Lincoln Y, editors. Focus Groups: Contingent articulations of Pedagogy, Politics, Inquiry. In: The SAGE Handbook of Qualitative Research. Thousand Oaks, CA: Sage Publications, Inc; 2011.
  55. Liamputtong P. Focus group methodology: Principles and practice. London, UK: SAGE; 2011.
  56. Williams S, Clausen M, Robertson A, Peacock S, McPherson K. Methodological Reflections on the Use of Asynchronous Online Focus Groups in Health Research. Int J Qual Methods 2012;11(4):368-383. [CrossRef]
  57. Kenny AJ. Interaction in cyberspace: an online focus group. J Adv Nurs 2005 Feb;49(4):414-422. [CrossRef] [Medline]
  58. Shenton A. Strategies for ensuring trustworthiness in qualitative research projects. Education for information 2004;22(2):63-75.
  59. Edelmann N. Reviewing the definitions of “lurkers” and some implications for online research. Cyberpsychol Behav Soc Netw 2013 Sep;16(9):645-649. [CrossRef] [Medline]
  60. Sun N, Rau P, Ma L. Understanding lurkers in online communities: A literature review. Computers in Human Behavior 2014;38:110-117. [CrossRef]
  61. Acocella I. The focus groups in social research: advantages and disadvantages. Qual Quant 2011 Sep 3;46(4):1125-1136. [CrossRef]
  62. Barbour RS, Flick U, Kvale S, Angrosino MV, Banks M, Gibbs G, et al. Negotiating the coresearcher mandate - service users' experiences of doing collaborative research on mental health. In: The Sage qualitative research kit. London, UK: SAGE; 2007.
  63. Bringsvor HB, Bentsen SB, Berland A. Sources of knowledge used by intensive care nurses in Norway: an exploratory study. Intensive Crit Care Nurs 2014 Jun;30(3):159-166. [CrossRef] [Medline]
  64. Salmon G. E-moderating: The Key to Teaching and Learning Online. 3rd Edition ed. New York: Routledge; 2011.
  65. Hatten J, Christensen L, Liu K, Goldstone L, Thurlow M. Elements of Successful Online Asynchronous Text-Based Discussions. Chesapeake, VA: Association for the Advancement of Computing in Education (AACE); 2014 Presented at: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education; 2014; New Orleans, LA.
  66. Whitehead LC. Methodological and ethical issues in Internet-mediated research in the field of health: an integrated review of the literature. Soc Sci Med 2007 Aug;65(4):782-791. [CrossRef] [Medline]
  67. Halcomb EJ, Gholizadeh L, DiGiacomo M, Phillips J, Davidson PM. Literature review: considerations in undertaking focus group research with culturally and linguistically diverse groups. J Clin Nurs 2007 Jun;16(6):1000-1011. [CrossRef] [Medline]
  68. Murray P. Institute of Educational Technology. 2001. Subject: talk.to/reflect - reflection and practice in nurses' computer-mediated communications   URL: http://www.nursing-informatics.com/PhD/PMurray.pdf [accessed 2016-05-04] [WebCite Cache]
  69. Murray PJ. Using Virtual Focus Groups in Qualitative Research. Qualitative Health Research 1997 Nov 01;7(4):542-549. [CrossRef]
  70. Hara N, Shachaf P, Stoerger S. Online communities of practice typology revisited. Journal of Information Science 2009 Aug 18;35(6):740-757. [CrossRef]
  71. Alonzo A. Graduate Faculty.: University of Kansas; 2009. Motivational factors in registered nurses completing a baccalaureate completion program   URL: http://kuscholarworks.ku.edu/dspace/bitstream/1808/5945/1/Alonzo_ku_0099D_10552_DATA_1.pdf [accessed 2016-05-03] [WebCite Cache]
  72. Tates K, Zwaanswijk M, Otten R, van DS, Hoogerbrugge PM, Kamps WA, et al. Online focus groups as a tool to collect data in hard-to-include populations: examples from paediatric oncology. BMC Med Res Methodol 2009;9:15 [FREE Full text] [CrossRef] [Medline]
  73. Turner D. Qualitative interview design: A practical guide for novice investigators. The Qualitative Report 2010;15:754-760 [FREE Full text]
  74. Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology 2006 Jan;3(2):77-101. [CrossRef]
  75. Lau ASM. Hospital-based nurses' perceptions of the adoption of Web 2.0 tools for knowledge sharing, learning, social interaction and the production of collective intelligence. J Med Internet Res 2011;13(4):e92 [FREE Full text] [CrossRef] [Medline]
  76. Borbasi S, Jackson D. Qualitative Research: the Whole Picture. In: Borbasi S, Jackson D, editors. Navigating the maze of research: enhancing nursing and midwifery practice. Chatswood, Australia: Mosby; 2012:123-145.
  77. Porter S. Validity, trustworthiness and rigour: reasserting realism in qualitative research. J Adv Nurs 2007 Oct;60(1):79-86. [CrossRef] [Medline]
  78. Noble H, Smith J. Issues of validity and reliability in qualitative research. Evid Based Nurs 2015 Apr;18(2):34-35. [CrossRef] [Medline]
  79. Ahern KJ. Ten Tips for Reflexive Bracketing. Qualitative Health Research 1999 May 01;9(3):407-411. [CrossRef]
  80. Hanson DJ. The Perspectives of Fieldwork Educators Regarding Level II Fieldwork Students. Occup Ther Health Care 2011;25(2-3):164-177. [CrossRef] [Medline]
  81. McCrea J. Current use, future trends and opportunties in public sector social media. 2012.   URL: http:/​/www.​jbmccrea.com/​publisher.kc/​J%20B%20McCrea%20Knowledge%20Centre/​cogitamus_report_Aug2012.​pdf [accessed 2016-02-06] [WebCite Cache]
  82. Archambault PM, Bilodeau A, Gagnon M, Aubin K, Lavoie A, Lapointe J, et al. Health care professionals' beliefs about using wiki-based reminders to promote best practices in trauma care. J Med Internet Res 2012;14(2):e49 [FREE Full text] [CrossRef] [Medline]
  83. Brooks F, Scott P. Exploring knowledge work and leadership in online midwifery communication. J Adv Nurs 2006 Aug;55(4):510-520. [CrossRef] [Medline]
  84. Cook-Craig PG, Sabah Y. The Role of Virtual Communities of Practice in Supporting Collaborative Learning among Social Workers. British Journal of Social Work 2009 May 12;39(4):725-739. [CrossRef]
  85. Hughes B, Joshi I, Lemonde H, Wareham J. Junior physician's use of Web 2.0 for information seeking and medical education: a qualitative study. Int J Med Inform 2009 Oct;78(10):645-655. [CrossRef] [Medline]
  86. Fuoco M, Leveridge MJ. Early adopters or laggards? Attitudes toward and use of social media among urologists. BJU Int 2015 Mar;115(3):491-497 [FREE Full text] [CrossRef] [Medline]
  87. Frisch N, Atherton P, Borycki E, Mickelson G, Cordeiro J, Novak LH, et al. Growing a professional network to over 3000 members in less than 4 years: evaluation of InspireNet, British Columbia's virtual nursing health services research network. J Med Internet Res 2014;16(2):e49 [FREE Full text] [CrossRef] [Medline]
  88. Burg MA, Adorno G, Hidalgo J. An analysis of Social Work Oncology Network Listserv Postings on the Commission of Cancer's distress screening guidelines. J Psychosoc Oncol 2012;30(6):636-651. [CrossRef] [Medline]
  89. Kukreja P, Heck SA, Riggins J. Use of social media by pharmacy preceptors. Am J Pharm Educ 2011 Nov 10;75(9):176 [FREE Full text] [CrossRef] [Medline]
  90. Usher WT. Australian health professionals' social media (Web 2.0) adoption trends: early 21st century health care delivery and practice promotion. Aust J Prim Health 2012;18(1):31-41. [CrossRef] [Medline]
  91. Stewart S, Sidebotham M, Davis D. International networking: connecting midwives through social media. Int Nurs Rev 2012 Sep;59(3):431-434. [CrossRef] [Medline]
  92. Apostolakis I, Koulierakis G, Berler A, Chryssanthou A, Varlamis I. Use of social media by healthcare professionals in Greece: an exploratory study. Int J Electron Healthc 2012;7(2):105-124. [CrossRef] [Medline]
  93. Li X, Gray K, Chang S, Elliott K, Barnett S. A conceptual model for analysing informal learning in online social networks for health professionals. Stud Health Technol Inform 2014;204:80-85. [Medline]


HCP: health care professionals
VC: virtual communities
VFG: virtual focus group


Edited by G Eysenbach; submitted 04.11.15; peer-reviewed by M Aebersold, WC Su; comments to author 10.12.15; revised version received 06.02.16; accepted 24.03.16; published 13.06.16

Copyright

©Kaye Rolls, Margaret Hansen, Debra Jackson, Doug Elliott. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 13.06.2016.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.