This paper is in the following e-collection/theme issue:

RCTs - Protocols/Proposals (funded, already peer-reviewed, non-eHealth) (162)

Published on in Vol 9, No 11 (2020): November

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/23112, first published .
Development of a Personalized Mobile Mental Health Intervention for Workplace Cyberbullying Among Health Practitioners: Protocol for a Mixed Methods Study

Development of a Personalized Mobile Mental Health Intervention for Workplace Cyberbullying Among Health Practitioners: Protocol for a Mixed Methods Study

Development of a Personalized Mobile Mental Health Intervention for Workplace Cyberbullying Among Health Practitioners: Protocol for a Mixed Methods Study

Authors of this article:

Yun Jin Kim1 Author Orcid Image ;   Linchao Qian1 Author Orcid Image ;   Muhammad Shahzad Aslam1 Author Orcid Image
Article Authors Cited by (5) Tweetations (1) Metrics

    Protocol

    School of Traditional Chinese Medicine, Xiamen University Malaysia, Sepang, Malaysia

    *all authors contributed equally

    Corresponding Author:

    Muhammad Shahzad Aslam, MPhil, PhD, PharmD

    School of Traditional Chinese Medicine

    Xiamen University Malaysia

    Jalan Sunsuria, Bandar Sunsuria, Selangor

    Sepang, 43900

    Malaysia

    Phone: 60 387055209

    Email: aslammuhammadshahzad@gmail.com


    Background: Workplace cyberbullying harms the psychological and social functioning of professionals working in an organization and may decrease the productivity and efficiency of daily life tasks. A recent study on trainee doctors across 8 different United Kingdom National Health Service trusts found health issues and job dissatisfaction in people who have experienced workplace cyberbullying. This disabling effect is even more noticeable in low-socioeconomic communities within low-income countries. In Malaysia, there is a need to create a personalized mobile mental health intervention program for health care professionals. These programs should be directed to prevent and decrease psychosocial issues and enhance coordination among health care professionals to solve health issues in the community.

    Objective: Our main objective is to study the pre-effects and posteffects of the Personalized Mobile Mental Health Intervention (PMMH-I) for workplace cyberbullying in public and private hospitals in Malaysia.

    Methods: A hospital-based multimethod multi-analytic evidential approach is proposed, involving social and psychological health informatics. The project has been subdivided into 3 stages, starting with Phase 1, a prevalence study, followed by exploratory studies. Phase 2 consists of a quasi-experimental design, whereas the development of a prototype and their testing will be proposed in Phase 3. Each stage includes the use of quantitative and qualitative methods (mixed-method program), using SPSS (version 26.0; IBM Corp) and Stata (version 16.1; StataCorp) as tools for quantitative research, and NVivo (version 1.0; QSR International) and Atlas.ti (version 9.0.16; ATLAS.ti Scientific Software Development GmbH) for qualitative research.

    Results: The results of this study will determine the pre- and posteffectiveness of an integrated PMMH-I for health care professionals. The prototype system platform will be developed and implemented in a public and private hospital. Results from Phase 1 will be published in 2021, followed by the implementation of Phase 2 in subsequent years.

    Conclusions: This study will provide evidence and guidance regarding the implementation of a personalized mobile mental health intervention for health care professionals into routine public and private hospitals to enhance communication and resolve conflicts.

    International Registered Report Identifier (IRRID): PRR1-10.2196/23112

    JMIR Res Protoc 2020;9(11):e23112

    doi:10.2196/23112

    Keywords

    workplace cyberbullying; mental health; personalized mobile mental health intervention; health informatics; Malaysia 


    Background

    Suicidal behavior, depression, loneliness, anxiety, and somatic symptoms are among the most common effects of cyberbullying experienced by students [1] and adolescents [2]. There is a huge psychological impact (ie, depression) on people who experience workplace bullying from coworkers, such as nurses [3-6], health care providers, and employers [7], especially among women. The prevalence of cyberbullying among first-year trainee doctors who reported experiencing it at least 1 time was 46.2% [8]. Another study found a high prevalence rate (28%) of cyberbullying among a diverse workforce sample in the United States [9].

    Malaysia has a high mobile penetration rate due to thriving e-commerce [10]. The problematic use of smartphones can lead to addiction; increased use of mobile phones in India has led to an increase in technology addiction [11,12]. This addiction leads to depression, anxiety, stress, and self-esteem issues [13]. A school-based study identified a strong correlation between pathological internet use and cyberbullying in Greece [14]. However, there is a lack of evidence that pathological mobile use could lead to an increase in cyberbullying in the workplace. Most published studies, systematic reviews, and interventions are limited to cyberbullying at school, colleges, universities, or the young population.

    Research Questions

    We aim to explore the following 4 research questions in this study: (1) What is the current workplace cyberbullying status among Traditional Chinese Medicine practitioners (TCM) in Malaysia? (2) What is the pre- and postefficacy of the Personalized Mobile Mental Health Intervention (PMMH-I) on the prevalence of measurable factors (ie, depression, anxiety, and stress) in workforce cyberbullying on TCM practitioners? (3) What are the moderating and mediating factors of workplace cyberbullying on TCM practitioners? (4) What is the technological feasibility of implementing the integrated PMMH-I as a component of routine hospital-based systems?

    Main Intention and Objective

    This study's main intention is to give awareness and authority to the community of health care professionals against cyberbullying by developing a Personalized Mobile Mental Health Intervention program (PMMH-I) in partnership with all health care providers. This partnership will seek to form alliances with public and private institutions to ensure the success and continuation of the program. The PMMH-I program will aim to reduce the psychometric properties of cyberbullying through awareness and adaptation of technology.

    The main objective of this protocol is to develop and implement the PMMH-I program to decrease the psychometric properties of cyberbullying in the hospital-based setting in Malaysia. We hypothesize that the creation of PMMH-I programs will come about by executing a PMMH-I strategy that permits the fusion of global and local knowledge. PMMH-I promotes health care community development, thereby increasing social integration between different health care providers such as doctors, nurses, traditional and complementary medical practitioners, pharmacists, and other health care providers.

    Theoretical Approach

    We will adopt the emotion reaction model (ERM) [15] as our theoretical framework, which allows researchers to explore the relationships among concepts of stressor, emotions, emotion regulators, and people who experience cyberbullying in the hospital setting in Malaysia. The ERM elucidates how emotions may produce an impact on people who experience cyberbullying in the current technological era. The adaptation of ERM depicted in Figure 1 posits the relationship between stressor, emotions, and people who experience cyberbullying, which is mediated by emotion reappraisal and emotion suppression.

    ‎
    Figure 1. A proposed theoretical model of the emotion reaction model.
    View this figure

    Ethics Approval

    According to the local and national ethical instructions for research (the National Committee for Clinical Research) guidelines, this study did not require ethics approval.

    Data Sharing Statement

    No data are available. All data relevant to the study are included in the manuscript.

    Study Plan

    A hospital-based multimethod multi-analytic evidential approach is proposed, involving social and psychological health informatics. The project has been subdivided into 3 stages, starting with Phase 1, a prevalence study, followed by exploratory studies. Phase 2 consists of a quasi-experimental design, whereas the development of a prototype and their testing will be proposed in Phase 3. Flow diagrams for the research design are presented in Figures 2 and 3. A breakdown of our anticipated timeline for each phase of the study appears in Figure 4.

    Each stage includes the use of quantitative and qualitative methods (mixed-method program), using SPSS (version 26.0; IBM Corp) and Stata (version 16.1; StataCorp) as tools for quantitative research, and NVivo (version 1.0; QSR International) and Atlas.ti (version 9.0.16; ATLAS.ti Scientific Software Development GmbH) for qualitative research.

    ‎
    Figure 2. Research flow diagram.
    View this figure
    ‎
    Figure 3. Flow diagram of the experimental design; PMMH-I: Personalized Mobile Mental Health Intervention.
    View this figure
    ‎
    Figure 4. Gantt chart of study-related activities.
    View this figure

    Phase 1: Multimethod Multi-Analytic Evidential Approach

    Objectives

    Phase 1 will consist of the identification and analysis of the problem. The duration of this phase will be 6 months and will include knowledge development about workplace cyberbullying among TCM practitioners.

    Prevalence Study

    The specific objectives of this study include (1) evaluating the overall prevalence rate of workplace cyberbullying and its related psychological impacts (depression, anxiety, and stress) on TCM practitioner; (2) understanding the measures associated with various forms of workplace cyberbullying on age, gender, and frequency; and (3) understanding the measure associated with workplace cyberbullying on perpetrators responsible for workplace cyberbullying. The current research will be a survey-based online cross-sectional prevalence study. TCM practitioners are considered a hard-to-reach population; thus, we will conduct a nonprobability snowball sample of 1023 adults (3% precision, 95% confidence level) according to the number of TCM practitioners, which was approximately 15,000 in 2011 [16]. The Hamilton Depression Scale (HAM-D) [17], the Hamilton Anxiety Scale (HAM-A) [18], and the clinical anger scale [19] will be used to assess the psychological impact on TCM practitioners. The Cyberbullying Questionnaire (CBQ) and a short version of a cyberbullying behavior questionnaire (CBQ-S), adapted from Jönsson et al [20], will be used to identify the prevalence among TCM practitioners; these selected questionnaires were already validated in Sweden and the US adult population [20]. The prevalence will also investigate the association with moderating variables (age and gender). Perpetrators of cyberbullying will also be assessed in the specific identification of the prevalence of workplace cyberbullying using the CBQ and CBQ-S questionnaires. The sampling method to understand perpetrator effects in the prevalence will similarly be addressed. The survey will also include a socioeconomic assessment, including education, income, home characteristics, and commodities. The survey will be conducted online due to the current pandemic situation caused by COVID-19, following the CHERRIES guidelines given by Gunther Eysenbach [21].

    Exploratory Study

    The purpose of the exploratory study is to understand the moderating and mediating factors of workplace cyberbullying by using the ERM on TCM practitioners [15]. The specific questions of this study include the following: (1) What are the relationships between emotions, workplace stressors, cyberbullying perpetration, cyberbullying victimization, and control appraisal, reappraisal, and suppression? (2) What effects do demographic factors have on emotions, workplace stressors, cyberbullying perpetration, cyberbullying victimization, and control appraisal, reappraisal, and suppression? The survey will be conducted using a convenience method, with a sample size of 384 (5% precision, 95% confidence level). A structural equation model will be developed, and each construct will be discussed. A snowball sampling method will be used to approach the target population. There will be a lucky draw at the end of the exploratory study on the participants; the 10 winners of the draw will receive an electronic power bank.

    This procedure was selected due to a hard-to-reach study population and a study undertaken during the COVID-19 pandemic.

    Phase 2: Program Development

    Objectives

    The aim of Stage 2 is to develop the anticyberbullying intervention program. Past approaches have been ineffective because of a lack of consistency within the community. To achieve this objective, a quasi-experiment with a nonequivalent pretest–post-test control group design will be conducted for a duration of 1-1.5 years (Figure 5).

    ‎
    Figure 5. Overview of the nonequivalent control-group pretest–post-test study.
    View this figure
    Quasi-experiment with Nonequivalent Pretest–Post-test Control Group Design

    The study design for this stage is quasi-experimental, in which the groups are nonrandomized into intervention and control groups and selected purposively. This study will be conducted in public hospitals and private hospitals located in Malaysia. All hospitals are eligible to participate. The selection of hospitals will be randomized for the implementation of the interventions. The randomization of hospitals will be performed by online statistical computing web programming to generate the randomization schedule [22]. The current methodology will help reduce selection bias in the study.

    This intervention study will be conducted on TCM practitioners specifically. A baseline assessment will be done, in the intervention and control hospital, to measure the burden of bullying and its correlates using the CBQ and CBQ-S. This stage will begin after the investigation of prevalence and exploratory research. First, baseline information will be collected within 3 months, and then the intervention will be monitored twice after a regular period of 6 months in order to monitor the consistency of the intervention program.

    The intervention program will be designed and finalized after (1) a systematic review of systematic reviews of previously published literature on bullying and the effectiveness of antibullying intervention programs; (2) the conducting of focus group discussions with TCM practitioners, patients, and other health care providers (to explore the perceptions, beliefs, and suggestions regarding bullying prevention programs); and (3) the conducting of a consultation workshop with all the stakeholders. The bullying intervention program (BIP) will pretest among 50 participants, which will include health care providers, TCM practitioners, and patients. The multicomponent hospital-based intervention strategy will be administered at 3 levels: (1) patients, (2) TCM practitioners, and (3) other health care providers. All the data of participants in this study will be password-protected and safe using Microsoft OneDrive. The recruitment of participants will follow the same procedure described for the exploratory study and prevalence study.

    Phase 3: Electronic Anticyberbullying Monitoring System

    Interface Design

    An expert from each stakeholder group (TCM practitioners, other health care professionals, patients, and IT experts) will be involved in the interface design, information system design, and prototype testing. The system’s overall performance and satisfaction will be acquired through questionnaires (questionnaires are available upon request). The CBQ and CBQ-S will be used to determine the effectiveness of an intervention program using a prototype (post-test). The compilation of this research will be used to design the Personalized Mobile Mental Health Intervention (PMMH-I). The duration for stage 3 will be 6 months.

    Literature Review on Interventions for Workplace Cyberbullying

    There is limited literature available on interventions for workplace cyberbullying among TCM practitioners. Most of the available literature is limited to the identification of exploratory factors, measurement factors, and increasing trends of workplace cyberbullying. Funded by the Massey University Research Fund, D’Souza et al [23] discussed the issue of workplace cyberbullying in New Zealand; the study sample size was limited to 20 participants, but they predict an increase of workplace cyberbullying [23,24]. Vranjes et al [25] developed the inventory of cyberbullying acts at the workplace (ICA-W); the available results are preliminary items and build upon existing knowledge.

    Moreover, the results of available literature are often generalized, noncontextual, and lack practical implications [25]. Another online self-report survey on workplace cyberbullying in New Zealand reports an increasing trend in workplace cyberbullying [26]; however, self-reported answers may be exaggerated and lead to an increase in survey bias. The studies of Farley [27], who had worked on the workplace cyberbullying measurement scale, are limited to methodological improvement in the measurement scale; these studies call for further exploratory studies. Other studies on the exploratory factors of workplace cyberbullying [27-29] lack coordination between theoretical and practical applications. The subjects of cyberbullying literature in Malaysia are limited mostly to adolescents and undergraduate students, and the focus is primarily on prevalence, the determination of exploratory factors, and descriptive studies [30-33]. The available studies are limited to examining the exploratory factors of workplace bullying [34].

    Our studies will adopt the ERM in hospitals, and will adapt personalized mobile-based IT consumerization of the ERM in workplace cyberbullying among health care professionals as the intervention. A recent study also supports mobile phone– and internet-based interventions for treating depression [35]. Our study will be the first to use a personalized mobile mental health intervention for workplace cyberbullying for TCM practitioners.

    Data Collection and Analysis

    The recruitment of participants will follow the same procedure as was described for the exploratory study and prevalence study. The participant will be invited to join through a webinar to complete the questionnaire. Only the participants who completed Phase 2 will be asked to continue. The prototype will be given to them, and a brief training will be provided through a 30-minute webinar. Stage 3 participants will be limited to the Stage 2 completers in order to gauge the effectiveness of the Step 2 intervention program and whether the prototype is capable of reporting cyberbullying effectively. Thematic analysis will be done on the data yielded from the control and intervention groups. All the data of participants in this study will be password-protected and safe using Microsoft OneDrive.


    The study was submitted for funding by an internal grant from Xiamen University Malaysia in May 2020. The prevalence study for Phase 1 began in July 2020, and it will be followed by exploratory research in January 2021. The duration for Phase 1 will be 12 months. For Phase 2, the recruitment of participants will begin in July 2021. The baseline study will be completed in 4 months. The intervention will be divided into two 4-month periods to measure the consistency of the intervention. The last phase will be the development and implementation of the prototype with pilot testing and post-testing, which will have a duration of 6 months (subject to the availability of funding).


    The impetus for this study is a need for technologically based interventions to decrease work-related cyberbullying identified by health professionals and academics. Workplace cyberbullying leads to counterproductive work behaviors [36] and may lead to violence due to conflicts or work-related stress. This study will also provide insight into how job-related stress (role conflicts), team-related stress (interpersonal conflicts), and organization-related stress (organizational change) can lead to unintentional cyberbullying communication. This causes cyberbullying victimization between doctors, traditional alternative practitioners, and other health care providers. There is a lack of evidence on knowledge generation indicators, such as prevalence studies. To reduce conflict and enhance work productivity, there is a need for exploratory studies to understand the ERM and the adaptation of technological interventions such as personalized mobile mental health in hospital-based settings.

    Acknowledgments

    This work was supported by the Research Management Center, Xiamen University Malaysia, grant number XMUMRF/2020-C6/ITCM/0005. The funding body had no role in the design and conduct of this study; the collection, management, analysis, and interpretation of the data; the preparation, review, and approval of the manuscript; or the decision to submit the manuscript for publication.

    Special thanks to Aishah Rose Marie for her perseverance in proofreading the manuscript.

    Authors' Contributions

    MSA was involved in conceptualization, methodology design, data collection, data analysis, prototype development, and co-writing of the paper. YK was involved in methodology design, data collection from the hospitals, and co-writing of the paper. LQ was involved in methodology design, data collection from the hospitals, and co-writing of the paper.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Peer Review Report.

    PDF File (Adobe PDF File), 1474 KB
    1. Bauman S, Toomey RB, Walker JL. Associations among bullying, cyberbullying, and suicide in high school students. J Adolesc 2013 Apr;36(2):341-350. [CrossRef] [Medline]
    2. Nixon C. Current perspectives: the impact of cyberbullying on adolescent health. AHMT 2014 Aug:143. [CrossRef]
    3. McKenna B, Smith N, Poole S, Coverdale J. Horizontal violence: experiences of Registered Nurses in their first year of practice. Journal of advanced nursing 2003;42(1):90-96.
    4. Lee, Youn J, Bernstein K, Lee M, Nokes KM. Bullying in the Nursing Workplace: Applying Evidence Using A Conceptual Framework. Nursing Economics 2014:255-267.
    5. Yildirim D. Bullying among nurses and its effects. Int Nurs Rev 2009 Dec;56(4):504-511. [CrossRef] [Medline]
    6. Laschinger HKS, Grau AL, Finegan J, Wilk P. New graduate nurses' experiences of bullying and burnout in hospital settings. J Adv Nurs 2010 Dec;66(12):2732-2742. [CrossRef] [Medline]
    7. MacIntosh J, Wuest J, Gray MM, Cronkhite M. Workplace bullying in health care affects the meaning of work. Qual Health Res 2010 Aug 12;20(8):1128-1141. [CrossRef] [Medline]
    8. Farley S, Coyne I, Sprigg C, Axtell C, Subramanian G. Exploring the impact of workplace cyberbullying on trainee doctors. Med Educ 2015 Apr 20;49(4):436-443. [CrossRef] [Medline]
    9. Lutgen-Sandvik P, Tracy SJ, Alberts JK. Burned by Bullying in the American Workplace: Prevalence, Perception, Degree and Impact. J Management Studies 2007 Sep;44(6):837-862. [CrossRef]
    10. Lee WO, Wong LS. Determinants of Mobile Commerce Customer Loyalty in Malaysia. Procedia - Social and Behavioral Sciences 2016 Jun;224:60-67. [CrossRef]
    11. Sharma MK, Rao GN, Benegal V, Thennarasu K, Thomas D. Technology Addiction Survey: An Emerging Concern for Raising Awareness and Promotion of Healthy Use of Technology. Indian Journal of Psychological Medicine 2020 Sep 17;39(4):495-499. [CrossRef]
    12. Shrivastava A, Sharma MK, Marimuthu P. Internet addiction at workplace and it implication for workers life style: Exploration from Southern India. Asian J Psychiatr 2018 Feb;32:151-155. [CrossRef] [Medline]
    13. Elhai JD, Dvorak RD, Levine JC, Hall BJ. Problematic smartphone use: A conceptual overview and systematic review of relations with anxiety and depression psychopathology. J Affect Disord 2017 Jan 01;207:251-259. [CrossRef] [Medline]
    14. Tsimtsiou Z, Haidich AB, Drontsos A, Dantsi F, Sekeri Z, Drosos E, et al. Pathological Internet use, cyberbullying and mobile phone use in adolescence: a school-based study in Greece. Int J Adolesc Med Health 2017 Apr 22;30(6):a. [CrossRef] [Medline]
    15. Vranjes I, Baillien E, Vandebosch H, Erreygers S, De Witte H. The dark side of working online: Towards a definition and an Emotion Reaction model of workplace cyberbullying. Computers in Human Behavior 2017 Apr;69:324-334. [CrossRef]
    16. Johny AK, Cheah WL, Razitasham S. Disclosure of Traditional and Complementary Medicine Use and Its Associated Factors to Medical Doctor in Primary Care Clinics in Kuching Division, Sarawak, Malaysia. Evid Based Complement Alternat Med 2017;2017:5146478-5146410 [FREE Full text] [CrossRef] [Medline]
    17. Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry 1960 Feb 01;23(1):56-62 [FREE Full text] [CrossRef] [Medline]
    18. HAMILTON M. The assessment of anxiety states by rating. Br J Med Psychol 1959;32(1):50-55. [CrossRef] [Medline]
    19. Snell WE, Gum S, Shuck RL, Mosley JA, Kite TL. The clinical anger scale: Preliminary reliability and validity. J. Clin. Psychol 1995 Mar;51(2):215-226. [CrossRef]
    20. Jönsson S, Muhonen T, Forssell RC, Bäckström M. Assessing Exposure to Bullying through Digital Devices in Working Life: Two Versions of a Cyberbullying Questionnaire (CBQ). PSYCH 2017;08(03):477-494. [CrossRef]
    21. Eysenbach G. Improving the quality of Web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res 2004 Sep 29;6(3):e34 [FREE Full text] [CrossRef] [Medline]
    22. Suresh K. An overview of randomization techniques: An unbiased assessment of outcome in clinical research. J Hum Reprod Sci 2011 Jan;4(1):8-11 [FREE Full text] [CrossRef] [Medline]
    23. Natalia D, Darryl F, David T, Bevan C. Engaging industry specialists on the issue of workplace cyberbullying — a New Zealand study. Journal of Health, Safety and Environment 2017;33(2):105-124.
    24. Natalia D, Darryl F, David T, Bevan C. Workplace Cyberbullying in New Zealand Nursing: A Report for Participants and Professional Bodies. Auckland, New Zealand: Massey University, School of Management   URL: https:/​/www.​massey.ac.nz/​shadomx/​apps/​fms/​fmsdownload.​cfm?file_uuid=D5ECA077-0C0D-4603-894F-AC2EBADE3FBE [accessed 2020-05-05]
    25. Vranjes I, Baillien E, Vandebosch H, Erreygers S, De Witte H. When workplace bullying goes online: construction and validation of the Inventory of Cyberbullying Acts at Work (ICA-W). European Journal of Work and Organizational Psychology 2017 Aug 08;27(1):28-39. [CrossRef]
    26. Gardner D, O'Driscoll M, Cooper-Thomas H, Roche M, Bentley T, Catley B, et al. Predictors of Workplace Bullying and Cyber-Bullying in New Zealand. Int J Environ Res Public Health 2016 Apr 27;13(5):448 [FREE Full text] [CrossRef] [Medline]
    27. Farley S, Coyne I, Axtell C, Sprigg C. Design, development and validation of a workplace cyberbullying measure, the WCM. Work & Stress 2016 Nov 22;30(4):293-317. [CrossRef]
    28. Coyne I, Farley S, Axtell C, Sprigg C, Best L, Kwok O. Understanding the relationship between experiencing workplace cyberbullying, employee mental strain and job satisfaction: a dysempowerment approach. The International Journal of Human Resource Management 2016 Feb 26;28(7):945-972. [CrossRef]
    29. Snyman R, Loh J. Cyberbullying at work: The mediating role of optimism between cyberbullying and job outcomes. Computers in Human Behavior 2015 Dec;53:161-168. [CrossRef]
    30. Balakrishnan V. Actions, emotional reactions and cyberbullying – From the lens of bullies, victims, bully-victims and bystanders among Malaysian young adults. Telematics and Informatics 2018 Aug;35(5):1190-1200. [CrossRef]
    31. Lai CS, Mohamad MM, Lee MF, Salleh KM, Sulaiman NL, Rosli DI, et al. Prevalence of Cyberbullying among Students in Malaysian Higher Learning Institutions. adv sci lett 2017 Feb 01;23(2):781-784. [CrossRef]
    32. Abu Bakar HS. The emergence themes of cyberbullying among adolescences. International Journal of Adolescence and Youth 2015 Mar 02;20(4):393-406. [CrossRef]
    33. Balakrishnan V. Cyberbullying among young adults in Malaysia: The roles of gender, age and Internet frequency. Computers in Human Behavior 2015 May;46:149-157. [CrossRef]
    34. Hidzir N, Jaafar M, Jalali A, Dahalan N. An Exploratory Study on the Relationship between the Personal Factors of the Perpetrator and Workplace Bullying. JP 2017;49:67-76. [CrossRef]
    35. Goldin PR, Lindholm R, Ranta K, Hilgert O, Helteenvuori T, Raevuori A. Feasibility of a Therapist-Supported, Mobile Phone-Delivered Online Intervention for Depression: Longitudinal Observational Study. JMIR Form Res 2019 Jan 22;3(1):e11509 [FREE Full text] [CrossRef] [Medline]
    36. Keskin H, Akgün AE, Ayar H, Kayman S. Cyberbullying Victimization, Counterproductive Work Behaviours and Emotional Intelligence at Workplace. Procedia - Social and Behavioral Sciences 2016 Nov;235:281-287. [CrossRef]

    ‎
    CBQ: Cyberbullying Questionnaire
    CBQ-S: short version of a cyberbullying behavior questionnaire
    ERM: emotion reaction model
    ICA-W: inventory of cyberbullying acts in the workplace
    PMMH-I: Personalized Mobile Mental Health Intervention program
    TCM: Traditional Chinese Medicine

    Edited by G Eysenbach; submitted 01.08.20; peer-reviewed by A Wahab, A van Kraaij; comments to author 03.09.20; revised version received 05.09.20; accepted 10.11.20; published 20.11.20

    Copyright

    ©Yun Jin Kim, Linchao Qian, Muhammad Shahzad Aslam. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 20.11.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.