This paper is in the following e-collection/theme issue:

RCTs - Pilots/Feasibility Studies (eHealth) (79) Web-based and Mobile Health Interventions (3092)

Published on in Vol 3, No 4 (2014): Oct-Dec

A Web-Based Training Program Using Cognitive Behavioral Therapy to Alleviate Psychological Distress Among Employees: Randomized Controlled Pilot Trial

A Web-Based Training Program Using Cognitive Behavioral Therapy to Alleviate Psychological Distress Among Employees: Randomized Controlled Pilot Trial

A Web-Based Training Program Using Cognitive Behavioral Therapy to Alleviate Psychological Distress Among Employees: Randomized Controlled Pilot Trial

Authors of this article:

Makiko Mori1 Author Orcid Image ;   Miyuki Tajima2 Author Orcid Image ;   Risa Kimura1 Author Orcid Image ;   Norio Sasaki1 Author Orcid Image ;   Hironori Somemura1 Author Orcid Image ;   Yukio Ito1 Author Orcid Image ;   June Okanoya1 Author Orcid Image ;   Megumi Yamamoto1 Author Orcid Image ;   Saki Nakamura1 Author Orcid Image ;   Katsutoshi Tanaka1 Author Orcid Image
Article Authors Cited by (15) Tweetations (1) Metrics

    Original Paper

    1Department of Occupational Mental Health, Graduate School of Medical Sciences, Kitasato University, Sagamihara-City Kanagawa, Japan

    2National Center for Cognitive Behavior Therapy and Research, National Center of Neurology and Psychiatry, Kodaira City Tokyo, Japan

    Corresponding Author:

    Makiko Mori, MD

    Department of Occupational Mental Health

    Graduate School of Medical Sciences

    Kitasato University

    1-15-1

    Kitasato

    Sagamihara-City Kanagawa, 228-8555

    Japan

    Phone: 81 042 660 9119

    Fax:81 042 660 9015

    Email: makiko.mori@konicaminolta.com


    Background: A number of psychoeducational programs based on cognitive behavioral therapy (CBT) to alleviate psychological distress have been developed for implementation in clinical settings. However, while these programs are considered critical components of stress management education in a workplace setting, they are required to be brief and simple to implement, which can hinder development.

    Objective: The intent of the study was to examine the effects of a brief training program based on CBT in alleviating psychological distress among employees and facilitating self-evaluation of stress management skills, including improving the ability to recognize dysfunctional thinking patterns, transform dysfunctional thoughts to functional ones, cope with stress, and solve problems.

    Methods: Of the 187 employees at an information technology company in Tokyo, Japan, 168 consented to participate in our non-blinded randomized controlled study. The training group received CBT group education by a qualified CBT expert and 1 month of follow-up Web-based CBT homework. The effects of this educational program on the psychological distress and stress management skills of employees were examined immediately after completion of training and then again after 6 months.

    Results: Although the training group did exhibit lower mean scores on the Kessler-6 (K6) scale for psychological distress after 6 months, the difference from the control group was not significant. However, the ability of training group participants to recognize dysfunctional thinking was significantly improved both immediately after training completion and after 6 months. While the ability of participants to cope with stress was not significantly improved immediately after training, improvement was noted after 6 months in the training group. No notable improvements were observed in the ability of participants to transform thoughts from dysfunctional to functional or in problem-solving skills. A sub-analysis of participants who initially exhibited clinically significant psychological distress (K6 score ≥5) showed that the mean K6 score was significantly improved immediately after training completion for the training group compared to the control group (−2.50 vs −0.07; mean difference 2.43, 95% CI 0.55-4.31; d=0.61), with this effect remaining even after 6 months (−3.49 vs −0.50; mean difference 2.99, 95% CI 0.70-5.29; d=0.60).

    Conclusions: Our results suggest that a brief stress management program that combines group CBT education with Web-based CBT homework moderately alleviates the distress of employees with clinically significant psychological distress. In addition, the program might help improve employees’ ability to evaluate their own stress management skills.

    JMIR Res Protoc 2014;3(4):e70

    doi:10.2196/resprot.3629

    Keywords

    Web-based training program; cognitive behavioral therapy; stress management; workplace; Internet; group 


    Alleviating psychological distress in employees is essential in terms of health and work performance. Epidemiological studies have reported that the proportion of workers whose stress level is high enough to necessitate treatment is approximately 15% [1,2]. Despite this, many experiencing such high levels of stress continue to work without receiving proper care [1]. According to a Japanese national survey, 58% of workers report feeling significantly strong psychological distress [3].

    Systematic reviews have reported that work-related psychological distress, regardless of clinical significance, has been found to be related to a number of mental disorders, including depression and anxiety disorders [4,5]. Further, to improve work performance, increasing emphasis is being placed on managing psychological distress regardless of clinical significance [6,7].

    In a national survey, 60% of workers reported strong psychological distress, which suggests that other workers might also feel some degree of psychological distress, the Japanese Ministry of Health, Labor and Welfare has encouraged employers to implement stress management education for all employees to prevent mental disorders and improve work performance [8].

    A systematic review of the effects of training programs for work-related stress reported that those using cognitive behavioral therapy (CBT) is the most effective option for alleviating stress [9]. These training programs require time and CBT experts and are conducted not only as therapy but also as stress management training [10-20]. CBT has mainly been implemented as an individual psychotherapy, although low-intensity CBT [21-23] to provide interventions to a relatively larger number of people is becoming increasingly common. Recent programs include the provision of information on CBT via books, group training, and group education. CBT is now also offered via telephone and Web in a self-learning format. This increase in accessibility has proven beneficial in improving stress management [9,24-28]. However, despite these promising findings regarding CBT, its efficacy in the workplace remains uncertain, as the time available for health education of employees in a workplace setting is limited.

    Here, we developed a brief educational program based on CBT that is feasible for implementation in a workplace setting. We conducted a pilot study with a randomized controlled design to investigate the effects of the program on alleviation of distress and improvement of stress management abilities in employees who have significant or non-significant distress.


    Study Participants and Procedure

    The target population consisted of 187 employees (147 men and 40 women) at an information technology company in Tokyo, Japan. The majority of employees were system engineers with a high degree of computer literacy. The company provides in-house training programs for managerial (eg, legal knowledge, human resource management, accounting) and non-managerial positions (eg, health and safety) once or twice a year. The present training program was announced and briefed for the 187 non-management employees in the company. Participation in this study was voluntary, and informed consent was obtained from employees prior to group education after explaining the study purpose, procedures, and details of the training program.

    The participants who provided written informed consent were randomly assigned to training or control groups. The training group received group CBT training during working hours in December 2011 and an additional month of CBT homework, with a follow-up study conducted 6 months later. All participants were required to complete self-rated online questionnaires before training, immediately after, and on 6-month follow-up. For ethical reasons, this training program was provided to the control group after follow-up. No exclusion criteria were set, as the study examined the effects of the CBT program in a real-world workplace setting. The study protocol was approved by the Ethics Committee of the School of Allied Health Sciences at Kitasato University. Reporting of methods and results of this study are based on the CONSORT-EHEALTH guidelines [29].

    Contents of the Training Program

    The training program was composed of a 150-minute group class presented by a qualified CBT expert on cognitive behavior therapy and 1 month of homework via Web-based CBT program. The following three topics were covered in the group education program: an overview of CBT, problem-solving techniques, and cognitive restructuring techniques. For problem-solving techniques, we encouraged participants to use group brainstorming, which we consider the most important element in a number of problem-solving techniques. For cognitive restructuring techniques, participants received a lecture designed to facilitate understanding of the techniques and column sheets to complete during the Web-based CBT program. Column sheets included the following topics: situations where participants felt stressed, feelings and behaviors, automatic thoughts, an objective examination of those automatic thoughts (including counterevidence), adaptive thoughts, and changes in feeling and behavior. While completing the worksheets, participants held group discussions by exchanging questions and opinions regarding the cognitive restructuring techniques. Participants also improved their understanding of the cognitive restructuring techniques by consulting with the CBT expert. Following group education, the Web-based CBT homework was explained.

    Participants were asked to practice the column method with a Web-based CBT program by reflecting on the stress they experienced over a 1-month period starting the day after group education. The Web-based CBT program was developed by Woman Wave Corporation (see Figures 1-2 for screenshots). The fee for the program was prepaid using research expenses to allow participants to access the program free of charge. The recommended Web program enables users to easily complete the column sheets by providing contextual explanations and advice on the column method. Users can complete column sheets by entering information as directed on the screen. In addition to the column sheet above, participants were able to access the program via their computers at work and home and were encouraged to complete their homework at least twice. Homework was expected to help familiarize participants with the column method. However, homework completion was not mandatory, to avoid placing further pressure on participants. To encourage homework completion, occupational health nurses sent a total of four emails, prepared by a CBT expert, to each participant to provide supplementary information and tips regarding the cognitive restructuring techniques. These occupational health nurses received a 150-minute training session before the study from a CBT expert and then answered questions from participants regarding Web-based CBT procedures, with a CBT expert answering any remaining questions. To reduce the burden on participants, the program did not contain homework on problem-solving techniques.

    ‎
    Figure 1. Program screenshot.
    View this figure
    ‎
    Figure 2. Program screenshot.
    View this figure

    Outcome Evaluation

    The primary outcome was measured as the change in Kessler-6 (K6) score, which measures psychological distress. The K6 score was measured before training to establish a baseline and then immediately after 1 month of training and again after 6 months. Developed as a screening tool for depressive disorders and anxiety disorders [30], the K6 scale is widely used to assess psychological stress [31,32], with the score obtained from a simple self-rating questionnaire on symptoms of depression and anxiety experienced over the previous month. The reliability and validity of the Japanese version of the K6 questionnaire utilized in this study have been verified [33]. A study on the cutoff point to diagnose clinically significant psychological distress of respondents suggest a cutoff point of 4 or 5 (total score, 24) [34].

    Secondary outcomes were evaluated based on respondents’ answers to several questions on an original self-rating questionnaire. Questions concerned the recognition of dysfunctional thinking habits (“Do you recognize your dysfunctional thinking habits?”), ability to change dysfunctional thinking patterns to functional ones (“Can you transform your dysfunctional thinking patterns that have been bothering you into functional ones?”), ability to cope with stress (“Are you confident that you can cope with stress by yourself?”), and problem-solving skills (“Do you think you can solve a problem when you face one?”). The respondents answered using a 5-point scale (1=strongly disagree, 5=strongly agree).

    Randomization and Masking

    An independent researcher who had no direct contact with the participants used computer-generated randomization with a 1:1 ratio and block size of 6. No stratification was performed and evaluators were masked. Owing to the nature of the intervention, participants were informed of their allocation status.

    Statistical Analysis

    A systematic review of the literature on mental disorder intervention suggests that Cohen’s effect size (d) for those with sub-threshold depression is 0.42 (95% CI 0.23-0.60) [35]. The sample size necessary to obtain an effect size of 0.42 with probability of Type I error (α) less than .05 and Type II error (β) less than .20 was 90 for each group. A generalized equation was used for estimation, based on an intention-to-treat (ITT) analysis. The rate of missing primary or secondary outcomes was 19.26% across the follow-up period (K6, 18.2%; recognition of dysfunctional thinking habits, 19.6%; changing dysfunctional thinking patterns, 19.3%; coping skills, 19.0%; problem-solving skills, 19.6%). To satisfy the ITT requirement that analyses be conducted for all participants, a multiple imputation (MI) method was used on the assumption that data could be considered missing at random. MI allows for uncertainty caused by missing data by generating several different plausible imputed data sets using a set of external covariates and appropriately combining results obtained from each [36,37]. We utilized a sequential regression approach to generate 20 imputations for each missing value, as recommended by Graham [38].

    To determine the effects of the training program, primary and secondary outcomes were measured, and differences in scores before and after implementation for the training and control groups were calculated. The short-term effect was calculated by subtracting the baseline scores from those obtained after completion of 1 month of homework. The long-term effect was calculated by subtracting the baseline scores from those obtained after 6 months. Results are shown as changes in the raw scores for primary and secondary outcomes. In addition, the differences in mean adjusted for baseline score of each outcome were also calculated. For the K6 scale, a sub-analysis was conducted among participants with a K6 score ≥5 at baseline. In addition, the training group was divided into subgroups of those completing Web-based CBT homework at least once and those completing no homework, and changes in the K6 scores of these subgroups were compared.

    To analyze baseline characteristics of the study participants, information on sex, age, hours of overtime, mean hours of sleep on weekdays, marital status, drinking habits, exercise habits, and history of psychiatric treatment was collected from each participant at baseline. A t test was used for numerical variables and a χ2 test for categorical variables. Statistical significance was set at P<.05. IBM SPSS Statistics 22 and IBM SPSS Missing Values 22 (SPSS Inc., Chicago, IL, USA) were used for statistical analyses.


    Participants

    Figure 3 shows the study flow. Of 187 potential participants, 2 took a leave of absence before the start of the study, 16 did not consent to participate, and 1 was transferred to another location before the study started, leaving 168 enrolled in this study. These 168 participants were randomly assigned to either the training (n=83) or control group (n=85). In the training group, 81 (98%) actually received a group session, and 63 (76%) actually received additional Web-based CBT homework. The completion of homework by participants was as follows: once (n=15), twice (n=47), and more than twice (n=1). Among those who did not complete assigned homework (20/83, 24%), 2 also did not attend the group session.

    Follow-up questionnaires immediately after completion of the program were completed by 69 (83%) of the 83 respondents in the training group and by 73 (86%) of the 85 control group participants. Follow-up questionnaires after 6 months were completed by 67 (81%) respondents in the training group and by 72 (85%) in the control group.

    Five participants emailed the nurse to inquire about the Web-based CBT. Of these five, two inquired about how to operate the Web program and three about how to complete the column sheets. The content of this advice was the same as that provided in the training session.

    ‎
    Figure 3. Trial profile.
    View this figure

    Baseline Characteristics

    Baseline characteristics of the 168 participants are shown in Table 1. No missing data were observed. Of the 168 participants, 22% (n=37) were women (19%, 16/83 of training group and 25%, 21/85 of control group), 78% (n=131) were men (81%, 67/83 of training group and 75%, 64/83 of control group), and mean age across both training and control groups was 38.4 years (SD 8.1 and SD 8.4 respectively). No significant differences were observed between the training and control groups regarding sex ratio, mean age, hours of overtime, mean hours of sleep, marital status, exercise and drinking habits, K6 score, ability to recognize and change dysfunctional thinking habits, ability to cope with stress, or problem-solving skills. Although a proportion of participants had pre-existing or ongoing mental health conditions that required psychiatric treatment, this was not significant relative to the populations of the training and control groups. Differences in primary and secondary outcome scores, age, and sex ratio at baseline also did not significantly differ between those who responded to the follow-up questionnaires, both immediately after the study and after 6 months, and those who did not.

    Table 1. Baseline characteristics of participants in training and control groups.a,b
    CharacteristicTotal
    (n=168)    		Training group
    (n=83)    		Control group
    (n=85)    		P value
    Men, n (%)
    		131 (78.0)67 (80.7)64 (75.3).26
    Age, years, mean (SD)
    		38.4 (8.3)38.4 (8.1)38.4 (8.4).35
    Overtime hours, n (%)

    		Few54 (32.1)28 (33.7)26 (30.6).34

    		<40 hours97 (57.7)46 (55.4)51 (60.0)

    		40-79 hours17 (10.1)9 (10.8)8 (9.4)

    		≥ 80 hours0 (0)0 (0)0 (0)
    Mean hours of sleep (weekday), n (%)

    		<5 hours17 (10.1)9 (10.8)8 (9.4).84

    		5-6 hours124 (73.8)59 (71.1)65 (76.5)

    		7-8 hours26 (15.5)15 (18.1)11 (13.1)

    		≥9 hours1 (0.60)0 (0)1 (1.20)
    Marital status, n (%)

    		Married77 (45.8)41 (49.4)36 (42.4).41

    		Single91 (54.2)42 (50.6)49 (57.6)
    Drinking, n (%)

    		None64 (38.1)33 (39.8)31 (36.5).29

    		1-3 days/week61 (36.3)26 (19.3)35 (41.2)

    		4-6 days/week19 (11.3)10 (12.0)9 (10.6)

    		Every day24 (14.3)14 (16.9)10 (11.8)
    Exercise habit, n (%)

    		None88 (52.4)41 (49.4)47 (55.3).6

    		1-2 times/week65 (38.7)35 (42.2)30 (35.3)

    		≥3 times/week15 (8.90)7 (8.40)8 (9.40)
    History of psychiatric treatment, n (%)

    		No history143 (85.1)69 (83.1)74 (87.1).28

    		History of treatment16 (9.50)8 (9.60)8 (9.40)

    		Undergoing treatment at present9 (5.40)6 (7.20)3 (3.50)
    K6 score, mean (SD)
    		4.8 (4.50)4.7 (4.50)4.8 (4.50).90
    Recognition of dysfunctional thinking habits, mean (SD)
    		2.36 (0.95)2.53 (1.02)2.20 (0.87).57
    Changing dysfunctional thinking patterns, mean (SD)
    		3.17 (0.89)3.10 (0.91)3.24 (0.86).33
    Coping skills, mean (SD)
    		3.08 (0.93)3.10 (0.90)3.06 (0.96).49
    Problem-solving skills, mean (SD)
    		2.87 (0.94)2.82 (0.97)2.92 (0.91).54

    aIndependent t test for difference between groups for continuous measures and chi-square test for differences between groups for categorical characteristics.

    bScores on a scale 1-5, with 1 indicating not at all and 5 indicating very well.

    Effects of Training Program

    Table 2 shows the results of ITT analysis. From before to immediately after training, the mean K6 score of the training group decreased by 0.46 while that of the control group increased by 0.22. However, this difference was not significant (mean difference 0.68, 95% CI −0.44 to 1.80). The intergroup difference in change in mean K6 score for the training and control groups from baseline to 6 months after program completion was also not significant (−0.14 at baseline, 0.83 after 6 months; mean difference 0.97, 95% CI −0.64 to 2.59). No significant effect due to the training program was observed, even when K6 scores were adjusted for baseline scores. Further, while ability of participants to recognize their own dysfunctional thinking was significantly increased both immediately after training (mean difference 0.33, 95% CI 0.06-0.59; d=0.37) and at 6 months (mean difference 0.45, 95% CI 0.06-0.83; d=0.33), significance was not observed after adjusting for baseline scores of recognition of dysfunctional thinking habits. The ability of participants to transform thought patterns from dysfunctional to functional was also not improved immediately after training in the training group. However, after adjustment for baseline scores, a small significant difference was observed immediately after training, but not after 6 months. While the ability of participants to cope with stress was not significantly improved immediately after training, significant improvement was noted after 6 months in the training group (mean difference 0.54, 95% CI 0.10-0.98; d=0.37), a finding that remained even after adjustment for baseline scores. The problem-solving ability of participants was not improved either immediately after training or after 6 months.

    At baseline, 36 participants in the training group (43%, 36/83) and 37 in the control group (44%, 37/85) exhibited clinically significant psychological distress (K6 score ≥5). Results of subgroup analysis are shown in Table 3. Mean K6 score was significantly improved in the training group compared with the control group immediately after training (−2.50 vs −0.07; mean difference 2.43, 95% CI 0.55-4.31; d=0.61), and this effect remained even after 6 months (−3.49 vs −0.50; mean difference 2.99, 95% CI 0.70-5.29; d=0.60) and on adjustment for baseline scores. In addition, the 36 participants of the training group with K6 cutoff score ≥5 points were subdivided into a complete group (n=28) who completed at least 1 homework session and an incomplete group (n=8) who completed no sessions. In contrast to the 37 participants in the control group with a baseline K6 score ≥5, the Web-based CBT complete subgroup had significantly lower mean scores both immediately after training (−2.60 vs −0.07; mean difference 2.53, 95% CI 0.46-4.60; d=0.63) and 6 months later (−4.02 vs −0.50; mean difference 3.52, 95% CI 1.13-5.90; d=0.74). The same result was observed when scores were adjusted for baseline scores. In addition, mean K6 score for those completing no homework (or Web-based CBT incomplete subgroup) was lower, though not significantly, immediately after training (−2.14 vs −0.07; mean difference 2.07, 95% CI −0.65 to 4.80; d=0.53) but increased 6 months later with no difference being observed from the control group (−1.67 vs −0.50; mean difference 1.16, 95% CI −3.44 to 5.77; d=0.23). The same result was observed when scores were adjusted for baseline scores.

    Study Safety

    This study did not exacerbate any existing psychological problems of any participants. While one subject did experience mild distress during group education after being reminded of painful memories, they recovered quickly.

    Table 2. Intention-to-treat analyses of primary and secondary outcomes after training and 6-month follow up.
    VariableImmediately after training6-month follow-up
    Mean (SE) changeUnadjusted
    difference in mean
    (95% CI)    		Adjusted
    difference in mean
    (95% CI)a    		Effect sizebMean (SD) changeUnadjusted
    difference in mean
    (95% CI)    		Adjusted
    difference in mean (95% CI)a)    		Effect sizeb
    K6 scores

    		Training group−0.46 (0.44)0.68 (−0.44 to 1.80)0.70 (−0.34 to 1.73)0.19−0.14 (0.64)0.97 (−0.64 to 2.59)0.99 (−0.45 to 2.44)0.18

    		Control group0.22 (0.34)0.83 (0.55)
    Recognizing dysfunctional thinking habits

    		Training group0.40 (0.10)0.33 (0.06-0.59)c0.19 (−0.02 to 0.40)0.370.68 (0.15)0.45 (0.06-0.83)c0.26 (−0.04 to 0.56)0.33

    		Control group0.08 (0.09)0.24 (0.14)
    Changing dysfunctional thinking patterns

    		Training group0.27 (0.08)0.18 (−0.04 to 0.40)0.23 (0.02-0.44)c0.260.43 (0.20)0.23 (−0.28 to 0.74)0.31 (−0.12 to 0.75)0.13

    		Control group0.08 (0.08)0.21 (0.17)
    Coping skills

    		Training group0.21 (0.10)0.23 (−0.02 to 0.48)0.21 (−0.02 to 0.45)0.270.77 (0.16)0.54 (0.10-0.98)c0.53 (0.15-0.91)d0.37

    		Control group−0.01 (0.08)0.23 (0.16)
    Problem-solving skills

    		Training group0.12 (0.12)0.17 (−0.13 to 0.47)0.17 (−0.12 to 0.45)0.18−0.01 (0.20)0.11 (−0.43 to 0.64)0.06 (−0.41 to 0.54)0.06

    		Control group−0.06 (0.10)−0.12 (0.19)

    aAdjusted for baseline scores.

    bUnadjusted Cohen’s d.

    cP<.05.

    dP<.01.

    Table 3. Subanalyses of K6 score among participants with K6 ≥5 at baseline.
    SubgroupImmediately after training6-month follow-up
    Mean (SE) changeUnadjusted
    difference in mean
    (95% CI)    		Adjusted
    difference in mean
    (95% CI)a    		Effect sizebMean (SD) changeUnadjusted
    difference in mean
    (95% CI)    		Adjusted
    difference in mean
    (95% CI)a    		Effect sizeb
    Training group (all), n=36−2.50 (0.67)2.43 (0.55-4.31)c2.45 (0.70-4.20)d0.61−3.49 (0.89)2.99 (0.70-5.29)c3.02 (0.87-5.17)d0.60
    Training group (completed homeworke), n=28−2.60 (0.78)2.53 (0.46-4.60)c2.60 (0.67-4.53)d0.63−4.02 (0.93)3.52 (1.13-5.90)d3.60 (1.42-5.78)d0.74
    Training group (did not complete homework), n=8−2.14 (1.25)2.07 (−0.65 to 4.80)1.93 (−0.58 to 4.45)0.53−1.67 (2.25)1.16 (−3.44 to 5.77)1.00 (−3.27 to 5.28)0.23
    Control group, n=37−0.07 (0.65)---−0.50 (0.77)---

    aAdjusted for sex, age, and baseline K6 scores.

    bUnadjusted Cohen’s d compared to control group.

    cP<.05.

    dP<.01.

    eDid homework using I-CBT more than once (mean implementation times was 1.5).


    Principal Findings

    The results of this study suggest that a brief stress management program combining group CBT training and Web-based CBT homework does not provide significant alleviation of stress when analyzed across all participants but does provide moderate alleviation of symptoms in employees with clinically significant psychological distress. Our results further suggest that this type of educational program can improve self-confidence in the ability to cope with stress.

    In previous studies of CBT for psychiatric patients, considerable time was required for face-to-face interaction between the CBT expert and patients, and intervention was discontinued in 30% to 50% of cases [24,39,40]. This conventional method is therefore generally considered unfeasible in a workplace setting, as most employees have insufficient time to complete high-intensity CBT and are considered less motivated regarding participation in CBT than psychiatric patients in a clinical setting.

    Recently, low-intensity CBT programs have become increasingly popular, and such programs have been implemented to provide medical and psychological support to as many people experiencing psychological distress as possible [21-23]. The positive effects of low-intensity CBT on the mental health of patients have already been reported for group education [41] as well as for therapy via email, phone [24,25], and Internet [26-28]. Further, the discontinuation rate for low-intensity CBT is lower than that for face-to-face CBT [24,42-44].

    Van der Klink et al reviewed 49 studies to compare the effects of cognitive-behavioral, multimodal, relaxation, and organization-focused intervention programs [9] on work-related stress. Improvement in psychological distress was greatest for cognitive-behavioral intervention programs such as CBT (d=0.68), followed by multimodal programs (d=0.51), relaxation programs (d=0.35), and organization-focused programs (d=0.08). While the intensity of CBT reviewed by Van der Klink et al was lower than conventional CBT, it is probably still unsuitable for many workplaces as a high degree of care, time, and involvement by experts is required. Of note, in Van der Klink et al’s review, the mean number of CBT sessions was 7.6 [9]. Mohr et al reported that face-to-face CBT sessions and CBT sessions via telephone were conducted a total of 16 times, with a mean session time of approximately 45 minutes in their study [24]. The protocol for Web-based CBT by Titov et al required six sessions across 8 weeks, and experts held these sessions on a one-on-one basis [45]. Similarly, in a study of T-CBT by Furukawa et al, 30- to 45-minute sessions were held a total of eight times, and experts (such as therapists) were available for each participant, although no one-on-one sessions were required [46].

    The training program implemented in the present study was developed by combining a group CBT course with short-term Web-based CBT. To enable implementation in a workplace setting, the program was simplified even more than conventional low-intensity CBT. Concern of benefits being compromised due to oversimplification is therefore justified. Indeed, although a brief Web-based psychoeducational program was found to have slightly improved the degree of occupational satisfaction, it did not clearly improve self-efficacy or problem-solving skills [47]. To counteract any detractions due to the simplicity of our program, we increased efficacy by asking participants to complete individual homework assignments.

    In the present study, analysis across all participants demonstrated alleviation of stress without statistical significance. Two possible reasons for this lack of a substantial finding are that some participants may not have clearly understood the requirements for training, subsequently losing motivation to participate in the CBT program. However, despite the lack of any notable effect of our educational program across all participants, we found that our program did significantly alleviate the stress among those employees who had clinically significant psychological distress before the program. This positive effect was particularly high in the training subgroup that also completed Web-based CBT homework, likely due to the stronger motivation of employees with higher stress to participate and actively complete the homework, thereby alleviating stress. Participants who were provided information concerning CBT during the Web-based CBT are reportedly more likely to complete their homework [48,49]. During the present study, participants were provided CBT-related information four times during the Web program, which might have enhanced their understanding of CBT and thereby increased the positive effects of CBT among those who completed the Web-based CBT homework.

    Analysis across all participants shows that the ability of participants to recognize dysfunctional thinking habits increased significantly both immediately after training and on 6-month follow-up. However, these differences disappeared after adjusting for baseline data. The ability to correct dysfunctional thinking patterns between two groups was only significantly different on 6-month follow-up after adjustment. The poor robustness of these results might be due to the lack of statistical power. We are therefore unable to conclude whether or not the ability to recognize dysfunctional thinking habits and correct dysfunctional thinking patterns improved in the present study. Nevertheless, the ability to cope with stress significantly improved on 6-month follow-up in both unadjusted and adjusted analyses. These results suggest that this program improves confidence in stress management skills. Using CBT to teach this new stress management skill to participants might improve various health outcomes [50-52].

    Regarding problem-solving skills, participants might have been unable to develop these skills due to the relatively short period of time allocated during group education and lack of Web-based CBT homework on the subject. Lecture sessions (with group work) and homework assignments therefore appear necessary to help participants acquire these problem-solving skills.

    Limitations

    Several limitations to the present study may prevent our findings from being fully generalizable. First, participants were employees of an information technology company and might therefore have been more likely to consent to Web-based CBT than the general population. Second, the reliability and validity of the original question items have not been evaluated. Therefore, the results of secondary outcomes cannot be confirmed. Third, this study was non-blinded and the participants in the training and control groups worked in the same office and might have shared information. Fourth, we evaluated one primary outcome and four secondary outcomes, which might have increased the possibility of a Type I error. Finally, the sample size was insufficient because we calculated sample size necessary to obtain an effect size of 0.42. Further, the target population contained a significant number of distressed subjects and participation rate was lower than originally expected, which could have affected the robustness of statistical results.

    Validation of the effects of this brief training program on the alleviation of distress and development of stress management in the workplace will require randomized clinical trials in a variety of workplaces with diverse corporate structures.

    Conclusions

    The results of this study suggest that a brief stress management program combining group CBT and a Web-based CBT can have positive effects on the alleviation of symptoms in employees with clinically significant psychological distress and development of confidence to cope with stress. These brief educational programs based on CBT principles might be an effective preventive measure for addressing current concerns of presenteeism and absenteeism among employees with high levels of stress.

    Conflicts of Interest

    None declared.

    1. Hilton MF, Whiteford HA, Sheridan JS, Cleary CM, Chant DC, Wang PS, et al. The prevalence of psychological distress in employees and associated occupational risk factors. J Occup Environ Med 2008 Jul;50(7):746-757. [CrossRef] [Medline]
    2. Hilton MF, Whiteford HA. Interacting with the public as a risk factor for employee psychological distress. BMC Public Health 2010;10:435 [FREE Full text] [CrossRef] [Medline]
    3. Ministry of Health, Labor and Welfare. Labor Health Survey in 2013. Japan: Ministry of Health, Labor and Welfare; 2013.
    4. Bonde JP. Psychosocial factors at work and risk of depression: a systematic review of the epidemiological evidence. Occup Environ Med 2008 Jul;65(7):438-445. [CrossRef] [Medline]
    5. Stansfeld S, Candy B. Psychosocial work environment and mental health--a meta-analytic review. Scand J Work Environ Health 2006 Dec;32(6):443-462 [FREE Full text] [Medline]
    6. Westerhof GJ, Keyes CLM. Mental illness and mental health: the two continua model across the lifespan. J Adult Dev 2010 Jun;17(2):110-119 [FREE Full text] [CrossRef] [Medline]
    7. Uegaki K, de Bruijne MC, van der Beek AJ, van Mechelen W, van Tulder MW. Economic evaluations of occupational health interventions from a company's perspective: a systematic review of methods to estimate the cost of health-related productivity loss. J Occup Rehabil 2011 Mar;21(1):90-99 [FREE Full text] [CrossRef] [Medline]
    8. Ministry of Health, Labor and Welfare. Guidelines for maintaining and improving mental health of workers (2006). Japan: Ministry of Health, Labor and Welfare; 2006.
    9. van der Klink JJ, Blonk RW, Schene AH, van Dijk FJ. The benefits of interventions for work-related stress. Am J Public Health 2001 Feb;91(2):270-276. [Medline]
    10. von Baeyer C, Krause L. Effectiveness of stress management training for nurses working in a burn treatment unit. Int J Psychiatry Med 1983;13(2):113-126. [Medline]
    11. Cecil MA, Forman SG. Effects of stress inoculation training and coworker support groups on teachers' stress. Journal of School Psychology 1990 Jun;28(2):105-118. [CrossRef]
    12. Fava M, Littman A, Halperin P, Pratt E, Drews FR, Oleshansky M, et al. Psychological and behavioral benefits of a stress/type A behavior reduction program for healthy middle-aged army officers. Psychosomatics 1991;32(3):337-342. [Medline]
    13. Forman SG. Stress-management training: Evaluation of effects on school psychological services. Journal of School Psychology 1981 Sep;19(3):233-241. [CrossRef]
    14. Gray-Toft P. Effectiveness of a counseling support program for hospice nurses. Journal of Counseling Psychology 1980;27(4):346-354. [CrossRef]
    15. Grønningaeter H, Hytten K, Skauli G, Christensen CC, Ursin H. Improved health and coping by physical exercise or cognitive behavioral stress management training in a work environment. Psych. & Hlth 1992 Oct 1;7(2):147-163. [CrossRef]
    16. Higgins NC. Occupational stress and working women: the effectiveness of two stress reduction programs. Journal of Vocational Behavior 1986 Aug;29(1):66-78. [CrossRef]
    17. Keyes JB, Dean SF. Stress inoculation training for direct contact staff working with mentally retarded persons. Behav. Intervent 1988 Oct;3(4):315-323. [CrossRef]
    18. Lee S, Crockett MS. Effect of assertiveness training on levels of stress and assertiveness experienced by nurses in Taiwan, Republic of China. Issues Ment Health Nurs 1994;15(4):419-432. [Medline]
    19. Long BC. Stress management for school personnel: stress-inoculation training and exercise. Psychol. Schs 1988 Jul;25(3):314-324. [CrossRef]
    20. McCue JD, Sachs CL. A stress management workshop improves residents' coping skills. Arch Intern Med 1991 Nov;151(11):2273-2277. [Medline]
    21. Barry M, Jenkins R. Implementing mental health promotion. Oxford, England: Elsevier; 2007.
    22. Department of Health. Improving Access to Psychological Therapies (IAPT) commissioning toolkit   URL: http://www.iapt.nhs.uk/iapt/ [accessed 2014-11-21] [WebCite Cache]
    23. Clark DM. Implementing NICE guidelines for the psychological treatment of depression and anxiety disorders: the IAPT experience. Int Rev Psychiatry 2011 Aug;23(4):318-327 [FREE Full text] [CrossRef] [Medline]
    24. Mohr DC, Ho J, Duffecy J, Reifler D, Sokol L, Burns MN, et al. Effect of telephone-administered vs face-to-face cognitive behavioral therapy on adherence to therapy and depression outcomes among primary care patients: a randomized trial. JAMA 2012 Jun 6;307(21):2278-2285 [FREE Full text] [CrossRef] [Medline]
    25. Simon GE, Ludman EJ, Tutty S, Operskalski B, Von Korff M. Telephone psychotherapy and telephone care management for primary care patients starting antidepressant treatment: a randomized controlled trial. JAMA 2004 Aug 25;292(8):935-942. [CrossRef] [Medline]
    26. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 2010;5(10):e13196 [FREE Full text] [CrossRef] [Medline]
    27. Christensen H, Griffiths KM, Jorm AF. Delivering interventions for depression by using the internet: randomised controlled trial. BMJ 2004 Jan 31;328(7434):265 [FREE Full text] [CrossRef] [Medline]
    28. Schneider J, Sarrami Foroushani P, Grime P, Thornicroft G. Acceptability of online self-help to people with depression: users' views of MoodGYM versus informational websites. J Med Internet Res 2014;16(3):e90 [FREE Full text] [CrossRef] [Medline]
    29. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
    30. Kessler RC, Andrews G, Colpe LJ, Hiripi E, Mroczek DK, Normand SL, et al. Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med 2002 Aug;32(6):959-976. [Medline]
    31. Kessler RC, Barker PR, Colpe LJ, Epstein JF, Gfroerer JC, Hiripi E, et al. Screening for serious mental illness in the general population. Arch Gen Psychiatry 2003 Feb;60(2):184-189. [Medline]
    32. Furukawa TA, Kessler RC, Slade T, Andrews G. The performance of the K6 and K10 screening scales for psychological distress in the Australian National Survey of Mental Health and Well-Being. Psychol Med 2003 Feb;33(2):357-362. [Medline]
    33. Furukawa TA, Kawakami N, Saitoh M, Ono Y, Nakane Y, Nakamura Y, et al. The performance of the Japanese version of the K6 and K10 in the World Mental Health Survey Japan. Int J Methods Psychiatr Res 2008;17(3):152-158. [CrossRef] [Medline]
    34. Kawakami N, Kondo K, Yanagida K, Furukawa TA. The mental health study of suicide prevention in adulthood. In: Research report of Ministry of Health, Labor and Welfare Japan. Japan: Ministry of Health, Labor and Welfare; 2004.
    35. Cuijpers P, Smit F, van Straten A. Psychological treatments of subthreshold depression: a meta-analytic review. Acta Psychiatr Scand 2007 Jun;115(6):434-441. [CrossRef] [Medline]
    36. Rubin D. Multiple imputation for nonreponse in surveys. New York: John Wiley and Sons; 1987.
    37. Donders A, van der Heijden G, Stijnen T, Moons K. Review: a gentle introduction to imputation of missing values. J Clin Epidemiol 2006 Oct;59(10):1087-1091. [CrossRef] [Medline]
    38. Graham JW. Missing data analysis: making it work in the real world. Annu Rev Psychol 2009;60:549-576. [CrossRef] [Medline]
    39. Mohr DC, Vella L, Hart S, Heckman T, Simon G. The effect of telephone-administered psychotherapy on symptoms of depression and attrition: a meta-analysis. Clin Psychol (New York) 2008;15(3):243-253 [FREE Full text] [CrossRef] [Medline]
    40. Wierzbicki M, Pekarik G. A meta-analysis of psychotherapy dropout. Professional Psychology: Research and Practice 1993;24(2):190-195. [CrossRef]
    41. Oei TP, Dingle G. The effectiveness of group cognitive behaviour therapy for unipolar depressive disorders. J Affect Disord 2008 Apr;107(1-3):5-21. [CrossRef] [Medline]
    42. Eysenbach G. The law of attrition. J Med Internet Res 2005;7(1):e11 [FREE Full text] [CrossRef] [Medline]
    43. Melville KM, Casey LM, Kavanagh DJ. Dropout from Internet-based treatment for psychological disorders. Br J Clin Psychol 2010 Nov;49(Pt 4):455-471. [CrossRef] [Medline]
    44. Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res 2009;11(2):e13 [FREE Full text] [CrossRef] [Medline]
    45. Titov N, Andrews G, Davies M, McIntyre K, Robinson E, Solley K. Internet treatment for depression: a randomized controlled trial comparing clinician vs. technician assistance. PLoS One 2010;5(6):e10939 [FREE Full text] [CrossRef] [Medline]
    46. Furukawa TA, Horikoshi M, Kawakami N, Kadota M, Sasaki M, Sekiya Y, GENKI Project. Telephone cognitive-behavioral therapy for subthreshold depression and presenteeism in workplace: a randomized controlled trial. PLoS One 2012;7(4):e35330 [FREE Full text] [CrossRef] [Medline]
    47. Shimazu A, Kawakami N, Irimajiri H, Sakamoto M, Amano S. Effects of web-based psychoeducation on self-efficacy, problem solving behavior, stress responses and job satisfaction among workers: a controlled clinical trial. J Occup Health 2005 Sep;47(5):405-413 [FREE Full text] [Medline]
    48. Christensen H, Griffiths KM, Jorm AF. Delivering interventions for depression by using the internet: randomised controlled trial. BMJ 2004 Jan 31;328(7434):265 [FREE Full text] [CrossRef] [Medline]
    49. Clarke G, Eubanks D, Reid E, Kelleher C, O'Connor E, DeBar LL, et al. Overcoming Depression on the Internet (ODIN) (2): a randomized trial of a self-help depression skills program with reminders. J Med Internet Res 2005;7(2):e16 [FREE Full text] [CrossRef] [Medline]
    50. Geraedts A, Kleiboer A, Wiezer N, van Mechelen W, Cuijpers P. Short-term effects of a web-based guided self-help intervention for employees with depressive symptoms: randomized controlled trial. J Med Internet Res 2014;16(5):e121 [FREE Full text] [CrossRef] [Medline]
    51. Slade M. Mental illness and well-being: the central importance of positive psychology and recovery approaches. BMC Health Serv Res 2010;10:26 [FREE Full text] [CrossRef] [Medline]
    52. Williams N, Birkin R. Communication style: help or hindrance in facilitating return to work? Occup Med (Lond) 2011 Sep;61(6):380-382 [FREE Full text] [CrossRef] [Medline]

    ‎
    CBT: cognitive behavioral therapy
    ITT: intention-to-treat
    K6: Kessler-6 scale
    MI: multiple imputation

    Edited by G Eysenbach; submitted 25.06.14; peer-reviewed by A Nakagawa, A Geraedts; comments to author 11.07.14; revised version received 31.08.14; accepted 06.11.14; published 02.12.14

    Copyright

    ©Makiko Mori, Miyuki Tajima, Risa Kimura, Norio Sasaki, Hironori Somemura, Yukio Ito, June Okanoya, Megumi Yamamoto, Saki Nakamura, Katsutoshi Tanaka. Originally published in JMIR Research Protocols (http://www.researchprotocols.org), 02.12.2014.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://www.researchprotocols.org, as well as this copyright and license information must be included.