Protocol
Abstract
Background: Advancements in wearable sensors have caused a resurgence in their use, particularly because their miniaturization offers ambulatory advantages while performing continuous vital sign monitoring. Digital alerts can be generated following early recognition of clinical deterioration through breaches of set parameter thresholds, permitting earlier intervention. However, a systematic real-world evaluation of these alerting systems has yet to be conducted, and their efficacy remains unknown.
Objective: The aim of this study is to implement wearable sensors and digital alerting systems in acute general wards to evaluate the resultant clinical outcomes.
Methods: Participants on acute general wards will be screened and recruited into a trial with a pre-post implementation design. In the preimplementation phase, the SensiumVitals monitoring system, which continuously measures temperature, heart, and respiratory rates, will be used for monitoring alongside usual care. In the postimplementation phase, alerts will be generated from the SensiumVitals system when pre-established thresholds for vital parameters have been crossed, requiring acknowledgement from health care staff; subsequent clinical outcomes will be analyzed.
Results: Enrolment is currently underway, having started in September 2017, and is anticipated to end shortly. Data analysis is expected to be completed in 2021.
Conclusions: This study will offer insight into the implementation of digital health technologies within a health care trust and aims to describe the effectiveness of wearable sensors for ambulatory continuous monitoring and digital alerts on clinical outcomes in acute general ward settings.
Trial Registration: ClinicalTrials.gov NCT04638738; https://clinicaltrials.gov/ct2/show/NCT04638738.
International Registered Report Identifier (IRRID): DERR1-10.2196/26240
doi:10.2196/26240
Keywords
Introduction
Vital signs and their trends are crucial in recognizing clinical deterioration, with changes often occurring several hours prior to an adverse event [
- ]. Consequently, monitoring of these physiological parameters forms a fundamental component of providing effective clinical care. Despite this, patient deterioration can go undetected, resulting in adverse clinical outcomes such as late referrals to intensive care units, increased morbidity, and mortality [ - ].Routinely measured vital signs include heart rate, respiratory rate, temperature, blood pressure, oxygen saturation (and supplemental oxygen), and level of consciousness. Individuals admitted to nonintensive (general) hospital wards undergo intermittent monitoring of these vital signs. A “track and trigger” early warning score (EWS) is recommended in the United Kingdom; the National Early Warning Score 2 (NEWS2) provides guidance on escalation protocols and the monitoring frequency of vital signs. Each vital parameter is individually scored according to severity and combined for a total NEWS score. Most frequently, observations are performed every 4-6 hours unless the patient is acutely unwell [
].EWSs are predicated around the idea that hospital inpatients at high risk of deterioration are identified early through prodromal vital parameter alterations (eg, elevated respiratory rate), enabling early intervention [
]. Since their implementation, EWSs have shown good predictive value for deterioration and have improved clinical outcomes [ ]. However, their intermittent nature is a critical limitation that enables acute deterioration between measurements to be easily missed [ ].Wearable sensors and digital alerting mechanisms offer a potential solution to this issue. Continuous monitoring through novel wearable sensors provides near real-time monitoring of vital signs without hindering ambulation. It is theorized that continuous monitoring will enable earlier detection of deterioration through a culmination of additional data points and reduced reliance on availability of medical personnel for performing observations [
]. Alerts are subsequently generated, informing health care professionals when pre-established thresholds for vital parameters, often tailorable, are breached. However, the evidence supporting the use of wearable sensors outside of intensive care settings remains mixed and limited [ , ]. The heterogeneity of study designs and complexity of interventions used, however, limit meaningful conclusions.Here, we describe the design of our trial, in which we implement wearable sensors and digital alerting systems in acute general wards in a National Health Service hospital; we also describe the implementation strategy and the evaluation of the resultant clinical outcomes (eg, length of stay, mortality, need for intensive care).
Methods
Study Design
This is a single-center, pre-post design in which digital alerting systems are implemented on acute wards. The preimplementation phase dated from September 2017 to August 2019, and the postimplementation phase is currently underway.
The preimplementation phase involved using the SensiumVitals system in accordance with usual care. However, health care staff were not able to view the continuous vital sign monitoring data or the digital alerts generated for abnormal parameters. Usual care, in our institution, involves intermittent monitoring of vital signs in accordance with NEWS2.
In the postimplementation phase, alerting systems following recognition of abnormal parameters will be included. These alerts will be transmitted to mobile devices and central monitoring hubs, with alert acknowledgement required from health care staff.
All participants provided informed consent. Ethical approval for this study has been granted by a Research Ethics Committee (Integrated Research Application System: 222979). The trial will be performed in accordance with Good Clinical Practice guidelines and the Declaration of Helsinki. Patient data will be anonymized to ensure privacy. Storage and handling of personal data will comply with the General Data Protection Regulation.
Intervention Protocol for Alerts
All alerts will be viewed by dedicated trained nursing staff covering the wards. Alerts will be generated when measured vital signs exceed pre-established thresholds for 10 consecutive minutes. These thresholds can be individually tailored but are initially programmed to trigger if the patient’s temperature exceeds 38.1 ºC, respiratory rate is over 25 breaths per minute, and heart rate is over 131 beats per minute, in accordance with NEWS2 cutoffs [
]. All incoming alerts are deemed to be of potential clinical relevance, and potential outcomes include but are not limited to reviewing the individual, repeating observations, increased frequency of monitoring, and escalation to a responsible physician.Stakeholder Engagement
Several stakeholders will continue to be engaged during the establishment of the project; permission from the Estates and Information Technology departments has been obtained. This permission ensured that bridges were installed by the hospital Estates department, enabling adherence with local policies. Monitoring software has been integrated with the hospital admissions data system, enabling consenting participants to be easily added to the system. Data will be stored and retained on hospital networks, alleviating data security concerns. Senior clinicians have been informed of the project through engagement meetings to drive recruitment and elucidate the aims of the study. Nursing staff have been trained directly to use the system; ad hoc refreshers will be available throughout the duration of the study.
Eligibility Criteria
Adults (aged over 18 years) admitted to general wards who are able to understand the participant information sheet are eligible for inclusion. Individuals with cardiac implantable electronic devices, who experience a skin reaction to the wearable sensor or its components, who have an open chest wound, or who withdraw consent will be excluded.
Recruitment will be aided by the responsible clinical team, who will deem individuals suitable to participate.
Data Collection
After enrolment, data will be routinely collected by two research nurses and a clinical fellow. Outcomes will be obtained from case note review, SensiumVitals data, and electronic health records, enabling prospective data collection.
Outcome Measures
Outcome measures will include hospital length of stay; critical NEWS (defined as 7 or over); number of admissions to intensive care; mortality; sepsis events; and time to antibiotics.
To understand the acceptability and usability of the SensiumVitals system by participants and health care staff, mixed methods analysis (semistructured interviews and questionnaires) will be undertaken in the postimplementation phase. For participants, these interviews and questionnaires will be administered 24 hours after the SensiumVitals sensor has been applied, enabling familiarity with the sensor and maximizing of data capture before potential hospital discharge. Due to the nature of the shift patterns, a set time point has not been chosen for health care staff; however, the studies will only be conducted once familiarity with the system has been established. All key stakeholders will also be invited to take part in semistructured interviews to determine barriers and facilitators to implementing wearable sensors and alerting mechanisms within the hospital.
The questionnaires consist of 5-point Likert scale responses (strongly disagree to strongly agree), with elements adapted from the validated System Usability Scale [
].Face-to-face interviews will be conducted by the lead researcher (FI) using a predetermined topic guide. Data collection will be an iterative process; emerging recurring concepts were incorporated into the interview guide for further exploration with remaining participants. Interviews will be recorded, anonymized, transcribed, and entered into NVivo 12 (QSR International) for analysis.
Statistical Analysis
The Shapiro-Wilk test will be used to check variables for Gaussian distribution. Data sets will be presented as absolute numbers of patients with the respective percentage per group or as parameter mean and standard deviation or median and range, depending on distribution. Descriptive statistics will describe the baseline characteristics of the participants, alerting frequencies, and events.
For comparisons of interval-scaled variables between the two groups, 2-tailed, unpaired t tests will be performed. Nonparametric between-group testing will be undertaken with 2-tailed Mann-Whitney U tests. Additionally, the chi-square test or Fisher exact test will be applied to nominal scale data.
Propensity score matching will be performed for differences among baseline demographics between pre-post phases, reducing bias from confounding variables. Analyses will be performed in SPSS (IBM Corporation), Stata (StataCorp LLC), and GraphPad (GraphPad Software Inc).
Mixed methods analysis will be undertaken for the questionnaire and semistructured interview data. Frequency distributions will be generated for Likert scale responses. Interview transcripts will be analyzed using thematic analysis [
]. The results will be discussed until consensus is reached.Power Calculations
Formal power calculations are not possible on any of the outcomes, given the lack of surrounding data. However, Downey et al [
] estimated sample sizes of 325-625 for time to antibiotics after the first evidence of sepsis using the SensiumVitals sensor. A total of 226 participants were randomized; 140 had the sensor applied, and the remaining participants underwent usual care. All outcome measurements in this study demonstrated nonsignificant results. Therefore, we aim to recruit a minimum of 600 individuals, with approximately half in the preimplementation phase and the remaining participants in the postimplementation phase.Data Monitoring
Overall, there is a low level of concern for patient safety with the SensiumVitals sensor, given previous use [
]. Furthermore, participants are at very low risk for adverse events; should any occur, they will be logged systematically and reported to ClinicalTrials.gov. Adverse events not related to the sensor will be reported to the responsible clinical team.Results
Enrolment is currently underway, having started in September 2017; it is anticipated to end shortly. Data analysis is expected to be completed in 2021.
Discussion
This trial has the potential to detect earlier early clinical deterioration using the SensiumVitals sensor, which may improve clinical outcomes. This disposable, lightweight, waterproof, wearable wireless patch is attached to a participant’s chest with two adhesive electrocardiogram electrodes and records the participant’s temperature, heart rate, and respiratory rate every 2 minutes, transmitting data to a central monitoring hub through radiofrequency and dedicated intranet hotspots (bridges) installed on wards, viewable through a secured web browser or mobile device. This continuous monitoring enables alerting systems to inform health care staff of individuals whose condition is deteriorating, allowing for earlier intervention.
Acceptability and practicability of continuous monitoring using wearable sensors on general surgical and medical wards has been demonstrated in the United Kingdom and the Netherlands [
, ]. However, these studies focused primarily on feasibility rather than on implementation strategy and clinical outcome measures, such as hospital length of stay, mortality, and intensive care transfers, which remain untested. Furthermore, our use of semistructured interviews to capture stakeholder perceptions will yield pertinent considerations for pragmatic implementation of novel digital technologies.As a trial designed to test real-world applicability, its design presents inherent limitations. The observational nature of this trial cannot establish cause-effect relationships. However, a prospective evaluation lends itself to describing practical issues that need to be overcome for successful implementation with evolving workflows in health care trusts. Moreover, pre-post designs can be influenced by longitudinal changes in health care delivery, which are a potential source of bias.
In conclusion, the results of our study could offer data to demonstrate the effectiveness of using continuous vital sign monitoring through wearable sensors and digital alerts to improve clinical outcomes in acute general ward settings. We may offer a methodology for successful implementation that can be adopted more widely in various health care trusts.
Acknowledgments
Infrastructure support for this research was provided by the National Institute for Health Research (NIHR) Imperial Biomedical Research Centre and the NIHR Imperial Patient Safety Translational Research Centre. This study was not funded.
Authors' Contributions
FMI drafted the manuscript. Significant amendments were made by MJ, SK, HA, and AD. All authors approved the final manuscript.
Conflicts of Interest
None declared.
References
- Kenzaka T, Okayama M, Kuroki S, Fukui M, Yahata S, Hayashi H, et al. Importance of vital signs to the early diagnosis and severity of sepsis: association between vital signs and sequential organ failure assessment score in patients with sepsis. Intern Med 2012;51(8):871-876 [FREE Full text] [CrossRef] [Medline]
- Smith GB. In-hospital cardiac arrest: is it time for an in-hospital 'chain of prevention'? Resuscitation 2010 Sep;81(9):1209-1211. [CrossRef] [Medline]
- DeVita MA, Smith GB, Adam SK, Adams-Pizarro I, Buist M, Bellomo R, et al. "Identifying the hospitalised patient in crisis"—a consensus conference on the afferent limb of rapid response systems. Resuscitation 2010 Apr;81(4):375-382. [CrossRef] [Medline]
- Cuthbertson BH, Boroujerdi M, McKie L, Aucott L, Prescott G. Can physiological variables and early warning scoring systems allow early recognition of the deteriorating surgical patient? Crit Care Med 2007 Feb;35(2):402-409. [CrossRef] [Medline]
- Hollis RH, Graham LA, Lazenby JP, Brown DM, Taylor BB, Heslin MJ, et al. A role for the early warning score in early identification of critical postoperative complications. Ann Surg 2016 May;263(5):918-923. [CrossRef] [Medline]
- Goldhill DR, White SA, Sumner A. Physiological values and procedures in the 24 h before ICU admission from the ward. Anaesthesia 1999 Jun;54(6):529-534 [FREE Full text] [CrossRef] [Medline]
- Buist M, Bernard S, Nguyen TV, Moore G, Anderson J. Association between clinically abnormal observations and subsequent in-hospital mortality: a prospective study. Resuscitation 2004 Aug;62(2):137-141. [CrossRef] [Medline]
- Centre for Clinical Practice at NICE (UK). Acutely ill patients in hospital: recognition of and response to acute illness in adults in hospital. National Institute for Health and Clinical Excellence. 2007 Jul. URL: https://www.ncbi.nlm.nih.gov/books/NBK45947/ [accessed 2021-04-23]
- McQuillan P, Pilkington S, Allan A, Taylor B, Short A, Morgan G, et al. Confidential inquiry into quality of care before admission to intensive care. BMJ 1998 Jun 20;316(7148):1853-1858 [FREE Full text] [Medline]
- Culliane M, Findlay G, Hargraves C, Lucas S. NCEPOD 2005 report: an acute problem? NCEPOD-National Confidental Enquiry into Patient Outcome Death. 2005. URL: https://www.ncepod.org.uk/2005report/index.html [accessed 2021-04-23]
- Thomson R, Luettel D, Healey F, Scobie S. Safer Care for the Acutely Ill Patient: Learning from Serious Incidents. In: NHS National Patient Safety Agency. London, UK: National Patient Safety Agency; Aug 06, 2007.
- Luettel D, Beaumont K, Healey F. Recognising and responding appropriately to early signs of deterioration in hospitalised patients. National Patient Safety Agency. 2007 Nov. URL: https://www.patientsafetyoxford.org/wp-content/uploads/2018/03/NPSA-DeteriorPatients.pdf [accessed 2021-04-23]
- Findlay G, Shotton H, Mason K. Time to intervene? A review of patients who underwent cardiopulmonary resuscitation as a result of an in-hospital cardiorespiratory arrest. National Confidential Enquiry into Patient Outcome and Death. 2012. URL: https://www.ncepod.org.uk/2012report1/downloads/CAP_fullreport.pdf [accessed 2021-04-23]
- National Early Warning Score (NEWS). Royal College of Physicians. 2017. URL: https://www.rcplondon.ac.uk/projects/outputs/national-early-warning-score-news-2 [accessed 2020-12-01]
- Ridley S. The recognition and early management of critical illness. Ann R Coll Surg Engl 2005 Sep;87(5):315-322 [FREE Full text] [CrossRef] [Medline]
- Downey CL, Tahir W, Randell R, Brown JM, Jayne DG. Strengths and limitations of early warning scores: a systematic review and narrative synthesis. Int J Nurs Stud 2017 Nov;76:106-119. [CrossRef] [Medline]
- Tarassenko L, Hann A, Young D. Integrated monitoring and analysis for early warning of patient deterioration. Br J Anaesth 2006 Jul;97(1):64-68 [FREE Full text] [CrossRef] [Medline]
- Downey C, Chapman S, Randell R, Brown J, Jayne D. The impact of continuous versus intermittent vital signs monitoring in hospitals: a systematic review and narrative synthesis. Int J Nurs Stud Internet 2018;84:A [FREE Full text] [CrossRef]
- Joshi M, Ashrafian H, Arora S, Khan S, Cooke G, Darzi A. Digital alerting and outcomes in patients with sepsis: systematic review and meta-analysis. J Med Internet Res 2019 Dec 20;21(12):e15166 [FREE Full text] [CrossRef] [Medline]
- Brooke J. SUS: a 'quick and dirty' usability scale. In: Usability Evaluation In Industry. Boca Raton, FL: CRC Press; 1996.
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006 Jan;3(2):77-101. [CrossRef]
- Downey C, Randell R, Brown J, Jayne DG. Continuous versus intermittent vital signs monitoring using a wearable, wireless patch in patients admitted to surgical wards: pilot cluster randomized controlled trial. J Med Internet Res 2018 Dec 11;20(12):e10802 [FREE Full text] [CrossRef] [Medline]
- Weenk M, Bredie SJ, Koeneman M, Hesselink G, van Goor H, van de Belt TH. Continuous monitoring of vital signs in the general ward using wearable devices: randomized controlled trial. J Med Internet Res 2020 Jun 10;22(6):e15471 [FREE Full text] [CrossRef] [Medline]
Abbreviations
EWS: early warning score |
NEWS2: National Early Warning Score 2 |
Edited by G Eysenbach; submitted 03.12.20; peer-reviewed by K Lam, A Acharya, M van Rossum; comments to author 20.01.21; revised version received 30.01.21; accepted 13.04.21; published 04.05.21
Copyright©Fahad Mujtaba Iqbal, Meera Joshi, Sadia Khan, Hutan Ashrafian, Ara Darzi. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 04.05.2021.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.