Protocol
Abstract
Background: Hypothermia in young infants presenting to the emergency department (ED) may indicate a serious bacterial infection (SBI) such as a urinary tract infection, bacteremia, or bacterial meningitis. Improved understanding of the epidemiology of SBI in infants with hypothermia and the development of prediction models can help avoid unnecessary invasive procedures and antimicrobial exposure.
Objective: The aim of the study is to (1) describe the epidemiology of SBI and herpes simplex virus (HSV) among infants with hypothermia, (2) assess the role of biomarkers in predicting SBI, and (3) derive and internally validate a multivariable predictive model for SBI among infants with hypothermia.
Methods: The study is being conducted through the Pediatric Emergency Medicine Collaborative Research Committee as a retrospective nested case-control study. We will include infants with hypothermia (rectal temperature<36.5 °C) presenting to 1 of 28 pediatric EDs in the United States between January 1, 2013, and December 31, 2022. Exclusion criteria will include (1) fever in the ED or prior to ED arrival, (2) transfer from another health care facility, (3) technology dependence, (4) trauma, (5) skin and soft tissue infections, and (6) presentation in cardiac arrest. The primary outcomes will be culture-confirmed SBI (objectives 1-3) and HSV-positivity (objective 1). The analytic approach for each objective will be (1) to use descriptive statistics to summarize the epidemiology of SBI and HSV and clinical outcomes, (2) to compare biomarker parameters of infants with and without SBI and determine optimal cutoff values using a receiver operator characteristic curve, and (3) to develop a multivariable predictive model using penalized mixed effects logistic regression within a 1:3 case-control sample among infants in the cohort who had a blood culture obtained.
Results: Data collection for this study is ongoing, with a collection of data from 21 hospitals at the time of protocol submission. Of 16 sites evaluated in preliminary analysis (n=45,673), the median age is 25 (IQR 6-52) days, and 24,182 (52.9%) are male. In total, 340 (0.7%) infants have an SBI, of whom 103 had bacteremia or meningitis. Mortality occurred in 7 (2.1%; 95% CI 0.9%-4.3%).
Conclusions: We will use a consensus-based outcome measure for SBI with an established data acquisition pathway. We will use a multicenter sample from US children’s hospitals, using a consensus-based outcome measure for SBI and a case-control approach to evaluate outcomes to improve the management of young infants with hypothermia in the ED.
International Registered Report Identifier (IRRID): DERR1-10.2196/66722
doi:10.2196/66722
Keywords
Introduction
Globally, neonatal sepsis is estimated to occur in nearly 3000 cases per 100,000 live births, with an estimated mortality rate of 18% [
]. While abnormalities of temperature (including fever or hypothermia) are understood to be a risk factor for sepsis [ , ], the specific association of hypothermia with high-risk infections is poorly characterized. Hypothermia among young infants presenting to the emergency department (ED) may be a sign of a serious bacterial infection (SBI), which includes urinary tract infection (UTI), bacteremia, or bacterial meningitis [ , ]. Prior study suggests that hypothermia may also occur in disseminated herpes simplex virus (HSV) infection [ - ]. However, infants more frequently present with hypothermia due to noninfectious pathologies or secondary to environmental factors [ , ]. The etiology of hypothermia in the setting of sepsis is likely multifactorial, with some preclinical studies suggesting an advantageous role for hypothermia as compared to fever in rats with severe endotoxemia [ ]. It remains unclear what percentage of infants with hypothermia are ill-appearing or have other relevant findings on examination. Prior work has provided limited data with respect to SBI among young infants with hypothermia. These studies, performed from single centers or from administrative datasets, have identified that SBIs occur in 1%-8% of young infants with hypothermia [ , , , - ].In contrast to young infants with fever [
, ], infants presenting to the ED with hypothermia lack prospectively derived evidence to guide care. In the absence of robust evidence-based consensus and guidelines to assist clinicians, substantial variability exists in the care provided for these infants, as demonstrated in one large survey of 1231 ED clinicians [ ]. This is further challenged by the lack of a consistent definition for hypothermia, which varies from 36.0 °C to <36.5 °C [ , , ]. Many infants with hypothermia are managed similarly to young infants with fever [ ], but this approach has not been fully studied. There is wide variability in the performance of cerebrospinal fluid (CSF) testing (14%-70%), obtaining blood for inflammatory markers (8%-88%) and empirical antibiotic use (56%-92%) [ ]. These data also suggested an increasing reliance on the use of inflammatory markers to guide decision-making, including C-reactive protein (CRP) and procalcitonin [ ]. Nevertheless, prior work has demonstrated associations of clinical factors with the presence of bacterial infections among infants with hypothermia, including age [ , ], temperature [ , ], persistence of hypothermia [ ], laboratory measures [ - ], and examination factors [ , ]. A well-performing prediction model to predict SBI is currently lacking.Improved data are required to evaluate the prevalence of SBI among young infants with hypothermia and to construct a predictive model for this outcome. This will help identify infants at very low risk for SBI in whom invasive procedures and unnecessary antimicrobial exposure can be avoided. This study therefore has the following three objectives: (1) to describe the epidemiology and prevalence of SBI and HSV among young infants (≤90 days) presenting to the ED with hypothermia, (2) to evaluate the role of biomarkers in the prediction of SBI among young infants, and to derive and internally validate a prediction rule for SBI among young infants presenting to the ED with hypothermia.
Methods
Overview
We will perform a multicenter study of infants with hypothermia in the ED using the Pediatric Emergency Medicine Collaborative Research Committee (PEM CRC) to characterize infants with SBI and HSV and to compare infants with hypothermia with and without SBI. The PEM CRC offers a framework for multicenter investigations, supporting and facilitating the development of valuable and rigorous collaborative research in pediatric emergency medicine. PEM CRC plays a crucial role in developing high-quality protocols and identifying interested coinvestigators across its member sites. The PEM CRC has established a centralized data center at Texas Children’s Hospital, Baylor College of Medicine (BCM). This center offers data collection support services, including front-end logic checks for electronic data sheets, high-speed automated data sheet scanning, and database creation, encryption, and processing, and has conducted several important studies focused on topics relevant to the care of uncommon, but clinically important, conditions that occur in children presenting to the acute care setting [
- ]. We will include infants ≤90 days with a blood culture performed and who presented to a contributing hospital with a rectal temperature of <36.5 °C in the ED over a 10-year period. We will use a case-control approach. BCM will serve as the data coordinating center. A graphical summary of the study protocol is provided in .
Approaches
Objective 1 Approach
We will construct a large, retrospective, multicenter dataset assembled from at least 25 participating hospitals to identify the frequency of presentation of hypothermia across participating hospitals, the incidence of SBI and HSV, types of SBI, the underlying bacteriology of SBI, and clinical outcomes of infants with SBI, including in-hospital mortality. We will describe secondary outcomes of infants to describe diagnoses and evaluate clinical outcomes of hospitalization, length of stay, use of the intensive care unit, diagnoses, and unscheduled return visits to the ED following ED discharge.
Objective 2 Approach
We will analyze infants with hypothermia who do and who do not have SBI to identify the predictive value of frequently performed tests and calculate ideal cutoffs for these tests to maximize their diagnostic value. As an exploratory component of this aim, we will additionally investigate the role of newer tests of inflammation for SBI in this population, including CRP and procalcitonin.
Objective 3 Approach
We will construct a prediction model using a multicenter dataset. We will use penalized multivariable logistic regression to develop a full model and bootstrapped backward selection models to develop a parsimonious reduced model. A prediction rule for infants with hypothermia will allow for the identification of infants at low risk of SBI. The identification of historical, clinical, and laboratory risk factors would facilitate real-time risk stratification and identification of a low-risk group. The performance and reporting of this prediction model will adhere to the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis guideline [
].Inclusion Criteria
Infants ≤90 days of age presenting to the ED of a participating pediatric ED with hypothermia, defined as a minimum rectal temperature of <36.5 °C in the ED over a 10-year period (January 1, 2013, to December 31, 2022). The <36.5 °C criterion is determined based on preliminary work performed by the investigators [
] and uses the World Health Organization criteria to define hypothermia in neonates [ ]. We will allow participating sites that are unable to provide data from 2011 to contribute data due to varying adoption of EHR systems across these hospital systems [ ].Exclusion Criteria
The exclusion criteria are as follows:
- Fever in the ED or prior to ED arrival. Fever is recognized as a risk factor for SBI among young infants presenting to the ED [ ]. Infants with fever should be managed according to national guidelines recommending routine testing for infants with fever on ED arrival. We will use a threshold for fever (rectal temperature ≥38.0 °C) used by the American Academy of Pediatrics in a clinical practice guideline published for the evaluation of this condition [ ].
- Transfer from another health care facility. It is difficult to accurately assess or obtain assessment or laboratory data present at the time of initial outside health care facility evaluation; as such, we exclude infants who were transferred to a study site from a different ED or hospital.
- Technology dependence. We will identify infants with technology dependence (eg, ventriculoperitoneal shunts) using the ICD-10 (International Statistical Classification of Diseases, Tenth Revision) procedure and diagnosis codes documented for the patient during any prior encounter within the hospital electronic health record (EHR) system. These will be identified using the technology dependence flag of the pediatric chronic complex condition algorithm [ ].
- Trauma. Hypothermia can occur in the setting of traumatic injury, including child abuse [ ]. Children with an encounter-level diagnosis consistent with trauma will be excluded usingICD-10codes from a validated injury diagnosis framework [ ].
- Skin and soft tissue infections. Children with skin and soft tissue infections frequently demonstrate a clinically apparent source of infection at the time of presentation. While these are known to occur among young infants with fever [ ], the incidence of skin and soft tissue infections among infants with hypothermia is unknown. These infections will be identified using the encounter-level ICD-10 codes L030, L031, L032, L033, L038, and L039 [ ].
- Presentation in cardiac arrest. Children may be hypothermic because they are present in a perimortem state. We will specifically exclude children who present to the ED in cardiac arrest or postmortem state. These will be identified by finding all infants who received cardiopulmonary resuscitation during their hospitalization, had a diagnosis code consistent with cardiac arrest, or had in-ED or in-hospital mortality. This process is intended to be sensitive to identify all potential encounters with cardiac arrest. We will ask each site principal investigator (PI) to manually review these cases to identify those presented in cardiac arrest or for whom resuscitative efforts were not attempted.
As our inclusion period includes the period of time prior to the adoption of ICD-10 in the United States, we will crosswalk the ICD-9 (International Classification of Diseases, Ninth Revision) diagnosis codes using generalized equivalence mappings, a resource developed by the US Centers for Medicare & Medicaid Services that provides forward and backward mappings between the diagnosis coding systems [
].Case Ascertainment and Initial Data Upload
The EHR will be queried each participating ED to identify eligible age (≤90 days) encounters from 2013 to 2022 with at least 1 documented episode of hypothermia during the ED encounter. Due to the large volume of records anticipated to be identified at each site (varying between 1500 and 3000 encounters on initial efforts from 7 hospitals), data collection will proceed through 2 phases to maximize the efficiency of manual chart review and avoid the collection of unnecessary data. First, we will use a standardized data collection of all variables that can be ascertained from the EHR through computerized queries. This will include (1) demographic details such as age, race, ethnicity, and sex, and administrative data (payor status, year, and season of visitation); (2) medical history, ED chief complaints, multiple temperature measurements throughout the visit, and heart rate and blood pressure data; (3) laboratory test results, including complete blood counts (CBCs), metabolic panels, and tests for viral and bacterial pathogens (including the results of urine, blood, and CSF culture, results from urinalysis and urine dipstick testing, and results from HSV testing); (4) results from chest radiography, if performed; (5) medication administrations (antipyretics, antibiotics, and antiviral medications); (6) ED outcomes and details of hospitalization such as neonatal or pediatric intensive care unit admissions; (7) follow-up information on any return visits (>7 days); and (8) diagnosis and procedure codes for the index encounter and all prior encounters. Considering race and ethnicity and social constructs, we will collect these data acknowledging the limitations in how these data may be reported in a retrospective study and that the means of reporting may vary by institution and over time (eg, self-reported vs determined by registration staff). These data will be reported descriptively. We will not incorporate race or ethnicity in prediction models. To minimize duplication of efforts and maximize homogeneity with data collection procedures across sites, we will promote the sharing of Structured Query Language queries using Epic and Cerner platforms across participating sites. Data will be uploaded from the EHR via a secure, HIPAA (Health Insurance Portability and Accountability Act)-compliant REDCap (Research Electronic Data Capture; Vanderbilt University) database hosted at BCM using a data upload. Data from each site will undergo quality assurance by the study team to ensure that the uploaded data from each site is free from systemic errors.
Case Matching and Manual Data Extraction
Trained study-site PIs will abstract variables from the EHR and enter them into a secure, HIPAA-compliant REDCap database hosted at BCM. The initial upload of patient data will include data for all encounters meeting minimum inclusion criteria (age ≤90 days presenting to the ED of a participating pediatric ED with at least 1 episode of a temperature <36.5 °C during the ED encounter). Exclusions will then be applied using the methodology described earlier. Outcome data with respect to SBI and HSV will be defined by the author team using a priori defined criteria (described in the Outcome Definitions section). Cases will be identified by querying each hospital’s EHR system or microbiology laboratory in the ED during the study period to identify infants ≤90 days with SBI. Controls will include infants with a minimum rectal temperature of <36.5 °C in the ED who had a blood culture performed and with no SBI identified. We will perform 3:1 nested matching of controls to cases based on site and proximity of the date of the encounter. Among encounters where blood cultures were obtained after antibiotic administration (which may be ascertained during manual chart review), cases or controls deemed ineligible will be replaced, and case-control matching will be reperformed within that subgroup. As prior work suggests that only some infants with hypothermia have a blood culture performed, the inclusion of only those infants with a culture performed will allow for the construction of models for infants for whom a clinician may have a suspicion for SBI.
After matching cases and controls, we will provide the record numbers of these selected cases to each of the site PIs. Site PIs will manually review each encounter to ensure whether it fulfills the inclusion criteria and does not meet any exclusion criteria. If cases or controls are found to meet exclusion criteria based on manual review, new assignments for these will be provided based on the next eligible matched control based on the proximity of the encounter. Site PIs will manually abstract the following variables: (1) birth history and relevant past medical history, including gestational age, birthweight, and maternal history (including history of group B Streptococcus positivity, maternal fever, and use of peripartum antibiotics), admission to the neonatal intensive care unit, presence of significant medical conditions diagnosed previous to the index ED encounter, immunization status, prior treatment for hyperbilirubinemia, and sick contacts in the home; (2) presenting history (history of seizure, apnea, abnormal behavioral or lethargy, cough, congestion, vomiting, diarrhea, alteration in feeding, decreased feeding, concern for environmental exposure, presence of reported hypothermia prior to ED arrival, lowest temperature prior to ED arrival, and mode of temperature assessment); and (3) physical examination data including (a) general ill-appearance (sick, toxic, inconsolable, or meningismus), (b) poor perfusion (shock, decreased pulses, cyanotic, and pale or ashen colored), (c) mental status changes (somnolence, lethargy, and altered), (d) sunken or full fontanelle, and (e) presence of respiratory distress, apnea, cyanosis, congested, seizure, clinical bronchiolitis, jaundice, or rash on examination. Historical and physical examination findings will be categorized as present or received or absent or not received based on documentation in the EHR. Variables categorized as either undocumented or missing based on the criteria in the manual of operations.
Compliance
All data abstractors will undergo web-based training via teleconferences and have access to a detailed manual of operation at each site. Regular updates to monitor study progress and address questions throughout the chart review process during each phase of data collection will be conducted. The REDCap database will be established according to best practices, including data validation and strategies to minimize missing data, ensuring precise data capture. Additionally, we will conduct routine monitoring and compliance reviews of the database to maintain data accuracy during the study.
Outcome Definitions
Our primary outcome of interest is culture-confirmed SBI, defined as positive blood, urine, or CSF cultures [
- ]. Classification for pathogenic versus contaminant bacteria (from false positive cultures) will be determined based on established criteria for the classification of suspected pathogens published by the Pediatric Emergency Care Applied Research Network [ ]. Indeterminate cases will be reviewed by the investigator team (which includes a specialist in pediatric infectious disease; ATC). UTI will be defined as the growth of ≥10,000 colony forming units/mL of a pathogen in urine culture plus an abnormal urinalysis (defined as the presence of leukocyte esterase, nitrites, or >5 white blood cells per high-power field on urine microscopy) [ ]. We will use SBI as our outcome of interest instead of invasive bacterial infection (IBI; defined as bacteremia or bacterial meningitis and which is a preferred definition in the literature pertaining to infants with fever [ ]), given the relative rarity of IBIs in previous publications and our pilot work (~2%). Cases that remain ambiguous will be reviewed by the investigator team (which includes a specialist in pediatric infectious disease; ATC), blinded to the context of relevant study predictors. We will plan an a priori sensitivity analysis limited only to infants with IBI, wherein we assess the performance of the SBI-based predictive model when using this alternative outcome. This 2-tiered approach has been previously applied to research on young infants with fever [ ]. We will evaluate return visits within 7 days. For any return visits, we will review testing performed to identify potential missed cases of SBI. Our secondary outcome of interest will be HSV infection. HSV will be identified by the presence of a positive polymerase chain reaction or culture from any source [ ].Predictors and Subgroups
We have selected candidate predictors based on a review of prior literature [
, , , , , , ] and following discussion among members of the study team. For each predictor, we will seek to ensure that data elements can be reliably and accurately extracted from the EHR. A list of candidate predictors that we will study is provided in .Category | Candidate predictors |
Past history | Gestational age, birthweight, small for gestational age status, previous use of antibiotics, previous neonatal intensive care unit hospitalization, maternal history of fever, peripartum antibiotics, group B Streptococcus colonization |
Demographics | Age, sex, season |
Presenting history | Hypothermia prior to emergency department arrival, seizure, apnea, abnormal behavior, cough, congestion, vomiting, diarrhea feeding changes, environmental exposure |
Vital signs | Minimum and maximum temperature, persistent hypothermia on multiple temperature assessments, systolic blood pressure, respiratory rate, heart rate |
Physical examination | Ill appearance, compromised perfusion, mental status changes, fontanelle changes, respiratory distress, apnea, seizure, congestion, jaundice, rash |
Laboratory assessment | Components of complete blood count, procalcitonin, C-reactive protein, urinalysis, results of respiratory pathogen testing |
Analyses
Objective 1: Epidemiology of SBI and HSV
We will describe the epidemiology of SBI and HSV among infants with hypothermia prior to the selection of controls and stratify infants into groups of UTI, bacteremia without meningitis, and bacterial meningitis (with or without bacteremia). We will calculate the percentage of infants having each outcome among the overall cohort of infants with hypothermia and among the cohort of infants who had a blood culture. We will also characterize important clinical outcomes, including the proportion of infants hospitalized following their ED visit and in-hospital mortality, and describe variation in care among the included study sites.
Objective 2: Role of Biomarkers in the Prediction of SBI
We will calculate descriptive statistics and use the Wilcoxon rank-sum test to compare parameters among infants with and without SBI. We will evaluate the individual role of continuous laboratory predictors (including components of the CBC such as the white blood count, absolute neutrophil count, band count, and platelets) for an outcome of SBI. For these predictors, we will determine optimal cutoff values by identifying the optimal point on the receiver operator characteristic curve (as defined by the Youden index) and derive test characteristics based on the optimal cutoffs. The area under the receiver operator characteristic curve will be the empirical determinant of whether predictors are related to the likelihood of occurrence of SBI.
Objective 3: Derivation and Internal Validation of a Prediction Rule
We will construct a multivariable predictive model using penalized mixed effects logistic regression to identify predictors associated with SBI. We will calculate adjusted odds ratios with 95% CIs to quantify the magnitude of the association between each predictor and the outcome, considering the study site and matched group as random effects. For continuous predictors (such as age or values of blood tests), we will evaluate three approaches: (1) retaining the variable as a continuous linear predictor, (2) classifying them as categorical variables based on optimally selected points on the receiver operator characteristic curve, or (3) exploring nonlinear or nonbinary categorical effects by applying restricted cubic splines.
After the construction of the full predictive model, we will use bootstrap backward selection to develop a more parsimonious model involving fewer predictors most related to the occurrence of SBI [
]. We will assess the performance of our model using calibration metrics [ , ] and use bootstrapping for internal validation. We will report metrics of the diagnostic accuracy (sensitivity, specificity, and positive and negative likelihood ratios) of our study sample at differing decision thresholds. We will develop a risk score to best identify children who are at risk of SBI by assigning point values to included predictors to develop an easily usable point-based scoring system [ ].We will assess the performance of the predictive model by its discrimination and calibration. Discrimination will be measured by calculation of the concordance index [
] and the area under the receiver operator characteristic of the predicted probabilities of SBI generated by the models. Calibration will be evaluated by plotting the observed smoothed proportions of SBI against the predicted proportions over the observed range of predicted probabilities and by calculating the Hosmer-Lemeshow statistic [ ]. We will perform bootstrap resampling to calculate indices of overfitting and overoptimism to evaluate if the model is tailored to the specific study cohort and therefore not generalizable [ ]. Statistical analyses will be conducted using R (version 4.3.2; R Foundation for Statistical Computing).Missing Data
As with all retrospective chart reviews, there is a risk of encountering missing or inaccurately documented data. We will implement clear definitions and provide detailed instructions for data extraction and interpretation, with a particular focus on subjective data points. Additionally, we will analyze the factors associated with such missingness. These measures will help reinforce the assumption that the missing data are missing at random, thus enhancing the robustness of the study findings. We will evaluate complete case versus multiple imputation-based approaches for missing data for data elements that are missing in <20% of cases. Data missing in excess of this proportion will be excluded from multivariable modeling.
Sample Size
We estimate identifying 41,250 infants with hypothermia in the proposed study from 25 sites over 10 years. We expect that at least 825 (2%) will have an SBI, resulting in a 95% CI width for the prevalence estimate of ±0.14%. Of these, approximately 25% (n=205) will have an IBI [
, , ]. Greater than 80% of patients with hypothermia who have a blood culture also have a CBC performed [ ]. From our sample of 41,250 infants anticipated from objective 1, we estimate that 25% (approximately n=10,310) will have a blood culture performed; and of these, 8250 will additionally have a CBC. As an exploratory component of this aim, we will evaluate inflammatory markers (specifically, CRP and procalcitonin). Prior work suggests that the use of these biomarkers is increasing over time, with 30% of patients with procalcitonin and 39.6% with CRP in 2019 [ ]. Projected from our pilot data, we expect to have 650 patients with procalcitonin from our study, of whom 65 will have an SBI.For our third objective, we anticipate having a sufficiently large sample size for the development of robust multivariable models. Under the 3:1 case-control design, the proportion of individuals with SBI in the dataset will be fixed at 0.25. Assuming 825 patients with SBI from objective 1, we estimate that the concordance index for the model will have a maximal CI half-width of 2.3%. At the expected model concordance index of roughly 0.80, the CI half-width will be 1.8%, which represents substantial precision in estimating the model’s quality of fit [
].Ethical Considerations
This study involves the review of medical records for patients. Institutional review board (IRB) approval as exempt from the requirements of informed consent has been obtained from the Ann & Robert H. Lurie Children’s Hospital of Chicago (IRB #2023-5779) and the 26 other participating hospitals (
). Data use agreements have been established between all hospitals and BCM. All data uploaded into the REDCap repository are deidentified. No compensation is provided to participants. Adverse events, including breaches of confidentiality, will be reported to the local IRBs of Ann & Robert H. Lurie Children’s Hospital of Chicago.Hospital name | City |
Ann & Robert H. Lurie Children’s Hospital of Chicago | Chicago, IL |
Boston Children’s Hospital | Boston, MA |
Children’s Healthcare of Atlanta | Atlanta, GA |
Children’s Hospital Colorado | Aurora, CO |
Children’s Hospital Los Angeles | Los Angeles, CA |
Children’s Hospital of Orange County | Orange, CA |
Children’s Hospital of Philadelphia | Philadelphia, PA |
Children’s Medical Center Dallas, UT Southwestern Medical Center | Dallas, TX |
Children’s Mercy Kansas City | Kansas City, MO |
Children’s Minnesota | Minneapolis and St Paul, MN |
Cincinnati Children’s Hospital Medical Center | Cincinnati, OH |
Hasbro Children’s Hospital | Providence, RI |
Johns Hopkins Children’s Center | Baltimore, MD |
Medical College of Wisconsin, Children’s Wisconsin | Milwaukee, WI |
MUSC Shawn Jenkins Children’s Hospital | Charleston, SC |
Nemours Children’s Health | Wilmington, DE |
Norton Children’s Hospital, University of Louisville | Louisville, KY |
Primary Children’s Hospital | Salt Lake City, UT |
Rady Children’s Hospital-San Diego | San Diego, CA |
Texas Children’s Hospital, Baylor College of Medicine | Houston, TX |
UH Rainbow Babies & Children’s Hospital, Cleveland Medical Center | Cleveland, OH |
UMass Memorial Children’s Medical Center, University of Massachusetts Medical School | Worcester, MA |
University of Florida Health Shands Children’s Hospital | Gainesville, FL |
University of Michigan Health C.S. Mott Children’s Hospital | Ann Arbor, MI |
UPMC Children’s Hospital of Pittsburgh | Pittsburgh, PA |
Weill Cornell Medical Center | New York, NY |
Yale New Haven Children’s Hospital, Yale School of Medicine | New Haven, CT |
Results
Initial site recruitment included coinvestigators and clinicians with relevant research experience and strong engagement with the study question. As of May 1, 2025, 27 sites have been included in the study, with data uploaded to a central REDCap repository from 23 sites, with 62,771 records prior to the application of exclusion criteria. Currently, we have reviewed data from 16 sites, encompassing 45,673 infants (median age 25, IQR 6-52 days), with 9361 (20.5%) receiving blood cultures, 9120 (20%) urine cultures, and 4470 (10.4%) CSF cultures. UTIs were identified in 253 (0.6%) infants and bacteremia or meningitis in 103 (0.2%), with most IBIs being isolated bacteremia. Escherichia coli was the most common pathogen, and mortality among infants with SBI was 7 (2.1%), primarily among those with bacteremia or bacterial meningitis. We intend to complete data submission using automated EHR criteria by June 2025, with manual chart review completed by December 2025. We expect to submit the main study findings for publication within 9 months following the final data analysis.
Discussion
Overview
This study aims to identify risk factors for SBIs among young infants with hypothermia and to develop a predictive model to inform clinical decision-making. We hypothesize that a subset of infants with hypothermia, particularly those with specific clinical and laboratory features, are at increased risk for SBI and that a multivariable model can reliably stratify this risk. By leveraging a large multicenter dataset, we anticipate that our findings will support more targeted evaluation and management strategies for this vulnerable population.
Principal Findings
Using a large, multicenter sample of infants presenting to the ED with hypothermia, this study will characterize the epidemiology of SBI and HSV and assess the diagnostic value of biomarkers in the prediction of SBI. This work will culminate in a statistical model to determine the risk of SBI among this patient population using clinical and laboratory factors and facilitate the development of a parsimonious model.
Limitations
First, preliminary research suggests that not all infants with hypothermia receive testing for SBI in EDs and that the proportion who do receive testing varies based on the criteria used to define hypothermia [
, , , ]. However, this is of limited impact, as our model will allow physicians to risk-stratify children for SBI on the subset of patients for whom diagnostic testing may be considered due to a suspicion of SBI. To further investigate this potential bias, we will compare demographics among children who are tested and who are not tested for SBI. A second limitation pertains to missing data; some infants may not have documentation of relevant risk factors or data required to calculate outcomes. We will evaluate both complete case versus selective multiple imputation-based approaches for missing data, acknowledging that missingness may be related to clinical decisions, such as ordering blood tests. Third, we plan to construct a parsimonious model that is generalizable (ie, both reproducible and transportable) to best serve the needs of clinicians who manage infants with hypothermia in the ED. We will assess the internal validity of the model using bootstrap resampling techniques, from which we will derive overoptimism indexes for various measures of model fit, including the concordance index [ ].Although this will be the largest sample of infants with hypothermia in the ED, our findings may not be completely representative of the prevalence of SBI among these patients because most participating institutions are academic institutions and pediatric hospitals; therefore, the findings may not be generalizable to different care settings. However, the PEM CRC represents geographic and socioeconomically diverse areas, and we would not expect that a systematic bias would be introduced.
Comparisons With Prior Work
The majority of prior work has been limited to single-center data and therefore is of limited generalizability [
, , ]. Limitations of prior multicenter work include small sample size, incorporation of infants with fever within the study sample, inclusion of infants with hypothermia during their hospitalization (and not only the ED stay, where management options differ) [ , ], and lack of internal validation. We will build upon these prior studies by providing a larger, analytically robust approach to identify risk factors for SBI in this population. The proposed study will be significantly larger, focused on the initial ED presentation and decision-making, and represent a more diverse population than prior studies. It will address a continued knowledge gap in the care of young infants.Future Directions
The findings from this study allow for additional research that will potentially allow for the implementation of real-time risk calculation for the presence of serious infections among infants with hypothermia. Our preliminary results (which corroborate with other work [
]) suggest that SBIs occur infrequently but are associated with high mortality, heightening challenges in risk stratification in this population. Future steps may therefore be intended to safely facilitate a reduction in low-value testing. Following the completion of this study, we will seek to externally validate and implement the model via clinical decision support systems and guidelines, reducing both overtreatment in low-risk infants and health care variability, thus improving care standardization and reducing the incidence of low-value care. This will potentially lower health care costs, decrease antibiotic exposure and unnecessary hospitalization, and alleviate the emotional and financial burden on families. At the study’s conclusion, dissemination efforts will involve broad participation from key partners in pediatrics, emergency medicine, hospital medicine, primary care pediatrics, infectious disease, and dissemination or implementation science.Conclusions
We aim to address the critical gap in evidence-based guidance for managing hypothermia in young infants presenting to the ED. By leveraging a large, multicenter dataset, we will delineate the epidemiology of SBI and HSV in this vulnerable population, evaluate the predictive value of biomarkers, and develop a clinically useful prediction model to stratify the risk of SBI. Our findings are expected to enhance patient care by reducing unnecessary invasive procedures and antibiotic exposure. If a robust model is developed and validated externally, these results will contribute to more standardized and evidence-based care, potentially reducing health care costs and the burden on families. Despite limitations such as variability in testing and the generalizability of the findings to nonacademic settings, this research marks a significant advancement in understanding and managing hypothermia in young infants.
Acknowledgments
This work was funded by the Gerber Foundation (grant #9940).
Data Availability
The datasets generated or analyzed during this study are not publicly available due to institutional data use agreements and restrictions but are available from the corresponding author on reasonable request. The study’s results will be published in peer-reviewed journals and shared through conference presentations and web-based education platforms.
Authors' Contributions
SR conceived of the study. SR, ATC, AJR, and PA initiated the study design and are the grant holders. DL provided statistical expertise in clinical trial design. All authors contributed to the refinement of the study protocol and approved the final manuscript.
Conflicts of Interest
None declared.
References
- Fleischmann C, Reichert F, Cassini A, Horner R, Harder T, Markwart R, et al. Global incidence and mortality of neonatal sepsis: a systematic review and meta-analysis. Arch Dis Child. 2021;106(8):745-752. [FREE Full text] [CrossRef] [Medline]
- Darmstadt GL, Ahmed S, Islam MS, Abdalla S, El Arifeen S, Arvay ML, et al. Association of clinical signs of possible serious bacterial infections identified by community health workers with mortality of young infants in South Asia: a prospective, observational cohort study. EClinicalMedicine. 2025;80:103070. [FREE Full text] [CrossRef] [Medline]
- Nisar YB, Tshefu A, Longombe AL, Esamai F, Marete I, Ayede AI, et al. Clinical signs of possible serious infection and associated mortality among young infants presenting at first-level health facilities. PLoS One. 2021;16(6):e0253110. [FREE Full text] [CrossRef] [Medline]
- Money NM, Lo YHJ, King H, Graves C, Holland JL, Rogers A, et al. Predicting serious bacterial infections among hypothermic infants in the emergency department. Hosp Pediatr. 2024;14(3):153-162. [CrossRef] [Medline]
- Raffaele JL, Sharma M, Berger S, Mitchell M, Lee C, Morrison J, et al. Prevalence of invasive bacterial infection in hypothermic young infants: a multisite study. J Pediatr. 2023;258:113407. [CrossRef] [Medline]
- Ramgopal S, Walker LW, Vitale MA, Nowalk AJ. Factors associated with serious bacterial infections in infants ≤60 days with hypothermia in the emergency department. Am J Emerg Med. 2019;37(6):1139-1143. [CrossRef] [Medline]
- Caviness AC, Demmler GJ, Selwyn BJ. Clinical and laboratory features of neonatal herpes simplex virus infection: a case-control study. Pediatr Infect Dis J. 2008;27(5):425-430. [CrossRef] [Medline]
- Caviness AC, Demmler GJ, Almendarez Y, Selwyn BJ. The prevalence of neonatal herpes simplex virus infection compared with serious bacterial illness in hospitalized neonates. J Pediatr. 2008;153(2):164-169. [CrossRef] [Medline]
- Kasmire KE, Vega C, Bennett NJ, Laurich VM. Hypothermia: a sign of sepsis in young infants in the emergency department? Pediatr Emerg Care. 2021;37(3):e124-e128. [CrossRef] [Medline]
- Graves C, Lo YH, Holland JL, Money NM, Hashikawa AN, Rogers A, et al. Hypothermia in young infants. Pediatrics. 2022;150(6):e2022058213. [CrossRef] [Medline]
- Liu E, Lewis K, Al-Saffar H, Krall CM, Singh A, Kulchitsky VA, et al. Naturally occurring hypothermia is more advantageous than fever in severe forms of lipopolysaccharide- and Escherichia coli-induced systemic inflammation. Am J Physiol Regul Integr Comp Physiol. 2012;302(12):R1372-R1383. [FREE Full text] [CrossRef] [Medline]
- Wood JK, Halvorson EE, Auriemma JR, Ervin SE, Thurtle DP, Keskinyan VS, et al. Clinical characteristics and health outcomes of neonates reporting to the emergency department with hypothermia. Hosp Pediatr. 2018;8(8):458-464. [CrossRef] [Medline]
- Jain SB, Anderson T, Mikhail D, Banerjee R, Arnold DH. Serious infections are rare in well-appearing neonates with hypothermia identified incidentally at routine visits. Am J Emerg Med. 2023;65:1-4. [CrossRef] [Medline]
- Lo YHJ, Graves C, Holland JL, Rogers AJ, Money N, Hashikawa AN, et al. Temperature threshold in the screening of bacterial infections in young infants with hypothermia. Emerg Med J. 2023;40(3):189-194. [FREE Full text] [CrossRef] [Medline]
- Perry MC, Yaeger SK, Noorbakhsh K, Cruz AT, Hickey RW. Hypothermia in young infants: frequency and yield of sepsis workup. Pediatr Emerg Care. 2021;37(8):e449-e455. [FREE Full text] [CrossRef] [Medline]
- Kuppermann N, Dayan PS, Levine DA, Vitale M, Tzimenatos L, Tunik MG, et al. A clinical prediction rule to identify febrile infants 60 days and younger at low risk for serious bacterial infections. JAMA Pediatr. 2019;173(4):342-351. [FREE Full text] [CrossRef] [Medline]
- Gomez B, Mintegi S, Bressan S, Da Dalt L, Gervaix A, Lacroix L, et al. European Group for Validation of the Step-by-Step Approach. Validation of the "step-by-step" approach in the management of young febrile infants. Pediatrics. 2016;138(2):e20154381. [CrossRef] [Medline]
- Ramgopal S, Graves C, Aronson P, Cruz A, Rogers A, RIsk Stratification for Hypothermic Infants (RISHI) Study Group. Clinician management practices for infants with hypothermia in the emergency department. Pediatrics. 2023;152(6):e2023063000. [CrossRef] [Medline]
- Lo YHJ, Ramgopal S, Hashikawa AN, Cranford JA, Rogers AJ. Variability in emergency department management of hypothermic infants ≤90 days of age. Am J Emerg Med. 2022;60:121-127. [CrossRef] [Medline]
- Kaplan RL, Cruz AT, Michelson KA, McAneney C, Blackstone MM, Pruitt CM, et al. Neonatal mastitis and concurrent serious bacterial infection. Pediatrics. 2021;148(1):e2021051322. [CrossRef] [Medline]
- Gutman CK, Aronson PL, Singh NV, Pickett ML, Bouvay K, Green RS, et al. Race, ethnicity, language, and the treatment of low-risk febrile infants. JAMA Pediatr. 2024;178(1):55-64. [CrossRef] [Medline]
- McLaren S, Cruz A, Yen K, Lipshaw M, Bergmann K, Mistry R, et al. Invasive bacterial infections in afebrile infants diagnosed with acute otitis media. Pediatrics. 2021;147(1):e20201571. [CrossRef] [Medline]
- Cruz AT, Nigrovic LE, Xie J, Mahajan P, Thomson JE, Okada PJ, et al. Predictors of invasive herpes simplex virus infection in young infants. Pediatrics. 2021;148(3):e2021050052. [CrossRef] [Medline]
- Collins GS, Reitsma JB, Altman DG, Moons K. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): the TRIPOD statement. BMC Med. 2015;13:1. [FREE Full text] [CrossRef] [Medline]
- Thermal protection of the newborn: a practical guide. World Health Organization. 1997. URL: https://www.who.int/publications/i/item/WHO_RHT_MSM_97.2 [accessed 2025-05-21]
- Pantell RH, Roberts KB, Adams WG, Dreyer BP, Kuppermann N, O'Leary ST, et al. Evaluation and management of well-appearing febrile infants 8 to 60 days old. Pediatrics. 2021;148(2):e2021052228. [CrossRef] [Medline]
- Feudtner C, Feinstein JA, Zhong W, Hall M, Dai D. Pediatric complex chronic conditions classification system version 2: updated for ICD-10 and complex medical technology dependence and transplantation. BMC Pediatr. 2014;14:199. [FREE Full text] [CrossRef] [Medline]
- Gustavson E, Levitt C. Physical abuse with severe hypothermia. Arch Pediatr Adolesc Med. Jan 1996;150(1):111-112. [CrossRef] [Medline]
- Hedegaard H, Johnson RL, Garnett MF, Thomas KE. The 2020 International Classification of Diseases, 10th Revision, clinical modification injury diagnosis framework for categorizing injuries by body region and nature of injury. Natl Health Stat Report. 2020;(150):1-27. [Medline]
- Hester G, Hersh AL, Mundorff M, Korgenski K, Wilkes J, Stoddard G, et al. Outcomes after skin and soft tissue infection in infants 90 days old or younger. Hosp Pediatr. 2015;5(11):580-585. [CrossRef] [Medline]
- Ren Z, Silverberg JI. Burden, risk factors, and infectious complications of cellulitis and erysipelas in US adults and children in the emergency department setting. J Am Acad Dermatol. 2021;84(5):1496-1503. [CrossRef] [Medline]
- General equivalence mappings. United States Centers for Medicare & Medicaid Services. 2009. URL: https://www.cms.gov/medicare/coding/icd10/downloads/icd-10_gem_fact_sheet.pdf [accessed 2024-05-17]
- Woll C, Neuman MI, Pruitt CM, Wang ME, Shapiro ED, Shah SS, et al. Epidemiology and etiology of invasive bacterial infection in infants ≤60 days old treated in emergency departments. J Pediatr. 2018;200:210-217.e1. [FREE Full text] [CrossRef] [Medline]
- Mahajan P, Kuppermann N, Mejias A, Suarez N, Chaussabel D, Casper TC, et al. Association of RNA biosignatures with bacterial infections in febrile infants aged 60 days or younger. JAMA. 2016;316(8):846-857. [FREE Full text] [CrossRef] [Medline]
- Study datasets. Pediatric Emergency Care Applied Research Network. URL: http://www.pecarn.org/studyDatasets/Default [accessed 2025-04-01]
- Ramilo O, Kuppermann N. Application of transcriptional signatures for diagnosis of febrile infants within the pediatric emergency care applied research network. Protocol Number 022. URL: https://www.pecarn.org/studydatasets/documents/Biosignatures_Protocol_v2.3_9.24.2012.pdf [accessed 2025-05-15]
- Mahajan P, Kuppermann N, Suarez N, Mejias A, Casper C, Dean JM, et al. RNA transcriptional biosignature analysis for identifying febrile infants with serious bacterial infections in the emergency department: a feasibility study. Pediatr Emerg Care. 2015;31(1):1-5. [FREE Full text] [CrossRef] [Medline]
- Aronson PL, Shabanova V, Shapiro ED, Wang ME, Nigrovic LE, Pruitt CM, et al. A prediction model to identify febrile infants ≤60 days at low risk of invasive bacterial infection. Pediatrics. 2019;144(1):e20183604. [FREE Full text] [CrossRef] [Medline]
- Steyerberg EW, Vergouwe Y. Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J. 2014;35(29):1925-1931. [FREE Full text] [CrossRef] [Medline]
- Alba AC, Agoritsas T, Walsh M, Hanna S, Iorio A, Devereaux PJ, et al. Discrimination and calibration of clinical prediction models: users' guides to the medical literature. JAMA. 2017;318(14):1377-1384. [CrossRef] [Medline]
- Lachenbruch PA, Mickey MR. Estimation of error rates in discriminant analysis. Technometrics. 1968;10(1):1-11. [CrossRef]
- Brentnall AR, Cuzick J, Field J, Duffy SW. A concordance index for matched case-control studies with applications in cancer risk. Stat Med. 2015;34(3):396-405. [CrossRef] [Medline]
- Lemeshow S, Hosmer JD. A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol. 1982;115(1):92-106. [CrossRef] [Medline]
- Holland JL, Ramgopal S, Money N, Graves C, Lo YH, Hashikawa A, et al. Biomarkers and their association with bacterial illnesses in hypothermic infants. Am J Emerg Med. 2023;64:137-141. [FREE Full text] [CrossRef] [Medline]
- Harrell FE. Multivariable Model Strategies. New York, NY. Springer; 2014:63-102.
- Combs MD, Mitchell M, Molas-Torreblanca K, Lee C, Raffaele JL, Sharma M, et al. Variation in care of well-appearing hypothermic young infants: a multisite study. Hosp Pediatr. 2023;13(8):742-750. [CrossRef] [Medline]
- Harrell FE. Describing, Resampling, Validating, and Simplifying the Model. New York, NY. Springer; 2014:103-126.
Abbreviations
BCM: Baylor College of Medicine |
CBC: complete blood count |
CRP: C-reactive protein |
CSF: cerebrospinal fluid |
ED: emergency department |
EHR: electronic health record |
HIPAA: Health Insurance Portability and Accountability Act |
HSV: herpes simplex virus |
IBI: invasive bacterial infection |
ICD-9: International Classification of Diseases, Ninth Revision |
ICD-10: International Statistical Classification of Diseases, Tenth Revision |
IRB: institutional review board |
PEM CRC: Pediatric Emergency Medicine Collaborative Research Committee |
PI: principal investigator |
REDCap: Research Electronic Data Capture |
SBI: serious bacterial infection |
UTI: urinary tract infection |
Edited by A Schwartz; submitted 20.09.24; peer-reviewed by N Idowu; comments to author 01.04.25; revised version received 07.04.25; accepted 09.05.25; published 19.06.25.
Copyright©Sriram Ramgopal, Paul Aronson, Douglas Lorenz, Alexander Joseph Rogers, Andrea Tania Cruz. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 19.06.2025.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.