Using Machine Learning to Predict Invasive Bacterial Infections in Young Febrile Infants Visiting the Emergency Department

Background: The aim of this study was to develop and evaluate a machine learning (ML) model to predict invasive bacterial infections (IBIs) in young febrile infants visiting the emergency department (ED). Methods: This retrospective study was conducted in the EDs of three medical centers across Taiw...

Full description

Bibliographic Details
Main Authors: I-Min Chiu, Chi-Yung Cheng, Wun-Huei Zeng, Ying-Hsien Huang, Chun-Hung Richard Lin
Format: Article
Language:English
Published: MDPI AG 2021-04-01
Series:Journal of Clinical Medicine
Subjects:
Online Access:https://www.mdpi.com/2077-0383/10/9/1875
id doaj-7c6be17e00cf44c3830fa70dc399e46c
record_format Article
spelling doaj-7c6be17e00cf44c3830fa70dc399e46c2021-04-26T23:03:10ZengMDPI AGJournal of Clinical Medicine2077-03832021-04-01101875187510.3390/jcm10091875Using Machine Learning to Predict Invasive Bacterial Infections in Young Febrile Infants Visiting the Emergency DepartmentI-Min Chiu0Chi-Yung Cheng1Wun-Huei Zeng2Ying-Hsien Huang3Chun-Hung Richard Lin4Department of Emergency Medicine, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung 833, TaiwanDepartment of Emergency Medicine, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung 833, TaiwanDepartment of Computer Science and Engineering, National Sun Yat-Sen University, Kaohsiung 804, TaiwanDepartment of Pediatrics, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung 833, TaiwanDepartment of Computer Science and Engineering, National Sun Yat-Sen University, Kaohsiung 804, TaiwanBackground: The aim of this study was to develop and evaluate a machine learning (ML) model to predict invasive bacterial infections (IBIs) in young febrile infants visiting the emergency department (ED). Methods: This retrospective study was conducted in the EDs of three medical centers across Taiwan from 2011 to 2018. We included patients age in 0–60 days who were visiting the ED with clinical symptoms of fever. We developed three different ML algorithms, including logistic regression (LR), supportive vector machine (SVM), and extreme gradient boosting (XGboost), comparing their performance at predicting IBIs to a previous validated score system (IBI score). Results: During the study period, 4211 patients were included, where 126 (3.1%) had IBI. A total of eight, five, and seven features were used in the LR, SVM, and XGboost through the feature selection process, respectively. The ML models can achieve a better AUROC value when predicting IBIs in young infants compared with the IBI score (LR: 0.85 vs. SVM: 0.84 vs. XGBoost: 0.85 vs. IBI score: 0.70, <i>p</i>-value < 0.001). Using a cost sensitive learning algorithm, all ML models showed better specificity in predicting IBIs at a 90% sensitivity level compared to an IBI score >2 (LR: 0.59 vs. SVM: 0.60 vs. XGBoost: 0.57 vs. IBI score >2: 0.43, <i>p</i>-value < 0.001). Conclusions: All ML models developed in this study outperformed the traditional scoring system in stratifying low-risk febrile infants after the standardized sensitivity level.https://www.mdpi.com/2077-0383/10/9/1875machine learninginvasive bacterial infectionyoung infant feveremergency department
collection DOAJ
language English
format Article
sources DOAJ
author I-Min Chiu
Chi-Yung Cheng
Wun-Huei Zeng
Ying-Hsien Huang
Chun-Hung Richard Lin
spellingShingle I-Min Chiu
Chi-Yung Cheng
Wun-Huei Zeng
Ying-Hsien Huang
Chun-Hung Richard Lin
Using Machine Learning to Predict Invasive Bacterial Infections in Young Febrile Infants Visiting the Emergency Department
Journal of Clinical Medicine
machine learning
invasive bacterial infection
young infant fever
emergency department
author_facet I-Min Chiu
Chi-Yung Cheng
Wun-Huei Zeng
Ying-Hsien Huang
Chun-Hung Richard Lin
author_sort I-Min Chiu
title Using Machine Learning to Predict Invasive Bacterial Infections in Young Febrile Infants Visiting the Emergency Department
title_short Using Machine Learning to Predict Invasive Bacterial Infections in Young Febrile Infants Visiting the Emergency Department
title_full Using Machine Learning to Predict Invasive Bacterial Infections in Young Febrile Infants Visiting the Emergency Department
title_fullStr Using Machine Learning to Predict Invasive Bacterial Infections in Young Febrile Infants Visiting the Emergency Department
title_full_unstemmed Using Machine Learning to Predict Invasive Bacterial Infections in Young Febrile Infants Visiting the Emergency Department
title_sort using machine learning to predict invasive bacterial infections in young febrile infants visiting the emergency department
publisher MDPI AG
series Journal of Clinical Medicine
issn 2077-0383
publishDate 2021-04-01
description Background: The aim of this study was to develop and evaluate a machine learning (ML) model to predict invasive bacterial infections (IBIs) in young febrile infants visiting the emergency department (ED). Methods: This retrospective study was conducted in the EDs of three medical centers across Taiwan from 2011 to 2018. We included patients age in 0–60 days who were visiting the ED with clinical symptoms of fever. We developed three different ML algorithms, including logistic regression (LR), supportive vector machine (SVM), and extreme gradient boosting (XGboost), comparing their performance at predicting IBIs to a previous validated score system (IBI score). Results: During the study period, 4211 patients were included, where 126 (3.1%) had IBI. A total of eight, five, and seven features were used in the LR, SVM, and XGboost through the feature selection process, respectively. The ML models can achieve a better AUROC value when predicting IBIs in young infants compared with the IBI score (LR: 0.85 vs. SVM: 0.84 vs. XGBoost: 0.85 vs. IBI score: 0.70, <i>p</i>-value < 0.001). Using a cost sensitive learning algorithm, all ML models showed better specificity in predicting IBIs at a 90% sensitivity level compared to an IBI score >2 (LR: 0.59 vs. SVM: 0.60 vs. XGBoost: 0.57 vs. IBI score >2: 0.43, <i>p</i>-value < 0.001). Conclusions: All ML models developed in this study outperformed the traditional scoring system in stratifying low-risk febrile infants after the standardized sensitivity level.
topic machine learning
invasive bacterial infection
young infant fever
emergency department
url https://www.mdpi.com/2077-0383/10/9/1875
work_keys_str_mv AT iminchiu usingmachinelearningtopredictinvasivebacterialinfectionsinyoungfebrileinfantsvisitingtheemergencydepartment
AT chiyungcheng usingmachinelearningtopredictinvasivebacterialinfectionsinyoungfebrileinfantsvisitingtheemergencydepartment
AT wunhueizeng usingmachinelearningtopredictinvasivebacterialinfectionsinyoungfebrileinfantsvisitingtheemergencydepartment
AT yinghsienhuang usingmachinelearningtopredictinvasivebacterialinfectionsinyoungfebrileinfantsvisitingtheemergencydepartment
AT chunhungrichardlin usingmachinelearningtopredictinvasivebacterialinfectionsinyoungfebrileinfantsvisitingtheemergencydepartment
_version_ 1721507237973721088