Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study.

<h4>Background</h4>Although machine learning-based prediction models for in-hospital cardiac arrest (IHCA) have been widely investigated, it is unknown whether a model based on vital signs alone (Vitals-Only model) can perform similarly to a model that considers both vital signs and labo...

Full description

Bibliographic Details
Main Authors: Ryo Ueno, Liyuan Xu, Wataru Uegami, Hiroki Matsui, Jun Okui, Hiroshi Hayashi, Toru Miyajima, Yoshiro Hayashi, David Pilcher, Daryl Jones
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2020-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0235835
id doaj-11edd5cf72e74d58b9488a95fdeb6345
record_format Article
spelling doaj-11edd5cf72e74d58b9488a95fdeb63452021-03-04T11:16:30ZengPublic Library of Science (PLoS)PLoS ONE1932-62032020-01-01157e023583510.1371/journal.pone.0235835Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study.Ryo UenoLiyuan XuWataru UegamiHiroki MatsuiJun OkuiHiroshi HayashiToru MiyajimaYoshiro HayashiDavid PilcherDaryl Jones<h4>Background</h4>Although machine learning-based prediction models for in-hospital cardiac arrest (IHCA) have been widely investigated, it is unknown whether a model based on vital signs alone (Vitals-Only model) can perform similarly to a model that considers both vital signs and laboratory results (Vitals+Labs model).<h4>Methods</h4>All adult patients hospitalized in a tertiary care hospital in Japan between October 2011 and October 2018 were included in this study. Random forest models with/without laboratory results (Vitals+Labs model and Vitals-Only model, respectively) were trained and tested using chronologically divided datasets. Both models use patient demographics and eight-hourly vital signs collected within the previous 48 hours. The primary and secondary outcomes were the occurrence of IHCA in the next 8 and 24 hours, respectively. The area under the receiver operating characteristic curve (AUC) was used as a comparative measure. Sensitivity analyses were performed under multiple statistical assumptions.<h4>Results</h4>Of 141,111 admitted patients (training data: 83,064, test data: 58,047), 338 had an IHCA (training data: 217, test data: 121) during the study period. The Vitals-Only model and Vitals+Labs model performed comparably when predicting IHCA within the next 8 hours (Vitals-Only model vs Vitals+Labs model, AUC = 0.862 [95% confidence interval (CI): 0.855-0.868] vs 0.872 [95% CI: 0.867-0.878]) and 24 hours (Vitals-Only model vs Vitals+Labs model, AUC = 0.830 [95% CI: 0.825-0.835] vs 0.837 [95% CI: 0.830-0.844]). Both models performed similarly well on medical, surgical, and ward patient data, but did not perform well for intensive care unit patients.<h4>Conclusions</h4>In this single-center study, the machine learning model predicted IHCAs with good discrimination. The addition of laboratory values to vital signs did not significantly improve its overall performance.https://doi.org/10.1371/journal.pone.0235835
collection DOAJ
language English
format Article
sources DOAJ
author Ryo Ueno
Liyuan Xu
Wataru Uegami
Hiroki Matsui
Jun Okui
Hiroshi Hayashi
Toru Miyajima
Yoshiro Hayashi
David Pilcher
Daryl Jones
spellingShingle Ryo Ueno
Liyuan Xu
Wataru Uegami
Hiroki Matsui
Jun Okui
Hiroshi Hayashi
Toru Miyajima
Yoshiro Hayashi
David Pilcher
Daryl Jones
Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study.
PLoS ONE
author_facet Ryo Ueno
Liyuan Xu
Wataru Uegami
Hiroki Matsui
Jun Okui
Hiroshi Hayashi
Toru Miyajima
Yoshiro Hayashi
David Pilcher
Daryl Jones
author_sort Ryo Ueno
title Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study.
title_short Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study.
title_full Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study.
title_fullStr Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study.
title_full_unstemmed Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study.
title_sort value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: a single-center retrospective cohort study.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2020-01-01
description <h4>Background</h4>Although machine learning-based prediction models for in-hospital cardiac arrest (IHCA) have been widely investigated, it is unknown whether a model based on vital signs alone (Vitals-Only model) can perform similarly to a model that considers both vital signs and laboratory results (Vitals+Labs model).<h4>Methods</h4>All adult patients hospitalized in a tertiary care hospital in Japan between October 2011 and October 2018 were included in this study. Random forest models with/without laboratory results (Vitals+Labs model and Vitals-Only model, respectively) were trained and tested using chronologically divided datasets. Both models use patient demographics and eight-hourly vital signs collected within the previous 48 hours. The primary and secondary outcomes were the occurrence of IHCA in the next 8 and 24 hours, respectively. The area under the receiver operating characteristic curve (AUC) was used as a comparative measure. Sensitivity analyses were performed under multiple statistical assumptions.<h4>Results</h4>Of 141,111 admitted patients (training data: 83,064, test data: 58,047), 338 had an IHCA (training data: 217, test data: 121) during the study period. The Vitals-Only model and Vitals+Labs model performed comparably when predicting IHCA within the next 8 hours (Vitals-Only model vs Vitals+Labs model, AUC = 0.862 [95% confidence interval (CI): 0.855-0.868] vs 0.872 [95% CI: 0.867-0.878]) and 24 hours (Vitals-Only model vs Vitals+Labs model, AUC = 0.830 [95% CI: 0.825-0.835] vs 0.837 [95% CI: 0.830-0.844]). Both models performed similarly well on medical, surgical, and ward patient data, but did not perform well for intensive care unit patients.<h4>Conclusions</h4>In this single-center study, the machine learning model predicted IHCAs with good discrimination. The addition of laboratory values to vital signs did not significantly improve its overall performance.
url https://doi.org/10.1371/journal.pone.0235835
work_keys_str_mv AT ryoueno valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy
AT liyuanxu valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy
AT wataruuegami valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy
AT hirokimatsui valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy
AT junokui valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy
AT hiroshihayashi valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy
AT torumiyajima valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy
AT yoshirohayashi valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy
AT davidpilcher valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy
AT daryljones valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy
_version_ 1714804113500274688