Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study.
<h4>Background</h4>Although machine learning-based prediction models for in-hospital cardiac arrest (IHCA) have been widely investigated, it is unknown whether a model based on vital signs alone (Vitals-Only model) can perform similarly to a model that considers both vital signs and labo...
Main Authors: | , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2020-01-01
|
Series: | PLoS ONE |
Online Access: | https://doi.org/10.1371/journal.pone.0235835 |
id |
doaj-11edd5cf72e74d58b9488a95fdeb6345 |
---|---|
record_format |
Article |
spelling |
doaj-11edd5cf72e74d58b9488a95fdeb63452021-03-04T11:16:30ZengPublic Library of Science (PLoS)PLoS ONE1932-62032020-01-01157e023583510.1371/journal.pone.0235835Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study.Ryo UenoLiyuan XuWataru UegamiHiroki MatsuiJun OkuiHiroshi HayashiToru MiyajimaYoshiro HayashiDavid PilcherDaryl Jones<h4>Background</h4>Although machine learning-based prediction models for in-hospital cardiac arrest (IHCA) have been widely investigated, it is unknown whether a model based on vital signs alone (Vitals-Only model) can perform similarly to a model that considers both vital signs and laboratory results (Vitals+Labs model).<h4>Methods</h4>All adult patients hospitalized in a tertiary care hospital in Japan between October 2011 and October 2018 were included in this study. Random forest models with/without laboratory results (Vitals+Labs model and Vitals-Only model, respectively) were trained and tested using chronologically divided datasets. Both models use patient demographics and eight-hourly vital signs collected within the previous 48 hours. The primary and secondary outcomes were the occurrence of IHCA in the next 8 and 24 hours, respectively. The area under the receiver operating characteristic curve (AUC) was used as a comparative measure. Sensitivity analyses were performed under multiple statistical assumptions.<h4>Results</h4>Of 141,111 admitted patients (training data: 83,064, test data: 58,047), 338 had an IHCA (training data: 217, test data: 121) during the study period. The Vitals-Only model and Vitals+Labs model performed comparably when predicting IHCA within the next 8 hours (Vitals-Only model vs Vitals+Labs model, AUC = 0.862 [95% confidence interval (CI): 0.855-0.868] vs 0.872 [95% CI: 0.867-0.878]) and 24 hours (Vitals-Only model vs Vitals+Labs model, AUC = 0.830 [95% CI: 0.825-0.835] vs 0.837 [95% CI: 0.830-0.844]). Both models performed similarly well on medical, surgical, and ward patient data, but did not perform well for intensive care unit patients.<h4>Conclusions</h4>In this single-center study, the machine learning model predicted IHCAs with good discrimination. The addition of laboratory values to vital signs did not significantly improve its overall performance.https://doi.org/10.1371/journal.pone.0235835 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Ryo Ueno Liyuan Xu Wataru Uegami Hiroki Matsui Jun Okui Hiroshi Hayashi Toru Miyajima Yoshiro Hayashi David Pilcher Daryl Jones |
spellingShingle |
Ryo Ueno Liyuan Xu Wataru Uegami Hiroki Matsui Jun Okui Hiroshi Hayashi Toru Miyajima Yoshiro Hayashi David Pilcher Daryl Jones Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study. PLoS ONE |
author_facet |
Ryo Ueno Liyuan Xu Wataru Uegami Hiroki Matsui Jun Okui Hiroshi Hayashi Toru Miyajima Yoshiro Hayashi David Pilcher Daryl Jones |
author_sort |
Ryo Ueno |
title |
Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study. |
title_short |
Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study. |
title_full |
Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study. |
title_fullStr |
Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study. |
title_full_unstemmed |
Value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: A single-center retrospective cohort study. |
title_sort |
value of laboratory results in addition to vital signs in a machine learning algorithm to predict in-hospital cardiac arrest: a single-center retrospective cohort study. |
publisher |
Public Library of Science (PLoS) |
series |
PLoS ONE |
issn |
1932-6203 |
publishDate |
2020-01-01 |
description |
<h4>Background</h4>Although machine learning-based prediction models for in-hospital cardiac arrest (IHCA) have been widely investigated, it is unknown whether a model based on vital signs alone (Vitals-Only model) can perform similarly to a model that considers both vital signs and laboratory results (Vitals+Labs model).<h4>Methods</h4>All adult patients hospitalized in a tertiary care hospital in Japan between October 2011 and October 2018 were included in this study. Random forest models with/without laboratory results (Vitals+Labs model and Vitals-Only model, respectively) were trained and tested using chronologically divided datasets. Both models use patient demographics and eight-hourly vital signs collected within the previous 48 hours. The primary and secondary outcomes were the occurrence of IHCA in the next 8 and 24 hours, respectively. The area under the receiver operating characteristic curve (AUC) was used as a comparative measure. Sensitivity analyses were performed under multiple statistical assumptions.<h4>Results</h4>Of 141,111 admitted patients (training data: 83,064, test data: 58,047), 338 had an IHCA (training data: 217, test data: 121) during the study period. The Vitals-Only model and Vitals+Labs model performed comparably when predicting IHCA within the next 8 hours (Vitals-Only model vs Vitals+Labs model, AUC = 0.862 [95% confidence interval (CI): 0.855-0.868] vs 0.872 [95% CI: 0.867-0.878]) and 24 hours (Vitals-Only model vs Vitals+Labs model, AUC = 0.830 [95% CI: 0.825-0.835] vs 0.837 [95% CI: 0.830-0.844]). Both models performed similarly well on medical, surgical, and ward patient data, but did not perform well for intensive care unit patients.<h4>Conclusions</h4>In this single-center study, the machine learning model predicted IHCAs with good discrimination. The addition of laboratory values to vital signs did not significantly improve its overall performance. |
url |
https://doi.org/10.1371/journal.pone.0235835 |
work_keys_str_mv |
AT ryoueno valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy AT liyuanxu valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy AT wataruuegami valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy AT hirokimatsui valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy AT junokui valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy AT hiroshihayashi valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy AT torumiyajima valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy AT yoshirohayashi valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy AT davidpilcher valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy AT daryljones valueoflaboratoryresultsinadditiontovitalsignsinamachinelearningalgorithmtopredictinhospitalcardiacarrestasinglecenterretrospectivecohortstudy |
_version_ |
1714804113500274688 |