Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department

Abstract Background Chest pain is among the most common presenting complaints in the emergency department (ED). Swift and accurate risk stratification of chest pain patients in the ED may improve patient outcomes and reduce unnecessary costs. Traditional logistic regression with stepwise variable se...

Full description

Bibliographic Details
Main Authors: Nan Liu, Marcel Lucas Chee, Zhi Xiong Koh, Su Li Leow, Andrew Fu Wah Ho, Dagang Guo, Marcus Eng Hock Ong
Format: Article
Language:English
Published: BMC 2021-04-01
Series:BMC Medical Research Methodology
Subjects:
Online Access:https://doi.org/10.1186/s12874-021-01265-2
id doaj-012879fc82c24240a09d3b51e466fce3
record_format Article
spelling doaj-012879fc82c24240a09d3b51e466fce32021-04-18T11:03:02ZengBMCBMC Medical Research Methodology1471-22882021-04-0121111310.1186/s12874-021-01265-2Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency departmentNan Liu0Marcel Lucas Chee1Zhi Xiong Koh2Su Li Leow3Andrew Fu Wah Ho4Dagang Guo5Marcus Eng Hock Ong6Duke-NUS Medical School, National University of SingaporeFaculty of Medicine, Nursing and Health Sciences, Monash UniversityDepartment of Emergency Medicine, Singapore General HospitalDuke-NUS Medical School, National University of SingaporeDuke-NUS Medical School, National University of SingaporeSingHealth Duke-NUS Emergency Medicine Academic Clinical ProgrammeDuke-NUS Medical School, National University of SingaporeAbstract Background Chest pain is among the most common presenting complaints in the emergency department (ED). Swift and accurate risk stratification of chest pain patients in the ED may improve patient outcomes and reduce unnecessary costs. Traditional logistic regression with stepwise variable selection has been used to build risk prediction models for ED chest pain patients. In this study, we aimed to investigate if machine learning dimensionality reduction methods can improve performance in deriving risk stratification models. Methods A retrospective analysis was conducted on the data of patients > 20 years old who presented to the ED of Singapore General Hospital with chest pain between September 2010 and July 2015. Variables used included demographics, medical history, laboratory findings, heart rate variability (HRV), and heart rate n-variability (HRnV) parameters calculated from five to six-minute electrocardiograms (ECGs). The primary outcome was 30-day major adverse cardiac events (MACE), which included death, acute myocardial infarction, and revascularization within 30 days of ED presentation. We used eight machine learning dimensionality reduction methods and logistic regression to create different prediction models. We further excluded cardiac troponin from candidate variables and derived a separate set of models to evaluate the performance of models without using laboratory tests. Receiver operating characteristic (ROC) and calibration analysis was used to compare model performance. Results Seven hundred ninety-five patients were included in the analysis, of which 247 (31%) met the primary outcome of 30-day MACE. Patients with MACE were older and more likely to be male. All eight dimensionality reduction methods achieved comparable performance with the traditional stepwise variable selection; The multidimensional scaling algorithm performed the best with an area under the curve of 0.901. All prediction models generated in this study outperformed several existing clinical scores in ROC analysis. Conclusions Dimensionality reduction models showed marginal value in improving the prediction of 30-day MACE for ED chest pain patients. Moreover, they are black box models, making them difficult to explain and interpret in clinical practice.https://doi.org/10.1186/s12874-021-01265-2Machine learningDimensionality reductionHeart rate n-variability (HRnV)Heart rate variability (HRV)Chest painEmergency department
collection DOAJ
language English
format Article
sources DOAJ
author Nan Liu
Marcel Lucas Chee
Zhi Xiong Koh
Su Li Leow
Andrew Fu Wah Ho
Dagang Guo
Marcus Eng Hock Ong
spellingShingle Nan Liu
Marcel Lucas Chee
Zhi Xiong Koh
Su Li Leow
Andrew Fu Wah Ho
Dagang Guo
Marcus Eng Hock Ong
Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department
BMC Medical Research Methodology
Machine learning
Dimensionality reduction
Heart rate n-variability (HRnV)
Heart rate variability (HRV)
Chest pain
Emergency department
author_facet Nan Liu
Marcel Lucas Chee
Zhi Xiong Koh
Su Li Leow
Andrew Fu Wah Ho
Dagang Guo
Marcus Eng Hock Ong
author_sort Nan Liu
title Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department
title_short Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department
title_full Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department
title_fullStr Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department
title_full_unstemmed Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department
title_sort utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department
publisher BMC
series BMC Medical Research Methodology
issn 1471-2288
publishDate 2021-04-01
description Abstract Background Chest pain is among the most common presenting complaints in the emergency department (ED). Swift and accurate risk stratification of chest pain patients in the ED may improve patient outcomes and reduce unnecessary costs. Traditional logistic regression with stepwise variable selection has been used to build risk prediction models for ED chest pain patients. In this study, we aimed to investigate if machine learning dimensionality reduction methods can improve performance in deriving risk stratification models. Methods A retrospective analysis was conducted on the data of patients > 20 years old who presented to the ED of Singapore General Hospital with chest pain between September 2010 and July 2015. Variables used included demographics, medical history, laboratory findings, heart rate variability (HRV), and heart rate n-variability (HRnV) parameters calculated from five to six-minute electrocardiograms (ECGs). The primary outcome was 30-day major adverse cardiac events (MACE), which included death, acute myocardial infarction, and revascularization within 30 days of ED presentation. We used eight machine learning dimensionality reduction methods and logistic regression to create different prediction models. We further excluded cardiac troponin from candidate variables and derived a separate set of models to evaluate the performance of models without using laboratory tests. Receiver operating characteristic (ROC) and calibration analysis was used to compare model performance. Results Seven hundred ninety-five patients were included in the analysis, of which 247 (31%) met the primary outcome of 30-day MACE. Patients with MACE were older and more likely to be male. All eight dimensionality reduction methods achieved comparable performance with the traditional stepwise variable selection; The multidimensional scaling algorithm performed the best with an area under the curve of 0.901. All prediction models generated in this study outperformed several existing clinical scores in ROC analysis. Conclusions Dimensionality reduction models showed marginal value in improving the prediction of 30-day MACE for ED chest pain patients. Moreover, they are black box models, making them difficult to explain and interpret in clinical practice.
topic Machine learning
Dimensionality reduction
Heart rate n-variability (HRnV)
Heart rate variability (HRV)
Chest pain
Emergency department
url https://doi.org/10.1186/s12874-021-01265-2
work_keys_str_mv AT nanliu utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment
AT marcellucaschee utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment
AT zhixiongkoh utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment
AT sulileow utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment
AT andrewfuwahho utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment
AT dagangguo utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment
AT marcusenghockong utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment
_version_ 1721522739216384000