Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department
Abstract Background Chest pain is among the most common presenting complaints in the emergency department (ED). Swift and accurate risk stratification of chest pain patients in the ED may improve patient outcomes and reduce unnecessary costs. Traditional logistic regression with stepwise variable se...
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
BMC
2021-04-01
|
Series: | BMC Medical Research Methodology |
Subjects: | |
Online Access: | https://doi.org/10.1186/s12874-021-01265-2 |
id |
doaj-012879fc82c24240a09d3b51e466fce3 |
---|---|
record_format |
Article |
spelling |
doaj-012879fc82c24240a09d3b51e466fce32021-04-18T11:03:02ZengBMCBMC Medical Research Methodology1471-22882021-04-0121111310.1186/s12874-021-01265-2Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency departmentNan Liu0Marcel Lucas Chee1Zhi Xiong Koh2Su Li Leow3Andrew Fu Wah Ho4Dagang Guo5Marcus Eng Hock Ong6Duke-NUS Medical School, National University of SingaporeFaculty of Medicine, Nursing and Health Sciences, Monash UniversityDepartment of Emergency Medicine, Singapore General HospitalDuke-NUS Medical School, National University of SingaporeDuke-NUS Medical School, National University of SingaporeSingHealth Duke-NUS Emergency Medicine Academic Clinical ProgrammeDuke-NUS Medical School, National University of SingaporeAbstract Background Chest pain is among the most common presenting complaints in the emergency department (ED). Swift and accurate risk stratification of chest pain patients in the ED may improve patient outcomes and reduce unnecessary costs. Traditional logistic regression with stepwise variable selection has been used to build risk prediction models for ED chest pain patients. In this study, we aimed to investigate if machine learning dimensionality reduction methods can improve performance in deriving risk stratification models. Methods A retrospective analysis was conducted on the data of patients > 20 years old who presented to the ED of Singapore General Hospital with chest pain between September 2010 and July 2015. Variables used included demographics, medical history, laboratory findings, heart rate variability (HRV), and heart rate n-variability (HRnV) parameters calculated from five to six-minute electrocardiograms (ECGs). The primary outcome was 30-day major adverse cardiac events (MACE), which included death, acute myocardial infarction, and revascularization within 30 days of ED presentation. We used eight machine learning dimensionality reduction methods and logistic regression to create different prediction models. We further excluded cardiac troponin from candidate variables and derived a separate set of models to evaluate the performance of models without using laboratory tests. Receiver operating characteristic (ROC) and calibration analysis was used to compare model performance. Results Seven hundred ninety-five patients were included in the analysis, of which 247 (31%) met the primary outcome of 30-day MACE. Patients with MACE were older and more likely to be male. All eight dimensionality reduction methods achieved comparable performance with the traditional stepwise variable selection; The multidimensional scaling algorithm performed the best with an area under the curve of 0.901. All prediction models generated in this study outperformed several existing clinical scores in ROC analysis. Conclusions Dimensionality reduction models showed marginal value in improving the prediction of 30-day MACE for ED chest pain patients. Moreover, they are black box models, making them difficult to explain and interpret in clinical practice.https://doi.org/10.1186/s12874-021-01265-2Machine learningDimensionality reductionHeart rate n-variability (HRnV)Heart rate variability (HRV)Chest painEmergency department |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Nan Liu Marcel Lucas Chee Zhi Xiong Koh Su Li Leow Andrew Fu Wah Ho Dagang Guo Marcus Eng Hock Ong |
spellingShingle |
Nan Liu Marcel Lucas Chee Zhi Xiong Koh Su Li Leow Andrew Fu Wah Ho Dagang Guo Marcus Eng Hock Ong Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department BMC Medical Research Methodology Machine learning Dimensionality reduction Heart rate n-variability (HRnV) Heart rate variability (HRV) Chest pain Emergency department |
author_facet |
Nan Liu Marcel Lucas Chee Zhi Xiong Koh Su Li Leow Andrew Fu Wah Ho Dagang Guo Marcus Eng Hock Ong |
author_sort |
Nan Liu |
title |
Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department |
title_short |
Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department |
title_full |
Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department |
title_fullStr |
Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department |
title_full_unstemmed |
Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department |
title_sort |
utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department |
publisher |
BMC |
series |
BMC Medical Research Methodology |
issn |
1471-2288 |
publishDate |
2021-04-01 |
description |
Abstract Background Chest pain is among the most common presenting complaints in the emergency department (ED). Swift and accurate risk stratification of chest pain patients in the ED may improve patient outcomes and reduce unnecessary costs. Traditional logistic regression with stepwise variable selection has been used to build risk prediction models for ED chest pain patients. In this study, we aimed to investigate if machine learning dimensionality reduction methods can improve performance in deriving risk stratification models. Methods A retrospective analysis was conducted on the data of patients > 20 years old who presented to the ED of Singapore General Hospital with chest pain between September 2010 and July 2015. Variables used included demographics, medical history, laboratory findings, heart rate variability (HRV), and heart rate n-variability (HRnV) parameters calculated from five to six-minute electrocardiograms (ECGs). The primary outcome was 30-day major adverse cardiac events (MACE), which included death, acute myocardial infarction, and revascularization within 30 days of ED presentation. We used eight machine learning dimensionality reduction methods and logistic regression to create different prediction models. We further excluded cardiac troponin from candidate variables and derived a separate set of models to evaluate the performance of models without using laboratory tests. Receiver operating characteristic (ROC) and calibration analysis was used to compare model performance. Results Seven hundred ninety-five patients were included in the analysis, of which 247 (31%) met the primary outcome of 30-day MACE. Patients with MACE were older and more likely to be male. All eight dimensionality reduction methods achieved comparable performance with the traditional stepwise variable selection; The multidimensional scaling algorithm performed the best with an area under the curve of 0.901. All prediction models generated in this study outperformed several existing clinical scores in ROC analysis. Conclusions Dimensionality reduction models showed marginal value in improving the prediction of 30-day MACE for ED chest pain patients. Moreover, they are black box models, making them difficult to explain and interpret in clinical practice. |
topic |
Machine learning Dimensionality reduction Heart rate n-variability (HRnV) Heart rate variability (HRV) Chest pain Emergency department |
url |
https://doi.org/10.1186/s12874-021-01265-2 |
work_keys_str_mv |
AT nanliu utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment AT marcellucaschee utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment AT zhixiongkoh utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment AT sulileow utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment AT andrewfuwahho utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment AT dagangguo utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment AT marcusenghockong utilizingmachinelearningdimensionalityreductionforriskstratificationofchestpainpatientsintheemergencydepartment |
_version_ |
1721522739216384000 |