A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation

BackgroundEffectively and efficiently diagnosing patients who have COVID-19 with the accurate clinical type of the disease is essential to achieve optimal outcomes for the patients as well as to reduce the risk of overloading the health care system. Currently, severe and nons...

Full description

Bibliographic Details
Main Authors: Chen, Yuanfang, Ouyang, Liu, Bao, Forrest S, Li, Qian, Han, Lei, Zhang, Hengdong, Zhu, Baoli, Ge, Yaorong, Robinson, Patrick, Xu, Ming, Liu, Jie, Chen, Shi
Format: Article
Language:English
Published: JMIR Publications 2021-04-01
Series:Journal of Medical Internet Research
Online Access:https://www.jmir.org/2021/4/e23948
id doaj-61d958519ee7459d8a9254712558ea5e
record_format Article
spelling doaj-61d958519ee7459d8a9254712558ea5e2021-04-07T13:31:22ZengJMIR PublicationsJournal of Medical Internet Research1438-88712021-04-01234e2394810.2196/23948A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and ValidationChen, YuanfangOuyang, LiuBao, Forrest SLi, QianHan, LeiZhang, HengdongZhu, BaoliGe, YaorongRobinson, PatrickXu, MingLiu, JieChen, Shi BackgroundEffectively and efficiently diagnosing patients who have COVID-19 with the accurate clinical type of the disease is essential to achieve optimal outcomes for the patients as well as to reduce the risk of overloading the health care system. Currently, severe and nonsevere COVID-19 types are differentiated by only a few features, which do not comprehensively characterize the complicated pathological, physiological, and immunological responses to SARS-CoV-2 infection in the different disease types. In addition, these type-defining features may not be readily testable at the time of diagnosis. ObjectiveIn this study, we aimed to use a machine learning approach to understand COVID-19 more comprehensively, accurately differentiate severe and nonsevere COVID-19 clinical types based on multiple medical features, and provide reliable predictions of the clinical type of the disease. MethodsFor this study, we recruited 214 confirmed patients with nonsevere COVID-19 and 148 patients with severe COVID-19. The clinical characteristics (26 features) and laboratory test results (26 features) upon admission were acquired as two input modalities. Exploratory analyses demonstrated that these features differed substantially between two clinical types. Machine learning random forest models based on all the features in each modality as well as on the top 5 features in each modality combined were developed and validated to differentiate COVID-19 clinical types. ResultsUsing clinical and laboratory results independently as input, the random forest models achieved >90% and >95% predictive accuracy, respectively. The importance scores of the input features were further evaluated, and the top 5 features from each modality were identified (age, hypertension, cardiovascular disease, gender, and diabetes for the clinical features modality, and dimerized plasmin fragment D, high sensitivity troponin I, absolute neutrophil count, interleukin 6, and lactate dehydrogenase for the laboratory testing modality, in descending order). Using these top 10 multimodal features as the only input instead of all 52 features combined, the random forest model was able to achieve 97% predictive accuracy. ConclusionsOur findings shed light on how the human body reacts to SARS-CoV-2 infection as a unit and provide insights on effectively evaluating the disease severity of patients with COVID-19 based on more common medical features when gold standard features are not available. We suggest that clinical information can be used as an initial screening tool for self-evaluation and triage, while laboratory test results should be applied when accuracy is the priority.https://www.jmir.org/2021/4/e23948
collection DOAJ
language English
format Article
sources DOAJ
author Chen, Yuanfang
Ouyang, Liu
Bao, Forrest S
Li, Qian
Han, Lei
Zhang, Hengdong
Zhu, Baoli
Ge, Yaorong
Robinson, Patrick
Xu, Ming
Liu, Jie
Chen, Shi
spellingShingle Chen, Yuanfang
Ouyang, Liu
Bao, Forrest S
Li, Qian
Han, Lei
Zhang, Hengdong
Zhu, Baoli
Ge, Yaorong
Robinson, Patrick
Xu, Ming
Liu, Jie
Chen, Shi
A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation
Journal of Medical Internet Research
author_facet Chen, Yuanfang
Ouyang, Liu
Bao, Forrest S
Li, Qian
Han, Lei
Zhang, Hengdong
Zhu, Baoli
Ge, Yaorong
Robinson, Patrick
Xu, Ming
Liu, Jie
Chen, Shi
author_sort Chen, Yuanfang
title A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation
title_short A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation
title_full A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation
title_fullStr A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation
title_full_unstemmed A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation
title_sort multimodality machine learning approach to differentiate severe and nonsevere covid-19: model development and validation
publisher JMIR Publications
series Journal of Medical Internet Research
issn 1438-8871
publishDate 2021-04-01
description BackgroundEffectively and efficiently diagnosing patients who have COVID-19 with the accurate clinical type of the disease is essential to achieve optimal outcomes for the patients as well as to reduce the risk of overloading the health care system. Currently, severe and nonsevere COVID-19 types are differentiated by only a few features, which do not comprehensively characterize the complicated pathological, physiological, and immunological responses to SARS-CoV-2 infection in the different disease types. In addition, these type-defining features may not be readily testable at the time of diagnosis. ObjectiveIn this study, we aimed to use a machine learning approach to understand COVID-19 more comprehensively, accurately differentiate severe and nonsevere COVID-19 clinical types based on multiple medical features, and provide reliable predictions of the clinical type of the disease. MethodsFor this study, we recruited 214 confirmed patients with nonsevere COVID-19 and 148 patients with severe COVID-19. The clinical characteristics (26 features) and laboratory test results (26 features) upon admission were acquired as two input modalities. Exploratory analyses demonstrated that these features differed substantially between two clinical types. Machine learning random forest models based on all the features in each modality as well as on the top 5 features in each modality combined were developed and validated to differentiate COVID-19 clinical types. ResultsUsing clinical and laboratory results independently as input, the random forest models achieved >90% and >95% predictive accuracy, respectively. The importance scores of the input features were further evaluated, and the top 5 features from each modality were identified (age, hypertension, cardiovascular disease, gender, and diabetes for the clinical features modality, and dimerized plasmin fragment D, high sensitivity troponin I, absolute neutrophil count, interleukin 6, and lactate dehydrogenase for the laboratory testing modality, in descending order). Using these top 10 multimodal features as the only input instead of all 52 features combined, the random forest model was able to achieve 97% predictive accuracy. ConclusionsOur findings shed light on how the human body reacts to SARS-CoV-2 infection as a unit and provide insights on effectively evaluating the disease severity of patients with COVID-19 based on more common medical features when gold standard features are not available. We suggest that clinical information can be used as an initial screening tool for self-evaluation and triage, while laboratory test results should be applied when accuracy is the priority.
url https://www.jmir.org/2021/4/e23948
work_keys_str_mv AT chenyuanfang amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT ouyangliu amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT baoforrests amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT liqian amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT hanlei amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT zhanghengdong amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT zhubaoli amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT geyaorong amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT robinsonpatrick amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT xuming amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT liujie amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT chenshi amultimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT chenyuanfang multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT ouyangliu multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT baoforrests multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT liqian multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT hanlei multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT zhanghengdong multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT zhubaoli multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT geyaorong multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT robinsonpatrick multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT xuming multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT liujie multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
AT chenshi multimodalitymachinelearningapproachtodifferentiatesevereandnonseverecovid19modeldevelopmentandvalidation
_version_ 1721535958554247168