Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation

Background and Objectives Deep neural networks recently become a popular tool in medical research to predict disease progression and unveil its underlying temporal phenotypes. While being well suited to study longitudinal clinical data and learn disease progression models, its application in clinica...

Full description

Bibliographic Details
Main Authors: Marcel Müller, Marta Gromicho, Mamede de Carvalho, Sara C. Madeira
Format: Article
Language:English
Published: Elsevier 2021-01-01
Series:Computer Methods and Programs in Biomedicine Update
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2666990021000173
id doaj-4b2a00b3f7654a6ba5bb7424e54dbcf6
record_format Article
spelling doaj-4b2a00b3f7654a6ba5bb7424e54dbcf62021-07-15T04:28:47ZengElsevierComputer Methods and Programs in Biomedicine Update2666-99002021-01-011100018Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanationMarcel Müller0Marta Gromicho1Mamede de Carvalho2Sara C. Madeira3Technische Universität Berlin and Telekom Innovation Laboratories, Berlin, GermanyInstituto de Medicina Molecular, Faculdade de Medicina, Universidade de Lisboa, Lisbon, PortugalInstituto de Medicina Molecular, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal; Department of Neurosciences and Mental Health, Centro Hospitalar Universitário de Lisboa-Norte, Lisbon, PortugalCorresponding author. LASIGE, Departamento de Informática, Faculdade de Ciências, Universidade de Lisboa, 1749-016 Lisboa, Portugal.; LASIGE, Faculdade de Ciências, Universidade de Lisboa, Lisbon, PortugalBackground and Objectives Deep neural networks recently become a popular tool in medical research to predict disease progression and unveil its underlying temporal phenotypes. While being well suited to study longitudinal clinical data and learn disease progression models, its application in clinical setting is challenged by the importance of model explainability. In this work, we integrate model learning using recurrent neural networks with deep model explanation using SHAP to study disease progression in Amyotrophic Lateral Sclerosis (ALS).Methods We propose and evaluate different deep neural networks to predict disease progression in a large cohort of Portuguese ALS patients. We learn models of disease progression targeting the prediction and explanation of respiratory decline to respiratory failure, as measured by clinical administration of non-invasive ventilation (NIV). Afterward, we explain the learnt models using SHAP and inspect the outcome with clinical researchers, targeting the identification of highly influencing features in model prediction, and putative features to be discarded in an augmented model, due to their small influence.Results When used to predict breathing capability of ALS patients in different time windows, our recurrent neural networks with LSTMs (Long Short-Term Memory) showed mean squared errors below 0.01 and 0.02 in train and test, respectively. This enables their effective use to predict the need for non-invasive ventilation, and potentially other clinically relevant endpoints, while providing clinical insights regarding disease progression to respiratory insufficiency. It was exciting to find that this study supports previous results showing that neck weakness is related to disease outcome and respiratory decline in ALS.Conclusions Our study to learn and explain a predictive model for ALS shows the potentialities of using deep learning from longitudinal clinical data together with deep model explanation to achieve accurate prognostic prediction and model interpretability, while drawing insights into disease progression and promoting personalized medicine.http://www.sciencedirect.com/science/article/pii/S2666990021000173Explainable modelsLongitudinal dataDisease progressionPrognostic predictionAmyotrophic lateral sclerosisALSFRS-R
collection DOAJ
language English
format Article
sources DOAJ
author Marcel Müller
Marta Gromicho
Mamede de Carvalho
Sara C. Madeira
spellingShingle Marcel Müller
Marta Gromicho
Mamede de Carvalho
Sara C. Madeira
Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation
Computer Methods and Programs in Biomedicine Update
Explainable models
Longitudinal data
Disease progression
Prognostic prediction
Amyotrophic lateral sclerosis
ALSFRS-R
author_facet Marcel Müller
Marta Gromicho
Mamede de Carvalho
Sara C. Madeira
author_sort Marcel Müller
title Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation
title_short Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation
title_full Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation
title_fullStr Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation
title_full_unstemmed Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation
title_sort explainable models of disease progression in als: learning from longitudinal clinical data with recurrent neural networks and deep model explanation
publisher Elsevier
series Computer Methods and Programs in Biomedicine Update
issn 2666-9900
publishDate 2021-01-01
description Background and Objectives Deep neural networks recently become a popular tool in medical research to predict disease progression and unveil its underlying temporal phenotypes. While being well suited to study longitudinal clinical data and learn disease progression models, its application in clinical setting is challenged by the importance of model explainability. In this work, we integrate model learning using recurrent neural networks with deep model explanation using SHAP to study disease progression in Amyotrophic Lateral Sclerosis (ALS).Methods We propose and evaluate different deep neural networks to predict disease progression in a large cohort of Portuguese ALS patients. We learn models of disease progression targeting the prediction and explanation of respiratory decline to respiratory failure, as measured by clinical administration of non-invasive ventilation (NIV). Afterward, we explain the learnt models using SHAP and inspect the outcome with clinical researchers, targeting the identification of highly influencing features in model prediction, and putative features to be discarded in an augmented model, due to their small influence.Results When used to predict breathing capability of ALS patients in different time windows, our recurrent neural networks with LSTMs (Long Short-Term Memory) showed mean squared errors below 0.01 and 0.02 in train and test, respectively. This enables their effective use to predict the need for non-invasive ventilation, and potentially other clinically relevant endpoints, while providing clinical insights regarding disease progression to respiratory insufficiency. It was exciting to find that this study supports previous results showing that neck weakness is related to disease outcome and respiratory decline in ALS.Conclusions Our study to learn and explain a predictive model for ALS shows the potentialities of using deep learning from longitudinal clinical data together with deep model explanation to achieve accurate prognostic prediction and model interpretability, while drawing insights into disease progression and promoting personalized medicine.
topic Explainable models
Longitudinal data
Disease progression
Prognostic prediction
Amyotrophic lateral sclerosis
ALSFRS-R
url http://www.sciencedirect.com/science/article/pii/S2666990021000173
work_keys_str_mv AT marcelmuller explainablemodelsofdiseaseprogressioninalslearningfromlongitudinalclinicaldatawithrecurrentneuralnetworksanddeepmodelexplanation
AT martagromicho explainablemodelsofdiseaseprogressioninalslearningfromlongitudinalclinicaldatawithrecurrentneuralnetworksanddeepmodelexplanation
AT mamededecarvalho explainablemodelsofdiseaseprogressioninalslearningfromlongitudinalclinicaldatawithrecurrentneuralnetworksanddeepmodelexplanation
AT saracmadeira explainablemodelsofdiseaseprogressioninalslearningfromlongitudinalclinicaldatawithrecurrentneuralnetworksanddeepmodelexplanation
_version_ 1721301866767187968