External Validation of Radiation-Induced Dyspnea Models on Esophageal Cancer Radiotherapy Patients

Purpose: Radiation-induced lung disease (RILD), defined as dyspnea in this study, is a risk for patients receiving high-dose thoracic irradiation. This study is a TRIPOD (Transparent Reporting of A Multivariable Prediction Model for Individual Prognosis or Diagnosis) Type 4 validation of previously-...

Full description

Bibliographic Details
Main Authors: Zhenwei Shi, Kieran G. Foley, Juan Pablo de Mey, Emiliano Spezi, Philip Whybra, Tom Crosby, Johan van Soest, Andre Dekker, Leonard Wee
Format: Article
Language:English
Published: Frontiers Media S.A. 2019-12-01
Series:Frontiers in Oncology
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fonc.2019.01411/full
id doaj-a392b54dbdf1462ba7b6d44ed27b064f
record_format Article
spelling doaj-a392b54dbdf1462ba7b6d44ed27b064f2020-11-25T02:17:54ZengFrontiers Media S.A.Frontiers in Oncology2234-943X2019-12-01910.3389/fonc.2019.01411493902External Validation of Radiation-Induced Dyspnea Models on Esophageal Cancer Radiotherapy PatientsZhenwei Shi0Kieran G. Foley1Juan Pablo de Mey2Emiliano Spezi3Philip Whybra4Tom Crosby5Johan van Soest6Andre Dekker7Leonard Wee8Department of Radiation Oncology (MAASTRO), GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre+, Maastricht, NetherlandsVelindre Cancer Centre, Cardiff, United KingdomFaculty of Health Medicine and Life Sciences (FHML), Maastricht University, Maastricht, NetherlandsSchool of Engineering, Cardiff University, Cardiff, United KingdomSchool of Engineering, Cardiff University, Cardiff, United KingdomVelindre Cancer Centre, Cardiff, United KingdomDepartment of Radiation Oncology (MAASTRO), GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre+, Maastricht, NetherlandsDepartment of Radiation Oncology (MAASTRO), GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre+, Maastricht, NetherlandsDepartment of Radiation Oncology (MAASTRO), GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre+, Maastricht, NetherlandsPurpose: Radiation-induced lung disease (RILD), defined as dyspnea in this study, is a risk for patients receiving high-dose thoracic irradiation. This study is a TRIPOD (Transparent Reporting of A Multivariable Prediction Model for Individual Prognosis or Diagnosis) Type 4 validation of previously-published dyspnea models via secondary analysis of esophageal cancer SCOPE1 trial data. We quantify the predictive performance of these two models for predicting the maximal dyspnea grade ≥ 2 within 6 months after the end of high-dose chemo-radiotherapy for primary esophageal cancer.Materials and methods: We tested the performance of two previously published dyspnea risk models using baseline, treatment and follow-up data on 258 esophageal cancer patients in the UK enrolled into the SCOPE1 multi-center trial. The tested models were developed from lung cancer patients treated at MAASTRO Clinic (The Netherlands) from the period 2002 to 2011. The adverse event of interest was dyspnea ≥ Grade 2 (CTCAE v3) within 6 months after the end of radiotherapy. As some variables were missing randomly and cannot be imputed, 212 patients in the SCOPE1 were used for validation of model 1 and 255 patients were used for validation of model 2. The model parameter Forced Expiratory Volume in 1 s (FEV1), as a predictor to both validated models, was imputed using the WHO performance status. External validation was performed using an automated, decentralized approach, without exchange of individual patient data.Results: Out of 258 patients with esophageal cancer in SCOPE1 trial data, 38 patients (14.7%) developed radiation-induced dyspnea (≥ Grade 2) within 6 months after chemo-radiotherapy. The discrimination performance of the models in esophageal cancer patients treated with high-dose external beam radiotherapy was moderate, area under curve (AUC) of 0.68 (95% CI 0.55–0.76) and 0.70 (95% CI 0.58–0.77), respectively. The curves and AUCs derived by distributed learning were identical to the results from validation on a local host.Conclusion: We have externally validated previously published dyspnea models using an esophageal cancer dataset. FEV1 that is not routinely measured for esophageal cancer was imputed using WHO performance status. Prediction performance was not statistically different from previous training and validation sets. Risk estimates were dominated by WHO score in Model 1 and baseline dyspnea in Model 2. The distributed learning approach gave the same answer as local processing, and could be performed without accessing a validation site's individual patients-level data.https://www.frontiersin.org/article/10.3389/fonc.2019.01411/fullradiation-induced dyspneaesophageal cancerchemo-radiotherapyprognostic modeldistributed learning
collection DOAJ
language English
format Article
sources DOAJ
author Zhenwei Shi
Kieran G. Foley
Juan Pablo de Mey
Emiliano Spezi
Philip Whybra
Tom Crosby
Johan van Soest
Andre Dekker
Leonard Wee
spellingShingle Zhenwei Shi
Kieran G. Foley
Juan Pablo de Mey
Emiliano Spezi
Philip Whybra
Tom Crosby
Johan van Soest
Andre Dekker
Leonard Wee
External Validation of Radiation-Induced Dyspnea Models on Esophageal Cancer Radiotherapy Patients
Frontiers in Oncology
radiation-induced dyspnea
esophageal cancer
chemo-radiotherapy
prognostic model
distributed learning
author_facet Zhenwei Shi
Kieran G. Foley
Juan Pablo de Mey
Emiliano Spezi
Philip Whybra
Tom Crosby
Johan van Soest
Andre Dekker
Leonard Wee
author_sort Zhenwei Shi
title External Validation of Radiation-Induced Dyspnea Models on Esophageal Cancer Radiotherapy Patients
title_short External Validation of Radiation-Induced Dyspnea Models on Esophageal Cancer Radiotherapy Patients
title_full External Validation of Radiation-Induced Dyspnea Models on Esophageal Cancer Radiotherapy Patients
title_fullStr External Validation of Radiation-Induced Dyspnea Models on Esophageal Cancer Radiotherapy Patients
title_full_unstemmed External Validation of Radiation-Induced Dyspnea Models on Esophageal Cancer Radiotherapy Patients
title_sort external validation of radiation-induced dyspnea models on esophageal cancer radiotherapy patients
publisher Frontiers Media S.A.
series Frontiers in Oncology
issn 2234-943X
publishDate 2019-12-01
description Purpose: Radiation-induced lung disease (RILD), defined as dyspnea in this study, is a risk for patients receiving high-dose thoracic irradiation. This study is a TRIPOD (Transparent Reporting of A Multivariable Prediction Model for Individual Prognosis or Diagnosis) Type 4 validation of previously-published dyspnea models via secondary analysis of esophageal cancer SCOPE1 trial data. We quantify the predictive performance of these two models for predicting the maximal dyspnea grade ≥ 2 within 6 months after the end of high-dose chemo-radiotherapy for primary esophageal cancer.Materials and methods: We tested the performance of two previously published dyspnea risk models using baseline, treatment and follow-up data on 258 esophageal cancer patients in the UK enrolled into the SCOPE1 multi-center trial. The tested models were developed from lung cancer patients treated at MAASTRO Clinic (The Netherlands) from the period 2002 to 2011. The adverse event of interest was dyspnea ≥ Grade 2 (CTCAE v3) within 6 months after the end of radiotherapy. As some variables were missing randomly and cannot be imputed, 212 patients in the SCOPE1 were used for validation of model 1 and 255 patients were used for validation of model 2. The model parameter Forced Expiratory Volume in 1 s (FEV1), as a predictor to both validated models, was imputed using the WHO performance status. External validation was performed using an automated, decentralized approach, without exchange of individual patient data.Results: Out of 258 patients with esophageal cancer in SCOPE1 trial data, 38 patients (14.7%) developed radiation-induced dyspnea (≥ Grade 2) within 6 months after chemo-radiotherapy. The discrimination performance of the models in esophageal cancer patients treated with high-dose external beam radiotherapy was moderate, area under curve (AUC) of 0.68 (95% CI 0.55–0.76) and 0.70 (95% CI 0.58–0.77), respectively. The curves and AUCs derived by distributed learning were identical to the results from validation on a local host.Conclusion: We have externally validated previously published dyspnea models using an esophageal cancer dataset. FEV1 that is not routinely measured for esophageal cancer was imputed using WHO performance status. Prediction performance was not statistically different from previous training and validation sets. Risk estimates were dominated by WHO score in Model 1 and baseline dyspnea in Model 2. The distributed learning approach gave the same answer as local processing, and could be performed without accessing a validation site's individual patients-level data.
topic radiation-induced dyspnea
esophageal cancer
chemo-radiotherapy
prognostic model
distributed learning
url https://www.frontiersin.org/article/10.3389/fonc.2019.01411/full
work_keys_str_mv AT zhenweishi externalvalidationofradiationinduceddyspneamodelsonesophagealcancerradiotherapypatients
AT kierangfoley externalvalidationofradiationinduceddyspneamodelsonesophagealcancerradiotherapypatients
AT juanpablodemey externalvalidationofradiationinduceddyspneamodelsonesophagealcancerradiotherapypatients
AT emilianospezi externalvalidationofradiationinduceddyspneamodelsonesophagealcancerradiotherapypatients
AT philipwhybra externalvalidationofradiationinduceddyspneamodelsonesophagealcancerradiotherapypatients
AT tomcrosby externalvalidationofradiationinduceddyspneamodelsonesophagealcancerradiotherapypatients
AT johanvansoest externalvalidationofradiationinduceddyspneamodelsonesophagealcancerradiotherapypatients
AT andredekker externalvalidationofradiationinduceddyspneamodelsonesophagealcancerradiotherapypatients
AT leonardwee externalvalidationofradiationinduceddyspneamodelsonesophagealcancerradiotherapypatients
_version_ 1724884395034148864