Application of Machine Learning Algorithms to Predict Central Lymph Node Metastasis in T1-T2, Non-invasive, and Clinically Node Negative Papillary Thyroid Carcinoma

Purpose: While there are no clear indications of whether central lymph node dissection is necessary in patients with T1-T2, non-invasive, clinically uninvolved central neck lymph nodes papillary thyroid carcinoma (PTC), this study seeks to develop and validate models for predicting the risk of centr...

Full description

Bibliographic Details
Main Authors: Jiang Zhu, Jinxin Zheng, Longfei Li, Rui Huang, Haoyu Ren, Denghui Wang, Zhijun Dai, Xinliang Su
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-03-01
Series:Frontiers in Medicine
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fmed.2021.635771/full
id doaj-46cc6d5a273e4a90a6b0d3b9895f59ee
record_format Article
spelling doaj-46cc6d5a273e4a90a6b0d3b9895f59ee2021-03-09T13:47:40ZengFrontiers Media S.A.Frontiers in Medicine2296-858X2021-03-01810.3389/fmed.2021.635771635771Application of Machine Learning Algorithms to Predict Central Lymph Node Metastasis in T1-T2, Non-invasive, and Clinically Node Negative Papillary Thyroid CarcinomaJiang Zhu0Jinxin Zheng1Longfei Li2Rui Huang3Haoyu Ren4Haoyu Ren5Denghui Wang6Zhijun Dai7Xinliang Su8Department of Endocrine and Breast Surgery, The First Affiliated Hospital of Chongqing Medical University, Chongqing, ChinaDepartment of Breast Surgery, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, ChinaDepartment of Health Statistics, School of Public Health, Chongqing Medical University, Chongqing, ChinaDepartment of Anesthesiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, ChinaDepartment of Endocrine and Breast Surgery, The First Affiliated Hospital of Chongqing Medical University, Chongqing, ChinaDepartment of General, Visceral, and Transplant Surgery, Ludwig-Maximilians-University, Munich, GermanyDepartment of Endocrine and Breast Surgery, The First Affiliated Hospital of Chongqing Medical University, Chongqing, ChinaDepartment of Breast Surgery, The First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou, ChinaDepartment of Endocrine and Breast Surgery, The First Affiliated Hospital of Chongqing Medical University, Chongqing, ChinaPurpose: While there are no clear indications of whether central lymph node dissection is necessary in patients with T1-T2, non-invasive, clinically uninvolved central neck lymph nodes papillary thyroid carcinoma (PTC), this study seeks to develop and validate models for predicting the risk of central lymph node metastasis (CLNM) in these patients based on machine learning algorithms.Methods: This is a retrospective study comprising 1,271 patients with T1-T2 stage, non-invasive, and clinically node negative (cN0) PTC who underwent surgery at the Department of Endocrine and Breast Surgery of The First Affiliated Hospital of Chongqing Medical University from February 1, 2016, to December 31, 2018. We applied six machine learning (ML) algorithms, including Logistic Regression (LR), Gradient Boosting Machine (GBM), Extreme Gradient Boosting (XGBoost), Random Forest (RF), Decision Tree (DT), and Neural Network (NNET), coupled with preoperative clinical characteristics and intraoperative information to develop prediction models for CLNM. Among all the samples, 70% were randomly selected to train the models while the remaining 30% were used for validation. Indices like the area under the receiver operating characteristic (AUROC), sensitivity, specificity, and accuracy were calculated to test the models' performance.Results: The results showed that ~51.3% (652 out of 1,271) of the patients had pN1 disease. In multivariate logistic regression analyses, gender, tumor size and location, multifocality, age, and Delphian lymph node status were all independent predictors of CLNM. In predicting CLNM, six ML algorithms posted AUROC of 0.70–0.75, with the extreme gradient boosting (XGBoost) model standing out, registering 0.75. Thus, we employed the best-performing ML algorithm model and uploaded the results to a self-made online risk calculator to estimate an individual's probability of CLNM (https://jin63.shinyapps.io/ML_CLNM/).Conclusions: With the incorporation of preoperative and intraoperative risk factors, ML algorithms can achieve acceptable prediction of CLNM with Xgboost model performing the best. Our online risk calculator based on ML algorithm may help determine the optimal extent of initial surgical treatment for patients with T1-T2 stage, non-invasive, and clinically node negative PTC.https://www.frontiersin.org/articles/10.3389/fmed.2021.635771/fullpapillary thyroid carcinomacentral lymph node metastasismachine learning algorithmslymph node dissectionsprediction model
collection DOAJ
language English
format Article
sources DOAJ
author Jiang Zhu
Jinxin Zheng
Longfei Li
Rui Huang
Haoyu Ren
Haoyu Ren
Denghui Wang
Zhijun Dai
Xinliang Su
spellingShingle Jiang Zhu
Jinxin Zheng
Longfei Li
Rui Huang
Haoyu Ren
Haoyu Ren
Denghui Wang
Zhijun Dai
Xinliang Su
Application of Machine Learning Algorithms to Predict Central Lymph Node Metastasis in T1-T2, Non-invasive, and Clinically Node Negative Papillary Thyroid Carcinoma
Frontiers in Medicine
papillary thyroid carcinoma
central lymph node metastasis
machine learning algorithms
lymph node dissections
prediction model
author_facet Jiang Zhu
Jinxin Zheng
Longfei Li
Rui Huang
Haoyu Ren
Haoyu Ren
Denghui Wang
Zhijun Dai
Xinliang Su
author_sort Jiang Zhu
title Application of Machine Learning Algorithms to Predict Central Lymph Node Metastasis in T1-T2, Non-invasive, and Clinically Node Negative Papillary Thyroid Carcinoma
title_short Application of Machine Learning Algorithms to Predict Central Lymph Node Metastasis in T1-T2, Non-invasive, and Clinically Node Negative Papillary Thyroid Carcinoma
title_full Application of Machine Learning Algorithms to Predict Central Lymph Node Metastasis in T1-T2, Non-invasive, and Clinically Node Negative Papillary Thyroid Carcinoma
title_fullStr Application of Machine Learning Algorithms to Predict Central Lymph Node Metastasis in T1-T2, Non-invasive, and Clinically Node Negative Papillary Thyroid Carcinoma
title_full_unstemmed Application of Machine Learning Algorithms to Predict Central Lymph Node Metastasis in T1-T2, Non-invasive, and Clinically Node Negative Papillary Thyroid Carcinoma
title_sort application of machine learning algorithms to predict central lymph node metastasis in t1-t2, non-invasive, and clinically node negative papillary thyroid carcinoma
publisher Frontiers Media S.A.
series Frontiers in Medicine
issn 2296-858X
publishDate 2021-03-01
description Purpose: While there are no clear indications of whether central lymph node dissection is necessary in patients with T1-T2, non-invasive, clinically uninvolved central neck lymph nodes papillary thyroid carcinoma (PTC), this study seeks to develop and validate models for predicting the risk of central lymph node metastasis (CLNM) in these patients based on machine learning algorithms.Methods: This is a retrospective study comprising 1,271 patients with T1-T2 stage, non-invasive, and clinically node negative (cN0) PTC who underwent surgery at the Department of Endocrine and Breast Surgery of The First Affiliated Hospital of Chongqing Medical University from February 1, 2016, to December 31, 2018. We applied six machine learning (ML) algorithms, including Logistic Regression (LR), Gradient Boosting Machine (GBM), Extreme Gradient Boosting (XGBoost), Random Forest (RF), Decision Tree (DT), and Neural Network (NNET), coupled with preoperative clinical characteristics and intraoperative information to develop prediction models for CLNM. Among all the samples, 70% were randomly selected to train the models while the remaining 30% were used for validation. Indices like the area under the receiver operating characteristic (AUROC), sensitivity, specificity, and accuracy were calculated to test the models' performance.Results: The results showed that ~51.3% (652 out of 1,271) of the patients had pN1 disease. In multivariate logistic regression analyses, gender, tumor size and location, multifocality, age, and Delphian lymph node status were all independent predictors of CLNM. In predicting CLNM, six ML algorithms posted AUROC of 0.70–0.75, with the extreme gradient boosting (XGBoost) model standing out, registering 0.75. Thus, we employed the best-performing ML algorithm model and uploaded the results to a self-made online risk calculator to estimate an individual's probability of CLNM (https://jin63.shinyapps.io/ML_CLNM/).Conclusions: With the incorporation of preoperative and intraoperative risk factors, ML algorithms can achieve acceptable prediction of CLNM with Xgboost model performing the best. Our online risk calculator based on ML algorithm may help determine the optimal extent of initial surgical treatment for patients with T1-T2 stage, non-invasive, and clinically node negative PTC.
topic papillary thyroid carcinoma
central lymph node metastasis
machine learning algorithms
lymph node dissections
prediction model
url https://www.frontiersin.org/articles/10.3389/fmed.2021.635771/full
work_keys_str_mv AT jiangzhu applicationofmachinelearningalgorithmstopredictcentrallymphnodemetastasisint1t2noninvasiveandclinicallynodenegativepapillarythyroidcarcinoma
AT jinxinzheng applicationofmachinelearningalgorithmstopredictcentrallymphnodemetastasisint1t2noninvasiveandclinicallynodenegativepapillarythyroidcarcinoma
AT longfeili applicationofmachinelearningalgorithmstopredictcentrallymphnodemetastasisint1t2noninvasiveandclinicallynodenegativepapillarythyroidcarcinoma
AT ruihuang applicationofmachinelearningalgorithmstopredictcentrallymphnodemetastasisint1t2noninvasiveandclinicallynodenegativepapillarythyroidcarcinoma
AT haoyuren applicationofmachinelearningalgorithmstopredictcentrallymphnodemetastasisint1t2noninvasiveandclinicallynodenegativepapillarythyroidcarcinoma
AT haoyuren applicationofmachinelearningalgorithmstopredictcentrallymphnodemetastasisint1t2noninvasiveandclinicallynodenegativepapillarythyroidcarcinoma
AT denghuiwang applicationofmachinelearningalgorithmstopredictcentrallymphnodemetastasisint1t2noninvasiveandclinicallynodenegativepapillarythyroidcarcinoma
AT zhijundai applicationofmachinelearningalgorithmstopredictcentrallymphnodemetastasisint1t2noninvasiveandclinicallynodenegativepapillarythyroidcarcinoma
AT xinliangsu applicationofmachinelearningalgorithmstopredictcentrallymphnodemetastasisint1t2noninvasiveandclinicallynodenegativepapillarythyroidcarcinoma
_version_ 1724227778096660480