Robust Resolution-Enhanced Prostate Segmentation in Magnetic Resonance and Ultrasound Images through Convolutional Neural Networks
Prostate segmentations are required for an ever-increasing number of medical applications, such as image-based lesion detection, fusion-guided biopsy and focal therapies. However, obtaining accurate segmentations is laborious, requires expertise and, even then, the inter-observer variability remains...
Main Authors: | , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-01-01
|
Series: | Applied Sciences |
Subjects: | |
Online Access: | https://www.mdpi.com/2076-3417/11/2/844 |
id |
doaj-15f6d64aef814c23aab4ce3bce9b7aea |
---|---|
record_format |
Article |
spelling |
doaj-15f6d64aef814c23aab4ce3bce9b7aea2021-01-19T00:01:49ZengMDPI AGApplied Sciences2076-34172021-01-011184484410.3390/app11020844Robust Resolution-Enhanced Prostate Segmentation in Magnetic Resonance and Ultrasound Images through Convolutional Neural NetworksOscar J. Pellicer-Valero0Victor Gonzalez-Perez1Juan Luis Casanova Ramón-Borja2Isabel Martín García3María Barrios Benito4Paula Pelechano Gómez5José Rubio-Briones6María José Rupérez7José D. Martín-Guerrero8Intelligent Data Analysis Laboratory, Department of Electronic Engineering, ETSE (Engineering School), Universitat de València (UV), Av. Universitat, sn, 46100 Bujassot, Valencia, SpainDepartment of Radiodiagnosis, Fundación Instituto Valenciano de Oncología (FIVO), Beltrán Báguena, 8, 46009 Valencia, SpainDepartment of Urology, Fundación Instituto Valenciano de Oncología (FIVO), Beltrán Báguena, 8, 46009 Valencia, SpainDepartment of Radiodiagnosis, Fundación Instituto Valenciano de Oncología (FIVO), Beltrán Báguena, 8, 46009 Valencia, SpainDepartment of Radiodiagnosis, Fundación Instituto Valenciano de Oncología (FIVO), Beltrán Báguena, 8, 46009 Valencia, SpainDepartment of Radiodiagnosis, Fundación Instituto Valenciano de Oncología (FIVO), Beltrán Báguena, 8, 46009 Valencia, SpainDepartment of Urology, Fundación Instituto Valenciano de Oncología (FIVO), Beltrán Báguena, 8, 46009 Valencia, SpainCentro de Investigación en Ingeniería Mecánica (CIIM), Universitat Politècnica de València (UPV), Camino de Vera, sn, 46022 Valencia, SpainIntelligent Data Analysis Laboratory, Department of Electronic Engineering, ETSE (Engineering School), Universitat de València (UV), Av. Universitat, sn, 46100 Bujassot, Valencia, SpainProstate segmentations are required for an ever-increasing number of medical applications, such as image-based lesion detection, fusion-guided biopsy and focal therapies. However, obtaining accurate segmentations is laborious, requires expertise and, even then, the inter-observer variability remains high. In this paper, a robust, accurate and generalizable model for Magnetic Resonance (MR) and three-dimensional (3D) Ultrasound (US) prostate image segmentation is proposed. It uses a densenet-resnet-based Convolutional Neural Network (CNN) combined with techniques such as deep supervision, checkpoint ensembling and Neural Resolution Enhancement. The MR prostate segmentation model was trained with five challenging and heterogeneous MR prostate datasets (and two US datasets), with segmentations from many different experts with varying segmentation criteria. The model achieves a consistently strong performance in all datasets independently (mean Dice Similarity Coefficient -<i>DSC</i>- above 0.91 for all datasets except for one), outperforming the inter-expert variability significantly in MR (mean <i>DSC</i> of 0.9099 vs. 0.8794). When evaluated on the publicly available Promise12 challenge dataset, it attains a similar performance to the best entries. In summary, the model has the potential of having a significant impact on current prostate procedures, undercutting, and even eliminating, the need of manual segmentations through improvements in terms of robustness, generalizability and output resolution.https://www.mdpi.com/2076-3417/11/2/844MR prostate imagingUS prostate imagingconvolutional neural networkprostate segmentationneural resolution enhancement |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Oscar J. Pellicer-Valero Victor Gonzalez-Perez Juan Luis Casanova Ramón-Borja Isabel Martín García María Barrios Benito Paula Pelechano Gómez José Rubio-Briones María José Rupérez José D. Martín-Guerrero |
spellingShingle |
Oscar J. Pellicer-Valero Victor Gonzalez-Perez Juan Luis Casanova Ramón-Borja Isabel Martín García María Barrios Benito Paula Pelechano Gómez José Rubio-Briones María José Rupérez José D. Martín-Guerrero Robust Resolution-Enhanced Prostate Segmentation in Magnetic Resonance and Ultrasound Images through Convolutional Neural Networks Applied Sciences MR prostate imaging US prostate imaging convolutional neural network prostate segmentation neural resolution enhancement |
author_facet |
Oscar J. Pellicer-Valero Victor Gonzalez-Perez Juan Luis Casanova Ramón-Borja Isabel Martín García María Barrios Benito Paula Pelechano Gómez José Rubio-Briones María José Rupérez José D. Martín-Guerrero |
author_sort |
Oscar J. Pellicer-Valero |
title |
Robust Resolution-Enhanced Prostate Segmentation in Magnetic Resonance and Ultrasound Images through Convolutional Neural Networks |
title_short |
Robust Resolution-Enhanced Prostate Segmentation in Magnetic Resonance and Ultrasound Images through Convolutional Neural Networks |
title_full |
Robust Resolution-Enhanced Prostate Segmentation in Magnetic Resonance and Ultrasound Images through Convolutional Neural Networks |
title_fullStr |
Robust Resolution-Enhanced Prostate Segmentation in Magnetic Resonance and Ultrasound Images through Convolutional Neural Networks |
title_full_unstemmed |
Robust Resolution-Enhanced Prostate Segmentation in Magnetic Resonance and Ultrasound Images through Convolutional Neural Networks |
title_sort |
robust resolution-enhanced prostate segmentation in magnetic resonance and ultrasound images through convolutional neural networks |
publisher |
MDPI AG |
series |
Applied Sciences |
issn |
2076-3417 |
publishDate |
2021-01-01 |
description |
Prostate segmentations are required for an ever-increasing number of medical applications, such as image-based lesion detection, fusion-guided biopsy and focal therapies. However, obtaining accurate segmentations is laborious, requires expertise and, even then, the inter-observer variability remains high. In this paper, a robust, accurate and generalizable model for Magnetic Resonance (MR) and three-dimensional (3D) Ultrasound (US) prostate image segmentation is proposed. It uses a densenet-resnet-based Convolutional Neural Network (CNN) combined with techniques such as deep supervision, checkpoint ensembling and Neural Resolution Enhancement. The MR prostate segmentation model was trained with five challenging and heterogeneous MR prostate datasets (and two US datasets), with segmentations from many different experts with varying segmentation criteria. The model achieves a consistently strong performance in all datasets independently (mean Dice Similarity Coefficient -<i>DSC</i>- above 0.91 for all datasets except for one), outperforming the inter-expert variability significantly in MR (mean <i>DSC</i> of 0.9099 vs. 0.8794). When evaluated on the publicly available Promise12 challenge dataset, it attains a similar performance to the best entries. In summary, the model has the potential of having a significant impact on current prostate procedures, undercutting, and even eliminating, the need of manual segmentations through improvements in terms of robustness, generalizability and output resolution. |
topic |
MR prostate imaging US prostate imaging convolutional neural network prostate segmentation neural resolution enhancement |
url |
https://www.mdpi.com/2076-3417/11/2/844 |
work_keys_str_mv |
AT oscarjpellicervalero robustresolutionenhancedprostatesegmentationinmagneticresonanceandultrasoundimagesthroughconvolutionalneuralnetworks AT victorgonzalezperez robustresolutionenhancedprostatesegmentationinmagneticresonanceandultrasoundimagesthroughconvolutionalneuralnetworks AT juanluiscasanovaramonborja robustresolutionenhancedprostatesegmentationinmagneticresonanceandultrasoundimagesthroughconvolutionalneuralnetworks AT isabelmartingarcia robustresolutionenhancedprostatesegmentationinmagneticresonanceandultrasoundimagesthroughconvolutionalneuralnetworks AT mariabarriosbenito robustresolutionenhancedprostatesegmentationinmagneticresonanceandultrasoundimagesthroughconvolutionalneuralnetworks AT paulapelechanogomez robustresolutionenhancedprostatesegmentationinmagneticresonanceandultrasoundimagesthroughconvolutionalneuralnetworks AT joserubiobriones robustresolutionenhancedprostatesegmentationinmagneticresonanceandultrasoundimagesthroughconvolutionalneuralnetworks AT mariajoseruperez robustresolutionenhancedprostatesegmentationinmagneticresonanceandultrasoundimagesthroughconvolutionalneuralnetworks AT josedmartinguerrero robustresolutionenhancedprostatesegmentationinmagneticresonanceandultrasoundimagesthroughconvolutionalneuralnetworks |
_version_ |
1724332792050876416 |