Contextual Prior Constrained Deep Networks for Mitosis Detection With Point Annotations

We study the problem of training an accurate deep learning mitosis detection model with only point annotations. To address this challenging label-efficient deep learning problem, we propose a novel contextual prior constraint mechanism and spatial area constrained loss to generate the reference grou...

Full description

Bibliographic Details
Main Authors: Jiangxiao Han, Xinggang Wang, Wenyu Liu
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9427540/
id doaj-d8310f2c6ab342eaa8b274f129cbd487
record_format Article
spelling doaj-d8310f2c6ab342eaa8b274f129cbd4872021-05-27T23:01:49ZengIEEEIEEE Access2169-35362021-01-019719547196710.1109/ACCESS.2021.30792159427540Contextual Prior Constrained Deep Networks for Mitosis Detection With Point AnnotationsJiangxiao Han0https://orcid.org/0000-0003-4362-4414Xinggang Wang1https://orcid.org/0000-0001-6732-7823Wenyu Liu2https://orcid.org/0000-0002-4582-7488School of Electronics Information and Communications, Huazhong University of Science and Technology, Wuhan, ChinaSchool of Electronics Information and Communications, Huazhong University of Science and Technology, Wuhan, ChinaSchool of Electronics Information and Communications, Huazhong University of Science and Technology, Wuhan, ChinaWe study the problem of training an accurate deep learning mitosis detection model with only point annotations. To address this challenging label-efficient deep learning problem, we propose a novel contextual prior constraint mechanism and spatial area constrained loss to generate the reference ground truth for segmentation and to restrain incorrectly predicted pixels, respectively. The spatial area constraint mechanism is not strictly cast at the pixel-level and restrains the mitosis and non-mitosis areas as positive/negative bags under the framework of multiple instance learning. The experimental results show that our contextual prior mechanism with PSPNet as the segmentation baseline achieves state-of-the-art performance with an F-score of 69.92%, 56.22%, and 85.29% on the mitosis detection task of AMIDA 2013, ICPR MITOSIS 2014, and point-annotated ICPR MITOSIS 2012, respectively. Especially, using our spatial area constraint mechanism and reference ground truth, the detection result on point-annotated ICPR MITOSIS 2012 even outperforms the result using the same backbone network with pixel-level annotations. The experimental results demonstrate the advancement and effectiveness of our proposed method. In addition, they indicate that our work can definitely improve the performance of mitosis detection on point-annotated datasets and be extended to other medical image analysis tasks with limited annotations.https://ieeexplore.ieee.org/document/9427540/Mitosis detectionimage semantic segmentationcontextual prior constraint mechanismspatial area constraintmultiple instance learning
collection DOAJ
language English
format Article
sources DOAJ
author Jiangxiao Han
Xinggang Wang
Wenyu Liu
spellingShingle Jiangxiao Han
Xinggang Wang
Wenyu Liu
Contextual Prior Constrained Deep Networks for Mitosis Detection With Point Annotations
IEEE Access
Mitosis detection
image semantic segmentation
contextual prior constraint mechanism
spatial area constraint
multiple instance learning
author_facet Jiangxiao Han
Xinggang Wang
Wenyu Liu
author_sort Jiangxiao Han
title Contextual Prior Constrained Deep Networks for Mitosis Detection With Point Annotations
title_short Contextual Prior Constrained Deep Networks for Mitosis Detection With Point Annotations
title_full Contextual Prior Constrained Deep Networks for Mitosis Detection With Point Annotations
title_fullStr Contextual Prior Constrained Deep Networks for Mitosis Detection With Point Annotations
title_full_unstemmed Contextual Prior Constrained Deep Networks for Mitosis Detection With Point Annotations
title_sort contextual prior constrained deep networks for mitosis detection with point annotations
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description We study the problem of training an accurate deep learning mitosis detection model with only point annotations. To address this challenging label-efficient deep learning problem, we propose a novel contextual prior constraint mechanism and spatial area constrained loss to generate the reference ground truth for segmentation and to restrain incorrectly predicted pixels, respectively. The spatial area constraint mechanism is not strictly cast at the pixel-level and restrains the mitosis and non-mitosis areas as positive/negative bags under the framework of multiple instance learning. The experimental results show that our contextual prior mechanism with PSPNet as the segmentation baseline achieves state-of-the-art performance with an F-score of 69.92%, 56.22%, and 85.29% on the mitosis detection task of AMIDA 2013, ICPR MITOSIS 2014, and point-annotated ICPR MITOSIS 2012, respectively. Especially, using our spatial area constraint mechanism and reference ground truth, the detection result on point-annotated ICPR MITOSIS 2012 even outperforms the result using the same backbone network with pixel-level annotations. The experimental results demonstrate the advancement and effectiveness of our proposed method. In addition, they indicate that our work can definitely improve the performance of mitosis detection on point-annotated datasets and be extended to other medical image analysis tasks with limited annotations.
topic Mitosis detection
image semantic segmentation
contextual prior constraint mechanism
spatial area constraint
multiple instance learning
url https://ieeexplore.ieee.org/document/9427540/
work_keys_str_mv AT jiangxiaohan contextualpriorconstraineddeepnetworksformitosisdetectionwithpointannotations
AT xinggangwang contextualpriorconstraineddeepnetworksformitosisdetectionwithpointannotations
AT wenyuliu contextualpriorconstraineddeepnetworksformitosisdetectionwithpointannotations
_version_ 1721425257253830656