Assessment of manual adjustment performed in clinical practice following deep learning contouring for head and neck organs at risk in radiotherapy
Background and purpose: Auto-contouring performance has been widely studied in development and commissioning studies in radiotherapy, and its impact on clinical workflow assessed in that context. This study aimed to evaluate the manual adjustment of auto-contouring in routine clinical practice and t...
Main Authors: | , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Elsevier
2020-10-01
|
Series: | Physics and Imaging in Radiation Oncology |
Subjects: | |
Online Access: | http://www.sciencedirect.com/science/article/pii/S2405631620300658 |
id |
doaj-9c94518f453c4d96aac97c57be684f06 |
---|---|
record_format |
Article |
spelling |
doaj-9c94518f453c4d96aac97c57be684f062020-12-19T05:09:22ZengElsevierPhysics and Imaging in Radiation Oncology2405-63162020-10-01165460Assessment of manual adjustment performed in clinical practice following deep learning contouring for head and neck organs at risk in radiotherapyCharlotte L. Brouwer0Djamal Boukerroui1Jorge Oliveira2Padraig Looney3Roel J.H.M. Steenbakkers4Johannes A. Langendijk5Stefan Both6Mark J. Gooding7University of Groningen, University Medical Center Groningen, Department of Radiation Oncology, Groningen, The Netherlands; Corresponding author at: Department of Radiation Oncology, University Medical Center Groningen, PO Box 30001, 9700 RB Groningen, The Netherlands.Mirada Medical Ltd., Oxford, United KingdomMirada Medical Ltd., Oxford, United KingdomMirada Medical Ltd., Oxford, United KingdomUniversity of Groningen, University Medical Center Groningen, Department of Radiation Oncology, Groningen, The NetherlandsUniversity of Groningen, University Medical Center Groningen, Department of Radiation Oncology, Groningen, The NetherlandsUniversity of Groningen, University Medical Center Groningen, Department of Radiation Oncology, Groningen, The NetherlandsMirada Medical Ltd., Oxford, United KingdomBackground and purpose: Auto-contouring performance has been widely studied in development and commissioning studies in radiotherapy, and its impact on clinical workflow assessed in that context. This study aimed to evaluate the manual adjustment of auto-contouring in routine clinical practice and to identify improvements regarding the auto-contouring model and clinical user interaction, to improve the efficiency of auto-contouring. Materials and methods: A total of 103 clinical head and neck cancer cases, contoured using a commercial deep-learning contouring system and subsequently checked and edited for clinical use were retrospectively taken from clinical data over a twelve-month period (April 2019–April 2020). The amount of adjustment performed was calculated, and all cases were registered to a common reference frame for assessment purposes. The median, 10th and 90th percentile of adjustment were calculated and displayed using 3D renderings of structures to visually assess systematic and random adjustment. Results were also compared to inter-observer variation reported previously. Assessment was performed for both the whole structures and for regional sub-structures, and according to the radiation therapy technologist (RTT) who edited the contour. Results: The median amount of adjustment was low for all structures (<2 mm), although large local adjustment was observed for some structures. The median was systematically greater or equal to zero, indicating that the auto-contouring tends to under-segment the desired contour. Conclusion: Auto-contouring performance assessment in routine clinical practice has identified systematic improvements required technically, but also highlighted the need for continued RTT training to ensure adherence to guidelines.http://www.sciencedirect.com/science/article/pii/S2405631620300658Automatic segmentationAuto-contouringDeep learningContour adjustmentHead and neck organs at riskRadiotherapy |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Charlotte L. Brouwer Djamal Boukerroui Jorge Oliveira Padraig Looney Roel J.H.M. Steenbakkers Johannes A. Langendijk Stefan Both Mark J. Gooding |
spellingShingle |
Charlotte L. Brouwer Djamal Boukerroui Jorge Oliveira Padraig Looney Roel J.H.M. Steenbakkers Johannes A. Langendijk Stefan Both Mark J. Gooding Assessment of manual adjustment performed in clinical practice following deep learning contouring for head and neck organs at risk in radiotherapy Physics and Imaging in Radiation Oncology Automatic segmentation Auto-contouring Deep learning Contour adjustment Head and neck organs at risk Radiotherapy |
author_facet |
Charlotte L. Brouwer Djamal Boukerroui Jorge Oliveira Padraig Looney Roel J.H.M. Steenbakkers Johannes A. Langendijk Stefan Both Mark J. Gooding |
author_sort |
Charlotte L. Brouwer |
title |
Assessment of manual adjustment performed in clinical practice following deep learning contouring for head and neck organs at risk in radiotherapy |
title_short |
Assessment of manual adjustment performed in clinical practice following deep learning contouring for head and neck organs at risk in radiotherapy |
title_full |
Assessment of manual adjustment performed in clinical practice following deep learning contouring for head and neck organs at risk in radiotherapy |
title_fullStr |
Assessment of manual adjustment performed in clinical practice following deep learning contouring for head and neck organs at risk in radiotherapy |
title_full_unstemmed |
Assessment of manual adjustment performed in clinical practice following deep learning contouring for head and neck organs at risk in radiotherapy |
title_sort |
assessment of manual adjustment performed in clinical practice following deep learning contouring for head and neck organs at risk in radiotherapy |
publisher |
Elsevier |
series |
Physics and Imaging in Radiation Oncology |
issn |
2405-6316 |
publishDate |
2020-10-01 |
description |
Background and purpose: Auto-contouring performance has been widely studied in development and commissioning studies in radiotherapy, and its impact on clinical workflow assessed in that context. This study aimed to evaluate the manual adjustment of auto-contouring in routine clinical practice and to identify improvements regarding the auto-contouring model and clinical user interaction, to improve the efficiency of auto-contouring. Materials and methods: A total of 103 clinical head and neck cancer cases, contoured using a commercial deep-learning contouring system and subsequently checked and edited for clinical use were retrospectively taken from clinical data over a twelve-month period (April 2019–April 2020). The amount of adjustment performed was calculated, and all cases were registered to a common reference frame for assessment purposes. The median, 10th and 90th percentile of adjustment were calculated and displayed using 3D renderings of structures to visually assess systematic and random adjustment. Results were also compared to inter-observer variation reported previously. Assessment was performed for both the whole structures and for regional sub-structures, and according to the radiation therapy technologist (RTT) who edited the contour. Results: The median amount of adjustment was low for all structures (<2 mm), although large local adjustment was observed for some structures. The median was systematically greater or equal to zero, indicating that the auto-contouring tends to under-segment the desired contour. Conclusion: Auto-contouring performance assessment in routine clinical practice has identified systematic improvements required technically, but also highlighted the need for continued RTT training to ensure adherence to guidelines. |
topic |
Automatic segmentation Auto-contouring Deep learning Contour adjustment Head and neck organs at risk Radiotherapy |
url |
http://www.sciencedirect.com/science/article/pii/S2405631620300658 |
work_keys_str_mv |
AT charlottelbrouwer assessmentofmanualadjustmentperformedinclinicalpracticefollowingdeeplearningcontouringforheadandneckorgansatriskinradiotherapy AT djamalboukerroui assessmentofmanualadjustmentperformedinclinicalpracticefollowingdeeplearningcontouringforheadandneckorgansatriskinradiotherapy AT jorgeoliveira assessmentofmanualadjustmentperformedinclinicalpracticefollowingdeeplearningcontouringforheadandneckorgansatriskinradiotherapy AT padraiglooney assessmentofmanualadjustmentperformedinclinicalpracticefollowingdeeplearningcontouringforheadandneckorgansatriskinradiotherapy AT roeljhmsteenbakkers assessmentofmanualadjustmentperformedinclinicalpracticefollowingdeeplearningcontouringforheadandneckorgansatriskinradiotherapy AT johannesalangendijk assessmentofmanualadjustmentperformedinclinicalpracticefollowingdeeplearningcontouringforheadandneckorgansatriskinradiotherapy AT stefanboth assessmentofmanualadjustmentperformedinclinicalpracticefollowingdeeplearningcontouringforheadandneckorgansatriskinradiotherapy AT markjgooding assessmentofmanualadjustmentperformedinclinicalpracticefollowingdeeplearningcontouringforheadandneckorgansatriskinradiotherapy |
_version_ |
1724377669709070336 |