Artificial Intelligence‐Supported Video Analysis as a Means to Assess the Impact of DROP‐IN Image Guidance on Robotic Surgeons: Radioguided Sentinel Lymph Node versus PSMA‐Targeted Prostate Cancer Surgery

The introduction of the tethered DROP‐IN gamma probe has enabled targeted robot‐assisted radioguided prostate cancer (PCa) resection of pelvic sentinel lymph nodes (SLNs) and prostate‐specific membrane antigen (PSMA)‐positive lesions. While both procedures use 99mTc‐isotopes, the two vary in signal...

Full description

Bibliographic Details
Published in:Advanced Intelligent Systems
Main Authors: Samaneh Azargoshasb, Hilda A. de Barros, Daphne D.D. Rietbergen, Paolo Dell’Oglio, Pim J. van Leeuwen, Christian Wagner, Phillip Stricker, Sergi Vidal-Sicart, Alberto Briganti, Tobias Maurer, Henk G. van der Poel, Matthias N. van Oosterom, Fijs W. B. van Leeuwen
Format: Article
Language:English
Published: Wiley 2023-10-01
Subjects:
Online Access:https://doi.org/10.1002/aisy.202300192
_version_ 1849880893978574848
author Samaneh Azargoshasb
Hilda A. de Barros
Daphne D.D. Rietbergen
Paolo Dell’Oglio
Pim J. van Leeuwen
Christian Wagner
Phillip Stricker
Sergi Vidal-Sicart
Alberto Briganti
Tobias Maurer
Henk G. van der Poel
Matthias N. van Oosterom
Fijs W. B. van Leeuwen
author_facet Samaneh Azargoshasb
Hilda A. de Barros
Daphne D.D. Rietbergen
Paolo Dell’Oglio
Pim J. van Leeuwen
Christian Wagner
Phillip Stricker
Sergi Vidal-Sicart
Alberto Briganti
Tobias Maurer
Henk G. van der Poel
Matthias N. van Oosterom
Fijs W. B. van Leeuwen
author_sort Samaneh Azargoshasb
collection DOAJ
container_title Advanced Intelligent Systems
description The introduction of the tethered DROP‐IN gamma probe has enabled targeted robot‐assisted radioguided prostate cancer (PCa) resection of pelvic sentinel lymph nodes (SLNs) and prostate‐specific membrane antigen (PSMA)‐positive lesions. While both procedures use 99mTc‐isotopes, the two vary in signal and background intensity. To understand how the different levels of image guidance impact surgical decision‐making, computer‐vision algorithms are used to extract the DROP‐IN probe kinematic form clinical videos. 44 PCa patients undergo SLN (25) and PSMA‐targeted (19) resections. PSMA‐PET/CT and SPECT/CT create preoperative roadmaps, and intraoperative probe signal intensities are recorded. Using neural network‐based software, probe trajectories are extracted from videos to extract multiparametric kinematics and generate decision‐making and dexterity scores. PSMA‐targeted resections yield significantly lower nodal signal intensities in preoperative SPECT‐CT scans (three‐fold; p = 0.01), intraoperative probe readouts (eight‐fold; p < 0.001), and signal‐to‐background ratios (SBR; two‐fold; p < 0.001). Kinematics assessment reveal that the challenges encounter during PSMA‐targeted procedures converted to longer target identification times and increase in probe pick‐ups (both five‐fold; p < 0.001). This results in a fourfold reduction in the decision‐making score (p < 0.001). Reduced signal intensities and intraoperative SBR values negatively affect the impact that image‐guided surgery strategies have on the surgical decision‐making process.
format Article
id doaj-art-9a367295c02c4eeaa0c9cccf49ecaaa2
institution Directory of Open Access Journals
issn 2640-4567
language English
publishDate 2023-10-01
publisher Wiley
record_format Article
spelling doaj-art-9a367295c02c4eeaa0c9cccf49ecaaa22025-08-20T01:09:29ZengWileyAdvanced Intelligent Systems2640-45672023-10-01510n/an/a10.1002/aisy.202300192Artificial Intelligence‐Supported Video Analysis as a Means to Assess the Impact of DROP‐IN Image Guidance on Robotic Surgeons: Radioguided Sentinel Lymph Node versus PSMA‐Targeted Prostate Cancer SurgerySamaneh Azargoshasb0Hilda A. de Barros1Daphne D.D. Rietbergen2Paolo Dell’Oglio3Pim J. van Leeuwen4Christian Wagner5Phillip Stricker6Sergi Vidal-Sicart7Alberto Briganti8Tobias Maurer9Henk G. van der Poel10Matthias N. van Oosterom11Fijs W. B. van Leeuwen12Interventional Molecular Imaging-Laboratory Department of Radiology Leiden University Medical Center Leiden 2333 ZA The NetherlandsDepartment of Urology Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital Amsterdam 1066 CX The NetherlandsInterventional Molecular Imaging-Laboratory Department of Radiology Leiden University Medical Center Leiden 2333 ZA The NetherlandsInterventional Molecular Imaging-Laboratory Department of Radiology Leiden University Medical Center Leiden 2333 ZA The NetherlandsDepartment of Urology Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital Amsterdam 1066 CX The NetherlandsDepartment of Urology, Pediatric Urology and Urologic Oncology St. Antonius-Hospital Gronau Gronau 48599 GermanyDepartment of Urology St. Vincents Hospital St. Vincent's Prostate Cancer Research Centre Sydney NSW AustraliaNuclear Medicine Department Hospital Clinic Barcelona Institut d’Investigació Biomèdica August Pi I Sunyer (IDIBAPS) Barcelona SpainDepartment of Urology University Vita-Salute, San Raffaele Scientific Institute Milan 20132 ItalyMartini-Klinik Prostate Cancer Center University Hospital Hamburg-Eppendorf Hamburg 20251 GermanyDepartment of Urology Netherlands Cancer Institute-Antoni van Leeuwenhoek Hospital Amsterdam 1066 CX The NetherlandsInterventional Molecular Imaging-Laboratory Department of Radiology Leiden University Medical Center Leiden 2333 ZA The NetherlandsInterventional Molecular Imaging-Laboratory Department of Radiology Leiden University Medical Center Leiden 2333 ZA The NetherlandsThe introduction of the tethered DROP‐IN gamma probe has enabled targeted robot‐assisted radioguided prostate cancer (PCa) resection of pelvic sentinel lymph nodes (SLNs) and prostate‐specific membrane antigen (PSMA)‐positive lesions. While both procedures use 99mTc‐isotopes, the two vary in signal and background intensity. To understand how the different levels of image guidance impact surgical decision‐making, computer‐vision algorithms are used to extract the DROP‐IN probe kinematic form clinical videos. 44 PCa patients undergo SLN (25) and PSMA‐targeted (19) resections. PSMA‐PET/CT and SPECT/CT create preoperative roadmaps, and intraoperative probe signal intensities are recorded. Using neural network‐based software, probe trajectories are extracted from videos to extract multiparametric kinematics and generate decision‐making and dexterity scores. PSMA‐targeted resections yield significantly lower nodal signal intensities in preoperative SPECT‐CT scans (three‐fold; p = 0.01), intraoperative probe readouts (eight‐fold; p < 0.001), and signal‐to‐background ratios (SBR; two‐fold; p < 0.001). Kinematics assessment reveal that the challenges encounter during PSMA‐targeted procedures converted to longer target identification times and increase in probe pick‐ups (both five‐fold; p < 0.001). This results in a fourfold reduction in the decision‐making score (p < 0.001). Reduced signal intensities and intraoperative SBR values negatively affect the impact that image‐guided surgery strategies have on the surgical decision‐making process.https://doi.org/10.1002/aisy.202300192artificial intelligenceimage-guided surgeryprostate cancerrobot-assisted surgerysentinel nodes
spellingShingle Samaneh Azargoshasb
Hilda A. de Barros
Daphne D.D. Rietbergen
Paolo Dell’Oglio
Pim J. van Leeuwen
Christian Wagner
Phillip Stricker
Sergi Vidal-Sicart
Alberto Briganti
Tobias Maurer
Henk G. van der Poel
Matthias N. van Oosterom
Fijs W. B. van Leeuwen
Artificial Intelligence‐Supported Video Analysis as a Means to Assess the Impact of DROP‐IN Image Guidance on Robotic Surgeons: Radioguided Sentinel Lymph Node versus PSMA‐Targeted Prostate Cancer Surgery
artificial intelligence
image-guided surgery
prostate cancer
robot-assisted surgery
sentinel nodes
title Artificial Intelligence‐Supported Video Analysis as a Means to Assess the Impact of DROP‐IN Image Guidance on Robotic Surgeons: Radioguided Sentinel Lymph Node versus PSMA‐Targeted Prostate Cancer Surgery
title_full Artificial Intelligence‐Supported Video Analysis as a Means to Assess the Impact of DROP‐IN Image Guidance on Robotic Surgeons: Radioguided Sentinel Lymph Node versus PSMA‐Targeted Prostate Cancer Surgery
title_fullStr Artificial Intelligence‐Supported Video Analysis as a Means to Assess the Impact of DROP‐IN Image Guidance on Robotic Surgeons: Radioguided Sentinel Lymph Node versus PSMA‐Targeted Prostate Cancer Surgery
title_full_unstemmed Artificial Intelligence‐Supported Video Analysis as a Means to Assess the Impact of DROP‐IN Image Guidance on Robotic Surgeons: Radioguided Sentinel Lymph Node versus PSMA‐Targeted Prostate Cancer Surgery
title_short Artificial Intelligence‐Supported Video Analysis as a Means to Assess the Impact of DROP‐IN Image Guidance on Robotic Surgeons: Radioguided Sentinel Lymph Node versus PSMA‐Targeted Prostate Cancer Surgery
title_sort artificial intelligence supported video analysis as a means to assess the impact of drop in image guidance on robotic surgeons radioguided sentinel lymph node versus psma targeted prostate cancer surgery
topic artificial intelligence
image-guided surgery
prostate cancer
robot-assisted surgery
sentinel nodes
url https://doi.org/10.1002/aisy.202300192
work_keys_str_mv AT samanehazargoshasb artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT hildaadebarros artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT daphneddrietbergen artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT paolodelloglio artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT pimjvanleeuwen artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT christianwagner artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT phillipstricker artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT sergividalsicart artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT albertobriganti artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT tobiasmaurer artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT henkgvanderpoel artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT matthiasnvanoosterom artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery
AT fijswbvanleeuwen artificialintelligencesupportedvideoanalysisasameanstoassesstheimpactofdropinimageguidanceonroboticsurgeonsradioguidedsentinellymphnodeversuspsmatargetedprostatecancersurgery