Lessons Learned and New Challenges: Re-evaluation of End-User Assessment of a Skills-Based Training Program for Urology Trainees

Objectives: To re-assess the perceived benefit and relevance of simulation sessions to Victorian urology trainees and to identify areas for potential improvement. Subjects and methods: All trainees attending skills training sessions between 2011 and 2016 were asked to complete a structured questionn...

Full description

Bibliographic Details
Main Authors: Damian Flanders, Athina Pirpiris, Niall Corcoran, Robert Forsyth, Richard Grills
Format: Article
Language:English
Published: SAGE Publishing 2019-03-01
Series:Journal of Medical Education and Curricular Development
Online Access:https://doi.org/10.1177/2382120519834552
id doaj-8864bbfaefce499cb47d5b284d5f0d33
record_format Article
spelling doaj-8864bbfaefce499cb47d5b284d5f0d332020-11-25T02:59:01ZengSAGE PublishingJournal of Medical Education and Curricular Development2382-12052019-03-01610.1177/2382120519834552Lessons Learned and New Challenges: Re-evaluation of End-User Assessment of a Skills-Based Training Program for Urology TraineesDamian Flanders0Athina Pirpiris1Niall Corcoran2Robert Forsyth3Richard Grills4Department of Urological Surgery, University Hospital Geelong, Barwon Health, Geelong, VIC, AustraliaDepartment of Urological Surgery, University Hospital Geelong, Barwon Health, Geelong, VIC, AustraliaUrology Department, Frankston Hospital, Melbourne, VIC, AustraliaUrological Society of Australia and New Zealand, Sydney, NSW, AustraliaDepartment of Surgery, Deakin University, Geelong, VIC, AustraliaObjectives: To re-assess the perceived benefit and relevance of simulation sessions to Victorian urology trainees and to identify areas for potential improvement. Subjects and methods: All trainees attending skills training sessions between 2011 and 2016 were asked to complete a structured questionnaire at the completion of the session. The questionnaire included 11 topic areas ranging from the year of surgical training to degree of usefulness of the session, including several sections for free-text response to offer more detailed feedback. Sessions were examined both individually and collectively to assess end-user satisfaction with the structure and content of the program. Results: In total, 24 individual skills sessions were held over the 6-year period, with a total of 355 attendees. Of these, 331 attendees completed the majority of the questionnaire, a response rate of over 93%. Overall 88% of the surveyed attendees stated that they had both the support of their supervising consultant and the flexibility of workload to attend the session; 90% of trainees felt that there was adequate reading material provided prior to the skills session, an improvement from 76% in the previous study period; and 97% of those surveyed felt that the existing session structure was appropriate and the same proportion found the sessions both useful and interesting, compared with just 63% in the previous study period. Analysis of individual topics demonstrates some variability in outcome measures, but for nearly every assessed parameter, greater than 90% of participants agreed that the session fulfilled the expected criteria. New topics developed since the 2011 analysis, including renal transplant and vascular repair, also had high levels of satisfaction. The practical models used have been refined and achieved higher scores than those in the previous assessment period. Conclusion: The urology skills-based training program has been well received by the surveyed trainees and is now embedded and accepted as part of the Victorian training program. The format of the sessions has matured and the overall rating, both individually and collectively, was high. There has been a clear increase in satisfaction across most areas assessed when compared with previous feedback. Despite this, there remain areas that can be improved, such as the amount and quality of available equipment and the inclusion of video demonstrations of operative techniques.https://doi.org/10.1177/2382120519834552
collection DOAJ
language English
format Article
sources DOAJ
author Damian Flanders
Athina Pirpiris
Niall Corcoran
Robert Forsyth
Richard Grills
spellingShingle Damian Flanders
Athina Pirpiris
Niall Corcoran
Robert Forsyth
Richard Grills
Lessons Learned and New Challenges: Re-evaluation of End-User Assessment of a Skills-Based Training Program for Urology Trainees
Journal of Medical Education and Curricular Development
author_facet Damian Flanders
Athina Pirpiris
Niall Corcoran
Robert Forsyth
Richard Grills
author_sort Damian Flanders
title Lessons Learned and New Challenges: Re-evaluation of End-User Assessment of a Skills-Based Training Program for Urology Trainees
title_short Lessons Learned and New Challenges: Re-evaluation of End-User Assessment of a Skills-Based Training Program for Urology Trainees
title_full Lessons Learned and New Challenges: Re-evaluation of End-User Assessment of a Skills-Based Training Program for Urology Trainees
title_fullStr Lessons Learned and New Challenges: Re-evaluation of End-User Assessment of a Skills-Based Training Program for Urology Trainees
title_full_unstemmed Lessons Learned and New Challenges: Re-evaluation of End-User Assessment of a Skills-Based Training Program for Urology Trainees
title_sort lessons learned and new challenges: re-evaluation of end-user assessment of a skills-based training program for urology trainees
publisher SAGE Publishing
series Journal of Medical Education and Curricular Development
issn 2382-1205
publishDate 2019-03-01
description Objectives: To re-assess the perceived benefit and relevance of simulation sessions to Victorian urology trainees and to identify areas for potential improvement. Subjects and methods: All trainees attending skills training sessions between 2011 and 2016 were asked to complete a structured questionnaire at the completion of the session. The questionnaire included 11 topic areas ranging from the year of surgical training to degree of usefulness of the session, including several sections for free-text response to offer more detailed feedback. Sessions were examined both individually and collectively to assess end-user satisfaction with the structure and content of the program. Results: In total, 24 individual skills sessions were held over the 6-year period, with a total of 355 attendees. Of these, 331 attendees completed the majority of the questionnaire, a response rate of over 93%. Overall 88% of the surveyed attendees stated that they had both the support of their supervising consultant and the flexibility of workload to attend the session; 90% of trainees felt that there was adequate reading material provided prior to the skills session, an improvement from 76% in the previous study period; and 97% of those surveyed felt that the existing session structure was appropriate and the same proportion found the sessions both useful and interesting, compared with just 63% in the previous study period. Analysis of individual topics demonstrates some variability in outcome measures, but for nearly every assessed parameter, greater than 90% of participants agreed that the session fulfilled the expected criteria. New topics developed since the 2011 analysis, including renal transplant and vascular repair, also had high levels of satisfaction. The practical models used have been refined and achieved higher scores than those in the previous assessment period. Conclusion: The urology skills-based training program has been well received by the surveyed trainees and is now embedded and accepted as part of the Victorian training program. The format of the sessions has matured and the overall rating, both individually and collectively, was high. There has been a clear increase in satisfaction across most areas assessed when compared with previous feedback. Despite this, there remain areas that can be improved, such as the amount and quality of available equipment and the inclusion of video demonstrations of operative techniques.
url https://doi.org/10.1177/2382120519834552
work_keys_str_mv AT damianflanders lessonslearnedandnewchallengesreevaluationofenduserassessmentofaskillsbasedtrainingprogramforurologytrainees
AT athinapirpiris lessonslearnedandnewchallengesreevaluationofenduserassessmentofaskillsbasedtrainingprogramforurologytrainees
AT niallcorcoran lessonslearnedandnewchallengesreevaluationofenduserassessmentofaskillsbasedtrainingprogramforurologytrainees
AT robertforsyth lessonslearnedandnewchallengesreevaluationofenduserassessmentofaskillsbasedtrainingprogramforurologytrainees
AT richardgrills lessonslearnedandnewchallengesreevaluationofenduserassessmentofaskillsbasedtrainingprogramforurologytrainees
_version_ 1724704066376826880