Comparison of video-based observation and direct observation for assessing the operative performance of residents undergoing phacoemulsification training

Purpose: To compare the video observation of procedural skills (VOPS) method with the direct observation of procedural skills (DOPS) method in the assessment of senior residents' performance utilizing the International Council of Ophthalmology's Ophthalmology Surgical Competency Assessment...

Full description

Bibliographic Details
Main Authors: Leila Ghiasian, Ali Hadavandkhani, Parya Abdolalizadeh, Leila Janani, Acieh Es'haghi
Format: Article
Language:English
Published: Wolters Kluwer Medknow Publications 2021-01-01
Series:Indian Journal of Ophthalmology
Subjects:
Online Access:http://www.ijo.in/article.asp?issn=0301-4738;year=2021;volume=69;issue=3;spage=574;epage=578;aulast=Ghiasian
id doaj-c5b2f6bb53e2492294724c329d70ffe8
record_format Article
spelling doaj-c5b2f6bb53e2492294724c329d70ffe82021-03-31T06:16:23ZengWolters Kluwer Medknow PublicationsIndian Journal of Ophthalmology0301-47381998-36892021-01-0169357457810.4103/ijo.IJO_1166_20Comparison of video-based observation and direct observation for assessing the operative performance of residents undergoing phacoemulsification trainingLeila GhiasianAli HadavandkhaniParya AbdolalizadehLeila JananiAcieh Es'haghiPurpose: To compare the video observation of procedural skills (VOPS) method with the direct observation of procedural skills (DOPS) method in the assessment of senior residents' performance utilizing the International Council of Ophthalmology's Ophthalmology Surgical Competency Assessment Rubric for phacoemulsification (ICO-OSCAR; phaco). Methods: This is a prospective comparative study conducted at a university-affiliated hospital. Six ophthalmology residents of postgraduate year 4 participated. Their performance in phacoemulsification was rated via DOPS and later in a masked manner through VOPS by a single faculty assessor. Results: Seventy-one surgeries were evaluated. There were no statistically significant differences between the scores of VOPS and DOPS regarding all ICO-OSCAR indices except “instrument insertion into the eye” in which DOPS had higher scores (P = 0.035). A significant correlation was observed in total scores of “task-specific” (r = 0.64, P < 0.001) and “global” (r = 0.38, P = 0.003) indices between VOPS and DOPS while some subscales did not show a correlation between the two methods of assessment. The Bland-Altman analysis demonstrated that nearly all data points of total “task-specific” and “global” scores fell within the 95% limits of agreement ([-5.84, 6.87] and [-4.78, 4.86], respectively). Conclusion: This study demonstrated that VOPS holds promise for a general rating of residents' performance.http://www.ijo.in/article.asp?issn=0301-4738;year=2021;volume=69;issue=3;spage=574;epage=578;aulast=Ghiasiandirect observationophthalmologyphacoemulsificationresidentsvideo observation
collection DOAJ
language English
format Article
sources DOAJ
author Leila Ghiasian
Ali Hadavandkhani
Parya Abdolalizadeh
Leila Janani
Acieh Es'haghi
spellingShingle Leila Ghiasian
Ali Hadavandkhani
Parya Abdolalizadeh
Leila Janani
Acieh Es'haghi
Comparison of video-based observation and direct observation for assessing the operative performance of residents undergoing phacoemulsification training
Indian Journal of Ophthalmology
direct observation
ophthalmology
phacoemulsification
residents
video observation
author_facet Leila Ghiasian
Ali Hadavandkhani
Parya Abdolalizadeh
Leila Janani
Acieh Es'haghi
author_sort Leila Ghiasian
title Comparison of video-based observation and direct observation for assessing the operative performance of residents undergoing phacoemulsification training
title_short Comparison of video-based observation and direct observation for assessing the operative performance of residents undergoing phacoemulsification training
title_full Comparison of video-based observation and direct observation for assessing the operative performance of residents undergoing phacoemulsification training
title_fullStr Comparison of video-based observation and direct observation for assessing the operative performance of residents undergoing phacoemulsification training
title_full_unstemmed Comparison of video-based observation and direct observation for assessing the operative performance of residents undergoing phacoemulsification training
title_sort comparison of video-based observation and direct observation for assessing the operative performance of residents undergoing phacoemulsification training
publisher Wolters Kluwer Medknow Publications
series Indian Journal of Ophthalmology
issn 0301-4738
1998-3689
publishDate 2021-01-01
description Purpose: To compare the video observation of procedural skills (VOPS) method with the direct observation of procedural skills (DOPS) method in the assessment of senior residents' performance utilizing the International Council of Ophthalmology's Ophthalmology Surgical Competency Assessment Rubric for phacoemulsification (ICO-OSCAR; phaco). Methods: This is a prospective comparative study conducted at a university-affiliated hospital. Six ophthalmology residents of postgraduate year 4 participated. Their performance in phacoemulsification was rated via DOPS and later in a masked manner through VOPS by a single faculty assessor. Results: Seventy-one surgeries were evaluated. There were no statistically significant differences between the scores of VOPS and DOPS regarding all ICO-OSCAR indices except “instrument insertion into the eye” in which DOPS had higher scores (P = 0.035). A significant correlation was observed in total scores of “task-specific” (r = 0.64, P < 0.001) and “global” (r = 0.38, P = 0.003) indices between VOPS and DOPS while some subscales did not show a correlation between the two methods of assessment. The Bland-Altman analysis demonstrated that nearly all data points of total “task-specific” and “global” scores fell within the 95% limits of agreement ([-5.84, 6.87] and [-4.78, 4.86], respectively). Conclusion: This study demonstrated that VOPS holds promise for a general rating of residents' performance.
topic direct observation
ophthalmology
phacoemulsification
residents
video observation
url http://www.ijo.in/article.asp?issn=0301-4738;year=2021;volume=69;issue=3;spage=574;epage=578;aulast=Ghiasian
work_keys_str_mv AT leilaghiasian comparisonofvideobasedobservationanddirectobservationforassessingtheoperativeperformanceofresidentsundergoingphacoemulsificationtraining
AT alihadavandkhani comparisonofvideobasedobservationanddirectobservationforassessingtheoperativeperformanceofresidentsundergoingphacoemulsificationtraining
AT paryaabdolalizadeh comparisonofvideobasedobservationanddirectobservationforassessingtheoperativeperformanceofresidentsundergoingphacoemulsificationtraining
AT leilajanani comparisonofvideobasedobservationanddirectobservationforassessingtheoperativeperformanceofresidentsundergoingphacoemulsificationtraining
AT acieheshaghi comparisonofvideobasedobservationanddirectobservationforassessingtheoperativeperformanceofresidentsundergoingphacoemulsificationtraining
_version_ 1724178308191485952