Rating the quality of teamwork—a comparison of novice and expert ratings using the Team Emergency Assessment Measure (TEAM) in simulated emergencies
Abstract Background Training in teamwork behaviour improves technical resuscitation performance. However, its effect on patient outcome is less clear, partly because teamwork behaviour is difficult to measure. Furthermore, it is unknown who should evaluate it. In clinical practice, experts are oblig...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
BMC
2019-02-01
|
Series: | Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine |
Subjects: | |
Online Access: | http://link.springer.com/article/10.1186/s13049-019-0591-9 |
id |
doaj-6c2de9f7fe824aae9657560578718ebd |
---|---|
record_format |
Article |
spelling |
doaj-6c2de9f7fe824aae9657560578718ebd2020-11-24T21:57:25ZengBMCScandinavian Journal of Trauma, Resuscitation and Emergency Medicine1757-72412019-02-012711810.1186/s13049-019-0591-9Rating the quality of teamwork—a comparison of novice and expert ratings using the Team Emergency Assessment Measure (TEAM) in simulated emergenciesJulia Freytag0Fabian Stroben1Wolf E. Hautz2Stefan K. Schauber3Juliane E. Kämmer4Simulated Patients Program, Office of the Vice Dean for Teaching and Learning, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of HealthLernzentrum, Office of the Vice Dean for Teaching and Learning, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of HealthDepartment of Emergency Medicine, Inselspital, Bern University Hospital, University of BernCentre for Health Sciences Education, University of OsloAG Progress Test Medizin, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of HealthAbstract Background Training in teamwork behaviour improves technical resuscitation performance. However, its effect on patient outcome is less clear, partly because teamwork behaviour is difficult to measure. Furthermore, it is unknown who should evaluate it. In clinical practice, experts are obliged to participate in resuscitation efforts and are thus unavailable to assess teamwork quality. Consequently, we sought to determine if raters with little clinical experience and experts provide comparable evaluations of teamwork behaviour. Methods Novice and expert raters judged teamwork behaviour during 6 emergency medicine simulations using the Teamwork Emergency Assessment Measure (TEAM). Ratings of both groups were analysed descriptively and compared with U and t tests. We used a mixed effects model to identify the proportion of variance in TEAM scores attributable to rater status and other sources. Results Twelve raters evaluated 7 teams rotating through 6 cases, for a total of 84 observations. We found no significant difference between expert and novice ratings for 7 of the 11 items of the TEAM or in the sums of all item scores. Novices rated teamwork behaviour higher on 4 items and overall. Rater status accounted for 11.1% of the total variance in scores. Conclusions Experts’ and novices’ ratings were similarly distributed, implying that raters with limited experience can provide reliable data on teamwork behaviour. Novices show a consistent, but slightly more lenient rating behaviour. Clinical studies and real-life teams may thus employ novices using a structured observational tool such as TEAM to inform their performance review and improvement.http://link.springer.com/article/10.1186/s13049-019-0591-9TeamworkNon-technical skillsExpert raterNovice raterAssessmentSimulation |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Julia Freytag Fabian Stroben Wolf E. Hautz Stefan K. Schauber Juliane E. Kämmer |
spellingShingle |
Julia Freytag Fabian Stroben Wolf E. Hautz Stefan K. Schauber Juliane E. Kämmer Rating the quality of teamwork—a comparison of novice and expert ratings using the Team Emergency Assessment Measure (TEAM) in simulated emergencies Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine Teamwork Non-technical skills Expert rater Novice rater Assessment Simulation |
author_facet |
Julia Freytag Fabian Stroben Wolf E. Hautz Stefan K. Schauber Juliane E. Kämmer |
author_sort |
Julia Freytag |
title |
Rating the quality of teamwork—a comparison of novice and expert ratings using the Team Emergency Assessment Measure (TEAM) in simulated emergencies |
title_short |
Rating the quality of teamwork—a comparison of novice and expert ratings using the Team Emergency Assessment Measure (TEAM) in simulated emergencies |
title_full |
Rating the quality of teamwork—a comparison of novice and expert ratings using the Team Emergency Assessment Measure (TEAM) in simulated emergencies |
title_fullStr |
Rating the quality of teamwork—a comparison of novice and expert ratings using the Team Emergency Assessment Measure (TEAM) in simulated emergencies |
title_full_unstemmed |
Rating the quality of teamwork—a comparison of novice and expert ratings using the Team Emergency Assessment Measure (TEAM) in simulated emergencies |
title_sort |
rating the quality of teamwork—a comparison of novice and expert ratings using the team emergency assessment measure (team) in simulated emergencies |
publisher |
BMC |
series |
Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine |
issn |
1757-7241 |
publishDate |
2019-02-01 |
description |
Abstract Background Training in teamwork behaviour improves technical resuscitation performance. However, its effect on patient outcome is less clear, partly because teamwork behaviour is difficult to measure. Furthermore, it is unknown who should evaluate it. In clinical practice, experts are obliged to participate in resuscitation efforts and are thus unavailable to assess teamwork quality. Consequently, we sought to determine if raters with little clinical experience and experts provide comparable evaluations of teamwork behaviour. Methods Novice and expert raters judged teamwork behaviour during 6 emergency medicine simulations using the Teamwork Emergency Assessment Measure (TEAM). Ratings of both groups were analysed descriptively and compared with U and t tests. We used a mixed effects model to identify the proportion of variance in TEAM scores attributable to rater status and other sources. Results Twelve raters evaluated 7 teams rotating through 6 cases, for a total of 84 observations. We found no significant difference between expert and novice ratings for 7 of the 11 items of the TEAM or in the sums of all item scores. Novices rated teamwork behaviour higher on 4 items and overall. Rater status accounted for 11.1% of the total variance in scores. Conclusions Experts’ and novices’ ratings were similarly distributed, implying that raters with limited experience can provide reliable data on teamwork behaviour. Novices show a consistent, but slightly more lenient rating behaviour. Clinical studies and real-life teams may thus employ novices using a structured observational tool such as TEAM to inform their performance review and improvement. |
topic |
Teamwork Non-technical skills Expert rater Novice rater Assessment Simulation |
url |
http://link.springer.com/article/10.1186/s13049-019-0591-9 |
work_keys_str_mv |
AT juliafreytag ratingthequalityofteamworkacomparisonofnoviceandexpertratingsusingtheteamemergencyassessmentmeasureteaminsimulatedemergencies AT fabianstroben ratingthequalityofteamworkacomparisonofnoviceandexpertratingsusingtheteamemergencyassessmentmeasureteaminsimulatedemergencies AT wolfehautz ratingthequalityofteamworkacomparisonofnoviceandexpertratingsusingtheteamemergencyassessmentmeasureteaminsimulatedemergencies AT stefankschauber ratingthequalityofteamworkacomparisonofnoviceandexpertratingsusingtheteamemergencyassessmentmeasureteaminsimulatedemergencies AT julianeekammer ratingthequalityofteamworkacomparisonofnoviceandexpertratingsusingtheteamemergencyassessmentmeasureteaminsimulatedemergencies |
_version_ |
1725855629887668224 |