Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education
<p>Abstract</p> <p>Background</p> <p>Script Concordance Test (SCT) is a new assessment tool that reliably assesses clinical reasoning skills. Previous descriptions of developing SCT-question banks were merely subjective. This study addresses two gaps in the literature:...
Main Authors: | , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
BMC
2012-10-01
|
Series: | BMC Medical Education |
Subjects: | |
Online Access: | http://www.biomedcentral.com/1472-6920/12/100 |
id |
doaj-aa1bd59ed67e4368804f30a4c5858012 |
---|---|
record_format |
Article |
spelling |
doaj-aa1bd59ed67e4368804f30a4c58580122020-11-25T03:53:46ZengBMCBMC Medical Education1472-69202012-10-0112110010.1186/1472-6920-12-100Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical educationAldekhayel Salah AALselaim Nahar AMagzoub MohiAL-Qattan Mohammad MAl-Namlah Abdullah MTamim HaniAl-Khayal AbdullahAl-Habdan Sultan IZamakhshary Mohammed F<p>Abstract</p> <p>Background</p> <p>Script Concordance Test (SCT) is a new assessment tool that reliably assesses clinical reasoning skills. Previous descriptions of developing SCT-question banks were merely subjective. This study addresses two gaps in the literature: 1) conducting the first phase of a multistep validation process of SCT in Plastic Surgery, and 2) providing an objective methodology to construct a question bank based on SCT.</p> <p>Methods</p> <p>After developing a test blueprint, 52 test items were written. Five validation questions were developed and a validation survey was established online. Seven reviewers were asked to answer this survey. They were recruited from two countries, Saudi Arabia and Canada, to improve the test’s external validity. Their ratings were transformed into percentages. Analysis was performed to compare reviewers’ ratings by looking at correlations, ranges, means, medians, and overall scores.</p> <p>Results</p> <p>Scores of reviewers’ ratings were between 76% and 95% (mean 86% ± 5). We found poor correlations between reviewers (Pearson’s: +0.38 to −0.22). Ratings of individual validation questions ranged between 0 and 4 (on a scale 1–5). Means and medians of these ranges were computed for each test item (mean: 0.8 to 2.4; median: 1 to 3). A subset of test items comprising 27 items was generated based on a set of inclusion and exclusion criteria.</p> <p>Conclusion</p> <p>This study proposes an objective methodology for validation of SCT-question bank. Analysis of validation survey is done from all angles, i.e., reviewers, validation questions, and test items. Finally, a subset of test items is generated based on a set of criteria.</p> http://www.biomedcentral.com/1472-6920/12/100Plastic surgeryScript concordance approachQuestion bankSurgical education |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Aldekhayel Salah A ALselaim Nahar A Magzoub Mohi AL-Qattan Mohammad M Al-Namlah Abdullah M Tamim Hani Al-Khayal Abdullah Al-Habdan Sultan I Zamakhshary Mohammed F |
spellingShingle |
Aldekhayel Salah A ALselaim Nahar A Magzoub Mohi AL-Qattan Mohammad M Al-Namlah Abdullah M Tamim Hani Al-Khayal Abdullah Al-Habdan Sultan I Zamakhshary Mohammed F Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education BMC Medical Education Plastic surgery Script concordance approach Question bank Surgical education |
author_facet |
Aldekhayel Salah A ALselaim Nahar A Magzoub Mohi AL-Qattan Mohammad M Al-Namlah Abdullah M Tamim Hani Al-Khayal Abdullah Al-Habdan Sultan I Zamakhshary Mohammed F |
author_sort |
Aldekhayel Salah A |
title |
Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education |
title_short |
Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education |
title_full |
Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education |
title_fullStr |
Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education |
title_full_unstemmed |
Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education |
title_sort |
constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education |
publisher |
BMC |
series |
BMC Medical Education |
issn |
1472-6920 |
publishDate |
2012-10-01 |
description |
<p>Abstract</p> <p>Background</p> <p>Script Concordance Test (SCT) is a new assessment tool that reliably assesses clinical reasoning skills. Previous descriptions of developing SCT-question banks were merely subjective. This study addresses two gaps in the literature: 1) conducting the first phase of a multistep validation process of SCT in Plastic Surgery, and 2) providing an objective methodology to construct a question bank based on SCT.</p> <p>Methods</p> <p>After developing a test blueprint, 52 test items were written. Five validation questions were developed and a validation survey was established online. Seven reviewers were asked to answer this survey. They were recruited from two countries, Saudi Arabia and Canada, to improve the test’s external validity. Their ratings were transformed into percentages. Analysis was performed to compare reviewers’ ratings by looking at correlations, ranges, means, medians, and overall scores.</p> <p>Results</p> <p>Scores of reviewers’ ratings were between 76% and 95% (mean 86% ± 5). We found poor correlations between reviewers (Pearson’s: +0.38 to −0.22). Ratings of individual validation questions ranged between 0 and 4 (on a scale 1–5). Means and medians of these ranges were computed for each test item (mean: 0.8 to 2.4; median: 1 to 3). A subset of test items comprising 27 items was generated based on a set of inclusion and exclusion criteria.</p> <p>Conclusion</p> <p>This study proposes an objective methodology for validation of SCT-question bank. Analysis of validation survey is done from all angles, i.e., reviewers, validation questions, and test items. Finally, a subset of test items is generated based on a set of criteria.</p> |
topic |
Plastic surgery Script concordance approach Question bank Surgical education |
url |
http://www.biomedcentral.com/1472-6920/12/100 |
work_keys_str_mv |
AT aldekhayelsalaha constructingaquestionbankbasedonscriptconcordanceapproachasanovelassessmentmethodologyinsurgicaleducation AT alselaimnahara constructingaquestionbankbasedonscriptconcordanceapproachasanovelassessmentmethodologyinsurgicaleducation AT magzoubmohi constructingaquestionbankbasedonscriptconcordanceapproachasanovelassessmentmethodologyinsurgicaleducation AT alqattanmohammadm constructingaquestionbankbasedonscriptconcordanceapproachasanovelassessmentmethodologyinsurgicaleducation AT alnamlahabdullahm constructingaquestionbankbasedonscriptconcordanceapproachasanovelassessmentmethodologyinsurgicaleducation AT tamimhani constructingaquestionbankbasedonscriptconcordanceapproachasanovelassessmentmethodologyinsurgicaleducation AT alkhayalabdullah constructingaquestionbankbasedonscriptconcordanceapproachasanovelassessmentmethodologyinsurgicaleducation AT alhabdansultani constructingaquestionbankbasedonscriptconcordanceapproachasanovelassessmentmethodologyinsurgicaleducation AT zamakhsharymohammedf constructingaquestionbankbasedonscriptconcordanceapproachasanovelassessmentmethodologyinsurgicaleducation |
_version_ |
1724476692015087616 |