Medical students’ thought process while solving problems in 3 different types of clinical assessments in Korea: clinical performance examination, multimedia case-based assessment, and modified essay question
Purpose This study aimed to explore students’ cognitive patterns while solving clinical problems in 3 different types of assessments—clinical performance examination (CPX), multimedia case-based assessment (CBA), and modified essay question (MEQ)—and thereby to understand how different types of asse...
Main Authors: | , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Korea Health Insurance Licensing Examination Institute
2019-05-01
|
Series: | Journal of Educational Evaluation for Health Professions |
Subjects: | |
Online Access: | http://www.jeehp.org/upload/jeehp-16-10.pdf |
id |
doaj-6591ff0968814538a1f37cd72bc571fd |
---|---|
record_format |
Article |
spelling |
doaj-6591ff0968814538a1f37cd72bc571fd2021-01-19T23:42:41ZengKorea Health Insurance Licensing Examination InstituteJournal of Educational Evaluation for Health Professions1975-59372019-05-011610.3352/jeehp.2019.16.10317Medical students’ thought process while solving problems in 3 different types of clinical assessments in Korea: clinical performance examination, multimedia case-based assessment, and modified essay questionSejin Kim0Ikseon Choi1Bo Young Yoon2Min Jeong Kwon3Seok-jin Choi4Sang Hyun Kim5Jong-Tae Lee6Byoung Doo Rhee7Research and Innovation in Learning Lab, College of Education, The University of Georgia, Athens, GA, USAResearch and Innovation in Learning Lab, College of Education, The University of Georgia, Athens, GA, USADepartment of Internal Medicine, Inje University College of Medicine, Busan, KoreaDepartment of Internal Medicine, Inje University College of Medicine, Busan, KoreaDepartment of Radiology, Inje University College of Medicine, Busan, KoreaDepartment of Internal Medicine, Inje University College of Medicine, Busan, KoreaDepartment of Preventive Medicine, Inje University College of Medicine, Busan, KoreaDepartment of Internal Medicine, Inje University College of Medicine, Busan, KoreaPurpose This study aimed to explore students’ cognitive patterns while solving clinical problems in 3 different types of assessments—clinical performance examination (CPX), multimedia case-based assessment (CBA), and modified essay question (MEQ)—and thereby to understand how different types of assessments stimulate different patterns of thinking. Methods A total of 6 test-performance cases from 2 fourth-year medical students were used in this cross-case study. Data were collected through one-on-one interviews using a stimulated recall protocol where students were shown videos of themselves taking each assessment and asked to elaborate on what they were thinking. The unit of analysis was the smallest phrases or sentences in the participants’ narratives that represented a meaningful cognitive occurrence. The narrative data were reorganized chronologically and then analyzed according to the hypothetico-deductive reasoning framework for clinical reasoning. Results Both participants demonstrated similar proportional frequencies of clinical reasoning patterns on the same clinical assessments. The results also revealed that the three different assessment types may stimulate different patterns of clinical reasoning. For example, the CPX strongly promoted the participants’ reasoning related to inquiry strategy, while the MEQ strongly promoted hypothesis generation. Similarly, data analysis and synthesis by the participants were more strongly stimulated by the CBA than by the other assessment types. Conclusion This study found that different assessment designs stimulated different patterns of thinking during problem-solving. This finding can contribute to the search for ways to improve current clinical assessments. Importantly, the research method used in this study can be utilized as an alternative way to examine the validity of clinical assessments.http://www.jeehp.org/upload/jeehp-16-10.pdfclinical performance examinationmodified essay questioncase-based assessmentclinical assessmentassessment validityrepublic of korea |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Sejin Kim Ikseon Choi Bo Young Yoon Min Jeong Kwon Seok-jin Choi Sang Hyun Kim Jong-Tae Lee Byoung Doo Rhee |
spellingShingle |
Sejin Kim Ikseon Choi Bo Young Yoon Min Jeong Kwon Seok-jin Choi Sang Hyun Kim Jong-Tae Lee Byoung Doo Rhee Medical students’ thought process while solving problems in 3 different types of clinical assessments in Korea: clinical performance examination, multimedia case-based assessment, and modified essay question Journal of Educational Evaluation for Health Professions clinical performance examination modified essay question case-based assessment clinical assessment assessment validity republic of korea |
author_facet |
Sejin Kim Ikseon Choi Bo Young Yoon Min Jeong Kwon Seok-jin Choi Sang Hyun Kim Jong-Tae Lee Byoung Doo Rhee |
author_sort |
Sejin Kim |
title |
Medical students’ thought process while solving problems in 3 different types of clinical assessments in Korea: clinical performance examination, multimedia case-based assessment, and modified essay question |
title_short |
Medical students’ thought process while solving problems in 3 different types of clinical assessments in Korea: clinical performance examination, multimedia case-based assessment, and modified essay question |
title_full |
Medical students’ thought process while solving problems in 3 different types of clinical assessments in Korea: clinical performance examination, multimedia case-based assessment, and modified essay question |
title_fullStr |
Medical students’ thought process while solving problems in 3 different types of clinical assessments in Korea: clinical performance examination, multimedia case-based assessment, and modified essay question |
title_full_unstemmed |
Medical students’ thought process while solving problems in 3 different types of clinical assessments in Korea: clinical performance examination, multimedia case-based assessment, and modified essay question |
title_sort |
medical students’ thought process while solving problems in 3 different types of clinical assessments in korea: clinical performance examination, multimedia case-based assessment, and modified essay question |
publisher |
Korea Health Insurance Licensing Examination Institute |
series |
Journal of Educational Evaluation for Health Professions |
issn |
1975-5937 |
publishDate |
2019-05-01 |
description |
Purpose This study aimed to explore students’ cognitive patterns while solving clinical problems in 3 different types of assessments—clinical performance examination (CPX), multimedia case-based assessment (CBA), and modified essay question (MEQ)—and thereby to understand how different types of assessments stimulate different patterns of thinking. Methods A total of 6 test-performance cases from 2 fourth-year medical students were used in this cross-case study. Data were collected through one-on-one interviews using a stimulated recall protocol where students were shown videos of themselves taking each assessment and asked to elaborate on what they were thinking. The unit of analysis was the smallest phrases or sentences in the participants’ narratives that represented a meaningful cognitive occurrence. The narrative data were reorganized chronologically and then analyzed according to the hypothetico-deductive reasoning framework for clinical reasoning. Results Both participants demonstrated similar proportional frequencies of clinical reasoning patterns on the same clinical assessments. The results also revealed that the three different assessment types may stimulate different patterns of clinical reasoning. For example, the CPX strongly promoted the participants’ reasoning related to inquiry strategy, while the MEQ strongly promoted hypothesis generation. Similarly, data analysis and synthesis by the participants were more strongly stimulated by the CBA than by the other assessment types. Conclusion This study found that different assessment designs stimulated different patterns of thinking during problem-solving. This finding can contribute to the search for ways to improve current clinical assessments. Importantly, the research method used in this study can be utilized as an alternative way to examine the validity of clinical assessments. |
topic |
clinical performance examination modified essay question case-based assessment clinical assessment assessment validity republic of korea |
url |
http://www.jeehp.org/upload/jeehp-16-10.pdf |
work_keys_str_mv |
AT sejinkim medicalstudentsthoughtprocesswhilesolvingproblemsin3differenttypesofclinicalassessmentsinkoreaclinicalperformanceexaminationmultimediacasebasedassessmentandmodifiedessayquestion AT ikseonchoi medicalstudentsthoughtprocesswhilesolvingproblemsin3differenttypesofclinicalassessmentsinkoreaclinicalperformanceexaminationmultimediacasebasedassessmentandmodifiedessayquestion AT boyoungyoon medicalstudentsthoughtprocesswhilesolvingproblemsin3differenttypesofclinicalassessmentsinkoreaclinicalperformanceexaminationmultimediacasebasedassessmentandmodifiedessayquestion AT minjeongkwon medicalstudentsthoughtprocesswhilesolvingproblemsin3differenttypesofclinicalassessmentsinkoreaclinicalperformanceexaminationmultimediacasebasedassessmentandmodifiedessayquestion AT seokjinchoi medicalstudentsthoughtprocesswhilesolvingproblemsin3differenttypesofclinicalassessmentsinkoreaclinicalperformanceexaminationmultimediacasebasedassessmentandmodifiedessayquestion AT sanghyunkim medicalstudentsthoughtprocesswhilesolvingproblemsin3differenttypesofclinicalassessmentsinkoreaclinicalperformanceexaminationmultimediacasebasedassessmentandmodifiedessayquestion AT jongtaelee medicalstudentsthoughtprocesswhilesolvingproblemsin3differenttypesofclinicalassessmentsinkoreaclinicalperformanceexaminationmultimediacasebasedassessmentandmodifiedessayquestion AT byoungdoorhee medicalstudentsthoughtprocesswhilesolvingproblemsin3differenttypesofclinicalassessmentsinkoreaclinicalperformanceexaminationmultimediacasebasedassessmentandmodifiedessayquestion |
_version_ |
1724331718345752576 |