İçerik Ağırlıklandırmasının Maddeler-Arası Boyutluluk Modeline Dayalı Çok Boyutlu Bilgisayar Ortamında Bireyselleştirilmiş Test Yöntemleri Üzerindeki Etkisinin İncelenmesi
The purpose of this study is to compare the performance of Between-item dimensionality-based Multidimensional CAT designs and to examine the effect of content balancing on different MCAT designs. For this purpose, real data set obtained from English Proficiency Test (EPT), which was administered b...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
EPODDER
2015-11-01
|
Series: | Journal of Measurement and Evaluation in Education and Psychology |
Subjects: | |
Online Access: | http://dergipark.ulakbim.gov.tr/epod/article/view/5000156293 |
id |
doaj-248e40e2b3724a798ef8592536226074 |
---|---|
record_format |
Article |
spelling |
doaj-248e40e2b3724a798ef85925362260742020-11-24T23:44:58ZengEPODDERJournal of Measurement and Evaluation in Education and Psychology1309-65752015-11-016236538410.21031/epod.03278İçerik Ağırlıklandırmasının Maddeler-Arası Boyutluluk Modeline Dayalı Çok Boyutlu Bilgisayar Ortamında Bireyselleştirilmiş Test Yöntemleri Üzerindeki Etkisinin İncelenmesiBurhanettin Özdemir0Selahattin Gelbal1Hacettepe ÜniversitesiHacettepe ÜniversitesiThe purpose of this study is to compare the performance of Between-item dimensionality-based Multidimensional CAT designs and to examine the effect of content balancing on different MCAT designs. For this purpose, real data set obtained from English Proficiency Test (EPT), which was administered by Hacettepe University between 2009 and 2013 academic years, was used. The three dimensional item pool consisted of real items measuring students’ listening, grammar and reading abilities. Item pool consisted of 555 items which was calibrated with 2PL between-item MIRT model. In this study, two different theta estimation (Fisher scoring and Bayesian MAP) methods, three different fisher information based item selection methods (A-optimality, D-optimality and Random) and three different precision based termination methods were used in order to determine the best MCAT design. In addition, results of MCAT algorithms with content distribution and without content distribution were compared so as to examine the effect of content balancing in the context of MCAT. The results of each MCAT condition were compared with respect to, reliability index, SEM, RMSD values associated with each dimension. According to results, both Bayesian MAP and Fisher’s scoring methods yielded similar results when A-Optimality item selection method was used. However, Fisher’s scoring method appeared to be affected from item selection methods and content balancing. Moreover, average number of items tended to increase and reliability coefficients tended to decrease somewhat, while standard error and RMSD values tended to decrease when content balancing was applied in MCAT.http://dergipark.ulakbim.gov.tr/epod/article/view/5000156293: Multidimensional adaptive testingbetween-item dimensionality modelcontent balancing |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Burhanettin Özdemir Selahattin Gelbal |
spellingShingle |
Burhanettin Özdemir Selahattin Gelbal İçerik Ağırlıklandırmasının Maddeler-Arası Boyutluluk Modeline Dayalı Çok Boyutlu Bilgisayar Ortamında Bireyselleştirilmiş Test Yöntemleri Üzerindeki Etkisinin İncelenmesi Journal of Measurement and Evaluation in Education and Psychology : Multidimensional adaptive testing between-item dimensionality model content balancing |
author_facet |
Burhanettin Özdemir Selahattin Gelbal |
author_sort |
Burhanettin Özdemir |
title |
İçerik Ağırlıklandırmasının Maddeler-Arası Boyutluluk Modeline Dayalı Çok Boyutlu Bilgisayar Ortamında Bireyselleştirilmiş Test Yöntemleri Üzerindeki Etkisinin İncelenmesi |
title_short |
İçerik Ağırlıklandırmasının Maddeler-Arası Boyutluluk Modeline Dayalı Çok Boyutlu Bilgisayar Ortamında Bireyselleştirilmiş Test Yöntemleri Üzerindeki Etkisinin İncelenmesi |
title_full |
İçerik Ağırlıklandırmasının Maddeler-Arası Boyutluluk Modeline Dayalı Çok Boyutlu Bilgisayar Ortamında Bireyselleştirilmiş Test Yöntemleri Üzerindeki Etkisinin İncelenmesi |
title_fullStr |
İçerik Ağırlıklandırmasının Maddeler-Arası Boyutluluk Modeline Dayalı Çok Boyutlu Bilgisayar Ortamında Bireyselleştirilmiş Test Yöntemleri Üzerindeki Etkisinin İncelenmesi |
title_full_unstemmed |
İçerik Ağırlıklandırmasının Maddeler-Arası Boyutluluk Modeline Dayalı Çok Boyutlu Bilgisayar Ortamında Bireyselleştirilmiş Test Yöntemleri Üzerindeki Etkisinin İncelenmesi |
title_sort |
i̇çerik ağırlıklandırmasının maddeler-arası boyutluluk modeline dayalı çok boyutlu bilgisayar ortamında bireyselleştirilmiş test yöntemleri üzerindeki etkisinin i̇ncelenmesi |
publisher |
EPODDER |
series |
Journal of Measurement and Evaluation in Education and Psychology |
issn |
1309-6575 |
publishDate |
2015-11-01 |
description |
The purpose of this study is to compare the performance of Between-item dimensionality-based
Multidimensional CAT designs and to examine the effect of content balancing on different MCAT designs. For
this purpose, real data set obtained from English Proficiency Test (EPT), which was administered by Hacettepe
University between 2009 and 2013 academic years, was used. The three dimensional item pool consisted of
real items measuring students’ listening, grammar and reading abilities. Item pool consisted of 555 items which was calibrated with 2PL between-item MIRT model. In this study, two different theta estimation
(Fisher scoring and Bayesian MAP) methods, three different fisher information based item selection methods
(A-optimality, D-optimality and Random) and three different precision based termination methods were used
in order to determine the best MCAT design. In addition, results of MCAT algorithms with content
distribution and without content distribution were compared so as to examine the effect of content balancing in
the context of MCAT. The results of each MCAT condition were compared with respect to, reliability index,
SEM, RMSD values associated with each dimension. According to results, both Bayesian MAP and Fisher’s
scoring methods yielded similar results when A-Optimality item selection method was used. However, Fisher’s
scoring method appeared to be affected from item selection methods and content balancing. Moreover, average
number of items tended to increase and reliability coefficients tended to decrease somewhat, while standard
error and RMSD values tended to decrease when content balancing was applied in MCAT. |
topic |
: Multidimensional adaptive testing between-item dimensionality model content balancing |
url |
http://dergipark.ulakbim.gov.tr/epod/article/view/5000156293 |
work_keys_str_mv |
AT burhanettinozdemir icerikagırlıklandırmasınınmaddelerarasıboyutlulukmodelinedayalıcokboyutlubilgisayarortamındabireysellestirilmistestyontemleriuzerindekietkisininincelenmesi AT selahattingelbal icerikagırlıklandırmasınınmaddelerarasıboyutlulukmodelinedayalıcokboyutlubilgisayarortamındabireysellestirilmistestyontemleriuzerindekietkisininincelenmesi |
_version_ |
1725497765096587264 |