Alternative item selection strategies for improving test security in computerized adaptive testing of the algorithm
One of the ability estimation methods that is widely applied to the Computerized Adaptive Testing (CAT) algorithm is the maximum likelihood estimation (MLE). However, the maximum likelihood method has the disadvantage of being unable to find a solution to the ability estimation of test-takers when t...
Main Author: | |
---|---|
Format: | Article |
Language: | English |
Published: |
Universitas Negeri Yogyakarta
2020-06-01
|
Series: | Research and Evaluation in Education |
Subjects: | |
Online Access: | https://journal.uny.ac.id/index.php/reid/article/view/30508 |
id |
doaj-ba21180fd7504e9a933d5ca480fbf890 |
---|---|
record_format |
Article |
spelling |
doaj-ba21180fd7504e9a933d5ca480fbf8902021-03-22T04:55:09ZengUniversitas Negeri YogyakartaResearch and Evaluation in Education2460-69952020-06-0161324010.21831/reid.v6i1.3050813219Alternative item selection strategies for improving test security in computerized adaptive testing of the algorithmIwan Suhardi0Universitas Negeri MakassarOne of the ability estimation methods that is widely applied to the Computerized Adaptive Testing (CAT) algorithm is the maximum likelihood estimation (MLE). However, the maximum likelihood method has the disadvantage of being unable to find a solution to the ability estimation of test-takers when the test takers’ scores do not have a pattern. If there are test takers who get either score of 0 or perfect score, then the abilities of test-takers are usually estimated using the step-size model. However, the step-size model often results in item exposure where certain items will appear more often than other items. This surely threatens the security of the test because items that often appear will be easier to recognize. This study tries to provide an alternative strategy by modifying the step-size model and randomizing the calculation results of the information function obtained. Based on the results of the study, it is found that alternative strategies for item selection can make more varied items appear to improve the security of tests on the CAT.https://journal.uny.ac.id/index.php/reid/article/view/30508item selection strategyitem exposurestep-sizeadaptive testing |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Iwan Suhardi |
spellingShingle |
Iwan Suhardi Alternative item selection strategies for improving test security in computerized adaptive testing of the algorithm Research and Evaluation in Education item selection strategy item exposure step-size adaptive testing |
author_facet |
Iwan Suhardi |
author_sort |
Iwan Suhardi |
title |
Alternative item selection strategies for improving test security in computerized adaptive testing of the algorithm |
title_short |
Alternative item selection strategies for improving test security in computerized adaptive testing of the algorithm |
title_full |
Alternative item selection strategies for improving test security in computerized adaptive testing of the algorithm |
title_fullStr |
Alternative item selection strategies for improving test security in computerized adaptive testing of the algorithm |
title_full_unstemmed |
Alternative item selection strategies for improving test security in computerized adaptive testing of the algorithm |
title_sort |
alternative item selection strategies for improving test security in computerized adaptive testing of the algorithm |
publisher |
Universitas Negeri Yogyakarta |
series |
Research and Evaluation in Education |
issn |
2460-6995 |
publishDate |
2020-06-01 |
description |
One of the ability estimation methods that is widely applied to the Computerized Adaptive Testing (CAT) algorithm is the maximum likelihood estimation (MLE). However, the maximum likelihood method has the disadvantage of being unable to find a solution to the ability estimation of test-takers when the test takers’ scores do not have a pattern. If there are test takers who get either score of 0 or perfect score, then the abilities of test-takers are usually estimated using the step-size model. However, the step-size model often results in item exposure where certain items will appear more often than other items. This surely threatens the security of the test because items that often appear will be easier to recognize. This study tries to provide an alternative strategy by modifying the step-size model and randomizing the calculation results of the information function obtained. Based on the results of the study, it is found that alternative strategies for item selection can make more varied items appear to improve the security of tests on the CAT. |
topic |
item selection strategy item exposure step-size adaptive testing |
url |
https://journal.uny.ac.id/index.php/reid/article/view/30508 |
work_keys_str_mv |
AT iwansuhardi alternativeitemselectionstrategiesforimprovingtestsecurityincomputerizedadaptivetestingofthealgorithm |
_version_ |
1724209526165471232 |