Group Differences in the Value of Subscores: A Fairness Issue
The aim of this paper was to study fairness in testing by analyzing the quality of subscores for different groups of test takers. This is done by studying the value added ratio (VAR) for all subscores in the test, which here is a Swedish college admission test. Comparisons were made between test tak...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2020-05-01
|
Series: | Frontiers in Education |
Subjects: | |
Online Access: | https://www.frontiersin.org/article/10.3389/feduc.2020.00055/full |
id |
doaj-6a0aa34b572c42448f72ec20c6fd62b8 |
---|---|
record_format |
Article |
spelling |
doaj-6a0aa34b572c42448f72ec20c6fd62b82020-11-25T02:10:32ZengFrontiers Media S.A.Frontiers in Education2504-284X2020-05-01510.3389/feduc.2020.00055529890Group Differences in the Value of Subscores: A Fairness IssueMarcus Strömbäck HjärnePer-Erik LyrénThe aim of this paper was to study fairness in testing by analyzing the quality of subscores for different groups of test takers. This is done by studying the value added ratio (VAR) for all subscores in the test, which here is a Swedish college admission test. Comparisons were made between test takers who take the regular test and test takers who are taking the test with extended time adaptation, as well as between males and females. Significant group differences in such subscore value would raise questions about fairness for that testing program. In particular, differences in subscore value between subgroups based on accommodations could indicate problems with the appropriateness of the accommodation. We found that the value added ratio (VAR) for all subscores in the studied test were slightly larger for males than for females. There were some differences between subgroups with respect to the extended time accommodation, but they were not systematic in the same way as for males and females. While the differences in the subscores' added value were small in general, they may in some instances be large enough to pose a threat to a valid and fair interpretation and use of test scores, and thus raises questions about fairness.https://www.frontiersin.org/article/10.3389/feduc.2020.00055/fullfairnesssubscoresgenderdyslexiatestadaptation |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Marcus Strömbäck Hjärne Per-Erik Lyrén |
spellingShingle |
Marcus Strömbäck Hjärne Per-Erik Lyrén Group Differences in the Value of Subscores: A Fairness Issue Frontiers in Education fairness subscores gender dyslexia test adaptation |
author_facet |
Marcus Strömbäck Hjärne Per-Erik Lyrén |
author_sort |
Marcus Strömbäck Hjärne |
title |
Group Differences in the Value of Subscores: A Fairness Issue |
title_short |
Group Differences in the Value of Subscores: A Fairness Issue |
title_full |
Group Differences in the Value of Subscores: A Fairness Issue |
title_fullStr |
Group Differences in the Value of Subscores: A Fairness Issue |
title_full_unstemmed |
Group Differences in the Value of Subscores: A Fairness Issue |
title_sort |
group differences in the value of subscores: a fairness issue |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Education |
issn |
2504-284X |
publishDate |
2020-05-01 |
description |
The aim of this paper was to study fairness in testing by analyzing the quality of subscores for different groups of test takers. This is done by studying the value added ratio (VAR) for all subscores in the test, which here is a Swedish college admission test. Comparisons were made between test takers who take the regular test and test takers who are taking the test with extended time adaptation, as well as between males and females. Significant group differences in such subscore value would raise questions about fairness for that testing program. In particular, differences in subscore value between subgroups based on accommodations could indicate problems with the appropriateness of the accommodation. We found that the value added ratio (VAR) for all subscores in the studied test were slightly larger for males than for females. There were some differences between subgroups with respect to the extended time accommodation, but they were not systematic in the same way as for males and females. While the differences in the subscores' added value were small in general, they may in some instances be large enough to pose a threat to a valid and fair interpretation and use of test scores, and thus raises questions about fairness. |
topic |
fairness subscores gender dyslexia test adaptation |
url |
https://www.frontiersin.org/article/10.3389/feduc.2020.00055/full |
work_keys_str_mv |
AT marcusstrombackhjarne groupdifferencesinthevalueofsubscoresafairnessissue AT pereriklyren groupdifferencesinthevalueofsubscoresafairnessissue |
_version_ |
1724919180987203584 |