Are Differentially Functioning Mathematics Items Reason of Low Achievement of Turkish Students in PISA 2015?

In PISA 2015 the average mathematics score of Turkey decreased dramatically. One of the reasons could be the psychometric properties of mathematics items of PISA 2015. Therefore, it is necessary to evaluate PISA mathematics items for language DIF. In the study, three different DIF detection methods...

Full description

Bibliographic Details
Main Author: Serkan ARIKAN
Format: Article
Language:English
Published: EPODDER 2019-03-01
Series:Journal of Measurement and Evaluation in Education and Psychology
Subjects:
DIF
Online Access:http://dergipark.gov.tr/epod/issue/43953/466860
Description
Summary:In PISA 2015 the average mathematics score of Turkey decreased dramatically. One of the reasons could be the psychometric properties of mathematics items of PISA 2015. Therefore, it is necessary to evaluate PISA mathematics items for language DIF. In the study, three different DIF detection methods were used: logistic regression (LR), Mantel-Haenszel (MH) and structural equation modeling (SEM). Eleven items were found to have DIF when Turkish and English speaking students were compared. The effect sizes of mathematics performance differences between Turkish and English speaking students before and after excluding DIF items did not change which indicated that DIF items did not cause Turkish students to perform lower than expected. All the DIF items were open response format in which answers were rated by experts and computers. The DIF items favoring Turkish students were mainly related to the basic cognitive process.
ISSN:1309-6575
1309-6575