Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia
The main aim of the present study was to investigate the presence of Differential Item Functioning (DIF) using a latent class (LC) analysis approach. Particularly, we examined potential sources of DIF in relation to gender. Data came from 6,265 Saudi Arabia students, who completed a high-stakes stan...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2020-04-01
|
Series: | Frontiers in Psychology |
Subjects: | |
Online Access: | https://www.frontiersin.org/article/10.3389/fpsyg.2020.00622/full |
id |
doaj-92c723eaa0a24febbfd0db244c1e02a7 |
---|---|
record_format |
Article |
spelling |
doaj-92c723eaa0a24febbfd0db244c1e02a72020-11-25T03:20:50ZengFrontiers Media S.A.Frontiers in Psychology1664-10782020-04-011110.3389/fpsyg.2020.00622501235Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi ArabiaIoannis Tsaousis0Georgios D. Sideridis1Georgios D. Sideridis2Hanan M. AlGhamdi3Department of Psychology, University of Crete, Rethymno, GreeceBoston Children’s Hospital, Harvard Medical School, Boston, MA, United StatesNational and Kapodistrian University of Athens, Athens, GreeceNational Center for Assessment in Higher Education, Riyadh, Saudi ArabiaThe main aim of the present study was to investigate the presence of Differential Item Functioning (DIF) using a latent class (LC) analysis approach. Particularly, we examined potential sources of DIF in relation to gender. Data came from 6,265 Saudi Arabia students, who completed a high-stakes standardized admission test for university entrance. The results from a Latent Class Analysis (LCA) revealed a three-class solution (i.e., high, average, and low scorers). Then, to better understand the nature of the emerging classes and the characteristics of the people who comprise them, we applied a new stepwise approach, using the Multiple Indicator Multiple Causes (MIMIC) model. The model identified both uniform and non-uniform DIF effects for several items across all scales of the test, although, for the majority of them, the DIF effect sizes were negligible. Findings from this study have important implications for both measurement quality and interpretation of the results. Particularly, results showed that gender is a potential source of DIF for latent class indicators; thus, it is important to include those direct effects in the latent class regression model, to obtain unbiased estimates not only for the measurement parameters but also of the structural parameters. Ignoring these effects might lead to misspecification of the latent classes in terms of both the size and the characteristics of each class, which in turn, could lead to misinterpretations of the obtained latent class results. Implications of the results for practice are discussed.https://www.frontiersin.org/article/10.3389/fpsyg.2020.00622/fulllatent class analysisDifferential Item Functioningmixture modelingauxiliary variableshigh-stakes testingmultiple indicator multiple causes |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Ioannis Tsaousis Georgios D. Sideridis Georgios D. Sideridis Hanan M. AlGhamdi |
spellingShingle |
Ioannis Tsaousis Georgios D. Sideridis Georgios D. Sideridis Hanan M. AlGhamdi Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia Frontiers in Psychology latent class analysis Differential Item Functioning mixture modeling auxiliary variables high-stakes testing multiple indicator multiple causes |
author_facet |
Ioannis Tsaousis Georgios D. Sideridis Georgios D. Sideridis Hanan M. AlGhamdi |
author_sort |
Ioannis Tsaousis |
title |
Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia |
title_short |
Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia |
title_full |
Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia |
title_fullStr |
Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia |
title_full_unstemmed |
Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia |
title_sort |
measurement invariance and differential item functioning across gender within a latent class analysis framework: evidence from a high-stakes test for university admission in saudi arabia |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Psychology |
issn |
1664-1078 |
publishDate |
2020-04-01 |
description |
The main aim of the present study was to investigate the presence of Differential Item Functioning (DIF) using a latent class (LC) analysis approach. Particularly, we examined potential sources of DIF in relation to gender. Data came from 6,265 Saudi Arabia students, who completed a high-stakes standardized admission test for university entrance. The results from a Latent Class Analysis (LCA) revealed a three-class solution (i.e., high, average, and low scorers). Then, to better understand the nature of the emerging classes and the characteristics of the people who comprise them, we applied a new stepwise approach, using the Multiple Indicator Multiple Causes (MIMIC) model. The model identified both uniform and non-uniform DIF effects for several items across all scales of the test, although, for the majority of them, the DIF effect sizes were negligible. Findings from this study have important implications for both measurement quality and interpretation of the results. Particularly, results showed that gender is a potential source of DIF for latent class indicators; thus, it is important to include those direct effects in the latent class regression model, to obtain unbiased estimates not only for the measurement parameters but also of the structural parameters. Ignoring these effects might lead to misspecification of the latent classes in terms of both the size and the characteristics of each class, which in turn, could lead to misinterpretations of the obtained latent class results. Implications of the results for practice are discussed. |
topic |
latent class analysis Differential Item Functioning mixture modeling auxiliary variables high-stakes testing multiple indicator multiple causes |
url |
https://www.frontiersin.org/article/10.3389/fpsyg.2020.00622/full |
work_keys_str_mv |
AT ioannistsaousis measurementinvarianceanddifferentialitemfunctioningacrossgenderwithinalatentclassanalysisframeworkevidencefromahighstakestestforuniversityadmissioninsaudiarabia AT georgiosdsideridis measurementinvarianceanddifferentialitemfunctioningacrossgenderwithinalatentclassanalysisframeworkevidencefromahighstakestestforuniversityadmissioninsaudiarabia AT georgiosdsideridis measurementinvarianceanddifferentialitemfunctioningacrossgenderwithinalatentclassanalysisframeworkevidencefromahighstakestestforuniversityadmissioninsaudiarabia AT hananmalghamdi measurementinvarianceanddifferentialitemfunctioningacrossgenderwithinalatentclassanalysisframeworkevidencefromahighstakestestforuniversityadmissioninsaudiarabia |
_version_ |
1724616323105816576 |