Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia

The main aim of the present study was to investigate the presence of Differential Item Functioning (DIF) using a latent class (LC) analysis approach. Particularly, we examined potential sources of DIF in relation to gender. Data came from 6,265 Saudi Arabia students, who completed a high-stakes stan...

Full description

Bibliographic Details
Main Authors: Ioannis Tsaousis, Georgios D. Sideridis, Hanan M. AlGhamdi
Format: Article
Language:English
Published: Frontiers Media S.A. 2020-04-01
Series:Frontiers in Psychology
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fpsyg.2020.00622/full
id doaj-92c723eaa0a24febbfd0db244c1e02a7
record_format Article
spelling doaj-92c723eaa0a24febbfd0db244c1e02a72020-11-25T03:20:50ZengFrontiers Media S.A.Frontiers in Psychology1664-10782020-04-011110.3389/fpsyg.2020.00622501235Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi ArabiaIoannis Tsaousis0Georgios D. Sideridis1Georgios D. Sideridis2Hanan M. AlGhamdi3Department of Psychology, University of Crete, Rethymno, GreeceBoston Children’s Hospital, Harvard Medical School, Boston, MA, United StatesNational and Kapodistrian University of Athens, Athens, GreeceNational Center for Assessment in Higher Education, Riyadh, Saudi ArabiaThe main aim of the present study was to investigate the presence of Differential Item Functioning (DIF) using a latent class (LC) analysis approach. Particularly, we examined potential sources of DIF in relation to gender. Data came from 6,265 Saudi Arabia students, who completed a high-stakes standardized admission test for university entrance. The results from a Latent Class Analysis (LCA) revealed a three-class solution (i.e., high, average, and low scorers). Then, to better understand the nature of the emerging classes and the characteristics of the people who comprise them, we applied a new stepwise approach, using the Multiple Indicator Multiple Causes (MIMIC) model. The model identified both uniform and non-uniform DIF effects for several items across all scales of the test, although, for the majority of them, the DIF effect sizes were negligible. Findings from this study have important implications for both measurement quality and interpretation of the results. Particularly, results showed that gender is a potential source of DIF for latent class indicators; thus, it is important to include those direct effects in the latent class regression model, to obtain unbiased estimates not only for the measurement parameters but also of the structural parameters. Ignoring these effects might lead to misspecification of the latent classes in terms of both the size and the characteristics of each class, which in turn, could lead to misinterpretations of the obtained latent class results. Implications of the results for practice are discussed.https://www.frontiersin.org/article/10.3389/fpsyg.2020.00622/fulllatent class analysisDifferential Item Functioningmixture modelingauxiliary variableshigh-stakes testingmultiple indicator multiple causes
collection DOAJ
language English
format Article
sources DOAJ
author Ioannis Tsaousis
Georgios D. Sideridis
Georgios D. Sideridis
Hanan M. AlGhamdi
spellingShingle Ioannis Tsaousis
Georgios D. Sideridis
Georgios D. Sideridis
Hanan M. AlGhamdi
Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia
Frontiers in Psychology
latent class analysis
Differential Item Functioning
mixture modeling
auxiliary variables
high-stakes testing
multiple indicator multiple causes
author_facet Ioannis Tsaousis
Georgios D. Sideridis
Georgios D. Sideridis
Hanan M. AlGhamdi
author_sort Ioannis Tsaousis
title Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia
title_short Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia
title_full Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia
title_fullStr Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia
title_full_unstemmed Measurement Invariance and Differential Item Functioning Across Gender Within a Latent Class Analysis Framework: Evidence From a High-Stakes Test for University Admission in Saudi Arabia
title_sort measurement invariance and differential item functioning across gender within a latent class analysis framework: evidence from a high-stakes test for university admission in saudi arabia
publisher Frontiers Media S.A.
series Frontiers in Psychology
issn 1664-1078
publishDate 2020-04-01
description The main aim of the present study was to investigate the presence of Differential Item Functioning (DIF) using a latent class (LC) analysis approach. Particularly, we examined potential sources of DIF in relation to gender. Data came from 6,265 Saudi Arabia students, who completed a high-stakes standardized admission test for university entrance. The results from a Latent Class Analysis (LCA) revealed a three-class solution (i.e., high, average, and low scorers). Then, to better understand the nature of the emerging classes and the characteristics of the people who comprise them, we applied a new stepwise approach, using the Multiple Indicator Multiple Causes (MIMIC) model. The model identified both uniform and non-uniform DIF effects for several items across all scales of the test, although, for the majority of them, the DIF effect sizes were negligible. Findings from this study have important implications for both measurement quality and interpretation of the results. Particularly, results showed that gender is a potential source of DIF for latent class indicators; thus, it is important to include those direct effects in the latent class regression model, to obtain unbiased estimates not only for the measurement parameters but also of the structural parameters. Ignoring these effects might lead to misspecification of the latent classes in terms of both the size and the characteristics of each class, which in turn, could lead to misinterpretations of the obtained latent class results. Implications of the results for practice are discussed.
topic latent class analysis
Differential Item Functioning
mixture modeling
auxiliary variables
high-stakes testing
multiple indicator multiple causes
url https://www.frontiersin.org/article/10.3389/fpsyg.2020.00622/full
work_keys_str_mv AT ioannistsaousis measurementinvarianceanddifferentialitemfunctioningacrossgenderwithinalatentclassanalysisframeworkevidencefromahighstakestestforuniversityadmissioninsaudiarabia
AT georgiosdsideridis measurementinvarianceanddifferentialitemfunctioningacrossgenderwithinalatentclassanalysisframeworkevidencefromahighstakestestforuniversityadmissioninsaudiarabia
AT georgiosdsideridis measurementinvarianceanddifferentialitemfunctioningacrossgenderwithinalatentclassanalysisframeworkevidencefromahighstakestestforuniversityadmissioninsaudiarabia
AT hananmalghamdi measurementinvarianceanddifferentialitemfunctioningacrossgenderwithinalatentclassanalysisframeworkevidencefromahighstakestestforuniversityadmissioninsaudiarabia
_version_ 1724616323105816576