The Importance of Sample Weights and Plausible Values in Large-Scale Assessments
International large-scale assessments such as PISA (The Programme for International Student Assessment), PIAAC (The Programme for the International Assessment of Adult Competencies) and TIMSS (Trends in International Mathematics Science Study), play a key role in determining educational policies b...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
EPODDER
2020-03-01
|
Series: | Journal of Measurement and Evaluation in Education and Psychology |
Subjects: | |
Online Access: | https://dergipark.org.tr/tr/pub/epod/issue/51680/602765 |
id |
doaj-42bd3a9acfe24285bacef237f4562ec5 |
---|---|
record_format |
Article |
spelling |
doaj-42bd3a9acfe24285bacef237f4562ec52020-11-25T02:52:10ZengEPODDERJournal of Measurement and Evaluation in Education and Psychology1309-65751309-65752020-03-01111436010.21031/epod.602765The Importance of Sample Weights and Plausible Values in Large-Scale AssessmentsSerkan ARIKAN0https://orcid.org/0000-0001-9610-5496Ferah ÖZER1https://orcid.org/0000-0001-8621-3522Vuslat ŞEKER2https://orcid.org/0000-0002-3279-5544Güneş ERTAŞ3https://orcid.org/0000-0001-8785-7768 Boğaziçi University Boğaziçi University Boğaziçi University Boğaziçi UniversityInternational large-scale assessments such as PISA (The Programme for International Student Assessment), PIAAC (The Programme for the International Assessment of Adult Competencies) and TIMSS (Trends in International Mathematics Science Study), play a key role in determining educational policies besides their primary objectives of measuring, evaluating and monitoring the educational process. Therefore, it is critical to analyze the data gathered from the large scale assessments using scientifically accurate statistical methods as the results have the potential to influence millions of stakeholders through major policy changes. Analysis of these data that consists of hundreds of different genuine variables requires expertise and using specific methods. This study illustrates issues to be considered while analyzing PISA, PIAAC and TIMSS data by presenting relevant syntax and exemplifying the possible incorrect results that might be encountered. In Turkey, there are very limited courses that focus on large scale data analysis. Workshops are also very limited to reach major groups. The aim of this study is to raise awareness related to sample weights and plausible values. Comparative findings of the study showed that without using sample weights and plausible values there is a high probability to get incorrect results. In this study, t-test and multiple regression analyses conducted by IDB Analyzer and multilevel regression analysis by Mplus were exemplified.https://dergipark.org.tr/tr/pub/epod/issue/51680/602765sample weightsplausible valueslarge scale assessmentidb analyzermplus |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Serkan ARIKAN Ferah ÖZER Vuslat ŞEKER Güneş ERTAŞ |
spellingShingle |
Serkan ARIKAN Ferah ÖZER Vuslat ŞEKER Güneş ERTAŞ The Importance of Sample Weights and Plausible Values in Large-Scale Assessments Journal of Measurement and Evaluation in Education and Psychology sample weights plausible values large scale assessment idb analyzer mplus |
author_facet |
Serkan ARIKAN Ferah ÖZER Vuslat ŞEKER Güneş ERTAŞ |
author_sort |
Serkan ARIKAN |
title |
The Importance of Sample Weights and Plausible Values in Large-Scale Assessments |
title_short |
The Importance of Sample Weights and Plausible Values in Large-Scale Assessments |
title_full |
The Importance of Sample Weights and Plausible Values in Large-Scale Assessments |
title_fullStr |
The Importance of Sample Weights and Plausible Values in Large-Scale Assessments |
title_full_unstemmed |
The Importance of Sample Weights and Plausible Values in Large-Scale Assessments |
title_sort |
importance of sample weights and plausible values in large-scale assessments |
publisher |
EPODDER |
series |
Journal of Measurement and Evaluation in Education and Psychology |
issn |
1309-6575 1309-6575 |
publishDate |
2020-03-01 |
description |
International large-scale assessments such as PISA (The Programme for International Student Assessment),
PIAAC (The Programme for the International Assessment of Adult Competencies) and TIMSS (Trends in
International Mathematics Science Study), play a key role in determining educational policies besides their
primary objectives of measuring, evaluating and monitoring the educational process. Therefore, it is critical to
analyze the data gathered from the large scale assessments using scientifically accurate statistical methods as the
results have the potential to influence millions of stakeholders through major policy changes. Analysis of these
data that consists of hundreds of different genuine variables requires expertise and using specific methods. This
study illustrates issues to be considered while analyzing PISA, PIAAC and TIMSS data by presenting relevant
syntax and exemplifying the possible incorrect results that might be encountered. In Turkey, there are very
limited courses that focus on large scale data analysis. Workshops are also very limited to reach major groups.
The aim of this study is to raise awareness related to sample weights and plausible values. Comparative findings
of the study showed that without using sample weights and plausible values there is a high probability to get
incorrect results. In this study, t-test and multiple regression analyses conducted by IDB Analyzer and multilevel
regression analysis by Mplus were exemplified. |
topic |
sample weights plausible values large scale assessment idb analyzer mplus |
url |
https://dergipark.org.tr/tr/pub/epod/issue/51680/602765 |
work_keys_str_mv |
AT serkanarikan theimportanceofsampleweightsandplausiblevaluesinlargescaleassessments AT ferahozer theimportanceofsampleweightsandplausiblevaluesinlargescaleassessments AT vuslatseker theimportanceofsampleweightsandplausiblevaluesinlargescaleassessments AT gunesertas theimportanceofsampleweightsandplausiblevaluesinlargescaleassessments AT serkanarikan importanceofsampleweightsandplausiblevaluesinlargescaleassessments AT ferahozer importanceofsampleweightsandplausiblevaluesinlargescaleassessments AT vuslatseker importanceofsampleweightsandplausiblevaluesinlargescaleassessments AT gunesertas importanceofsampleweightsandplausiblevaluesinlargescaleassessments |
_version_ |
1724730810684145664 |