Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification
This study examined the stability of reading difficulties (RD) from grades 2 to 6 and focused on the effects of measurement error and cut-off selection in the identification of RD and its stability with the use of simulations. It addressed methodological limitations of prior studies by (a) applying...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2020-01-01
|
Series: | Frontiers in Psychology |
Subjects: | |
Online Access: | https://www.frontiersin.org/article/10.3389/fpsyg.2019.02841/full |
id |
doaj-a65691f9931d4c16a0c13e490054d32a |
---|---|
record_format |
Article |
spelling |
doaj-a65691f9931d4c16a0c13e490054d32a2020-11-25T02:03:25ZengFrontiers Media S.A.Frontiers in Psychology1664-10782020-01-011010.3389/fpsyg.2019.02841499441Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in IdentificationMaria Psyridou0Asko Tolvanen1Marja-Kristiina Lerkkanen2Anna-Maija Poikkeus3Minna Torppa4Department of Teacher Education, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, FinlandDepartment of Psychology, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, FinlandDepartment of Teacher Education, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, FinlandDepartment of Teacher Education, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, FinlandDepartment of Teacher Education, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, FinlandThis study examined the stability of reading difficulties (RD) from grades 2 to 6 and focused on the effects of measurement error and cut-off selection in the identification of RD and its stability with the use of simulations. It addressed methodological limitations of prior studies by (a) applying a model-based simulation analysis to examine the effects of measurement error and cut-offs in the identification of RD, (b) analyzing a non-English and larger sample, and (c) examining RD in both reading fluency and reading comprehension. Reading fluency and reading comprehension of 1,432 Finnish-speaking children were assessed in grades 2 and 6. In addition to the use of single cut-off points on observed data, we used a simulation approach based on an estimated structural equation model (SEM) in order to examine the effect of measurement error on RD identification stability. We also examined the effect of single cut-offs by using a simulation-based buffer zone. Our results showed that measurement error affects the identification of RD over time. The use of a simulation-based buffer zone could control both the effects of measurement error and the arbitrariness of single cut-offs and lead to more accurate classification into RD groups, especially for those with scores close to the cut-offs. However, even after controlling for measurement error and using buffer zones, RD was not stable over time for all children, but both resolving and late-emerging groups existed. The findings suggest that reading development needs to be followed closely beyond the early grades and that reading instruction should be planned according to individual needs at specific time points. There is a clear need for further consideration of the mechanisms underlying the stability and instability of RD.https://www.frontiersin.org/article/10.3389/fpsyg.2019.02841/fullreading difficultiesstabilitymeasurement errorcut-offssimulationreading fluency |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Maria Psyridou Asko Tolvanen Marja-Kristiina Lerkkanen Anna-Maija Poikkeus Minna Torppa |
spellingShingle |
Maria Psyridou Asko Tolvanen Marja-Kristiina Lerkkanen Anna-Maija Poikkeus Minna Torppa Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification Frontiers in Psychology reading difficulties stability measurement error cut-offs simulation reading fluency |
author_facet |
Maria Psyridou Asko Tolvanen Marja-Kristiina Lerkkanen Anna-Maija Poikkeus Minna Torppa |
author_sort |
Maria Psyridou |
title |
Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification |
title_short |
Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification |
title_full |
Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification |
title_fullStr |
Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification |
title_full_unstemmed |
Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification |
title_sort |
longitudinal stability of reading difficulties: examining the effects of measurement error, cut-offs, and buffer zones in identification |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Psychology |
issn |
1664-1078 |
publishDate |
2020-01-01 |
description |
This study examined the stability of reading difficulties (RD) from grades 2 to 6 and focused on the effects of measurement error and cut-off selection in the identification of RD and its stability with the use of simulations. It addressed methodological limitations of prior studies by (a) applying a model-based simulation analysis to examine the effects of measurement error and cut-offs in the identification of RD, (b) analyzing a non-English and larger sample, and (c) examining RD in both reading fluency and reading comprehension. Reading fluency and reading comprehension of 1,432 Finnish-speaking children were assessed in grades 2 and 6. In addition to the use of single cut-off points on observed data, we used a simulation approach based on an estimated structural equation model (SEM) in order to examine the effect of measurement error on RD identification stability. We also examined the effect of single cut-offs by using a simulation-based buffer zone. Our results showed that measurement error affects the identification of RD over time. The use of a simulation-based buffer zone could control both the effects of measurement error and the arbitrariness of single cut-offs and lead to more accurate classification into RD groups, especially for those with scores close to the cut-offs. However, even after controlling for measurement error and using buffer zones, RD was not stable over time for all children, but both resolving and late-emerging groups existed. The findings suggest that reading development needs to be followed closely beyond the early grades and that reading instruction should be planned according to individual needs at specific time points. There is a clear need for further consideration of the mechanisms underlying the stability and instability of RD. |
topic |
reading difficulties stability measurement error cut-offs simulation reading fluency |
url |
https://www.frontiersin.org/article/10.3389/fpsyg.2019.02841/full |
work_keys_str_mv |
AT mariapsyridou longitudinalstabilityofreadingdifficultiesexaminingtheeffectsofmeasurementerrorcutoffsandbufferzonesinidentification AT askotolvanen longitudinalstabilityofreadingdifficultiesexaminingtheeffectsofmeasurementerrorcutoffsandbufferzonesinidentification AT marjakristiinalerkkanen longitudinalstabilityofreadingdifficultiesexaminingtheeffectsofmeasurementerrorcutoffsandbufferzonesinidentification AT annamaijapoikkeus longitudinalstabilityofreadingdifficultiesexaminingtheeffectsofmeasurementerrorcutoffsandbufferzonesinidentification AT minnatorppa longitudinalstabilityofreadingdifficultiesexaminingtheeffectsofmeasurementerrorcutoffsandbufferzonesinidentification |
_version_ |
1724948376319950848 |