Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification

This study examined the stability of reading difficulties (RD) from grades 2 to 6 and focused on the effects of measurement error and cut-off selection in the identification of RD and its stability with the use of simulations. It addressed methodological limitations of prior studies by (a) applying...

Full description

Bibliographic Details
Main Authors: Maria Psyridou, Asko Tolvanen, Marja-Kristiina Lerkkanen, Anna-Maija Poikkeus, Minna Torppa
Format: Article
Language:English
Published: Frontiers Media S.A. 2020-01-01
Series:Frontiers in Psychology
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fpsyg.2019.02841/full
id doaj-a65691f9931d4c16a0c13e490054d32a
record_format Article
spelling doaj-a65691f9931d4c16a0c13e490054d32a2020-11-25T02:03:25ZengFrontiers Media S.A.Frontiers in Psychology1664-10782020-01-011010.3389/fpsyg.2019.02841499441Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in IdentificationMaria Psyridou0Asko Tolvanen1Marja-Kristiina Lerkkanen2Anna-Maija Poikkeus3Minna Torppa4Department of Teacher Education, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, FinlandDepartment of Psychology, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, FinlandDepartment of Teacher Education, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, FinlandDepartment of Teacher Education, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, FinlandDepartment of Teacher Education, Faculty of Education and Psychology, University of Jyväskylä, Jyväskylä, FinlandThis study examined the stability of reading difficulties (RD) from grades 2 to 6 and focused on the effects of measurement error and cut-off selection in the identification of RD and its stability with the use of simulations. It addressed methodological limitations of prior studies by (a) applying a model-based simulation analysis to examine the effects of measurement error and cut-offs in the identification of RD, (b) analyzing a non-English and larger sample, and (c) examining RD in both reading fluency and reading comprehension. Reading fluency and reading comprehension of 1,432 Finnish-speaking children were assessed in grades 2 and 6. In addition to the use of single cut-off points on observed data, we used a simulation approach based on an estimated structural equation model (SEM) in order to examine the effect of measurement error on RD identification stability. We also examined the effect of single cut-offs by using a simulation-based buffer zone. Our results showed that measurement error affects the identification of RD over time. The use of a simulation-based buffer zone could control both the effects of measurement error and the arbitrariness of single cut-offs and lead to more accurate classification into RD groups, especially for those with scores close to the cut-offs. However, even after controlling for measurement error and using buffer zones, RD was not stable over time for all children, but both resolving and late-emerging groups existed. The findings suggest that reading development needs to be followed closely beyond the early grades and that reading instruction should be planned according to individual needs at specific time points. There is a clear need for further consideration of the mechanisms underlying the stability and instability of RD.https://www.frontiersin.org/article/10.3389/fpsyg.2019.02841/fullreading difficultiesstabilitymeasurement errorcut-offssimulationreading fluency
collection DOAJ
language English
format Article
sources DOAJ
author Maria Psyridou
Asko Tolvanen
Marja-Kristiina Lerkkanen
Anna-Maija Poikkeus
Minna Torppa
spellingShingle Maria Psyridou
Asko Tolvanen
Marja-Kristiina Lerkkanen
Anna-Maija Poikkeus
Minna Torppa
Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification
Frontiers in Psychology
reading difficulties
stability
measurement error
cut-offs
simulation
reading fluency
author_facet Maria Psyridou
Asko Tolvanen
Marja-Kristiina Lerkkanen
Anna-Maija Poikkeus
Minna Torppa
author_sort Maria Psyridou
title Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification
title_short Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification
title_full Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification
title_fullStr Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification
title_full_unstemmed Longitudinal Stability of Reading Difficulties: Examining the Effects of Measurement Error, Cut-Offs, and Buffer Zones in Identification
title_sort longitudinal stability of reading difficulties: examining the effects of measurement error, cut-offs, and buffer zones in identification
publisher Frontiers Media S.A.
series Frontiers in Psychology
issn 1664-1078
publishDate 2020-01-01
description This study examined the stability of reading difficulties (RD) from grades 2 to 6 and focused on the effects of measurement error and cut-off selection in the identification of RD and its stability with the use of simulations. It addressed methodological limitations of prior studies by (a) applying a model-based simulation analysis to examine the effects of measurement error and cut-offs in the identification of RD, (b) analyzing a non-English and larger sample, and (c) examining RD in both reading fluency and reading comprehension. Reading fluency and reading comprehension of 1,432 Finnish-speaking children were assessed in grades 2 and 6. In addition to the use of single cut-off points on observed data, we used a simulation approach based on an estimated structural equation model (SEM) in order to examine the effect of measurement error on RD identification stability. We also examined the effect of single cut-offs by using a simulation-based buffer zone. Our results showed that measurement error affects the identification of RD over time. The use of a simulation-based buffer zone could control both the effects of measurement error and the arbitrariness of single cut-offs and lead to more accurate classification into RD groups, especially for those with scores close to the cut-offs. However, even after controlling for measurement error and using buffer zones, RD was not stable over time for all children, but both resolving and late-emerging groups existed. The findings suggest that reading development needs to be followed closely beyond the early grades and that reading instruction should be planned according to individual needs at specific time points. There is a clear need for further consideration of the mechanisms underlying the stability and instability of RD.
topic reading difficulties
stability
measurement error
cut-offs
simulation
reading fluency
url https://www.frontiersin.org/article/10.3389/fpsyg.2019.02841/full
work_keys_str_mv AT mariapsyridou longitudinalstabilityofreadingdifficultiesexaminingtheeffectsofmeasurementerrorcutoffsandbufferzonesinidentification
AT askotolvanen longitudinalstabilityofreadingdifficultiesexaminingtheeffectsofmeasurementerrorcutoffsandbufferzonesinidentification
AT marjakristiinalerkkanen longitudinalstabilityofreadingdifficultiesexaminingtheeffectsofmeasurementerrorcutoffsandbufferzonesinidentification
AT annamaijapoikkeus longitudinalstabilityofreadingdifficultiesexaminingtheeffectsofmeasurementerrorcutoffsandbufferzonesinidentification
AT minnatorppa longitudinalstabilityofreadingdifficultiesexaminingtheeffectsofmeasurementerrorcutoffsandbufferzonesinidentification
_version_ 1724948376319950848