
doi: 10.1111/bmsp.12348
pmid: 38726687
Oral reading fluency (ORF) assessments are commonly used to screen at‐risk readers and evaluate interventions' effectiveness as curriculum‐based measurements. Similar to the standard practice in item response theory (IRT), calibrated passage parameter estimates are currently used as if they were population values in model‐based ORF scoring. However, calibration errors that are unaccounted for may bias ORF score estimates and, in particular, lead to underestimated standard errors (SEs) of ORF scores. Therefore, we consider an approach that incorporates the calibration errors in latent variable scores. We further derive the SEs of ORF scores based on the delta method to incorporate the calibration uncertainty. We conduct a simulation study to evaluate the recovery of point estimates and SEs of latent variable scores and ORF scores in various simulated conditions. Results suggest that ignoring calibration errors leads to underestimated latent variable score SEs and ORF score SEs, especially when the calibration sample is small.
Models, Statistical, Psychometrics, item response theory, Reproducibility of Results, count data, Dyslexia, Reading, Bias, oral reading fluency, Calibration, Humans, Computer Simulation, Educational Measurement, response time, measurement error, Applications of statistics to psychology
Models, Statistical, Psychometrics, item response theory, Reproducibility of Results, count data, Dyslexia, Reading, Bias, oral reading fluency, Calibration, Humans, Computer Simulation, Educational Measurement, response time, measurement error, Applications of statistics to psychology
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 2 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
