
pmid: 35661320
The study presents statistical procedures that monitor functioning of items over time. We propose generalized likelihood ratio tests that surveil multiple item parameters and implement with various sampling techniques to perform continuous or intermittent monitoring. The procedures examine stability of item parameters across time and inform compromise as soon as they identify significant parameter shift. The performance of the monitoring procedures was validated using simulated and real assessment data. The empirical evaluation suggests that the proposed procedures perform adequately well in identifying the parameter drift. They showed satisfactory detection power and gave timely signals while regulating the error rates reasonably low. The procedures also showed superior performance when compared with the existent methods. The empirical findings suggest that multivariate parametric monitoring can provide an efficient and powerful control tool for maintaining the quality of items. The procedures allow joint monitoring of multiple item parameters and achieve sufficient power by dint of likelihood-ratio tests. Based on the findings from the empirical experimentation, we suggest some practical strategies for performing online item monitoring.
Likelihood Functions, Models, Statistical, Psychometrics, Educational Psychology, online monitoring, item parameter drift, Applications of statistics in engineering and industry; control charts, Empirical Research, Social and Behavioral Sciences, Sequential statistical analysis, sequential generalized likelihood ratio test, cumulative sum control chart, Quantitative Methods, response time, Applications of statistics to psychology
Likelihood Functions, Models, Statistical, Psychometrics, Educational Psychology, online monitoring, item parameter drift, Applications of statistics in engineering and industry; control charts, Empirical Research, Social and Behavioral Sciences, Sequential statistical analysis, sequential generalized likelihood ratio test, cumulative sum control chart, Quantitative Methods, response time, Applications of statistics to psychology
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 3 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
