Reliability

Preprint OPEN
Condon, David ; Revelle, William (2017)
  • Related identifiers: doi: 10.17605/OSF.IO/JGWM4
  • Subject: bepress|Social and Behavioral Sciences|Psychology|Quantitative Psychology | bepress|Social and Behavioral Sciences|Psychology | bepress|Social and Behavioral Sciences

Separating the signal in a test from the irrelevant noise is a challenge for all measurement. Low test reliability limits test validity, attenuates important relationships, and can lead to regression artifacts. Multiple approaches to the assessment and improvement of reliability are discussed. The advantages and disadvantages of several different approaches to reliability are considered. Practical advice on how to assess reliability using open source software is provided.
  • References (83)
    83 references, page 1 of 9

    Allport, G. W., & Odbert, H. S. (1936). Trait-names: A psycho-lexical study. Psychological Monographs, 47 (211).

    Atkinson, G., Waterhouse, J., Reilly, T., & Edwards, B. (2001). How to show that unicorn milk is a chronobiotic: The regression-to-the mean statistical artifact. Chronobiology International: The Journal of Biological & Medical Rhythm Research, 18 (6), 1041-1053.

    Bentler, P. (2009). Alpha, dimension-free, and model-based internal consistency reliability. Psychometrika, 74 (1), 137-143. doi: 10.1007/s11336-008-9100-1

    Bock, R. D. (1997). A brief history of item theory response. Educational Measurement: Issues and Practice, 16 (4), 21{33. Retrieved from http://dx.doi.org/10.1111/j.1745-3992.1997.tb00605.x doi: 10 .1111/j.1745-3992.1997.tb00605.x

    Brennan, R. L. (1997). A perspective on the history of generabability theory. Educational Measurement: Issues and Practice, 16 (4), 14{20. Retrieved from http://dx.doi.org/10.1111/j.1745-3992 .1997.tb00604.x doi: 10.1111/j.1745-3992.1997.tb00604.x

    Brennan, R. L., & Kane, M. T. (1977). Signal/noise ratios for domain referenced tests. Psychometrika, 42 (4), 609-625.

    Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3 (3), 296-322.

    Campbell, D. T., & Kenny, D. (1999). A primer on regression artifacts. Guilford Press.

    Cicero, M. T. (1877). Tusculan disputations (translated by C.D. Yonge, Ed.). New York: Harper & Brothers (Originally published c 45 BCE).

    Cole, D. A., Martin, N. C., & Steiger, J. H. (2005). Empirical and conceptual problems with longitudinal trait-state models: Introducing a trait-state-occasion model. Psychological Methods, 10 (1), 3{20.

  • Metrics
    No metrics available
Share - Bookmark

  • Download from
    PsyArXiv via PsyArXiv (Preprint, 2017)
  • Cite this publication