"Rassling the hog": The influence of correlated item error on internal consistency, Classical reliability, and congeneric reliability

Applied Psychological Measurement

Volumn 29, Issue 2, 2005, Pages 106-125

  Lucke, Joseph F ^a  

^a UNIVERSITY OF TEXAS HEALTH SCIENCE CENTER AT SAN ANTONIO   (United States)

Author keywords

Classical reliability; Coefficient alpha; Coefficient omega; Compound symmetry; Congeneric reliability; Correlated item error; Deviance from true score equivalence; Internal consistency; Reliability; Total item error covariance; True score equivalence

Indexed keywords

EID: 14544306973     PISSN: 01466216     EISSN: None     Source Type: Journal    
DOI: 10.1177/0146621604272739     Document Type: Article

References (40)

1. Bollen, K. A. (1989). Structural equations with latent variables. New York: John Wiley.
2. Carmines, E. G., & McIver, J. P. (1981). Analyzing models with unobservable variables: Analysis of covariance structures. In G. W. Bohrnstedt & E. F. Borgatta (Eds.), Social measurement (pp. 65-115). Beverly Hills, CA: Sage.
3. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334.
4. Feldt, L. S. (2002). Estimating the internal consistency reliability of tests composed of testlets varying in length. Applied Measurement in Education, 15(1), 33-48.
5. Green, S. B., & Herschberger, S. L. (2000). Correlated errors in true score models and their effect on coefficient alpha. Structural Equation Modeling, 7(2), 251-270.
6. Guttman, L. (1945). A basis for analyzing test-retest reliability. Psychometrika, 70(4), 255-282.
7. Guttman, L. (1953). Reliability formulas that do not assume experimental independence. Psychometrika, 18(3), 225-239.
8. Jöreskog, K. G. (1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36, 109-133.
9. Jöreskog, K. G., & Sörbom, D. (1996). LISREL 8 user's guide. Chicago: Scientific Software International.
10. Komaroff, E. (1997). Effect of simultaneous violations of essential τ-equivalence and uncorrelated error on coefficient a. Applied Psychological Measurement, 27(4), 337-348.
11. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores with contributions by Allan Birnbaum. Reading, MA: Addison-Wesley.
12. McDonald, R. P. (1970). The theoretical foundations of common factor analysis, principal factor analysis, and alpha factor analysis. British Journal of Mathematical and Statistical Psychology, 23, 1-21.
13. McDonald, R. P. (1981). The dimensionality of tests and items. British Journal of Mathematical and Statistical Psychology, 34, 100-117.
14. McDonald, R. P. (1985). Factor analysis and related methods. Hillsdale, NJ: Lawrence Erlbaum.
15. McDonald, R. P. (1999). Test theory: A unified approach. Mahwah, NJ: Lawrence Erlbaum.
16. Miller, M. B. (1995). Coefficient alpha: A basic introduction from the perspectives of classical test theory and structural equation modeling. Structural Equation Modeling, 2(3), 255-273.
17. Muthén, B. O. (2002). Beyond SEM: General latent variable modeling. Behaviormetrika, 29(1), 81-117.
18. Muthén, L. K., & Muthén, B. O. (2001). Mplus user's guide: Statistical analysis with latent variables (2nd ed.). Los Angeles: Author.
19. Novick, M. R., & Lewis, C. (1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 52(1), 1-13.
20. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
21. Raykov, T. (1997a). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 27(2), 173-184.
22. Raykov, T. (1997b). Scale reliability, Cronbach's coefficient alpha, and violations of essential tau-equivalence with fixed congeneric components. Multivariate Behavioral Research, 52(4), 329-353.
23. Raykov, T. (1998a). A method for obtaining standard errors and confidence intervals of composite reliability for congeneric items. Applied Psychological Measurement, 22(4), 369-374.
24. Raykov, T. (1998b). Coefficient alpha and composite reliability with interrelated nonhomogeneous items. Applied Psychological Measurement, 22(4), 375-385.
25. Raykov, T. (2001 a). Bias of coefficient α for fixed congeneric measures with correlated errors. Applied Psychological Measurement, 25(1), 69-76.
26. Raykov, T. (2001b). Estimation of congeneric scale reliability using covariance structure analysis with nonlinear constraints. British Journal of Mathematical and Statistical Psychology, 54, 315-323.
27. Raykov, T. (2002). Analytic estimation of standard error and confidence interval for scale reliability. Multivariate Behavioral Research, 57(1), 89-103.
28. Raykov, T., & Penev, S. (2001). The problem of equivalent structural models: An individual residual perspective. In G. A. Marcoulides & R. E. Schumacker (Eds.), New developments and techniques in structural equation modeling (pp. 297-321). Mahwah, NJ: Lawrence Erlbaum.
29. Raykov, T., & Shrout, P. E. (2002). Reliability of scales with general structure: Point and interval estimation using a structural equation modeling approach. Structural Equation Modeling, 9(2), 195-212.
30. Reuterberg, S.-E., & Gustafsson, J.-E. (1992). Confirmatory factor analysis and reliability: Testing measurement model assumptions. Educational and Psychological Measurement, 52, 795-811.
31. Rosenbaum, P. (1988). Item bundles. Psychometrika, 53, 349-359.
32. Rozeboom, W. W. (1966). Foundations of the theory of prediction. Homewood, IL: Dorsey.
33. Rozeboom, W. W. (1989). The reliability of a linear composite of nonequivalent subtests. Applied Psychological Measurement, 13(3), 277-283.
34. Shevlin, M., Miles, J. N. V., Davies, M. N. O., & Walker, S. (2000). Coefficient alpha: A useful indicator of reliability? Personality and Individual Differences, 28, 229-237.
35. Tuerlinckx, F., & De Boeck, P. (2004). Models for residual dependencies. In P. De Boeck & M. Wilson (Eds.), Explanatory item response models: A generalized linear and nonlinear approach. New York: Springer.
36. Wainer, H., & Kiely, G. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24, 185-201.
37. Wilson, M., & Adams, R. J. (1995). Rasch models for item bundles. Psychometrika, 60(2), 181-198.
38. Zimmerman, D. W., & Williams, R. H. (1980). Is classical test theory 'robust' under violations of the assumption of uncorrelated errors? Canadian Journal of Psychology, 34(3), 227-237.
39. Zimmerman, D. W., Zumbo, B. D., & Lalonde, C. (1993). Coefficient alpha as an estimate of test reliability under violations of two assumptions. Educational and Psychological Measurement, 53, 33-49.
40. Zumbo, B. D., & Rupp, A. (2004). Responsible modeling of measurement data for appropriate inferences: Important advances in reliability and validity theory. In D. Kaplan (Ed.), The Sage handbook of quantitative methodology for the social sciences. Thousand Oaks, CA: Sage.