Commentary on coefficient alpha: A cautionary tale

Psychometrika

Volumn 74, Issue 1, 2009, Pages 121-135

  Green, Samuel B ^a   Yang, Yanyun ^b  

^a ARIZONA STATE UNIVERSITY   (United States)

^b FLORIDA STATE UNIVERSITY   (United States)

Author keywords

Coefficient alpha; Reliability; Structural equation modeling; Violation of assumptions

Indexed keywords

EID: 61449142568     PISSN: 00333123     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11336-008-9098-4     Document Type: Article

References (65)

1. G. Becker 2000 How important is transient error in estimating reliability? Going beyond simulation studies Psychological Methods 5 370 379
2. P.M. Bentler J.A. Woodward 1980 Inequalities among lower bounds to reliability: With applications to test construction and factor analysis Psychometrika 45 249 267
3. Bollen, K.A. (1989). Structural equations with latent variables. New York: Wiley.
4. R.B. Cattell B. Tsujioka 1964 The importance of factor-trueness and validity, versus homogeneity and orthogonality in test scales Educational and Psychological Measurement 24 3 30
5. F.F. Chen S.G. West K.H. Sousa 2006 A comparison of bifactor and second-order models of quality of life Multivariate Behavioral Research 41 189 224
6. J.M. Cortina 1993 What is coefficient alpha? An examination of theory and applications Journal of Applied Psychology 78 98 104
7. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Holt, Rinehart, and Winston.
8. L.J. Cronbach 1951 Coefficient alpha and the internal structure of tests Psychometrika 16 297 334
9. L.S. Feldt A.L. Qualls 1996 Bias in coefficient alpha arising from heterogeneity of test content Applied Measurement in Education 9 277 286
10. J. Fleishman J. Benson 1987 Using LISREL to evaluate measurement models and scale reliability Educational and Psychological Measurement 47 925 939
11. D.W. Gerbing J.C. Anderson 1988 An updated paradigm for scale development incorporating unidimensionality and its assessment Journal of Marketing Research 25 186 192
12. M.E. Gessaroli J.C. Folske 2002 Generalizing the reliability of tests comprised of testlets International Journal of Testing 2 277 295
13. S.B. Green 2003 A coefficient alpha for test-retest data Psychological Methods 8 88 101
14. S.B. Green S.L. Hershberger 2000 Correlated errors in true score models and their effect on coefficient alpha Structural Equation Modeling 7 251 270
15. Green, S.B., & Yang, Y. (2009). Reliability of summed item scores using structural equation modeling: An alternative to coefficient alpha. Psychometrika, 94. doi: 10.1007/s11336-008-9099-3.
16. S.B. Green R.W. Lissitz S.A. Mulaik 1977 Limitations of coefficient alpha as an index of test unidimensionality Educational and Psychological Measurement 37 827 838
17. S.B. Green T.M. Akey K.K. Fleming S.L. Hershberger J.G. Marquis 1997 Effect of the number of scale points on chi-square fit indices in confirmatory factor analysis Structural Equation Modeling 4 108 120
18. L.A. Guttman 1945 A basis for analyzing test-retest reliability Psychometrika 10 255 282
19. J. Hattie 1985 Methodology review: Assessing unidimensionality of test and items Applied Psychological Measurement 9 139 164
20. J.L. Horn 1965 A rationale and a test for the number of factors in factor analysis Psychometrika 30 179 185
21. Humphreys, L.G. (1985). General intelligence: An integration of factor, test, and simplex theory. In B.B. Wolman (Ed.), Handbook of intelligence: Theories, measurements, and applications (pp. 15-35). New York: Wiley.
22. P.H. Jackson C.C. Agunwamba 1977 Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: I. Algebraic lower bounds Psychometrika 42 567 578
23. K.G. Jöreskog 1971 Statistical analysis of sets of congeneric test Psychometrika 36 109 133
24. L.F. Leary N.J. Dorans 1985 Implications for altering the context in which test items appear: A historical perspective on an immediate concern Review of Educational Research 55 387 411
25. G. Lee D.A. Frisbie 1999 Estimating reliability under a generalizability theory model for test scores composed of testlets Applied Measurement in Education 12 237 255
26. G. Lee S.B. Dunbar D.A. Frisbie 2001 The relative appropriateness of eight measurement models for analyzing scores from tests composed of testlets Educational and Psychological Measurement 61 958 975
27. Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental test scores. Reading: Addison-Wesley.
28. Lucke, J.F. (2005). "Rassling the hog": The influence of correlated item error on internal consistency, classical reliability, and congeneric reliability. Applied Psychological Measurement, pp. 106-125.
29. A.E. Maxwell 1968 The effect of correlated errors on estimates of reliability coefficients Educational and Psychological Measurement 28 803 811
30. R.P. McDonald 1981 The dimensionality of test and items British Journal of Mathematical and Statistical Psychology 34 100 117
31. McDonald, R.P. (1999). Test theory: A unified approach. Hillsdale: Erlbaum.
32. M.B. Miller 1995 Coefficient alpha: A basic introduction from the perspectives of classical test theory and structural equation modeling Structural Equation Modeling 2 255 273
33. M.R. Novick C. Lewis 1967 Coefficient alpha and the reliability of composite measurements Psychometrika 32 1 13
34. Ochieng, C.O. (2001). Effects of item order on consistency and precision under different ordering schemes in attitudinal scales: A case of physical self-concept scales (Paper No. ESQESS-2001-3). University of British Columbia. Edgeworth Laboratory for Quantitative Educational and Social Science, Vancouver, B.C.
35. T. Raykov 1997 Estimation of composite reliability for congeneric measures Applied Psychological Measurement 21 173 184
36. T. Raykov 1998 Coefficient alpha and composite reliability with interrelated nonhomogeneous items Applied Psychological Measurement 22 375 385
37. T. Raykov 2001 Bias of coefficient α for fixed congeneric measures with correlated errors Applied Psychological Measurement 25 69 76
38. T. Raykov P. Shrout 2002 Reliability of scales with general structure: Point and interval estimation using a structural equation modeling approach Structural Equation Modeling 9 195 212
39. S.P. Reise N.G. Waller A.L. Comrey 2000 Factor analysis and scale revision Psychological Assessment 12 287 297
40. S.P. Reise J. Morizot R.D. Hays 2007 The role of the bifactor model in resolving dimensionality issues in health outcomes measures Quality of Life Research 16 19 31
41. D. Rindskopf T. Rose 1988 Some theory and applications of confirmatory second-order factor analysis Multivariate Behavioral Research 23 51 67
42. Rozeboom, W.W. (1966). Foundations of the theory of prediction. Homewood: Dorsey.
43. W.W. Rozeboom 1989 The reliability of a linear composite of nonequivalent subtests Applied Psychological Measurement 13 277 283
44. M. Roznowski L.R. Tucker L.G. Humphreys 1991 Three approaches to determining the dimensionality of binary items Applied Psychological Measurement 15 109 127
45. J. Schmid J.M. Leiman 1957 The development of hierarchical factor solutions Psychometrika 22 53 61
46. K.T. Schurr L.W. Henriksen 1983 Effects of item sequencing and grouping in low-inference type questionnaires Journal of Educational Measurement 20 379 391
47. Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach's alpha. Psychometrika, 94. doi: 10.1007/s11336-008-9101- 0.
48. S.G. Sireci D. Thissen H. Wainer 1991 On the reliability of testlet-based tests Journal of Educational Measurement 28 237 247
49. J.E. Sparfeldt S.R. Schilling D.H. Rost 2006 Blocked versus randomized format of questionnaires: A confirmatory Educational and Psychological Measurement 66 961 974
50. L. Steinberg 2001 The consequences of pairing questions: Context effects in personality measurement Journal of Personality and Social Psychology 81 332 342
51. L. Steinberg D. Thissen 1996 Uses of item response theory and the testlet concept in the measurement of psychopathology Psychological Methods 1 81 97
52. J.M.F. Ten Berge H.A.L. Kiers 1991 A numerical approach to the exact and the approximate minimum rank of a covariance matrix Psychometrika 56 309 315
53. Ten Berge, J.M.F., & Kiers, H.A.L. (2003). The minimum rank factor analysis program MRFA. Internal report, Department of Psychology, University of Groningen, The Netherlands.
54. J.G. Veres R.R. Sims T.S. Locklear 1991 Improving the reliability of Kolb's revised learning style inventory Educational & Psychological Measurement 51 143 150
55. H. Wainer G.L. Kiely 1987 Item clusters and computerized adaptive testing: A case of testlets Journal of Educational Measurement 24 185 201
56. B. Woodhouse E.H. Jackson 1977 Lower bounds for the reliability of a test composed of nonhomogeneous items II: A search procedure to locate the greatest lower bound Psychometrika 42 579 591
57. Yang, Y., & Green, S.B. (2007). Coefficient alpha and SEM estimates of reliability. Presented at annual meeting of the American Educational Research Association.
58. W.M. Yen 1984 Effects of local item dependence on the fit and equating performance of the three-parameter logistic model Applied Psychological Measurement 8 125 145
59. W.M. Yen 1993 Scaling performance assessments: Strategies for managing local item dependence Journal of Educational Measurement 30 187 214
60. Y.F. Yung D. Thissen L.D. McLeod 1999 On the relationship between the higher-order factor model and the hierarchical factor model Psychometrika 64 113 128
61. D.W. Zimmerman R.D. Zumbo C. Lalonde 1993 Coefficient alpha as an estimate of test reliability under violation of two assumptions Educational and Psychological Measurement 53 33 49
62. H: Their relations with each other and two alternative conceptualizations of reliability Psychometrika 70 123 133
63. h for structures containing two group factors: Perils and prospects Applied Psychological Measurement 15 135 157
64. Zumbo, B.D., & Rupp, A.A. (2004). Responsible modeling of measurement data for appropriate inferences: Important advances in reliability and validity theory. In D. Kaplan (Ed.), The SAGE handbook of quantitative methodology for the social sciences (pp. 73-92). Thousand Oaks: Sage.
65. W.R. Zwick W.F. Velicer 1986 Comparison of five rules for determining the number of components to retain Psychological Bulletin 99 432 442