The impact of outliers on Cronbach's coefficient alpha estimate of reliability visual analogue scales

Educational and Psychological Measurement

Volumn 67, Issue 4, 2007, Pages 620-634

  Liu, Yan ^a   Zumbo, Bruno D ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Coefficient alpha; Outliers; Reliability; Visual analogue scale

Indexed keywords

EID: 34547207210     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164406296976     Document Type: Article

References (41)

1. Andrews, D.F., Bickel, P.J., Hampel, F.R., Huber, P.J., Rogers, W.H., Tukey, J.W. (1972). Robust estimates of location: Survey and advances. Princeton, NJ: Princeton University Press.
2. Anscombe, F.J. (1960). Rejection of outliers. Technometrics, 2, 123-146.
3. Barnett, V. (1978). The study of outliers: Purpose and model. Applied Statistics, 27, 242-250.
4. Barnett, V., Lewis, T. (1993). Outliers in statistical data (3 rd ed.). New York: John Wiley.
5. Barnette, J. (1999). Nonattending respondent effects on the internal consistency of self-administered surveys: A Monte Carlo simulation study. Educational and Psychological Measurement, 59, 38-46.
6. Beckman, R.J., Cook, R.D. (1983). Outlier..........s. Technometrics, 25, 119-149.
7. Blair, R.C., Higgins, J.J. (1980). The power of t and Wilconxon statistics: A comparison. Evaluation Review, 4, 645-656.
8. Blair, R.C., Higgins, J.J. (1981). A note on the asymptotic relative efficiency of the Wilcoxon rank-sum test relative to the independent means t test under mixtures of low normal distributions. British Journal of Mathematical and Statistical Psychology, 34, 124-128.
9. Bradley, J.V. (1980). Nonrobustness in Z, t, and F tests at large sample sizes. Bulletin of the Psychonomic Society, 16, 333-336.
10. Chatterjee, S., Hadi, A.S. (1986). Influential observations, high leverage points, and outliers in linear regression. Statistical Science, 1, 209-227.
11. Cohen, J. (1973). Eta-squared and partial eta-squared in fixed factor ANOVA designs. Educational and Psychological Measurement, 33, 107-112.
12. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum.
13. Cook R.D., Weisberg, S. (1980). Characterizations of an empirical influence function for detecting influential cases in regression. Technometrics, 22, 495-507.
14. Cortina, J.M. (1993). What is coefficient alpha: An examination of theory and applications. Journal of Applied Psychology, 78, 98-104.
15. Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 12, 1-16.
16. Cronbach, L.J. (2004). My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64, 391-418.
17. Draper N.R., Smith, H. (1981). Applied regression analysis (2 nd ed.). New York: John Wiley.
18. Freund, J.E., Walpole, R.E. (1980). Mathematical statistics (3 rd ed.). New Jersey: Prentice Hall.
19. Gelin, M.N., Beasley, T.M., Zumbo, B.D. (2003, April). What is the impact on scale reliability and exploratory factor analysis of a Pearson correlation matrix when some respondents are not able to follow the rating scale ? Paper presented at the annual meeting of the American Educational Research Association (AERA), Chicago, IL.
20. Henrysson, S., Wedman, I. (1972). Analysis of the inter-item covariance matrix. Scandinavian Journal of Educational Research, 16, 25-35.
21. Howell, D.C. (1997). Statistical methods for psychology. Belmont, CA: Duxbury Press.
22. Huber, P.J. (1964). Robust estimation of a location parameter. Annals of Mathematical Statistics, 35, 73-101.
23. Huber, P.J. (1972). Robust statistics: A review. Annals of Mathematical Statistics, 43, 1041-1067.
24. Huber, P.J. (1973). Robust regression: Asymptotics, conjectures and Monte Carlo. Annals of Statistics, 1, 799-821.
25. Huber, P.J. (1981). Robust statistics. New York: John Wiley.
26. Jreskog, K.G. (1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36, 109-133.
27. Lind, J.C., Zumbo, B.D. (1993). The continuity principle in psychological research: An introduction to robust statistics. Canadian Psychology, 34, 407-412.
28. Mosteller, F., Tukey, J.W. (1968). Data analysis, including statistics. In G. Lindzey E. Aronson (Eds.), The handbook of social psychology: Vol. 2. Research methods (pp. 80-203). Reading, MA: Addison-Wesley.
29. Novick, M.R., Lewis, M.R. (1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 32, 1-13.
30. Pellegrini, E.K., Scandura, T.A. (2005). Construct equivalence across groups: An unexplored issue in mentoring research. Educational and Psychological Measurement, 65, 323-335.
31. Reuterberg, S.E., Gustafsson, J.E. (1992). Confirmatory factor analysis and reliability: Testing measurement model assumptions. Educational and Psychological Measurement, 52, 795-811.
32. Slocum, S.L. (2005). Assessing unidimensionality of psychological scales: Using individual and integrative criteria from factor analysis. Unpublished doctoral dissertation, University of British Columbia, Canada.
33. Stevens, J.P. (1984). Outliers and influential data points in regression analysis. Psychological Bulletin, 95, 334-344.
34. Tukey, J.W. (1960). A survey of sampling from contaminated distributions. In I. Olkin, S. G. Ghury, W. Hoeffding, W. G. Madow, and H. B. Mann (Eds.), Contributions to probability and statistics (pp. 448-485). Palo Alto, CA: Stanford University Press.
35. Wilcox, R.R. (1992). Robust generalizations of classical test reliability and Cronbach's alpha. British Journal of Mathematical and Statistical Psychology, 45, 239-254.
36. Wilcox, R.R. (1998). How many discoveries have been lost by ignoring modern statistical methods? American Psychologist, 53, 300-314.
37. Wilcox, R.R. (2005). Introduction to robust estimation and hypothesis testing (2 nd ed.). San Diego, CA: Academic Press.
38. Zimmerman, D.W., Zumbo, B.D., Lalonde, C. (1993). Coefficient alpha as an estimate of test reliability under violation of two assumptions. Educational and Psychological Measurement, 53, 33-49.
39. Zumbo, B.D. (1994). The lurking assumptions in using generalizability theory to monitor an individual's progress. In D. Laveault, B. D. Zumbo, M. E. Gessaroli, M. Boss, (Eds.), Modern theories of measurement: Problems issues (pp. 261-278). Ottawa, Canada: University of Ottawa.
40. Zumbo, B.D., Jennings, M.J. (2002). The robustness of validity and efficiency of the related samples t-test in the presence of outliers. Psicologica, 23, 415-450.
41. Zumbo, B.D., Ochieng, C.O. (2003, April). The impact of Likert or rating scale mis-responding (differential responding) on commonly used statistical methods: An overview of the symposium and the methodology. Paper presented at the annual meeting of the American Educational Research Association (AERA), Chicago, IL.