Effects of measurement errors on psychometric measurements in ergonomics studies: Implications for correlations, ANOVA, linear regression, factor analysis, and linear discriminant analysis

Ergonomics

Volumn 52, Issue 5, 2009, Pages 499-511

  Liu, Yan ^a   Salvendy, Gavriel ^b,c  

^a Wright State University   (United States)

^b SCHOOL OF INDUSTRIAL ENGINEERING   (United States)

^c TSINGHUA UNIVERSITY   (China)

Author keywords

Measurement errors; Reliability; Statistical analysis

Indexed keywords

ANALYSIS OF VARIANCE (ANOVA); DISCRIMINANT ANALYSIS; ERGONOMICS; FACE RECOGNITION; FORESTRY; IMAGE RETRIEVAL; MEASUREMENTS; QUALITY ASSURANCE; RANDOM ERRORS; REGRESSION ANALYSIS; RELIABILITY ANALYSIS; RESEARCH;

BIOMEDICAL ANALYSIS; DISCRIMINANT FUNCTIONS; DISCRIMINATION ABILITY; DISCRIMINATION ANALYSIS; ERGONOMICS RESEARCH; FACTOR ANALYSIS; LINEAR DISCRIMINANT ANALYSIS; RANDOM MEASUREMENT ERRORS; REGRESSION COEFFICIENT; RESEARCH PROGRESS; STATISTICAL ANALYSIS; STATISTICAL ANALYSIS TOOLS; STATISTICAL POWER; SURVEY METHODS; THEORY DEVELOPMENT;

MEASUREMENT ERRORS;

ANALYSIS OF VARIANCE; ARTICLE; CHEMICAL ANALYSIS; CORRELATION ANALYSIS; DISCRIMINANT ANALYSIS; ELECTROPHYSIOLOGY; ERGONOMICS; FACTORIAL ANALYSIS; LINEAR REGRESSION ANALYSIS; MEASUREMENT ERROR; PSYCHOMETRY; RELIABILITY; BIOENGINEERING; HUMAN; MEDICAL RESEARCH; PROCEDURES; REPRODUCIBILITY; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS; STATISTICS AND NUMERICAL DATA;

ANALYSIS OF VARIANCE; BIOMEDICAL RESEARCH; DATA INTERPRETATION, STATISTICAL; HUMAN ENGINEERING; HUMANS; LINEAR MODELS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; STATISTICS AS TOPIC;

EID: 68349160601     PISSN: 00140139     EISSN: 13665847     Source Type: Journal    
DOI: 10.1080/00140130802392999     Document Type: Article

References (67)

1. American Educational Research Association, American Psychological Association, and the National Council on Measurement in Education, 1999. Standards for educational and Psychological testing. Washington, D.C.: American Educational Research Association.
2. Armor, D., 1974. Theta reliability and factor scaling. In: H. Costner, ed. Sociological methodology. San Francisco, CA: Jossey-Bass, 17-50.
3. Bakan, D., 1966. The test of significance in psychological research. Psychological Bulletin, 66, 423-437.
4. Bohrnstedt, G.W., 1983. Measurement. In: P.H. Rossi, J.D. Wright, and A.B. Anderson, eds. Handbook of survey research. New York: Academic Press, 69-121.
5. Brown, W., 1910. Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3, 296-322.
6. Carayon, P. and Salvendy, G., 1997. Data collection and evaluation of outcome measures. In: G. Salvendy, ed. Handbook of human factors and ergonomics, 2nd edition. New York: John Wiley & Sons Inc., 1451-1471.
7. Carmines, E.G. and Zeller, R.A., 1979. Reliability and validity assessment. Thousand Oaks, CA: Sage Publications.
8. Carroll, R.J. and Stefanski, L.A., 1995. Measurement error in nonlinear models. London: Chapman & Hall.
9. Chang, C.-H., Wang, J.-D., and Hwang, Y.-H., 2004. Development of a monitoring system for keyboard users' performance. Ergonomics, 47 (14), 1571-1581.
10. Cliff, N., 1984. An improved internal consistency reliability estimate. Journal of Educational Statistics, 9, 151-161.
11. Cohen, J., 1994. The earth is round (p < .05). American Psychologist 49, 997-1003.
12. Crocker, L. and Algina, J., 1986. Introduction to classical and modern test theory. New York: CBS College Publishing.
13. Cronbach, L.J., 1951. Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
14. Cronbach, L.J. and Furby, L., 1970. How should we measure 'change' - Or should we? Psychological Bulletin, 74, 68-80.
15. Cummings, M.L., 2004. The need for command and control instant message adaptive interfaces: Lessons learned from Tactical Tomahawk human-in-the-loop simulations. Cyberpsychology & Behavior, 7 (6), 653-661.
16. Demerouti, E., et al. 2004. The impact of shiftwork on work-home conflict, job attitudes and health. Ergonomics, 47 (9), 987-1002.
17. Dixon, P. and O'Reilly, T., 1999. Scientific versus statistical inference. Canadian Journal of Experimental Psychology, 53, 133-149.
18. Dwyer, J.H., 1983. Statistical models for the social and behavioral sciences. New York: Oxford University Press Inc.
19. Edwards, P.J., et al. 2005. Understanding users with diabetic retinopathy: Factors that affect performance in a menu selection task. Behaviour and Information Technology, 24 (3), 175-186.
20. Edwards, W., 1965. Tactical note on the relation between scientific and statistical hypotheses. Psychological Bulletin, 63, 400-402.
21. Embretson, S.E., 1996. The new rules of measurement. Psychological Assessment, 8 (4), 341-349.
22. Everitt, B.S. and Dunn, G., 1991. Applied multivariate data analysis London: Halsted Press.
23. Eysenck, H.J. and Fulker, D.W., 1979. The structure and measurement of intelligence. New York: Springer-Verlag.
24. Fabrigar, L.R., et al. 1999. Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299.
25. Fitts, P.M., 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47, 381-391.
26. Fleiss, J.L., 1971. Measuring nominal scale agreement among many raters. Psychological Bulletin, 76 (5), 378-382.
27. Fuller, W.A., 1987. Measurement error models. New York: John Wiley & Sons Inc.
28. Ghiselli, E.E., Campbell, J.P., and Zedeck, S., 1981. Measurement theory for the behavioral sciences. New York: Freeman Press.
29. Giles, D., 2002. Advanced research methods in psychology. New York: Routledge.
30. Gill, J., 2002. Bayesian methods: A social and behavioral sciences approach. New York: Chapman & Hall.
31. Gleser, L.J., Carroll, R.J., and Gallo, P.P., 1987. The limiting distribution of least squares in an errors-in-variables linear regression model. Annals of Statistics, 15, 220-233.
32. Harlow, L.L., Mulaik, S.A., and Steiger, J.H. eds. 1997. What if there were no significance tests? Mahwah, NJ: Lawrence Erlbaum.
33. Heise, D.R. and Bohrnstedt, G.W., 1970. Validity, invalidity, and reliability. In: E. Borgatta and G.W. Bohrnst, eds. Sociological methodology. San Francisco, CA: Jossey-Bass, 104-129.
34. Hinkle, D.E., Wiersma, W., and Jurs, S.G., 1998. Applied statistics for the behavioral sciences, 5th edition. Boston, MA: Houghton Mifflin.
35. Hosmer, D. and Lemeshow, S., 1989. Applied logistic regression. New York: John Wiley and Sons, Inc.
36. Howard, E.P., 1985. Applying the Rasch Model to test administration. Journal of Nursing Education, 24, 340-343.
37. Huberty, C., 1987. On statistical testing. Educational Researcher, 16, 4-9.
38. Jeng, M., 2006. Error in statistical tests of error in statistical tests. BMC Medical Research Methodology, 6 (45) [online]. Available from: http://www.pubmedcentral.nih.gov/ articlerender.fcgi?artid=1586023 [Accessed 10 December 2007].
39. Johnson, R.A. and Wichern, D.W., 2002. Applied multivariate statistical analysis. Upper Saddle Rever, NJ: Prentice Hall.
40. Keppel, G. and Wickens, T., 2004. Design and analysis: A researcher's handbook, 4th edition. Upper Saddle Rever, NJ: Pearson Prentice Hall.
41. Kim, B. and Bishu, R.R., 1996. On assessing operator response time in human reliability analysis (HRA) using a possibilistic fuzzy regression model. Reliability Engineering & System Safety, 52 (1), 27-34.
42. Kirk, R., 1996. Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746-759.
43. Klecka, W., 1980. Discriminant analysis. Thousand Oaks, CA: Sage Publications.
44. Knapp, T.R., 1991. Coefficient alpha: Conceptualizations and anomalies. Research in Nursing & Health, 14, 457-460.
45. Knapp, T.R., 2002. Reliability of measuring instruments, 2nd edition. Vancouver, Canada: Edgeworth Laboratory for Quantitative Educational and Behavioral Science Series, University of British Columbia.
46. Kossinets, G., 2006. Effects of missing data in social networks. Social Networks, 28 (3), 247-268.
47. Krus, D.J. and Helmstadter, G.C., 1993. The problem of negative reliabilities. Educational and Psychological Measurement, 53, 643-650.
48. Kuder, G.F. and Richardson, M.W., 1937. The theory of the estimation of test reliability. Psychometrika, 2, 151-160.
49. LeMay, M. and Hird, E., 1985. Operator work load: When is enough? Communications of ACM, 29 (7), 638-642.
50. McDonald, R.P., 1999. Test theory: A unified treatment. Mahwah, NJ: Erlbaum.
51. MacKenzie, I.S. and Zhang, S.X., 2001. An empirical investigation of the novice experience with soft keyboards. Behaviour & Information Technology, 20, 411-418.
52. Magnusson, D., 1967. Test theory. Reading, MA: Addison-Wesley Publishing Company.
53. Miller, G.L., Yearout, R.D., and Neimkin, R., 1998. Assessing carpal tunnel syndrome Risk via discriminant analysis. In: S. Kumar, ed. Advances in occupational ergonomics and safety. Amsterdam: IOS Press, 794-797.
54. Montgomery, D.C., 2005. Design and analysis of experiments, 6th edition. Hoboken, NJ: John Wiley & Sons Inc.
55. Oviatt, S., 1995. Predicting spoken disfluencies during human-computer interaction. Computer Speech and Language, 9 (1), 19-35.
56. Raju, N.S., 1977. A generalization of coefficient alpha. Psychometrika, 42, 549-565.
57. Reichardt, C.S. and Gollob, H.F., 1997. When confidence intervals should be used instead of statistical tests, and vice versa. In: L.L. Harlow, S.A. Mulaik, and J.H. Steiger, eds. What if there were no significance tests? Mahwah, NJ: Lawrence Erlbaum, 259-284.
58. Salvendy, G. and Seymour, W.D., 1973. Prediction and development of industrial work performance. New York: John Wiley & Sons Inc.
59. Schmidt, F.L. and Hunter, J.E., 1996. Measurement error in psychological research: Lessons from 26 research scenarios. Psychological Methods 1 (2), 199-223.
60. Schneeweiss, H. and Augustin, T., 2006. Some recent advances in measurement error models and methods. Allgemenies Statistisches Archiv, 90 (1), 183-197.
61. Serlin, R.C. and Lapsley, D.K., 1985. Rationality in psychological research. American Psychologist, 40, 73-83.
62. Shrout, P.E. and Fleiss, J.L., 1979. Intraclass correlations: Use in assessing interrater reliability. Psychological Bulletin, 86, 420-428.
63. Thompson, B., 1994. The concept of statistical significance testing. Practical Assessment, Research & Evaluation, 4 (5) [online]. Available from: http://PAREonline.net/getvn.asp?v=4&n=5 [Accessed 10 December 2007].
64. Toms, E.G. and Taves, A.R., 2004. Measuring user perceptions of Web site reputation. Information Processing & Management, 40 (2), 291-317.
65. Torkzadeh, R., Pflughoeft, K., and Hall, L., 1999. Computer self-efficacy, training effectiveness and user attitudes: An empirical study. Behaviour and Information Technology, 18 (4), 299-309.
66. Viswanathan, M., 2005. Measurement error and research design. Thousand Oaks, CA: Sage Publication Inc.
67. Weisberg, S., 2005. Applied linear regression, 3rd edition. Hoboken, NJ: John Wiley & Sons.