Does test anxiety induce measurement bias in cognitive ability tests?

Intelligence

Volumn 36, Issue 6, 2008, Pages 526-538

  Reeve, Charlie L ^a   Bonaccio, Silvia ^b  

^a UNIVERSITY OF NORTH CAROLINA AT CHARLOTTE   (United States)

^b UNIVERSITY OF OTTAWA   (Canada)

Author keywords

Cognitive abilities; g; Intelligence testing; Measurement bias; Test anxiety

Indexed keywords

EID: 53849125827     PISSN: 01602896     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intell.2007.11.003     Document Type: Article

References (68)

1. Ackerman P.L., and Heggestad E.D. Intelligence, personality, and interests: Evidence for overlapping traits. Psychological Bulletin 121 (1997) 219-245
2. Arbuckle J.L., and Wothke W. Amos 4.0 user's guide (1996), SmallWaters Corporation, Chicago, IL
3. Aronson J.A., Lustina M.J., Good C., Keough K., Steele C.M., and Brown J. When White men can't do math: Necessary and sufficient factors in stereotype threat. Journal of Experimental Social Psychology 35 (1999) 29-46
4. Arvey R.D., Strickland W., Drauden G., and Martin C. Motivational components of test taking. Personnel Psychology 43 (1990) 695-716
5. Bagozzi R.P., and Edwards J.R. A general approach for representing constructs in organizational research. Organizational Research Methods 1 (1998) 45-87
6. Bentler P.M. Comparative fit indexes in structural models. Psychological Bulletin 107 (1990) 238-246
7. Bentler P.M., and Bonnett D.G. Significance test and goodness of fit in the analysis of covariance structures. Psychological Bulletin 88 (1980) 588-606
8. Browne M.W., and Cudeck R. Alternative ways of assessing model fit. Sociological Methods and Research 21 (1992) 230-258
9. Carroll J.B. Human cognitive abilities: A survey of factor-analytic studies (1993), Cambridge University Press, New York
10. Chan D. Racial subgroup differences in predictive validity perceptions on personality and cognitive ability tests. Journal of Applied Psychology 82 (1997) 311-320
11. Chan D., Schmitt N., DeShon R.P., Clause C.S., and Delbridge K. Reactions to cognitive ability tests: The relationships between race, test performance, face validity perceptions, and testtaking motivation. Journal of Applied Psychology 82 (1997) 300-310
12. Chan D., Schmitt N., Sacco J.M., and DeShon R.P. Understanding pretest and posttest reactions to cognitive ability and personality tests. Journal of Applied Psychology 83 (1998) 471-485
13. Covington, and Omelich. "I knew it was cold before the exam": A test of the anxiety-blockage hypothesis. Journal of Educational Psychology 79 (1987) 393-400
14. Croizet J.C., and Claire T. Extending the concept of stereotype and threat to social class: The intellectual underperformance of students from low socioeconomic backgrounds. Personality and Social Psychology Bulletin 24 (1998) 588-594
15. Ergene T. Effective interventions on test anxiety reduction: A meta-analysis. School Psychology International 24 (2003) 313-328
16. Eysenck, H. J. (1967). The biological basis of personality. Springfield, Il: Charles C. Thomas.
17. Eysenck H.J. Personality, learning, and anxiety. In: Eysenck H.J. (Ed). Handbook of abnormal psychology. 2nd. ed. (1973), Pitman, London
18. Eysenck M.W. Anxiety, learning, and memory: A reconceptualization. Journal of Research in Personality 13 (1979) 363-385
19. Eysenck H.J., and Eysenck M.W. Personality and individual differences: A natural science approach (1985), Plenum, New York, NY
20. Eysenck M.W., and Calvo M.G. Anxiety and performance: The processing efficiency theory. Cognition and Emotion 6 (1992) 409-434
21. Flanagan J.C., Dailey J.T., Shaycoft M.F., Gorham W.A., Orr D.B., and Goldberg I. Design for a study of American youth (1962), Houghton Mifflin, Boston
22. Gottfredson L.S. Why g matters: The complexity of everyday life. Intelligence 24 (1997) 79-132
23. Gray J.A. Causal theories of personality and how to test them. In: Royce J.R. (Ed). Multivariate analysis of psychological theory. (1973), Academic Press, New York
24. Gustafsson J.-E. Hierarchical models of individual differences in cognitive abilities. In: Sternberg R.J. (Ed). Advances in the Psychology of Human Intelligence (1988), NJ7 Erlbaum, Hillsdale 35-71
25. Gustafsson J.-E., and Balke G. General and narrow abilities as predictors of school achievement. Multivariate Behavioral Research 28 (1993) 407-434
26. Haladyna T.M., and Downing S.M. Construct-irrelevant variance in high-stakes testing. Educational Measurement: Issues and Practice 23 (2004) 17-27
27. Hembree R. Correlates, causes, effects, and treatment of test anxiety. Review of Educational Research 58 (1988) 47-77
28. Hu L., and Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 6 (1999) 1-55
29. Jensen A.R. Bias in mental testing (1980), Free Press, New York, NY
30. Jensen A.R. The g factor: The science of mental ability (1998), Praeger, Westport, CT
31. Liebert R.M., and Morris L.W. Cognitive and emotional components of test anxiety: A distinction and some initial data. Psychological Reports 20 (1967) 975-978
32. Loehlin J.C. Latent variable models. 4th ed. (2004), Lawrence Erlbaum, Mahwah, NJ
33. McCarthy J.M., and Goffin R.D. Is the Test Attitude Survey psychometrically sound. Educational and Psychological Measurement 63 (2003) 446-464
34. McGrew K.S. Analysis of the major intelligence batteries according to a proposed comprehensive Gf-Gc framework. In: Flanagan D.P., Genshaft J.L., and Harrison's P. (Eds). Contemporary intelligence assessment: Theories, tests, and issues (1997), Guilford Press, New York7 151-179
35. Messick S. Validity of psychological assessment: Validation of inferences from person's responses and performance as scientific inquiry into score meaning. American Psychologist 50 (1995) 741-749
36. Mellenbergh G.J. Item bias and item response theory. International Journal of Educational Research 13 (1989) 127-143
37. Meredith W. Measurement invariance, factor analysis and factorial invariance. Psychometrika 58 (1993) 525-543
38. Millsap R.E. Invariance in measurement and prediction: Their relationship in the single-factor case. Psychological Methods 2 (1997) 248-260
39. Muthén B. Some uses of structural equation modeling in validity studies: Extending IRT to external variables. In: Wainer H., and Braun H. (Eds). Test validity (1988), Erlbaum, Hillsdale, NJ 213-238
40. Muthén B.O. Using item specific instructional information in achievement modeling. Psychometrika 54 (1989) 385-396
41. Osborne J.W. Testing stereotype threat: Does anxiety explain race and sex differences in achievement?. Contemporary Educational Psychology 26 (2001) 291-310
42. Osborne J.W. Linking stereotype threat and anxiety. Educational Psychology 27 (2007) 135-154
43. Ruch W.W., and Stang S.W. Employee Aptitude Survey examiner's manual. 2nd ed. (1994), Psychological Services Inc, Glendale, CA
44. Ruch W.W., Stang S.W., McKillip R.H., and Dye D.A. Employee Aptitude Survey technical manual. 2nd ed. (2001), Psychological Services Inc, Glendale, CA
45. Ryan A.M., and Ployhart R.E. Applicants' perceptions of selection procedures and decisions: A critical review and agenda for the future. Journal of Management 26 (2000) 565-606
46. Sarason I.G. Experimental approaches to test anxiety: Attention and the uses of information. In: Spielberger C.D. (Ed). Anxiety: current trends in theory and research vol.2 (1972), Academic Press, New York 381-403
47. Satorra A., and Saris W.E. Power of the likelihood ratio test in covariance structure analysis. Psychometrika 50 (1985) 83-90
48. Schmitt N. Do reactions to tests produce changes in the construct measured?. Multivariate Behavioral Research 37 (2002) 105-126
49. Schmit M.J., and Ryan A.M. Test-taking dispositions: A missing link?. Journal of Applied Psychology 77 (1992) 629-637
50. Schmitt N., and Gilliland S.W. Beyond differential prediction: Fairness in selection. In: Saunders D.M. (Ed). New approaches to employee management: Fairness in employee selection vol. 1 (1992), JAI Press, Greenwich, CT 21-46
51. Shih M., Pittinsky T.L., and Ambady N. Stereotype susceptibility: Identity salience and shifts in quantitative performance. Psychological Science 10 (1999) 80-83
52. Spencer S.J., Steele C.M., and Quinn D.M. Stereotype threat and women's math performance. Journal Experimental Social Psychology 35 (1999) 4-28
53. Steele C.M., and Aronson J. Stereotype threat and the intellectual test performance of African Americans. Journal of Personality and Social Psychology 69 (1995) 797-811
54. Spearman C. "General intelligence," objectively determined and measured. American Journal of Psychology 15 (1904) 201-293
55. Spearman C. The abilities of man: Their nature and measurement (1927), MacMillan, New York
56. Spielberger C.D. The effects of anxiety on complex learning and academic achievement. In: Spielberger C.D. (Ed). Anxiety and behavior. (1966), Academic Press, New York
57. Spielberger C.D., Gorsuch R., and Lushene R. The State-trait Anxiety Inventory (STAI) test manual form X (1970), Consulting Psychologists Press, Palo Alto, CA
58. Spitz H.H. The raising of intelligence: A selected history of attempts to raise retarded intelligence (1986), Erlbaum, Hillsdale, NJ
59. Steiger, J. H., & Lind, J. M. (1980). Statistically based tests for the number of common factors. Paper presented at the Annual Meeting of the Psychometric Society, Iowa City, IA.
60. Stone J., Lynch C., Sjomeling M., and Darley J.M. Stereotype threat effects on Black and White athletic performance. Journal of Personality and Social Psychology 77 (1999) 1213-1227
61. Tobias S. Test anxiety: Interference, defective skills, and cognitive capacity. Educational Psychologist 20 (1985) 135-142
62. Tryon G. The measurement and treatment of test anxiety. Review of Educational Research 50 (1980) 353-372
63. Tucker L.R., and Lewis C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika 38 (1973) 1-10
64. Vandenberg R.J., and Lance C.E. A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods 3 (2000) 4-70
65. Wicherts J.M., Dolan C.V., and Hessen D.J. Stereotype threat and group differences in test performance: A question of measurement invariance. Journal of Personality and Social Psychology 89 (2005) 696-716
66. Wine J. Test anxiety and the direction of attention. Psychological Bulletin 76 (1971) 92-104
67. Zeidner M. Personality trait correlates of intelligence. In: Saklofske D.H., and Zeidner M. (Eds). International handbook of personality and intelligence (1995), Plenum Press, New York, NY 299-319
68. Zeidner M. Test anxiety: The state of the art (1998), Plenum Press, New York