Progression through the ranks: Assessing employee reactions to high-stakes employment testing

Personnel Psychology

Volumn 62, Issue 4, 2009, Pages 793-832

  McCarthy, Julie ^a   Hrabluik, Coreen ^a   Jelley, R Blake ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b UNIVERSITY OF PRINCE EDWARD ISLAND   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 70449463647     PISSN: 00315826     EISSN: 17446570     Source Type: Journal    
DOI: 10.1111/j.1744-6570.2009.01158.x     Document Type: Article

References (96)

1. Alpert R, Haber RN 1960). Anxiety in academic achievement situations. Journal of Abnormal and Social Psychology, 10, 207 215.
2. Ambrose ML, Cropanzano R 2003). A longitudinal analysis of organizational fairness: An examination of reactions to tenure and promotion decisions. Journal of Applied Psychology, 88, 266 275.
3. Arbuckle J 2003). Amos 5.0. Chicago, IL : Smallwaters Corporation.
4. Arvey RD, Strickland W, Drauden G, Martin C 1990). Motivational components of test-taking. Personnel Psychology, 43, 695 715.
5. Bagdadli S, Roberson Q, Paoletti F 2006). The mediating role of procedural justice in responses to promotional decisions. Journal of Business and Psychology, 21, 83 102.
6. Bagozzi RP, Yi Y 1988). On the evaluation of structural equation models. Journal of the Academy of Marketing Science, 16, 74 94.
7. Bandura A 1989). Self-regulation of motivation and action through internal standards and goals systems. In Pervin LA (Eds. Goal concepts in personality and social psychology (pp. 19 85). Hillsdale, NJ : Erlbaum.
8. Barlow DH 2002). Anxiety and its disorders: The nature and treatment of anxiety and panic (2nd ed.). New York : Guilford.
9. Bauer TN, Truxillo DM, Paronto ME, Weekley JA, Campion MA 2004). Applicant reactions to different selection technology: Face-to-face interactive voice response, and computer-assisted telephone screening interviews. International Journal of Selection and Assessment, 12, 135 148.
10. Bauer TN, Truxillo DM, Sanchez RJ, Craig JM, Ferrara P, Campion MA 2001). Applicant reactions to selection: Development of the selection procedural justice scale (SPJS). Personnel Psychology, 54, 387 419.
11. Bauer TN, Truxillo DT, Tucker JS, Weathers V, Bertolino M, Erdogan B, et al. (2006). Selection in the information age: The role of personal information privacy concerns and computer use in understanding applicant reactions. Journal of Management, 32, 601 625.
12. Becton JB, Feild HS, Giles WF, Jones-Farmer A 2008). Racial differences in promotion candidate performance and reactions to selection procedures: A field study in a diverse top-management context. Journal of Organizational Behavior, 29, 265 285.
13. Bell BS, Wiechmann D, Ryan AM 2006). Consequences of organizational justice expectations in a selection system. Journal of Applied Psychology, 91, 455 466.
14. Bentler PM 1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238 246.
15. Bies RJ, Moag JS 1986). Interactional justice: Communication criteria of fairness. Research on Negotiations in Organizations, 1, 43 55.
16. Canadian Police Sector Council 2001). Strategic human resources analysis of public policing in Canada. Study commissioned by the Canadian Police Association and the Canadian Association of Chiefs of Police conducted by the Management Consulting Firm PricewaterhouseCoopers.
17. Carson PP, Carson KD, Griffeth RW, Steel RP 1994). Promotion and employee turnover: Critique, meta-analysis, and implications. Journal of Business and Psychology, 8, 455 466.
18. Catano VM, Darr W, Campbell CA 2007). Performance appraisal of behavior-based competencies: A reliable and valid procedure. Personnel Psychology, 60, 201 230.
19. Chan D, Schmitt N 2004). An agenda for future research on applicant reactions to selection procedures: A construct oriented approach. International Journal of Selection and Assessment, 12, 9 23.
20. Chan D, Schmitt N, DeShon R, Clause CS, Delbridge K 1997). Reactions to cognitive ability tests: The relationships between race, test performance, face validity perceptions, and test-taking motivation. Journal of Applied Psychology, 82, 300 310.
21. Chan D, Schmitt N, Sacco J, DeShon, R 1998). Understanding pretest and posttest reactions to cognitive ability and personality tests. Journal of Applied Psychology, 83, 471 485.
22. Cohen J 1992). A power primer. Psychological Bulletin, 112, 155 159.
23. Collins CJ, Han J 2004). Exploring applicant pool quantity and quality: The effects of early recruitment practice strategies, corporate advertising, and firm reputation. Personnel Psychology, 57, 685 717.
24. Donaldson S, Blanchard A 1995). The seven health practices, well-being, and performance at work: Evidence for the value of reaching small and underserved worksites. Preventive Medicine, 24, 270 277.
25. Eysenck MW, Calvo MG 1992). Anxiety and performance: The processing efficiency theory. Cognition and Emotion, 6, 409 434.
26. Eysenck MW, Derakshan N, Santos R, Calvo MG 2007). Anxiety and cognitive performance: Attentional control theory. Emotion, 7, 336 353.
27. Farmer SJ, Beehr TA, Love KG 2003). Becoming an undercover police officer: A note on fairness perceptions, behavior, and attitudes. Journal of Organizational Behavior, 24, 373 387.
28. Ferris GR, Buckley MR, Allen GM 1992). Promotion systems in organizations. Human Resources Planning, 15, 47 68.
29. Gaugler BB, Rosenthal DB, Thorton GC III., Bentson C 1987). Meta-analysis of assessment center validity. Journal of Applied Psychology, 72, 493 511.
30. George JM, Jones GR 1996). The experience of work and turnover intentions: Interactive effects of value attainment, job satisfaction, and positive mood. Journal of Applied Psychology, 81, 318 325.
31. Gilliland SW 1993). The perceived fairness of selection systems: An organizational justice perspective. Academy of Management Review, 18, 694 734.
32. Gilliland SW 1994). Effects of procedural and distributive justice on reactions to a selection system. Journal of Applied Psychology, 79, 691 701.
33. Greenberg J 1993). The social side of fairness: Interpersonal and informational classes of organizational justice. In Cropanzano R (Ed. Justice in the workplace: Approaching fairness in human resource management (pp. 79 103). Hillsdale, NJ : Erlbaum.
34. Greenhaus JH 1971). An investigation of the role of career salience in vocational behavior. Journal of Vocational Behavior, 1, 209 216.
35. Hausknecht JP, Day DV, Thomas SC 2004). Applicant reactions to selection procedures: An updated model and meta-analysis. Personnel Psychology, 57, 639 683.
36. Hembree R 1988). Correlates, causes, effects, and treatment of test anxiety. Review of Educational Research, 58, 7 77.
37. Hopko DR, Hunt MK, Armento ME 2005). Attentional task aptitude and performance anxiety. International Journal of Stress Management, 12, 389 408.
38. Ilies R, Scott BA, Judge TA 2006). The interactive effects of personal traits and experienced states on intraindividual patterns of citizenship behavior. Academy of Management Journal, 49, 561 575.
39. Jelley RB 2007). Police management job analysis and leadership needs assessment. Aylmer, ON : Ontario Police College, Ministry of Community Safety and Correctional Services. Queen's Printer for Ontario. Retrieved June 17, 2008, from http://www.opconline.ca/res/LNA/index.html
40. Johns G 1993). Constraints on the adoption of psychology-based personnel practices: Lessons from organizational innovation. Personnel Psychology, 46, 569 592.
41. Jones G 1995). More than just a game: Research developments and issues in competitive anxiety in sport. British Journal of Psychology, 86, 449 478.
42. Jones G, Swain A 1992). Intensity and direction as dimensions of competitive state anxiety and relationships with competitiveness. Perceptual and Motor Skills, 74, 467 472.
43. Judge TA, Scott BA, Ilies R 2006). Hostility, job attitudes, and workplace deviance: Test of a multilevel model. Journal of Applied Psychology, 91, 126 138.
44. Kanfer R, Ackerman PL 1989). Motivation and cognitive abilities: An integrative/aptitude-treatment interaction approach to skill acquisition. Journal of Applied Psychology, 74, 657 690.
45. Kaplowitz M, Hadlock T, Levine R 2004). A comparison of web and mail survey response rates. Public Opinion Quarterly, 68, 94 101. (Pubitemid 38750629)
46. Kravitz DA, Stinson V, Chavez TL 1996). Evaluations of tests used for making selection and promotion decisions. International Journal of Selection and Assessment, 4, 24 33.
47. Latham GP 2007). Work motivation: History, theory, research and practice. Thousand Oaks, CA : Sage.
48. Lievens F, De Corte W, Brysse K 2003). Applicant perceptions of selection procedures: The role of selection information, belief in tests, and comparative anxiety. International Journal of Selection and Assessment, 11, 67 77.
49. Lind EA 2001). Fairness heuristic theory: Justice judgments as pivotal cognitions in organizational relations. In Greenberg J, Cropanzano R (Eds. Advances in organization justice (pp. 56 88). Stanford, CA : Stanford University Press.
50. Lind EA, Tyler RR 1988). The social psychology of procedural justice. NewYork : Plenum.
51. Lyness KS, Schrader CA 2006). Moving ahead or just moving? An examination of gender differences in senior corporate management appointments. Group & Organization Management, 31, 651 676.
52. MacCallum RC, Browne MW, Sugawara HM 1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130 149.
53. MacKinnon DP, Krull JL, Lockwood CM 2000). Equivalence of the mediation, confounding and suppression effects. Prevention Science, 1, 173 181.
54. McCarthy JM, Goffin RD 2004). Measuring job interview anxiety: Beyond weak knees and sweaty palms. Personnel Psychology, 57, 607 637.
55. McCarthy JM, Goffin R 2005). Selection test anxiety: Exploring tension and fear of failure across the sexes in simulated selection contexts. International Journal of Selection and Assessment, 13, 282 295.
56. McClelland DC, Burham DH 2003). Power is the great motivator. Harvard Business Review, 1, 117 126.
57. McFarland LA, Ryan AM, Kriska SD 2003). Impression management use and effectiveness across assessment methods. Journal of Management, 29, 641 661.
58. McIntyre RM, Smith D, Hassett CE 1984). Accuracy of performance ratings as affected by rater training and perceived purpose of rating. Journal of Applied Psychology, 69, 147 156.
59. Meichenbaum D 1985). Stress inoculation training. New York : Pergamon.
60. Petty R, Cacioppo J 1986). Communication and persuasion: Central and peripheral routes to attitude change. New York : Springer-Verlag.
61. Ployhart RE, Ryan AM 1998). Applicants' reactions to the fairness of selection procedures: The effects of positive rule violations and time of measurement. Journal of Applied Psychology, 83, 3 16.
62. Ployhart RE, Ziegert JC, McFarland LA 2003). Understanding racial differences on cognitive ability tests in selection contexts: An integration of stereotype threat and applicant reactions research. Human Performance, 16, 231 259.
63. Podsakoff PM, MacKenzie SM, Lee J, Podsakoff NP 2003). Common method variance in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879 903.
64. Powell GN 1991). Applicant reactions to the initial employment interview: Exploring theoretical and methodological issues. Personnel Psychology, 44, 67 83.
65. Raffety BD, Smith RE, Ptacek JT 1997). Facilitating and debilitating trait anxiety, situational anxiety, and coping with an anticipated stressor: A process analysis. Journal of Personality and Social Psychology, 72, 892 906.
66. Ryan AM 2001). Explaining the black-white test score gap: The role of test perceptions. Human Performance, 14, 45 75.
67. Ryan AM, Ployhart RE 2000). Applicants' perceptions of selection procedures and decisions: A critical review and agenda for the future. Journal of Management, 26, 565 606.
68. Ryan AM, Ployhart RE, Greguras GI, Schmit MJ 1998). Test preparation programs in selection contexts: Self-selection and program effectiveness. Personnel Psychology, 51, 599 622.
69. Ryan AM, Sacco JM, McFarland LA, Kriska DS 2000). Applicant self-selection: Correlates of withdrawal from a multiple hurdle process. Journal of Applied Psychology, 85, 163 179.
70. Saal FE, Moore SC 1993). Perceptions of promotion fairness and promotion candidates' qualifications. Journal of Applied Psychology, 78, 105 110.
71. Saks AM 1996). The relationship between the amount and helpfulness of entry training and work outcomes. Human Relations, 49, 429 451.
72. Salem B, Ellis D, Johnson D 1981). Development and use of an in-basket promotional exam for police sergeants. Review of Public Personnel Administration, 2, 23 35.
73. Sanchez RJ, Truxillo DM, Bauer TN 2000). Development and examination of an expectancy-based measure of test-taking motivation. Journal of Applied Psychology, 85, 739 750.
74. Sarason IG, Potter EH, Sarason BR 1986). Recording and recall of personal events: Effects on cognitions and behavior. Journal of Personality and Social Psychology, 51, 347 356.
75. Schaubroeck J, Lam SK 2004). Comparing lots before and after: Promotion rejectees' invidious reactions to promotees. Organizational Behavior and Human Decision Processes, 94, 33 47.
76. Schmit M, Ryan AM 1992). Test-taking dispositions: A missing link? Journal of Applied Psychology, 77, 629 637.
77. Schmit M, Ryan AM 1997). Applicant withdrawal: The role of test-taking attitudes and racial differences. Personnel Psychology, 50, 855 876.
78. Seipp B 1991). Anxiety and academic performance: A meta-analysis of findings. Anxiety Research, 4, 27 41.
79. Shackman AJ, Sarinopoulos I, Maxwell JS, Pizzagalli DA, Lavric A, Davidson RJ 2006). Anxiety selectively disrupts visuospatial working memory. Emotion, 6, 40 61.
80. Shrout PE, Bolger N 2002). Mediation in experimental and nonexperimental studies: New procedures and recommendations. Psychological Methods, 7, 422 445.
81. Smither JW, Reilly RR, Millsap RE, Pearlman K, Stoffey RW 1993). Applicant reactions to selection procedures. Personnel Psychology, 46, 49 76.
82. Spielberger CD, Vagg PR 1995). Test anxiety: Theory, assessment and treatment. Washington, DC : Taylor and Francis.
83. Statistics Canada 2002). 2001 Census of Population (Provinces, Census Divisions, Municipalities): 2001 Labour Force Activity, Class of Worker, Occupation, Industry, Place of Work, Mode of Transportation, Language of Work and Unpaid Work. E-STAT ed. Ottawa, ON : Statistics Canada. Retrieved August 15, 2008, from E-STAT database.
84. Steiger J 1989). Causal modeling: A supplementary module for SYSTAT and SYGRAPH. Evanston, IL : Systat.
85. Steiner DD, Gilliland SW 1996). Fairness reactions to personnel selection techniques in France and the United States. Journal of Applied Psychology, 81, 134 141.
86. Tabachnick B, Fidell L 2005). Using multivariate statistics (4th ed.). Boston : Allyn and Bacon.
87. Tharenou P 2001). Going up? Do traits and informal social processes predict advancing in management? Academy of Management Journal, 44, 1005 1017.
88. Thoresen CJ, Kaplan SA, Barsky AP, Warren CR, de Chermont K 2003). The affective underpinnings of job perceptions and attitudes: A meta-analytic review and integration. Psychological Bulletin, 129, 914 945.
89. Truxillo DM, Bauer TN 1999). Applicant reactions to test-score banding in entry-level and promotional contexts. Journal of Applied Psychology, 84, 322 339.
90. Truxillo DM, Bauer TN, Campion M, Paronto ME 2002). Selection fairness information and applicant reactions: A longitudinal field study. Journal of Applied Psychology, 87, 1220 1031.
91. Truxillo DM, Steiner DD, Gilliland SW 2004). The importance of organizational justice in personnel selection: Defining when selection fairness really matters. International Journal of Selection and Assessment, 12, 39 53.
92. Tsidulko J 2006). Dispute over police promotions test still rolling. Virgin Islands, St. Thomas : Virgin Islands Daily News.
93. Tyler TR, Lind EA 1992). A relational model of authority in groups. In Zanna MP (Ed. Advances in experimental social psychology (pp. 115 191). San Diego, CA : Academic Press.
94. Weiss HM, Cropanzano R 1996). Affective events theory: A theoretical discussion of the structure, causes and consequences of affective experiences at work. In Staw BM, Cummings LL (Eds. Research in organization behavior: An annual series of analytical essays and critical reviews (pp. 1 74). Greenwich, CT : JAI.
95. Wine J 1980). Cognitive-attentional theory of test anxiety. In Sarason IG (Ed Test anxiety: Theory, research and applications (pp. 349 385). Hillsdale, NJ : Erlbaum.
96. Zeidner M 1998). Test anxiety: The state of the art. New York : Plenum Press.