Use of implicit measures for organizational research: An empirical example

Canadian Journal of Behavioural Science

Volumn 41, Issue 4, 2009, Pages 202-212

  Johnson, Russell E ^a   Steinman, Lilunia ^b  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b MARYWOOD UNIVERSITY   (United States)

Author keywords

Implicit measures; Implicit processing; Organizational behaviour; Organizational justice; Promotion focus

Indexed keywords

EID: 70449397427     PISSN: 0008400X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0015164     Document Type: Article

References (109)

1. Aarts, H., & Dijksterhuis, A. (2000). Habits as knowledge structures: Automaticity in goal-directed behaviour. Journal of Personality and Social Psychology, 78, 53-63.
2. Ambrose, M. L., & Amaud, A. (2005). Are procedural justice and distributive justice conceptually different? In J. Greenberg & J. A. Colquitt (Eds.), Handbook of organizational justice (pp. 59-84). Mahwah, NJ: Erlbaum.
3. Ambrose, M. L., & Schminke, M. (2003). Organizational structure as a moderator of the relationship between procedural justice, interactional justice, perceived organizational support, and supervisory trust. Journal of Applied Psychology, 88, 295-305.
4. Anderson, J. R. (1987). Skill acquisition: Compilation of weak-method problem solutions. Psychological Review, 94, 192-210.
5. Banaji, M. R., Lemm, K. M., & Carpenter, S. J. (2001). The social unconscious. In A. Tesser & N. Schwarz (Eds.), Blackwell handbook of social psychology: Intralndividual processes (pp. 134-158). Oxford, United Kingdom: Blackwell.
6. Barclay, L. J., Skarlicki, D. P., & Pugh, S. D. (2005). Exploring the role of emotions in injustice perceptions and retaliation. Journal of Applied Psychology, 90, 629-643.
7. Bargh, J. A., & Chartrand, T. L. (1999). The unbearable automaticity of being. American Psychologist, 54, 462-479.
8. Bargh, J. A., & Chartrand, T. L. (2000). The mind in the middle: A practical guide to priming and automaticity research. In H. T. Reis and C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (pp. 253-285). Cambridge, United Kingdom: Cambridge University Press.
9. Bargh, J. A., Chen, M., & Burrows, L. (1996). Automaticity of social behaviour: Direct effects of trait construct and stereotype priming on action. Journal of Personality and Social Psychology, 71, 230-244.
10. Baron, R. A. (1993). Interviewers' moods and evaluations of job applicants: The role of applicant qualifications. Journal of Applied Social Psychology, 23, 253-271.
11. Bassili, J. N. (2001). Cognitive indices of social information processing. In A. Tesser & N. Schwarz (Eds.), Blackwell handbook of social psychology: Intraindividual processes (pp. 68-88). Oxford, United Kingdom: Blackwell.
12. Bassili, J. N., & Smith, M. C. (1986). On the spontaneity of trait attributions: Converging evidence for the role of cognitive strategy. Journal of Personality and Social Psychology, 50, 239-245.
13. Bies, R. J. (2001). Interactional (in) justice: The sacred and the profane. In J. Greenberg & R. Cropanzano (Eds.), Advances in organizational justice (pp. 89-118). Stanford, CA: Stanford University Press.
14. Bies, R. J., & Tripp, T. M. (2002). Hot flashes, open wounds: Injustice and the tyranny of its emotions. In S. Gilliland, D. Steiner, & D. Skarlicki (Eds.), Emerging perspectives on managing organizational justice (pp. 203-223). Greenwich, CT: IAP Press.
15. Bing, M. N., LeBreton, J. M, Davison, H. K., Migetz, D. Z., & James, L. R. (2007). Integrating implicit and explicit social cognitions for enhanced personality assessment: A general framework for choosing measurement and statistical methods. Organizational Research Methods, 10, 346-389.
16. Birkeland, S. A., Manson, T. M., Kisamore, J. L., Brannick, M. T., and Smith, M. A. (2006). A meta-analytic investigation of job applicant faking on personality measures. International Journal of Selection and Assessment, 14, 317-335.
17. Bosson, J. K., Swann, W. B., Jr., & Pennebaker, J. W. (2000). Stalking the perfect measure of implicit self-esteem: The blind men and the elephant revisited. Journal of Personality and Social Psychology, 79, 631-643.
18. Brief, A. P., Butcher, A. H., & Roberson, L. (1995). Cookies, disposition, and job attitudes: The effects of positive mood-inducing events and negative affectivity on job satisfaction in a field experiment. Organizational Behaviour and Human Decision Processes, 62, 55-62.
19. Brosnan, S. F., & de Waal, F. B. M. (2003). Monkeys reject unequal pay. Nature, 425, 297-299.
20. Cacioppo, J. T., & Petty, R. E. (1982). The need for cognition. Journal of Personality and Social Psychology, 42, 116-131.
21. Cacioppo, J. T., Petty, R. E., & Kao, C. F. (1984). The efficient assessment of need for cognition. Journal of Personality Assessment, 48, 306-307.
22. Carver, C. S., & Scheier, M. F. (1998). On the self-regulation of behaviour. Cambridge, United Kingdom: Cambridge University Press.
23. Cohen-Charash, Y., & Spector, P. E. (2001). The role of justice in organizations: A metaanalysis. Organizational Behaviour and Human Decision Processes, 86, 278-321.
24. Colquitt, J. A. (2001). On the dimensionality of organizational justice: A construct validation of a measure. Journal of Applied Psychology, 86, 386-400.
25. Colquitt, J. A., Conlon, D. E., Wesson, M. J., Porter, C. O. L. H., & Ng, K. Y. (2001). Justice at the millennium: A meta-analytic review of 25 years of organizational justice research. Journal of Applied Psychology, 86, 425-445.
26. Conrey, F. R., Sherman, J. W., Gawronski, B., Hugenberg, K., & Groom, C. (2005). Separating multiple processes in implicit social cognition: The Quad-Model of implicit task performance. Journal of Personality and Social Psychology, 89, 469-487.
27. Cook, S. W., & Selltiz, C. (1964). A multiple-indicator approach to attitude measurement. Psychological Bulletin, 62, 36-55.
28. Cropanzano, R., Byrne, Z. S., Bobocel, D. R., & Rupp, D. E. (2001). Moral virtues, fairness heuristics, social entities, and other denizens of organizational justice. Journal of Vocational Behaviour, 58, 164-209.
29. De Cremer, D., & Tyler, T. R. (2005). Managing group behaviour: The interplay between procedural fairness, self, and cooperation. In M. Zanna (Ed.), Advances in experimental social psychology (Vol. 37, pp. 152-218). New York: Academic Press.
30. De Dreu, C. K. W., & Camnevale, P. J. (2003). Motivational bases of information processing and strategy in conflict and negotiation. In M. P. Zanna (Ed.), Advances in experimental social psychology (Vol. 35, pp. 235-291). New York: Academic Press.
31. DeGroot, T., & Motowidlo, S. J. (1999). Why visual and vocal interview cues can affect interviewers' judgments and predict job performance. Journal of Applied Psychology, 84, 986-993.
32. De Houwer, J., & Moors, A. (2007). How to define and examine the implicitness of implicit measures. In B. Wittenbrink & N. Schwarz (Eds.), Implicit measures of attitudes (pp. 179-194). New York: Guilford Press.
33. Devine, P. G. (1989). Stereotypes and prejudice: Their automatic and controlled components. Journal of Personality and Social Psychology, 56, 5-18.
34. Eysenck, H. J. (1967). Dimensions of personality. London: Routledge and Kegan Paul.
35. Fazio, R. H., Jackson, J. R., Dunton, B. C, & Williams, C. J. (1995). Variability in automatic activation as an unobtrusive measure of racial attitudes: A bona fide pipeline? Journal of Personality and Social Psychology, 69, 1013-1027.
36. Fazio, R. H., & Olson, M. A. (2003). Implicit measures in social cognition: Their meaning and use. Annual Review of Psychology, 54, 297-327.
37. Ferguson, M. J., & Bargh, J. A. (2007). Beyond the attitude object: Implicit attitudes spring from object-centered contexts. In B. Wittenbrink & N. Schwarz (Eds.), Implicit measures of attitudes (pp. 216-246). New York: Guilford Press.
38. Ferreira, M. B., Garcia-Marques, L., & Sherman, S. J. (2006). Automatic and controlled components of judgment and decision making. Journal of Personality and Social Psychology, 91, 797-813.
39. Folger, R., & Cropanzano, R. (1998). Organizational justice and human resource management. 91 Thousand Oaks, CA: Sage.
40. Folger, R., Cropanzano, R., & Goldman, B. M. 41 (2005). Justice and moral sentiment: The deontic response to "foul play" at work. In J. Greenberg and J. A. Colquitt (Eds.), Handbook of organizational justice (pp. 215-245). Mahwah, NJ: Erlbaum.
41. Forgas, J. P. (2003). Affective influences on attitudes and judgments. In R. J. Davidson, K. R. Scherer, & H. H. Goldsmith (Eds.), Handbook of affective sciences (pp. 596-218). New York: Oxford University Press.
42. Gawronski, B., & Bodenhausen, G. V. (2006). Associative and prepositional processes in evaluation: An integrative review of implicit and explicit attitude change. Psychological Bulletin, 132, 692-731.
43. Gawronski, B., LeBel, E. P., & Peters, K. R. (2007). What do implicit measures tell us? Scrutinizing the validity of three common assumptions. Perspectives on Psychological Science, 2, 181-193.
44. Gilbert, D. T., & Hixon, J. G. (1991). The trouble of thinking: Activation and application of stereotypic beliefs. Journal of Personality and Social Psychology, 60, 509-517.
45. Greenberg, J. A. (1993). The social side of fairness: Interpersonal and informational classes of organizational justice. In R. Cropanzano (Ed.), 21 Justice in the workplace: Approaching fairness in human resource management (pp. 79-103). Hillsdale, NJ: Erlbaum.
46. Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998). Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74, 1464-1480.
47. Hafer, C. L. (2000). Do innocent victims threaten the belief in a just world? Evidence from a modified Stroop task. Journal of Personality and Social Psychology, 79, 165-173.
48. Haines, E. L., & Sumner, K. E. (2006). Implicit measurement of attitudes, stereotypes, and self-concepts in organizations: Teaching old dogmas new tricks. Organizational Research Methods, 9, 536-553.
49. Higgins, E. T. (1997). Beyond pleasure and pain. American Psychologist, 52, 1280-1300.
50. Higgins, E. T., Shah, J. Y., & Friedman, R. (1997). Emotional responses to goal attainment: Strength of regulatory focus as moderator. Journal of Personality and Social Psychology, 72, 515-525.
51. Higgins, E. T., & Spiegel, S. (2004). Promotion and prevention strategies for self-regulation: A motivated cognition perspective. In R. F. Baumeister & K. D. Vohs (Eds.), Handbook of self-regulation: Research, theory, and applications (pp. 171-187). New York: Guilford Press.
52. IIies, R., Arvey, R. D., & Bouchard, J. J., Jr. (2006).Darwinism, behavioral genetics, and organizational behaviour: A review and agenda for future research. Journal of Organizational Behaviour, 27, 121-141.
53. Ito, T. A., & Cacioppo, J. T. (2007). Attitudes as mental and neural states of readiness: Using physiological measures to study implicit attitudes. In B. Wittenbrink & N. Schwarz (Eds.), Implicit measures of attitudes (pp. 125-158). New York: Guilford Press.
54. Johnson, R. E. (2005, June). Organizational justice and self-concept: (Un) Fairness perceptions and shifting identities. Paper presented at the 66th Annual Convention of the Canadian Psychological Association, Montreal, Quebec, Canada.
55. Johnson, R. E. (2006). Uncovering the motivational processes underlying justice: The implicit cognitive, affective, and conative effects of experiencing (un) fairness. Doctoral dissertation, University of Akron, Akron, OH.
56. Johnson, R. E., & Chang, C.-H. (2008). Relationships between organizational commitment and its antecedents: Employee self-concept matters. Journal of Applied Social Psychology, 38, 513-541.
57. Johnson, R. E., Chang, C-H., & Lord, R. G. (2006). Moving from cognition to behaviour What the research says. Psychological Bulletin, 132, 381-415.
58. Johnson, R. E., Chang, C-H., & Rosen, C. C. (2006, August). Linking justice to motivation: The effects of justice on self-concept, regulatory focus, and affect. Paper presented at the 66th Academy of Management Annual Meeting, Atlanta, GA.
59. Johnson, R. E., & Lord, R. G. (2007, April). The implicit effects of (un) fairness on self-concept: Unconscious shifts in identity levels. In D. R. Bobocel & R. E. Johnson's (Chairs), The role of the self in organizational justice. Paper presented at the 22nd Annual Society for Industrial and Organizational Psychology Conference, New York.
60. Johnson, R. E., Pogson, C. E., & Levy, P. E. (2006, May). Fairness as a heuristic: What are the measurement implications? In R. E. Johnson and P. E. Levy's (Chairs), Taking account of measurement issues regarding organizational justice. Paper presented at the 21st Annual Society for Industrial and Organizational Psychology Conference, Dallas, TX.
61. Johnson, R. E., Selenta, C, & Lord, R. G. (2006). When organizational justice and the self-concept meet: Consequences for the organization and its members. Organizational Behaviour and Human Decision Processes, 99, 175-201.
62. Kanfer, R., & Ackerman, P. L. (1989). Motivation and cognitive abilities: An integrative/aptirude-treatment interaction approach to skill acquisition. Journal of Applied Psychology, 74, 657-690.
63. Kim, T-Y., & Leung, K. (2007). Forming and reacting to overall fairness: A cross-cultural comparison. Organizational Behaviour and Human Decision Processes, 104, 83-95.
64. Klauer, K. C, & Teige-Mocigemba, S. (2007). Controllability and resource dependence in automatic evaluation. Journal of Experimental Social Psychology, 43, 648-655.
65. Kruglanski, A. W. (1989). Lay epistemics and human knowledge: Cognitive and motivational bases. New York: Plenum Press.
66. Kunda, Z., & Thagard, P. (1996). Forming impressions from stereotypes, traits, and behaviours: A parallel-constraint-satisfaction theory. Psychological Review, 103, 284-308.
67. Lane, V. R., & Scott, S. G. (2007). The neural network model of organizational identification. Organizational Behaviour and Human Decision Processes, 104, 175-192.
68. Lee, C, & Farh, J.-L. (2008). The effects of gender in organizationaljustice perception. Journal of Organizational Behaviour, 20, 133-143.
69. Lind, E. A. (2001). Fairness heuristic theory: Justice judgments as pivotal cognitions in organizational relations. In J. Greenberg & R. Cropanzano (Eds.), Advances in Organizational Justice (pp. 56-88). San Francisco: New Lexington Press.
70. Locke, E. A. (1976). The nature and causes of job satisfaction. In M. D. Dunnette (Ed.), Handbook of industrial and organizational psychology (pp. 1297-1349). Chicago: Rand McNally.
71. Locke, E. A., & Latham, G. P. (1990). A theory of goal-setting and task performance. Englewood Cliffs, NJ: Prentice Hall.
72. Locke, E. A., & Latham, G. P. (2004). What should we do about motivation theory? Six recommendations for the twenty-first century. Academy of Management Review, 29, 388-403.
73. Lockwood, P., Jordan, C. H., & Kunda, Z. (2002). Motivation by positive or negative role models: Regulatory focus determines who will best inspire us. Journal of Personality and Social Psychology, 83, 854-864.
74. Logan, G. D. (2002). An instance theory of attention and memory. Psychological Review, 109, 376-400.
75. Lord, R. G., Brown, D. J., Harvey, J. L., & Hall, R. J. (2001). Contextual constraints on prototype generation and their multilevel consequences for leadership perceptions. Leadership Quarterly, 12, 311-338.
76. Lord, R. G., & Harvey, J. L. (2002). An information processing framework for emotional regulation. In R. G. Lord, R. J. Klimoski, & R. Kanfer (Eds.), Emotions in the workplace: Understanding the structure and role of emotions in organizational behaviour (pp. 115-146). San Francisco: Jossey-Bass.
77. McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (1995). Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102, 419-457.
78. Metcalfe, J., & Mischel, W. (1999). A hot/cool-system analysis of delay of gratification: Dynamics of willpower. Psychological Review, 106, 3-19.
79. Meyer, D. E., & Schvaneveldt, R. W. (1971). Facilitation in recognizing pairs of words: Evidence of a dependence between retrieval operations. Journal of Experimental Psychology, 90, 227-234.
80. Miller, G. A. (1956). The magical number seven, plus or minus two. Psychological Review, 63, 81-97.
81. Oldham, G. R., & Hackman, J. R. (1980). Work design in organizational context. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behaviour (Vol. 2; pp. 247-278). Greenwich, CT: JAI Press.
82. Payne, B. K., Cheng, C. M., Govorun, O., & Stewart, B. D. (2005). An inkblot for attitudes: Affect misattribution as implicit measurement. Journal of Personality and Social Psychology, 89, 277-293.
83. Reynolds, S. J. (2006). A neurocognitive model of the ethical decisionmaking process: Implications for study and practice. Journal of Applied Psychology, 91, 737-748.
84. Rosen, C. C, Akirmak, U., & Johnson, R. E. (2008, April). Affect and performance: Support for the use of implicit measures. Paper presented at the 23rd Annual Society for Industrial and Organizational Psychology Conference, San Francisco.
85. Saboe, K., & Johnson, R. E. (2008, April). Implicit identities predict supervisor-rated work outcomes and relationships. Paper presented at the 23rd Annual Society for Industrial and Organizational Psychology Conference, San Francisco.
86. Shah, J. Y., Friedman, R., & Kruglanski, A. W. (2002). Forgetting all else: On the antecedents and consequences of goal shielding. Journal of Personality and Social Psychology, 83, 1261-1280.
87. Shapiro, D. L. (2001). The death of justice theory is likely if theorists neglect the "wheels" already invented and the voices of the injustice victims. Journal of Vocational Behaviour, 58, 235-242.
88. Shapiro, D. L., & Brett, J. M. (2005). What is the role of control in organizational justice? In J. Greenberg & J. A. Colquitt (Eds.), Handbook of organizational justice (pp. 155-177). Mahwah, NJ: Erlbaum.
89. Shapiro, D. L., & Kirkman, B. L. (2001). Anticipatory injustice: The consequences of expecting injustice in the workplace. In J. Greenberg and R. Cropanzano (Eds.), Advances in organizational justice (pp. 152-178). San Francisco: Stanford University Press.
90. Shiffrin, R. M, & Schneider, W. (1977). Controlled and automatic human information processing: II. Perceptual learning, automatic attending, and a general theory. Psychological Review, 84, 127-190.
91. Skarlicki, D. P., & Folger, R. (2004). Broadening our understanding of organizational retaliatory behaviour. In R. W. Griffin & A. M. O'Leary-Kelly (Eds.), The dark side of organizational behaviour (pp. 373-402). San Francisco: Jossey-Bass.
92. Smith, E. R. (1998). Mental representations and memory. In D. T. Gilbert and S. T. Fiske (Eds.), Handbook of social psychology (Vol. 2, 4th ed., pp. 391-445). New York: McGraw-Hill.
93. Smith, E. R., & Conrey, F. R. (2007). Mental representations are states, not things: Implications for implicit and explicit measurement. In B. Wittenbrink & N. Schwarz (Eds.), Implicit measures of attitudes (pp. 247-264). New York: Guilford Press.
94. Smith, E. R., & DeCoster, J. (2000). Dual process models in social and cognitive psychology: Conceptual integration and links to underlying memory systems. Personality and Social Psychology Review, 4, 108-131.
95. Snell, A. F., Sydell, E. J., & Lueke, S. B. (1999). Towards a theory of applicant faking: Integrating studies of deception. Human Resource Management Review, 9, 219-242.
96. Spector, P. E. (1997). Job satisfaction: Applications, assessment, causes and consequences. Thousand Oaks, CA: Sage.
97. Srull, T. K., & Wyer, Jr., R. S. (1979). The role of category accessibility in the interpretation of information about persons: Some determinants and implications. Journal of Personality and Social Psychology, 37, 1660-1672.
98. Stajkovic, A. D., Locke, E. A., & Blair, E. S. (2006). A first examination of the relationships between primed subconscious goals, assigned conscious goals, and task performance. Journal of Applied Psychology, 91, 1172-1180.
99. Steele, C. M., & Aronson, J. (1995). Stereotype threat and the intellectual test performance of African-Americans. Journal of Personality and Social Psychology, 69, 797-811.
100. Strack, F., & Deutsch, R. (2004). Reflective and impulsive determinants of social behaviour. Personality and Social Psychology Review, 8, 220-247.
101. Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18, 643-662.
102. Tyler, T. R. (1989). The psychology of procedural justice: A test of the group value model. Journal of Personality and Social Psychology, 57, 830-838.
103. Vargas, P. T., Sekaquaptewa, D., & von Hippel, W. (2007). Armed only with paper and pencil: "Low tech" measures of implicit attitudes. In B. Wittenbrink & N. Schwarz (Eds.), Implicit measures of attitudes (pp. 103-124). New York: Guilford Press.
104. Verplanken, B., & Orbell, S. (2003). Reflections on past behaviour: A self-report index of habit strength. Journal of Applied Social Psychology, 33, 1313-1330.
105. Vroom, V. H. (1964). Work and motivation. New York: Wiley.
106. Wexley, K. N., & Latham, G. P. (2001). Developing and training human resources in organizations. New York: Harper Collins.
107. Williams, J. M. G., Mathews, A., & MacLeod, C. (1996). The emotional stroop task and psychopathology. Psychological Bulletin, 120, 3-24.
108. Wittenbrink, B. (2007). Measuring attitudes through priming. In B. Wittenbrink & N. Schwarz (Eds.), Implicit measures of attitudes (pp. 17-58). New York: Guilford Press.
109. Wittenbrink, B., & Schwarz, N. (Eds.). (2007). Implicit measures of attitudes. New York: Guilford Press.