Construct and criterion-related validation of a measure of emotional reasoning skills: A two-study investigation

International Journal of Selection and Assessment

Volumn 17, Issue 1, 2009, Pages 101-118

  Blickle, Gerhard ^a   Momm, Tassilo S ^a   Kramer, Jochen ^a   Mierke, Jan ^a   Liu, Yongmei ^b   Ferris, Gerald R ^c  

^a UNIVERSITY OF BONN   (Germany)

^b UNIVERSITY OF TEXAS AT ARLINGTON   (United States)

^c FLORIDA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 60449087100     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/j.1468-2389.2009.00455.x     Document Type: Article

References (108)

1. Ackerman, P.L. Heggestad, E.D. (1997) Intelligence, Personality, and Interests: Evidence for overlapping traits. Psychological Bulletin, 121, 219 245.
2. Aiken, L.S. West, S.G. (1991) Multiple Regression: Testing and interpreting interactions. Newbury Park, CA : Sage Publications.
3. Amelang, M. Steinmayr, R. (2006) Is There a Validity Increment for Tests of Emotional Intelligence in Explaining the Variance of Performance Criteria? Intelligence, 34, 459 468.
4. Bar-On, R. (2000) Emotional and Social Intelligence: Insights from the emotional quotient. In : Bar-On, R. Parker, J.D.A. (eds), The Handbook of Emotional Intelligence: Theory, development, assessment, and application at home, school, and in the workplace. San Francsico : Jossey-Bass, pp. 363 388.
5. Barrick, M.R., Mount, M.K. Judge, T.A. (2001) Personality and Job Performance at the Beginning of the New Millennium: What do we know and where do we go next? International Journal of Selection and Assessment, 9, 9 30.
6. Baum, K. Nowicki, S. (1998) Perception of Emotion: Measuring decoding accuracy of adult prosodic cues varying in intensity. Journal of Nonverbal Behavior, 22, 89 109.
7. Bergmann, C. Eder, F. (1992) Allgemeiner Interessen-Struktur-Test - Umwelt-Struktur-Test Testmappe [Test of general structure of interests - Environment-structure-test manual]. Weinheim, FRG : Beltz.
8. Blickle, G., Meurs, J.A., Schneider, P.B., Kramer, J., Zettler, I., Maschler, J., Noethen, D. Ferris, G.R. (2008) Personality, Political Skill, and Job Performance. Journal of Vocational Behavior, 72, 377 387.
9. Borkenau, P. Ostendorf, F. (1993) NEO-Fünf-Faktoren-Inventar (NEO-FFI) nach Costa und McCrae. Göttingen, FRG : Hogrefe.
10. Bowen, C., Swim, J.K. Jacobs, R.R. (2000) Evaluating Gender Biases on Actual Job Performance or Real People: A meta-analysis. Journal of Applied Social Psychology, 33, 648 665.
11. Brackett, M.A. Mayer, J.D. (2003) Convergent, Discriminant, and Incremental validity of Competing Measures of Emotional Intelligence. Personality and Social Psychology Bulletin, 29, 1147 1158.
12. Brackett, M.A., Rivers, S.E., Shiffman, S., Lerneer, N. Salovey, P. (2006) Relating Emotional Abilities to Social Functioning: A comparison of self-report and performance measures of emotional intelligence. Journal of Personality and Social Psychology, 91, 780 795.
13. Camras, L.A. Allison, K. (1989) Children's and Adults' Beliefs About Emotion Elicitation. Motivation and Emotion, 13, 53 70.
14. Caruso, D.R. Salovey, P. (2004) The Emotionally Intelligent Manager. San Francisco, CA : Jossey-Bass.
15. Chan, D. Schmitt, N. (2002) Situational Judgment and Performance. Human Performance, 15, 233 254.
16. Ciarrochi, J.V., Chan, A.Y.C. Caputi, P. (2000) A Critical Evaluation of the Emotional Intelligence Construct. Personality and Individual Differences, 28, 539 561.
17. Clore, G.L., Ortony, A. Foss, M.A. (1987) The Psychological Foundations of the Affective Lexicon. Journal of Personality and Social Psychology, 53, 751 766.
18. Conway, J.M. (1999) Distinguishing Contextual from Task Performance for Managerial Jobs. Journal of Applied Psychology, 84, 3 13.
19. Costa, P.T. McCrae, R.R. (1989) NEO-PI/NEO-FFI Manual Supplement. Odessa, FL : Psychological Assessment Resources.
20. Côté, S. Miners, C.T.H. (2006) Emotional Intelligence, Cognitive Intelligence, and Job Performance. Administrative Science Quarterly, 51, 1 28.
21. Daus, C.S. Ashkanasy, N.M. (2005) The Case for the Ability-Based Model of Emotional Intelligence in Organizational Behavior. Journal of Organizational Behavior, 26, 453 466.
22. Davies, M., Stankov, L. Roberts, R.D. (1998) Emotional Intelligence: In search of an elusive construct. Journal of Personality and Social Psychology, 75, 989 1015.
23. Davis, M.H. (1983) Measuring Individual Differences in Empathy: Evidence for a multidimensional approach. Journal of Personality and Social Psychology, 44, 113 126.
24. De Gruijter, D.N.M. (2003) Reliability. In : Fernández- Ballesteros, R. (ed.), Encyclopedia of Psychological Assessment, Vol. 2. London : Sage, pp. 807 812.
25. Denham, S.A. (1998) Emotional Development in Young Children. New York : Guilford.
26. Ekman, P. (1972) Universals and Cultural Differences in Facial Expressions of Emotion. In : Cole, J.K. (ed.), Nebraska Symposium on Motivation, 1971. Lincoln, NE : University of Nebraska Press, pp. 207 283.
27. Ekman, P., Friesen, W.V. Ancoli, S. (1980) Facial Designs of Emotional Experience. Journal of Personality and Social Psychology, 39, 1125 1134.
28. Elfenbein, H.A. (2006) Learning in Emotion Judgements: Training and the cross-cultural understanding of facial expressions. Journal of Nonverbal Behavior, 30, 21 36.
29. Elfenbein, H.A. Ambady, N. (2002) Predicting Workplace Outcomes from the Ability to Eavesdrop on Feelings. Journal of Applied Psychology, 87, 963 971.
30. Elfenbein, H.A., Foo, M.D., White, J., Tan, H.H. Aik, V.C. (2007) Reading Your Counterpart: The benefit of emotion recognition accuracy for effectiveness in negotiation. Journal of Nonverbal Behavior, 31, 205 223.
31. Elfenbein, H.A., Polzer, J.T. Ambady, N. (2007) Team Emotion Recognition Accuracy and Team Performance. In : Ashkanasy, N.M., Zerbe, W.J. Härtel, C.E.J. (eds), Research on Emotions in Organizations, Vol. 3. Amsterdam : Elsevier, pp. 87 119.
32. Eslinger, P.J. (1998) Neurological and Neuropsychological Bases of Empathy. European Journal of Neurology, 39, 193 199.
33. Fernández-Dols, J.M. Ruiz-Belda, M.A. (1997) Spontaneous Facial Behavior During Intense Emotional Episodes: Artistic truth and optical truth. In : Russel, J.A. Fernández-Dols, J.M. (eds), The Psychology of Facial Expression. Cambridge : Cambridge University Press, pp. 255 294.
34. Ferris, G.R., Blickle, G., Schneider, P.B., Kramer, J., Zettler, I., Solga, J., Noethen, D. Meurs, J.A. (2008) Political Skill Construct and Criterion-Related Validation: A two-study investigation. Journal of Managerial Psychology, 23, 744 771.
35. Ferris, G.R., Davidson, S.L. Perrewé, P.L. (2005) Political Skill at Work: Impact on work effectiveness. Mountain View, CA : Davies-Black Publishing.
36. Ferris, G.R., Judge, T.A., Rowland, K.M. Fitzgibbons, D.E. (1994) Subordinate Influence and the Performance Evaluation Process: Test of a model. Organizational Behavior and Human Decision Processes, 58, 101 135.
37. Ferris, G.R., Perrewé, P.L. Douglas, C. (2002) Social Effectiveness in Organizations: Construct validity and research directions. Journal of Leadership and Organizational Studies, 9, 49 63.
38. Ferris, G.R., Treadway, D.C., Kolodinsky, R.W., Hochwarter, W.A., Kacmar, C.J., Douglas, C. Frink, D.D. (2005) Development and Validation of the Political Skill Inventory. Journal of Management, 31, 126 152.
39. Ferris, G.R., Witt, L.A. Hochwarter, W.A. (2001) Interaction of Social Skill and General Mental Ability on Job Performance and Salary. Journal of Applied Psychology, 86, 1075 1082.
40. Fridlund, A.J. (1991) Sociality of Solitary Smiling: Potentiation by an implicit audience. Journal of Personality and Social Psychology, 60, 229 240.
41. Goffman, E. (1959) The Presentation of Self in Everyday Life. New York : Bantam Books.
42. Goldberg, L.R. (1993) The Structure of Phenotypic Personality Traits. American Psychologist, 48, 26 34.
43. Goleman, D. (1995) Emotional Intelligence: Why it can matter more than IQ. New York : Bantam.
44. Goleman, D. (1998) Working with Emotional Intelligence. New York : Bantam Books.
45. Harris, M.M. Schaubroeck, J. (1988) A Meta-Analysis of Self-Supervisor, Self-Peer, and Peer-Supervisor Ratings. Personnel Psychology, 41, 43 62.
46. Harrison, R. (1986) The Grouping of Affect Terms According to the Situations Which Elicit Them: A test of a cognitive theory of emotion. Journal of Research in Personality, 20, 252 266.
47. Hayes, J. (2002) Interpersonal Skills at Work. London, GB : Routledge, Taylor & Francis Group.
48. Hirsh, H.R., Northrop, L.C. Schmidt, F.L. (1986) Validity Generalization Results for Law Enforcement Occupations. Personnel Psychology, 39, 399 420.
49. Hochschild, A.R. (1983) The Managed Heart. Berkeley, CA : University Press.
50. Holland, J.L. (1997) Making Vocational Choices: A theory of vocational personalities and work environments (3rd edn Odessa, FL : Psychological Assessment Resources.
51. Hunter, J.E. Schmidt, F.L. (2004) Methods of Meta-Analysis: Correcting error and bias in research findings (2nd edn Beverly Hills, CA : Sage Publications.
52. Innes-Ker, A. Niedenthal, P.M. (2002) Emotion Concepts and Emotional States in Social Judgment and Categorization. Journal of Personality and Social Psychology, 83, 804 816.
53. Jörin, S., Stoll, F., Bergmann, S. Eder, F. (2004) EXPLORIX. Bern, CH : Huber.
54. Judge, T.A. Ferris, G.R. (1993) Social Context of Performance Evaluation Decisions. Academy of Management Journal, 36, 80 105.
55. Kent, J. Plomin, R. (1987) Testing Specific Cognitive Abilities by Telephone and Mail. Intelligence, 11, 391 400.
56. Klein, C., DeRouin, R.E. Salas, E. (2006) Uncovering Work Place Interpersonal Skills: A review, framework, and research agenda. In : Hodgkinson, G.P. Ford, J.K. (eds), International Review of Industrial and Organizational Psychology, Vol. 21 (pp. 79 126). Chichester, UK : John Wiley & Sons.
57. Kliegel, M., Martin, M. Jäger, T. (2007) Development and Validation of the Cognitive Telephone Screening Instrument (COGTEL) for the Assessment of Cognitive Function Across Adulthood. The Journal of Psychology, 141, 147 170.
58. Kraut, R.E. Johnston, R.E. (1979) Social and Emotional Messages of Smiling: An ethological approach. Journal of Personality and Social Psychology, 37, 1539 1553.
59. Lam, L.T. Kirby, S.L. (2002) Is Emotional Intelligence an Advantage? An Exploration of the Impact of Emotional and General Intelligence on Individual Performance. Journal of Social Psychology, 142, 133 143.
60. Lane, R.D., Quinlan, D.M., Schwartz, G.E., Walker, P.A. Zeitlin, S.B. (1990) The Levels of Emotional Awareness Scale: A cognitive-developmental measure of emotion. Journal of Personality Assessment, 55, 124 134.
61. Law, K.S., Wong, C.-S. Song, L.J. (2004) The Construct and Criterion Validity of Emotional Intelligence and its Potential Utility for Management Studies. Journal of Applied Psychology, 89, 483 496.
62. Lazarus, R.S. (1991) Emotion and Adaptation. New York : Oxford University Press.
63. Legree, P.J., Fischl, M.A., Gade, P.A. Wilson, M. (1998) Testing Word Knowledge by Telephone to Estimate General Cognitive Aptitude Using an Adaptive Test. Intelligence, 26, 91 98.
64. LePine, J.A. Van Dyne, L. (2001) Voice and Cooperative Behavior as Contrasting Forms of Contextual Performance: Evidence of differential relationships with big five personality characteristics and cognitive ability. Journal of Applied Psychology, 86, 326 336.
65. Liu, Y. (2006). The Antecedents and Consequences of Emotion Regulation at Work. Unpublished doctoral dissertation, Department of Management, College of Business, Florida State University, Tallahassee, FL.
66. Locke, E.A. (2005) Why Emotional Intelligence is an Invalid Concept. Journal of Organizational Behavior, 26, 425 431.
67. Lopes, P.N., Brackett, M.A., Nezlek, J.B., Schütz, A., Sellin, I. Salovey, P. (2004) Emotional Intelligence and Social Interaction. Personality and Social Psychology Bulletin, 30, 1018 1034.
68. Lopes, P.N., Salovey, P. Straus, R. (2003) Emotional Intelligence, Personality, and the Perceived Quality of Social Relationships. Personality and Individual Differences, 35, 641 658.
69. Matsumoto, D., LeRoux, J.A., Wilson-Cohn, C., Raroque, J., Kooken, K., Ekman, P., Yrizarry, N., Loewinger, S., Uchida, H., Yee, A., Amo, L. Goh, A. (2000) A New Test to Measure Emotion Recognition Ability: Matsumoto and Ekman's Japanese and Caucasian Brief Affect Recognition Test (JACBART). Journal of Nonverbal Behavior, 24, 179 209.
70. Mayer, D.M., Roberts, R.D. Barsade, S.G. (2008) Human Abilities: Emotional intelligence. Annual Review of Psychology, 59, 507 536.
71. Mayer, J.D. Salovey, P. (1993) The Intelligence of Emotional Intelligence. Intelligence, 17, 433 442.
72. Mayer, J.D. Salovey, P. (1997) What is Emotional Intelligence? In : Salovey, P. Sluyter, D. (eds), Emotional Development and Emotional Intelligence: Implications for educators. New York : Basic Books, pp. 3 31.
73. nd edn). New York : Cambridge University Press, pp. 396 420.
74. Mayer, J.D., Salovey, P. Caruso, D.R. (2002) Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) User's Manual. Toronto, Canada : MHS Publishers.
75. Mayer, J.D., Salovey, P. Caruso, D.R. (2004) Emotional Intelligence: Theory, findings, implications. Psychological Inquiry, 15, 197 215.
76. Mayer, J.D., Salovey, P., Caruso, D.R. Sitarenios, G. (2003) Measuring Emotional Intelligence with the MSCEIT V2.0. Emotion, 3, 97 105.
77. McCrae, R.R. (1996) Social Consequences of Experiential Openness. Psychological Bulletin, 120, 323 337.
78. Mehrabian, A. Epstein, N.A. (1972) A Measure of Emotional Empathy. Journal of Personality, 40, 525 543.
79. Nowicki, S. Carton, J. (1993) The Measurement of Emotional Intensity from Facial Expressions. Journal of Social Psychology, 133, 749 750.
80. Nowicki, S. Duke, M.P. (1994) Individual Differences in the Nonverbal Communication of Affect: The diagnostic analysis of nonverbal accuracy scale. Journal of Nonverbal Behavior, 18, 9 35.
81. Nowicki, S. Duke, M.P. (2001) Nonverbal Reciprocity: The diagnostic analysis of nonverbal accuracy (ANVA). In : Hall, J.A. Bernieri, F.J. (eds), Interpersonal Sensitivity: Theory and measurement. Mahwah, NJ : Lawrence Erlbaum, pp. 183 198.
82. O'Connel, M.S., Hartman, N.S., McDaniel, M.A., Grubb III., W.L. Lawrence, A. (2007) Incremental Validity of Situational Judgment Tests for Task and Contextual Job Performance. International Journal of Selection and Assessment, 15, 19 29.
83. Plutchik, R. (1980) A General Psychoevolutionary Theory of Emotion. In : Plutchik, R. Kellerman, H. (eds), Emotion: Theory, research, and experience, Vol. 1. San Diego, CA : Academic Press, pp. 3 33.
84. Prati, L.M., Douglas, C., Ferris, G.R., Ammeter, A.P. Buckley, M.R. (2003) Emotional Intelligence, Leadership, Effectiveness, and Team Outcomes. The International Journal of Organizational Analysis, 11, 21 40.
85. Pulakos, E.D., Schmitt, N., Dorsey, D.W., Arad, S., Hedge, J.W. Borman, W.C. (2002) Predicting Adaptive Performance: Further tests of a model of adaptability. Human Performance, 15, 299 323.
86. Roberts, R.D., Zeidner, M. Matthews, G. (2001) Does Emotional Intelligence Meet Traditional Standards for an Intelligence? Some New Data and Conclusions. Emotion, 1, 196 231.
87. Rode, J.C., Mooney, C.H., Artaud-Day, M.L., Near, J.P., Baldwin, T.T., Rubin, R.S. Bommer, W.H. (2005) Emotional Intelligence and Individual Performance: Evidence for direct and moderated effects. Journal of Organizational Behavior, 28, 399 421.
88. Rogers, E.M. (1982) Information Exchange and Technological Innovation. In : Sahal, D. (ed), The Transfer and Utilization of Technical Knowledge. Lexington, MA : Lexington Books, pp. 105 123.
89. Rosenthal, R., Hall, J., DiMatteo, M.R., Rogers, P.L. Archer, D. (1979) Sensitivity to Nonverbal Communication: The PONS test. Baltimore : John Hopkins University Press.
90. Rubin, R.S., Munz, D.C. Bommer, W.H. (2005) Leading from Within: The effects of emotion recognition and personality on transformational leadership behavior. Academy of Management Journal, 48, 845 858.
91. Saarni, C. (1999) The Development of Emotional Competence. New York : Guilford Press.
92. Scherer, K. (1984) On the Nature and Function of Emotion: A component process approach. In : Scherer, K. Ekman, P. (eds), Approaches to Emotion. Hillsdale, NJ : Erlbaum, pp. 293 318.
93. Schmidt, F.L. Hunter, J.E. (1998) The Validity and Utility of Selection Methods in Personnel Psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 437 454.
94. Schmidt-Atzert, L. Bühner, M. (2002). Development of a Performance Measure of Emotional Intelligence. Paper presented at the 43rd congress of the German Psychological Society. Humboldt-Universität, Berlin, Germany.
95. Schmitt, N., Cortina, J.M., Ingerick, M.J. Wiechmann, D. (2003) Personnel Selection and Employee Performance. In : Borman, W.C., Ilgen, D.R. Klimoski, R.J. (eds), Handbook of Psychology, Vol. 12: Industrial and organizational psychology. Hoboken, NJ : Wiley, pp. 77 105.
96. Smith, C.A. Lazarus, R.S. (1993) Appraisal Components, Core Relational Themes, and Emotions. Cognition and Emotion, 7, 233 269.
97. Spector, P.E. (2001) Research Methods for Data Collection and Data Analysis. In : Anderson, N., Ones, D.S., Sinangil, H.K. Viswesvaran, C. (eds), Handbook of Industrial, Work, and Organizational Psychology, Vol. 1: Personnel psychology. London, UK : Sage Publications, pp. 10 26.
98. Tippins, N.T., Beaty, J., Drasgow, F., Gibson, W.M., Pearlman, K., Segall, D.O. Shepherd, W. (2006) Unproctored Internet Testing in Employment Settings. Personnel Psychology, 59, 189 225.
99. Van Rooy, D.L. Viswesvaran, C. (2004) Emotional Intelligence: A meta-analytic investigation of predictive validity and nomological net. Journal of Vocational Behavior, 65, 71 95.
100. Van Scotter, J.R. Motowidlo, S.J. (1996) Interpersonal Facilitation and Job Dedication as Separate Facets of Contextual Performance. Journal of Applied Psychology, 81, 525 531.
101. Vinchur, A.J., Shippmann, J.S., Switzer, F.S. Roth, P.L. (1998) A Meta-Analytic Review of Predictors of Job Performance for Salespeople. Journal of Applied Psychology, 83, 586 597.
102. Viswesvaran, C., Schmidt, F.L. Ones, D.S. (2005) Is There a General Factor in Ratings of Job Performance? A Meta-Analytic Framework for Disentangling Substantive and Error Influence. Journal of Applied Psychology, 90, 108 131.
103. Wageman, R. (2001) The Meaning of Interdependence. In Turner, M.E. (ed.), Groups at Work: Theory and research. Mahwah, NJ : Lawrence Erlbaum, pp. 197 217.
104. Waldman, D.A. Avolio, B.J. (1986) A Meta-Analysis of Age Differences in Job Performance. Journal of Applied Psychology, 71, 33 38.
105. Weiner, B. (1985) An Attributional Theory of Achievement Motivation and Emotion. New York : Springer-Verlag.
106. Weiss, H.M. Cropanzano, R. (1996) Affective Events Theory: A theoretical discussion of the structure, causes and consequences of affective experiences at work. In : Staw, B.M. Cummings, L.L. (eds), Research in Organizational Behavior, Vol. 18. Greenwich, CT : JAI, pp. 1 74.
107. Wonderlic Inc. (1996) Wonderlic Personal Test (WPT - German Version). Libertyville, IL : Wonderlic Personnel Test Inc.
108. Wonderlic Inc. (2002) Wonderlic Personnel Test & Scholastic Level Exam: User's manual. Libertyville, IL : Wonderlic.