Hire me: Computational inference of hirability in employment interviews based on nonverbal behavior

IEEE Transactions on Multimedia

Volumn 16, Issue 4, 2014, Pages 1018-1031

  Nguyen, Laurent Son ^a,b   Frauendorfer, Denise ^c   Mast, Marianne Schmid ^c   Gatica Perez, Daniel ^a,b  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

^b EPFL   (Switzerland)

^c UNIVERSITY OF NEUCHÂTEL   (Switzerland)

Author keywords

Employment interviews; hirability; nonverbal behavior; social computing

Indexed keywords

FEATURE EXTRACTION; FORECASTING; PERSONNEL SELECTION; REGRESSION ANALYSIS;

AUTOMATIC PREDICTION; BEHAVIORAL FEATURES; COMPUTATIONAL FRAMEWORK; COMPUTATIONAL INFERENCES; HIRABILITY; NONVERBAL BEHAVIOR; ORGANIZATIONAL PSYCHOLOGY; SOCIAL COMPUTING;

SURVEYS;

EID: 84901003963     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2014.2307169     Document Type: Article

References (46)

1. "Microcone: Intelligentmicrophone array for groups," [Online]. Available:http://www.dev-audio.com/products/microcone/.
2. "Speech feature extraction code," [Online]. Available: http://groupmedia.media.mit.edu/data.php.
3. "Wonderlic cognitive ability test," [Online]. Available: http://www.wonderlic.com/assessments/ability/cognitive-ability-tests/ classic-cognitive-ability-test.
4. N. Ambady, M. Hallahan, and R. Rosenthal, "On judging and beingjudged accurately in zero-acquaintance situations," Personality andSocial Psychol., vol. 69, no. 3, pp. 518-529, 1995.
5. N. Anderson and V. Shackleton, "Decision making in the graduate selectioninterview: A field study," Occupational Psychol., vol. 63, no.1, pp. 63-76, 1990.
6. M. R. Barrick and M. K. Mount, "The big five personality dimensionsand job performance: A meta-analysis," Personnel Psychol., vol. 44,no. 1, pp. 1-26, 1991.
7. S. Basu, "Conversational scene analysis," PhD thesis, , 2002.
8. L. M. Batrinca, N. Mana, B. Lepri, F. Pianesi, and N. Sebe, "Please,tell me about yourself: Automatic personality assessment using shortself-presentations," in Proc. Int. Conf. Multimodal Interactions, 2011,pp. 255-262.
9. J.-I. Biel, O. Aran, and D. Gatica-Perez, "You are known by how youvlog: Personality impressions, and nonverbal behavior in YouTube," inProc. Int. Conf. Weblogs and Social Media, 2011, pp. 446-449.
10. J.-I. Biel and D. Gatica-Perez, "The YouTube Lens: Crowdsourced personalityimpressions and audiovisual analysis of vlogs," IEEE Trans.Multimedia, vol. 15, no. 1, pp. 41-55, Jan. 2013.
11. L. Breiman, "Random forests," Mach. Learning, vol. 45, no. 1, pp.5-32, 2013.
12. D. F. Caldwell and J. M. Burger, "Personality characteristics of jobapplicants and success in screening interviews," Personnel Psychol.,vol. 51, no. 1, pp. 119-136, 1998.
13. M. S. Cole, H. S. Feild, W. F. Giles, and S. G. Harris, "Recruiters inferencesof applicant personality based on resume screening: Do paperpeople have a personality?," Business and Psychol., vol. 24, no. 1, pp.5-18, 2008.
14. P. T. Costa and R. R. McCrae, "Neo PI-R Professional Manual," PsychologicalAssessment Resources, 1992.
15. J. R. Curhan and A. Pentland, "Thin slices of negotiation: Predictingoutcomes from conversational dynamics within the first 5 minutes,"Appl. Psychol., vol. 92, no. 3, p. 802, 2007.
16. T. DeGroot and J. Gooty, "Can nonverbal cues be used to make meaningfulpersonality attributions in employment interviews?," Businessand Psychol., vol. 24, no. 2, pp. 179-192, 2009.
17. S. Favre, H. Salamin, J. Dines, and A. Vinciarelli, "Role recognitionin multiparty recordings using social affiliation networks, and discretedistributions," in Proc. Int. Conf. Multimodal Interfaces, 2008, pp.29-36.
18. R. J. Forbes and P. R. Jackson, "Non-verbal behaviour and the outcomeof selection interviews," Occupational Psychol., vol. 53, no. 1,pp. 65-72, 1980.
19. D. Gatica-Perez, "Automatic nonverbal analysis of social interactionin small groups: A review," Image and Vision Computing, vol. 27, no.12, pp. 1775-1787, 2009.
20. R. Gifford, C. F. Ng, and M. Wilkinson, "Nonverbal cues in the employmentinterview: Links between applicant qualities and interviewerjudgments, " Appl. Psychol., vol. 70, no. 4, pp. 729-736, 1985.
21. S. Gosling, "A very brief measure of the Big-Five personality domains,"Res. Personality, vol. 37, no. 6, pp. 504-528, 2003. (Pubitemid 37445626)
22. J. L. Howard and G. R. Ferris, "The employment interview context:Social and situational influences on interviewer decisions," Appl. SocialPsychol., vol. 26, no. 2, pp. 112-136, 1996.
23. A. I. Huffcut, J. M. Conway, P. L. Roth, and N. J. Stone, "Identificationand meta-analytic assessment of psychological constructs measured inemployment interviews," Appl. Psychol., vol. 86, no. 5, pp. 897-913,2001. (Pubitemid 33582416)
24. A. S. Imada and M. D. Hakel, "Influence of nonverbal communicationand rater proximity on impressions and decisions in simulated employmentinterviews," Appl. Psychol., vol. 62, no. 3, pp. 295-300, 1977. (Pubitemid 8278128)
25. D. B. Jayagopi,H.Hung, C.Yeo, andD.Gatica-Perez, "Modeling dominancein group conversations using nonverbal activity cues," Audio,Speech, and Language Process., vol. 17, no. 3, pp. 501-513, 2009.
26. D. B. Jayagopi, D. Sanchez-Cortes, K. Otsuka, J. Yamato, and D.Gatica-Perez, "Linking speaking, and looking behavior patterns withgroup composition, perception, and performance," in Proc. Int. Conf.Multimodal Interaction, 2012, pp. 433-440.
27. I. T. Jolliffe, Principal Component Analysis, 2nd ed. ed. : Springer-Verlag, 2002.
28. M. L. Knapp and J. A. Hall, Nonverbal communication in human interaction,7th ed. ed. : Wadsworth, Cengage Learning, 2009.
29. R. C. Liden, C. L. Martin, and C. K. Parsons, "Interviewer and applicantbehaviors in employment interviews," Acad. Management J., vol.36, no. 2, pp. 372-386, 1993.
30. A. Madan, R. Caneel, and A. Pentland, "Voices of attraction," in Proc.Int. Conf. Augmented Cognition, 2005.
31. M. A. McDaniel, D. L. Whetzel, F. L. Schmidt, and S. D. Maurer,"The validity of employment interviews: A comprehensive review andmeta-analysis, " Appl. Psychol., vol. 79, no. 4, pp. 599-616, 1994.
32. T. V. McGovern, "The making of a job interviewee: The effect of nonverbalbehavior on an interviewer's evaluations during a selection interview,"Dissertation Abstracts Int., vol. 37, no. 9B, pp. 4740-4741,1976.
33. L. S. Nguyen, J.-M. Odobez, and D. Gatica-Perez, "Using self-contextfor multimodal detection of head nods in face-to-face interactions," inProc. Int. Conf. Multimodal Interactions, 2012, pp. 289-292.
34. J.-M. Odobez and P. Bouthemy, "Robust multiresolution estimation ofparametric motion models," Visual Commun. Image Representation,vol. 6, no. 4, pp. 348-365, 1995.
35. S. Park, J. Gratch, and L. P. Morency, "I already know your answer:Using nonverbal behaviors to predict immediate outcomes in a dyadicnegotiation," in Proc. Int. Conf. Multimodal Interaction, 2012, pp.19-22.
36. C. K. Parsons and R. C. Liden, "Interviewer perceptions of applicantqualifications: A multivariate field study of demographic characteristicsand nonverbal cues," Appl. Psychol., vol. 69, no. 4, pp. 557-568,1984.
37. F. Pianesi, N.Mana, A. Cappelletti, B. Lepri, andM. Zancanaro, "Multimodalrecognition of personality traits in social interactions," in Proc.Int. Conf. Multimodal Interaction, 2008, pp. 53-60.
38. R. A. Posthuma, F. P. Morgeson, and M. A. Campion, "Beyond employmentinterview validity: A comprehensive narrative review of recentresearch and trends over time," Personnel Psychol., vol. 55, no. 1,p. 81, 2002.
39. R. E. Riggio, "Assessment of basic social skills," Personality and SocialPsychol., vol. 51, no. 3, pp. 649-660, 1986.
40. S. Rothmann and E. P. Coetzer, "The big five personality dimensionsand job performance," Ind. Psychol., vol. 29, no. 1, pp. 68-74, 2003.
41. D. Sanchez-Cortes, O. Aran, M. Schmid Mast, and D. Gatica-Perez,"A nonverbal behavior approach to identify emergent leaders in smallgroups," IEEE Trans. Multimedia, vol. 14, no. 3, pp. 816-832, Jun.2012.
42. S. Scherer, G. Stratou, M. Mahmoud, J. Boberg, J. Gratch, A. S. Rizzo,and L.-P. Morency, "Automatic behavior descriptors for psychologicaldisorder analysis," in Proc. Int. Conf. Automatic Face and GestureRecognit., 2013, pp. 1-8.
43. G. F. Schmidt, "The effect of thin slicing on structured interview decisions,"Ph.D. dissertation, Dept. Psychol., Univ. South Florida, Tampa,FL, USA, 2007.
44. Y. Song, L.-P. Morency, and R. Davis, "Multimodal human behavioranalysis: Learning correlation, and interaction across modalities," inProc. Int. Conf. Multimodal Interaction, 2012, pp. 27-30.
45. W. H. Wiesner and S. F. Cronshaw, "A meta-analytic investigation ofthe impact of interview format and degree of structure on the validityof the employment interview," Occupational Psychol., vol. 61, no. 4,pp. 275-290, 1988.
46. B. Wrede and E. Shriberg, "Spotting "hot spots" in meetings: Humanjudgments and prosodic cues," in Proc. Eurospeech, 2003, pp.2805-2808.