Social Sensing for Psychology: Automated Interpersonal Behavior Assessment

Current Directions in Psychological Science

Volumn 24, Issue 2, 2015, Pages 154-160

  Schmid Mast, Marianne ^a   Gatica Perez, Daniel ^b   Frauendorfer, Denise ^a   Nguyen, Laurent ^b   Choudhury, Tanzeem ^c  

^a UNIVERSITY OF LAUSANNE   (Switzerland)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

^c Departments of Mechanical and Aerospace Engineering   (United States)

Author keywords

honest signals; interpersonal behavior; nonverbal behavior; social interaction; social sensing; ubiquitous computing

Indexed keywords

EID: 84926484082     PISSN: 09637214     EISSN: 14678721     Source Type: Journal    
DOI: 10.1177/0963721414560811     Document Type: Article

References (36)

1. Bishop C.Pattern recognition and machine learning. New York, NY: Springer; 2012:
2. Lazer D.,Pentland A.,Adamic L.,Aral S., L., B. A.,Brewer D.,.. Van Alstyne M.. 2009;:
3. Miller G.. 2012;:
4. Pentland A.. 2008;:
5. Yarkoni T.. 2012;:
6. Ba S.,Odobez J.-M.Multiperson visual focus of attention from head pose and meeting contextual cues.IEEE Transactions on Pattern Analysis and Machine Intelligence. 2011;3:101-116
7. BasuS. (2002). Conversational scene analysis. Cambridge, MA: MIT Department of EECS. Retrieved from http://alumni.media.mit.edu/~sbasu/papers.html
8. Baumeister R. F.,Vohs K. D.,Funder D. C.Psychology as the science of self-reports and finger movements: Whatever happened to actual behavior?.Perspectives on Psychological Science. 2007;2:396-403
9. Bem D. J.Advances in experimental social psychology. Berkowitz L., ed. New York, NY: Academic Press; 1972:1-62.
10. Biel J.-I.,Aran O.,Gatica-Perez D..Paper presented at the AAAI Conference on Weblogs and Social Media; 2011Barcelona, Spain; 2011.
11. BoersmaP.WeeninkD. (2013). Praat: Doing phonetics by computer [Computer program]. Retrieved Version 5.3.51. Available from http://www.praat.org/
12. Choudhury T.,Basu S.Advances in neural information processing systems. Jordan M. I.LeCun Y.Solla S. A., ed. Vancouver, British Colombia, Canada: MIT Press; 2005:281-288.
13. Ekman P.,Friesen W.Facial Action Coding System: A technique for the measurement of facial movement. Palo Alto, CA: Consulting Psychologists Press; 1978:
14. FrauendorferD.Schmid MastM.NguyenL.Gatica-PerezD. (2014). A step towards automated applicant selection: Predicting job performance based on applicant nonverbal interview behavior. Manuscript in preparation.
15. Funes K.,Odobez J.-M..Paper presented at the IEEE Conference on Computer Vision and Pattern Recognition; 2012Providence, RI; 2012.
16. Hoque M.,Courgeon M.,Martin J.-C.,Mutlu B.,Picard R. W..Paper presented at the Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing; 2013Zurich, Switzerland; 2013.
17. Kim T.,Chang A.,Holland L.,Pentland A. S..Paper presented at the 2008 ACM Conference on Computer-Supported Cooperative Work; 2008San Diego, CA; 2008.
18. Kiran K.,Rachuri M.,Musolesi M.,Mascolo C.,Rentfrow P. J.,Longworth C.,Aucinas A..Paper presented at the 12th ACM International Conference on Ubiquitous Computing (Ubicomp); 2010Copenhagen, Denmark; 2010.
19. Lane N. D.,Miluzzo E.,Hong L.,Peebles D.,Choudhury T.,Campbell A. T.A survey of mobile phone sensing.Communications Magazine, IEEE. 2010;48 (9): 140-150
20. Lazer D.,Pentland A.,Adamic L.,Aral S., L., B. A.,Brewer D.,.. Van Alstyne M.Life in the network: The coming age of computational social science.Science. 2009;323:721-723
21. Littlewort G.,Whitehill J.,Wu T.,Fasel I.,Frank M.,Movellan J.,Bartlett M..Paper presented at the IEEE International Conference on Automatic Face and Gesture Recognition; 2011Santa Barbara, CA; 2011.
22. Lu H.,Rabbi M.,Chittaranjan G. T.,Frauendorfer D.,Schmid Mast M.,Campbell A. T.,.. Choudhury T..Paper presented at the UbiComp; 2012Pittsburgh, PA; 2012.
23. Marcos-Ramiro A.,Pizarro-Perez D.,Marron-Romera M.,Nguyen L. S.,Gatica-Perez D..Paper presented at the IEEE International Conference on Automatic Face and Gesture Recognition; 2013Shanghai, China; 2013.
24. Marin J., M. J.,Zisserman A.,Eichner A.,Ferrari V.Detecting people looking at each other in videos.International Journal of Computer Vision. 2014;106:282-296
25. Mehl M. R.,Pennebaker J. W.The sounds of social life: A psychometric analysis of students’ daily social environments and natural conversations.Journal of Personality and Social Psychology. 2003;84:857-870
26. Mehl M. R.,Pennebaker J. W.,Crow D. M.,Dabbs J.,Price J. H.The Electronically Activated Recorder (EAR): A device for sampling naturalistic daily activities and conversations.Behavior Research Methods, Instruments, & Computers. 2001;33:517-523
27. Miller G.The smartphone psychology manifesto.Perspectives on Psychological Science. 2012;7:221-237
28. Nguyen L. S.,Odobez J.-M.,Gatica-Perez D..Paper presented at the International Conference on Multimodal Interactions; 2012Santa Monica, CA; 2012.
29. Olguin D. O.,Waber B. N.,Taemie K.,Mohan A.,Ara K.,Pentland A.Sensible organizations: Technology and methodology for automatically measuring organizational behavior.IEEE Transactions on Systems, Man, and Cybernetics—Part B: Cybernetics. 2009;39 (1): 43-55
30. Patel R. A.,Hartzler A.,Czerwinski M. P.,Pratt W.,Back A. L.,Roseway A..Paper presented at the CHI ’13 Extended Abstracts on Human Factors in Computing Systems; 2013Paris, France; 2013.
31. Pentland A.Honest signals. Cambridge, MA: MIT Press; 2008:
32. Rachuri K. K.,Musolesi M.,Mascolo C.,Rentfrow P. J.,Longworth C.,Aucinas A..Paper presented at the Proceedings of the 12th ACM International Conference on Ubiquitous computing; 2010Copenhagen, Denmark; 2010.
33. Shotton J.,Fitzgibbon A.,Cook M.,Sharp T.,Finocchio M.,Moore R. K.,.. Blake A..Paper presented at the IEEE Conference on Computer Vision and Pattern Recognition; 2011Colorado Springs, CO; 2011.
34. VinciarelliA.PanticM.BourlardH. (2009). Social signal processing: Survey of an emerging domain. Image and Vision Computing, 27, 1743–1759. doi:http://dx.doi.org/10.1016/j.imavis.2008.11.007
35. Wyatt D.,Choudhury T.,Bilmes J.,Kitts J. A.Inferring colocation and conversation networks from privacy-sensitive audio with implications for computational social science.ACM Transactions on Intelligent Systems and Technology. 2011;2 (1): 1-41
36. Yarkoni T.Psychoinformatics: New horizons at the interface of the psychological and computing sciences.Current Directions in Psychological Science. 2012;21:391-397