Automatic nonverbal analysis of social interaction in small groups: A review

Image and Vision Computing

Volumn 27, Issue 12, 2009, Pages 1775-1787

  Gatica Perez, Daniel ^a  

^a EPFL   (Switzerland)

Author keywords

Nonverbal behavior; Small group conversations; Social interaction analysis

Indexed keywords

COMMUNICATION; TIME DOMAIN ANALYSIS;

AUTOMATIC ANALYSIS; AUTOMATIC UNDERSTANDING; COMPUTATIONAL MODELING; COMPUTATIONAL TECHNIQUE; CONVERSATIONAL ANALYSIS; FACE-TO-FACE INTERACTION; INTERACTION MANAGEMENT; INTERNAL STATE; LINGUISTIC APPROACH; NON-VERBAL COMMUNICATIONS; NONVERBAL BEHAVIOR; PERSONALITY TRAITS; SMALL GROUP CONVERSATIONS; SMALL GROUPS; SOCIAL COGNITION; SOCIAL INTERACTION ANALYSIS; SOCIAL INTERACTIONS; SOCIAL PSYCHOLOGY; SOCIAL RELATIONSHIPS; TECHNICAL COMMUNITY; TIME-SCALES;

MAINTENANCE OF WAY;

EID: 70349297103     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2009.01.004     Document Type: Article

References (137)

1. J. Ajmera, C. Wooters, A robust speaker clustering algorithm, in: Proc. of the IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), St. Thomas, Dec. 2003.
2. H.J.A. op den Akker, M. Theune, How do I address you? Modelling addressing behavior based on an analysis of a multi-modal corpus of conversational discourse, in: Proc. of the AISB Symposium on Multimodal Output Generation (MOG 2008), Aberdeen, Apr. 2008.
3. M. Al-Hames, A. Dielmann, D. Gatica-Perez, S. Reiter, S. Renals, G. Rigoll, D. Zhang, Multimodal integration for meeting group action segmentation and recognition, in: Proc. of the Workshop on Machine Learning for Multimodal Interaction (MLMI), Edinburgh, May 2005.
4. S.O. Ba, J.-M. Odobez, A probabilistic framework for joint head tracking and pose estimation, in: Proc. of the Int. Conf. on Pattern Recognition (ICPR), Cambridge, Aug. 2004.
5. S.O. Ba, J.-M. Odobez, A study on visual focus of attention modeling using head pose, in: Proc. of the Workshop on Machine Learning for Multimodal Interaction (MLMI), Washington, DC, May 2006.
6. S.O. Ba, J.M. Odobez, Multi-party focus of attention recognition in meetings from head pose and multimodal contextual cues, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), Las Vegas, Mar. 2008.
7. K. Bachour, F. Kaplan, P. Dillenbourg, An interactive table for regulating face-to-face collaborative learning, in: Proc. of the European Conf. on Technology-Enhanced Learning (ECTEL), Maastricht, Sep. 2008.
8. Bales R.F. Interaction Process Analysis: A Method for the Study of Small Groups (1951), Addison-Wesley, Reading, MA
9. S. Banerjee, J. Cohen, T. Quisel, A. Chan, Y. Patodia, Z. Al-Bawab, R. Zhang, P. Rybsi, M. Veloso, A. Black, R. Stern, R. Rosenfeld, A. Rudnicky, Creating multi-modal, user-centric records of meetings with the Carnegie Mellon meeting recording architecture, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, Meeting Recognition Workshop, Montreal, Mar. 2004.
10. S. Banerjee, A. Rudnicky, Using simple speech-based features to detect the state of a meeting and the roles of the meeting participants, in: Proc. of the Int. Conf. on Spoken Language Processing (ICSLP), Jeju Island, Oct. 2004.
11. S. Basu, T. Choudhury, B. Clarkson, A. Pentland, Towards measuring human interactions in conversational settings, in: Proc. of the IEEE CVPR Int. Workshop on Cues in Communication (CVPR-CUES), Kauai, Dec. 2001.
12. S. Bengio, An asynchronous Hidden Markov Model for audio-visual speech recognition, in: Proc. of the Conf. on Advances in Neural Information Processing Systems, NIPS 15, Vancouver, Dec. 2002.
13. T. Bergstrom, K. Karahalios, Conversation clock: visualizing audio patterns in co-located groups, in: Proc. of the Hawaii Int. Conf. on Systems Science (HICSS), Hawaii, 2007.
14. M. Brand, N. Oliver, A. Pentland, Coupled hidden Markov models for complex action recognition, in: Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, Jun. 1997.
15. O. Brdiczka, J. Maisonnasse, P. Reigner, Automatic detection of interaction groups, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Trento, Oct. 2005.
16. Burgoon J.K., and Dunbar N.E. Nonverbal expressions of dominance and power in human relationships. In: Manusov V., and Patterson M. (Eds). The Sage Handbook of Nonverbal Communication (2006), Sage, Beverley Hills, CA
17. S. Burger, V. MacLaren, H. Yu, The ISL meeting corpus: the impact of meeting type on speech style, in: Proc. of the ICSLP, Denver, Sep. 2002.
18. N. Campbell, On the use of nonverbal speech sounds in human communication, in: Proc. of the COST 2102 Workshop on Verbal and Nonverbal Communication Behaviours, Vietri sul Mare, Mar. 2007.
19. N. Campbell, T. Sadanobu, M. Imura, N. Iwahashi, S. Noriko, D. Douxchamps, A multimedia database of meeting and informal interactions for tracking participant involvement and discourse flow, in: Proc. of the Language Resources and Evaluation Conference (LREC), Genoa, May 2006.
20. N. Campbell, D. Douxchamps, Processing image and audio information for recognizing discourse participation status through features of face and voice, in: Proc. of the INTERSPEECH, 2007.
21. Cappella J.N. Controlling the floor in conversation. In: Siegman A.W., and Feldstein S. (Eds). Multichannel Integrations of Nonverbal Behavior (1985), Erlbaum, Hillsdale, NJ
22. J. Carletta, S. Ashby, S. Bourban, M. Flynn, M. Guillemot, T. Hain, J. Kadlec,V. Karaiskos, W. Kraaij, M. Kronenthal, G. Lathoud, M. Lincoln, A. Lisowska, I. McCowan, W. Post, D. Reidsma, P. Wellner, The AMI meeting corpus: a pre-announcement, in: Proc. of the Workshop on Machine Learning for Multimodal Interaction (MLMI), Edinburgh, Jul. 2005.
23. Carletta J. Unleashing the killer corpus: experiences in creating the multi-everything AMI meeting corpus. Language Resources and Evaluation Journal 41 2 (2007) 181-190
24. Chartrand T.L., and Bargh J.A. The chameleon effect: the perception-behavior link and social interaction. Journal of Personality and Social Psychology 76 6 (1999) 893-910
25. Chartrand T.L., Maddux W., and Lakin J. Beyond the perception-behavior link: the ubiquitous utility and motivational moderators of nonconscious mimicry. In: Hassin R., Uleman J., and Bargh J.A. (Eds). The New Unconscious (2005), Oxford University Press, Berlin
26. L. Chen, T.R. Rose, F. Parrill, X. Han, J. Tu, Z. Huang, M. Harper, F. Quek, D. McNeill, R. Tuttle, T. Huang, VACE multimodal meeting corpus, in: Proc. of the Workshop on Machine Learning for Multimodal Interaction (MLMI), Edinburgh, Jul. 2005.
27. L. Chen, M. Harper, A. Franklin, T.R. Rose, I. Kimbara, Z. Huang, F. Quek, A multimodal analysis of floor control in meetings, in: Proc. of the Workshop on Machine Learning for Multimodal Interaction (MLMI), Washington, DC, May 2006.
28. Choi Y.S., Gray H.M., and Ambady N. The glimpsed world: unintended communication and unintended perception. In: Hassin R.H., Uleman J.S., and Bargh J.A. (Eds). The New Unconscious (2005), Oxford University Press, Oxford
29. T. Choudhury, A. Pentland, Modeling face-to-face communication using the sociometer, in: Proc. of the Int. Conf. on Ubiquitous Computing, Seattle, Oct. 2003.
30. T. Choudhury, S. Basu, Modeling conversational dynamics as a mixed memory Markov process, in: Proc. of the NIPS, Dec. 2004.
31. Clark H.H., and Carlson T.B. Hearers and speech acts. Language 58 2 (1982) 332-373
32. Cook M., and Smith J.M.C. The role of gaze in impression formation. British Journal of Social and Clinical Psychology (1975)
33. Cowie R., Douglas-Cowie E., Tsapatsoulis N., Votsis G., Kollias S., Fellenz W., and Taylor J. Emotion recognition in human-computer interaction. IEEE Signal Processing Magazine (2001)
34. Curhan J.R., and Pentland A. Thin slices of negotiation: predicting outcomes from conversational dynamics within the first 5 minutes. Journal of Applied Psychology 92 3 (2007) 802-811
35. A. Dielmann, S. Renals, Dynamic Bayesian networks for meeting structuring, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Montreal, May 2004.
36. Dielmann A., and Renals S. Dynamic Bayesian networks for meeting structuring. IEEE Transactions in Multimedia 9 1 (2007) 25-36
37. J.M. DiMicco, A. Pandolfo, W. Bender influencing group participation with a shared display, in: Proc. of the ACM Conf. on Computer Supported Cooperative Work (CSCW), Chicago, Nov. 2004.
38. W. Dong, B. Lepri, A. Capelletti, A. Pentland, F. Pianesi, M. Zancanaro, Using the influence model to recognize functional roles in meetings, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Nagoya, Nov. 2007.
39. Dovidio J.F., and Ellyson S.L. Decoding visual dominance: atributions of power based on relative percentages of looking while speaking and looking while listening. Social Psychology Quarterly 45 2 (1982) 106-113
40. Dunbar N.E., and Burgoon J.K. Perceptions of power and interactional dominance in interpersonal relationships. Journal of Social and Personal Relationships 22 2 (2005) 207-233
41. Dunbar N.E., and Burgoon J.K. Measuring nonverbal dominance. In: Manusov V. (Ed). The Sourcebook of Nonverbal Measures: Going Beyond Words (2005), Erlbaum, Hillsdale, NJ
42. Duncan S. Some signals and rules for taking speaker turns in conversations. Journal of Personality and Social Psychology 23 2 (1972) 283-292
43. Dupont S., and Luettin J. Audio-visual speech modeling for continuous speech recognition. IEEE Transactions on Multimedia 2 3 (2000) 141-151
44. N. Eagle, A. Pentland, Social network computing, in: Proc. of the Int. Conf. on Ubiquituous Computing (UBICOMP), Seattle, Oct. 2003.
45. Efran J.S. Looking for approval: effects of visual behavior of approbation from persons differing in importance. Journal of Personality and Social Psychology 10 1 (1968) 21-25
46. In: Ellyson S.L., and Dovidio J.F. (Eds). Power Dominance and Nonverbal Behavior (1985), Springer, Berlin
47. Exline R.V., Ellyson S.L., and Long B. Visual behavior as an aspect of power role relationships. Advances in the Study of Communication and Affect (1975), Plenum Press, New York
48. S. Favre, H. Salamin, J. Dines, A. Vinciarelli. Role recognition in multiparty recordings using social affiliation networks and discrete distributions, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Chania, Oct. 2008.
49. Fay N., Garod S., and Carletta J. Group discussion as interactive dialogue or serial monologue: the influence of group size. Psychological Science 11 6 (2000) 487-492
50. N. Garg, S. Favre, H. Salamin, D. Hakkani-Tr, A. Vinciarelli, Role recognition for meeting participants: an approach based on lexical information and social network analysis, in: Proc. of the ACM Int. Conf. on Multimedia, Vancouver, Oct. 2008.
51. J. Garofolo, M. Michel, C. Laprun, V. Stanford, E. Tabassi, The NIST meeting room pilot corpus, in: Proc. of the Language Resources and Evaluation Conference (LREC), Lisbon, May 2004.
52. D. Gatica-Perez, I. McCowan, D. Zhang, S. Bengio, Detecting group interest-level in meetings, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Philadelphia, Mar. 2005.
53. D. Gatica-Perez, D. Zhang, S. Bengio, Extracting information from multimedia meeting collections, in: Proc. of the ACM Int. Conf. on Multimedia, Workshop on Multimedia Information Retrieval (ACM MM MIR), Singapore, Nov. 2005.
54. D. Gatica-Perez, Analyzing human interaction in conversations: a review, in: Proc. of the IEEE Int. Conf. on Multisensor Fusion and Integration for Intelligent Systems (MFI), Heidelberg, Sep. 2006.
55. Gifford R. Personality and nonverbal behavior: a complex conundrum. In: Manusov V., and Patterson M.L. (Eds). The SAGE Handbook of Nonverbal Communication (2006), Sage, Beverly Hills, CA
56. Goodwin C. Conversational Organization: Interaction Between Speakers and Hearers vol. 11 (1981), Academic Press, New York, NY
57. Hall J.A., Coats E.J., and LeBeau L.S. Nonverbal behavior and the vertical dimension of social relations: a meta-analysis. Psychological Bulletin 131 6 (2005) 898-924
58. Hare A.P. Types of roles in small groups: a bit of history and a current perspective. Small Group Research 25 Aug. (1994) 433-448
59. In: Hassin R.H., Uleman J.S., and Bargh J.A. (Eds). The New Unconscious (2005), Oxford University Press, Oxford
60. D. Heylen, D. Reidsma, R. Ordelman, Annotating state of mind in meeting data, in: Proc. of the LREC Workshop on Corpora for Research on Emotion and Affect, Genoa, May 2006.
61. D. Heylen, A. Nijholt, M. Poel, Generating nonverbal signals for a sensitive artificial listener, in: Proc. of the COST 2102 Workshop on Verbal and Nonverbal Communication Behaviours, Vietri sul Mare, Mar. 2007.
62. D. Hillard, M. Ostendorf, E. Shriberg, Detection of agreement vs. disagreement in meetings: training with unlabeled data, in: Proc. of the HLT-NAACL Conference, Edmonton, May 2003.
63. H. Hung, D. Jayagopi, C. Yeo, G. Friedland, S. Ba, J.-M. Odobez, K. Ramchandran, N. Mirghafori, D. Gatica-Perez, Using audio and video features to classify the most dominant person in a group meeting, in: Proc. of the ACM Int. Conf. on Multimedia (ACM MM), Augsburg, Sep. 2007.
64. H. Hung, Y. Huang, G. Friedland, D. Gatica-Perez, Estimating the dominant person in multi-party conversations using speaker diarization strategies, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), Las Vegas, Mar. 2008.
65. H. Hung, Y. Huang, C. Yeo, D. Gatica-Perez. Associating audio-visual activity cues in a dominance estimation framework, in: Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, Workshop on CVPR for Human Communicative Behavior Analysis (CVPR4HB), Anchorage, Jun. 2008.
66. H. Hung, D. Jayagopi, S. Ba, J.-M. Odobez, D. Gatica-Perez, Investigating automatic dominance estimation in groups from visual attention and speaking activity, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Chania, Oct. 2008.
67. A. Janin, D. Baron, J. Edwards, D. Ellis, D. Gelbart, N. Morgan, B. Peskin, T. Pfau, E. Shriberg, A. Stolcke, C. Wooters, The ICSI meeting corpus, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Hong-Kong, Apr. 2003.
68. D. Jayagopi, S. Ba, J.-M. Odobez, D. Gatica-Perez Predicting two facets of social verticality in meetings from five-minute time slices and nonverbal cues, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Chania, Oct. 2008.
69. D. Jayagopi, H. Hung, C. Yeo, D. Gatica-Perez, Predicting the dominant clique in group conversations with nonverbal cues, in: Proc. of the ACM Int. Conf. on Multimedia, Vancouver, Oct. 2008.
70. D. Jayagopi, H. Hung, C. Yeo, D. Gatica-Perez Modeling dominance in group conversations using nonverbal activity cues, IEEE Trans. on Pattern Analysis and Machine Intelligence, Special Issue on Multimodal Processing for Speech-based Interactions, vol. 17, No. 3, Mar. 2009.
71. John O.P., and Srivastava S. The big five trait taxonomy: history measurement and theoretical perspectives. In: Pervian L.A., and John O.P. (Eds). Handbook of Personality Theory and Research (1999), Guilford Press, New York
72. N. Jovanovic, R. op den Akker, Towards automatic addressee identification in multi-party dialogues, in: Proc. of the SIGDial Workshop on Discourse and Dialogue, Boston, Apr. 2004.
73. N. Jovanovic, R. op den Akker, A. Nijholt, A corpus for studying addressing behavior in multi-party dialogues, in: Proc. of the SIGDial Workshop on Discourse and Dialogue, Lisbon, Sep. 2005.
74. N. Jovanovic, R. op den Akker, A. Nijholt, Addressee identification in face-to-face meetings, in: Proc. of the Conf. European Chapter of the Association for Computational Linguistics (EACL), Trento, Apr. 2006.
75. N. Jovanovic, To whom it may concern: addressing in face-to-face meetings, Doctoral Dissertation, Department of Computer Science, University of Twente, Mar. 2007.
76. M. Katzenmeier, R. Stiefelhagen, T. Schultz, Identifying the addressee in human-human-robot interactions based on head pose and speech, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), State College, PA, Oct. 2004.
77. L. Kennedy, D. Ellis, Pitch-based emphasis detection for characterization of meeting recordings, in: Proc. of the ASRU, Virgin Islands, Dec. 2003.
78. L. Kennedy, D. Ellis, Laughter detection in meetings, in: Proc. of the ICASSP 2004.
79. T. Kim, A. Chang, L. Holland, A. Pentland, Meeting mediator: enhancing group collaboration with sociometric feedback, in: Proc. of the ACM Conf. on Computer Supported Cooperative Work (CSCW), San Diego, Nov. 2008.
80. Knapp M.L., and Hall J.A. Nonverbal Communication in Human Interaction. 6th ed. (2005), Wadsworth, Berlin
81. O. Kulyk, C. Wang, J. Terken, Real-time feedback based on nonverbal behaviour to enhance social dynamics in small group meetings, in: Proc. of the Int. Workshop on Machine Learning for Multimodal Interaction (MLMI), Edinburgh, Jul. 2005.
82. M. Knox, N. Mirghafori, Automatic laughter detection using neural networks, in: Proc. of the Interspeech, Antwerp, 2007.
83. K. Laskowski, T. Schultz, Detection of laughter-in-interaction in multichannel close-talk microphone recordings of meetings, in: Proc. of the Int. Workshop on Machine Learning for Multimodal Interaction (MLMI), Utrecht, Sep. 2008.
84. Leffler A., Gillespie D.L., and Conaty J.C. The effects of status differentiation on nonverbal behavior. Social Psychology Quarterly 45 3 (1982) 151-161
85. Lynn Smith-Lovin C.B. Interruptions in group discussions: the effects of gender and group composition. American Sociological Review 54 3 (1989) 424-435
86. A. Madan, Thin slices of interest, Master's Thesis, Massachusetts Institute of Technology, 2005.
87. A. Madan, R. Caneel, A. Pentland, Voices of attraction, in: Proc. of the Int. Conf. on Augmented Cognition (AC-HCI), Las Vegas, Jul. 2005.
88. N. Mana, B. Lepri, P. Chippendale, A. Cappelletti, F. Pianesi, P. Svaizer, M. Zancanaro, Multimodal corpus of multi-party meetings for automatic social behavior analysis and personality traits detection, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Workshop on Tagging, Mining, and Retrieval of Human-Related Activity Information, Nagoya, Nov. 2007.
89. In: Manusov V., and Patterson M.L. (Eds). The SAGE Handbook of Nonverbal Communication (2006), Sage, Beverley Hills, CA
90. I. McCowan, S. Bengio, D. Gatica-Perez, G. Lathoud, F. Monay, D. Moore, P. Wellner, H. Bourlard, Modeling human interactions in meetings, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Hong-Kong, Apr. 2003.
91. McCowan I., Gatica-Perez D., Bengio S., Lathoud G., Barnard M., and Zhang D. Automatic analysis of multimodal group actions in meetings. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 3 (2005) 305-317
92. McGrath J.E. Groups: Interaction and Performance (1984), Prentice-Hall, Englewood Cliffs, NJ
93. In: McNeill D. (Ed). Language and Gesture (2000), Cambridge University Press, Cambridge, MA
94. N. Morgan, D. Baron, J. Edwards, D. Ellis, D. Gelbart, A. Janin, T. Pfau, E. Shriberg, A. Stolcke, The meeting project at ICSI, in: Proc. of the Human Language Technology Conf. (HLT), San Diego, CA, March 2001.
95. N. Oliver, E. Horvitz, A. Garg, Layered representations for learning and inferring office activity from multiple sensory channels, in: Proceedings of the International Conference on Multimodal Interfaces (ICMI'02), October 2002.
96. K. Otsuka, Y. Takemae, J. Yamato, H. Murase, Probabilistic inference of multiparty-conversation structure based on markov-switching models of gaze patterns, head directions, and utterances, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Trento, Oct. 2005.
97. K. Otsuka, J. Yamato, Y. Takemae, H. Murase, Quantifying interpersonal influence in face-to-face conversations based on visual attention patterns, in: Proc. of the ACM CHI Extended Abstract, Montreal, Apr. 2006.
98. K. Otsuka, J. Yamato, Y. Takemae, H. Murase, Conversation scene analysis with dynamic Bayesian network based on visual head tracking, in: Proc. of the IEEE Int. Conf. on Multimedia (ICME), Toronto, Jul. 2006.
99. K. Otsuka, J. Yamato, H. Sawada, Automatic inference of cross-modal nonverbal interactions in multiparty conversations, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Nagoya, Nov. 2007.
100. K. Otsuka, S. Araki, K. Ishizuka, M. Fujimoto, M. Heinrich, J. Yamato, A realtime multimodal system for analyzing group meetings by combining face pose tracking and speaker diarization, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Chania, Oct. 2008.
101. Pentland A. Socially aware computation and communication. IEEE Computer 38 Mar. (2005) 63-70
102. A. Pentland, A. Madan, Perception of social interest, in: Proc. of the IEEE Int. Conf. on Computer Vision, Workshop on Modeling People and Human Interaction (ICCV-PHI), Beijing, Oct. 2005.
103. Pentland A. Honest Signals: How They Shape Our World (2008), MIT Press, Cambridge, MA
104. S. Petridis, M. Pantic, Audiovisual laughter detection based on temporal features, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Chania, Oct. 2008.
105. Pianesi F., Zancanaro M., Lepri B., and Cappelletti A. A multimodal annotated corpus of consensus decision making meetings. Language Resources and Evaluation 41 3-4 (2007)
106. F. Pianesi, N. Mana, A. Cappelletti, B. Lepri, M. Zancanaro, Multimodal recognition of personality traits in social interactions, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Chania, Oct. 2008.
107. Rabiner L.R., and Juang B.-H. Fundamentals of Speech Recognition (1993), Prentice-Hall, Englewood Cliffs, NJ
108. B. Raducanu, J. Vitria, D. Gatica-Perez, You're fired! Nonverbal role analysis in competitive meetings, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), Taiwan, Apr. 2009.
109. D. Reidsma, D. Heylen, and R. Ordelman, "Annotating Emotion in Meetings Proceedings, in Proc. LREC, Genoa, May 2006.
110. S. Reiter, B. Schuller, G. Rigoll, Segmentation and recognition of meeting events using a two-layered HMM and a combined MLP-HMM approach, in: Proc. of the IEEE Int. Conf. on Multimedia (ICME), Toronto, Jul. 2006.
111. R.J. Rienks, D. Heylen, Automatic dominance detection in meetings using easily detectable features, in: Proc. of the Workshop on Machine Learning for Multimodal Interaction (MLMI), Edinburgh, Jul. 2005.
112. R. Rienks, D. Zhang, D. Gatica-Perez, W. Post, Detection and application of influence rankings in small-group meetings, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Banff, Nov. 2006.
113. R. Rienks, A. Nijholt, D. Heylen, Verbal behavior of the more and the less influential meeting participant, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Workshop on Tagging, Mining and Retrieval of Human Related Activity Information, Nagoya, Oct. 2007.
114. Rotter J.B. Generalized expectancies for internal versus external control of reinforcement. Psychological Monographs 80 (1965)
115. Salazar A.J. An analysis of the development evolution of roles in the small group. Small Group Research 27 4 (1996) 475-503
116. Schmid Mast M. Dominance as expressed and inferred through speaking time: a meta-analysis. Human Communication Research 28 3 (2002) 420-450
117. E. Shriberg, R. Dhillon, S. Bhagat, J. Ang, H. Carvey, The ICSI meeting recorder dialog act (MRDA) corpus, in: Proc. of the HLT-NAACL SIGDIAL Workshop, Boston, Apr. 2004.
118. E. Shriberg, Spontaneous speech: how people really talk and why engineers should care, in: Proc. of the European Conf. on Speech Communication and Technology (Eurospeech), Lisbon, Sep. 2005.
119. V. Stanford, J. Garofolo, M. Michel, The NIST smart space and meeting room projects: signals, acquisition, annotation, and metrics, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Hong Kong, 2003.
120. Stiefelhagen R., Yang J., and Waibel A. Modeling focus of attention for meeting indexing based on multiple cues. IEEE Transactions on Neural Networks 13 4 (2002) 928-938
121. R. Stiefelhagen, Tracking focus of attention in meetings, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Pittsburgh, PA, 2002.
122. W.T. Stoltzman, Toward a social signaling framework: activity and emphasis in speech, Master's Thesis, Massachusetts Institute of Technology, Sep. 2006.
123. J. Sturm, O. Houben-Van Herwijnen, A. Eyck, J. Terken, Influencing social dynamics in meetings through a peripheral display, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Nagoya, Oct. 2007.
124. Y. Takemae, K. Otsuka, N. Mukawa, An analysis of speakers' gaze behavior for automatic addressee identification in multiparty conversation and its application to video editing, in: Proc. of the IEEE Int. Workshop on Robot and Human Interface Communication, Okayama, Sep. 2004.
125. K. Truong, D. van Leeuwen, Automatic detection of laughter, in: Proc. of the Interspeech, Lisbon, 2005.
126. Truong K., and van Leeuwen D. Automatic discrimination between laughter and speech. Speech Communication 49 2 (2007) 144-158
127. Tusing K.J., and Dillard J.P. The sounds of dominance: vocal precursors of perceived dominance during interpersonal influence. Human Communication Research 26 1 (2000) 148-171
128. Vinciarelli A. Speakers role recognition in multiparty audio recordings using social network analysis and duration distribution modeling. IEEE Transactions on Multimedia 9 6 (2007) 1215-1226
129. A. Vinciarelli, M. Pantic, H. Bourlard, A. Pentland, Social signal processing: state-of-the-art and future perspectives of an Emergin domain, in: Proc. of the ACM Int. Conf. on Multimedia, Vancouver, Oct. 2008.
130. A. Waibel, M. Bett, F. Metze, K. Ries, T. Schaaf, T. Schultz, H. Soltau, H. Yu, K. Zechner, Advances in automatic meeting record creation and access, in: Proc. of the IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Salt Lake City, UT, May 2001.
131. B. Wrede, E. Shriberg, Spotting hotspots in meetings: human judgments and prosodic cues, in: Proc. of the Eurospeech, Geneva, Sep. 2003.
132. B. Wrede, E. Shriberg, The relationship between dialogue acts and hot spots in meetings, in: Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Virgin Islands, Dec. 2003.
133. M. Zancanaro, B. Lepri, F. Pianesi, Automatic detection of group functional roles in face to face interactions, in: Proc. of the Int. Conf. on Multimodal Interfaces (ICMI), Banff, Nov. 2006.
134. D. Zhang, D. Gatica-Perez, S. Bengio, I. McCowan, G. Lathoud, Modeling individual and group actions in meetings: a two-layer HMM framework, in: Proc. of the IEEE CVPR Workshop on Event Mining, Washington, DC, Jun. 2004.
135. D. Zhang, D. Gatica-Perez, S. Bengio, I. McCowan, G. Lathoud, Multimodal group action clustering in meetings, in: Proc. of the ACM Int. Conf. on Multimedia, Workshop on Video Surveillance and Sensor Networks (ACM MM-VSSN), New York, Oct. 2004.
136. D. Zhang, D. Gatica-Perez, S. Bengio, Semi-supervised meeting event recognition with adapted HMMs, in: Proc. of the IEEE Int. Conf. on Multimedia (ICME), Amsterdam, Jul. 2005.
137. Zhang D., Gatica-Perez D., Bengio S., and McCowan I. Modeling individual and group actions in meetings with layered HMMs. IEEE Transactions on Multimedia 8 3 (2006)