Analyzing group interactions in conversations: A review

IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems

Volumn , Issue , 2006, Pages 41-46

  Gatica Perez, Daniel ^a  

^a EPFL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

FACE RECOGNITION; MODAL ANALYSIS; PROFESSIONAL ASPECTS; SOCIAL ASPECTS;

GROUP INTERACTIONS; MULTISENSOR FUSION;

USER INTERFACES;

EID: 34548224266     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MFI.2006.265658     Document Type: Conference Paper

References (58)

1. M. Al-Hames, A. Dielmann, D. Gatica-Perez, S. Reiter, S. Renais, G. Rigoll, and D. Zhang, "Multimodal integration for meeting group action segmentation and recognition," in Proc. Workshop on Machine Learning for Multimodal Interaction (MLMI), Edinburgh.
2. J. Ang, Y. Liu, and E. Shriberg, "Automatic dialog act segmentation and classification in multiparty meetings," in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Philadelphia, Mar. 2005.
3. S. O. Ba and J.-M. Odobez, "A probabilistic framework for joint head tracking and pose estimation," in Proc. Int. Conf. on Pattern Recognition (ICPR), Cambridge, Aug. 2004.
4. S. O. Ba and J.-M. Odobez, "A study on visual focus of attention modeling using head pose," in Proc. Workshop on Machine Learning for Multimodal Interaction (MLMI), Washington, DC, May 2006.
5. R.F. Bales, Interaction Process Analysis: a method for the study of small groups, Addison-Wesley, 1951.
6. S. Basu, T. Choudhury, B. Clarkson, and A. Pentland, "Towards measuring human interactions in conversational settings," in Proc. IEEE CVPR Int. Workshop on Cues in Communication (CVPR-CUES), Kauai, Dec. 2001.
7. S. Bengio, "An asynchronous Hidden Markov Model for audio-visual speech recognition," in Proc. Conf. on Advances in Neural Information Processing Systems, NIPS 15, Vancouver, Dec. 2002.
8. M. Brand, "Coupled Hidden Markov Model for modeling interacting processes," MIT Media Lab, Vision and Modeling, Technical Report 405, Nov. 2002.
9. L. Chen, T. R. Rose, F. Parrill, X. Han. J. Tu, Z. Huang, M. Harper, F. Quek, D. McNeill, R. Tuttle, and T. Huang, "VACE multimodal meeting corpus," in Proc. Workshop on Machine Learning for Multimodal Interaction (MLMI), Edinburgh, Jul. 2005.
10. L. Chen, M. Harper, A. Franklin, T. R. Rose, I. Kimbara, Z. Huang, and F. Quek, "A multimodal analysis of floor control in meetings," in Proc. Workshop on Machine Learning for Multimodal Interaction (MLMI), Washington, DC, May 2006.
11. T. Choudhury and S. Basu, "Modeling conversational dynamics as a mixed memory markov process," in Proc. NIPS, Dec. 2004.
12. H. H. Clark and T. B. Carlson, "Hearers and speech acts," Language, vol. 58, no. 2, pp. 332-373, Jun. 1982.
13. M. Cook and J. M. C. Smith, "The role of gaze in impression formation," British Journal of Social and Clinical Psychology, 1975.
14. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor, "Emotion Recognition in Human-Computer Interaction," IEEE Signal Processing Magazine, 2001.
15. A. Dielmann and S. Renals, "Dynamic Bayesian networks for meeting structuring," in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Montreal, May 2004.
16. J. F. Dovidio and S. L. Ellyson, "Decoding visual dominance: atributions of power based on relative percentages of looking while speaking and looking while listening," Social Psychology Quarterly, vol. 45, no. 2, pp. 106-113, Jun. 1982.
17. S. Dupont and J. Luettin, "Audio-visual speech modeling for continuous speech recognition," IEEE Transactions on Multimedia, vol. 2, no. 3, pp. 141-151, September 2000.
18. S. Duncan, "Some signals and rules for taking speaker turns in conversations", Journal of Personality and Social Psychology, vol. 23, no. 2, pp. 283-292, 1972.
19. N. Eagle and A. Pentland, "Social network computing," in Proc. Int. Conf. on Ubiquituous Computing (UBICOMP), Seattle, Oct. 2003.
20. J. S. Efran, "Looking for approval: effects of visual behavior of approbation from persons differing in importance," Journal of Personality and Social Psychology, vol. 10, no. 1, pp. 21-25, Sep. 1968.
21. S. L. Ellyson and J. F. Dovidio, Eds., Power, Dominance, and Nonverbal Behavior, Springer-Verlag., 1985.
22. R. V. Exline, S. L. Ellyson, and B. Long, "Visual behavior as an aspect of power role relationships," Advances in the study of communication and affect, 1975.
23. N. Fay, S. Garod, and J. Carletta, "Group discussion as interactive dialogue or serial monologue: the influence of group size," Psychological Science, vol. 11, no. 6, pp. 487-492, 2000.
24. D. Gatica-Perez, I. McCowan, D. Zhang, and S. Bengio, "Detecting group interest-level in meetings," in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Philadelphia, Mar. 2005.
25. C. Goodwin, Conversational Organization: Interaction Between Speakers and Hearers, vol. 11, Academic Press. New York, NY, 1981.
26. D. Hillard, M. Ostendorf, and E. Shriberg, "Detection of agreement vs. disagreement in meetings: Training with unlabeled data," in Proc. HLT-NAACL Conference, Edmonton, May 2003.
27. S. Hongeng and R. Nevatia, "Multi-agent event recognition," in Proc. IEEE Int. Conference on Computer Vision, Vancouver, July 2001.
28. G. Ji and J. Bilmes, "Dialog act tagging using graphical models," in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Philadelphia, Mar. 2005.
29. N Jovanovic and R. op den Akker, "Towards automatic addressee identification in multi-party dialogues," in Proc. SIGDial Workshop on Discourse and Dialogue, Boston, Apr. 2004.
30. N Jovanovic, R. op den Akker, and A. Nijholt, "A corpus for studying addressing behavior in multi-party dialogues," in Proc. SIGDial Workshop on Discourse and Dialogue, Lisbon, Sep. 2005.
31. M. Katzenmeier. R. Stiefelhagen, and T. Schultz, "Identifying the addressee in human-human-robot interactions based on head pose and speech," in Proc. Int. Conf. on Multimodal Interfaces (ICMI), State College, PA, Oct. 2004.
32. L. Kennedy and D. Ellis, "Pitch-based emphasis detection for characterization of meeting recordings," in Proc. ASRU, Virgin Islands, Dec. 2003.
33. R. Krauss, C. Garlock, P. Bricker, and L. McMahon, "The role of audible and visible back-channel responses in interpersonal communication," Journal of Personality and Social Psychology, vol. 35, no. 7, pp. 523-529, 1977.
34. I. McCowan, S. Bengio, D. Gatica-Perez, G. Lathoud, F. Monay, D. Moore, P. Wellner, and H. Bourlard, "Modeling human interactions in meetings," in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Hong-Kong, Apr. 2003.
35. I. McCowan, D. Gatica-Perez, S. Bengio, G. Lathoud, M. Barnard, and D. Zhang, "Automatic analysis of multimodal group actions in meetings," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 305-317, Mar. 2005.
36. J.E. McGrath, Groups: Interaction and Performance, Prentice-Hall, 1984.
37. D. McNeill, Ed., Language and gesture. Cambridge University Press, 2000.
38. N. Morgan, D. Baron, J. Edwards, D. Ellis, D. Gelbart, A. Janin, T. Pfau, E. Shriberg, and A. Stolcke, "The meeting project at ICSI," in Proc. Human Language Technology Conf. (HLT), San Diego, CA, March 2001.
39. N. Oliver, B. Rosario, and A. Pentland, "A Bayesian computer vision system for modeling human interactions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 8, Aug. 2000.
40. N. Oliver, E. Horvitz, and A. Garg, "Layered representations for learning and inferring office activity from multiple sensory channels," in Proceedings of the International Conference on Multimodal Interfaces (ICMI'02), October 2002.
41. K. Otsuka, Y. Takemae, J. Yamato, and H. Murase, "Probabilistic inference of multiparty-conversation structure based on markov-switching models of gaze patterns, head directions, and utterances," in Proc. Int. Conf. on Multimodal Interfaces (ICMI), Trento, Oct. 2005.
42. A. Pentland, "Socially aware computation and communication," IEEE Computer, vol. 38, pp. 63-70, Mar. 2005.
43. A. Pentland and A. Madan, "Perception of social interest," in Proc. IEEE Int. Conf. on Computer Vision, Workshop on Modeling People and Human Interaction (ICCV-PHI), Beijing, Oct. 2005.
44. L. R. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition, Prentice-Hall, 1993.
45. R.J. Rienks and D. Heylen, "Automatic dominance detection in meetings using easily detectable features," in Proc. Workshop on Machine Learning for Multimodal Interaction (MLMI), Edinburgh, Jul. 2005.
46. E. Shriberg, "Spontaneous speech: How people really talk and why engineers should care," in Proc. European Conf. on Speech Communication and Technology (Eurospeech), Lisbon, Sep. 2005.
47. T. Starner and A. Pentland, "Visual recognition of american sign language using HMMs," in Proc. Int. Work, on Auto. Face and Gesture Recognition (AFGR), Zurich, 1995.
48. R. Stiefelhagen, J. Yang, and A. Waibel, "Modeling focus of attention for meeting indexing based on multiple cues," IEEE IEEE Trans. on Neural Networks, vol. 13, no. 4, pp. 928-938, 2002.
49. R. Stiefelhagen, "Tracking focus of attention in meetings," in Int. Conf. on Multimodal Interfaces (ICMI), Pittsburgh, PA, 2002.
50. A. Waibel, M. Bett, F. Metze, K. Ries, T. Schaaf, T. Schultz, H. Soltau, H. Yu, and K. Zechner, "Advances in automatic meeting record creation and access," in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Salt Lake City, UT, May 2001.
51. B. Wrede and E. Shriberg, "Spotting hotspots in meetings: Human judgments and prosodic cues," in Proc. Eurospeech, Geneva, Sep. 2003.
52. B. Wrede and E. Shriberg, "The relationship between dialogue acts and hot spots in meetings," in Proc. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Virgin Islands, Dec. 2003.
53. D. Zhang, D. Gatica-Perez, S. Bengio, I. McCowan, and G. Lathoud, "Modeling individual and group actions in meetings: a two-layer HMM framework," in Proc. IEEE CVPR Workshop on Event Mining, Washington, DC, Jun. 2004.
54. D. Zhang, D. Gatica-Perez, S. Bengio, I. McCowan, and G. Lathoud, "Multimodal group action clustering in meetings," in Proc. ACM Int. Conf. on Multimedia, Workshop on Video Surveillance and Sensor Networks (ACM MM-VSSN), New York, Oct. 2004.
55. D. Zhang, D. Gatica-Perez, and S. Bengio, "Semi-supervised meeting event recognition with adapted HMMs," in Proc. IEEE Int. Conf. on Multimedia (ICME), Amsterdam, Jul. 2005.
56. D. Zhang. D. Gatica-Perez, S. Bengio, and D. Roy, "Learning influence among interacting markov chains," in Proc. Neural Information Processing Systems (NIPS), Vancouver, Dec. 2005.
57. D. Zhang, D. Gatica-Perez, S. Bengio, and I. McCowan, "Modeling individual and group actions in meetings with layered HMMs," IEEE Trans. on Multimedia, vol. 8, no. 3, Jun. 2006
58. M. Zimmermann, Y. Liu, E. Shriberg, and A. Stolcke, "Toward Joint Segmentation And Classification Of Dialog Acts In Multipary Meetings," in Proc. Workshop on Machine Learning for Multimodal Interaction (MLMI), Edinburgh, Jun. 2005.