Multimodal floor control shift detection

ICMI-MLMI'09 - Proceedings of the International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interfaces

Volumn , Issue , 2009, Pages 15-22

  Chen, Lei ^a,b   Harper, Mary P ^c,d  

^a PURDUE UNIVERSITY   (United States)

^b EDUCATIONAL TESTING SERVICE   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

^d Johns Hopkins University   (United States)

Author keywords

Floor control; Language model; Multimodal fusion; Nonverbal communication; Prosody

Indexed keywords

FLOOR CONTROL; HUMAN-COMPUTER INTERACTION SYSTEM; LANGUAGE MODEL; MULTI-MODAL; MULTI-MODAL FUSION; MULTI-PARTY CONVERSATIONS; NON-VERBAL COMMUNICATIONS; SHIFT DETECTION; STATISTICAL MODELS;

COMMUNICATION; COMPUTATIONAL LINGUISTICS; FLOORS; HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS;

COMPUTER CONTROL SYSTEMS;

EID: 74049100057     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1647314.1647320     Document Type: Conference Paper

References (40)

1. M. Argyle and M. Cook. Gaze and Mutual Gaze. Cambridge Univ. Press, 1976.
2. G. Beattie. The regulation of speaker turns in face-to-face conversation: Some implications for conversation in sound-only communication channels. Semiotica, 34:55-70, 1981.
3. A. Berger, S. Pietra, and V. Pietra. A maximum entropy approach to natural language processing. Computational Linguistics, 22:39-72, 1996.
4. A. Cassell, T. Nakano, T. Bickmore, C. Sidner, and C. Rich. Non-verbal cues for discourse structure. In Proceedings of the Conference of Annual Meeting on Association for Computational Linguistics Linguistics (ACL), pages 106-115, Toulouse, France, 2001.
5. L. Chen. Incorporating Nonverbal Features into Multimodal Models of Human-to-Human Communication. PhD thesis, Purdue University, West Lafayette,IN, August 2008.
6. L. Chen, M. Harper, A. Franklin, T. R. Rose, I. Kimbara, Z. Q. Huang, and F. Quek. A multimodal analysis of floor control in meetings. In Proceedings of the Joint Workshop on Machine Learning and Multimodal Interaction (MLMI), Washington, DC, USA, May 2006.
7. L. Chen, T. Rose, Y. Qiao, I. Kimbara, F. Parrill, H. Welji, T. Xu, J. Tu, Z. Huang, M. Harper, F. Quek, Y. Xiong, D. McNeill, R. Tuttle, and T. S. Huang. VACE multimodal meeting corpus. In Proceedings of the Joint Workshop on Machine Learning and Multimodal Interaction (MLMI), 2005.
8. S. Chen and R. Rosenfeld. A Gaussian prior for smoothing maximum entropy models. Technical report, Carnegie Mellon University, 1999.
9. T. Dietterich. Ensemble methods in machine learning. Lecture Notes in Computer Science, 1857:1-15, 2000.
10. S. Duncan. Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology, 23:283-292, 1972.
11. U. Fayyad and K. Irani. On the handling of continuous-valued attributes in decision tree generation. Machine Learning, 8:87-102, 1992.
12. L. Ferrer, E. Shriberg, and A. Stolcke. Is the speaker done yet? Faster and more accurate end-of-utterance detection using prosody in human-computer dialog. In Proceedings of the International Conference on Spoken Language Processing (ICSLP), Denver, CO, 2002.
13. C. Ford and S. Thompson. Interactional units in conversation: Syntactic, intonational, and pragmatic resources for the managment of turns. In T. Ochs, Schegloff, editor, Interaction and Grammar. Cambridge Univ. Press, 1996.
14. Y. Freund and R. Schapire. Experiments with a new boosting algorithm. In Proceedings of the International Conference on Machine Learning (ICML), 1996.
15. D. Gatica-Perez. Analyzing human interaction in conversations: A review. In Proceedings of IEEE Conference on Multisensor Fusion and Integration for Intelligent Systems, 2006.
16. C. Goodwin. Conversational Organization: Interaction Between Speakers and Hearers. Academic Press, 1981.
17. Z. Huang, L. Chen, and M. Harper. An open source prosodic feature extraction tool. In Proceedings of the Conference on Language Resources and Evaluations (LREC), May 2006.
18. N. Jovanovic, R. Akker, and A. Nijholt. Addressee identification in face-to-face meetings. In Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics (EACL), Trento, Italy, April 2006.
19. A. Kalma. Gazing in trials - A powerful signal in floor appointment. British Journal of Social Psychology, 31:21-39, 1992.
20. A. Kendon. Some functions of gaze-direction in social interaction. Acta Psychologica, 26:22-63, 1967.
21. J. Lafferty, A. McCallum, and F. Pereira. Conditional random field: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the International Conference on Machine Learning (ICML), 2001.
22. E. L. Lehmann. Testing Statistical Hypotheses. Springer, 3rd edition, 2005.
23. G. Levow. Turn-taking in mandarin dialogue: Interactions of tones and intonation. In Proceedings of the SIGHAN Workshop, 2005.
24. Y. Liu. Structural Event Detection for Rich Transcription of Speech. PhD thesis, Purdue University, 2004.
25. J. Local and J. Kelly. Projection and 'silences': Notes on phonetic and conversational structure. Human Studies, 9:185-204, 1986.
26. A. McCallum. Mallet: A machine learning toolkit for language. http://mallet.cs.umass.edu, 2005.
27. D. McNeill. Hand and Mind: What Gestures Reveal about Thought. Univ. Chicago Press, 1992.
28. D. G. Novick. Models of gaze in multi-party discourse. In Proceedings of Computer Human Interface (CHI) Workshop on the Virtuality Continuum Revisted, Portland, OR, April 2005.
29. D. G. Novick, B. Hansen, and K. Ward. Coordinating turn-taking with gaze. In Proceedings of the International Conference on Spoken Language Processing (ICSLP), 1996.
30. E. Padilha and J. Carletta. Nonverbal behaviours improving a simulation of small group discussion. In Proceedings of the First International Nordic Symposium of Multi-modal Communication, 2003.
31. T. Rose, F. Quek, and Y. Shi. MacVissta: A system for multimodal analysis. In Proceedings of the International Conference on Multimodal Interface (ICMI), 2004.
32. H. Sacks, E. Schegloff, and G. Jefferson. A simplest systematics for the organisation of turn taking for conversation. Language, 50:696-735, 1974.
33. D. Schlangen. From reaction to prediction experiments with computational models of turn-taking. In Proceedings of the International Conference on Spoken Language Processing (ICSLP), 2006.
34. E. Shriberg, A. Stolcke, D. Hakkani-Tur, and G. Tur. Prosody-based automatic segmentation of speech into sentences and topics. Speech Communication, 32(1-2):127-154, 2000.
35. S. Strassel. Simple Metadata Annotation Specification. Linguistic Data Consortium, 5.0 edition, 2003.
36. S. Thede and M. Harper. A second-order hidden markov model for part-of-speech tagging. In Proceedings of the Conference of Annual Meeting on Association for Computational Linguistics Linguistics (ACL), Baltimore, MD, 1999.
37. R. Vertegaal, G. Veer, and H. Vons. Effects of gaze on multiparty mediated communication. In Proceedings of Graphics Interface, 2000.
38. A. Wichmann and J. Caspers. Melodic cues to turn-taking in english: Evidence from perception. In Proceedings of the SIGDial Workshop on Discourse and Dialogue, 2001.
39. I. H. Witten and E. Frank. Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, 2005.
40. L. Zhang. Maximum Entropy Modeling Toolkit for Python and C++. http://homepages.inf.ed.ac.uk/s0450736/maxent-toolkit.html, 2005.