Conversation scene analysis based on dynamic Bayesian network and image-based gaze detection

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010

Volumn , Issue , 2010, Pages

  Gorga, Sebastian ^a   Otsuka, Kazuhiro ^a  

^a Nippon Telegraph and Telephone Corporation   (Japan)

Author keywords

dynamic Bayesian network; eye gaze; face to face multiparty conversation; Gaussian mixture; Gibbs sampler; image based gaze detection; Markov Chain Monte Carlo; visual focus of attention

Indexed keywords

DYNAMIC BAYESIAN NETWORK; EYE-GAZE; FOCUS OF ATTENTION; GAUSSIAN MIXTURES; GIBBS SAMPLERS; IMAGE-BASED; MARKOV CHAIN MONTE CARLO; MULTI-PARTY CONVERSATIONS;

DETECTORS; DISTRIBUTED PARAMETER NETWORKS; GESTURE RECOGNITION; INFERENCE ENGINES; INTELLIGENT NETWORKS; INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS; MARKOV PROCESSES; MONTE CARLO METHODS; SECURITY OF DATA; SPEECH COMMUNICATION; SPEECH RECOGNITION;

BAYESIAN NETWORKS;

EID: 78650954595     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1891903.1891969     Document Type: Conference Paper

References (27)

1. M. Argyle. Bodily Communication - 2nd ed. Routledge, London and New York, 1988.
2. M. Argyle and M. Cook. Gaze and Mutual Gaze. Cambridge University Press, Cambridge, 1976.
3. S. O. Ba and J.-M. Odobez. Multi-party focus of attention recognition in meetings from head pose and multimodal contextual cues. In ICASSP, 2008
4. J.M. Bernardo and A.F.M. Smith. Bayesian Theory. John Wiley & Sons, Ltd., 1994.
5. M.S. Choi and W.Y. Kim. A novel two stage template matching method for rotation and illumination invariance. Pattern Recognition, 35, pages 119-129, 2002.
6. A. Doshi and M.M Trivedi. Head and gaze dynamics in visual attention and context learning. In IEEE CVPR Joint Workshop for Visual and Contextual Learning and Visual Scene Understanding, 2009
7. A.T. Duchowski. Eye Tracking Methodology: Theory and Practice. Springer, 2007.
8. S. Duncan. Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology, 23(2), 283-292, 1972.
9. S. Fruhwirth-Schnatter. Finite Mixture and Markov Switching Models. Springer, 2006.
10. D. Gatica-Perez. Automatic nonverbal analysis of social interaction in small groups: A review. Image and Vision Computing, 27, pages 1775-1787, 2009.
11. W.R. Gilks, S. Richardson and D.J. Spiegelhalter. Markov Chain Monte Carlo in Practice. Chapman & Hall/CRC, 1996.
12. C. Goodwin. Conversational Organization: Interaction between Speakers and Hearers. Academic Press, 1981.
13. C.-W. Hsu, C.-C. Chang, C.-J. Lin. A Practical guide to support vector classification. Technical Report, Department of Computer Science & Information Engineering, National Taiwan University, 2008.
14. A. Kendon. Some functions of gaze-direction in social interaction. Acta Psychologica, 26, pages 22-63, 1967.
15. C.-J. Kim and C.R. Nelson. State-Space Models with Regime Switching. MIT Press, 1999.
16. G. Loy and A. Zelinsky. Fast radial symmetry for detecting points of interest. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(8), 2003.
17. O. M. Lozano and K. Otsuka. Real-time visual tracker by stream processing: Simultaneous and fast 3D tracking of multiple faces in video sequences by using a particle filter. Journal of Signal Processing Systems, 57(2), pages 285-295, 2009
18. P. Morasso, G. Sandini, V. Tagliasco and R. Zaccaria. Control strategies in the eye-head coordination system. IEEE Trans. Systems, Man and Cibernetics, 7(9), pages 639-651, 1977.
19. L. P. Morency, C. M. Christoudias, T. Darrell. Recognizing gaze aversion gestures in embodied conversational discourse. In Proc. ICMI'06, pages 287-294, 2006.
20. K. Otsuka, Y. Takemae, J. Yamato, and H. Murase. A probabilistic inference of multiparty-conversation structure based on Markov-switching models of gaze patterns, head directions, and utterances. In Proc. ICMI'05, pages 191-198, 2005.
21. K. Otsuka, J. Yamato, and H. Murase. Conversation scene analysis with dynamic Bayesian network based on visual head tracking. In Proc. ICMI'06, pages 949-952, 2006.
22. K. Otsuka, H. Sawada and J. Yamato. Automatic inference of cross-modal nonverbal interactions in multiparty conversations. In Proc. ICMI'07, pages 255-262, 2007.
23. P. Qvarfordt, S. Zhai. Conversing with the user based on eye-gaze patterns. In Proc. CHI'05, pages 221-230, 2005.
24. V. P. Richmon and J. C. McCroskey. Nonverbal Behavior in Interpersonal Relations - 5th ed. Allyn and Bacon/Pearson, Boston, 2004.
25. H. Sawada, S. Araki, K. Otsuka, M. Fujimoto and K. Ishizuka. Voice activity detection for multiple speakers with multiple pin microphones. In 2007 Spring Meeting, Acoustical Society of Japan, 2007.
26. R. Stiefelhagen, J. Zhu. Head orientation and gaze direction in meetings. In Proc. ACM CHI '02, 2002.
27. W. H. Zangemeister and L. Stark. Types of gaze movement: variable interactions of eye and head movements. Experimental Neurology, 77, pages 563-577, 1982.