A probabilistic inference of multiparty-Conversation structure based on markov-Switching models of gaze patterns, head directions, and utterances

Proceedings of the Seventh International Conference on Multimodal Interfaces, ICMI'05

Volumn , Issue , 2005, Pages 191-198

  Otsuka, Kazuhiro ^a,c   Yamato, Junji ^a   Takemae, Yoshinao ^b   Murase, Hiroshi ^c  

^a NTT Corporation   (Japan)

^b NTT CORPORATION   (Japan)

^c NAGOYA UNIVERSITY   (Japan)

Author keywords

Dynamic bayesian network; Eye gaze; Face to face multiparty conversation; Gibbs sampler; Markov chain monte carlo; Markov switching model; Nonverbal cues

Indexed keywords

BAYESIAN; EYE GAZE; FACE-TO-FACE MULTIPARTY CONVERSATION; GIBBS SAMPLER; MARKOV CHAIN MONTE CARLO (MCMC); MARKOV-SWITCHING MODEL; NONVERBAL CUES;

INFORMATION TECHNOLOGY; MARKOV PROCESSES; MATHEMATICAL MODELS; MONTE CARLO METHODS; PARAMETER ESTIMATION; PROBABILISTIC LOGICS;

TELECOMMUNICATION SYSTEMS;

EID: 32344452625     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1088463.1088497     Document Type: Conference Paper

References (27)

1. S. Basu, T. Choudhury, and B. Clarkson. Learning human interactions with the influence model, In MIT Media Lab. TR#539, 2001.
2. J. M. Bernardo and A. F. M. Smith. Bayesian Theory. John Wiley & Sons, Ltd., 1994.
3. M. Bett, H. Y. R. Gross, X. Zhu, Y. Pan, J. Yang, and A. Waibel. Multimodal meeting tracker, In Proc. RIAO 2000: Content-Based Multimodal Inform. Access, 2000.
4. R. Chen and T.-H. Li. Blind restoration of linearly degraded discrete signals by Gibbs sampling. IEEE Trans. Signal Processing, 43(10):2410-2413, 1995.
5. H. H. Clark and T. B. Carlson. Hearers and speech acts. Language, 58:332-373, 1982.
6. R. Cutler et al. Distributed meetings: A meeting capture and broadchasting system. In Proc. ACM Multimedia '02, pages 503-512, 2002.
7. A. Dielmann and S. Renals, Dynamic Bayesian networks for meeting structuring. In Proc. IEEE ICASSP'04, 2004.
8. R. Diestel. Graph Theory, 2nd ed. Springer-Verlag New York, Inc., 2000.
9. S. Frühwirth-Schnatter. Markov chain Monte Carlo estimation of classical and dynamic switching and mixture models. J. American Statistical Association, 96(453):194-209, 2001.
10. W. R. Gilks, S. Richardson, and D. J. Spiegelhalter. Markov Chain Monte Carlo in Practice, Chapman &: Hall/CRC, 1996.
11. E. Goffman. Forms of Talks. University of Pennsylvania Press, Philadelphia, 1981.
12. C. Goodwin, Conversational Organization : Interaction between Speakers and Hearers. Academic Press, 1981.
13. D. Heylen, I. V. Es, A. Nijholt, and B. V. Dijk. Experimenting with the gaze of a conversational agent. In Proc. Int. CLASS Workshop on Natural Intelligent and Effective Interaction in Multimodal Dialogue Systems, pages 93-100, 2002.
14. N. Jovanovic and R. Akker. Towards automatic addressee identification in multi-party dialogues. In Proc. SIGdial'04, pages 89-92, 2004.
15. A. Kendon. Some functions of gaze-direction in social interaction. Acta Psychologica, 26:22-63, 1967.
16. C.-J. Kim and C. R. Nelson. State-Space Models with Regime Switching. MIT Press, 1999.
17. Y. Matsumoto and A. Zelinsky. An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement. In Proc. Int. Conf. Automatic Face and Gesture Recognition '04, pages 499-504, 2000.
18. I. McCowan, D. Perez, S. Bengio, G. Lathoud, M. Barnard, and D. Zhang. Automatic analysis of multimodal group actions in meetings,. IEEE Trans. PAMI, 27(3), 2005.
19. L.-P. Morency, A. Rahimi, and T. Darrell, Adaptive view-based appearance model. In Proc. CVPR'03, pages 803-810, 2003.
20. D. G. Novic, B. Hansen, and K.Ward, Coordinating turn-taking with gaze. In Proc. Int. Conf. Spoken Language '96., pages 1888-1891, 1996.
21. T. Ohno and N. Mukawa. A free-head, simple calibration, gaze tracking system that enables gaze-based interaction. In Proc. Eye Tracking Research & Application Symposium (ETRA)2004, pages 115-122, 2004.
22. D. Reidsma et al. Virtual meeting rooms: From observation to simulation. In Proc. Social Intelli. Design '05, 2005.
23. R. Stiefelhagen, J. Yang, and A. Waibel. Modeling focus of attention for meeting index based on multiple cues. IEEE Trans. Neural Networks, 13(4), 2002.
24. R. Stiefelhagen and J. Zhu. Head orientation and gaze direction in meetings. In Proc. ACM CHI'02, 2002.
25. Y. Takemae, K. Otsuka, and N. Mukawa. Impact of video editing based on participants' gaze in multiparty conversation. In Proc. ACM CHI'04, pages 1333-1336, 2004.
26. R. Vertegaal, R. Slagter, G. Veer, and A. Nijholt. Eye gaze patterns in conversations: There is more to conversational agents than meets the eyes. In Proc. ACM CHI'2001, pages 301-308, 2001.
27. D. Zhang, D. G. Perez, S. Bengio, I. McCowan, and G. Lathoud, Modeling individual and group actions in meetings: A two-layers HMM framework. In Proc. 2nd. IEEE Workshop on Event Mining, 2004.