Recognizing visual focus of attention from head pose in natural meetings

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 39, Issue 1, 2009, Pages 16-33

  Ba, Sileye O ^a,b   Odobez, Jean Marc ^a,b  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

^b EPFL   (Switzerland)

Author keywords

Head pose tracking; Hidden markov model; Maximum a posteriori adaptation; Meeting analysis; Particle filter; Visual focus of attention

Indexed keywords

AIR FILTERS; MAGNETOSTRICTIVE DEVICES; NONLINEAR FILTERING; OBJECT RECOGNITION; PROJECTION SCREENS; SENSORS; TARGETS;

HEAD POSE TRACKING; MAXIMUM A POSTERIORI ADAPTATION; MEETING ANALYSIS; PARTICLE FILTER; VISUAL FOCUS OF ATTENTION;

HIDDEN MARKOV MODELS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ATTENTION; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; HEAD MOVEMENT; HUMAN; IMAGE PROCESSING; METHODOLOGY; NORMAL DISTRIBUTION; PHYSIOLOGY; PROBABILITY; VISUAL FIELD;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; ATTENTION; COMPUTER SIMULATION; HEAD MOVEMENTS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MARKOV CHAINS; NORMAL DISTRIBUTION; PATTERN RECOGNITION, AUTOMATED; VISUAL FIELDS;

EID: 61549113510     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2008.927274     Document Type: Article

References (36)

1. K. Smith, S. Ba, D. Gatica-Perez, and J.-M. Odobez, "Multiperson wandering focus of attention tracking," in Proc. Int. Conf. Multimodal Interfaces, Banff, AB, Canada, Nov. 2006.
2. O. Kulyk, J. Wang, and J. Terken, "Real-time feedback on nonverbal behaviour to enhance social dynamics in small group meetings," in Machine Learning for Multimodal Interaction, vol. 3869. New York: Springer-Verlag, 2006.
3. J. McGrath, Groups: Interaction and Performance. Englewood Cliffs, NJ: Prentice-Hall, 1984.
4. D. Heylen, "Challenges ahead head movements and other social acts in conversation," in Proc. Joint Symp. Virtual Social Agent, 2005, pp. 45-52.
5. S. Langton, R. Watt, and V. Bruce, "Do the eyes have it? Cues to the direction of social attention," Trends Cogn. Sci., vol. 4, no. 2, pp. 50-58, Feb. 2000.
6. J. N. Bailenson, A. Beal, J. Loomis, J. Blascovitch, and M. Turk, "Transformed social interaction, augmented gaze, and social influence in immersive virtual environments," Human Commun. Res., vol. 31, no. 4, pp. 511-537, Oct. 2005.
7. N. Jovanovic and H. Op den Akker, "Towards automatic addressee identification in multi-party dialogues," in Proc. 5th SIGdial Workshop Discourse Dialogue, 2004, pp. 89-92.
8. S. Duncan, Jr., "Some signals and rules for taking speaking turns in conversations," J. Pers. Soc. Psychol., vol. 23, no. 2, pp. 283-292, Aug. 1972.
9. D. Novick, B. Hansen, and K. Ward, "Coordinating turn taking with gaze," in Proc. Int. Conf. Spoken Lang. Process., 1996, pp. 1888-1891.
10. R. Rienks, D. Zhang, D. Gatica-Perez, and W. Post, "Detection and application of influence rankings in small group meetings," in Proc. Int. Conf. Multimodal Interfaces, Banff, AB, Canada, Nov. 2006, pp. 257-264.
11. R. Stiefelhagen, J. Yang, and A. Waibel, "Modeling focus of attention for meeting indexing based on multiple cues," IEEE Trans. Neural Netw., vol. 13, no. 4, pp. 928-938, Jul. 2002.
12. K. Otsuka, Y. Takemae, J. Yamato, and H. Murase, "A probabilistic inference of multiparty-conversation structure based on Markov-switching models of gaze patterns, head directions, and utterances," in Proc. ICMI, Trento, Italy, Oct. 2005, pp. 191-198.
13. J. L. Crowley, Ed., in Proc. Pointing, ICPR Int. Workshop Vis. Observation Deictic Gestures, Cambridge, U.K., Aug. 22, 2004.
14. "Multimodal technologies for perception of humans," in Proc. 1st Int. Eval. Workshop on Classification of Events, Activities and Relationships, ser. Lecture Notes in Computer Science, vol. 4122, Southampton, U.K., Apr. 6-7, 2006.
15. E. G. Freedman and D. L. Sparks, "Eye-head coordination during head-unrestrained gaze shifts in rhesus monkeys," J. Neurophysiol. vol. 77, no. 5, pp. 2328-2348, May 1997.
16. I. Malinov, J. Epelboim, A. Herst, and R. Steinman, "Characteristics of saccades and vergence in two kinds of sequential looking tasks," Vis. Res., vol. 16, no. 1, pp. 2083-2090, Jul. 2000.
17. S. O. Ba and J. M. Odobez, "A Rao-Blackwellized mixed state particle filter for head pose tracking," in Proc. ICMI Workshop MMMP, Trento, Italy, 2005, pp. 9-16.
18. C. Morimoto and M. Mimica, "Eye gaze tracking techniques for interactive applications," Comput. Vis. Image Underst., vol. 98, no. 1, pp. 4-24, Apr. 2005.
19. R. Pieters, E. Rosbergen, and M. Hartog, "Visual attention to advertising: The impact of motivation and repetition," in Proc. Conf. Advances Consum. Res., 1995, pp. 242-248.
20. J.-G. Wang and E. Sung, "Study on eye gaze estimation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 3, pp. 332-350, Jun. 2002.
21. R. Stiefelhagen and J. Zhu, "Head orientation and gaze direction in meetings," in Proc. Conf. Human Factors Comput. Syst., 2002, pp. 858-859.
22. A. Gee and R. Cipolla, "Estimating gaze from a single view of a face," in Proc. Int. Conf. Pattern Recog., 1994, pp. 758-760.
23. T. Horprasert, Y. Yacoob, and L. Davis, "Computing 3D head orientation from a monocular image sequence," in Proc. Int. Conf. Autom. Face Gesture Recog., 1996, pp. 244-252.
24. T. Cootes and P. Kittipanya-ngam, "Comparing variations on the active appearance model algorithm," in Proc. BMVC, 2002, pp. 837-846.
25. S. Srinivasan and K. L. Boyer, "Head pose estimation using view based eigenspaces," in Proc. Int. Conf. Pattern Recog., 2002, pp. 302-305.
26. Y. Wu and K. Toyama, "Wide range illumination insensitive head orientation estimation," in Proc. Conf. Autom. Face Gesture Recog. 2001, pp. 183-188.
27. L. Brown and Y. Tian, "Comparative study of coarse head pose estimation," in Proc. IEEE Workshop Motion Video Comput., 2002, pp. 125-130.
28. L. Lu, Z. Zhang, H. Shum, Z. Liu, and H. Chen, "Model- and exemplar-based robust head pose tracking under occlusion and varying expression," in Proc. IEEE Workshop CVPR-MECV, Dec. 2001, pp. 1-8.
29. M. Danninger, R. Vertegaal, D. Siewiorek, and A. Mamuji, "Using social geometry to manage interruptions and co-worker attention in office environments," in Proc. Conf. Graph. Interfaces, Victoria, BC, Canada, 2005, pp. 211-218.
30. M. Hayhoe and D. Ballard, "Eye movements in natural behavior," Trends Cogn. Sci., vol. 9, no. 4, pp. 188-194, Apr. 2005.
31. S. Baron-Cohen, "How to build a baby that can read minds: Cognitive mechanisms in mindreading," Cahier Psychol. Cogn., vol. 13, pp. 513-552, 1994.
32. J.-M. Odobez, "Focus of attention coding guidelines," IDIAP Res. Inst., Martigny, Switzerland, Tech. Rep. IDIAP-COM-2, 2006.
33. N. Gourier, D. Hall, and J. L. Crowley, "Estimating face orientation from robust detection of salient facial features," in Proc. Pointing, ICPR Int. Workshop Vis. Observation Deictic Gestures, 2004, pp. 183-191.
34. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Readings Speech Recognit., vol. 53A, no. 3, pp. 267-296, 1990.
35. J. Gauvain and C. H. Lee, "Bayesian learning for hidden Markov model with Gaussian mixture state observation densities," Speech Commun. vol. 11, no. 2/3, pp. 205-213, Jun. 1992.
36. R. Stiefelhagen, "Tracking and modeling focus of attention," Ph.D. dissertation, Univ. Karlsruhe, Karlsruhe, Germany, 2002.