Head gestures for perceptual interfaces: The role of context in improving recognition

Artificial Intelligence

Volumn 171, Issue 8-9, 2007, Pages 568-585

  Morency, Louis Philippe ^a   Sidner, Candace ^b   Lee, Christopher ^c   Darrell, Trevor ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b BAE SYSTEMS   (United States)

^c Boston Dynamics   (United States)

Author keywords

Context based recognition; Contextual information; Head gesture recognition; Visual feedback

Indexed keywords

ARTIFICIAL INTELLIGENCE; FEEDBACK; INTERFACES (COMPUTER); KNOWLEDGE ACQUISITION; MODAL ANALYSIS; VIRTUAL REALITY;

CONTEXT-BASED RECOGNITION; CONTEXTUAL INFORMATION; HEAD GESTURE RECOGNITION; VISUAL FEEDBACK;

GESTURE RECOGNITION;

EID: 34249676165     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2007.04.003     Document Type: Article

References (34)

1. Bickmore T. Towards the design of multimodal interfaces for handheld conversational characters. Proceedings of the CHI Extended Abstracts on Human factors in Computing Systems Conference (2002), ACM Press 788-789
2. Bickmore T., and Cassell J. Social dialogue with embodied conversational agents. In: van Kuppevelt J., Dybkjaer L., and Bernsen N. (Eds). Natural, Intelligent and Effective Interaction with Multimodal Dialogue Systems (2004), Kluwer Academic
3. Breazeal C., Hoffman G., and Lockerd A. Teaching and working with robots as a collaboration. The Third International Conference on Autonomous Agents and Multi-Agent Systems AAMAS, 2004 (July 2004), ACM Press 1028-1035
4. De Carolis B., Pelachaud C., Poggi I., and de Rosis F. Behavior planning for a reflexive agent. Proceedings of the International Joint Conference on Artificial Intelligence. Seattle (September 2001), Morgan Kaufmann Publishers 1059-1064
5. Cassell J., and Thorisson K.R. The power of a nod and a glance: Envelope vs. emotional feedback in animated conversational agents. Applied Artificial Intelligence (1999) 519-538
6. Clark H.H., and Schaefer E.F. Contributing to discourse. Cognitive Science 13 (1989) 259-294
7. Cohen C.J., Beach G.J., and Foulk G. A basic hand gesture control system for PC applications. Proceedings 30th Applied Imagery Pattern Recognition Workshop (AIPR'01) (2001), John Wiley & Sons 74-79
8. Cortes C., and Vapnik V. Support-vector networks. Machine Learning 20 3 (1995) 273-297
9. Dillman R., Becher R., and Steinhaus P. ARMAR II-a learning and cooperative multimodal humanoid robot system. International Journal of Humanoid Robotics 1 1 (2004) 143-155
10. Dillman R., Ehrenmann M., Steinhaus P., Rogalla O., and Zoellner R. Human friendly programming of humanoid robots-the German Collaborative Research Center. The Third IARP International Workshop on Humanoid and Human-Friendly Robotics (December 2002), Tsukuba Research Centre, Japan
11. S. Fujie, Y. Ejiri, K. Nakajima, Y. Matsusaka, T. Kobayashi, A conversation robot using head gesture recognition as para-linguistic information, in: Proceedings of 13th IEEE International Workshop on Robot and Human Communication, RO-MAN 2004, September 2004, pp. 159-164
12. Jacob R.J.K. Eye tracking in advanced interface design. Advanced Interface Design and Virtual Environments (1995), Oxford University Press 258-288
13. Kaiser E., Olwal A., McGee D., Benko H., Corradini A., Li X., Cohen P., and Feiner S. Mutual disambiguation of 3d multimodal interaction in augmented and virtual reality. Proceedings of the 5th International Conference on Multimodal Interfaces (ICMI 2003). Vancouver, BC, Canada (November 2003), ACM Press 12-19
14. Kapoor A., and Picard R. A real-time head nod and shake detector. Proceedings from the Workshop on Perspective User Interfaces (November 2001), ACM Press 1-5
15. S. Kawato, J. Ohya, Real-time detection of nodding and head-shaking by directly detecting and tracking the between-eyes, in: Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition, 2000, pp. 40-45
16. R. Kjeldsen, Head gestures for computer control, in: Proc. Second International Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-time Systems, 2001, pp. 62-67
17. Lemon O., Gruenstein A., and Peters S. Collaborative activities and multi-tasking in dialogue systems. Traitement Automatique des Langues (TAL) 43 2 (2002) 131-154 Special issue on dialogue
18. S. Lenman, L. Bretzer, B. Thuresson, Computer vision based hand gesture interfaces for human-computer interaction, Technical Report CID-172, Center for User Oriented IT Design, Stockholm, June 2002
19. Matsusaka Y., Tojo T., and Kobayashi T. Conversation robot participating in group conversation. IEICE Transaction of Information and System E86-D 1 (January 2003) 26-36
20. L.-P. Morency, A. Quattoni, T. Darrell, Latent-dynamic discriminative models for continuous gesture recognition, Technical Report MIT-CSAIL-TR-2007-002, CSAIL Technical report, January 2007
21. L.-P. Morency, A. Rahimi, N. Checka, T. Darrell, Fast stereo-based head tracking for interactive environment, in: Proceedings of the International Conference on Automatic Face and Gesture Recognition, 2002, pp. 375-380
22. L.-P. Morency, A. Rahimi, T. Darrell, Adaptive view-based appearance model, in: Proceedings IEEE Conf. on Computer Vision and Pattern Recognition, vol. 1, 2003, pp. 803-810
23. Y. Nakano, G. Reinstein, T. Stocky, J. Cassell, Towards a model of face-to-face grounding, in: Proceedings of the Annual Meeting of the Association for Computational Linguistics, Sapporo, Japan, July 2003, pp. 553-561
24. Rich C., Sidner C., and Lesh N. Collagen: Applying collaborative discourse theory to human-computer interaction. AI Magazine 22 4 (2001) 15-25 Special issue on intelligent user interfaces
25. Sidner C., Lee C., Kidd C.D., Lesh N., and Rich C. Explorations in engagement for humans and robots. Artificial Intelligence 166 1-2 (August 2005) 140-164
26. Sidner C., Lee C., Morency L.-P., and Forlines C. The effect of head-nod recognition in human-robot conversation. Proceedings of the 1st Annual Conference on Human-Robot Interaction (March 2006), ACM Press 290-296
27. Siracusa M., Morency L.-P., Wilson K., Fisher J., and Darrell T. Haptics and biometrics: A multimodal approach for determining speaker location and focus. Proceedings of the 5th International Conference on Multimodal Interfaces (November 2003), ACM Press 77-80
28. Stiefelhagen R. Tracking focus of attention in meetings. Proceedings of International Conference on Multimodal Interfaces. Pittsburgh, PA (2002), ACM Press 273-280
29. Takemae Y., Otsuka K., and Mukaua N. Impact of video editing based on participants' gaze in multiparty conversation. Proceedings of the CHI Extended Abstracts on Human factors in Computing Systems Conference (April 2004), ACM Press 1333-1336
30. A. Torralba, K.P. Murphy, W.T. Freeman, M.A. Rubin, Context-based vision system for place and object recognition, in: IEEE Intl. Conference on Computer Vision (ICCV), Nice, France, October 2003, pp. 273-280
31. Toyama K. Look, Ma-No Hands! Hands-free cursor control with real-time 3D face tracking. Proceedings from the Workshop on Perspective User Interfaces (1998), ACM Press 49-54
32. D. Traum, J. Rickel, Embodied agents for multi-party dialogue in immersive virtual world, in: Proceedings of the International Joint Conference on Autonomous Agents and Multi-Agent Systems (AAMAS 2002), July 2002, pp. 766-773
33. Wikipedia. Wikipedia encyclopedia (2002). http://en.wikipedia.org/wiki/Dialog_box
34. Zhai S., Morimoto C., and Ihde S. Manual and gaze input cascaded (magic) pointing. Proceedings of the CHI Conference on Human Factors in Computing Systems (1999), ACM Press 246-253