Human-Centred Intelligent Human-Computer Interaction (HCI2): How far are we from attaining it?

International Journal of Autonomous and Adaptive Communications Systems

Volumn 1, Issue 2, 2008, Pages 168-187

  Pantic, Maja ^a,b   Nijholt, Anton ^b   Pentland, Alex ^c   Huanag, Thomas S ^d  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF TWENTE   (Netherlands)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^d UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Context sensing; Human affect recognition; Introductory and survey; Sensing humans; Social signals detection

Indexed keywords

MAMMALS; USER INTERFACES; WEAVING;

AFFECT RECOGNITION; CONTEXT SENSING; INTRODUCTORY AND SURVEY; SENSING HUMANS; SOCIAL SIGNALS;

HUMAN COMPUTER INTERACTION;

EID: 61549133072     PISSN: 17548632     EISSN: 17548640     Source Type: Journal    
DOI: 10.1504/ijaacs.2008.019799     Document Type: Article

References (57)

1. Aarts, E. (2005) 'Ambient intelligence drives open innovation', ACM Interactions, Vol. 12, pp. 66-68. (Pubitemid 41064958)
2. Ambady, N. and Rosenthal, R. (1992) 'Thin slices of expressive behavior as predictors of interpersonal consequences: a meta-analysis', Psychological Bulletin, Vol. 111, pp. 256-274.
3. Bicego, M., Cristani, M. and Murino, V. (2006) 'Unsupervised scene analysis: a hidden Markov model approach', Computer Vision and Image Understanding, Vol. 102, pp. 22-41. (Pubitemid 43344448)
4. Bray, M., Koller-Meier, E. and van Gool, L. (2007) 'Smart particle filtering for high-dimensional tracking', Computer Vision and Image Understanding, Vol. 106, pp. 116-129. (Pubitemid 46528766)
5. Bowyer, K. W., Chang, K. and Flynn, P. J. (2006) 'A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition', Computer Vision and Image Understanding, Vol. 101, pp. 1-15. (Pubitemid 41642085)
6. Bowyer, K. W., Chang, K., Yan, P., Flynn, P. J., Hansley, E. and Sarkar, S. (2006) 'Multimodal biometrics: an overview', Paper presented in the Proceedings of the Workshop on Multimodal User Authentication (MMUA'06). Available at: http://www.nd.edu/~kwb/publications.html.
7. Chartrand, T. L. and Bargh, J. A. (1999) 'The chameleon effect: the perception-behavior link and social interaction', Journal of Personality and Social Psychology, Vol. 76, pp. 893-910.
8. Cohn, J. F. and Schmidt, K. L. (2004) 'The timing of facial motion in posed and spontaneous smiles', Journal of Wavelets, Multi-resolution and Information Processing, Vol. 2, pp. 121-132.
9. Costa, M., Dinsbach, W., Manstead, A. S. R. and Bitti, P. E. R. (2001) 'Social presence, embarrassment, and nonverbal behavior', Journal of Nonverbal Behavior, Vol. 25, pp. 225-240.
10. Coulson, M. (2004) 'Attributing emotion to static body postures: recognition accuracy, confusions, and viewpoint dependence', Journal of Nonverbal Behavior, Vol. 28, pp. 117-139. (Pubitemid 39015676)
11. Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W. and Taylor, J. G. (2001) 'Emotion recognition in human-computer interaction', IEEE Signal Processing Magazine, Vol. 18, pp. 32-80. (Pubitemid 32287669)
12. Ekman, P. (Ed.) (1982) Emotion in the Human Face. New York, NY: Cambridge University Press.
13. Ekman, P. and Friesen, W. F. (1969) 'The repertoire of nonverbal behavioral categories - origins, usage, and coding', Semiotica, Vol. 1, pp. 49-98.
14. Ekman, P., Friesen, W. V. and Hager, J. C. (2002) Facial Action Coding System. Salt Lake City, USA: A Human Face.
15. Ekman, P., Huang, T. S., Sejnowski, T. J. and Hager, J. C. (Eds) (1992) NSF Understanding the Face. Salt Lake City, USA: A Human Face eStore, (see Library).
16. Ekman, P. and Rosenberg, E. (Eds) (2005) What the Face Reveals. Oxford, UK: Oxford University Press.
17. Elgammal, A. and Lee, C-S. (2007) 'Nonlinear manifold learning for dynamic shape and dynamic appearance', Computer Vision and Image Understanding, Vol. 106, pp. 31-46. (Pubitemid 46528759)
18. Fragopanagos, F. and Taylor, J. G. (2005) 'Emotion recognition in human-computer interaction', Neural Networks, Vol. 18, pp. 389-405. (Pubitemid 40922647)
19. Furnas, G., Landauer, T., Gomes, L. and Dumais, S. (1987) 'The vocabulary problem in human-system communication', Communications of the ACM, Vol. 30, pp. 964-972.
20. Haykin, S. and de Freitas, N. (Eds) (2004) 'Special issue on sequential state estimation', Paper presented in the Proceedings of the IEEE, Vol. 92, pp. 399-574.
21. Juslin, P. N. and Scherer, K. R. (2005) 'Vocal expression of affect', in J. Harrigan, R. Rosenthal and K. Scherer (Eds), The New Handbook of Methods in Nonverbal Behavior Research. Oxford, UK: Oxford University Press.
22. Lewis, M. and Haviland-Jones, J. M. (Eds) (2000) Handbook of Emotions. New York, NY: Guilford Press.
23. Li, S. Z. and Jain, A. K. (Eds) (2005) Handbook of Face Recognition. New York, NY: Springer.
24. Littlewort, G. C., Bartlett, M. S. and Lee, K. (2007) 'Faces of pain: automated measurement of spontaneous facial expressions of genuine and posed pain', Paper presented in the Proceedings of the ACM International Conference of Multimodal Interfaces, pp. 15-21.
25. Littlewort, G., Bartlett, M. S., Fasel, I., Susskind, J. and Movellan, J. (2006) 'Dynamics of facial expression extracted automatically from video', Journal of Image and Vision Computing, Vol. 24, pp. 615-625. (Pubitemid 43867835)
26. Maat, L. and Pantic, M. (2007) 'Gaze-X: adaptive affective multimodal interface for single-user office scenarios', Lecture Notes in Artificial Intelligence, Vol. 4451, pp. 251-271.
27. Mitra, S. and Acharya, T. (2007) 'Gesture recognition: a survey', IEEE Transactions on Systems, Man and Cybernetics, Part C, Vol. 37, pp. 311-324. (Pubitemid 46621535)
28. Neiberg, D., Elenius, K. and Laskowski, K. (2006) 'Emotion recognition in spontaneous speech using GMM', Paper presented in the Proceedings of the International Conference on Spoken Language Processing, pp. 809-812.
29. Nijholt, A. and Traum, D. (2005) 'The virtuality continuum revisited', Paper presented in the Proceedings of the International Conference on Computer Human Interaction, pp. 2132-2133.
30. Nock, H. J., Iyengar, G. and Neti, C. (2004) 'Multimodal processing by finding common cause', Communications of the ACM, Vol. 47, pp. 51-56.
31. Ong, S. C. W. and Ranganath, S. (2005) 'Automatic sign language analysis: a survey and the future beyond lexical meaning', IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 27, pp. 873-891. (Pubitemid 40889839)
32. Oviatt, S. (2003) 'User-centered modeling and evaluation of multimodal interfaces', Paper presented in the Proceedings of the IEEE, Vol. 91, pp. 1457-1468. (Pubitemid 40890824)
33. Pal, P., Iyer, A. N. and Yantorno, R. E. (2006) 'Emotion detection from infant facial expressions and cries', Paper presented in the Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 721-724.
34. Pantic, M. and Bartlett, M. S. (2007) 'Machine analysis of facial expressions', in K. Delac and M. Grgic (Eds), Face Recognition (pp. 377-416). Vienna, Austria: I-Tech Education and Publishing.
35. Pantic, M. and Patras, I. (2006) 'Dynamics of facial expressions - recognition of facial actions and their temporal segments from face profile image sequences', IEEE Transaction on Systems, Man, and Cybernetics, Part B, Vol. 36, pp. 433-449.
36. Pantic, M., Pentland, A., Nijholt, A. and Huang, T. S. (2007) 'Human computing and machine understanding of human behaviour: a survey', Lecture Notes in Artificial Intelligence, Vol. 4451, pp. 47-71.
37. Pantic, M. and Rothkrantz, L. J. M. (2003) 'Toward an affect-sensitive multimodal human-computer interaction', Paper presented in the Proceedings of the IEEE, Vol. 91, pp. 1370-1390. (Pubitemid 40890819)
38. Pentland, A. (2005) 'Socially aware computation and communication', IEEE Computer, Vol. 38, pp. 33-40. (Pubitemid 40556075)
39. Petridis, S. and Pantic, M. (2008) 'Audiovisual discrimination between laughter and speech', Paper presented in the Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing. pp. 5117-5120.
40. Poppe, R. (2007) 'Vision-based human motion analysis: an overview', Computer Vision and Image Understanding, Vol. 108, pp. 4-18. (Pubitemid 47333391)
41. Russell, J. A., Bachorowski, J. and Fernandez-Dols, J. (2003) 'Facial and vocal expressions of emotion', Annual Review Of Psychology, Vol. 54, pp. 329-349. (Pubitemid 37417497)
42. Russell, J. A. and Fernandez-Dols, J. M. (Eds) (1997) The Psychology of Facial Expression. Cambridge, UK: Cambridge University Press.
43. Sato, A., Imaoka, H., Suzuki, T. and Hosoi, T. (2005) 'Advances in face detection and recognition technologies', NEC Journal of Advanced Technology, Vol. 2, pp. 28-34. (Pubitemid 40970349)
44. Schuller, B., Mueller, R., Hoernler, B., Hoethker, A., Konosu, H. and Rigoll, G. (2007) 'Audiovisual recognition of spontaneous interest within conversations', Paper presented in the Proceedings of the ACM International Conference on Multimodal Interfaces, pp. 30-37.
45. Smith, K., Ba, S., Odobez, J-M. and Gatica-Perez, D. (2008) 'Tracking the visual focus of attention for a varying number of wandering people', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30.
46. Streitz, N. and Nixon, P. (2005) 'The disappearing computer', ACM Communications, Vol. 48, pp. 33-35.
47. Tian, Y. L., Kanade, T. and Cohn, J. F. (2005) 'Facial expression analysis', In S. Z. Li and A. K. Jain (Eds), Handbook of Face Recognition, New York, NY: Springer, pp. 247-276.
48. Tong, Y., Liao, W. and Ji, Q. (2007) 'Facial action unit recognition by exploiting their dynamics and semantic relationships', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 29, pp. 1683-1699.
49. Truong, K. P. and van Leeuwen, D. A. (2007) 'Automatic discrimination between laughter and speech', Speech Communication, Vol. 49, pp. 144-158. (Pubitemid 46241514)
50. Valstar, M. F. and Pantic, M. (2006) 'Fully automatic facial action unit detection and temporal analysis', Paper presented in the Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Vol. 3, p. 149.
51. Valstar, M. F., Gunes, H. and Pantic, M. (2007) 'How to distinguish posed from spontaneous smiles using geometric features', Paper presented in the Proceedings of the ACM International Conference On Multimodal Interfaces, pp. 38-45.
52. Wang, J. J. and Singh, S. (2003) 'Video analysis of human dynamics - a survey', Real Time Imaging, Vol. 9, pp. 321-346.
53. Whissell, C. M. (1989) 'The dictionary of affect in language', in R. Plutchik and H. Kellerman (Eds), Emotion - Theory, Research and Experience, Vol 4: The Measurement of Emotions (pp. 113-131). New York, NY: Academic Press.
54. Yang, M-H., Kriegman, D. J. and Ahuja, N. (2002) 'Detecting faces in images: a survey', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, pp. 34-58. (Pubitemid 34325615)
55. Zeng, Z., Hu, Y., Liu, M., Fu, Y. and Huang, T. S. (2006) 'Training combination strategy of multi-stream fused hidden Markov model for audio-visual affect recognition', Paper presented in the Proceedings of the ACM International Conference on Multimedia, pp. 65-68. (Pubitemid 47113505)
56. Zeng, Z., Pantic, M., Roisman, G. I. and Huang, T. S. (2008) 'A survey of affect recognition methods: audio, visual and spontaneous expressions', IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30.
57. Zhao, W., Chellappa, R., Phillips, P. J. and Rosenfeld, A. (2003) 'Face recognition: a literature survey', ACM Computing Surveys, Vol. 35, pp. 399-458.