Multimodal integration - A biological view

IJCAI International Joint Conference on Artificial Intelligence

Volumn , Issue , 2001, Pages 1417-1424

  Coen, Michael H ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BEHAVIORAL THEORY; INTELLIGENT ROOM; INTERACTIVE ENVIRONMENTS; MULTIMODAL INTEGRATION; MULTIMODAL SYSTEM; NOVEL METHODOLOGY; PERCEPTUAL INFORMATION; SENSORY PROCESSING;

ARTIFICIAL INTELLIGENCE;

INTEGRATION;

EID: 84880887921     PISSN: 10450823     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. Atkeson CG, Hale J, Pollick F, Riley M, Kotosaka S, Schaal S, Shibata T, Tevatia G, Vijayakumar S, Ude A, Kawato M: Using humanoid robots to study human behavior. IEEE Intelligent Systems, Special Issue on Humanoid Robotics, 46-56. 2000.
2. Brooks, R.A., C. Breazeal (Ferrell), R. Irie, C. Kemp, M. Marjanovic, B. Scassellati and M. Williamson, Alternate Essences of Intelligence. In Proceedings of The Fifteenth National Conference on Artificial Intelligence. (AAAI98). Madison, Wisconsin. 1998.
3. Butterworth, G. The origins of auditory-visual perception and visual proprioception in human development. In Intersensory Perception and Sensory Integration, R.D. Walk and L.H. Pick, Jr. (Eds.) New York. Plenum. 1981.
4. Cheng, G., and Kuniyoshi, Y. Complex Continuous Meaningful Humanoid Interaction: A Multi Sensory-Cue Based Approach Proc. of IEEE International Conference on Robotics and Automation (ICRA 2000), pp.2235-2242, San Francisco, USA, April 24-28, 2000.
5. Coen, M. Design Principles for Intelligent Environments. In Proceedings of The Fifteenth National Conference on Artificial Intelligence. (AAAI98). Madison, Wisconsin. 1998.
6. Coen, M. The Future Of Human-Computer Interaction or How I learned to stop worrying and love My Intelligent Room. IEEE Intelligent Systems. March/April. 1999.
7. Coen, M., and Wilson, K. Learning Spatial Event Models from Multiple-Camera Perspectives in an Intelligent Room. In Proceedings of MANSE'99. Dublin, Ireland. 1999.
8. Coen, M., Phillips, B., Warshawsky, N., Weisman, L., Peters, S., Gajos, K., and Finin, P. Meeting the computational needs of intelligent environments: The Metaglue System. In Proceedings of MANSE'99. Dublin, Ireland. 1999.
9. Cohen, P. R., Johnston, M., McGee, D., Smith, I. Oviatt, S., Pittman, J., Chen, L., and Clow, J. QuickSet: Multimodal interaction for simulation set-up and control. 1997, Proceedings of the Applied Natural Language Conference, Association for Computational Linguistics. 1997.
10. Cytowic, R. E., Synesthesia: A Union of Senses. New York. Springer-Verlag. 1989.
11. Darrell, T., Gordon, G., Harville, M., and Woodfill, J., Integrated person tracking using stereo, color, and pattern detection, Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR '98), pp. 601-609, Santa Barbara, June 1998.
12. Ferrell, C. Orientation behavior using registered topographic maps. In Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior (SAB-96). Society of Adaptive Behavior. 1996.
13. Gross, R., Yang, J., and Waibel, A. Face Recognition in a meeting room. Fourth IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, France, March 2000
14. Held, R. Shifts in binaural localization after prolonged exposures to atypical combinations of stimuli. Am. J. Psychol. 68L526-266. 1955.
15. Helmholtz, H. v. Handbook of Physiological Optics. 1856. as reprinted. in James P.C. Southall. (Ed.) 2000.
16. James, H. 1890. Principles of Psychology. Vol. 2. Dover. 1955.
17. Kohler, I. The formation and transformation of the perceptual world. Psychological Issues 3(4):1-173. 1964.
18. McGurk, H., and MacDonald, J. Hearing lips and seeing voices. Nature. 264:746-748. 1976.
19. Meltzoff, A.N. and Moore, M.K. Imitation of facial and manual gestures by human neonates. Science 198:75-78. 1977. (Pubitemid 8196230)
20. Miller, George and Noam Chomsky (1963). Finitary models of language users. In Luce, R.; Bush, R. and Galanter, E. (eds.) Handbook of Mathematical Psychology, Vol 2. New York: Wiley. 419-93.
21. Piaget, J. Construction of reality in the child, London: Routledge & Kegan Paul, 1954.
22. Sams, M., Aulanko, R., Hamalainen, M., Hari, R., Lounasmaa, O., Lu, S., and Simola, J. Seeing speech: Visual information from lip movements modified activity in the human auditory cortex. Neurosci. Lett. 127:141-145. 1991.
23. Sandini G., Metta G. and Konczak J. "Human Sensori-motor Development and Artificial Systems". In: AIR&IHAS '97, Japan. 1997.
24. Stein, B., and Meredith, M. A. The Merging of the Senses. Cambridge, MA. MIT Press. 1994.
25. Stork, D.G., and Hennecke, M. Speechreading: An overview of image processing, feature extraction, sensory integration and pattern recognition techniques", Proc. of the Second Int. Conf. on Auto. Face and Gesture Recog. Killington, VT pp. xvi-xxvi 1996.
26. Sumby, W.H., and Pollack, I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26:212-215. 1954.
27. Sun. http://www.javasoft.com/products/java-media/speech/. 2001.
28. Thelen, E., and Smith, L. A Dynamic Systems Approach to the Development of Cognition and Action. Cambridge, MIT Press. 1998.
29. Ullman, Shimon. High-level vision: object recognition and visual cognition. Cambridge. MIT Press. 1996.
30. Waibel, A., Vo, M.T., Duchnowski, P., and Manke, S. Multimodal Interfaces. Artificial Intelligence Review. 10:3-4. p299-319. 1996.
31. Wren, C., Azarbayejani, A., Darrell, T., and Pentland, P., "Pfinder: Real-Time Tracking of the Human Body ", IEEE Transactions on Pattern Analysis and Machine Intelligence, July 1997.
32. Wu, Lizhong, Oviatt, Sharon L., Cohen, Philip R., Multimodal Integration - A Statistical View, IEEE Transactions on Multimedia, Vol. 1, No. 4, December 1999, pp. 334-341.
33. Zue, V., Seneff, S., Glass, J., Polifroni, J., Pao, C., Hazen, T., and Hetherington, L. "JUPITER: A Telephone-Based Conversational Interface for Weather Information," IEEE Transactions on Speech and Audio Processing, Vol. 8, No. 1, January 2000.