Realistic Avatar Eye and Head Animation Using a Neurobiological Model of Visual Attention

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 5200, Issue , 2003, Pages 64-78

  Itti, L ^a   Dhavale, N ^a   Pighin, F ^a  

^a University of Southern California ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AVATAR ANIMATION; OPTICAL MOTION CAPTURE SYSTEMS;

ANIMATION; COMPUTER GRAPHICS; COMPUTER SIMULATION; DATA PROCESSING; MONITORING; MOTION ESTIMATION; NEURAL NETWORKS; NEUROPHYSIOLOGY;

OPTICAL SYSTEMS;

EID: 1842583039     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (67)

1. C. Bregler, M. Covell, and M. Slaney, "Video rewrite: driving visual speech with audio," in SIGGRAPH 97 Conference Proceedings, pp. 353-360, ACM SIGGRAPH, Aug. 1997.
2. M. Brand, "Voice puppetry," in Proceedings of ACM SIGGRAPH 1999, pp. 21-28, ACM Press/Addison-Wesley Publishing Co., 1999.
3. T. Ezzat, G. Geiger, and T. Poggio, "Trainable videorealistic speech animation," in Proceedings of ACM SIGGRPAH 2002, pp. 388-398, ACM Press, 2002.
4. C. Gale and A. F. Monk, "Where am i looking? the accuracy of video-mediated gaze awareness," Percept Psychophys 62(3), pp. 586-595, 2000.
5. J. V. Haxby, E. A. Hoffman, and M. I. Gobbini, "Human neural systems for face recognition and social communication," Biol Psychiatry 51(1), pp. 59-67, 2002.
6. J. M. Findlay and R. Walker, "A model of saccade generation based on parallel processing and competitive inhibition," Behav Brain Sci 22, pp. 661-74; discussion 674-721, Aug 1999.
7. D. L. Sparks, "The brainstem control of saccadic eye movements," Nat Rev Neurosci 3(12), pp. 952-964, 2002.
8. L. Spillmann and J. S. Werner, Visual Perception: The Neurophysiological Foundations, Academic Press, San Diego, CA, 1990.
9. B. Wandell, Foundations of vision, Sinauer Associates, Sunderland, MA, 1995.
10. E. Weichselgartner and G. Sperling, "Dynamics of automatic and controlled visual attention," Science 238(4828), pp. 778-780, 1987.
11. A. M. Treisman and G. Gelade, "A feature-integration theory of attention," Cognit Psychol 12(1), pp. 97-136, 1980.
12. C. Koch and S. Ullman, "Shifts in selective visual attention: towards the underlying neural circuitry," Hum Neurobiol 4(4), pp. 219-27, 1985.
13. L. Itti and C. Koch, "Computational modeling of visual attention," Nature Reviews Neuroscience 2, pp. 194-203, Mar 2001.
14. L. G. Ungerleider and M. Mishkin, "Two cortical visual systems," in Analysis of visual behavior, D. G. Ingle, M. A. A. Goodale, and R. J. W. Mansfield, eds., pp. 549-586, MIT Press, Cambridge, MA, 1982.
15. F. Crick and C. Koch, "Constraints on cortical and thalamic projections: the no-strong-loops hypothesis," Nature 391(6664), pp. 245-50, 1998.
16. J. Moran and R. Desimone, "Selective attention gates visual processing in the extrastriate cortex," Science 229(4715), pp. 782-4, 1985.
17. S. Treue and J. C. Martinez Trujillo, "Feature-based attention influences motion processing gain in macaque visual cortex," Nature 399(6736), pp. 575-579, 1999.
18. M. Corbetta and G. L. Shulman, "Control of goal-directed and stimulus-driven attention in the brain," Nat Rev Neurosci 3(3), pp. 201-215, 2002.
19. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence 20, pp. 1254-1259, Nov 1998.
20. L. Itti and C. Koch, "A saliency-based search mechanism for overt and covert shifts of visual attention," Vision Research 40, pp. 1489-1506, May 2000.
21. J. M. Wolfe, "Visual search in continuous, naturalistic stimuli," Vision Res 34(9), pp. 1187-95,1994.
22. J. K. Tsotsos, S. M. Culhane, W. Y. K. Wai, Y. H. Lai, N. Davis, and F. Nuflo, "Modeling visual-attention via selective tuning," Artificial Intelligence 78(1-2), pp. 507-45, 1995.
23. R. Milanese, S. Gil, and T. Pun, "Attentive mechanisms for dynamic and static scene analysis," Optical Engineering 34(8), pp. 2428-2434, 1995.
24. E. Bizzi, R. E. Kalil, and P. Morasso, "Two modes of active eye-head coordination in monkeys," Brain Res 40(1), pp. 45-48, 1972.
25. G. R. Barnes, "Vestibulo-ocular function during co-ordinated head and eye movements to acquire visual targets," J Physiol 287, pp. 127-147, 1979.
26. E. G. Freedman and D. L. Sparks, "Activity of cells in the deeper layers of the superior colliculus of the rhesus monkey: evidence for a gaze displacement command," J Neurophysiol 78(3), pp. 1669-1690, 1997.
27. E. Y. Chen, L. C. Lam, R. Y. Chen, and D. G. Nguyen, "Blink rate, neurocognitive impairments, and symptoms in schizophrenia," Biol Psychiatry 40(7), pp. 597-603, 1996.
28. K. Fukuda, "Eye blinks: new indices for the detection of deception," Int J Psychophysiol 40(3), pp. 239-245, 2001.
29. S. P. Lee, J. B. Badler, and N. I. Badler, "Eyes alive," in Proceedings of the 29th annual conference on Computer graphics and interactive techniques, pp. 637-644, ACM Press, 2002.
30. T. Rikert and M. Jones, "Gaze estimation using morphable models," in Int. Conference on Automatic Face and Gesture Recognition, 1998.
31. R. Stiefelhagen, J. Yang, and A. Waibel, "Estimating focus of attention based on gaze and sound," in Workshop on Perceptive User Interfaces (PUI '01). Orlando, Florida, 2001.
32. J. Heinzmann and A. Zelinsky, "3-D facial pose and gaze point estimation using a robust real-time tracking paradigm," in Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, pp. 142-147, 1998.
33. O. Renault, D. Thalmann, and N. M. Thalmann, "A vision-based approach to behavioural animation," Visualization and Computer Animation 1, pp. 18-21, 1990.
34. R. W. Hill, "Perceptual attention in virtual humans: towards ralistic and believable gaze behaviours," in Simulating Human Agents, 2000.
35. C. Peters and C. O'Sullivan, "Synthetic vision and memory for autonomous virtual humans," Computer Graphics Forum 21(4), pp. 1-10, 2002.
36. D. Terzopoulos and T. F. Rabie, "Animat vision: Active vision in artificial animals," Videre: Journal of Computer Vision Research 1(1), pp. 2-19, 1997.
37. P. J. Butt and E. H. Adelson, "The laplacian pyramid as a compact image code," IEEE Trans on Communications 31, pp. 532-540, 1983.
38. G. Borgefors, "Distance transformations in digital images," in CVGIP: Image Understanding, 54(2), p. 301, 1991.
39. A. G. Leventhal, The Neural Basis of Visual Function (Vision and Visual Dysfunction Vol. 4), CRC Press, Boca Raton, FL, 1991.
40. H. Greenspan, S. Belongie, R. Goodman, P. Perona, S. Rakshit, and C. H. Anderson, "Overcomplete steerable pyramid filters and rotation invariance," in Proc. IEEE Computer Vision and Pattern Recognition (CVPR), Seattle, WA, pp. 222-228, 1994.
41. C. Yee and D. Walther, "Motion detection for bottom-up visual attention," tech. rep., SURF/CNS, California Institute of Technology, 2002.
42. W. Reichardt, "Evaluation of optical motion information by movement detectors," J Comp Physiol [A] 161(4), pp. 533-547, 1987.
43. A. Luschow and H. C. Nothdurft, "Pop-out of orientation but no pop-out of motion at isoluminance," Vision Research 33(1), pp. 91-104, 1993.
44. R. L. De Valois, D. G. Albrecht, and L. G. Thoreil, "Spatial- frequency selectivity of cells in macaque visual cortex," Vision Research 22, pp. 545-559, 1982.
45. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex," J Physiol (London) 160, pp. 106-54, 1962.
46. K. S. Rockland and J. S. Lund, "Intrinsic laminar lattice connections in primate visual cortex," J Comp Neural 216(3), pp. 303-18, 1983.
47. C. D. Gilbert and T. N. Wiesel, "Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex," J Neurosci 9(7), pp. 2432-42, 1989.
48. A. M. Sillito, K. L. Grieve, H. E. Jones, J. Cudeiro, and J. Davis, "Visual cortical mechanisms detecting focal orientation discontinuities.," Nature 378(6556), pp. 492-6, 1995.
49. J. B. Levitt and J. S. Lund, "Contrast dependence of contextual effects in primate visual cortex.," Nature 387(6628), pp. 73-6, 1997.
50. M. Weliky, K. Kandier, D. Fitzpatrick, and L. C. Katz, "Patterns of excitation and inhibition evoked by horizontal connections in visual cortex share a common relationship to orientation columns.," Neuron 15(3), pp. 541-52, 1995.
51. U. Polat and D. Sagi, "The architecture of perceptual spatial interactions.," Vision Res 34(1), pp. 73-8, 1994.
52. M. W. Cannon and S. C. Fullenkamp, "Spatial interactions in apparent contrast: inhibitory effects among grating patterns of different spatial frequencies, spatial positions and orientations," Vision Res 31(11), pp. 1985-98,1991.
53. M. I. Posner, Y. Cohen, and R. D. Rafal, "Neural systems control of spatial orienting," Philos Trans R Soc Land B Biol Sci 298(1089), pp. 187-98, 1982.
54. B. C. Motter and E. J. Belky, "The guidance of eye movements during active visual search," Vision Res 38(12), pp. 1805-15, 1998.
55. V. Navalpakkam and L. Itti, "A goal oriented attention guidance model," in Proc. 2nd Workshop on Biologically Motivated Computer Vision (BMCV'02), Tuebingen, Germany, pp. 453-461, Nov 2002.
56. E. G. Freedman, "Interactions between eye and head control signals can account for movement kinematics," Biol Cybern 84(6), pp. 453-462, 2001.
57. E. Bizzi, "The coordination of eye-head movements," Sci Am 231(4), pp. 100-106, 1974.
58. J. Lanman, E. Bizzi, and J. Allum, "The coordination of eye and head movement during smooth pursuit," Brain Res 153(1), pp. 39-53, 1978.
59. J. A. Waterston and G. R. Barnes, "Visual-vestibular interaction during head-free pursuit of pseudorandom target motion in man," J Vestib Res 2(1), pp. 71-88, 1992.
60. H. H. Goossens and A. J. V. Opstal, "Human eye-head coordination in two dimensions under different sensorimotor conditions," Exp Brain Res 114(3), pp. 542-560, 1997.
61. A. Thiele, P. Henning, M. Kubischik, and K. P. Hoffmann, "Neural mechanisms of saccadic suppression," Science 295(5564), pp. 2460-2462, 2002.
62. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D. Salesin, "Synthesizing realistic facial expressions from photographs.," in SIGGRAPH 98 Conference Proceedings, pp. 75-84, ACM SIGGRAPH, July 1998.
63. D. Parkhurst, K. Law, and E. Niebur, "Modeling the role of salience in the allocation of overt visual attention," Vision Res 42(1), pp. 107-123, 2002.
64. R. J. Peters, L. Itti, and C. Koch, "Eye movements are influenced by short-range interactions among orientation channels," in Proc.Society for Neuroscience Annual Meeting (SFN'02), p. 715.12, Nov 2002.
65. P. F. Dominey and M. A. Arbib, "A cortico-subcortical model for generation of spatially accurate sequential saccades," Cereb Cortex 2(2), pp. 153-175, 1992.
66. A. Torralba, "Contextual modulation of target saliency," in Advances in Neural Information Processing Systems, Vol. 14, T. G. Dietterich, S. Becker, and Z. Ghahramani, eds., MIT Press, Cambridge, MA, 2002.
67. L. Itti, "Real-time high-performance attention focusing in outdoors color video streams," in Proc. SPIE Human Vision and Electronic Imaging VII (HVEI'02), San Jose, CA, B. Rogowitz and T. N. Pappas, eds., pp. 235-243, Jan 2002.