Bottom-up gaze shifts and fixations learning by imitation

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 37, Issue 2, 2007, Pages 256-271

  Belardinelli, Anna ^a   Pirri, Fiora ^a   Carbone, Andrea ^a  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

Gaze following; Gaze machine; Joint attention; Robot learning by imitation

Indexed keywords

ARTIFICIAL INTELLIGENCE; FACE RECOGNITION; HIDDEN MARKOV MODELS; INDUSTRIAL ROBOTS; NEURAL NETWORKS; NEUROPHYSIOLOGY;

GAZE FOLLOWING; GAZE MACHINE; JOINT ATTENTION;

ROBOT LEARNING;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ATTENTION; BIOMIMETICS; COMPUTER ASSISTED DIAGNOSIS; EYE FIXATION; HUMAN; IMITATION; MAN MACHINE INTERACTION; METHODOLOGY; PATTERN RECOGNITION; PHYSIOLOGY; ROBOTICS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; ATTENTION; BIOMIMETICS; FIXATION, OCULAR; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMITATIVE BEHAVIOR; MAN-MACHINE SYSTEMS; PATTERN RECOGNITION, VISUAL; ROBOTICS;

EID: 34047132177     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2006.886950     Document Type: Article

References (74)

1. H. Akaike, "Information theory and an extension of the maximum likelihood principle," in Proc. 2nd Int. Symp. Inf. Theory, B. N. Petrov and F. Csaki, Eds., 1973, pp. 267-281.
2. T. Arbel, "Recognizing volumetric objects in presence of uncertainty," M.S. thesis, McGill Univ., Montreal, QC, Canada, 1995.
3. J. Bergen and B. Julesz, "Parallel versus serial processing in rapid pattern discrimination," Nature, vol. 303, no. 5919, pp. 696-698, Jun. 1983.
4. C. Biernacki, G. Celeux, and G. Govaert, "An improvement of the NEC criterion for assessing the number of clusters in a mixture model," Pattern Recognit. Lett., vol. 20, no. 3, pp. 267-272, Mar. 1999.
5. J. Bilmes, "A gentle tutorial on the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models," Univ. California, Berkeley, CA, Tech. Rep. ICSI-TR-97-021, 1997.
6. J. Braun and B. Julesz, "Withdrawing attention at little or no cost: Detection and discrimination task," Percept. Psychophys., vol. 60, no. 1, pp. 1-23, Jan. 1998.
7. J. Braun and D. Sagi, "Vision outside the focus of attention," Percept. Psychophys., vol. 1, no. 48, pp. 45-58, Jul. 1990.
8. C. Breazeal and B. Scassellati, "Infant-like social interactions between a robot and a human caregiver," Adapt. Behav., vol. 8, no. 1, pp. 49-74, Jan. 2000.
9. R. Brooks and A. Meltzoff, "The importance of eyes: How infants interpret adult looking behavior," Devel. Psychol., vol. 38, no. 6, pp. 958-966, Nov. 2002.
10. R. Brooks and A. Meltzoff, "The development of gaze following and its relation to language," Devel. Sci., vol. 8, no. 6, pp. 535-543, Nov. 2005.
11. P. Burt, "Attention mechanisms for vision in a dynamic world," in Proc. ICPR, 1988, pp. 977-987.
12. G. Butterworth and E. Cochran, "Towards a mechanism of joint visual attention in human infancy," J. Behav. Devel., vol. 3, no. 3, pp. 253-272, 1980.
13. C. Koch and S. Ullman, "Shifts in selective visual-attention: Towards the underlying neural circuitry," Hum. Neurobiol, vol. 4, no. 4, pp. 219-227, 1994.
14. M. Carpenter, T. Nagell, and M. Tomasello, "Social cognition, joint attention, and communicative competence from 9 to 15 months of age," Monogr. Soc. Res. Child Devel., vol. 63, no. 4, pp. 1-143, 1998. (4, Serial No. 255).
15. A. Chan, N. Vasconcelos, and P. Moreno, "A family of probabilistic kernels based on information divergence," Univ. California, San Diego, CA, Tech. Rep. SVCL-TR-2004-1, Jun. 2004.
16. Y. Cheng, "Mean shift, mode seeking, and clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 8, pp. 790-799, Aug. 1995.
17. J. Clark and N. Ferrier, "Modal control of an attentive vision system," in Proc. ICCV, 1988, pp. 514-523.
18. V. Corkum and C. Moore, "Development of joint visual attention in infants," in Joint Attention: Its Origins and Role in Development. Hillsdale, NJ: Erlbaum, 1995.
19. J. G. Daugman, "Complete discrete 2-D gabor transforms by neural networks for image analysis and compression," IEEE Trans. Acoust., Speech, Signal Process., vol. 36, no. 7, pp. 1169-1179, Jul. 1988.
20. Y. Demiris and G. Hayes, Imitation as a Dual Route Process Featuring Predictive and Learning Components: A Biologically-Plausible Computational Model, C. Nehaniv and K. Dautenhahn, Eds. Cambridge, MA: MIT Press, 2002.
21. Y. Demiris and M. Johnson, "Distributed, prediction perception of actions: A biologically inspired architecture for imitation and learning," Connect. Sci., vol. 15, no. 4, pp. 231-243, Dec. 2003.
22. Y. Demiris and B. Khadouri, "Hierarchical attentive multiple models for execution and recognition," Robot. Auton. Syst., vol. 54, no. 5, pp. 361-369, May 2006.
23. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Stat. Soc., vol. 39, no. 1, pp. 1-38, 1977.
24. A. T. Duchowski, Eye Tracking Methodology: Theory and Practice. New York: Springer-Verlag, 2003.
25. I. Fasel, G. Deak, J. Triesch, and J. Movellan, "Combining embodied models and empirical research for understanding the development of shared attention," in Proc. 2nd Int. Conf. Develop. and Learning, 2002, pp. 21-27.
26. P. Ferrari, E. Koheler, L. Fogassi, and V. Gallese, "The ability to follow eye gaze and its emergence during development in macaque monkeys," Proc. Nat. Acad. Sci., vol. 97, no. 25, pp. 13 997-14 002, Dec. 2000.
27. J. M. Findlay and I. D. Gilchrist, Active Vision: The Psychology of Looking and Seeing. London, U.K.: Oxford Univ. Press, 2003.
28. C. Fraley and A. E. Raftery, "How many clusters? Which clustering method? Answers via model-based cluster analysis," Comput. J., vol. 41, no. 8, pp. 578-588, 1998.
29. K. Fukunaga and L. Hostetler, "Estimation of the gradient of a density function, with applications in pattern recognition," IEEE Trans. Inf. Theory, vol. IT-21, no. 1, pp. 32-40, Jan. 1975.
30. G. Granlund, H. Knutsson, C. Westelius, and J. Wiklund, "Issues in robot vision," Image Vis. Comput., vol. 12, no. 3, pp. 131-148, Apr. 1994.
31. V. V. Hafner and F. Kaplan, "Learning to interpret pointing gestures: Experiments with four-legged autonomous robots" in Biomimetic Neural Learning for Intelligent Robots. Intelligent Systems, Cognitive Robotics, and Neuroscience. Lecture Notes in Artificial Intelligence, vol. 3575, S. Wermter, G. Palm, and M. Elshow, Eds. Berlin, Germany: Springer-Verlag, 2005.
32. L. Itti, "Visual attention," in The Handbook of Brain Theory and Neural Networks, 2nd ed. M. A. Arbib, Ed. Cambridge, MA: MIT Press, Jan. 2003, pp. 1196-1201.
33. L. Itti and C. Koch, "A saliency-based search mechanism for overt and covert shifts of visual attention," Vis. Res., vol. 40, no. 10, pp. 1489-1506, Jun. 2000.
34. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
35. W. James, The Principles of Psychology. New York: Holt, 1980.
36. H. Jasso, J. Triesch, and C. Teuscher, "A reinforcement learning model explains the stage-wise development of gaze following," in Proc. 12th Joint Symp. Neural Comput., May 14, 2005.
37. T. Jebara, R. Kondor, and A. Howard, "Probability product kernels," J. Mach. Learn. Res., vol. 5, pp. 819-844, Dec. 2004.
38. C. Koch, Models of Motion Perception: Introduction and the Reichardt Correlation Model. Pasadena, CA: Caltech, 2004. Notes of the Course Vision: From Computational Theory to Neuronal Mechanisms CNS/Bi/EE 186 (4-4-4).
39. H. Kozima, Infanoid: A Babybot That Explores the Social Environment. Norwell, MA: Kluwer, 2002, pp. 157-164.
40. M. H. C. Law, M. A. T. Figueiredo, and A. K. Jain, "Simultaneous feature selection and clustering using mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1154-1166, Sep. 2004.
41. F. Leisch, "FlexMix: A general framework for finite mixture models and latent class regression," R. J. Stat. Softw., vol. 11, no. 8, 2004.
42. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
43. S. Lyu, "FlexMix: A kernel between unordered sets of data: The Gaussian mixture approach," in Proc. ECML, 2005, pp. 255-267.
44. G. J. McLachlan and D. Peel, Finite Mixture Models. New York: Wiley, 2000.
45. G. McLachlan and D. Peel, "MIXFIT: An algorithm for the automatic fitting and testing of normal mixture models," in Proc. 14th Int. Conf. Pattern Recog., 1998, pp. 553-557.
46. A. Meltzoff and M. Moore, "Explaining facial imitation: A theoretical model," Early Devel. Parent., vol. 6, no. 3/4, pp. 179-192, Sep.-Dec. 1997.
47. H. Moll and M. Tomasello, "12- and 18-month-old infants follow gaze to spaces behind barriers," Devel. Sci., vol. 7, no. 1, pp. F1-F9, Feb. 2004.
48. Y. Nagai, "Joint attention development in infant-like robot based on head movement imitation," in Proc. 3rd Int. Symp. Imitation Animals and Artifacts (AISB), 2005, pp. 87-96.
49. Y. Nagai, "The role of motion information in learning human-robot joint attention," in Proc. ICRA, 2005, pp. 2081-2086.
50. E. Nakamura and N. D. Kehtarnavaz, "Determining number of clusters and prototype locations via multi-scale clustering," Pattern Recognit. Lett., vol. 19, no. 14, pp. 1265-1283, Dec. 1998.
51. S. Okamoto, M. Tanaka, and M. Tomonaga, "Looking back: Representational mechanism of joint attention in an infant chimpanzee (pan troglodytes)," Jpn. Psychol. Res., vol. 46, no. 3, pp. 236-245, Sep. 2004.
52. E. Parzen, "On estimation of a probability density function and mode," Ann. Math. Stat., vol. 33, no. 3, pp. 1065-1076, Sep. 1962.
53. A. Pentland, "Social dynamics: Signals and behavior," in Proc. ICDL, 2004. MIT Media Lab. Tech. Note 579.
54. A. Pentland, "Socially aware computation and communication," Computer, vol. 38, no. 3, pp. 33-40, Mar. 2005.
55. A. Pentland, "Socially aware media," in Proc. ACM Multimedia, 2005, pp. 690-695.
56. A. Polymenis and D. M. Titterington, "On the determination of the number of components in a mixture," Stat. Prob. Lett., vol. 38, no. 4, pp. 295-298, Jul. 1998.
57. D. J. Povinelli, Folk Physics for Apes: The Chimpanzee's The of How The World Works. London, UK.: Oxford Univ. Press, 2000.
58. R. Rensink, J. O'Regan, and J. Clark, "On the failure to detect changes in scenes across brief interruptions," Vis. Cogn., vol. 7, no. 1-3, pp. 127-145, Jan. 2000.
59. J. Rissanen, Minimum Description Length Principle. Hoboken, NJ: Wiley, 1985, pp. 523-527.
60. G. Rizzolatti, L. Fogassi, and V. Gallese, "Neurophysiological mechanism underlying the understanding and imitation of action," Nature Neurosc., vol. 2, no. 9, pp. 661-670, 2001.
61. S. Roweis, Gaussian Identities, 1999. notes. [Online]. Available: http://www.cs.toronto.edu/~roweis/notes/gaussid.pdf
62. P. Sandon, "Control of eye and arm movements using active, attentional vision," Int. J. Pattern Recognit. Artif. Intell., vol. 8, no. 6, pp. 1471-1491, 1994.
63. B. Scassellati, "Imitation and mechanisms of joint attention: A developmental structure for building social skills on a humanoid robot" in Computation for Metaphors, Analogy and Agents, Lecture Notes in Artificial Intelligence, vol. 1562, C. Nehaniv, Ed. Berlin, Germany: Springer-Verlag, 1998, pp. 176-195.
64. C. Schmid and R. Mohr, "Local grayvalue invariants for image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 5, pp. 530-535, May 1997.
65. G. Schwarz, "Estimating the dimension of a model," Ann. Stat., vol. 6, no. 2, pp. 461-464, Mar. 1978.
66. A. Shon, D. Grimes, C. Baker, M. Hoffman, S. Zhou, and R. Rao, "Probabilistic gaze imitation and saliency learning in a robotic head," in Proc. IEEE Int. Conf. Robot. and Autom., 2005, pp. 2876-2881.
67. D. Simons and D. Levin, "Change blindness," Trends Cogn. Sci., vol. 1, no. 7, pp. 261-267, Oct. 1997.
68. P. Smith, M. Shah, and N. Vitoria, "Determining driver visual attention with one camera," IEEE Trans. Intell. Transp. Syst., vol. 4, no. 4, pp. 205-218, Dec. 2003.
69. M. Tomasello, B. Hare, and B. Agnetta, "Chimpanzees, pan troglodytes, follow gaze direction geometrically," Anim. Behav., vol. 58, no. 4, pp. 769-777, Oct. 1999.
70. A. Treisman, "Preattentive processing in vision," Comput. Vis. Graph. Image Process., vol. 31, no. 2, pp. 156-177, Aug. 1985.
71. J. Triesch, D. Ballard, and R. A. Jacobs, "Fast temporal dynamics of visual cue integration," J. Vis., vol. 1, no. 3, p. 463, 2001.
72. J. Triesch, C. Teuscher, G. Deak, and E. Carlson, "Gaze following: Why (not) learn it?" Devel. Sci., vol. 9, no. 2, pp. 125-147, Mar. 2006.
73. C. S. Wallace and D. Boulton, "An information measure for classification," Comput. J., vol. 11, no. 2, pp. 185-194, Aug. 1968.
74. J. M. Wolfe and K. R. Cave, "Deploying visual attention: The guided search model," in In AI and the Eye, T. Troscianko and A. Blake, Eds. Hoboken, NJ: Wiley, 1990, pp. 79-103.