Modeling Embodied Visual Behaviors

ACM Transactions on Applied Perception

Volumn 4, Issue 2, 2007, Pages 11-

  Sprague, Nathan ^a   Ballard, Dana ^b   Robinson, Al ^b  

^a KALAMAZOO COLLEGE   (United States)

^b UNIVERSITY OF ROCHESTER   (United States)

Author keywords

Experimentation; reinforcement learning; Theory; visual attention; Visual routines

Indexed keywords

EID: 85013237108     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1265957.1265960     Document Type: Article

References (56)

1. Aivar, M. P., Hayhoe, M. M., Chizk, M. M., and Mruczek, R. E. B. 2005. Spatial memory and saccadic targeting in a natural task. Journal of Vision. 4, 1-3.
2. Arkin, R. 1998. Behavior-Based Robotics. MIT Press, Cambridge, MA.
3. Babcock, J. and Pelz, J. B. 2000. The rit wearable eyetracker. ACM SIGCHI Eye Tracking Research and Application Symposium.
4. Baddeley, A. D. 1989. Working Memory. Oxford University Press, Oxford.
5. Ballard, D. and Sprague, N. 2002. Attentional resource allocation in extended natural tasks [abstract]. Journal of Vision 2, 7, 568a.
6. Ballard, D., Hayhoe, M., and Pelz, J. 1995. Memory representations in natural tasks. Cognitive Neuroscience. 7, 66-80.
7. Ballard, D., Hayhoe, M., and Pook, P. 1997. Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences 20, 723-767.
8. Brooks, R. A. 1986. A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation RA-2, 1 (Apr.), 14-23.
9. Bryson, J. J. and Stein, L. A. 2001. Modularity and design in reactive intelligence. In International Joint Conference on Artificial Intelligence. Seattle, Washington.
10. Clark, A. 1999. An embodied model of cognitive science? Trends in Cognitive Sciences 3, 345-351.
11. Faloutsos, P., Van De Panne, M., and Terzopoulos, D. 2001. The virtual stuntman: Dynamic characters with a repertoire of motor skills. Computers and Graphics 25, 933-953.
12. Firby, R. J., Kahn, R. E., Prokopowicz, P. N., and Swain, M. J. 1995. An architecture for vision and action. In Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence. 72-79.
13. Hartley, R. and Pipitone, F. 1991. Experiments with the subsumption architecture. In Proceedings of the International Converence on Robotics and Automation.
14. Hayhoe, M. M., Bensinger, D., and Ballard, D. H. 1998. Task constraints in visual working memory. Vision Research 38, 125-137.
15. Hayhoe, M. M., Shrivastava, A., Mruczek, R., and Pelz, J. 2003. Visual memory and motor planning in a natural task. Journal of Vision. 3, 49-63.
16. Humphrys, M. 1996. Action selection methods using reinforcement learning. In Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior.
17. Itti, L. and Koch, C. 2000. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 40, 10-12 (May), 1489-1506.
18. Jagersand, M., Fuentes, O., and Nelson, R. 1996. Acquiring visuo-motor models for precision manipulation with robot hands. In Proceedings of the 4th European Conference on Computer Vision. 603-612.
19. JOhansson, R., Westling, G., Backstrom, A., and Flanagan, J. R. 1999. Eye-hand coordination in object manipulation. Perception 28, 1311-1328.
20. Kaelbling, L. P., Littman, M. L., and Moore, A. W. 1996. Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4, 237-285.
21. Karlsson, J. 1997. Learning to solve multiple goals. Ph.D. thesis, University of Rochester, Rochester, New York.
22. Kosslyn, S. M. and Shwartz, S. 1977. A simulation of visual imagery. Cognitive Science 1, 265-269.
23. Land, M., Mennie, N., and Rusted, J. 1999. The roles of vision and eye movements in the activities of daily living. Perception 28, 1311-1328.
24. Luck, S. J. and Vogel, E. K. 1997. The capacity of visual working memory for features and conjunctions. Nature London 390, 279-281.
25. Marr, D. 1982. Vision. W.H. Freeman, San Francisco, CA.
26. Miller, G. 1956. The magic number seven plus or minus two: Some limits on your capacity for processing information. Psychological Review 63, 81-96.
27. Moray, N. 1986. Handbook of perception and human performance (Vol. II). New York:Wiley.
28. Newell, A. 1990. Unified Theories of Cognition. Harvard University Press, Cambridge, MA.
29. Newell, F. N., Ernst, M. O., Yjan, B. S., and Bulthoff, H. H. 2000. Viewpoint dependence in visual and haptic object recognition. Psychological Science 12, 37-42.
30. Nilsson, N. 1984. Shakey the robot. Tech. Rep. 223, SRI International.
31. Noe, A. 2005. Action in Perception. MIT Press, Cambridge, MA.
32. O'Regan, J. K. and Noe, A. 2001. A sensorimotor approach to vision and visual consciousness. Behavioral and Brain Sciences 24, 939-973.
33. Pashler, H. 1998. The Psychology of Attention. MIT Press, Cambridge, MA.
34. Pelz, J., Hayhoe, M., and Loeber, R. 2001. The coordination of eye, head, and hand movements in a natural task. Experimental Brain Research 139, 3, 166-177.
35. Pew, R. W. and Baron, S. 1983. Perspectives on human performance modelling. Automatica 19, 663-676.
36. Razzaque, S., Swapp, D., Slater, M., Whiton, M., and Steed, A. 2002. Redirected walking in space. Eighth Eurographics Workshop on Virtual Environments.
37. Roelfsema, P., Lamme, V., and Spekreijse, H. 2000. The implementation of visual routines. Vision Research 40, 1385-1411.
38. Roelfsema, P. R., and Spekreijse, H. 2003. Subtask sequencing in the primary visual cortex. Proceedings of the National Academy of Sciences USA 100, 5467-5472.
39. Roskies, A. L. 1999. The binding problem. Neuron 24, 7-9.
40. Roy, D. and Pentland, A. 2002. Learning words from sights and sounds: A computational model. Behavioral and Brain Sciences 26, 113-146.
41. Sprague, N. and Ballard, D. 2003a. Eye movements for reward maximization. In Advances in Neural Information Processing Systems 15.
42. Sprague, N. and Ballard, D. 2003b. Multiple-goal reinforcement learning with modular sarsa(0). Tech. Rep. 798, University of Rochester Computer Science Department.
43. Sprague, N. and Ballard, D. 2003c. Multiple-goal reinforcement learning with modular sarsa(0). In International Joint Conference on Artificial Intelligence.
44. Sprague, N. 2004. Learning to coordinate visual behaviors. Ph.D. thesis, University of Rochester Department of Computer Science.
45. Suri, R. E. and SCHULTZ, W. 2001. Temporal difference model reproduces anticipatory neural activity. Neural Computation 13, 841-862.
46. Sutton, R. 1996. Generalization in reinforcement learning: Successful examples using sparse coarse coding. In Advances in Neural Information Processing Systems. 8.
47. Sutton, R. and Barto, A. G. 1998. Reinforcement learning: An Introduction. MIT Press. Cambridge, MA.
48. Terzopoulos, D. and Rabie, T. F. 1997. Animat vision: Active vision in artificial animals. Videre: Journal of Computer Vision Research 1, 1, 2-19.
49. Triesch, J., Ballard, D., Hayhoe, M., and Sullivan, B. 2003. What you see is what you need. Journal of Vison. 3, 86-94.
50. Trommershauser, J., Maloney, L., and Landy, M. 2003. Statistical decision theory and the selection of rapid, goal-directed movements. Journal of the Optical Society A 20, 7, 1419-1433.
51. Ullman, S. 1985. Visual routines. Cognition 18, 97-159.
52. Van Rullen, R., Reddy, L., and Koch, C. 2004. Visual search and dual tasks reveal two distinct attentional resources. Journal of Cognitive Neuroscience 16, 4-14.
53. Von Der Malsburg, C. 1999. The what and why of binding: the modeler's perspective. Neuron 24, 95-104.
54. Watkins, C. J. C. H. 1989. Learning from delayed rewards. Ph.D. thesis, King's College, Oxford.
55. Watkins, C. J. C. H. and Dayan, P. 1992. Q-learning. Machine Learning Journal 8, 3/4 (May).
56. Yu, C. and Ballard, D. 2004. A multimodal learning interface for grounding spoken language in sensorimotor experience. ACM Transactions on Applied Perception 1, 57-80.