Learning where to attend with deep architectures for image tracking

Neural Computation

Volumn 24, Issue 8, 2012, Pages 2151-2184

  Denil, Misha ^a   Bazzani, Loris ^b   Larochelle, Hugo ^c   de Freitas, Nando ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b UNIVERSITY OF VERONA   (Italy)

^c UNIVERSITÉ DE SHERBROOKE   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ATTENTION; DEPTH PERCEPTION; DISTANCE PERCEPTION; HUMAN; LEARNING; ORIENTATION; PATTERN RECOGNITION; PHYSIOLOGY;

ALGORITHMS; ATTENTION; DISTANCE PERCEPTION; HUMANS; LEARNING; ORIENTATION; PATTERN RECOGNITION, VISUAL; SPACE PERCEPTION;

EID: 84867478719     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00312     Document Type: Article

References (56)

1. Auer, P., Cesa-Bianchi, N., Freund, Y., & Schapire, R. E. (1998). Gambling in a rigged casino: The adversarial multi-armed bandit problem (Tech. Rep.). Leoben, Austria: University of Leoben.
2. Auer, P., Cesa-Bianchi, N., Freund, Y., & Schapire, R. E. (2001). The nonstochastic multiarmed bandit problem. SIAM Journal on Computing, 32, 48-77.
3. Barrington, L., Marks, T. K., Hsiao, J. H., & Cottrell, G. W. (2008). Nimble: A kernel density model of saccade-based visual memory. Journal of Vision, 8(14), 1-14.
4. Bazzani, L., de Freitas, N., Larochelle, H., Murino, V., & Ting, J. A. (2011). Learning attentional policies for tracking and recognition in video with deep networks. In Proceedings of the International Conference on Machine Learning (pp. 937-944). New York: ACM.
5. Brochu, E., Cora, V. M., & de Freitas, N. (2009). A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning (Tech. Rep. TR-2009-23). Vancouver, BC: University of British Columbia.
6. Butko, N. J., & Movellan, J. R. (2008). I-POMDP: An infomax model of eye movement. In Proceedings of the International Conference on Development and Learning. Piscataway, NJ: IEEE.
7. Colombo, J. (2001). The development of visual attention in infancy. Annual Review of Psychology, 52, 337-367.
8. Doucet, A., de Freitas, N., & Gordon, N. (2001). Introduction to sequential Monte Carlo methods. In A. Doucet, N. de Freitas, & N. J. Gordon (Eds.), Sequential Monte Carlo methods in practice. New York: Springer-Verlag.
9. Erez, T., Tramper, J. J., Smart,W. D., & Gielen, S. C. A. M. (2011). A POMDPmodel of eye-hand coordination. In Proceedings of the 25th Conference on Artificial Intelligence (pp. 952-957). Cambridge, MA: AAAI Press.
10. Freund, Y., & Haussler, D. (1991). Unsupervised learning of distributions of binary vectors using 2-layer networks. In J. E. Moody, S. J. Hanson, & R. P. Lippmann (Eds.), Advances in neural information processing systems (pp. 912-919). Cambridge, MA: MIT Press.
11. Freund, Y., & Schapire, R. E. (1997). A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55, 119-139.
12. Gaborski, R., Vaingankar, V., Chaoji, V., Teredesai, A., & Tentler, A. (2004). Detection of inconsistent regions in video streams. In Proceedings of SPIE Human Vision and Electronic Imaging (pp. 202-210). Bellingham,WA: SPIE.
13. Gao, D.,Mahadevan, V., & Vasconcelos, N. (2007). The discriminant center-surround hypothesis for bottom-up saliency. In J. C. Platt, D. Köller, Y. Singer, & S. Roweis (Eds.), Advances in neural information processing systems, 20 (pp. 1-8). Cambridge, MA: MIT Press.
14. Girard, B., & Berthoz, A. (2005). From brainstem to cortex: Computational models of saccade generation circuitry. Progress in Neurobiology, 77(4), 215-251.
15. Goodale, M. A., & Milner, A. D. (1992). Separate visual pathways for perception and action. Trends in Neurosciences, 15(1), 20-25.
16. Gottlieb, J. P., Kusunoki, M., & Goldberg, M. E. (1998). The representation of visual salience in monkey parietal cortex. Nature, 391, 481-484.
17. Hinton, G. E. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14, 1771-1800.
18. Hinton, G. E. (2010). A practical guide to training restricted Boltzmann machines (Tech. Rep.). Toronto: Department of Computer Science, University of Toronto.
19. Hinton, G. E., & Salakhutdinov, R. R. (2006). Reducing the dimensionality of data with neural networks. Science, 313(5786), 504-507.
20. Hoffman, M., Brochu, E., & de Freitas, N. (2011). Portfolio allocation for Bayesian optimization. In F. G. Cozman & A. Pfeffer (Eds.), Uncertainty in artificial intelligence (pp. 327-336). AUAI Press.
21. Isard, M., & Blake, A. (1996). Contour tracking by stochastic propagation of conditional density. In Proceedings of the European Computer Vision Conference (pp. 343-356). Berlin: Springer-Verlag.
22. Itti, L., Koch, C., & Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis andMachine Intelligence, 20(11), 1254-1259.
23. Jones, D. R., Perttunen, C. D., & Stuckman, B. E. (1993). Lipschitzian optimization without the Lipschitz constant. Journal of Optimization Theory and Applications, 79, 157-181.
24. Kaelbling, L. P., Littman, M. L., & Cassandra, A. R. (1998). Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101(1-2), 99-134.
25. Kalal, Z., Mikolajczyk, K., & Matas, J. (2010). Face-tld: Tracking-learning-detection applied to faces. In Proceedings of the IEEE International Conference on Image Processing (pp. 3789-3792). Piscataway, NJ: IEEE.
26. Kanan, C., & Cottrell, G.W. (2010). Robust classification of objects, faces, and flowers using natural image statistics. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2472-2479). Piscataway, NJ: IEEE.
27. Kavukcuoglu, K., Ranzato, M. A., Fergus, R., & Lecun, Y. (2009). Learning invariant features through topographic filter maps. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 1605-1612). Piscataway, NJ: IEEE.
28. Kim, M., Kumar, S., Pavlovic, V., & Rowley, H. (2008). Face tracking and recognition with visual constraints in real-world videos. In Proceedings of the IEEE Conf. Computer Vision and Pattern Recognition (pp. 1-8). Piscataway, NJ: IEEE.
29. Koch, C., & Ullman, S. (1985). Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology, 4, 219-227.
30. Köster, U., & Hyvärinen, A. (2007). A two-layer ICA-like model estimated by score matching. In Proceedings of the International Conference of Artificial Neural Networks (pp. 798-807). Berlin: Springer.
31. Lampert, C. H., Blaschko, M. B., & Hofmann, T. (2008). Beyond sliding windows: Object localization by efficient subwindow search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 1-8). Piscataway, NJ: IEEE.
32. Larochelle, H., & Hinton, G. E. (2010). Learning to combine foveal glimpses with a third-order Boltzmann machine. In J. Lafferty, C.K.I. Williams, J. Shawe-Taylor, R. S. Zemel, & A. Culotta (Eds.), Advances in neural information processing systems, 23. Red Hook, NY: Curran Associates.
33. Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009). Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proceedings of the International Conference on Machine Learning. Madison, WI: Omnipress.
34. Martinez-Cantin, R., de Freitas,N., Doucet, A., & Castellanos, J. (2007). Active policy learning for robot planning and exploration under uncertainty. In Proceedings of Robotics: Science and Systems. Cambridge, MA: MIT Press.
35. Mcnaughton, B. L., Battaglia, F. P., Jensen, O., Moser, E. I., & Moser, M. (2006). Path integration and the neural basis of the "cognitive map." Nature Reviews Neuroscience, 7(8), 663-678.
36. Najemnik, J., & Geisler, W. S. (2005). Optimal eye movement strategies in visual search. Nature, 434, 387-391.
37. Nelson, J.D., Mckenzie, C. R.M., Cottrell, G.W.,&Sejnowski, T. J. (2010). Experience matters: Information acquisition optimizes probability gain. Psychological Science, 21(7), 960-969.
38. Okuma, K., Taleghani, A., de Freitas, N., & Lowe, D. G. (2004). A boosted particle filter:Multitarget detection and tracking. In Proceedings of the European Conference on Computer Vision. Berlin: Springer-Verlag.
39. Olshausen, B. A., Anderson, C. H., & Van Essen, D. C. (1993). A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information. Journal of Neuroscience, 13, 4700-4719.
40. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381, 607-609.
41. O'Reilly, R. (2010). The what and how of prefrontal cortical organization. Trends in Neurosciences, 33(8), 355-361.
42. Postma, E. O., van den Herik, H. J., & Hudson, P. T. W. (1997). SCAN: A scalable model of attentional selection. Neural Networks, 10(6), 993-1015.
43. Ranzato, M. A., & Hinton, G. E. (2010). Modeling pixel means and covariances using factorized third-order Boltzmann machines. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 2551-2558). Piscataway, NJ: IEEE.
44. Rasmussen, C. E., & Williams, C. K. I. (2006). Gaussian processes for machine learning. Cambridge, MA: MIT Press.
45. Rensink, R. A. (2000). The dynamic representation of scenes. Visual Cognition, 7, 17-42.
46. Rosa, M. G. P. (2002). Visual maps in the adult primate cerebral cortex: Some implications for brain development and evolution. Brazilian Journal of Medical and Biological Research, 35, 1485-1498.
47. Smolensky, P. (1986). Information processing in dynamical systems: Foundations of harmony theory. In J. L. McClelland & D. E. Rumelhart (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1, pp. 194-281). Cambridge, MA: MIT Press.
48. Srinivas, N., Krause, A., Kakade, S. M., & Seeger, M. (2010). Gaussian process optimization in the bandit setting: No regret and experimental design. In Proceedings of the International Conference on Machine Learning (pp. 1015-1022). Madison, WI: Omnipress.
49. Swersky, K., Buchman, D., Marlin, B. M., & de Freitas, N. (2011). On autoencoders and scorematching for energy basedmodels. In Proceedings of the 28th International Conference on Machine Learning (pp. 1201-1208). New York: ACM.
50. Taylor, G. W., Sigal, L., Fleet, D. J., & Hinton, G. E. (2010). Dynamical binary latent variable models for 3D human pose tracking. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 631-638). Piscataway, NJ: IEEE.
51. Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. M. (2006). Contextual guidance of eye movements and attention in real-world scenes: The role of global features in object search. Psychological Review, 113, 766-786.
52. Ungerleider, L., & Mishkin, M. (1982). Two cortical visual systems. In D. J. Ingle, M. A. Goodale, & R.J.W. Mansfield (Eds.), The analysis of visual behavior (pp. 549-586). Cambridge, MA: MIT Press.
53. Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P. A. (2008). Extracting and composing robust features with denoising autoencoders. In Proceedings of the International Conference on Machine Learning (pp. 1096-1103). New York: ACM.
54. Vogel, J., & de Freitas, N. (2008). Target-directed attention: Sequential decisionmaking for gaze planning. In Proceedings of the IEEE International Conference on Robotics and Automation (pp. 2372-2379). Piscataway, NJ: IEEE.
55. Welling, M., Rosen-Zvi, M., & Hinton, G. (2004). Exponential family harmoniums with an application to information retrieval. In L. Saul, Y. Weiss, & L. Bottou (Eds.), Neural information processing systems, 17 (pp. 1481-1488). Cambridge, MA: MIT Press.
56. Zhang, L., Tong, M. H., & Cottrell, G. W. (2009). Sunday: Saliency using natural statistics for dynamic analysis of scenes. In Proceedings of the 31st Annual Cognitive Science Conference. Cambridge, MA: AAAI Press.