Active sensing as bayes-optimal sequential decision-making

Uncertainty in Artificial Intelligence - Proceedings of the 29th Conference, UAI 2013

Volumn , Issue , 2013, Pages 12-21

  Ahmad, Sheeraz ^a   Yu, Angela J ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACTIVE CONTROLLER; COMPUTATIONAL NEUROSCIENCE; CONTEXT DEPENDENT; CONTEXT SENSITIVITY; GEOMETRIC PROPERTIES; INFORMATION MAXIMIZATION; PERIPHERAL VISION; SENSORY PROCESSING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE;

OPTIMIZATION;

EID: 84888139374     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. Mauricio Araya-López, Vincent Thomas, Olivier Buffet, and François Charpillet. A closer look at momdps. In Tools with Artificial Intelligence (ICTAI), 2010 22nd IEEE International Conference on, Volume 2, pages 197-204. IEEE, 2010.
2. R Bellman. On the theory of dynamic programming. PNAS, 38(8): 716-719, 1952.
3. S Branson, P Perona, and S Belongie. Strong supervision from weak annotation: Interactive training of deformable part models. IEEE International Conference on Computer Vision, 2: 1832-1839, 2011.
4. M.D. Buhmann. Radial basis functions: theory and implementations, Volume 12. Cambridge university press, 2003.
5. N J Butko and J R Movellan. Infomax control of eyemovements. IEEE Transactions on Autonomous Mental Development, 2(2): 91-107, 2010.
6. Timothy H. Chung and Joel W. Burdick. A decision-making framework for control strategies in probabilistic search. Intl. Conference on Robotics and Automation. ICRA, April 2007.
7. T. Darrell and A. Pentland. Active gesture recognition using partially observable markov decision processes. In Pattern Recognition, 1996., Proceedings of the 13th International Conference on, Volume 3, pages 984-988. IEEE, 1996.
8. L. Dorard, D. Glowacka, and J. Shawe-Taylor. Gaussian process modelling of dependencies in multi-armed bandit problems. In Int. Symp. Op. Res, 2009.
9. J M Findley. Global processing for saccadic eye movements. Vision Research, 1982.
10. J C Gittins. Bandit processes and dynamic allocation indices. J. Royal Stat. Soc., 41: 148-77, 1979.
11. D. Golovin, A. Krause, and D. Ray. Near-optimal bayesian active learning with noisy observations. arXiv preprint arXiv: 1010.3091, 2010.
12. L Itti and P Baldi. Bayesian surprise attracts human attention. In Advances in Neural Information Processing Systems, Vol. 19, pages 1-8, Cambridge, MA, 2006. MIT Press.
13. L Itti and C Koch. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40(10-12): 1489-506, 2000.
14. S. Ji, R. Parr, and L. Carin. Nonmyopic multiaspect sensing with partially observable markov decision processes. Signal Processing, IEEE Transactions on, 55(6): 2720-2730, 2007.
15. R. Kaplow. Point-based POMDP solvers: Survey and comparative analysis. PhD thesis, McGill University, 2010.
16. C Koch and S Ullman. Shifts in selective visual attention: towards the underlying neural circuitry. Hum. Neurobiol., 1985.
17. C. Kwok and D. Fox. Reinforcement learning for sensing strategies. In Intelligent Robots and Systems, 2004.(IROS 2004). Proceedings. 2004 IEEE/RSJ International Conference on, Volume 4, pages 3158-3163. IEEE, 2004.
18. M.G. Lagoudakis and R. Parr. Least-squares policy iteration. The Journal of Machine Learning Research, 4: 1107-1149, 2003.
19. Tai Sing Lee and Stella Yu. An information-theoretic framework for understanding saccadic behaviors. In Advance in Neural Information Processing Systems, Volume 12, Cambridge, MA, 2000. MIT Press.
20. K. Liu and Q. Zhao. Indexability of restless bandit problems and optimality of whittle index for dynamic multichannel access. Information Theory, IEEE Transactions on, 56(11): 5547-5567, 2010.
21. W.S. Lovejoy. Computationally feasible bounds for partially observed markov decision processes. Operations research, 39(1): 162-175, 1991.
22. D Martin, C Fowlkes, D Tal, and J Malik. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In Proc. 8th International Conference on Computer Vision, Volume 2, pages 416-423, 2001.
23. S Minut and S Mahadevan. A reinforcement learning model of selective visual attention. In Proceedings of the Fifth International Conference on Autonomous Agents, Montreal, 2001.
24. M. Naghshvar and T. Javidi. Active m-ary sequential hypothesis testing. In Information Theory Proceedings (ISIT), 2010 IEEE International Symposium on, pages 1623-1627. IEEE, 2010.
25. J Najemnik and W S Geisler. Optimal eye movement strategies in visual search. Nature, 434(7031): 387-91, 2005.
26. Sylvie CW Ong, Shao Wei Png, David Hsu, and Wee Sun Lee. Planning under uncertainty for robotic tasks with mixed observability. The International Journal of Robotics Research, 29(8): 1053-1068, 2010.
27. S. Pandey, D. Chakrabarti, and D. Agarwal. Multi-armed bandit problems with dependent arms. In Proceedings of the 24th international conference on Machine learning, pages 721-728. ACM, 2007.
28. J. Pineau, G. Gordon, and S. Thrun. Anytime point-based approximations for large pomdps. Journal of Artificial Intelligence Research, 27(1): 335-380, 2006.
29. W.B. Powell. Approximate Dynamic Programming: Solving the curses of dimensionality, Volume 703. Wiley-Interscience, 2007.
30. M Sridharan, J Wyatt, and R Dearden. Planning to see: A hierarchical approach to planning visual actions on a robot using pomdps. Artificial Intelligence, pages 704-725, 2010.
31. R. Washburn and M. Schneider. Optimal policies for a class of restless multiarmed bandit scheduling problems with applications to sensor management. Journal of Advances in Information Fusion. v3, 2008.
32. P Whittle. Restless bandits: activity allocation in a changing world. J. App. Probability, 25A: 287-98, 1988.
33. C K I Williams and C E Rasmussen. Gaussian processes for regression. In M.C. Mozer D. S. Touretzky and M. E. Hasselmo, editors, Advances in Neural Information Processing Systems 8, pages 514-20. MIT Press, Cambridge, MA, 1996.
34. A F Yarbus. Eye Movements and Vision. Plenum Press, New York, 1967.
35. G J Zelinsky, R P Rao, M M Hayhoe, and D H Ballard. Eye movements reveal the spatio-temporal dynamics of visual search. Psychol. Sci., 1997.