Towards optimization of a human-inspired heuristic for solving explore-exploit problems

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2012, Pages 2820-2825

  Reverdy, Paul ^a   Wilson, Robert C ^b   Holmes, Philip ^a   Leonard, Naomi E ^a  

^a Princeton University   (United States)

^b PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION MAKING; ECONOMIC AND SOCIAL EFFECTS; PARAMETER ESTIMATION;

FEEDBACK CONTROL LAW; HEURISTIC SOLUTIONS; HUMAN DECISION MAKING; OPTIMAL PARAMETER; OPTIMIZING PARAMETERS; ROBUSTNESS TO MODELING ERRORS; TRADE OFF;

OPTIMIZATION;

EID: 84874248431     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2012.6426148     Document Type: Conference Paper

References (14)

1. W.B. Powell, Approximate Dynamic Programming, 2nd Ed. Hoboken, NJ: Wiley, 2011.
2. G. Aston-Jones and J.D. Cohen. "An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance," Annu. Rev. Neurosci., Vol. 28, No. 1, pp. 403-450, 2005.
3. J.D. Cohen, S.M. McClure and A.J. Yu. "Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration," Phil. Trans. R. Soc. B, Vol. 362, pp. 933-942, 2007.
4. F. Balci, P. Simen, R. Niyogi, A. Saxe, P. Holmes and J.D. Cohen. "Acquisition of decision making criteria: Reward rate ultimately beats accuracy," Attention, Perception & Psychophysics 73 (2), 640-657, 2011.
5. R.C. Wilson, A. Geana, J.M. White, E.A. Ludvig, and J.D. Cohen. "To boldly go: Ambiguity-seeking in human exploratory decision making." In preparation.
6. D.W. Stephens and J.R. Krebs, Foraging Theory. Princeton, NJ: Princeton University Press, 1987.
7. S. Bubeck and N. Cesa-Bianchi, "Regret analysis of stochastic and nonstochastic multi-armed bandit problems," arXiv:1204.5721, 2012.
8. H.-L. Choi and J.P. How. "A multi-UAV targeting algorithm for ensemble forecast improvement," in Proc. AIAA Guidance, Navigation And Control Conference and Exhibit, Hilton Head, SC, 2007.
9. H.-L. Choi. "Adaptive sampling and forecasting with mobile sensor networks," PhD thesis, Dept. of Aeronautics and Astronautics, MIT, Cambridge, MA, 2008.
10. D. Tomlin, A. Nedic, M.T. Todd, R. C. Wilson, D. A. Prentice, P. Holmes, and J. D. Cohen. "Group foraging task reveals separable influences of individual experience and social information," presented at Neuroscience 2011, Washington, DC.
11. A. Nedic. "Models for individual decision-making with social feedback," PhD thesis, Dept. of Electrical Engineering, Princeton Univ., Princeton, NJ, 2011.
12. N. E. Leonard, D. A. Paley, F. Lekien, R. Sepulchre, D. M. Fratantoni, and R. E. Davis. "Collective motion, sensor networks, and ocean sampling," Proc. IEEE, Vol. 95, No. 1, pp. 48-74, Jan. 2007.
13. S. M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory. Upper Saddle River, NJ: Prentice Hall PTR, 1993, Ch. 12.
14. H. Poor, An Introduction to Signal Detection and Estimation, 2nd Ed. New York: Springer-Verlag, 1994.