Cheap but Clever: Human Active Learning in a Bandit Setting

Cooperative Minds: Social Interaction and Group Dynamics - Proceedings of the 35th Annual Meeting of the Cognitive Science Society, CogSci 2013

Volumn , Issue , 2013, Pages 1647-1652

  Zhang, Shunan ^a   Yu, Angela J ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Bandit problems; human active learning; human decision making; knowledge gradient

Indexed keywords

APPROXIMATION ALGORITHMS; ARTIFICIAL INTELLIGENCE; BEHAVIORAL RESEARCH; OPTIMIZATION;

ACTIVE LEARNING; BANDIT PROBLEMS; DECISION POLICY; HEURISTIC POLICIES; HUMAN ACTIVE LEARNING; HUMAN DECISION-MAKING; KNOWLEDGE GRADIENT; KNOWN ENVIRONMENTS; LONG-TERM GOALS; OPTIMAL POLICIES;

DECISION MAKING;

EID: 84898947296     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Banks, J., Olson, M., & Porter, D. (2013). An experimental analysis of the bandit problem. Economic Theory, 10, 55-77.
2. Cohen, J. D., McClure, S. M., & Yu, A. J. (2007). Should I stay or should I go? Exploration versus exploitation. Philosophical Transactions of the Royal Society B: Biological Sciences, 362, 933-942.
3. Daw, N. D., O'Doherty, J. P., Dayan, P., Seymour, B., & Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature, 441, 876-879.
4. Frazier, P., Powell, W., & Dayanik, S. (2008). A knowledge-gradient policy for sequential information collection. SIAM Journal on Control and Optimization, 47, 2410-2439.
5. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2004). Bayesian data analysis (2 ed.). Boca Raton, FL: Chapman & Hall/CRC.
6. Gittins, J. C. (1979). Bandit processes and dynamic allocation indices. Journal of the Royal Statistical Society, 41, 148-177.
7. Kaebling, L. P., Littman, M. L., & Moore, A. W. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4, 237-285.
8. Lee, M. D., Zhang, S., Munro, M., & Steyvers, M. (2011). Psychological models of human and optimal performance in bandit problems. Cognitive Systems Research, 12, 164-174.
9. Powell, W., & Ryzhov, I. (2012). Optimal learning (1 ed.). Wiley.
10. Robbins, H. (1952). Some aspects of the sequential design of experiments. Bulletin of the American Mathematical Society, 58, 527-535.
11. Ryzhov, I., Powell, W., & Frazier, P. (2012). The knowledge gradient algorithm for a general class of online learning problems. Operations Research, 60, 180-195.
12. Steyvers, M., Lee, M. D., & Wagenmakers, E.-J. (2009). A bayesian analysis of human decision-making on bandit problems. Journal of Mathematical Psychology, 53, 168-179.
13. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, MA: MIT Press.
14. Yu, A. J., & Cohen, J. D. (2009). Sequential effects: Superstition or rational behavior? In Advances in neural information processing systems (Vol. 21, p. 1873-1880). Cambridge, MA.: MIT Press.
15. Zhang, S., & Lee, M. D. (2010). Cognitive models and the wisdom of crowds. In N. Taatgen & H. van Rijn (Eds.), Proceedings of the 32th annual conference of the cognitive science society. Austin, TX.