Nonparametric learning rules from bandit experiments: The eyes have it!

Games and Economic Behavior

Volumn 81, Issue 1, 2013, Pages 215-231

  Hu, Yingyao ^a   Kayaba, Yutaka ^b   Shum, Matthew ^b  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Bayesian vs. non Bayesian learning; Belief dynamics; Experiments; Eye tracking; Learning

Indexed keywords

EID: 84879337413     PISSN: 08998256     EISSN: 10902473     Source Type: Journal    
DOI: 10.1016/j.geb.2013.05.003     Document Type: Article

References (60)

1. Ackerberg D. Advertising, learning, and consumer choice in experience good markets: A structural examination. Int. Econ. Rev. 2003, 44:1007-1040.
2. Anderson C. Ambiguity aversion in multi-armed bandit problems. Theory Dec. 2012, 72(1):15-33.
3. Armel K., Rangel A. The impact of computation time and experience on decision values. Amer. Econ. Rev. 2008, 98(2):163-168.
4. Armel K., Beaumel A., Rangel A. Biasing simple choices by manipulating relative visual attention. Judgm. Dec. Making 2008, 3(5):396-403.
5. Bajari P., Hortaçsu A. Are structural estimates of auction models reasonable? Evidence from experimental data. J. Polit. Economy 2005, 113:703-741.
6. Banks J., Olson M., Porter D. An experimental analysis of the bandit problem. Econ. Theory 1997, 10(1):55-77.
7. Bergemann D., Hege U. Venture capital financing, moral hazard, and learning. J. Banking Finance 1998, 22(6):703-735.
8. Boorman E., Behrens T., Woolrich M., Rushworth M. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. Neuron 2009, 62(5):733-743.
9. Brocas, I., Carrillo, J., Wang, S., Camerer, C., 2009. Measuring attention and strategic behavior in games with private information. Mimeo, USC.
10. Brown A.L., Camerer C.F., Lovallo D. To review or not to review? Limited strategic thinking at the box office. Amer. Econ. J. Microecon 2012, 4(2):1-28.
11. Camerer C., Johnson E. Thinking about attention in games: Backward and forward induction. The Psychology of Economic Decisions, vol. 2: Reasons and Choices 2004, I. Brocas, J. Carrillo (Eds.).
12. Camerer C., Johnson E., Rymon T., Sen S. Cognition and framing in sequential bargaining for gains and losses. Frontiers of Game Theory 1993, 27-47.
13. Caplin A., Dean M. Economic insights from 'neuroeconomic' data. Amer. Econ. Rev. 2008, 98(2):169-174.
14. Caplin A., Dean M., Glimcher P., Rutledge R. Measuring beliefs and rewards: A neuroeconomic approach. Quart. J. Econ. 2010, 125:923-960.
15. Chan T., Hamilton B. Learning, private information, and the economic evaluation of randomized experiments. J. Polit. Economy 2006, 114:997-1040.
16. Charness G., Levin D. When optimal choices feel wrong: A laboratory study of Bayesian updating, Complexity, and Affect. Amer. Econ. Rev. 2005, 95:1300-1309.
17. Costa-Gomes M., Crawford V. Cognition and behavior in two-person guessing games: An experimental study. Amer. Econ. Rev. 2006, 96(5):1737-1768.
18. Costa-Gomes M., Crawford V., Broseta B. Cognition and behavior in normal-form games: An experimental study. Econometrica 2001, 69(5):1193-1235.
19. Crawford G., Shum M. Uncertainty and learning in pharmaceutical demand. Econometrica 2005, 73:1137-1174.
20. Crawford V., Iriberri N. Level-k auctions: Can a nonequilibrium model of strategic thinking explain the winner's curse and overbidding in private-value auctions?. Econometrica 2007, 75(6):1721-1770.
21. Edwards W. Conservatism in human information processing. Formal Representation of Human Judgment 1968, 17-52.
22. El-Gamal M., Grether D. Are people Bayesian? Uncovering behavioral strategies. J. Amer. Statistical Assoc. 1995, 90:1137-1145.
23. Erdem T., Keane M. Decision-making under uncertainty: Capturing dynamic brand choice processes in turbulent consumer goods markets. Marketing Sci. 1996, 15:1-20.
24. Gabaix X., Laibson D., Moloche G., Weinberg S. Costly information acquisition: Experimental analysis of a boundedly rational model. Amer. Econ. Rev. 2006, 96(4):1043-1068.
25. Gans N., Knox G., Croson R. Simple models of discrete choice and their performance in bandit experiments. Manufact. Service Operations Manage. 2007, 9(4):383-408.
26. Ghahramani Z. An introduction to hidden Markov models and Bayesian networks. Int. J. Pattern Recogn. Artificial Intel. 2001, 15:9-42.
27. Gillen, B., 2011. Identification and estimation of level-k auctions. Mimeo, Caltech.
28. Gittins J., Jones G. A dynamic allocation index for the sequential design of experiments. Progress in Statistics 1974, North-Holland. J. Gani (Ed.).
29. Goldfarb A., Xiao M. Who thinks about the competition? Managerial ability and strategic entry in US local telephone markets. Amer. Econ. Rev. 2011, 101:3130-3161.
30. Hampton A., Bossaerts P., O'Doherty J. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J. Neurosci. 2006, 26:8360-8367.
31. Hikosaka O., Nakamura K., Nakahara H. Basal ganglia orient eyes to reward. J. Neurophysiol. 2006, 95(2):567.
32. Ho, T., Su, X., 2010. A dynamic level-k model in games. Mimeo, University of California at Berkeley.
33. Hsu M., Bhatt M., Adolphs R., Tranel D., Camerer C. Neural systems responding to degrees of uncertainty in human decision-making. Science 2005, 310(5754):1680-1683.
34. Hsu M., Krajbich I., Zhao C., Camerer C. Neural response to reward anticipation under risk is nonlinear in probabilities. J. Neurosci. 2009, 29(7):2231-2237.
35. Hu Y. Identification and estimation of nonlinear models with misclassification error using instrumental variables: A general solution. J. Econometrics 2008, 144:27-61.
36. Hu Y., Shum M. Nonparametric identification of dynamic models with unobserved state variables. J. Econometrics 2012, 171:32-44.
37. Johnson E., Camerer C., Sen S., Rymon T. Detecting failures of backward induction: Monitoring information search in sequential bargaining. J. Econ. Theory 2002, 104(1):16-47.
38. Jovanovic B. Job matching and the theory of turnover. J. Polit. Economy 1979, 972-990.
39. Kahneman D., Tversky A. Subjective probability: A judgment of representativeness. Cogn. Psychol. 1972, 3(3):430-454.
40. Kawagoe R., Takikawa Y., Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nature Neurosci. 1998, 1:411-416.
41. Knoepfle D., Wang J., Camerer C. Studying learning in games using eye-tracking. J. Europ. Econ. Assoc. 2009, 7(2-3):388-398.
42. Krajbich I., Armel C., Rangel A. Visual fixations and the computation and comparison of value in simple choice. Nature Neurosci. 2010, 13:1292-1298.
43. Kuhnen C., Knutson B. The influence of affect on beliefs, preferences and financial decisions 2008, MPRA Paper 10410. University Library of Munich, Germany.
44. Lauwereyns J., Watanabe K., Coe B., Hikosaka O. A neural correlate of response bias in monkey caudate nucleus. Nature 2002, 418:413-417.
45. Meyer R., Shi Y. Sequential choice under ambiguity: Intuitive solutions to the armed-bandit problem. Manage. Sci. 1995, 41(5):817-834.
46. Miller R. Job matching and occupational choice. J. Polit. Economy 1984, 92:1086-1120.
47. Nyarko Y., Schotter A. An experimental study of belief learning using elicited beliefs. Econometrica 2002, 70:971-1005.
48. Payne J., Bettman J., Johnson E. The Adaptive Decision Maker 1993, Cambridge University Press.
49. Payzan-LeNestour E., Bossaerts P. Risk, unexpected uncertainty, and estimation uncertainty: Bayesian learning in unstable settings. PLoS Computational Biol. 2011, 7(1):1704-1711.
50. Preuschoff K., Bossaerts P., Quartz S. Neural differentiation of expected reward and risk in human subcortical structures. Neuron 2006, 51(3):381-390.
51. Preuschoff K., Hart B.Marius, Einhauser W. Pupil dilation signals surprise: Evidence for noradrenaline's role in decision making. Front. Dec. Neurosci. 2011, 5.
52. Reutskaja E., Nagel R., Camerer C., Rangel A. Search dynamics in consumer choice under time pressure: An eye-tracking study. Amer. Econ. Rev. 2011, 101(2):900-926.
53. Rothschild M. A two-armed bandit theory of market pricing. J. Econ. Theory 1974, 9(2):185-202.
54. Shimojo S., Simion C., Shimojo E., Scheier C. Gaze bias both reflects and influences preference. Nature Neurosci. 2003, 6(12):1317-1322.
55. Sokol-Hessner P., Hsu M., Curley N., Delgado M., Camerer C., Phelps E. Thinking like a trader selectively reduces individuals' loss aversion. Proc. Natl. Acad. Sci. 2009, 106(13):5035.
56. Strahilevitz M., Odean T., Barber B. Once burned, twice shy: How naïve learning, counterfactuals, and regret affect the repurchase of stocks previously sold. J. Marketing Res. 2011, 48:102-120.
57. Sutton R., Barto A. Reinforcement Learning 1998, MIT Press.
58. Wang J., Spezio M., Camerer C. Pinocchio's pupil: Using eyetracking and pupil dilation to understand truth telling and deception in sender-receiver games. Amer. Econ. Rev. 2010, 100(3):984-1007.
59. Weitzman M. Optimal search for the best alternative. Econometrica 1979, 641-654.
60. Wilcox N. Theories of learning in games and heterogeneity bias. Econometrica 2006, 74:1271-1292.