Simple models of discrete choice and their performance in bandit experiments

Manufacturing and Service Operations Management

Volumn 9, Issue 4, 2007, Pages 383-408

  Gans, Noah ^a   Knox, George ^b   Croson, Rachel ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b TILBURG UNIVERSITY   (Netherlands)

Author keywords

Decision making under uncertainty; Discrete choice models; Experimental tests; Multiarmed bandit; Service quality

Indexed keywords

DECISION-MAKING UNDER UNCERTAINTY; DISCRETE-CHOICE MODELS; EXPERIMENTAL TESTS; MULTIARMED BANDIT; SERVICE QUALITY;

DECISION MAKING;

EID: 61549113484     PISSN: 15234614     EISSN: 15265498     Source Type: Journal    
DOI: 10.1287/msom.1060.0130     Document Type: Article

References (44)

1. Allison, P. D. 1982. Discrete-time methods for the analysis of event histories. Social. Methodology 13 61-98.
2. Anderson, C. M. 2001. Behavioral models of strategies in multiarmed bandit problems. Ph.D. dissertation, California Institute of Technology, Pasadena, CA.
3. Anderson, S. P., A. de Palma, J.-F. Thisse. 1992. Discrete Choice Theory of Product Differentiation. MIT Press, Cambridge, MA.
4. Banks, J., M. Olson, D. Porter. 1997. An experimental analysis of the bandit problem. Econom. Theory 10 55-77.
5. Brezzi, M., T. L. Lai. 2002. Optimal learning and experimentation in bandit experiments. J. Econom. Dynam. Control 27 87-108.
6. Brown, R. G., R. F. Meyer. 1961. The fundamental thoerem of exponential smoothing. Oper. Res. 9 673-687.
7. Burns, B. D., B. Corpus. 2004. Randomness and inductions from streaks: "gambler's fallacy" versus "hot hand." Psychonomic Bull. Rev. 11179-184.
8. Bush, R. R., F. Mosreller. 1955. Stochastic Models for Learning. Wiley, New York.
9. Camerer, C. F., T.-H. Ho. 1999. Experience-weighted attraction learning in normal form games. Econometrica 67 827-874.
10. Camerer, C. F., R. M. Hogarth. 1999. The effects of financial incentives in experiments: A review and capital-labor-production framework. J. Risk Uncertainty 19 7-42.
11. Chang, F., T. L. Lai. 1987. Optimal stopping and dynamic allocation. Adv. Appl. Probab. 19 829-853.
12. Erdem, T., M. P. Keane. 1996. Decision-making under uncertainty: Capturing dynamic brand choice processes in turbulent consumer goods markets. Marketing Sci. 15 1-20.
13. Erev, I., A. Roth. 1998. Predicting how people play games: Reinforcement learning in experimental games with unique mixedstrategy equilibria. Amer. Econom. Rev. 88 848-879.
14. Friedman, D., S. Sunder. 1994. Experimental Methods: A Primer for Economists. Cambridge University Press, Cambridge, UK.
15. Gans, N. 2002a. Customer loyalty and supplier quality competition. Management Sci. 48 207-221.
16. Gans, N. 2002b. Service quality, switching costs and their effect on customer retention. Working paper, The Wharton School, OPIM Department, University of Pennsylvania, Philadelphia, PA.
17. Gaur, V., Y.-H. Park. 2003. Asymmetric consumer learning and inventory competition. Management Sci. Forthcoming.
18. Gilboa, I., A. Pazgal. 2001. Cumulative discrete choice. Marketing Lett. 12 119-130.
19. Gilovich, T., R. Vallone, A. Tversky. 1985. The hot hand in basketball: On the misperception of random sequences. Cognitive Psych. 17 295-314.
20. Gittins, J. C. 1979. Bandit processes and dynamic allocation indices. J. Roy. Statist. Soc. B41 148-177.
21. Gittins, J. C. 1989. Multi-Armed Bandit Allocation Indices. John Wiley & Sons, Chichester, UK.
22. Gittins, J. C., D. M. Jones. 1974. A dynamic allocation index for the sequential design of experiments. J. Gani et al., eds. Progress in Statistics. North-Holland Publishing Company, Amsterdam, The Netherlands, 241-266.
23. Guadagni, P. M., J. D. C. Little. 1983. A logit model of brand choice calibrated on scanner data. Marketing Sci. 2 203-238.
24. Hall, J., E. Porteus. 2000. Customer service competition in capacitated systems. Manufacturing Service Oper. Management 2 144-165.
25. Harless, D. W., C. F. Camerer. 1994. The predictive utility of generalized expected utility theories. Econometrica 62(6) 1251-1289.
26. Harrison, G. W. 1989. Theory and misbehavior of first-price auctions. Amer. Econom. Rev. 79 749-762.
27. Henderson, P. W., R. A. Peterson. 1992. Mental accounting and categorization. Organ. Behav. Human Decision Processes 51 92-117.
28. Horowitz, A. D. 1973. Experimental study of the two-armed bandit problem. Ph.D. dissertation, University of North Carolina, Chapel Hill, NC.
29. Houser, D., M. Keane, K. McCabe. 2004. Behavior in a dynamic decision problem: An analysis of experimental evidence using a Bayesian type classification algorithm. Econometrica 72 781-822.
30. Hutchinson, J. W., R. J. Meyer. 1994. Dynamic decision making: Optimal policies and actual behavior in sequential choice problems. Marketing Lett. 5 369-382.
31. Jones, T., E. W. Sasser, Jr. 1995. Why satisfied customers defect. Harvard Bus. Rev. 73(6) 88-99.
32. Kahneman, D., A. Tversky. 1973. On the psychology of prediction. Psych. Rev. 80 237-251.
33. Kass, R. E., A. E. Raftery. 1995. Bayes factors. J. Amer. Statist. Assoc. 90 773-795.
34. Lehmann, E. L. 1975. Nonparametrics: Statistical Methods Based on Ranks. Holden-Day, San Francisco, CA.
35. March, J. G. 1996. Learning to be risk averse. Psych. Rev. 103 309-319.
36. Matsuda, T., M. Sekiguchi. 1971. Models of human forecasting behavior: A note on the relationship between exponential smoothing and the Bayesian method. J. Oper. Res. Soc. Japan 13 136-154.
37. Meyer, R. J., Y. Shi. 1995. Sequential choice under ambiguity: Intuitive solutions to the armed-bandit problem. Management Sci. 41 817-834.
38. Miller, G. A. 1956. The magical number seven, plus or minus two: Some limits on our capacity to process information. Psych. Rev. 63 81-89.
39. Robbins, D., P. L. Warner. 1973. Individual organism probability matching with rats in a two-choice task. Bull. Psychonomic Soc. 2 405-407.
40. Roth, A. E. 1988. Laboratory experimentation in economics: A methodological overview. Econom. J. 98 974-1031.
41. Schmalensee, R. 1975. Alternative models of bandit selection. J. Econom. Theory 10 333-342.
42. Simon, H. A. 1959. Theories of decision-making in economics and behavioral science. Amer. Econom. Rev. 49 253-283.
43. Sutton, R. S., A. G. Barto. 1998. Reinforcement Learning: An Introduction. MIT Press, Cambridge, MA.
44. Tversky, A., D. Kahneman. 1974. Judgment under uncertainty: Heuristics and biases. Science 185 1124-1131.