Dynamic stochastic dominance in bandit decision problems

Theory and Decision

Volumn 47, Issue 3, 1999, Pages 267-295

  Magnac, Thierry ^b   Robin, Jean Marc ^a  

^a ECOLE NORMALE SUPÉRIEURE   (France)

^b NONE

Author keywords

Multi armed bandit problems; Stochastic dominance; Stochastic dynamic programing

Indexed keywords

EID: 0009733361     PISSN: 00405833     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1005142630173     Document Type: Article

References (22)

1. Banks, J.S. and Sundaram, R.K. (1992), Denumerable armed bandit problems, Econometrica 60 (5): 1071-1096.
2. Berry, D.A. and Fristedt, B. (1985), Bandit Problems: Sequential Allocation of Experiments, London: Chapman and Hall.
3. Berry, D.A. and Kertz, R.P. (1991), Worth of perfect information in Bernoulli bandits, Adv. Appl. Prob. 23: 1-23.
4. Bikhchandani, S. and Sharma, S. (1990), Optimal search with learning, Working Paper no. 580, Department of Economics, University of California, Los Angeles.
5. Bikhchandani, S., Segal, U. and Sharma, S. (1992), Stochastic dominance under Bayesian learning, Journal of Economic Theory 56(2): 352-377.
6. Billingsley, P. (1986), Probability and Measure, New York: Wiley.
7. Blackwell, D. (1965), Discounted dynamic programming, Ann. Math. Statis. 36: 226-35.
8. DeGroot, M.H. (1970), Optimal Statistical Decisions, New York: McGraw-Hill Book.
9. Fishman, A. (1990), Stochastic dominance in multi sampling environments, Journal of Economic Theory 51: 77-91.
10. Flinn, C. (1986), Wages and job mobility of young workers, Journal of Political Economy 94: S88-S110.
11. Gittins, J.C. (1989), Multi-armed Bandit Allocation Indices, New York: Wiley
12. Gittins, J.C. and Jones, D.M. (1974), A dynamic allocation index for sequential design of experiments, in J. Gani (ed.), Progress in Statistics, Amsterdam: North-Holland, pp. 241-266.
13. Gittins, J.C. and Wang, Y.-G. (1992), The learning component of allocation indices, Annals of Statistics 20(3): 1625-1636.
14. Hadar, J. and Russel, W.R. (1969), Rules for ordering uncertain prospects, The American Economic Review 59: 25-34.
15. Jovanovic, B. (1979), Job-matching and the theory of turnover, Journal of Political Economy 87: 972-990.
16. Kamae, T., Krengel, U. and O'Brien, G.L. (1977), Stochastic inequalities on partially ordered spaces, The Annals of Probability 5: 899-912.
17. Milgrom, P.R. and Weber, R.J. (1982), A theory of auctions and competitive bidding, Econometrica 50: 1089-1122.
18. Miller, R. (1984), Job matching and occupational choice, Journal of Political Economy 92: 1086-1120.
19. Rothschild, M. and Stiglitz, J.E. (1970), Increasing risk, I: A definition, Journal of Economic Theory 2: 225-243.
20. Rothschild, M. (1974), A two-armed bandit theory of market pricing, Journal of Economic Theory 9: 185-202.
21. Russel, W.R. and Seo, T.K. (1989), Representative sets for stochastic dominance rules, in T.B. Fomby and T.K. Seo (eds.), Studies in the Economics of Uncertainty, Berlin: Springer Verlag.
22. Whittle, P. (1982), Optimization over Time, 2 vols, New York: Wiley.