Paradoxes in learning and the marginal value of information

Decision Analysis

Volumn 7, Issue 4, 2010, Pages 378-403

  Frazier, Peter I ^a   Powell, Warren B ^b  

^a Cornell University   (United States)

^b Princeton University   (United States)

Author keywords

Bayesian analysis; Design of experiments; Sequential decision analysis; Value of information

Indexed keywords

EID: 78651309095     PISSN: 15458490     EISSN: 15458504     Source Type: Journal    
DOI: 10.1287/deca.1100.0190     Document Type: Article

References (55)

1. Berger, J. O., J. Deely. 1988. A Bayesian approach to ranking and selection of related means with alternatives to analysis-ofvariance methodology. J. Amer. Statist. Assoc. 83(402) 364-373.
2. Bickel, J. E. 2008. The relationship between perfect and imperfect information in a two-action risk-sensitive problem. Decision Anal. 5(3) 116-128.
3. Bickel, J. E., J. E. Smith. 2006. Optimal sequential exploration: A binary learning model. Decision Anal. 3(1) 16-32.
4. Bickel, J. E., R. Gibson, D. McVay, S. Pickering, J. Waggoner. 2008. Quantifying the reliability and value of 3D land seismic. SPE Reservoir Evaluation Engrg. 11(5) 832-841.
5. Bilgic, M., L. Getoor. 2007. VOILA: Efficient feature-value acquisition for classification. Proc. Natl. Conf. Artificial Intelligence, AAAI Press, Menlo Park, CA, 1225-1230.
6. Boyd, S., L. Vandenberghe. 2004. Convex Optimization. Cambridge University Press, Cambridge, UK.
7. Bratvold, R., J. E. Bickel, H. P. Lohne. 2007. Value of information in the oil and gas industry: Past, present, and future. SPE Annual Technical Conf. Exhibition, Society of Petroleum Engineers, Richardson, TX.
8. Chade, H., E. Schlee. 2002. Another look at the Radner-Stiglitz nonconcavity in the value of information. J. Econom. Theory 107(2) 421-452.
9. Chen, C. H. 1995. An effective approach to smartly allocate computing budget for discrete event simulation. IEEE Conf. Decision Control, 34th, New Orleans, IEEE, Piscataway, NJ, 2598-2603.
10. Chen, C. H. 1996. A lower bound for the correct subset-selection probability and its application to discrete-event system simulations. IEEE Trans. Automatic Control 41(8) 1227-1231.
11. Chen, C. H., L. Dai, H. C. Chen. 1996. A gradient approach for smartly allocating computing budget for discrete event simulation. J. M. Charnes, D. J. Morrice, D. T. Brunner, J. J. Swain, eds. Proc. 1996 Winter Simulation Conf., IEEE, Piscataway, NJ, 398-405.
12. Chen, C. H., J. Lin, E. Yücesan, S. E. Chick. 2000b. Simulation budget allocation for further enhancing the efficiency of ordinal optimization. Discrete Event Dynam. Systems 10(3) 251-270.
13. Chen, H. C., C. H. Chen, E. Yucesan. 2000a. Computing efforts allocation for ordinal optimization and discrete event simulation. Automatic Control, IEEE Trans. 45(5) 960-964.
14. Chen, H. C., L. Dai, C. H. Chen, E. Yücesan. 1997. New development of optimal computing budget allocation for discrete event simulation. Proc. 1997 Winter Simulation Conf., IEEE, Piscataway, NJ, 334-341.
15. Chick, S. E., P. I. Frazier. 2009a. The conjunction of the knowledge gradient and the economic approach to simulation selection. Proc. 2009 Winter Simulation Conf., IEEE, Piscataway, NJ, 528-539.
16. Chick, S. E., P. I. Frazier. 2009b. Sequential sampling for selection: The discounted case. INSEAD, Fontainebleau, France.
17. Chick, S. E., N. Gans. 2009. Economic analysis of simulation selection problems. Management Sci. 55(3) 421-437.
18. Chick, S. E., K. Inoue. 2001. New two-stage and sequential procedures for selecting the best simulated system. Oper. Res. 49(5) 732-743. (Pubitemid 34011324)
19. Chick, S. E., J. Branke, C. Schmidt. 2007. New greedy myopic and existing asymptotic sequential selection procedures: Preliminary empirical results. Proc. 2007 Winter Simulation Conf., IEEE, Piscataway, NJ, 289-296.
20. Chick, S. E., J. Branke, C. Schmidt. 2010. Sequential sampling to myopically maximize the expected value of information. INFORMS J. Comput. 22(1) 71-80.
21. DeGroot, M. H. 1970. Optimal Statistical Decisions. McGraw Hill, New York.
22. De Lara, M., L. Gilotte. 2007. A tight sufficient condition for Radner-Stiglitz nonconcavity in the value of information. J. Econom. Theory 137(1) 696-708.
23. Delquié, P. 2008. The value of information and intensity of preference. Decision Anal. 5(3) 129-139.
24. Fatti, L. P., A. Mehrez, M. Pachter. 1987. Bounds and properties of the expected value of sample information for a projectselection problem. Naval Res. Logist. 34(1) 141-150.
25. Frazier, P. I., W. B. Powell. 2009. Consistency of sequential Bayesian sampling policies. Working paper, Cornell University Ithaca, NY.
26. Frazier, P. I., W. B. Powell, S. Dayanik. 2008. A knowledge gradient policy for sequential information collection. SIAM J. Control Optim. 47(5) 2410-2439.
27. Goel, A., S. Khanna, B. Null. 2009. The ratio index for budgeted learning, with applications. Proc. Twentieth Annual ACM-SIAM Sympos. Discrete Algorithms, Society for Industrial and Applied Mathematics, Philadelphia, 18-27.
28. Guha, S., K. Munagala. 2007. Approximation algorithms for budgeted learning problems. Proc. 39th Annual ACM Sympos. Theory Comput., ACM, New York, 104-113.
29. Gupta, S. S., K. J. Miescke. 1996. Bayesian look ahead one-stage sampling allocations for selection of the best population. J. Statist. Planning Inference 54(2) 229-244.
30. Guttman, I., G. C. Tiao. 1964. A Bayesian approach to some best population problems. Ann. Math. Statist. 35(2) 825-835.
31. He, D. H., S. E. Chick, C. H. Chen. 2007. Opportunity cost and OCBA selection procedures in ordinal optimization for a fixed number of alternative systems. IEEE Trans. Systems Man Cybernetics C 37(5) 951-961.
32. Heckerman, D., E. Horvitz, B. Middleton. 1993. An approximate nonmyopic computation for value of information. IEEE Trans. Pattern Anal. Machine Intelligence 15(3) 292-298.
33. Howard, R. A. 1966. Information value theory. IEEE Trans. Systems Sci. Cybernetics 2(1) 22-26.
34. Kaelbling, L. P., M. L. Littman, A. R. Cassandra. 1998. Planning and acting in partially observable stochastic domains. Artificial Intelligence 101 (1-2) 99-134.
35. Kapoor, A., R. Greiner. 2005. Learning and classifying under hard budgets. 16th Eur. Conf. Machine Learn., Springer-Verlag New York, 170-181.
36. Keisler, J. 2004. Value of information in portfolio decision analysis. Decision Anal. 1(3) 177-189.
37. Krause, A., C. Guestrin. 2005. Optimal nonmyopic value of information in graphical models-efficient algorithms and theoretical limits. L. P. Kaelbling, A. Saffiotti, eds. Proc. 19th Internat. Joint Conf. Artificial Intelligence, Morgan Kaufmann, San Francisco, 1339-1345.
38. Laplace, P. S. 1820. Théorie Analytique Des Probabilités. M. V. Courcier, Paris.
39. Lizotte, D. J., O. Madani, R. Greiner. 2003. Budgeted learning of naive-Bayes classifiers. C. Meek, U. Kjærulff, eds. Proc. 19th Conf. Uncertainty Artificial Intelligence, Morgan Kaufmann, San Francisco, 378-385.
40. Mattsson, L. G., M. Voorneveld, J. W. Weibull. 2004. Informationconstrained discrete choice. Working Paper 558, EFI-The Economic Research Institute, Stockholm School of Economics, Stockholm.
41. Mehrez, A., A. P. Sethi. 1989. Hierarchical planning of projectselection problems with information purchasing. J. Oper. Res. Soc. 40(3) 267-279.
42. Mehrez, A., A. Stulman. 1984. A note on capital budgeting in the purchase of information. Managerial Decision Econom. 5(4) 251-254.
43. Merrick, J. R. W. 2009. Bayesian simulation and decision analysis: An expository survey. Decision Anal. 6(4) 222-238.
44. Moscarini, G., L. Smith. 2002. The law of large demand for information. Econometrica 70(6) 2351-2366.
45. Radner, R., J. Stiglitz. 1984. A nonconcavity in the value of information. Bayesian Models Econom. Theory 5, 33-52.
46. Raiffa, H., R. Schlaifer. 1968. Applied Statistical Decision Theory. MIT Press, Cambridge, MA.
47. Ross, A. M. 2003. Useful bounds on the expected maximum of correlated normal random variables. Working paper 03W-004, Industrial and Systems Engineering, Lehigh University, Bethlehem, PA.
48. Ruben, H. 1963. A convergent asymptotic expansion for Mill's ratio and the normal probability integral in terms of rational functions. Math. Annalen 151(4) 355-364.
49. Samson, D., A. Wirth, J. Rickard. 1989. The value of information from multiple sources of uncertainty in decision analysis. Eur. J. Oper. Res. 39(3) 254-260.
50. Schwartz, B. 2004. The Paradox of Choice: Why More Is Less. Harper Perennial, New York.
51. Stigler, G. J. 1961. The economics of information. J. Political Econom. 69(3) 213-225.
52. Tiao, G. C., B. Afonja. 1976. Some Bayesian considerations of the choice of design for ranking, selection and estimation. Ann. Inst. Statist. Math. 28(1) 167-185.
53. Tolpin, D., S. E. Shimony. 2009. Semi-myopic sensing plans for value optimization. Arxiv preprint June 17, arXiv:0906.3149.
54. Weibull, J. W., L. G. Mattsson, M. Voorneveld. 2007. Better may be worse: Some monotonicity results and paradoxes in discrete choice under uncertainty. Theory Decision 63(2) 121-151.
55. Yokota, F., K. M. Thompson. 2004. Value of information literature analysis: A review of applications in health risk management. Medical Decision Making 24(3) 287-298. (Pubitemid 38656313)