Non-stationary stochastic optimization

Operations Research

Volumn 63, Issue 5, 2015, Pages 1227-1244

  Besbes, Omar ^a   Gur, Yonatan ^b   Zeevi, Assaf ^a  

^a Howard Hughes Medical Institute   (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Minimax regret; Non stationary; Online convex optimization; Stochastic approximation

Indexed keywords

APPROXIMATION THEORY; BUDGET CONTROL; CONVEX OPTIMIZATION; COST FUNCTIONS; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC SYSTEMS;

ACHIEVABLE PERFORMANCE; CHANGING ENVIRONMENT; MINIMAX REGRET; NONSTATIONARY; ONLINE CONVEX OPTIMIZATIONS; STOCHASTIC APPROXIMATIONS; STOCHASTIC OPTIMIZATION PROBLEMS; STOCHASTIC OPTIMIZATIONS;

STRUCTURAL OPTIMIZATION;

EID: 84947997582     PISSN: 0030364X     EISSN: 15265463     Source Type: Journal    
DOI: 10.1287/opre.2015.1408     Document Type: Article

References (33)

1. Agarwal A, Dekel O, Xiao L (2010) Optimal algori thms for online convex optimization with multi-point bandit feedback. Proc. 23rd Ann. Conf. Learn. Theory, COLT '10 (Omnipress, Madison, WI), 28-40.
2. Agarwal A, Foster DP, Hsu D, Kakade SM, Rakhlin A (2013) Stochastic convex optimization with bandit feedback. SIAM J. Optim. 23:213-240.
3. Araman VF, Caldentey R (2011) Revenue management with incomplete demand information. Cochran JJ, Cox, Jr. LA, Keskinocak P, Kharoufeh JP, Smith JC, eds. Wiley Encyclopedia Operations Research and Management Science (John Wiley & Sons, Hoboken, NJ), 1-17.
4. Ben-Tal A, Nemirovski A (1998) Robust convex optimization. Math. Oper. Res. 23(4):769-805.
5. Benveniste A, Priouret P, Metivier M (1990) Adaptive Algorithms and Stochastic Approximations (Springer, New York).
6. Bertsimas D, Brown DB, Caramanis C (2011) Theory and applications of robust optimization. SIAM Rev. 53:464-501.
7. Besbes O, Muharremoglu A (2013) On implications of demand censoring in the newsvendor problem. Management Sci. 59(6):1407-1424.
8. Besbes O, Zeevi A (2011) On the minimax complexity of pricing in a changing environment. Oper. Res. 59(1):66-79.
9. Blackwell D (1956) An analog of the minimax theorem for vector payoffs. Pacific J. Math. 6:1-8.
10. Broder J, Rusmevichientong P (2012) Dynamic pricing under a general parametric choice model. Oper. Res. 60(4):965-980.
11. Cesa-Bianchi N,Lugosi G 2006) Prediction, Learning, and Games (Cambridge University Press Cambridge, UK).
12. Cope EW (2009) Regret and convergence bounds for a class of continuumarmed bandit problems. IEEE Trans. Automatic Control 54: 1243-1253.
13. den Boer A, Zwart B (2014) Simultaneously learning and optimizing using controlled variance pricing. Management Sci. 60(3):770-783.
14. Flaxman AD, Kalai AT, McMahan HB (2005) Online convex optimization in the bandit setting: Gradient descent without gradient. Proc. Sixteenth Ann. ACM-SIAM Sympos. Discrete Algorithms (S IAM, Philadelphia), 385-394.
15. Hannan J (1957) Approximation to Bayes risk in repeated play. Contubotions to the Theory of Games, Vol. 3 (Princeton University Press, Princeton, NJ), 97-139.
16. Haykin SS (2001) Kalman Filtering and Neural Networks (John Wiley & Sons, New York).
17. Hazan E, Kale S (2010) Extracting certainty from uncertainty: Regret bounded by variation in costs. Machine Learn. 80:165-188.
18. Hazan E, Kale S (2011) Beyond the regret minimization barrier: An optimal algorithm for stochastic strongly-convex optimization. J. Machine Learn. Res. Proceedings Track 19:421-436.
19. Hazan E, Agarwal A, Kale S (2007) Logarithmic regret algorithms for online convex optimization. Machine Learn. 69:169-192.
20. Huh WT, Rusmevichientong P (2009) A non-parametric asymptotic analysis of inventory planning with censored demand. Math. Oper. Res. 34(1):103-123.
21. Kalai A, Vempala S (2003) Efficient algorithms for online decision problems. Learning Theory and Kernel Machines (Springer, Berlin), 26-40.
22. Kalman RE (1960) A new approach to linear filtering and prediction problems. J. Fluids Engrg. 81:35-45.
23. Keller G, Rady S (1999) Optimal experimentation in a changing environment. Rev. Econom. Stud. 66:475-507.
24. Keskin BN, Zeevi A (2014) Dynamic pricing with an unknown demand model: Asymptotically optimal semi-myopic policies. Oper. Res. 62(5):1142-1167.
25. Kiefer J, Wolfowitz J (1952) Stochastic estimation of the maximum of a regression function. Ann. Math. Statist. 23:462-466.
26. Kleinberg RD (2004) Nearly tight bounds for the continuum-Armed bandit problem. Saul L, Weiss Y, Bottou L, eds. Adv. Neural Inform. Processing Systems 17 (MIT Press, Cambridge, MA), 697-704.
27. Kushner HJ, Yin GG ( 2003) Stochastic Approximation and Recursive Algorithms and Applications (Springer, New York).
28. Lai TL (2003) Stochastic approximation. Ann. Statist. 31:391-406.
29. McMahan HB, Blum A (2004 ) Online geometric optimization in the bandit setting against an adaptive adversary. Learning Theory (Springer, Berlin), 109-123.
30. Nemirovski A, Yudin D (1983) Problem Complexity and Method Efficiency in Optimization (John Wiley & Sons, New York).
31. Robbins H, Monro S (1951) A stochastic approximatiom method. Ann. Math. Statist. 22:400-407.
32. Tsybakov AB 2008) Introduction to Nonparametric Estimation Springer New York).
33. Zinkevich M (2003) Online convex programming and generalized infinitesimal gradient ascent. 20th Internat. Conf. Machine Learn. (AAAI, Palo Alto, CA), 928-936.