Universal convexification via risk-aversion

Uncertainty in Artificial Intelligence - Proceedings of the 30th Conference, UAI 2014

Volumn , Issue , 2014, Pages 162-171

  Dvijotham, Krishnamurthy ^a   Fazel, Maryam ^a   Todorov, Emanuel ^a  

^a University of Washington   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; DYNAMICAL SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MARKOV PROCESSES; STOCHASTIC SYSTEMS;

CONVEXIFICATION APPROACH; DISCRETE-TIME DYNAMICAL SYSTEMS; GUARANTEED CONVERGENCE; MACHINE LEARNING APPLICATIONS; MARKOV DECISION PROCESSES; OPTIMIZATION PROBLEMS; STANDARD OPTIMIZATION METHOD; STOCHASTIC GRADIENT ALGORITHMS;

OPTIMIZATION;

EID: 84923299173     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Y. F. Atchade, G. Fort, and E. Moulines. On stochastic proximal gradient algorithms. ArXiv e-prints, February 2014.
2. K. Bache and M. Lichman. UCI machine learning repository, 2013. URL http://archive.ics.uci. edu/ml.
3. J. Baxter and P. Bartlett. Infinite-horizon policygradient estimation. Journal of Artificial Intelligence Research, 15:319-350, 2001.
4. Stéphane Boucheron, Gábor Lugosi, and Pascal Massart. Concentration inequalities: A nonasymptotic theory of independence. Oxford University Press, 2013.
5. S. Boyd and L. Vandenberghe. Convex optimization. Cambridge University Press, Cambrdige, UK, 2004.
6. B. Van Den Broek, W. Wiegerinck, and B. Kappen. Risk sensitive path integral control. In Uncertainty in AI, 2010. Proceedings of the 2010, 2010.
7. Sebastian Bubeck. The complexities of optimization, December 2013. URL https: //blogs.princeton.edu/imabandit/2013/04/ 25/orf523-noisy-oracles/.
8. Chih-Chung Chang and Chih-Jen Lin. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2: 27:1-27:27, 2011. Software available at http://www. csie.ntu.edu.tw/~cjlin/libsvm.
9. K. Dvijotham and E. Todorov. A unifying framework for linearly-solvable control. Uncertainty in Artificial Intelligence, 2011.
10. W. Fleming and S. Mitter. Optimal control and nonlinear filtering for nondegenerate diffusion processes. Stochastics, 8:226-261, 1982.
11. H.J. Kappen. Linear theory for control of nonlinear stochastic systems. Physical Review Letters, 95(20): 200201, 2005.
12. Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86 (11):2278-2324, 1998.
13. S.I. Marcus, E. Fernández-Gaucherand, D. Hernández-Hernandez, S. Coraluppi, and P. Fard. Risk sensitive Markov decision processes. Systems and Control in the Twenty-First Century, 29, 1997.
14. Hossein Mobahi. Optimization by Gaussian Smoothing with Application to Geometric Alignment. PhD thesis, University of Illinois at Urbana Champaign, Dec 2012.
15. A. Rangarajan. Generalised graduated non-convexity algorithm for maximum a posterjori image estimation. In Proc. ICPR, pages 127-133, 1990.
16. J Speyer, John Deyst, and D Jacobson. Optimization of stochastic linear systems with additive measurement and process noise using exponential performance criteria. Automatic Control, IEEE Transactions on, 19(4):358-366, 1974.
17. E. Theodorou, J. Buchli, and S. Schaal. Reinforcement learning of motor skills in high dimensions: A path integral approach. In Robotics and Automation (ICRA), 2010 IEEE International Conference on, pages 2397-2403. IEEE, 2010a.
18. Evangelos Theodorou, Jonas Buchli, and Stefan Schaal. A generalized path integral control approach to reinforcement learning. The Journal of Machine Learning Research, 9999:3137-3181, 2010b.
19. E. Todorov. Efficient computation of optimal actions. Proceedings of the National Academy of Sciences, 106(28):11478, 2009.
20. M. Toussaint. Robot trajectory optimization using approximate inference. International Conference on Machine Learning, 26:1049-1056, 2009.