Distributed optimization in adaptive networks

Advances in Neural Information Processing Systems

Volumn , Issue , 2004, Pages

  Moallemi, Ciamac C ^a   Van Roy, Benjamin ^a  

^a Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION; GRADIENT METHODS; LEARNING ALGORITHMS; MARKOV PROCESSES; MOBILE DEVICES; ORDINARY DIFFERENTIAL EQUATIONS; SENSOR NETWORKS;

AGGREGATE PERFORMANCE; DISTRIBUTED COMMUNICATIONS; DISTRIBUTED OPTIMIZATION; ELECTRONIC COMPONENT; LOCAL COMMUNICATIONS; MARKOV DECISION PROCESSES; PERFORMANCE OBJECTIVE; POLICY GRADIENT METHODS;

OPTIMIZATION;

EID: 33746360402     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (9)

1. P. L. Bartlett and J. Baxter. Stochastic Optimization of Controlled Markov Decision Processes. In IEEE Conference on Decision and Control, pages 124-129, 2000.
2. P. L. Bartlett and J. Baxter. Estimation and Approximation Bounds for Gradient-Based Reinforcement Learning. Journal of Computer and System Sciences, 64:133-150, 2002.
3. J. Baxter and P. L. Bartlett. Infinite-Horizon Gradient-Based Policy Search. Journal of Artificial Intelligence Research, 15:319-350, 2001.
4. J. Baxter, P. L. Bartlett, and L.Weaver. Infinite-Horizon Gradient-Based Policy Search: II. Gradient Ascent Algorithms and Experiments. Journal of Artificial Intelligence Research, 15:351-381, 2001.
5. T. Jaakkola, S. P. Singh, and M. I. Jordan. Reinforcement Learning Algorithms for Partially Observable Markov Decision Problems. In Advances in Neural Information Processing Systems 7, pages 345-352, 1995.
6. H. J. Kushner and G. Yin. Stochastic Approximation Algorithms and Applications. Springer- Verlag, New York, NY, 1997.
7. P. Marbach, O. Mihatsch, and J.N. Tsitsiklis. Call Admission Control and Routing in Integrated Service Networks. In IEEE Conference on Decision and Control, 1998.
8. P. Marbach and J.N. Tsitsiklis. Simulation-Based Optimization of Markov Reward Processes. IEEE Transactions on Automatic Control, 46(2):191-209, 2001.
9. C. C. Moallemi and B. Van Roy. Appendix to NIPS Submission. URL: Http://www.moallemi.com/ciamac/papers/nips-2003-appendix.pdf, 2003.