Newton-Raphson consensus for distributed convex optimization

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2011, Pages 5917-5922

  Zanella, Filippo ^a   Varagnolo, Damiáno ^a   Cenedese, Angelo ^a   Pillonetto, Gianluigi ^a   Schenato, Luca ^a  

^a UNIVERSITY OF PADOVA   (Italy)

Author keywords

consensus algorithms; convex optimization; distributed optimization; multi agent systems; Newton Raphson methods

Indexed keywords

CONVEX OPTIMIZATION; COST FUNCTIONS; NEWTON-RAPHSON METHOD; NUMERICAL METHODS;

ALTERNATING DIRECTION METHOD OF MULTIPLIERS; CONSENSUS ALGORITHMS; CONVEX COST FUNCTION; DISTRIBUTED OPTIMIZATION; LIMITED COMMUNICATION; MULTI-AGENTS SYSTEMS; RATE OF CONVERGENCE; SUB-GRADIENT METHODS;

MULTI AGENT SYSTEMS;

EID: 84860691049     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2011.6160605     Document Type: Conference Paper

References (39)

1. D. Puccinelli and M. Haenggi, "Wireless sensor networks: applications and challenges of ubiquitous sensing," IEEE Circuits and Systems Magazine, vol. 5, no. 3, pp. 19 - 31, 2005.
2. A. Ipakchi and F. Albuyeh, "Grid of the future - are we ready to transition to a smart grid?" IEEE Power Energy Magazine, vol. 7, no. 2, pp. 52 - 62, 2009.
3. P. J. Huber, Robust statistics. John Wiley & Sons Inc, 2009.
4. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers," Stanford Statistics Dept., Tech. Rep., 2010.
5. J. N. Tsitsiklis, "Problems in decentralized decision making and computation," Ph.D. dissertation, MIT, 1984.
6. D. P. Bertsekas, A. Nedić, and A. E. Ozdaglar, Convex Analysis and Optimization. Athena Scientific, 2003.
7. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge University Press, 2004.
8. D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods. Athena Scientific, 1997.
9. D. P. Bertsekas, Network Optimization: Continuous and Discrete Models. Belmont, Massachusetts: Athena Scientific, 1998.
10. K. C. Kiwiel, "Convergence of approximate and incremental subgradient methods for convex optimization," SIAM J. on Optim., vol. 14, no. 3, pp. 807 - 840, 2004.
11. B. Johansson, "On distributed optimization in networked systems," Ph.D. dissertation, KTH Electrical Engineering, 2008.
12. A. Nedić and D. P. Bertsekas, "Incremental subgradient methods for nondifferentiable optimization," SIAM J. on Optim., vol. 12, no. 1, pp. 109 - 138, 2001.
13. D. Blatt, A. Hero, and H. Gauchman, "A convergent incremental gradient method with a constant step size," SIAM J. on Optim., vol. 18, no. 1, pp. 29 - 51, 2007.
14. S. S. Ram, A. Nedić, and V. Veeravalli, "Incremental stochastic subgradient algorithms for convex optimzation," SIAM J. on Optim., vol. 20, no. 2, pp. 691 - 717, 2009.
15. B. Johansson, M. Rabi, and M. Johansson, "A randomized incremental subgradient method for distributed optimization in networked systems," SIAM J. on Optim., vol. 20, no. 3, pp. 1157 - 1170, 2009.
16. A. Nedić, A. Ozdaglar, and P. A. Parrilo, "Constrained consensus and optimization in multi-agent networks," IEEE TAC, vol. 55, no. 4, pp. 922 - 938, 2010.
17. A. Nedić, "Asynchronous broadcast-based convex optimization over a network," IEEE TAC, vol. PP, no. 99, pp. 1 - 1, 2010.
18. M. Rabbat and R. Nowak, "Distributed optimization in sensor networks," in IPSN, 2004.
19. B. Johansson, T. Keviczky, M. Johansson, and K. H. Johansson, "Subgradient methods and consensus algorithms for solving convex optimization problems," in CDC, December 2008, pp. 4185 - 4190.
20. M. G. Rabbat, R. D. Nowak, and J. A. Bucklew, "Generalized consensus computation in networked systems with erasure links," in Sig. Proc. Advances in Wireless Comm., June 2005, pp. 1088 - 1092.
21. L. Xiao, M. Johansson, and S. Boyd, "Simultaneous routing and resource allocation via dual decomposition," IEEE Trans. on Comm., vol. 52, no. 7, pp. 1136 - 1144, 2004.
22. I. D. Schizas, A. Ribeiro, and G. B. Giannakis, "Consensus in ad hoc WSNs with noisy links - part I: Distributed estimation of deterministic signals," IEEE Trans. on Sig. Proc., vol. 56, pp. 350 - 364, 2008.
23. C. Fischione, "F-Lipschitz optimization with Wireless Sensor Networks applications," IEEE TAC, vol. to appear, pp. -, 2011.
24. C. Fischione and U. Jönsson, "Fast-Lipschitz optimization with Wireless Sensor Networks applications," in IPSN, 2011.
25. J. Van Ast, R. Babška, and B. D. Schutter, "Particle swarms in optimization and control," in IFAC World Congress, 2008.
26. E. Alba and J. M. Troya, "A survey of parallel distributed genetic algorithms," Complexity, vol. 4, no. 4, pp. 31 - 52, 1999.
27. R. O. Saber, J. Fax, and R. Murray, "Consensus and cooperation in multi-agent networked systems," Proceedings of IEEE, vol. 95, no. 1, pp. 215-233, January 2007.
28. F. Garin and L. Schenato, Networked Control Systems. Springer, 2011, ch. A Survey on distributed estimation and control applications using linear consensus algorithms, pp. 75-107.
29. A. Nedić and A. Ozdaglar, "Distributed subgradient methods for multi-agent optimization," IEEE TAC, vol. 54, no. 1, pp. 48 - 61, 2009.
30. -, "On the rate of convergence of distributed subgradient methods for multi-agent optimization," in CDC, 2007.
31. A. Jadbabaie, A. Ozdaglar, and M. Zargham, "A distributed Newton method for network optimization," in CDC, 2009.
32. M. Zargham, A. Ribeiro, A. Ozdaglar, and A. Jadbabaie, "Accelerated dual descent for network optimization," in ACC, 2011.
33. F. Zanella, D. Varagnolo, A. Cenedese, G. Pillonetto, and L. Schenato, "Newton-raphson consensus for distributed convex optimization," http://paduaresearch.cab.unipd.it/, Tech. Rep., 2011.
34. P. Kokotović, H. K. Khalil, and J. O'Reilly, Singular Perturbation Methods in Control: Analysis and Design, ser. Classics in applied mathematics. SIAM, 1999, no. 25.
35. H. K. Khalil, Nonlinear Systems, 3rd ed. Prentice Hall, 2001.
36. L. Xiao, S. Boyd, and S. Lall, "A scheme for robust distributed sensor fusion based on average consensus," in IPSN, 2005, pp. 63-70.
37. S. Bolognani, S. D. Favero, L. Schenato, and D. Varagnolo, "Consensus-based distributed sensor calibration and least-square parameter identification in wsns," International Journal of Robust and Nonlinear Control, vol. 20, no. 2, pp. 176-193, 2010.
38. K. Tanabe, "Global analysis of continuous analogues of the Levenberg-Marquardt and Newton-Raphson methods for solving nonlinear equations," Annals of the Institute of Statistical Mathematics, vol. 37, no. 1, pp. 189-203, 1985.
39. R. Hauser and J. Nedić, "The continuous Newton-Raphson method can look ahead," SIAM J. on Optim., vol. 15, pp. 915 - 925, 2005.