Decomposition by partial linearization: Parallel optimization of multi-agent systems

IEEE Transactions on Signal Processing

Volumn 62, Issue 3, 2014, Pages 641-655

  Scutari, Gesualdo ^a   Facchinei, Francisco ^b   Song, Peiran ^a   Palomar, Daniel P ^c   Pang, Jong Shi ^d  

^a State University of New York   (United States)

^b SAPIENZA UNIVERSITY OF ROME   (Italy)

^c HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^d University of Southern California   (United States)

Author keywords

Nonconvex multi agent problems; parallel and distributed optimization; successive convex approximation

Indexed keywords

DISTRIBUTED OPTIMIZATION; GRADIENT ALGORITHM; MULTI-AGENT PROBLEMS; OPTIMIZATION PROBLEMS; PARALLEL OPTIMIZATION; PARTIAL LINEARIZATION; SPECIFIC PROBLEMS; SUCCESSIVE CONVEX APPROXIMATIONS;

ALGORITHMS; FUNCTIONS; ITERATIVE METHODS; MULTI AGENT SYSTEMS;

OPTIMIZATION;

EID: 84893409470     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2013.2293126     Document Type: Article

References (45)

1. G. Scutari,D.P. Palomar, F. Facchinei, and J.-S.Pang, "Distributed dynamic pricing for MIMO interfering multiuser systems: A unified approach," in Proc. Int. Conf. NETwork Games, COntrol, OPtimiz. (Net-GCooP 2011), Paris, France, Oct. 2011, pp. 12-14.
2. D. P. Palomar and M. Chiang, "Alternative distributed algorithms for network utility maximization: Framework and applications," IEEE Trans. Autom. Control, vol. 52, no. 12, pp. 2254-2269, Dec. 2007.
3. M. Chiang, S. H. Low, A. R. Calderbank, and J. C. Doyle, "Layering as optimization decomposition: A mathematical theory of network architectures," Proc. IEEE, vol. 95, no. 1, pp. 255-312, Jan. 2007.
4. D. P. Bertsekas and J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods, 2nd ed. Belmont, MA, USA: Athena Scientific Press, 1989.
5. Z.-Q. Luo and S. Zhang, "Spectrum management: Complexity and duality," IEEE J. Sel. Topics Signal Process., vol. 2, no. 1, pp. 57-72, Feb. 2008.
6. M. Hong and Z.-Q. Luo, "Signal processing and optimal resource allocation for the interference channel," in Library in Signal Processing. New York: Academic Press, 2013, vol. 2, Communications and Radar Signal Processing, ch. 8, pp. 409-462.
7. W. Yu,G.Ginis, and J. M. Cioffi, "Distributed multiuser power control for digital subscriber lines," IEEE J. Sel. Areas Commun., vol. 20, no. 5, pp. 1105-1115, Jun. 2002. (Pubitemid 34789883)
8. Z.-Q. Luo and J.-S. Pang, "Analysis of iterative waterfilling algorithm for multiuser power control in digital subscriber lines," EURASIP J. Appl. Signal Process., vol. 2006, pp. 1-10, May 2006.
9. G. Scutari, D. P. Palomar, and S. Barbarossa, "Optimal linear precoding strategies for wideband noncooperative systems based on game theory-Part I: Nash equilibria and distributed algorithms," IEEE Trans. Signal Process., vol. 56, no. 3, pp. 1230-1267, Mar. 2008.
10. G. Scutari, D. P. Palomar, and S. Barbarossa, "Asynchronous iterative water-filling for Gaussian frequency-selective interference channels," IEEE Trans. Inf. Theory, vol. 54, no. 7, pp. 2868-2878, Jul. 2008.
11. R. Cendrillon, J. Huang, M. Chiang, and M. Moonen, "Autonomous spectrum balancing for digital subscriber lines," IEEE Trans. Signal Process., vol. 55, no. 8, pp. 4241-4257, Aug. 2007. (Pubitemid 47263358)
12. G. Scutari, D. P. Palomar, and S. Barbarossa, "Competitive design of multiuserMIMOsystems based on game theory:Aunified view," IEEE J. Sel. Areas Commun., vol. 26, no. 7, pp. 1089-1103, Sep. 2008.
13. G. Scutari, D. P. Palomar, and S. Barbarossa, "The MIMO iterative waterfilling algorithm," IEEE Trans. Signal Process., vol. 57, no. 5, May 2009.
14. G. Scutari and D. P. Palomar, "MIMO cognitive radio: A game theoretical approach," IEEE Trans. Signal Process., vol. 58, no. 2, pp. 761-780, Feb. 2010.
15. E. Larsson, E. Jorswieck, J. Lindblom, and R. Mochaourab, "Game theory and the flat-fading Gaussian interference channel," IEEE Signal Process. Mag., vol. 26, no. 5, pp. 18-27, Sep. 2009.
16. A. Leshem and E. Zehavi, "Game theory and the frequency selective interference channel," IEEE Signal Process. Mag., vol. 26, no. 5, pp. 28-40, Sep. 2009.
17. F. Facchinei and J.-S. Pang, Finite-Dimensional Variational Inequalities and Complementarity Problem. New York, NY, USA: Springer-Verlag, 2003.
18. J.-S. Pang, G. Scutari, D. P. Palomar, and F. Facchinei, "Design of cognitive radio systems under temperature-interference constraints: A variational inequality approach," IEEE Trans. Signal Process., vol. 58, no. 6, pp. 3251-3271, Jun. 2010.
19. G. Scutari, D. Palomar, F. Facchinei, and J.-S. Pang, "Flexible design of cognitive radio wireless systems: From game theory to variational inequality theory," IEEE Signal Process. Mag., vol. 26, no. 5, pp. 107-123, Sep. 2009.
20. G. Scutari, D. Palomar, F. Facchinei, and J.-S. Pang, "Convex optimization, game theory, and variational inequality theory in multiuser communication systems," IEEE Signal Process. Mag., vol. 27, no. 3, pp. 35-49, May 2010.
21. J. Huang, R. Berry, and M. L. Honig, "Distributed interference compensation for wireless networks," IEEE J. Sel. Areas Commun., vol. 24, no. 5, pp. 1074-1084, May 2006.
22. F.Wang, M. Krunz, and S. Cui, "Price-based spectrum management in cognitive radio networks," IEEE J. Sel. Topics Signal Process., vol. 2, no. 1, pp. 74-87, Feb. 2008. (Pubitemid 351392289)
23. D. Schmidt, C. Shi, R. Berry, M. Honig, andW. Utschick, "Distributed resource allocation schemes: Pricing algorithms for power control and beamformer design in interference networks," IEEE Signal Process. Mag., vol. 26, no. 5, pp. 53-63, Sep. 2009.
24. S.-J.Kim and G. B.Giannakis, "Optimal resource allocation forMIMO ad hoc cognitive radio networks," IEEE Trans. Inf. Theory, vol. 57, no. 5, pp. 3117-3131, May 2011.
25. L. Grippo and M. Sciandrone, "On the convergence of the block nonlinear Gauss-Seidel method under convex constraints," Oper. Res. Lett., vol. 26, no. 3, pp. 127-136, Apr. 2000. (Pubitemid 30564332)
26. S. Ye and R. S. Blum, "Optimized signaling for MIMO interference systems with feedback," IEEE Trans. Signal Process., vol. 51, no. 11, pp. 2839-2848, Nov. 2003.
27. M. Chiang, C. W. Tan, D. P. Palomar, D. O. Neill, and D. Julian, "Power control by geometric programming," IEEE Trans. Wireless Commun., vol. 6, no. 7, pp. 2640-2651, Jul. 2007.
28. P. Tsiaflakis, M. Diehl, and M. Moonen, "Distributed spectrum management algorithms for multiuser DSL networks," IEEE Trans. Signal Process., vol. 56, no. 10, pp. 4825-4843, Oct. 2008.
29. J. Papandriopoulos and J. S. Evans, "Scale: A low-complexity distributed protocol for spectrum balancing in multiuser DSL networks," IEEE Trans. Inf. Theory, vol. 55, no. 8, pp. 3711-3724, Aug. 2009.
30. Q. Shi, M. Razaviyayn, Z.-Q. Luo, and C. He, "An iteratively weighted MMSE approach to distributed sum-utility maximization for a MIMO interfering broadcast channel," IEEE Trans. Signal Process., vol. 59, no. 9, pp. 4331-4340, Sep. 2011.
31. C. Shi, D. A. Schmidt, R. A. Berry, M. L. Honig, and W. Utschick, "Distributed interference pricing for the MIMO interference channel," presented at the Int. Conf. Commun. (ICC), Princeton, NJ, USA, Jun. 14-18, 2009.
32. B. R. Marks and G. P. Wright, "A general inner approximation algorithm for nonconvex mathematical programs," Oper. Res., vol. 26, no. 2, pp. 681-683, 1978.
33. M. Razaviyayn, M. Hong, and Z.-Q. Luo, "A unified convergence analysis of block successive minimization methods for nonsmooth optimization," Arxiv.org, 2012 [Online]. Available: http://arxiv.org/abs/ 1209.2385v1
34. M. Hong, Q. Li, Y.-F. Liu, and Z.-Q. Luo, "Decomposition by successive convex approximation: a unifying approach for linear transceiver design in interfering heterogenous networks," Arxiv.org, 2012 [Online]. Available: http://arxiv.org/abs/1210.1507v1
35. R. Cendrillon, W. Yu, M. Moonen, J. Verlinden, and T. Bostoen, "Optimal multiuser spectrum balancing for digital subscriber lines," IEEE Trans. Signal Process., vol. 54, no. 5, pp. 922-933, May 2006. (Pubitemid 43792596)
36. D. Bertsekas, Nonlinear Programming, 2nd ed. Belmont,MA, USA: Athena Scientific, 1999.
37. C. Shi, R. Berry, and M. Honig, "Distributed interference pricing for ofdm wireless networks with non-separable utilities," presented at the 42nd Annu. Conf. Inf. Sci. Syst., Princeton, NJ, USA, Mar. 2008.
38. W. Yu, W. Rhee, S. Boyd, and J. Cioffi, "Iterative water-filling for Gaussian vector multiple access channels," IEEE Trans. Inf. Theory, vol. 50, no. 1, pp. 145-151, Jan. 2004.
39. Y. Yang, G. Scutari, and D. Palomar, "Parallel stochastic decomposition algorithms for multi-agent systems," presented at the IEEE Int. Workshop Signal Process. Adv. Wireless Commun. (SPAWC), Darmstadt, Germany, Jun. 16-19, 2013.
40. A. Hjorungnes, Complex-Valued Matrix Derivatives With Applications in Signal Processing and Communications. London, U.K.: Cambridge Univ. Press, 2011.
41. G. Scutari, F. Facchieni, J.-S. Pang, and D. P. Palomar, "Real and complex monotone communication games," IEEE Trans. Inf. Theory, 2013 [Online]. Available: http://arxiv.org/abs/1212.6235, accepted for publication
42. D. P. Palomar and J. Fonollosa, "Practical algorithms for a family of waterfilling solutions," IEEE Trans. Signal Process., vol. 53, no. 2, pp. 686-695, Feb. 2005. (Pubitemid 40181762)
43. P. Song, "Numerical comparison of decomposition algorithms for nonconvex sum-utility problems," Dept. of Elect. Eng., Univ. at Buffalo, the State Univ. of New York, Tech. Rep., 2013 [Online]. Available: http://www.eng.buffalo.edu/~peiranso/SongTechRepNum-CompJan13.pdf
44. 3GPP TR 36.814, [Online]. Available: http://www.3gpp.org/ftp/Specs/ archive/36-serier/36.814
45. B. T. Polyak, Introduction to Optimization. NewYork,NY,USA: Optimization Software, Inc., Publications Div., 1987.