Distributed seeking of nash equilibria with applications to mobile sensor networks

IEEE Transactions on Automatic Control

Volumn 57, Issue 4, 2012, Pages 904-919

  Stanković, Miloš S ^a   Johansson, Karl H ^a   Stipanović, Dušan M ^b  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Convergence; extremum seeking; learning; mobile sensor networks; multi agent control; Nash equilibrium; noncooperative games; stochastic optimization

Indexed keywords

CONVERGENCE; EXTREMUM SEEKING; LEARNING; MOBILE SENSOR NETWORKS; MULTIAGENT CONTROL; NASH EQUILIBRIA; NONCOOPERATIVE GAME; STOCHASTIC OPTIMIZATIONS;

ALGORITHMS; CONTROL THEORY; COST FUNCTIONS; GAME THEORY; STOCHASTIC SYSTEMS; TELECOMMUNICATION NETWORKS; WIRELESS SENSOR NETWORKS;

PROBLEM SOLVING;

EID: 84859722327     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2011.2174678     Document Type: Article

References (50)

1. M. S. Stanković, K. H. Johansson, and D. M. Stipanović, "Distributed seeking of Nash equilibria in mobile sensor networks," in Proc. IEEE Conf. Decision Control, 2010, pp. 5598-5603.
2. J. Nash, "Non-cooperative games," Ann. Math., vol. 54, no. 2, pp. 286-295, 1951.
3. K. Tumer and D. Wolpert, Collectives and the design of complex systems. New York: Springer-Verlag, 2004.
4. D. Monderer and L. S. Shapley, "Potential games," Games Econ. Behav., no. 14, pp. 124-143, 1996.
5. T. Basar and G. J. Olsder, Dynamic Noncooperative Game Theory, 2nd ed. Philadelphia, PA: SIAM, 1999.
6. P. Dubey, "Inefficiency of Nash equilibria," Math. Operat. Res., vol. 11, no. 1, pp. 1-8, Feb. 1986.
7. G. Inalhan, D. M. Stipanović, and C. J. Tomlin, "Decentralized optimization, with application to multiple aircraft coordination," in Proc. IEEE Conf. Decision Control, 2002, pp. 1147-1155.
8. L. Buttyan, J.-P. Hubaux, L. Li, X.-Y. Li, T. Roughgarden, and A. Leon-Garcia, "Guest editorial non-cooperative behavior in networking," IEEE J. Sel. Areas Commun., vol. 25, no. 6, Aug. 2007.
9. T. Roughgarden, "Intrinsic robustness of the price of anarchy," in Proc. STOC '09: 41st ACM Symp. Theory of Comput., New York, pp. 513-522.
10. N. Li and J. R. Marden, "Designing games for distributed optimization," in Proc. IEEE Conf. Decision Control, 2011.
11. S. Li and T. Basar, "Distributed algorithms for the computation of noncooperative equilibria," Automatica, vol. 23, pp. 523-533, 1987.
12. J. S. Shamma and G. Arslan, "Dynamic fictitious play, dynamic gradient play, and distributed convergence to Nash equilibria," IEEE Trans. Autom. Control, vol. 50, no. 3, pp. 312-327, Mar. 2005.
13. J. R. Marden, H. P. Young, G. Arslan, and J. S. Shamma, "Payoff based dynamics for multi-player weakly acyclic games," SIAM J. Control Optim., vol. 48, no. 1, pp. 373-396, 2009.
14. M. Zhu and S. Martinez, "Distributed coverage games for mobile visual sensors (I) : Reaching the set of Nash equilibria," in Proc. IEEE Conf. Decision Control, 2009, pp. 169-174.
15. H. P. Young, "Learning by trial and error," Games Econ. Behav., vol. 65, no. 2, pp. 626-643, 2009.
16. M. Krstic, P. Frihauf, J. Krieger, and T. Basar, "Nash equilibrium seeking with finitely- and infinitely-many players," in Proc. 8th IFAC Symp. Nonlinear Control Syst., 2010.
17. P. Frihauf, M. Krstic, and T. Basar, "Nash equilibrium seeking for dynamic systems with non-quadratic payoffs," in Proc. 14th Int. Symp. Dynamic Games Applicat., 2010.
18. K. B. Ariyur and M. Krstic, Real Time Optimization by Extremum Seeking. Hoboken, NJ: Wiley, 2003.
19. J. Y. Choi, M. Krstic, K. B. Ariyur, and J. S. Lee, "Extremum seeking control for discrete-time systems," IEEE Trans. Autom. Control, vol. 47, no. 2, pp. 318-323, Feb. 2002.
20. Y. Tan, D. Nešić, and I. Mareels, "On non-local stability properties of extremum seeking control," Automatica, vol. 42, pp. 889-903, 2006.
21. M. S. Stanković and D. M. Stipanović, "Stochastic extremum seeking with applications to mobile sensor networks," in Proc. Amer. Control Conf., 2009, pp. 5622-5627.
22. M. S. Stanković and D. M. Stipanović, "Extremum seeking under stochastic noise and applications to mobile sensors," Automatica, vol. 46, pp. 1243-1251, 2010.
23. C. Zhang, A. Siranosian, and M. Krstic, "Extremum seeking for moderately unstable systems and for autonomous vehicle target tracking without position measurements," Automatica, vol. 43, pp. 1832-1839, 2007.
24. M. S. Stanković and D. M. Stipanović, "Discrete time extremum seeking by autonomous vehicles in a stochastic environment," in Proc. IEEE Conf. Decision Control, 2009, pp. 4541-4546.
25. M. Zavlanos, A. Jadbabaie, and G. Pappas, "Flocking while preserving network connectivity," in Proc. IEEE Conf. Decision Control, 2007, pp. 2919-2924.
26. M. Schuresko and J. Cortes, "Distributed motion constraints for algebraic connectivity of robotic networks," J. Intell. Robot. Syst., vol. 56, no. 1-2, pp. 99-126, 2009.
27. D. V. Dimarogonas and K. H. Johansson, "Bounded control of network connectivity in multi-agent systems," IET Control Theory Applicat., vol. 4, no. 8, pp. 1330-1338, 2010.
28. P. Yang, R. Freeman, G. Gordon, K. Lynch, S. Srinivasa, and R. Sukthankar, "Decentralized estimation and control of graph connectivity for mobile sensor networks," Automatica, vol. 46, no. 2, pp. 390-396, 2010.
29. M. Mesbahi and M. Egerstedt, Graph Theoretic Methods in Multiagent Networks. Princeton, NJ: Princeton Univ. Press, 2010.
30. R. Olfati-Saber, J. A. Fax, and R. M. Murray, "Consensus and cooperation in networked multi-agent systems," Proc. IEEE, vol. 95, no. 1, pp. 215-233, Jan. 2007.
31. C. G. Cassandras and W. Li, "Sensor networks and cooperative control," Eur. J. Control, vol. 11, no. 4-5, pp. 436-463, 2005.
32. J. R. Marden, G. Arslan, and J. S. Shamma, "Cooperative control and potential games," IEEE Trans. Syst., Man, Cybern. B, vol. 39, no. 6, pp. 1393-1407, Dec. 2009.
33. H.-B. Dürr, M. S. Stanković, and K. H. Johansson, "Distributed positioning of autonomous mobile sensors with application to coverage control," in Proc. Amer. Control Conf., 2011, pp. 4822-4827.
34. H.-B. Dürr, M. S. Stanković, and K. H. Johansson, "Nash equilibrium seeking in multi-vehicle systems: A Lie bracket approximation-based approach," arXiv:1109.6129v2, 2011.
35. G. M. Hoffmann and C. J. Tomlin, "Mobile sensor network control using mutual information methods and particle filters," IEEE Trans. Autom. Control, vol. 55, no. 1, pp. 32-47, Jan. 2010.
36. A. Ganguli, S. Susca, S. Martinez, F. Bullo, and J. Cortes, "On collective motion in sensor networks: Sample problems and distributed algorithms," in Proc. IEEE Conf. Decision Control, Dec. 2005, pp. 4239-4244.
37. J. Cortes, S. Martinez, T. Karatas, and F. Bullo, "Coverage control for mobile sensing networks," IEEE Trans. Robot. Autom., vol. 20, no. 2, pp. 243-255, Apr. 2004.
38. J. Cortes, S. Martinez, and F. Bullo, "Robust rendezvous for mobile autonomous agents via proximity graphs in arbitrary dimensions," IEEE Trans. Autom. Control, vol. 51, no. 8, pp. 1289-1298, Aug. 2006.
39. B. T. Polyak and Y. Z. Tsypkin, "Pseudogradient algorithms of adaptation and learning," Autom. Remote Control, no. 3, pp. 45-68, 1973.
40. H. F. Chen, Stochastic Approximation and its Applications. Norwell, MA: Kluwer, 2003.
41. H. J. Kushner and D. S. Clark, Stochastic Approximation Methods for Contrained and Unconstrained Systems. New York: Springer, 1978.
42. L. Ljung, "Analysis of recursive stochastic algorithms," IEEE Trans. Autom. Control, vol. AC-22, no. 4, pp. 551-575, Aug. 1977.
43. J. B. Rosen, "Existence and uniqueness of equilibrium points for concave n-person games," Econometrica, vol. 33, no. 3, pp. 520-534, 1965.
44. A. S. Poznyak and D. O. Chikin, "Asymptotic properties of the stochastic approximation procedure with dependent noise," Autom. Remote Control, no. 12, pp. 78-93, 1984.
45. B. T. Polyak, "Convergence and rate of convergence of iterative stochastic algorithms, II linear case," Autom. Remote Control, no. 4, pp. 101-107, 1977.
46. B. T. Polyak, "Convergence and rate of convergence of iterative stochastic algorithms, I general case," Autom. Remote Control, no. 12, pp. 83-94, 1976.
47. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Clarendon, 1995.
48. C. Zhang, D. Arnold, N. Ghods, A. Siranosian, and M. Krstic, "Source seeking with nonholonomic unicycle without position measurement and with tuning of forward velocity," Syst. Control Lett., vol. 56, pp. 245-252, 2007.
49. S. S. Stanković,M. S. Stanković, and D. M. Stipanović, "Decentralized parameter estimation by consensus based stochastic approximation," IEEE Trans. Autom. Control, vol. 56, no. 3, pp. 531-543, Mar. 2011.
50. M. Huang and J. Manton, "Stochastic consensus seeking with noisy and directed inter-agent communication: Fixed and randomly varying topologies," IEEE Trans. Autom. Control, vol. 55, no. 1, pp. 235-241, Jan. 2010.