Stochastic learning solution for distributed discrete power control game in wireless data networks

IEEE/ACM Transactions on Networking

Volumn 16, Issue 4, 2008, Pages 932-944

  Xing, Yiping ^a,b   Chandramouli, R ^a  

^a Stevens Institute of Technology   (United States)

^b Bear Stearns & Co Inc   (United States)

Author keywords

Game theory; Power control; Stochastic learning; Wireless networking

Indexed keywords

AD HOC NETWORKS; BEAMFORMING; DECISION MAKING; DIFFERENCE EQUATIONS; DIFFERENTIAL EQUATIONS; DIFFERENTIATION (CALCULUS); LEARNING ALGORITHMS; ORDINARY DIFFERENTIAL EQUATIONS; POWER CONTROL; SOLUTIONS; STANDARDS; STOCHASTIC PROGRAMMING; TELECOMMUNICATION NETWORKS; WIRELESS NETWORKS;

A-STABLE; CONTINUOUS DOMAINS; DISCRETIZATION; DISTRIBUTED POWER CONTROL; FINITE NUMBERS; ITERATIVE PROCEDURES; NASH EQUILIBRIUM; NON-COOPERATIVE GAME THEORY; POWER ADAPTATION; POWER CONTROL ALGORITHMS; POWER CONTROL GAME; POWER CONTROL PROBLEM; POWER CONTROLLED; POWER LEVELING; PRIMARY OBJECTIVE; QUALCOMM; RECENT TRENDS; STOCHASTIC LEARNING; TRANSMITTER POWER; WIRELESS DATA NETWORKS; WIRELESS NETWORKING;

GAME THEORY;

EID: 50149095089     PISSN: 10636692     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNET.2007.911424     Document Type: Article

References (34)

1. J. M. Aein, "Power balancing in system employing frequency reuse," COMSAT Technical Review, vol. 3, no. 2, pp. 277-300, 1973.
2. R. W. Nettleton and H. Alavi, "Power control for a spread spectrum radio system," in Proc. IEEE Vehicular Technology Conf., Toronto, ON, Canada, 1983, pp. 242-246
3. S. A. Grandhi, R. Vijayan, D. J. Goodman, and J. Zander, "Centralized power control in cellular radio systems," IEEE Trans. Veh. Technol. vol. 42, no. 5, pp. 466-468, Nov. 1993.
4. J. Zander, "Performance of optimum transmitter power control in cellular radio systems." IEEE Trans. Veh. Tehnol., vol. 41, no. 1, pp. 57-62, Feb. 1992.
5. J. Zander, "Distributed cochannel control in celluar radio systems," IEEE Trans. Veh. Technol., vol. 41, no. 4, pp. 305-311, Aug. 1992.
6. S. A. Grandhi, R. Vijayan, and D. J. Goodman, "Distributed power control in cellular radio systems," IEEE Trans. Commun., vol. 110. 2. pp. 226-228, Feb. 1994.
7. A. Sampath, P. S. Kumar, and J. M. Holtzman, "Power control resource, management for a multimedia CDMA wireless system," in Proc. IEEE PIMRC, 1995, pp. 21-25.
8. K. Seong-Lyun, Z. Rosberg, and J. Zander, "Combined power control and transmission rate selection in cellular networks," in Proc. IEEE Vehicular Technology Conf., Sep. 1999, pp. 19-22.
9. S. Ulukus and R. Yates, "Stochastic power control for cellular radio systems," IEEE Trans. Commun., vol. 46, no. 6. pp. 784-798, Jun. 1998.
10. M. K. Varanasi and D. Das, "Fast stochastic power control algorithms for nonlinear multiuser receivers," IEEE Trans. Commun., vol. 50, no. 11, pp. 1817-1827, Nov. 2002.
11. A. Yener, R. D. Yates, and S. Ulukus, "Joint power control, multiuser detection and beamforming for CDMA systems," in Proc. IEEE Vehicular Technology Conf., Houston, TX, May 1999, pp. 1032-1036.
12. J. Zhang, E. K. P. Chong, and I. Kontoyannis, "Unified spatial diversity combining and power allocation schemes for CDMA systems in multiple time-scale fading channels," IEEE J. Sel. Areas Commun., vol. 19, no. 7, pp. 1276-1288, Jul. 2001.
13. H. Ji and C. Y. Huang, "Non-cooperative uplink power control in cellular radio systems," Wireless Networks, vol. 4, no. 2, pp. 233-240. 1998.
14. T. Alpean. T. Basar, R. Srikant, and E. Altman, "CDMA uplink power control as a noncooperative game," in Proc. IEEE Conf. Decision and Control, Dec. 2001, vol. 1, pp. 197-202.
15. C. W. Sung and W. S. Wong, "A noncooperative powers control game for multirate CDMA data networks," IEEE Trans. Wireless Commun., vol. 2, no. 1, pp. 186-194, Jan. 2003.
16. M. Xiao, N. B. Shroff, and E. K. P. Chong, "A utility-based power-control seheme, in wireless cellular systems," IEEE/ACM Trans. Netw., vol. 11, no. 2, pp. 210-221, Apr. 2003.
17. D. Famolari, N. B. Mandayam, D. J. Goodman, and V. Shah, "A new framework for power control in wireless data networks: Games, utitlity and pricing," in Proc. 36th Annu. Allerton Conf. Communications, Control, and Computing, Monticello, IL, 1998, pp. 289-310.
18. C. U. Saraydar, N. B. Mandayam, and D. J. Goodman, "Efficient power control via pricing in wireless data network," IEEE Trans. Commun. vol. 50, no. 2, pp. 291-303, Feb. 2002.
19. "An overview of the application of code division multiple access (CDMA) to digital cellular systems and person cellular networks," Qualcomm Inc., Doc. EX60-10010, 1992.
20. C. W. Sung, K. K. Leung, and W. S. wong, "A quality based fixed-step power control algorithm with adaptive target threshold," IEEE Trans. Veh. Technol., vol. 49, no. 7, pp. 1430-1439, Jul. 2000.
21. M. Andersin, Z. Rosberg, and J. Zander, "Distributed discrete power control algorithm with adaptive target threshold," IEEE Trans. Veh. Technol., vol. 49, no. 7, pp. 1430-1439, Jul. 2000.
22. K. S. Narendra and M. A. L. Thalbachar, Learning Automata: An Introduction. Englewood Cliffs, NJ: Prentice-Hall, 1989.
23. R. Chandramouli, "A stochastic technique for on-line prediction and tracking of wireless packet networks," in Proc. 35th Asilomar Conf. Signals, Systems, and Computing, 2001, vol. 1, pp. 672-676.
24. S. Kiran and R. Chandramouli, "An adaptive energy efficient link layer protocol using stochastic learning control," in Proc. IEEE Int. Conf. Communications. 2003, DD. 1114-1118.
25. D. Fudenberg and J. Tirole, Genome Theory. Cambridge, MA: MIT Press, 1992.
26. P. S. Sastry, V. V. Phansalkaar, and M. A. L. Thathachar, "Decentralized learning of Nash equilibria in multi-person stochastic games with incomplete irformation," IEEE Trans. Syste., Man, Cybernet., vol. 24, no. 5, pp. 769-777, May 1994.
27. J. Hu and M. P. Wellman, "Multiagent reinforcement learning: Theory retical framework and an algorithm," in Proc 15th Int. Conf. Machine learning, 1998, pp. 242-250.
28. K. S. Narendra and A. Annaswamy. Stable Adaptive System. Englewood Cliffs, NJ: Prentice-Hall. 1989.
29. R. N. Kent and B. S. Edward, Fundamentals of Differential Equations and Boundary Value Problem. Reading, MA: Addison-Wesley, 1996.
30. S. Lakshmivarahan and K. S. Narendra, "Learning algorithms for two-person zero-sum stochastic games with incomplete information: A unified approach," SIAM J. Control Optim. vol. 20, no. 4, pp. 541-552. Jul. 1982.
31. A. Blaquiere, Non-Linear System Analysis. New York: Academic.
32. K. S. Narendra and A. Annaswamy, Stable Adaptive Systems. Englewood Cliffs, NJ: Prentice-Hall, 1989.
33. M.F. Norman, Markov Processes and Learning Models. New York: Academic, 1973.
34. M. Haleem and R. Chandramouli, "Adaptive downlink scheduling and rate selection: A cross layer design special issue on mobile computing and networking," IEEE J. Sel. Areas Commun., vol. 23, no. 6, pp. 1287-1297, Jun. 2005.