Spectrum access games and strategic learning in cognitive radio networks for delay-critical applications

Proceedings of the IEEE

Volumn 97, Issue 4, 2009, Pages 720-739

  Van Der Schaar, Mlhaela ^a   Fu, Fangwen ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Channel access games; Cognitive radios; Knowledge driven wireless networking; Multiuser wireless communication; Spectrum access; Stochastic games; Strategic learning; Wireless resource markets

Indexed keywords

AUTONOMOUS AGENTS; COGNITIVE SYSTEMS; COMMERCE; GAME THEORY; MULTIMEDIA SERVICES; MULTIMEDIA SYSTEMS; RADIO; RADIO SYSTEMS; SPECTROSCOPY; STOCHASTIC SYSTEMS; WIRELESS NETWORKS;

CHANNEL ACCESS; SPECTRUM ACCESS; STOCHASTIC GAME; STRATEGIC LEARNING; WIRELESS COMMUNICATIONS; WIRELESS NETWORKING; WIRELESS RESOURCES;

COGNITIVE RADIO;

EID: 65249087826     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2009.2013036     Document Type: Article

References (42)

1. FCC, "Spectrum policy task force," ET Docket 02-135, Nov. 2002.
2. S. Haykin, "Cognitive radio: Brain-empowered wireless communications," IEEF J. Sel Areas Commun., vol. 23, Feb. 2005.
3. F. A. Ian, W. Y. Lee, M. C Vuran, and S. Mohanty, "Next generation/dynamic spectrum access/cognitive radio wireless network: A survey," Comput. Netw., vol. 50, no. 13, Sep. 2006.
4. A. Ghasemi and E. S. Sousa, "Collaborative spectrum sensing for opportunities access in fading environments," in Proc. Dyspan 2005, Nov. 2005, pp. 131-136.
5. C. Doerr, M. Neureld, J. Fifield et al., "MultiMAC-An adaptive MAC framework for dynamic radio networking," in Proc. Dyspan 2005, Nov. 2005, pp. 548-555.
6. C. Kloeck, H. Jaekel, and F. Jondral, "Auction sequence as a new resource allocation mechanism," in Proc. VTC'05, Dallas, TX, Sep. 2005.
7. F. Fu and M. van der Schaar, "Learning to compete for resources in wireless stochastic games," IEEE Trans. Veh. Technol., to be published.
8. J. Huang, R. Berry, and M. L. Honig, "Auction-based spectrum sharing," ACM Mobile Netw. Applicat. J. (MONET), vol. 11, no. 3, pp. 405-418, Jun. 2006.
9. L. Berlemann, S. Mangold, G. R. Hiertz, and B. H. Walke, "Policy defined spectrum sharing and medium access for cognitive radios," /. Commun. Acad., vol. 1, no. 1, Apr. 2006.
10. C. T. Chou, N. S. Shankar, H. Kim, and K. Shin, "What and how much to gain by spectrum agility?" IEEE J. Sel. Areas Commun., vol. 25, pp. 576-588, Apr. 2007.
11. S. Shankar, C. T. Chou, K. Challapali, and S. Mangold, "Spectrum agile radio: Capacity and QoS implications of dynamic spectrum assignment," in Proc. Global Telecommun. Conf, Nov. 2005.
12. M. van der Schaar, Y. Andreopoulos, and Z. Hu, "Optimized scalable video streaming over IEEE 802.11 a/e HCCA wireless networks under delay constraints," IEEE Trans. Mobile Comput., vol. 5, pp. 755-768, Jun. 2006.
13. F. Fu, T. M. Stoenescu, and M. van der Schaar, "A pricing mechanism for resource allocation in wireless multimedia applications," IEEE J. Sel. Topics Signal Process., vol. 1, pp. 264-279, Aug. 2007.
14. R. W. Lucky, "Tragedy of the commons" IEEE Spectrum, vol. 43, no. 1, p. 88, Jan. 2006.
15. R. G. Gallager, Discrete Stochastic Processes. Norwell, MA: Kluwer Academic, 1996.
16. L. S. Shapley, "Stochastic games," Proc. Nat. Acad. Sci. USA, vol. 39, pp. 1095-1100, 1953.
17. C. Watkins and P. Dayan, "Q-learning," Tech. Note Machine Learn., vol. 8, pp. 279-292, 1992.
18. P. Klemperer, "Auction theory: A guide to the literature," J. Econ. Sun)., vol. 13, no. 3, pp. 227-286, Jul. 1999.
19. J. Sun, E. Modiano, and L. Zheng, "Wireless channel allocation using an auction algorithm," IEEE J. Sel. Areas Commun., vol. 24, May 2006.
20. F. Fu and M. van der Schaar, "Non-collaborative resource management for wireless multimedia applications using mechanism design," IEEE Trans. Multimedia, vol. 9, pp. 851-868, Jun. 2007.
21. D. Fudenberg and D. K. Levine, The Theory of Learning in Games. Cambridge, MA: MIT Press, 1999.
22. Q. Zhang and S. A. Kassam, "Finite-state Markov model for Rayleigh fading channels," IEEE Trans. Commun., vol. 47, Nov. 1999.
23. Y. Su and M. van der Schaar, "A new perspective on multi-user power control games in interference channels, UCLA Tech. Rep. [Online]. Available: http://arxiv.org/abs/ 0709.3880
24. Y. Su and M. van der Schaar, "Multi-user multimedia resource allocation over multicarrier wireless networks," IEEE Trans. Signal Process., vol. 56, pp. 2102-2116, May 2008.
25. A. Larcher, H. Sun, M. van der Schaar, and Z. Ding, "Decentralized transmission strategy for delay-sensitive applications over spectrum agile networks," in Proc. 13th int. Packet Video Worfeshop (PV 2004), 2004.
26. A. B. MacKenzie and L. A. DaSilva, "Game theory for wireless engineers," in Synthesis Lectures on Communications. San Rafael, CA: Morgan and Claypool, 2006.
27. H. Ji and C-Y. Huang, "Non-cooperative uplink power control in cellular radio systems," Wireless Netw., vol. 4, no. 3, pp. 233-240,1998.
28. D. Goodman and N. Mandayam, "Power control for wireless data, " IEEE Pers. Commun. Mag., vol. 7, pp. 48-54, Apr. 2000.
29. M. Xiao, N. Schroff, and E. Chong, "Utility based power control in cellular radio systems," in Proc. IEEE INFOCOM, Anchorage, AK, 2001.
30. A. B. MacKenzie and S. B. Wicker, "Game theory in communications: Motivation, explanation, and application to power control," in Proc. IEEE GLOBECOM, 2001, pp. 821-826.
31. D. Vengerov, N. Bambos, and H. Berenji, "A fuzzy reinforcement learning approach to power control in wireless transmitters," IEEE Trans. Systems, Man, Cybern. B, vol. 35, no. 4, pp. 768-778, 2005.
32. C Long, Q. Zhang, B. Li, H. Yang, and X. Guan, "Non-cooperative power control for wireless ad hoc networks with repeated games," IEEE J. Sel. Areas Commun., vol. 25, no. 6, pp. 1101-1112, 2007.
33. Z. Han, C Pandana, and K. Liu, "Distributive opportunistic spectrum access for cognitive radio using correlated equilibrium and no-regret learning, " in Proc. Wireless Commun. Netw. Conf. (WCNC 2007), 2007, pp. 11-15.
34. J. Neel, R. M. Buehrer, J. H. Reed, and R. P. Gilles, "Game theoretic analysis of a network of cognitive radios," in Proc. 45th Midwest Symp. Circuits Syst., Aug. 2002, vol. 3, pp. 409-412.
35. W. Yu, G. Ginis, and J. Cioffi, "Distributed multiuser power control for digital subscriber lines," IEEE J. Sel. Areas Commun., vol. 20, pp. 1105-1115, Jun. 2002.
36. Y. Chevaleyre, P. E. Dunne, U. Endriss, J. Lang, M. Lemaître, N. Maudet, J. Padget, S. Phelps, J. A. Rodŕiguez-Aguilar, and P. Sousa, "Issues in multiagent resource allocation," informática, vol. 30, pp. 3-31, 2006.
37. F. Meshkati, H. V. Poor, and S. C Schwartz, "Energy-efficient resource allocation in wireless networks," IEEE Signal Process. Mag., vol. 24, pp. 58-68, May 2007.
38. H. P. Shiang and M. van der Schaar, "Queuing-based dynamic channel selection for heterogeneous multimedia applications over cognitive radio networks," IEEE Trans. Multimedia, vol. 10, no. 5, pp. 896-909, Aug. 2008.
39. J. Park and M. van der Schaar, "Stackelberg Contention Games in Multi-User Networks," EURASIP Journal on Advances in Signal Process., Special issue on Game Theory in Signal Processing and Communications, to appear.
40. Y. B. Reddy, "Detecting primary signals for efficient utilization of spectrum using Q-leaming," in Proc. 5th Jnt. Conf. Inf. Technol: New Gen. (ITNG 2008), 2008, pp. 360-365.
41. H. P. Shiang and M. van der Schaar, "Distributed resource management in multi-hop cognitive radio networks for delay sensitive transmission," IEEE Trans. Veh. Technol., 2008.
42. Y. Su and M. van der Schaar, "Conjectural Equilibrium in Water-filling Games." [Online]. Available: http://arxiv.org/ftp/arxiv/ papers/0811/0811.0048.pdf