An anti-jamming stochastic game for cognitive radio networks

IEEE Journal on Selected Areas in Communications

Volumn 29, Issue 4, 2011, Pages 877-889

  Wang, Beibei ^a   Wu, Yongle ^a   Liu, K J Ray ^b   Clancy, T Charles ^c  

^a QUALCOMM INC   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

Author keywords

cognitive radio networks; game theory; reinforcement learning; Security mechanism; spectrum management

Indexed keywords

ANTI-JAMMING; ATTACKING STRATEGY; CHANNEL QUALITY; COGNITIVE RADIO NETWORK; DATA MESSAGES; DEFENSE STRATEGY; ENVIRONMENT DYNAMICS; MINIMAX-Q LEARNING; OPTIMAL POLICIES; SECURITY MECHANISM; SPECTRUM AVAILABILITY; SPECTRUM MANAGEMENT; SPECTRUM UTILIZATION; STATIONARY POLICY; STOCHASTIC GAME; STRATEGIC BEHAVIOR; TIME VARYING;

GAME THEORY; JAMMING; NETWORK MANAGEMENT; RADIO COMMUNICATION; RADIO SYSTEMS; REINFORCEMENT LEARNING; SECURITY SYSTEMS; STOCHASTIC SYSTEMS;

RADIO;

EID: 79953200186     PISSN: 07338716     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSAC.2011.110418     Document Type: Article

References (39)

1. J. Mitola, "Cognitive radio: An integrated agent architecture for software defined radio," Ph.D. dissertation, KTH Royal Institute of Technology, Stockholm, Sweden, 2000.
2. S. Haykin, "Cognitive radio: Brain-empowered wireless communications," IEEE J. Sel. Areas Commun., vol. 23, no. 2, pp. 201-220, Feb. 2005. (Pubitemid 40245487)
3. B. Wang and K. J. Ray Liu, "Advances in cognitive radio networks: A survey," IEEE J. Sel. Topics Signal Process., vol. 5, no. 1, pp. 5-23, Feb. 2011.
4. K. J. R. Liu and B. Wang, Cognitive Radio Networking and Security: A Game-Theoretic View, Cambridge University Press, 2010.
5. M. M. Halldorson, J. Y. Halpern, L. Li, and V. S Mirrokni, "On spectrum sharing games," Proc. ACM on Principles of distributed computing, pp. 107-114, 2004.
6. O. Ileri, D. Samardzija, and N. B. Mandayam, "Demand responsive pricing and competitive spectrum allocation via a spectrum server," IEEE Symposium on New Frontiers in Dynamic Spectrum Access Networks (DySPAN'05), pp. 194-202, Baltimore, Nov. 2005. (Pubitemid 44462521)
7. J. Huang, R. Berry, and M. L. Honig, "Auction-based spectrum sharing," ACM/Springer Mobile Networks and Apps., vol. 11, no. 3, pp. 405-418, June 2006. (Pubitemid 43724282)
8. C. Kloeck, H. Jaekel, and F. K. Jondral, "Dynamic and local combined pricing, allocation and billing system with coginitive radios," IEEE Symposium on New Frontiers in Dynamic Spectrum Access Networks (DySPAN'05), pp. 73-81, Baltimore, Nov. 2005. (Pubitemid 44462505)
9. S. Gandhi, C. Buragohain, L. Cao, H. Zheng, and S. Suri, "A general framework for wireless spectrum auctions," IEEE Symposium on New Frontiers in Dynamic Spectrum Access Networks (DySPAN'07), pp. 22- 33, Dublin, Apr. 2007. (Pubitemid 47431632)
10. Z. Ji and K. J. R. Liu, "Belief-assisted pricing for dynamic spectrum allocation in wireless networks with selfish users," in Proc. IEEE Int'l Conference on Sensor, Mesh, and Ad Hoc Communications and Networks (SECON), pp. 119-127, Reston, Sep. 2006.
11. Z. Ji and K. J. R. Liu, "Multi-stage pricing game for collusion-resistant dynamic spectrum allocation," IEEE J. Sel. Areas Commun., vol. 26, no. 1, pp. 182-191, Jan. 2008.
12. Y. Wu, B. Wang, K. J. R. Liu, and T. C. Clancy, "A Scalable Collusion- Resistant Multi-Winner Cognitive Spectrum Auction Game," IEEE Trans. Commun., vol. 57, no. 12, pp. 3805-3816, Dec. 2009.
13. B. Wang, Y. Wu, and K. J. R. Liu, "Game theory for cognitive radio networks: An overview," Computer Networks, vol. 54, no. 14, pp. 2537- 2561, Oct. 2010.
14. Y. Xing, R. Chandramouli, S. Mangold, and S. Shankar, "Dynamic spectrum access in open spectrum wireless networks," IEEE J. Sel. Areas Commun., vol. 24, no. 3, pp. 626-637, Mar. 2006.
15. Q. Zhao, L. Tong, A. Swami, and Y. Chen, "Decentralized cognitive MAC for opportunistic spectrum access in ad hoc networks: A POMDP framework," IEEE J. Sel. Areas Commun., vol. 25, no. 3, pp. 589-600, Apr. 2007.
16. B. Wang, Z. Ji, K. J. R. Liu, and C. Clancy, "Primary-prioritized Markov approach for efficient and fair dynamic spectrum allocation," IEEE Trans. Wireless Commun., vol. 8, no. 4, pp. 1854-1865, Apr. 2009.
17. R. Chen, J. Park, and J. H. Reed, "Defense against primary user emulation attacks in cognitive radio networks," IEEE J. Sel. Areas Commun., vol. 26, no. 1, pp. 25-37, Jan. 2008.
18. R. Chen, J. Park, and K. Bian, "Robust Distributed Spectrum Sensing in Cognitive Radio Networks," IEEE 27th Conference on Computer Communications (INFOCOM), pp. 31-35, Phoenix, AZ, Apr. 2008.
19. T. X. Brown and A. Sethi, "Potential cognitive radio denial-of-service vulnerabilities and protection countermeasures: A multi-dimensional analysis and assessment," Mobile Networks and Applications, vol. 13, no. 5, pp. 516-532, Oct. 2008.
20. T. C. Clancy and N. Goergen, "Security in cognitive radio networks: Threats and mitigation," 3rd International Conference on Cognitive Radio Oriented Wireless Networks and Communications (CrownCom), pp. 1-8, Singapore, May 2008.
21. A. Wood and J. Stankovic, "Denial of service in sensor networks," IEEE Computer, 35(10):54-62, Oct. 2002. (Pubitemid 35186161)
22. G. Noubir, "On connectivity in ad hoc network under jamming using directional antennas and mobility," International Conference on Wired /Wireless Internet Communications, pp. 186-200, 2004.
23. R. L. Pickholtz, D. L. Schilling, and L. B. Milstein, "Theory of spread spectrum communications-a tutorial," IEEE Trans. Commun., vol. 20, no. 5, pp. 855-884, May 1982.
24. Q. Zhang and S. A. Kassam, "Finite-state Markov model for Rayleigh fading channels," IEEE Trans. Commun., vol. 47, no. 11, pp. 1688-1692, Nov. 1999. (Pubitemid 32210755)
25. V. Navda, A. Bohra, S. Ganguly, and D. Rubenstein, "Using channel hopping to increase 802.11 resilience to jamming attacks," IEEE 26th Conference on Computer Communications (INFOCOM), pp. 2526-2530, Anchorage, AK, Apr. 2007. (Pubitemid 47334514)
26. R. Gummadi, D. Wetherall, B. Greenstein, and S. Seshan, "Understanding and mitigating the impact of RF interference on 802.11 networks," ACM SIGCOMM Computer Communication Review, vol. 37, no. 4, pp. 385-396, 2007. (Pubitemid 350239800)
27. A. D. Wood, J. A. Stankovic, and G. Zhou, "DEEJAM: Defeating energyefficient jamming in IEEE 802.15.4-based wireless networks," Proc. 4th IEEE Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON), pp. 60-69, San Diego, CA, June 2007.
28. S. Khattab, D. Mosse, and R. Melhem, "Modeling of the channelhopping anti-jamming defense in multi-radio wireless networks," Proc. 5th Annual International Conference on Mobile and Ubiquitous Systems: Computing, Networking, and Services (MobiQuitous), pp. 1-10, Dublin, Ireland, July 2008.
29. W. Xu, T. Wood, W. Trappe, and Y. Zhang, "Channel surfing and spatial retreats: Defenses against wireless denial of service," in Proc. 3rd ACM Workshop on Wireless Security (WiSe), pp. 80-89, Philadelphia, PA, Oct. 2004. (Pubitemid 40062798)
30. S. Geirhofer, L. Tong, and B. M. Sadler, "Cognitive medium access: Constraining interference based on experimental models," IEEE J. Sel. Areas Commun., vol. 26, no. 1, pp. 95-105, Jan. 2008.
31. L.S. Shapley, "Stochastic games," Proc. Nat. Acad. Sci. USA, vol. 39, no. 10, pp. 1095-1100, 1953.
32. J. Filar and K. Vrieze, Competitive Markov Decision Processes, Springer-Verlag, 1997.
33. M. L. Littman, "Markov games as a framework for multi-agent reinforcement learning," Proc. 11th International Conference on Machine Learning, pp. 157-163, 1994.
34. M. L. Littman and C. Szepesvari, "A generalized reinforcement- learning model: Convergence and applications," Proc. 13th International Conference on Machine Learning, pp. 310-318, 1996.
35. J. Hu and M. P. Wellman, "Multiagent reinforcement learning: Theoretical framework and an algorithm," Proc. 15th International Conference on Machine Learning, pp. 242-250, 1998.
36. A. Neyman and S. Sorin, Stochastic Games and Applications, Kluwer Academic Press, 2003.
37. J. F. Mertens and A. Neyman, "Stochastic Games," International Journal of Game Theory, vol. 10, pp. 53-66, 1981.
38. T. S. Rappaport, Wireless Communications: Principles and Practice, Prentice Hall, 1996.
39. A. Chan, X. Liu, G. Noubir, and B. Thapa, "Control channel jamming: Resilience and identification of traitors," Proc. ISIT, 2007.