Reinforcement Learning-Based NOMA Power Allocation in the Presence of Smart Jamming

IEEE Transactions on Vehicular Technology

Volumn 67, Issue 4, 2018, Pages 3377-3389

  Xiao, Liang ^a,b   Li, Yanda ^a   Dai, Canhuang ^a   Dai, Huaiyu ^c   Poor, H Vincent ^d  

^a XIAMEN UNIVERSITY   (China)

^b SOUTHEAST UNIVERSITY   (China)

^c North Carolina State University   (United States)

^d Princeton University   (United States)

Author keywords

game theory; Nonorthogonal multiple access (NOMA); power allocation; reinforcement learning; smart jamming

Indexed keywords

ANTENNAS; BASE STATIONS; ENERGY EFFICIENCY; GAME THEORY; JAMMING; MIMO SYSTEMS; POWER CONTROL; RADIO TRANSMISSION; SECURITY SYSTEMS; SOFTWARE RADIO;

DOWNLINK; GAMES; NOMA; POWER ALLOCATIONS; RESOURCE MANAGEMENT; SMART JAMMING;

REINFORCEMENT LEARNING;

EID: 85038880038     PISSN: 00189545     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVT.2017.2782726     Document Type: Article

References (36)

1. L. Dai, B. Wang, Y. Yuan, S. Han, I. Chih-Lin, and Z. Wang, "Nonorthogonal multiple access for 5G: Solutions, challenges, opportunities, and future research trends," IEEE Commun. Mag., vol. 53, no. 9, pp. 74-81, Sep. 2015.
2. B. Kimy et al., "Non-orthogonal multiple access in a downlink multiuser beamforming system," in Proc. IEEE Mil. Commun. Conf., San Diego, CA, USA, Nov. 2013, pp. 1278-1283.
3. Z. Ding, L. Dai, and H. V. Poor, "MIMO-NOMA design for small packet transmission in the Internet of Things," IEEE Access, vol. 4, pp. 1393-1405, Apr. 2016.
4. M. F. Hanif, Z. Ding, T. Ratnarajah, and G. K. Karagiannidis, "A minorization-maximization method for optimizing sum rate in the downlink of non-orthogonal multiple access systems," IEEE Trans. Signal Process., vol. 64, no. 1, pp. 76-88, Jan. 2016.
5. Z. Ding, R. Schober, and H. V. Poor, "A general MIMO framework for NOMA downlink and uplink transmission based on signal alignment," IEEE Trans. Wireless Commun., vol. 15, no. 6, pp. 4438-4454, Jun. 2016.
6. K. Firouzbakht, G. Noubir, and M. Salehi, "On the performance of adaptive packetized wireless communication links under jamming," IEEE Trans. Wireless Commun., vol. 13, no. 7, pp. 3481-3495, Jul. 2014.
7. Q. Wang, K. Ren, P. Ning, and S. Hu, "Jamming-resistant multiradio multichannel opportunistic spectrum access in cognitive radio networks," IEEE Trans. Veh. Technol., vol. 65, no. 10, pp. 8331-8344, Oct. 2016.
8. Q. Yan et al., "Jamming resilient communication using MIMO interference cancellation," IEEE Trans. Inf. Forensics Security, vol. 11, no. 7, pp. 1486-1499, Jul. 2016.
9. X. Zhou, D. Niyato, and A. Hjorungnes, "Optimizing training-based transmission against smart jamming," IEEE Trans. Veh. Technol., vol. 60, no. 6, pp. 2644-2655, Jul. 2011.
10. A. Mukherjee and A. L. Swindlehurst, "Jamming games in the MIMO wiretap channel with an active eavesdropper," IEEE Trans. Signal Process., vol. 61, no. 1, pp. 82-91, Jan. 2013.
11. A. Garnaev, Y. Liu, and W. Trappe, "Anti-jamming strategy versus a low-power jamming attack when intelligence of adversary's attack type is unknown," IEEE Trans. Signal Inf. Process. Netw., vol. 2, no. 1, pp. 49-56, Mar. 2016.
12. Y. Gwon, S. Dastangoo, C. Fossa, and H. T. Kung, "Competing mobile network game: Embracing antijamming and jamming strategies with reinforcement learning," in Proc. IEEE Conf. Commun. Netw. Security, Washington, DC, USA, Oct. 2013, pp. 28-36.
13. F. Slimeni, B. Scheers, Z. Chtourou, and V. L. Nir, "Jamming mitigation in cognitive radio networks using a modified Q-learning algorithm," in Proc. IEEE Int. Conf. Mil. Commun. Inf. Syst., Cracow, Poland, May 2015, pp. 1-7.
14. E. R. Gomes and R. Kowalczyk, "Dynamic analysis of multiagent Qlearning with ϵ-greedy exploration," in Proc. ACM Annu. Int. Conf.Mach. Learn., Montreal, QC, Canada, Jun. 2009, pp. 369-376.
15. R. S. Sutton, "Dyna, an integrated architecture for learning, planning, and reacting," ACM SIGART Bulletin, vol. 2, no. 4, pp. 160-163, Aug. 1991.
16. Q. Sun, S. Han, I. Chin-Lin, and Z. Pan, "On the ergodic capacity of MIMO NOMA systems," IEEE Wireless Commun. Lett., vol. 4, no. 4, pp. 405-408, Aug. 2015.
17. Z. Ding, P. Fan, and H. V. Poor, "Impact of user pairing on 5G nonorthogonal multiple-access downlink transmissions," IEEE Trans. Veh. Technol., vol. 65, no. 8, pp. 6010-6023, Aug. 2016.
18. Z. Wei, D. W. K. Ng, and J. Yuan, "Power-efficient resource allocation for MC-NOMA with statistical channel state information," in Proc. IEEE Global Commun. Conf., Washington, DC, USA, Dec. 2016, pp. 1-7.
19. F. Liu, P. Mähönen, and M. Petrova, "Proportional fairness-based user pairing and power allocation for non-orthogonalmultiple access," in Proc. IEEE Annu. Int. Symp. Pers., Indoor, Mobile Radio Commun., Hong Kong, Aug. 2015, pp. 1127-1131.
20. S. Timotheou and I. Krikidis, "Fairness for non-orthogonalmultiple access in 5G systems," IEEE Signal Process. Lett., vol. 22, no. 10, pp. 1647-1651, Oct. 2015.
21. J. A. Oviedo and H. R. Sadjadpour, "A fair power allocation approach to NOMA in multi-user SISO systems," IEEE Trans. Veh. Technol., vol. 66, no. 9, pp. 7974-7985, Sep. 2017, doi: 10.1109/TVT.2017.2689000.
22. L. Xiao, J. Liu, Q. Li, N. B. Mandayam, and H. V. Poor, "User-centric view of jamming games in cognitive radio networks," IEEE Trans. Inf. Forensics Security, vol. 10, no. 12, pp. 2578-2590, Dec. 2015.
23. X. Tang, P. Ren, Y. Wang, Q. Du, and L. Sun, "Securing wireless transmission against reactive jamming: A Stackelberg game framework," in Proc. IEEE Global Commun. Conf., San Diego, CA, USA, Dec. 2015, pp. 1-6.
24. Y. Wu, B. Wang, K. J. R. Liu, and T. C. Clancy, "Anti-jamming games in multi-channel cognitive radio networks," IEEE J. Sel. Areas Commun., vol. 30, no. 1, pp. 4-15, Jan. 2012.
25. A. Garnaev, M. Baykal-Gursoy, and H.V. Poor, "Agame theoretic analysis of secret and reliable communication with active and passive adversarial modes," IEEE Trans. Wireless Commun., vol. 15, no. 3, pp. 2155-2163, Mar. 2016.
26. L. Xiao, N. B. Mandayam, and H. V. Poor, "Prospect theoretic analysis of energy exchange among microgrids," IEEE Trans. Smart Grid, vol. 6, no. 1, pp. 63-72, Jan. 2015.
27. X. He, H. Dai, P. Ning, and R. Dutta, "A stochastic multi-channel spectrum access game with incomplete information," in Proc. IEEE Int. Conf. Commun., London, U.K., Jun. 2015, pp. 4799-4804.
28. L. Xiao, Y. Li, J. Liu, and Y. Zhao, "Power control with reinforcement learning in cooperative cognitive radio networks against jamming," Springer J. Supercomput., vol. 71, no. 9, pp. 3237-3257, Sep. 2015.
29. X. Xiao, C. Dai, Y. Li, C. Zhou, and L. Xiao, "Energy trading game for microgrids using reinforcement learning," in Proc. EAI Int. Conf. Game Theory Netw., Knoxville, TN, USA, May 2017, pp. 131-140.
30. K. S. Hwang, W. C. Jiang, Y. J. Chen, and W. H. Wang, "Model-based indirect learning method based on Dyna-Q architecture," in Proc. IEEE Int. Conf. Systems, Man, Cybern., Manchester, U.K., Oct. 2013, pp. 2540-2544.
31. Y. Li, L. Xiao, H. Dai, and H. V. Poor, "Game theoretic study of protecting MIMO transmissions against smart attacks," in Proc. IEEE Int. Conf. Commun., London, U.K., May 2017.
32. C. Wang, J. Chen, and Y. Chen, "Power allocation for a downlink nonorthogonal multiple access system," IEEE Wireless Commun. Lett., vol. 5, no. 5, pp. 532-535, Aug. 2016.
33. Z. Ding, Z. Yang, P. Fan, and H. V. Poor, "On the performance of nonorthogonal multiple access in 5G systems with randomly deployed users," IEEE Signal Process. Lett., vol. 21, no. 12, pp. 1501-1505, Dec. 2014.
34. L. P. Kaelbling, M. L. Littman, and A.W. Moore, "Reinforcement learning: A survey," J. Artif. Intell. Res., vol. 4, pp. 237-285, 1996.
35. H. H. Kha, H. D. Tuan, and H. H. Nguyen, "Fast global optimal power allocation in wireless networks by local DC programming," IEEE Trans. Wireless Commun., vol. 11, no. 2, pp. 510-515, Feb. 2012.
36. J. Cui, Z. Ding, and P. Fan, "Anovel power allocation scheme under outage constraints in NOMA systems," IEEE Signal Process. Lett., vol. 23, no. 9, pp. 1226-1230, Sep. 2016.