Delay-Optimal Dynamic Mode Selection and Resource Allocation in Device-To-Device Communications-Part II: Practical Algorithm

IEEE Transactions on Vehicular Technology

Volumn 65, Issue 5, 2016, Pages 3491-3505

  Lei, Lei ^a   Kuang, Yiru ^a   Cheng, Nan ^b   Shen, Xuemin ^b   Zhong, Zhangdui ^a   Lin, Chuang ^c  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b UNIVERSITY OF WATERLOO   (Canada)

^c TSINGHUA UNIVERSITY   (China)

Author keywords

Device To Device Communication; Mode Selection; Online Stochastic Learning; Resource Allocation

Indexed keywords

ALGORITHMS; CHANNEL STATE INFORMATION; DYNAMIC PROGRAMMING; E-LEARNING; EQUATIONS OF STATE; ITERATIVE METHODS; LAGRANGE MULTIPLIERS; LEARNING ALGORITHMS; MARKOV PROCESSES; MOBILE TELECOMMUNICATION SYSTEMS; OPTIMAL CONTROL SYSTEMS; ORTHOGONAL FREQUENCY DIVISION MULTIPLEXING; RESOURCE ALLOCATION; STOCHASTIC SYSTEMS;

AVERAGE END-TO-END DELAYS; CONSTRAINED MARKOV DECISION PROCESS; DEVICE-TO-DEVICE COMMUNICATIONS; DEVICETO-DEVICE (D2D) COMMUNICATION; MODE SELECTION; ORTHOGONAL FREQUENCY DIVISION MULTIPLE ACCESS; STOCHASTIC LEARNING; VALUE ITERATION ALGORITHM;

FREQUENCY DIVISION MULTIPLE ACCESS;

EID: 84971014154     PISSN: 00189545     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVT.2015.2444791     Document Type: Article

References (18)

1. L. Lei et al., "Delay-optimal dynamic mode selection and resource allocation in device-To-device communications-Part I: Optimal policy" IEEE Trans. Veh. Technol., vol. 65, no. 5, pp. 3474-3490, May 2016.
2. G. Fodor, et al., "Design aspects of network assisted device-To-device communications, " IEEE Commun. Mag., vol. 50, no. 3, pp. 170-177, Mar. 2012.
3. L. Lei, Z. Zhong, C. Lin, and X. Shen, "Operator controlled device-Todevice communications in LTE-Advanced networks, " IEEEWireless Mag., vol. 19, no. 3, pp. 96-104, Jun. 2012.
4. L. Song, D. Niyato, Z. Han, and E. Hossain, Wireless Device-To-Device Communications and Networks. Cambridge, U.K.: Cambridge Univ. Press, 2015.
5. H. Nishiyama, M. Ito, and N. Kato, "Relay-by-smartphone: Realizing multi-hop device-To-device communications, " IEEE Wireless Commun., vol. 52, no. 4, pp. 56-65, Apr. 2014.
6. M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming. New York, NY, USA: Wiley, 2005.
7. D. P. Bertsekas, Dynamic Programming and Optimal Control, 3rd ed. Belmont, MA, USA: Athena Scientific, 2007.
8. Y. Cui, V. K. N. Lau, and R. Wang, "A survey on delay-Aware resource control for wireless systems-large deviation theory, stochastic Lyapunov drift, and distributed stochastic learning, " IEEE Trans. Inf. Theory, vol. 58, no. 3, pp. 1677-1701, Mar. 2012.
9. R. Wang and V. K. Lau, "Delay-Aware two-hop cooperative relay communications via approximate MDP and stochastic learning, " IEEE Trans. Inf. Theory, vol. 59, no. 11, pp. 7645-7670, Nov. 2013.
10. M. Moghaddari, E. Hossain, and L. B. Le, "Delay-optimal distributed scheduling in multi-user multi-relay cellular wireless networks, " IEEE Trans. Wireless Commun., vol. 61, no. 4, pp. 1349-1360, Apr. 2013.
11. G. Naddafzadeh-Shirazi, K. Peng-Yong, and T. Chen-Khong, "Distributed reinforcement learning frameworks for cooperative retransmission in wireless networks, " IEEE Trans. Veh. Technol., vol. 59, no. 8, pp. 4157-4162, Oct. 2010.
12. K. Zheng, F. Liu, L. Lei, C. Lin, and Y. Jiang, "Stochastic performance analysis of a wireless finite-state Markov channel, " IEEE Trans. Wireless Commun., vol. 12, no. 2, pp. 782-793, Feb. 2013.
13. L. Georgiadis, M. J. Neely, and L. Tassiulas, "Resource allocation and cross-layer control in wireless networks, " Found. Trends Netw., vol. 1, no. 1, pp. 1-144, 2006.
14. H. J. Kushner and G. G. Yin, Stochastic Approximation and Optimization of Random Systems, 2nd ed. New York, NY, USA: Springer-Verlag, 2003.
15. V. S. Borkar, "Stochastic approximation with two time scales, " Syst. Control Lett., vol. 29, no. 5, pp. 291-294, Feb. 1997.
16. Q. Liu, S. Zhou, and G. B. Giannakis, "Queueing with adaptive modulation and coding over wireless links: Cross-layer analysis and design, " IEEE Trans. Wireless Commun., vol. 4, no. 3, pp. 1142-1153, May 2005.
17. V. S. Borkar, "Asynchronous stochastic approximation, " SIAM J. Control Optim., vol. 36, pp. 840-851, 1998.
18. V. S. Borkar, "An actor-critic algorithm for constrained Markov decision processes, " Syst. Control Lett., vol. 54, no. 3, pp. 207-213, Mar. 2005.