To relay or not to relay: Learning device-to-device relaying strategies in cellular networks

IEEE Transactions on Mobile Computing

Volumn 15, Issue 6, 2016, Pages 1569-1585

  Mastronarde, Nicholas ^a   Patel, Viral ^a   Xu, Jie ^b   Liu, Lingjia ^c   Van Der Schaar, Mihaela ^d  

^a State University of New York   (United States)

^b UNIVERSITY OF MIAMI   (United States)

^c University of Kansas   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Emerging technologies; learning; mobile communications systems; mobile environments; network management; wireless communications

Indexed keywords

BUDGET CONTROL; MOBILE TELECOMMUNICATION SYSTEMS; NETWORK MANAGEMENT; RADIO TRANSCEIVERS; RELAY CONTROL SYSTEMS; WIRELESS NETWORKS; WIRELESS TELECOMMUNICATION SYSTEMS;

EMERGING TECHNOLOGIES; LEARNING; MOBILE COMMUNICATIONS SYSTEMS; MOBILE ENVIRONMENTS; WIRELESS COMMUNICATIONS;

LEARNING ALGORITHMS;

EID: 84969610661     PISSN: 15361233     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMC.2015.2465379     Document Type: Article

References (49)

1. N. Mastronarde, V. Patel, J. Xu, and M. Van Der Schaar, "Learning relaying strategies in cellular D2D networks with token-based incentives, " in Proc. IEEE Globecom Workshops, Dec. 2013, pp. 163-169
2. P. Liu, Z. Tao, Z. Lin, E. Erkip, and S. Panwar, "Cooperative wireless communications: A cross-layer approach, " IEEE Wireless Commun., vol. 13, no. 4, pp. 84-92, Aug. 2006
3. T.C.-Y. Ng and W. Yu, "Joint optimization of relay strategies and resource allocations in cooperative cellular networks, " IEEE J. Sel. Areas Commun., vol. 25, no. 2, pp. 328-339, Feb. 2007
4. O. Alay, P. Liu, Y. Wang, E. Erkip, and S. S. Panwar, "Cooperative layered video multicast using randomized distributed space time codes, " IEEE Trans. Multimedia, vol. 13, no. 5, pp. 1127-1140, Oct. 2011
5. N. Mastronarde, F. Verde, D. Darsena, A. Scaglione, and M. Van Der Schaar, "Transmitting important bits and sailing high radio waves: A decentralized cross-layer approach to cooperative video transmission, " IEEE J. Sel. Areas Commun., vol. 30, no. 9, pp. 1597-1604, Oct. 2012
6. 3GPP TS 36.216, "Physical layer for relaying operation, " Sep. 2011
7. Wi-Fi Direct [Online]. Available: http://www.wi-fi.org/discoverwi-fi/wi-fi-direct, 2015
8. LTE Direct [Online]. Available: https://www.qualcomm.com/invention/research/projects/lte-direct, 2015
9. D. Feng, L. Lu, Y. Yuan-Wu, G. Li, S. Li, and G. Feng, "Device-todevice communications in cellular networks, " IEEE Commun. Mag., vol. 52, no. 4, pp. 49-55, Apr. 2014
10. J. D. Power and Assoc., 2012 US wireless smartphone and traditional mobile phone customer satisfaction study [Online]. Available: www.jdpower.com/content/press-release/py6kvam/2012-u-s-wireless-smartphone-and-traditional-mobile-phone-satisfaction-studies-volume, 2012
11. X. Lin, J. Andrews, A. Ghosh, and R. Ratasuk, "An overview of 3GPP device-to-device proximity services, " IEEE Commun. Mag., vol. 52, no. 4, pp. 40-48, Apr. 2014
12. S. Andreev, A. Pyattaev, K. Johnsson, O. Galinina, and Y. Koucheryavy, "Cellular traffic offloading onto network-assisted device-to-device connections, " IEEE Commun. Mag., vol. 52, no. 4, pp. 20-31, Apr. 2014
13. S. Andreev, O. Galinina, A. Pyattaev, K. Johnsson, Y. Koucheryavy, "Analyzing assisted offloading of cellular user sessions onto d2d links in unlicensed bands, " IEEE J. Sel. Areas Commun., vol. 33, no. 1, pp. 67-80, Jan. 2015
14. H. Nishiyama, M. Ito, and N. Kato, "Relay-by-smartphone: Realizing multi-hop device-to-device communications, " IEEE Commun. Mag., vol. 52, no. 4, pp. 56-65, Apr. 2014
15. X. Lin, J. G. Andrews, and A. Ghosh, "A comprehensive framework for device-to-device communications in cellular networks, " ArXiv preprint, ArXiv: 1305.4219, 2013
16. Y. Zhao, R. Adve, T. J. Lim, "Improving amplify-and-forward relay networks: Optimal power allocation versus selection, " IEEE Trans. Wireless Commun., vol. 6, no. 8, pp. 3114-3123, Aug. 2007
17. A. Osseiran, K. Doppler, C. Ribeiro, M. Xiao, M. Skoglund, and J. Manssour, "Advances in device-to-device communications and network coding for IMT-advanced, " presented at the ICT Mobile Summit, Santander, Spain, 2009
18. K. Vanganuru, S. Ferrante, and G. Sternberg, "System capacity and coverage of a cellular network with D2D mobile relays, " in Proc. Military Commun. Conf., 2012, pp. 1-6
19. A. Asadi and V. Mancuso, "On the compound impact of opportunistic scheduling and D2D communications in cellular networks, " in Proc. 16th ACM Int. Conf. Model., Anal. Simul. Wireless Mobile Syst., 2013, pp. 279-288
20. W. Su, J. D. Matyjas, and S. Batalama, "Active cooperation between primary users and cognitive radio users in heterogeneous ad-hoc networks, " IEEE Trans. Signal Process., vol. 60, no. 4, pp. 1796-1805, Apr. 2012
21. D. Zhang, R. Shinkuma, and N. B. Mandayam, "Bandwidth exchange: An energy conserving incentive mechanism for cooperation, " IEEE Trans. Wireless Commun., vol. 9, no. 6, pp. 2055-2065, Jun. 2010
22. T. Nadkar, V. Thumar, G. Shenoy, U. B. Desai, and S. N. Merchant, "Cognitive relaying with time incentive: Protocol design for multiple primary users, " in Proc. IEEE 22nd Int. Symp. Pers., Indoor, Mobile Radio Commun., 2011, pp. 577-582
23. G. Zhang, K. Yang, Q. Hu, P. Liu, and E. Ding, "Bargaining game theoretic framework for stimulating cooperation in wireless cooperative multicast networks, " IEEE Commun. Lett., vol. 16, no. 2, pp. 208-211, Feb. 2012
24. Y. Chen and K.J. Ray Liu, "Indirect reciprocity game modelling for cooperation stimulation in cognitive networks, " IEEE Trans. Commun., vol. 59, no. 1, pp. 159-168, Jan. 2011
25. 3GGP, TR 36.814: "Further advancements for E-UTRA, "Mar. 2010
26. IEEE, IEEE Standard for local and metropolitan area networks Part 16: Air interface for broadband wireless access systems Amendment 3: Advanced air interface (IEEE 802.16m), 2011
27. S. Buchegger, J. Y. L. Boudec, "Performance analysis of the CONFIDANT protocol, " in Proc. ACM Int. Symp. Mobile Ad Hoc Netw. Comput., 2002, pp. 226-236
28. S. Bansal and M. Baker, "Observation-based cooperation enforcement in ad hoc networks, " Comput. Sci. Dept., Stanford Univ., Stanford, CA USA, Tech. Paper, Jul. 2003
29. S. Zhong, J. Chen, and Y. Yang, "Sprite: A simple, cheat-proof, credit-based system for mobile ad-hoc networks, " in Proc. 22nd Annu. Joint Conf. IEEE Comput. Commun. Soc., 2003, pp. 1987-1997
30. L. Buttyan and J.-P. Hubaux, "Stimulating cooperation in selforganizing mobile ad hoc networks, " Mobile Netw. Appl., vol. 8, no. 5, pp. 579-592, 2003
31. J. Crowcroft, R. Gibbens, F. Kelly, and S. Ostring, "Modeling incentives for collaboration in mobile ad hoc networks, " Perform. Eval., vol. 57, no. 4, pp. 427-439, 2004
32. M. Jakobsson, J.-P. Hubaux, and L. Buttyan, "A micro-payment scheme encouraging collaboration in multi-hop cellular networks, " Financial Cryptography, pp. 15-33, 2003
33. J. Xu and M. Van Der Schaar, "Token system design for autonomic wireless relay networks, " IEEE Trans. Commun., vol. 61, no. 7, pp. 2924-2935, Jul. 2013
34. V. Vishnumurthy, S. Chandrakumar, and E. G. Sirer, "KARMA: A secure economic framework for peer-to-peer resource sharing, " in Proc. Workshop Econ. Peer-to-Peer Syst., 2003, pp. 1-6
35. M. Van Der Schaar, J. Xu, and W. Zame "Efficient online exchange via fiat money, " Econ. Theory, vol. 54, no. 2, pp. 211-248, Oct. 2013
36. J.-B. Seo and V.C. M. Leung, "Performancemodeling and stability of semi-persistent schedulingwith initial randomaccess in LTE, " IEEE Trans. Wireless Commun., vol. 11, no. 12, pp. 4446-4456, Dec. 2012
37. L. P. Kaelbling, M. L. Littman, and A. W. Moore, "Reinforcement learning: A survey, " arXiv preprint, cs/9605103, 1996
38. A. Mehrotra and L. Golding, "Mobility and security management in the GSM system and some proposed future improvements, " Proc. IEEE, vol. 86, no. 7, pp. 1480-1496, Jul. 1998
39. M. Geuss, "How apple pay and google wallet actually work, " Ars Technica [Online]. Available: http://arstechnica.com/gadgets/2014/10/how-mobile-payments-really-work/, Oct. 2012
40. J. Mattingley, Y. Wang, and S. Boyd, "Receding horizon control, " IEEE Control Syst., vol. 31, no. 3, pp. 52-65, Jun. 2011
41. P. Wiecek, E. Altman, and Y. Hayel, "Stochastic state dependent population games in wireless communication, " IEEE Trans. Autom. Control, vol. 56, no. 3, pp. 492-505, Mar. 2011
42. M. L. Littman, T. L. Dean, and L. P. Kaebling, "On the complexity of solving Markov decision problems, " in Proc. 11th Conf. Uncertainty Artif. Intell., 1995, pp. 394-402
43. Y. Shoham, R. Powers, and T. Grenager, "Multi-agent reinforcement learning: A critical survey, " Web manuscript, 2003
44. M. Weinberg and J. S. Rosenschein, "Best-response multiagent learning in non-stationary environments, " in Proc. 3rd Int. Conf. Auton. Agents Multiagent Syst., vol. 2, pp. 506-513
45. J. Broch, D. Maltz, D. Johnson, Y.-C. Hu, and J. Jetcheva, "A performance comparision of multi-hop wireless ad hoc network routing protocols, " in Proc. ACM MobiCom, 1998, pp. 85-97
46. D. Fudenberg and D. K. Levine, The Theory of Learning in Games. Cambridge, MA, USA: MIT Press, 1998
47. N. Mastronarde, V. Patel, J. Xu, and M. Van Der Schaar, "To relay or not to relay: Learning relaying strategies in cellular device-todevice networks, " Tech. Rep. [Online]: Available: http://arxiv.org/abs/1308.3185v2, Dec. 2013
48. 3GPP TR 36.931 version 9.0.0 Release 9 [Online]: Available: http://www.etsi.org/deliver/etsi-tr/136900-136999/136931/09.00.00-60/tr-136931v090000p.pdf, 2011
49. D5.3: WINNER+ Final Channel Models [Online]: Available: http://projects.celtic-initiative.org/winner%2B/WINNER+%20Deliverables/D5.3-v1.0.pdf, 2010