Distributed reinforcement learning frameworks for cooperative retransmission in wireless networks

IEEE Transactions on Vehicular Technology

Volumn 59, Issue 8, 2010, Pages 4157-4162

  Naddafzadeh Shirazi, Ghasem ^a,b   Kong, Peng Yong ^a,b   Tham, Chen Khong ^a,b  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Distributed Markov decision process (MDP) for wireless networks; media access control (MAC) cooperative retransmission; reinforcement learning (RL)

Indexed keywords

CO-OPERATIVE DIVERSITY; CONCURRENT TRANSMISSION; CONSUMED ENERGY; COOPERATIVE RETRANSMISSION; DISTRIBUTED MARKOV DECISION PROCESS (MDP) FOR WIRELESS NETWORKS; DISTRIBUTED METHODS; DISTRIBUTED REINFORCEMENT LEARNING; DISTRIBUTED WIRELESS; FAST CONVERGENCE; LEARNING SCHEMES; LOCAL SOLUTION; LOW COMPLEXITY; LOWER BOUNDS; MARKOV DECISION PROCESSES; MEDIA ACCESS CONTROL; MODEL FREE; NETWORK SIZE; NETWORK THROUGHPUT; NUMBER OF STATE; PER UNIT; REINFORCEMENT LEARNING (RL); RELAY NODE; SPATIAL REUSE; TRANSMISSION PROBABILITIES;

ACCESS CONTROL; CONCURRENCY CONTROL; CONVERGENCE OF NUMERICAL METHODS; LEARNING ALGORITHMS; MARKOV PROCESSES; NETWORK PROTOCOLS; REINFORCEMENT LEARNING; RELAY CONTROL SYSTEMS; SECURITY SYSTEMS;

WIRELESS NETWORKS;

EID: 77958088003     PISSN: 00189545     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVT.2010.2059055     Document Type: Article

References (19)

1. G. Naddafzadeh-Shirazi, P.-Y. Kong, and C. K. Tham, "Cooperative retransmissions using Markov decision process with reinforcement learning," in Proc. 20th IEEE PIMRC, 2009, pp. 652-656.
2. H. S. Wang and N. Moayeri, "Finite-state Markov channel-A useful model for radio communication channels," IEEE Trans. Veh. Technol., vol.44, no.1, pp. 163-171, Feb. 1995.
3. H. S. Chang and M. C. Fu, "A distributed algorithm for solving a class of multi-agent Markov decision problems," in Proc. IEEE CDC, 2003, pp. 5341-5346.
4. J. Shen, V. Lesser, and N. Carver, "Minimizing communication cost in a distributed Bayesian network using a decentralized MDP," in Proc. 2nd AAMAS, 2003, pp. 678-685.
5. M. Lauer and M. Riedmiller, "An algorithm for distributed reinforcement learning in cooperative multi-agent systems," in Proc. 17th Int. Conf. Mach. Learning, 2000, pp. 535-542.
6. J. Schneider, W.-K. Wong, A. Moore, and M. Riedmiller, "Distributed value functions," in Proc. 16th Int. Conf. Mach. Learn., 1999, pp. 371-378.
7. J. R. Kok and N. Vlassis, "Collaborative multiagent reinforcement learning by payoff propagation," J. Mach. Learn. Res., vol.7, pp. 1789-1828, Dec. 2006.
8. C. Pandana and K. J. R. Liu, "Near-optimal reinforcement learning framework for energy-aware sensor communications," IEEE J. Sel. Areas Commun., vol.23, no.4, pp. 788-797, Apr. 2005.
9. A. T. Hoang and M. Motani, "Buffer and channel adaptive modulation for transmission over fading channels," in Proc. IEEE ICC, 2003, vol.4, pp. 2748-2752.
10. A. T. Hoang and M. Motani, "Buffer and channel adaptive transmission over fading channels with imperfect channel state information," in Proc. WCNC, 2004, vol.3, pp. 1891-1896.
11. D. Djonin and V. Krishnamurthy, "Amplify-and-forward cooperative diversity wireless networks: Model, analysis, and monotonicity properties," in Proc. CDC-ECC, Dec. 2005, pp. 3231-3236.
12. M. Dianati, X. Ling, S. Naik, and X. Shen, "A node cooperative ARQ scheme for wireless ad hoc networks," IEEE Trans. Veh. Technol., vol.55, no.3, pp. 1032-1044, May 2006.
13. G. Naddafzadeh-Shirazi, P.-Y. Kong, and C.-K. Tham, "Markov decision process frameworks for cooperative retransmission in wireless networks," in Proc. IEEE WCNC, 2009, pp. 1-6.
14. J. Dowling, E. Curran, R. Cunningham, and V. Cahill, "Using feedback in collaborative reinforcement learning to adaptively optimize MANET routing," IEEE Trans. Syst.,Man, Cybern. A, Syst., Humans, vol.35, no.3, pp. 360-372, May 2005.
15. A. Tanenbaum, Computer Networks, 4th ed. Englewood Cliffs, NJ: Prentice-Hall, 2003, ch. 4.2.
16. E. D. Ferreira and P. K. Khosla, "Multi-agent collaboration using distributed value functions," in Proc. IEEE Intell. Vehicles Symp., Oct. 2000, pp. 404-409.
17. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998.
18. S. Koenig and R. G. Simmons, "Complexity analysis of real-time reinforcement learning," in Proc. AAAI, 1997, pp. 99-105.
19. P. Gupta and P. R. Kumar, "The capacity of wireless networks," IEEE Trans. Inf. Theory, vol.46, no.2, pp. 388-404, Mar. 2000.