Neural-based downlink scheduling algorithm for broadband wireless networks

Computer Communications

Volumn 30, Issue 2, 2007, Pages 207-218

  Fiengo, Pasquale ^a   Giambene, Giovanni ^a   Trentin, Edmondo ^a  

^a UNIVERSITY OF SIENA   (Italy)

Author keywords

Reinforcement learning; Traffic scheduling; Wireless communications

Indexed keywords

ALGORITHMS; MULTIMEDIA SYSTEMS; NEURAL NETWORKS; QUALITY OF SERVICE; RADIO SYSTEMS; TELECOMMUNICATION TRAFFIC;

REINFORCEMENT LEARNING; TRAFFIC SCHEDULING; WIRELESS COMMUNICATIONS;

TELECOMMUNICATION NETWORKS;

EID: 33845483883     PISSN: 01403664     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.comcom.2006.08.009     Document Type: Article

References (35)

1. A.K. Parekh, G. Gallager, A generalized processor sharing approach to flow control in integrated services networks - the single node case, in: Proceedings of IEEE INFOCOM 1992, vol. 2, pp. 915-924.
2. P. Bhagwat, Partha P. Bhattacharya, A. Krishna, S. K. Tripathi, Enhancing throughput over wireless LANs using channel state dependent packet scheduling, in: Proceedings of INFOCOM, 1996, pp. 1133-1140.
3. S. Lu, V. Bharghavan, R. Srikant, Fair scheduling in wireless packet networks, IEEE ACM Transactions on Networking, 7(4):473-489, 1999.
4. C.Y. Ngo, Contention free MAC protocol for wireless ATM, in: Proceedings of ACTS Mobile Summit, 1997.
5. S.J. Golestani, A self-clocked fair queuing scheme for broadband applications, in: Proceedings of IEEE INFOCOM'94, June 1994.
6. M.S. Gast. 802.11 Wireless Networks: The Definitive Guide. 1st Ed., OReilly, April 2002.
7. A. Andreadis, G. Benelli, G. Giambene, V. Pasqualetti, High-capacity resource sharing schemes for broadband wireless networks. Journal on Wireless Communications and Mobile Computing, John Wiley and Sons, 4: 395-412, 2004.
8. Hertz J., Krogh A., and Palmer R. Introduction to the Theory of Neural Computation (1991), Addison Wesley
9. Andersson C.W. Learning to control an inverted pendulum using neural networks. IEEE Control Systems Magazine 9 3 (1989) 31-36
10. Supplement to IEEE Standard for Information Tachnology-Telecommunications and information technology exchange between system and metropolitan area networks-Specific requirements. PART 11: Wireless Lan Medium Access Control (MAC) and Physical Layer (PHY) specifications: Higher Speed Physical Layer Extension in the 2.4 Ghz Band. IEEE, 1999. IEEE Std 802.11b-1999 (Supplement to ANSI IEEE802.11,1999 Edition).
11. Sinha P., Nandagopal T., Venkitaraman N., Sivakumar R., and Bharghavan V. WTCP: a reliable transport protocol for wireless wide-area networks. Wireless Networks 8 2-3 (2002) 301-316
12. W. Stevens. TCP Slow Start, Congestion Avoidance, Fast Retransmit, and Fast Recover Algorithms. IETF RFC 2001, January 1997.
13. Sutton R.S., and Barto A.G. Reinforcement Learning: An Introduction (1998), MIT Press, Cambridge, MA
14. Littman M.L., Pack Kaelbing L., and Moore A.W. Reinforcement learning: a survey. Journal of Artificial Intelligence Research 4 11,28 (1996) 237-285
15. R.S. Sutton. Reinforcement learning: Past, present and future. In SEAL, pages 195-197, 1998.
16. Tesauro G. Temporal difference learning and TD-gammon. Communications of the ACM 38 3 (1995) 58-68
17. W. Zhang and T. G. Dietterich. High-performance job-shop scheduling with a time-delay TD(λ) network, volume 11(28). Cambridge, MA, MIT Press, 1996.
18. Crites R.H., and Barto A.G. Elevator group control using multiple reinforcement learning agents. Machine Learning 33 11,28 (1998) 235-262
19. R.S. Sutton, A.G. Barto, Generalization in reinforcement learning: successful examples using sparse coarse coding. Advances in Neural Information Processing Systems, 8(11,28,72,105): 1038-1044, MIT Press 1996.
20. Schaal S., and Atkenson C.G. Robot juggling: an implementation of memory-based learning. Control System Magazine 14 11,28,29 (1994) 57-71
21. Barto A.G., Sutton R.S., and Anderson C.W. Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Transactions on Systems, Man and Cybernetics, SMC 13 5 (1983) 834-846
22. R.S. Sutton. TD models: modeling the world at a mixture of time scales, in: Proceedings of the International Conference on Machine Learning, 1995, pp. 531-539.
23. J. Karlsson, Learning to Solve Multiple Goals. Ph.D. thesis, University of Rochester, 1997.
24. Bellman R. Dynamic programming treatment of the travelling salesman problem. Journal of ACM 9 1 (1962) 61-63
25. Bridle J.S. Training stochastic model recognition algorithms as networks can lead to maximum mutual information estimation of parameters (1990), Morgan Kaufmann Publishers Inc.
26. Milstein L.B., and Wilhelmsson L. On the effect of imperfect interleaving for the Gilbert-Elliot channel. IEEE Transactions on Communications 47 5 (1999) 681-688
27. A. Pattavina, A. Cannarsi, M. De Marco, Quality of services issues in extending ATM to wireless networks, in: Proceedings of ICUPC'98, October 1998.
28. Karim M.R. ATM Technology and Services Delivery (2000), Prentice Hall
29. A.Y. Seydim. Wireless ATM (WATM): An overview. EE 8304 Spring 2000 - Southern Methodist University, Texas, USA. Available at the URL: .
30. L. Wischhof, J. Lockwood. Packet scheduling for link-sharing and quality of service support in wireless local area networks. Technical Report WUCS-01-35, Applied Research Laboratory, Washington University in St. Louis, November 2001.
31. D. Verma, H. Zhang, D. Ferrari, Delay jitter control for real-time communication in a packet switching network, in: Proceedings of TriCom, 1991.
32. Fukunaga K. Statistical Pattern Recognition (1990), Academic Press, San Diego
33. Brady P.T. A model for on-off speech patterns in two-way conversations. Bell System Technical Journal 48 (1969) 2445-2472
34. O. Casals, C. Blondia, Performance analysis of statistical multiplexing of VBR sources, in: Proceedings of INFOCOM'92, 1992, pp. 828-838.
35. Aghvami A.H., and Brand A.E. Multidimensional PRMA with priorized Bayesan broadcast. IEEE Transactions on Vehicular Technology 47 (1998) 1148-1161