Distributed Q-learning for interference control in OFDMA-based femtocell networks

IEEE Vehicular Technology Conference

Volumn , Issue , 2010, Pages

  Galindo Serrano, Ana ^a   Giupponi, Lorenza ^a  

^a CENTRE TECNOLÒGIC DE TELECOMUNICACIONS DE CATALUNYA CTTC   (Spain)

Author keywords

Decentralized Q learning; Femtocell system; Interference management; Multi agent system

Indexed keywords

CELLULAR NETWORK; DISTRIBUTED Q-LEARNING; INTERFERENCE CONTROL; INTERFERENCE MANAGEMENT; INTERFERENCE PROBLEMS; MULTI-AGENT REINFORCEMENT LEARNING; OPTIMAL POLICIES; ORTHOGONAL FREQUENCY DIVISION MULTIPLE ACCESS; POWER ALLOCATIONS; Q-LEARNING; RADIO RESOURCES; SELF-ORGANIZED; SIMULATION RESULT; SURROUNDING ENVIRONMENT; SYSTEM CAPACITY;

AD HOC NETWORKS; CELLULAR NEURAL NETWORKS; COMPUTER SIMULATION; FREQUENCY DIVISION MULTIPLE ACCESS; MOBILE TELECOMMUNICATION SYSTEMS; MULTI AGENT SYSTEMS; REINFORCEMENT; WIRELESS TELECOMMUNICATION SYSTEMS;

MULTIPLE ACCESS INTERFERENCE;

EID: 77954904158     PISSN: 15502252     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VETECS.2010.5493950     Document Type: Conference Paper

References (10)

1. S. R. Saunders, S. Carlaw, A. Giustina, R. R. Bhat, V. S. Rao, and R. Siegberg, Femtocells: Oppotunities and Challenges for Business and Technology. Great Britain: John Wiley & Sons Ltd., 2009.
2. V. Chandrasekhar, J. G. Andrews, and A. Gatherer, "Femtocell networks: A survey," IEEE Communication Magazine, vol.46, no.9, pp. 59-67, Sept. 2008.
3. N. Arulselvan, V. Ramachandran, S. Kalyanasundaram, and G. Han, "Distributed power control mechanisms for HSDPA femtocells," in IEEE 69th Vehicular Thechnology Conference, April 2009, pp. 1-5.
4. D. López-Pérez, A. Valcarce, G. D. L. Roche, E. Liu, and J. Zhand, "Access methods to WiMAX femtocells: A downlink system-level case study," in Communication Systems, 2008. ICCS 2008. 11th IEEE Singapore International Conference on, Nov. 2008.
5. K. P. Sycara, "Multiagent systems," AI Magazine, vol.19, no.2, pp. 79-92, 1998.
6. M. E. Harmon and S. S. Harmon, "Reinforcement learning: A tutorial," 2000.
7. C. J. Watkins and P. Dayan, "Technical note: Q-learning," Machine Learning, vol.8, pp. 279-292, 1992.
8. L. Panait and S. Luke, "Cooperative multi-agent learning: The state of the art," Autonomous Agents and Multi-Agent Systems, vol.3, no.11, pp. 383-434, Nov. 2005.
9. (2008, Dec.) Interference management in UMTS femtocell. [Online]. Available: http://www.femtoforum.org/femto/Files/File/InterferenceManagement inMTS Femtocells.pdf
10. J. Salo, G. Del Galdo, J. Salmi, P. Kysti, M. Milojevic, D. Laselva, and C. Schneider, "MATLAB implementation of the 3GPP Spatial Channel Model (3GPP TR 25.996)," On-line, Jan. 2005, http://www.tkk.fi/Units/Radio/scm/.