Cognition and docition in OFDMA-based femtocell networks

GLOBECOM - IEEE Global Telecommunications Conference

Volumn , Issue , 2010, Pages

  Galindo Serrano, Ana ^a   Giupponi, Lorenza ^a   Dohler, Mischa ^a  

^a CENTRE TECNOLÒGIC DE TELECOMUNICACIONS DE CATALUNYA CTTC   (Spain)

Author keywords

Decentralized Q learning; Femtocell system; Interference management; Multi agent system

Indexed keywords

DECISION MAKING; FEMTOCELL; FREQUENCY DIVISION MULTIPLE ACCESS; ITERATIVE METHODS; LEARNING ALGORITHMS; ORTHOGONAL FREQUENCY DIVISION MULTIPLEXING; REINFORCEMENT LEARNING;

DECENTRALISED; DECENTRALIZED Q-LEARNING; FEMTOCELL NETWORKS; FEMTOCELL SYSTEMS; FEMTOCELLS; FREQUENCY-DIVISION MULTIPLE ACCESS; INTERFERENCE MANAGEMENT; MACRO CELLS; ORTHOGONAL FREQUENCY DIVISION MULTIPLES; Q-LEARNING;

MULTI AGENT SYSTEMS;

EID: 79551652068     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/GLOCOM.2010.5683552     Document Type: Conference Paper

References (12)

1. S. R. Saunders, S. Carlaw, A. Giustina, R. R. Bhat, V. S. Rao, and R. Siegberg, Femtocells: Oppotunities and Challenges for Business and Technology. Great Britain: John Wiley & Sons Ltd., 2009.
2. C. J. Watkins and P. Dayan, "Technical note: Q-learning," Machine Learning, vol. 8, pp. 279-292, 1992.
3. M. N. Ahmadabadi and M. Asadpour, "Expertness based cooperative Qlearning," IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 32, no. 1, pp. 66-76, Feb. 2002.
4. M. Tan, Multi-Agent Reinforcement Learning: Independent vs. Cooperative Agents. In M. N. Huhns and M. P. Singh, editors. Morgan Kaufmann, San Francisco, CA, USA., 1993, ch. 26, pp. 451-480.
5. M. Dohler, L. Giupponi, A. Galindo-Serrano, and P. Blasco, "Docitive networks: A novel framework beyond cognition," IEEE Communications Society, Multimdia Communications TC, E-Letter, Jan. 2010.
6. J. Watkins and P. Dayan, "Nash Q-learning for general-sum stochastic games," Journal of Machine Learning Research, vol. 4, pp. 1039-1069, 2003.
7. A. Galindo-Serrano and L. Giupponi, "Distributed Q-learning for interference control in OFDMA-based femtocell networks," in IEEE 71th Vehicular Thechnology Conference, VTC Spring 2010, Taipei, Taiwan, May 2010.
8. L. Panait and S. Luke, "Cooperative multi-agent learning: The state of the art," Autonomous Agents and Multi-Agent Systems, vol. 3, no. 11, pp. 383-434, Nov. 2005.
9. A. Galindo-Serrano and L. Giupponi, "Distributed Q-learning for aggregated interference control in cognitive radio networks," IEEE Trans. on Vehicular Technology, vol. 59, no. 4, pp. 1823-1834, May 2010.
10. 3GPP, "3GPP R4-092042 TSG RAN WG4 (Radio) Meeting 51: Simulation assumptions and parameters for FDD HeNB RF requirements," Tech. Rep., 4-8 May 2009.
11. J. Salo, G. Del Galdo, J. Salmi, P. Kysti, M. Milojevic, D. Laselva, and C. Schneider, "MATLAB implementation of the 3GPP Spatial Channel Model (3GPP TR 25.996)," On-line, Jan. 2005, http://www.tkk.fi/Units/Radio/scm/.
12. G. Scutari, D. P. Palomar, and S. Barbarossa, "Asynchronous iterative waterfilling for gaussian frequency-selective interference channels," IEEE Transanctions on Information Theory, vol. 54, no. 7, pp. 2868-2878, Jul 2008.