From cognition to docition: The teaching radio paradigm for distributed & autonomous deployments

Computer Communications

Volumn 33, Issue 17, 2010, Pages 2015-2020

  Giupponi, Lorenza ^a   Galindo Serrano, Ana M ^a   Dohler, Mischa ^a  

^a CENTRE TECNOLÒGIC DE TELECOMUNICACIONS DE CATALUNYA CTTC   (Spain)

Author keywords

Aggregated interference; Cognitive radio; Decentralized Q learning; Docitive learning; Multi agent system

Indexed keywords

ACCESS POINTS; AGGREGATED INTERFERENCE; AUTONOMOUS NETWORKING; COGNITIVE RADIO; COGNITIVE STATE; COMMUNICATION PARADIGM; CONTROL OVERHEAD; CONVERGENCE SPEED; DECENTRALIZED Q-LEARNING; DISTRIBUTED LEARNING; DOCITIVE LEARNING; FEMTO CELLS; INDEPENDENT LEARNING; MULTI-AGENT REINFORCEMENT LEARNING; NON-STATIONARITIES; PERFORMANCE TARGETS; REAL TIME; RUNTIMES; SELF ADAPTATION; SELF-ADAPT; SPEED-UPS; START-UPS; SURROUNDING ENVIRONMENT; SYSTEM DYNAMICS;

CONVERGENCE OF NUMERICAL METHODS; DISTRIBUTED COMPUTER SYSTEMS; MULTI AGENT SYSTEMS; RADIO;

LEARNING ALGORITHMS;

EID: 77957133340     PISSN: 01403664     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.comcom.2010.07.025     Document Type: Article

References (24)

1. S. Haykin Cognitive radio: brain-empowered wireless communications IEEE J. Select. Areas Commun 23 2005 201 220
2. J.I. Mitola, and G.Q.J. Maguire Cognitive radio: making software radios more personal IEEE [see also IEEE Wireless Communications] Personal Commun. 6 1999 13 18
3. M. Dohler, L. Giupponi, A. Galindo, P. Blasco, Docitive networks: A novel framework beyond cognition, IEEE Communications Society, Multimedia Communications TC, E-Letter (Jan. 2010).
4. L. Giupponi, A. Galindo, P. Blasco, M. Dohler, Docitive networks - an emerging paradigm for dynamic spectrum management, IEEE Wireless Comm. Magazine, Special Issue on Dynamic Spectrum Management, 2010.
5. M. Tan Multi-Agent Reinforcement Learning: Independent vs. Cooperative Agents M.N. Huhns, M.P. Singh, 1993 Morgan Kaufmann San Francisco, CA, USA 451 480
6. M.N. Ahmadabadi, and M. Asadpour Expertness based cooperative Q-learning IEEE Transactions on Systems, Man, and Cybernetics, Part B 32 2002 66 76
7. D. Fudenberg, and L. D. The Theory of Learning in Games 1998 MIT Press
8. K.D. Jong Evolutionary Computation: A Unified Approach 2005 MIT Press
9. R. Bellman Dynamic Programming 1957 Princeton Univ. Press Princeton, NJ
10. G. Brown Iterative solution of games by fictitious play Activity Analysis of Production and Allocation 1951 John Wiley and Sons New York
11. R. Powers, Y. Shoham, New criteria and a new algorithm for learning in multi-agent systems, in: Proc. of Advances in Neural Information Processing Systems (NISP2004), pp. 1089-1096.
12. G. Tesauro, Extending Q-learning to general adaptive multi-agent systems, in: Proc. of Advances in Neural Information Processing Systems (NISP2003), pp. 1089-1096.
13. M. Weinberg, J.S. Rosenschein, Best response multi-agent learning in non stationary environments, in: Proc. of 3rd International Joint Conference on Autonomous Agents and Multi agent systems (AAMAS 2004), pp. 506-513.
14. M.L. Littman, Markov games as a framework for multi-agent reinforcement learning, in: Proc. of the 11th International Conference on machine Learning, pp. 157-163.
15. C. Claus, C. Boutilier, The dynamics of reinforcement learning in cooperative multi-agent systems, in: Proc. of the 15th national Conference on Artificial Intelligence, pp. 746-752.
16. M.L. Littman, Friend-or-foe Q-learning in general-sum games, in: Proc. of the 18th International Conference on machine Learning.
17. J. Hu, and M. Wellman Nash Q-learning for general-sum stochastic games J. Mach. Learn. Res. 4 2003 1039 1069
18. A. Greenwald, K. Hall, Correlated Q-learning, in: Proc. of 20th International Conference on Machine Learning (ICML 2003), pp. 242-249.
19. V. Kononen, Asymmetric multiagent reinforcement learning, in: Proc. of IEEE/WIC International Conference on Intelligent Agent Technology (IAT 2003), pp. 336-342.
20. A. Greenwald, A. Jafari, A class of no-regret algorithms and game-theoretic equilibria, in: Proc. of 2003 Computational Learning Theory Conference, pp. 1-11.
21. Y. Freund, R. Schapire, A decision-theoretic generalization of online learning and an application to boosting, in: Proc. of 2nd European Computational Learning Theory Conference, pp. 23-37.
22. J. Hu, and M.P. Wellman Technical note: Q-learning Mach. Learn. 8 1992 279 292
23. 3GPP, 3GPP TSG RAN WG4 (Radio) Meeting 51: Simulation assumptions and parameters for FDD HeNB RF requirements, Technical Report, 2009.
24. A. Galindo, L. Giupponi, M. Dohler, Cognition and docition in OFDMA-based femtocell networks, in: IEEE Globecom 2010, Miami, USA.