Reinforcement learning based auction algorithm for dynamic spectrum access in cognitive radio networks

IEEE Vehicular Technology Conference

Volumn , Issue , 2010, Pages

  Teng, Yinglei ^a   Zhang, Yong ^a   Niu, Fang ^a   Dai, Chao ^a   Song, Mei ^a  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

Author keywords

[No Author keywords available]

Indexed keywords

AUCTION ALGORITHMS; AUCTION MARKETS; BIDDING PRICES; BIDDING STRATEGY; COGNITIVE RADIO NETWORK; DYNAMIC SPECTRUM ACCESS; PACKET TRANSMISSIONS; Q-LEARNING; SIMULATION RESULT; TIME VARYING; TRANSMISSION RATES;

PACKET NETWORKS; SPECTROSCOPY;

LEARNING ALGORITHMS;

EID: 78649406105     PISSN: 15502252     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VETECF.2010.5594301     Document Type: Conference Paper

References (8)

1. S.Haykin, "Cognitive radio: brain-empowered wireless communications," IEEE Journal on Seleted Areas in Communications, Vol. 23, no.2, pp. 201-220, Feb. 2005.
2. Federal Communications Commission, "Notice of proposed rule making and order: Facilitating opportunities for flexible, efficient, and reliable spectrum use employing cognitive radio technologies," ET Docket No. 03-108, Feb. 2005.
3. D. Niyato, E. Hossain, "Spectrum trading in cognitive radio networks: a market-equilibrium-based approach" IEEE Wireless Communications, Vol.15, no. 6, pp. 71-80, Dec.2008.
4. W. Beibei, W. Yongle, "Game theoretical mechanism design methods," IEEE Signal Processing Magazine, Vol.25, no.6, pp. 74- 84 , Nov.2008.
5. R. S. Sutton and A. G. Barto, Reinforcement Learning, Cambridge,MA: MIT Press, 1998.
6. Fu Fangwen, M.van der Schaar, "Learning to Compete for Resources in Wireless Stochastic Games," IEEE Transactions on Vehicular Technology, Vol.58 , no. 4 , pp. 1904-1919, 2009.
7. T. Jakkola and S. P. Singh, "On the convergence of stochastic iterative dynamic programming algorithms," Neural Computation, vol.6, no.6, pp. 1185-1201, Jun.1994.
8. T.Venkatesh, Y.V. Kiran, C.S.R. Murthy, "Joint Path and Wavelength Selection using Q-learning in Optical Burst Switching Networks," in Proc. IEEE Globecom, pp.1-5, 2009.