Application of reinforcement learning to medium access control for wireless sensor networks

Engineering Applications of Artificial Intelligence

Volumn 46, Issue , 2015, Pages 23-32

  Chu, Yi ^a   Kosunalp, Selahattin ^a   Mitchell, Paul D ^a   Grace, David ^a   Clarke, Tim ^a  

^a UNIVERSITY OF YORK   (United Kingdom)

Author keywords

Medium access control; Reinforcement learning; Wireless sensor networks

Indexed keywords

ENERGY EFFICIENCY; LEARNING SYSTEMS; MARKOV PROCESSES; REINFORCEMENT LEARNING; WIRELESS SENSOR NETWORKS;

CONVERGENCE TIME; FRAME-BASED; LEARNING PROCESS; LOWER COMPLEXITY; MARKOV MODEL; Q-LEARNING; RANDOM ACCESS; SLOTTED ALOHA;

MEDIUM ACCESS CONTROL;

EID: 84946024730     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2015.08.004     Document Type: Article

References (36)

1. F. Akyildiz, Y. Sankarasubramaniam, E. Cayirci, and W. Su Wireless sensor networks: a survey Comput. Netw. 40 2002 393 422
2. Abramson N., 1970. The aloha system: another alternative for computer communications, In: Proceedings of the AFIPS '70 (Fall), pp. 281-285.
3. J. Barcelo, B. Bellalta, C. Cano, A. Sfairopoulou, M. Oliver, and K. Verma Towards a collision-free WLAN: dynamic parameter adjustment in CSMA/E2CA EURASIP J. Wirel. Commun. Netw 2011
4. Chu Y., Mitchell P.D., Grace D., 2012a. Reinforcement learning based ALOHA for multi-hop wireless sensor networks with informed receiving, In: Proceedings of the IET Conference on Wireless Sensor Systems (WSS), pp. 1-6.
5. Chu Y., Mitchell P.D., Grace D., 2012b. ALOHA and Q-Learning based medium access control for wireless sensor networks, In: Proceedings of the International Symposium on Wireless Communication Systems (ISWCS), pp. 511-515.
6. C.-M. Chao, and Y.-W. Lee A quorum-based energy-saving MAC protocol design for wireless sensor networks IEEE Trans. Veh. Technol. 59 2 2010 813 822
7. Y.L. Chen, N.C. Wang, M.Y. Chen, Y.F. Huang, and Y.N. Shih A concentric clustering architecture with PSO algorithm in a wireless sensor network Sens. Mater.: Int. J. Sens. Technol. 26 5 2013 325 332
8. Y.L. Chen, M.Y. Chen, F.K. Cheung, and Y.C. Chang A new hybrid architecture with an intersection-based coverage algorithm in wireless sensor networks Comput. Sci. Inf. Syst. J. 11 3 2014 1017 1035
9. I. Demirkol, C. Ersoy, and F. Alagoz MAC protocols for wireless sensor networks: a survey Commun. Mag. 44 2006 115 121
10. M. Fang, D. Malone, K. Duffy, and D. Leith Decentralised learning MACs for collision-free access in WLANs Wirel. Netw. 19 1 2013 83 98
11. D.T. Finkbeiner II Introduction to Matrices and Linear Transformations 1978 Freeman San Francisco
12. IEEE Standard for Local and Metropolitan area networks, 2012. Part 15.4: Low-Rate Wireless Personal Area Networks.
13. L.P. Kaelbling, M.L. Littman, and A.W. Moore Reinforcement learning: a survey Artif. Intell. Res. 4 1996 237 285
14. B.-J. Kwak, N.-O. Song, and L.E. Miller Performance analysis of exponential backoff IEEE/ACM Trans. Netw. 13 2005 343 355
15. L. Kleinrock, and F.A. Tobagi Packet switching in radio channels: Part 1-carrier sense multiple-access modes and their throughput-delay characteristics IEEE Trans. Commun. 23 1975 1400 1416
16. H. Li, D. Grace, P.D. Mitchell, 2010. Cognitive radio multiple access control for unlicensed and open spectrum with reduced spectrum sensing requirements, In: Proceedings of the International Symposium on Wireless Communication Systems (ISWCS), pp. 1046-1050.
17. P. Lin, C. Qiao, X. Wang, 2004. Medium access control with a dynamic duty cycle for sensor networks, In: Proceedings of the IEEE Wireless Communications and Networking Conference (WCNC), pp. 1534-1539.
18. Lindsey S., Raghavendra, C.S., 2002. PEGASIS: power-efficient gathering in sensor information systems, In: Proceedings of the IEEE Aerospace Conference, Big Sky, Montana, pp. 1124-1130.
19. J. Li A Bit-Map Assisted Energy-Efficient MAC Scheme for Wireless Sensor Networks (MS. thesis) 2004 Electrical Engineering, Mississippi State University Starkville, MS
20. D. Poole Linear Algebra. A Modern Introduction 2005 Cengage Learning Boston
21. I. Rhee, A. Warrier, M. Aia, J. Min, and M.L. Sichitiu Z-MAC: A hybrid mac for wireless sensor networks IEEE/ACM Trans. Netw. 16 2008 511 524
22. Rhee I., Warrier A., J. Min, Xu L., 2006. Drand: distributed randomized TDMA scheduling for wireless ad hoc networks, In:Proceedings of the ACM International Symposium on Mobile Ad Hoc Networking and Computing (MOBIHOC), pp. 190-201.
23. V. Rajendran, K. Obraczka, and J.J. Garcia-Luna-Aceves Energy-efficient, collision-free medium access control for wireless sensor networks Wirel. Netw. 12 2006
24. Y. Sun, S. Du, O. Gurewitz, D. Johnson, 2008. DW-MAC: A low latency, energy efficient demand-wakeup MAC protocol for wireless sensor networks, In: Proceedings of the ACM International Symposium on Mobile Ad Hoc Networking and Computing (MOBIHOC), pp. 53-62.
25. C. Schurgers, M.B. Srivastava, 2001. Energy efficient routing in wireless sensor networks, In:Proceedings of the MILCOM Commununications for Network-Centric Operations: Creating the Information Force, Mclean.
26. G.M. Shafiullah, Salahuddin A. Azad, and A.B.M. Shawkat Ali Energy-efficient wireless MAC protocols for railway monitoring applications IEEE Trans. Intell. Transp. Syst. 14 2 2013 649 659
27. R.S. Suttong, and A.G. Barto Reinforcement Learning: An Introduction 1998 MIT Press Cambridge, MA
28. The ZigBee Alliance, 2015. (www.zigbee.org) (retrieved 06.02.15).
29. Tang Y., Grace D. Clarke T., Wei J., Multichannel non-persistent CSMA MAC schemes with reinforcement learning for cognitive radio networks, In: Proceedings of the International Symposium on Communications and Information Technologies (ISCIT), pp. 502-506.
30. TinyOS: An operating system for wireless sensor networks, 2005. Ambient Intelligence, Springer-Verlag, Berlin, 115-148.
31. M.C. Vuran, and I.F. Akyildiz Spatial correlation-based collaborative medium access control in wireless sensor networks IEEE/ACM Trans. Netw. 14 2 2006 316 329
32. R.S. Varga Geršgorin and His Circles 2004 Springer-Verlag Berlin
33. Y. Wei, J. Heidemann, and D. Estrin Medium access control with coordinated adaptive sleeping for wireless sensor networks IEEE/ACM Trans. Netw. 12 3 2004 493 506
34. X. Wang, G. Xing, Y. Zhang, C. Lu, R. Pless, and C. Gill Integrated coverage and connectivity configuration for energy conservation in sensor networks ACM Trans. Sens. Netw. 1 1 2005 36 72
35. Chu Yi Application of Reinforcement Learning on Medium Access Control for Wireless Sensor Networks (Ph.D. thesis) 2013 University of York UK
36. (http://www.memsic.com/userfiles/files/datasheets/wsn/iris-datasheet.pdf) (retrieved 06.02.15).