Use of Q-learning approaches for practical medium access control in wireless sensor networks

Engineering Applications of Artificial Intelligence

Volumn 55, Issue , 2016, Pages 146-154

  Kosunalp, Selahattin ^a,b   Chu, Yi ^b   Mitchell, Paul D ^b   Grace, David ^b   Clarke, Tim ^b  

^a BAYBURT UNIVERSITY   (Turkey)

^b UNIVERSITY OF YORK   (United Kingdom)

Author keywords

ALOHA; Medium access control; Q Learning; Wireless sensor networks

Indexed keywords

ACCESS CONTROL; WIRELESS SENSOR NETWORKS;

ALOHA; ENVIRONMENT CONDITIONS; EXPLORATION/EXPLOITATION; EXTENSIVE SIMULATIONS; MEDIUM ACCESS CONTROL(MAC); Q-LEARNING; Q-LEARNING APPROACH; TRANSMISSION STRATEGIES;

MEDIUM ACCESS CONTROL;

EID: 84977137236     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2016.06.012     Document Type: Article

References (18)

1. Akyildiz, I.F., Su, W., Sankarasubramaniam, Y., Cayirci, E., A survey on sensor networks. Commun. Mag. 40:8 (2002), 102–114.
2. Chu, Y., Mitchell, P.D., Grace D., 2012. ALOHA and Q-learning based medium access control for wireless sensor networks. In: Proceedings of the International Symposium on Wireless Communication Systems, pp. 511–515.
3. Datasheet for IRIS, 2014. Wireless Measurement System. Available online at: 〈http://bullseye.xbow.com:81/Products/productdetails.aspx?sid=264〉, (accessed July, 2014).
4. Datasheet for MicaZ, 2014. Wireless Measurement System. Available online at: 〈http://www.openautomation.net/uploadsproductos/micaz_datasheet.pdf〉, (accessed July, 2014).
5. Demirkol, I., Ersoy, C., Alagoz, F., MAC protocols for wireless sensor networks: a survey. Commun. Mag. 44:4 (2006), 115–121 2006.
6. Kosunalp, S., Mitchell, P.D., Grace, D., Clarke, T., 2013. Practical implementation issues of reinforcement learning based ALOHA for wireless sensor networks. In: Proceedings of the International Symposium on Wireless Communication Systems, pp. 360–364.
7. Levis, P., Madden, S., Polastre, J., Szewczyk, R., Whitehouse, K. Woo, A., Gay, D., Hill, J., Welsh, M., Brewer, E., Culler, D., 2005. TinyOS: an operating system for wireless sensor networks. Ambient Intelligence, Springer, Verlag, pp. 115–148.
8. Liu, Z., Elhanany, I., 2006. RL-MAC: a QoS-aware reinforcement learning based MAC protocol for wireless sensor networks. In: Proceedings of the IEEE ICNSC, pp. 768–773.
9. Mihaylov, M., Elhanany, Y.L. Borgne, Decentralised reinforcement learning for energy-efficient scheduling in wireless sensor networks. Int. J. Commun. Netw. Distrib. Syst. 9:3–4 (2012), 207–224.
10. Niu, J., Deng, Z., Distributed self-learning scheduling approach for wireless sensor network. Ad Hoc Netw. 11:4 (2013), 1276–1286.
11. Rhee, I., Warrier, A., Aia, M., Min, J., Sichitiu, M.L., Z-MAC: a hybrid mac for wireless sensor networks. IEEE/ACM Trans. Netw. 16:3 (2008), 511–524.
12. Sangwon, H., Ning, P., 2011. Secure code dissemination in wireless sensor networks. Encyclopedia of Cryptography and Security, Springer, US, pp. 1099–1102.
13. Stefano, G., Liotta, A., Fortino, G., 2013. QL-MAC: a Q-Learning based MAC for wireless sensor networks. Algorithms and Architectures for Parallel Processing, Springer International Publishing, pp. 267–275.
14. Sutton, R.S., Barto, A.G., Reinforcement learning: an introduction. 1998, MIT Press, Cambridge, MA.
15. Yan, Y., Mitchell, P.D., Clarke, T., Grace, D., 2013. Distributed frame size selection for Q Learning based Slotted ALOHA protocol. In: Proceedings of the International Symposium on Wireless Communication Systems, pp. 733–737.
16. Yan, Y., Mitchell, P.D., Clarke, T., Grace, D., 2014. Adaptation of the ALOHA-Q protocol to multi-hop wireless sensor networks. In: Proceedings of the 20th European Wireless Conference, pp. 921–926.
17. Ye, W., Heidemann, J., Estrin, D., 20012. An energy-efficient mac protocol for wireless sensor networks. In: Proceedings of the IEEE INFOCOM, pp. 1567–1576.
18. Yigitel, M.A., Incel, O.D., Ersoy, C., QoS-aware mac protocols for wireless sensor networks: a survey. Comput. Netw. 55:8 (2011), 1982–2004.