Distributed self-learning scheduling approach for wireless sensor network

Ad Hoc Networks

Volumn 11, Issue 4, 2013, Pages 1276-1286

  Niu, Jianjun ^a,b   Deng, Zhidong ^a  

^a TSINGHUA UNIVERSITY   (China)

^b Beijing Special Engineering Design and Research Institute   (China)

Author keywords

Distributed approach; Energy consumption; Latency; Q learning; Scheduling; Wireless sensor network

Indexed keywords

DISTRIBUTED APPROACHES; DISTRIBUTED SCHEDULING; ENERGY CONSTRAINT; LATENCY; OPTIMAL SCHEDULING; Q-LEARNING; REDUCE ENERGY CONSUMPTION; TRANSMISSION PARAMETERS;

ENERGY UTILIZATION; MEDIUM ACCESS CONTROL; SCHEDULING; WIRELESS SENSOR NETWORKS;

SENSOR NODES;

EID: 84877578845     PISSN: 15708705     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.adhoc.2010.11.004     Document Type: Article

References (28)

1. I.F. Akyildiz, W. Su, Y. Sankarasubramaniam, and E. Cayirci Wireless sensor networks: a survey Computer Networks 38 2002 393 422
2. J. Yick, B. Mukherjee, and D. Ghosal Wireless sensor network survey Computer Networks 52 2008 2292 2330
3. D. Estrin Tutorial Wireless Sensor Networks Part IV: Sensor Network Protocols 2002 MobiCom
4. G. Anastasi, M. Conti, M. Francesco, and A. Passarella Energy conservation in wireless sensor networks: a survey Ad Hoc Networks 7 3 2009 537 568
5. L. Wang, and Y. Xiao A survey of energy-efficient scheduling mechanisms in sensor networks Mobile Networks and Application 11 2006 723 740
6. N.A. Pantazis, D.J. Vergados, D.D. Vergados, and C. Douligeris Energy efficiency in wireless sensor networks using sleep mode TDMA scheduling Ad Hoc Networks 7 2009 322 343
7. S. Gandham, M. Dawande, and R. Prakash Link scheduling in wireless sensor networks: distributed edge-coloring revisited Journal of Parallel and Distributed Computing 68 2008 1122 1134
8. Y. Yi, G.D. Veciana, S. Shakkottai, On optimal MAC scheduling with physical interference, in: Proceedings of 26th IEEE International Conference on Computer Communications (INFOCOM 2007), IEEE Press, 2007, pp. 294-302.
9. C. Cano, B. Bellalta, A. Sfairopoulou, and J. Barcelo A low power listening MAC with scheduled wake up after transmissions for WSNs IEEE Communications Letters 13 2009 221 223
10. Y. Chang, J. Jian, J. Sheu, H. Shih, ADCA: an asynchronous duty cycle adjustment MAC protocol for wireless sensor networks, in: Proceedings of IEEE GLOBECOM, IEEE Press, New Orleans, LA, USA, November 2008, pp. 1-5.
11. S. Visweswara, R. Dutta, and M. Sichitiu Adaptive ad hoc self-organizing scheduling for quasi-periodic sensor network lifetime Computer Communication 29 2006 3366 3384
12. J. Polastre, J. Hill, D. Culler, Versatile low power media access for wireless sensor networks, in: Proceedings of the Second International Conference on Embedded Networked Sensor Systems (SenSys 2004), 2004, pp. 95-107.
13. M. Buettner, G.V. Yee, E. Anderson, R. Han, X-MAC: a short preamble MAC protocol for duty-cycled wireless sensor networks. in: Proceedings of the Fourth International Conference on Embedded Networked Sensor Systems (SenSys'06), 2006, pp. 307-320.
14. Y. Sun, O. Gruewitz, D. B. Johnson, RI-MAC: a receiver-initiated asynchronous duty cycle MAC protocol for dynamic traffic loads in wireless sensor networks, in: Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems (SenSys'08), 2008, pp. 1-14.
15. W. Ye, J. Heidemann, D. Estrin, An energy-efficient MAC protocol for wireless sensor networks, in: Proceedings of IEEE INFOCOM, New York, June 2002, pp. 1567-1576.
16. T.V. Dam, K. Langendoen, An adaptive energy-efficient MAC protocol for wireless sensor networks, in: Proceedings of the 1st International Conference on Embedded Networked Sensor Systems, 2003, pp. 171-180.
17. S. Liu, K.-W. Fan, and P. Sinha CMAC: an energy-efficient MAC layer protocol using convergent packet forwarding for wireless sensor networks ACM Transactions on Sensor Networks 5 4 2009 29 34
18. Y. Sun, S. Du, O. Gurewitz, D.B. Johnson, DW-MAC: a low latency, energy efficient demand-wakeup MAC protocol for wireless sensor network, in: Proceedings of the 9th ACM International Symposium on Mobile Ad Hoc Networking And Computing (MobiHoc'08), 2008, pp. 53-62.
19. R.S. Sutton, and A.G. Barto Reinforcement Learning: An Introduction 1998 The MIT Press Cambridge, Massachusetts, London, England
20. A. Bonarini, A. Lazaric, F. Montrone, and M. Restelli Reinforcement distribution in fuzzy Q-learning Fuzzy Sets and Systems 160 10 2009 1420 1443
21. C. Szepesvari, Interpolation-based Q-learning, in: Proceedings of the 21th International Conference on Machine Learning, July 4-8, 2004, pp. 791-798.
22. H. Hansselt, and M. Wiering Reinforcement learning in continuous action spaces Proceedings of the 2007 IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning 2007 IEEE Press 272 279 April 1-5
23. D. Vinceze, S. Kovacs, Fuzzy rule interpolation-based Q-learning, in: Proceedings of 5th International Symposium on Applied Computational Intelligence and Informatics, Timisoara, Romaria, May 28-29, 2009, pp. 55-59.
24. J. Millan, D. Posenato, and E. Dedieu Continuous-action Q-learning Machine Learning 49 2002 247 265
25. A. Meier, M. Woehrle, M. Zimmerling, L. Thiele, ZeroCal: automatic MAC protocol calibration, in: Proceedings of the 6th IEEE International Conference on Distributed Computing in Sensor Systems (DCOSS 2010), 2010, pp. 31-44.
26. G. Weiss Multiagent Systems: A modern Approach to Distributed Artificial Intelligence 2000 The MIT Press Cambridge, Massachusetts, London, England
27. Crossbow Technology, MPR-MIB Users Manual (Revision A), Crossbow Technology: San Jose, CA, USA, 2007.
28. P. Dutta, J. Taneja, J. Jeong, X. Jiang, D. Culler, A building block approach to sensornet systems, in: Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems (Sensys'08), 2008, pp. 267-280.