Self-learning scheduling approach for wireless sensor network

Proceedings of the 2010 2nd International Conference on Future Computer and Communication, ICFCC 2010

Volumn 3, Issue , 2010, Pages

  Niu, Jianjun ^a,b  

^a TSINGHUA UNIVERSITY   (China)

^b Beijing Special Engineering Design and Research Institute   (China)

Author keywords

Reinforcement learning; Scheduling; Wireless sensor network

Indexed keywords

CONTINUOUS VALUE; ENERGY CONSUMPTION; KEY ISSUES; MAC PROTOCOL; PACKET TRANSMISSIONS; Q-LEARNING METHOD; QOS METRICS; S-MAC PROTOCOLS; SELF-LEARNING; SIMULATION RESULT; SLEEP SCHEDULING; TRANSMISSION PARAMETERS; WIRELESS SENSOR;

ENERGY EFFICIENCY; ENERGY UTILIZATION; NETWORK PERFORMANCE; REINFORCEMENT LEARNING; SCHEDULING; SENSOR NETWORKS; SLEEP RESEARCH; WIRELESS SENSOR NETWORKS;

NETWORK PROTOCOLS;

EID: 78049380269     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICFCC.2010.5497643     Document Type: Conference Paper

References (18)

1. I.F. Akyildiz, W. Su, Y. Sankarasubramaniam and E. Cayirci, "Wireless Sensor Networks: A Survey," Comput. Netw, vol. 38, 2002, pp. 393-422, doi: 10.1016/S1389-1286(01)00302-4.
2. F.-Y. Ren, H.-N. Huang and C. Lin. "Wireless Sensor Networks," Journal of Software, vol. 14(7), 2003, pp. 1282-1291. (in Chinese)
3. D. Estrin, Tutorial Wireless Sensor Networks Part IV: Sensor Network Protocols [R]. MobiCom 2002.
4. G. Anastasi, M. Conti, M. D. Francesco and A. Passarella, "Energy Conservation in Wireless Sensor Networks: A Survey," Ad Hoc Networks, vol. 7(3), 2009, pp. 537-568, doi: 10.1016/j.adhoc.2008.06.003.
5. Y. Yao and G.B. Giannakis, "Energy-Efficient Scheduling for Wireless Sensor Networks," IEEE Trans. Commun., Vol. 53, 2005, pp. 1333-1342, doi: 10.1109/TCOMM.2005.852834.
6. Y. Chen and E. Fleury, "A Distributed Policy Scheduling for Wireless Sensor Networks," Proc. of IEEE INFOCOM, IEEE Press, 2007, pp. 1559-1567, doi: 10.1109/INFCOM.2007.183.
7. T. Shu and M. Krunz, "Energy-efficient Power/Rate Control and Scheduling in Hybrid TDMA/CDMA Wireless Sensor Networks," Computer Networks Journal (COMNET), vol. 53(9), 2009, pp. 1395-1408, doi: 10.1016/j.comnet.2009. 01.006.
8. Y. Yi, G.D. Veciana and S. Shakkottai, "On Optimal MAC Scheduling with Physical Interference," Proc. of IEEE INFOCOM, IEEE Press, May 6-12, 2007, pp. 294-302, doi:10.1109/INFCOM.2007.42.
9. C. Cano, B. Bellalta, A. Sfairopoulou and J. Barcelo, "A Low Power Listening MAC with Scheduled Wake Up after Transmissions for WSNs," IEEE Commun. Lett., vol. 13, 2009, pp. 221-223, doi: 10.1109/LCOMM.2009.081831.
10. Y.C. Chang, J.R. Jian, J.P. Sheu and H.Y. Shih, "ADCA: An Asynchronous Duty Cycle Adjustment MAC Protocol for Wireless Sensor Networks," Proc. of IEEE GLOBECOM, IEEE Press, November, 2008, pp. 1-5, doi: 10.1109/GLOCOM.2008.ECP.81.
11. S.C. Visweswara, R. Dutta and M.L. Sichitiu, "Adaptive Ad Hoc Self-Organizing Scheduling for Quasi-Periodic Sensor Network Lifetime," Comput. Commun., vol. 29, 2006, pp. 3366-3384, doi: 10.1016/j.comcom.2006.01. 037.
12. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, The MIT Press, Cambridge, Massachusetts, London, , 1998.
13. A. Bonarini, A. Lazaric, F. Montrone and M. Restelli, "Reinforcement Distribution in Fuzzy Q-learning," Fuzzy Sets and Systems, vol. 160(10), 2009, pp. 1420-1443, doi: 10.1016/j.fss.2008.11.026.
14. P. Baranyi, L. T. Koczy and T. D. Gedeon, "A Generalized Concept for Fuzzy Rule Interpolation," IEEE Transactions on Fuzzy Systems, vol. 12(6), 2004, pp. 820-837, doi: 10.1109/TFUZZ.2004.836085.
15. H. V. Hansselt and M. A. Wiering, "Reinforcement Learning in Continuous Action Spaces," Proc. of the 2007 IEEE Symposium on Approximate Dynamic Programming and Reinforcement Learning, IEEE Press, April 1-5, 2007, pp. 272-279, doi: 10.1109/ADPRL.2007.368199.
16. D. Vinceze and S. Kovacs, "Fuzzy Rule Interpolation-based Q-learning," Proceedings of 5th international symposium on applied computational intelligence and informatics, IEEE Press, May 28-29, 2009, pp. 55-59, doi: 10.1109/SACI.2009.5136311.
17. J. D. R. Millan, D. Posenato and E. Dedieu, "Continuous-Action Q-learning," Machine Learning, vol. 49, 2002, pp. 247-265, doi: 10.1023/A:1017988514716.
18. Crossbow Technology, MPR-MIB Users Manual (Revision A), Crossbow Technology: San Jose, CA, USA, 2007.