CLIQUE: Role-free clustering with Q-learning for wireless sensor networks

Proceedings - International Conference on Distributed Computing Systems

Volumn , Issue , 2009, Pages 441-449

  Förster, Anna ^a   Murphy, Amy L ^b  

^a UNIVERSITY OF LUGANO   (Switzerland)

^b ITC IRST   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER HEAD; COMMUNICATION ENERGY; DATA CLUSTERING; DYNAMIC NETWORK; MACHINE-LEARNING; NETWORK DYNAMICS; NODE FAILURE; Q-LEARNING; SINK MOBILITY;

CLUSTERING ALGORITHMS; COMPUTER SCIENCE; COMPUTER SIMULATION; ROUTING PROTOCOLS; SENSOR NETWORKS; TECHNICAL PRESENTATIONS; WIRELESS TELECOMMUNICATION SYSTEMS;

WIRELESS SENSOR NETWORKS;

EID: 70350214813     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDCS.2009.43     Document Type: Conference Paper

References (16)

1. W. Rabiner-Heinzelman, A. Chandrakasan, and H. Balakrishnan, "Energy-efficient communication protocol for wireless microsensor networks," in Proceedings of the 33rd Hawaii International Conference on System Sciences (HICSS), Washington DC, USA, 2000.
2. L. Yu, N. Wang, W. Zhang, and C. Zheng, "Group: A grid-clustering routing protocol for wireless sensor networks," in Proceedings of the International Conference on Wireless Communications, Networking and Mobile Computing (WiCOM), Wuhan, China, December 2006.
3. D. Tulone and S. Madden, "Paq: Time series forecasting for approximate query answering in sensor networks." Proceedings of the 3rd European Conference for Wireless Sensor Networks (EWSN), 2006.
4. A. Egorova-Förster and A. L. Murphy, "Exploring non uniform quality of service for extending WSN lifetime," in Proceedings of the 3rd International Workshop on Sensor Networks and Systems for Pervasive Computing (PerSens). White Plains, NY, USA: IEEE Computer Society, 2007.
5. A. Förster and A. L. Murphy, "FROMS: Feedback routing for optimizing multiple sinks in WSN with reinforcement learning," in Proceedings 3rd International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), 2007.
6. S. Bandyopadhyay and E. Coyle, "An energy efficient hierarchical clustering algorithm for wireless sensor networks," in Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM), vol. 3, March 2003, pp. 1713 - 1723.
7. M. Demirbas, A. Arora, V. Mittal, and V. Kulathumani, "Design and analysis of a fast local clustering service for wireless sensor networks," in Proceedings of the 1st International Conference on Broadband Wireless Networking (BroadNets), 2004, pp. 700-709.
8. O. Younis and S. Fahmy, "Heed: a hybrid, energy-efficient, distributed clustering approach for ad hoc sensor networks," IEEE Transactions on Mobile Computing, vol. 3, no. 4, pp. 366-379, 2004.
9. D. Ganesan, B. Greenstein, D. Estrin, J. Heidemann, and R. Govindan, "Multiresolution storage and search in sensor networks," ACM Transactions on Storage, vol. 1, no. 3, pp. 277-315, August 2005.
10. H. Luo, F. Ye, J. Cheng, S. Lu, and L. Zhang, "TTDD: Two-tier data dissemination in large-scale wireless sensor networks," Wireless Networks, vol. 11, no. 1-2, pp. 161-175, 2005.
11. A. W. Matin and S. Hussain, "Intelligent hierarchical cluster-based routing," in Proceedings of the International Workshop on Mobility and Scalability in Wireless Sensor Networks (MSWSN), San Francisco, CA, 2006.
12. J. A. Boyan and M. L. Littman, "Packet routing in dynamically changing networks: A reinforcement learning approach," Advances in Neural Information Processing Systems, vol. 6, 1994.
13. P. Beyens, M. Peeters, K. Steenhaut, and A. Nowe, "Routing with compression in wireless sensor networks: A Q-learning approach," in Proceedings of the 5th European Workshop on Adaptive Agents and Multi-Agent Systems (AAMAS), 2005.
14. A. Förster, "Machine learning techniques applied to wireless ad-hoc networks: Guide and survey," in Proceedings of the 3rd International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), 2007.
15. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction. The MIT Press, March 1998.
16. A. Förster and A. L. Murphy, "Balancing Energy Expenditure in WSNs through Reinforcement Learning: A Study," in Proceedings of the 1st International Workshop on Energy in Wireless Sensor Networks (WEWSN), Santorini Island, Greece, 2008.