Clustering distributed sensor data streams using local processing and reduced communication

Intelligent Data Analysis

Volumn 15, Issue 1, 2011, Pages 3-28

  Gama, João ^a   Rodrigues, Pedro Pereira ^a,b   Lopes, Luís ^a  

^a UNIVERSITY OF PORTO   (Portugal)

^b University of Porto   (Portugal)

Author keywords

distributed data streams; frequent items monitoring; incremental discretization; Online adaptive clustering; sensor networks

Indexed keywords

ADAPTIVE CLUSTERING; CENTRAL POINT; CENTRAL SERVERS; CLUSTER STRUCTURE; DATA DISTRIBUTED; DATA POINTS; DATA STREAM; DISCRETIZATIONS; DISTRIBUTED ALGORITHM; DISTRIBUTED DATA STREAMS; DISTRIBUTED SENSOR; DISTRIBUTED SENSOR NETWORKS; FREQUENT ITEMS; GLOBAL STATE; ITS DATA; LOCAL PROCESSING; LOCAL SENSORS; ONLINE DISCRETIZATION; PARTITIONAL CLUSTERING ALGORITHM; PHYSIOLOGICAL SENSORS; SYNTHETIC DATA; UNIVARIATE;

ADAPTIVE ALGORITHMS; DATA COMMUNICATION SYSTEMS; LOSS PREVENTION; SENSOR NETWORKS;

CLUSTERING ALGORITHMS;

EID: 79551527268     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/IDA-2010-0453     Document Type: Article

References (31)

1. C.C. Aggarwal, J. Han, J. Wang and P.S. Yu, A framework for clustering evolving data streams. In VLDB 2003, Proceedings of 29th International Conference on Very Large Data Bases, pages 81-92. Morgan Kaufmann, September 2003.
2. R. Agrawal, J. Gehrke, D. Gunopulos and P. Raghavan, Automatic subspace clustering of high dimensional data for data mining applications. In Proceedings of the ACM-SIGMOD International Conference on Management of Data, pages 94-105, Seattle,Washington, June 1998. ACM Press.
3. I. Akyildiz, W. Su, Y. Sankarasubramaniam and E. Cayirci, A Survey on Sensor Networks, IEEE Communications Magazine 40(8) (2002), 102-114.
4. M. Bern and D. Eppstein, Approximation Algorithms for NP-hard Problems, Chapter 8. Approximation Algorithms for Geometric Problems, pages 296-345. PWS Publishing Company, 1996.
5. P. Bradley, U. Fayyad and C. Reina, Scaling clustering algorithms to large databases, In Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining, pages 9-15. AAAI Press, 1998.
6. M. Charikar, K. Chen and M. Farach-Colton, Finding frequent items in data streams. In Proceedings of the 29th International Colloquium on Automata, Languages and Programming, pages 693-703. Springer Verlag, 2002.
7. G. Cormode and S. Muthukrishnan, What's hot and what's not: Tracking most frequent items dynamically. In Proceedings of the 22nd Symposium on Principles of Databse Systems, pages 296-306, 2003.
8. G. Cormode, S. Muthukrishnan andW. Zhuang, Conquering the divide: Continuous clustering of distributed data streams. In Proceedings of the 23rd International Conference on Data Engineering (ICDE 2007), pages 1036-1045, 2007.
9. D.E. Culler and H. Mulder, Smart Sensors to Network the World, Scientific American, 2004.
10. S. Datta, K. Bhaduri, C. Giannella, R. Wolff and H. Kargupta, Distributed data mining in peer-to-peer networks, IEEE Internet Computing 10(4) (2006), 18-26.
11. E.D. Demaine, A. Lopez-Ortiz and J.I. Munro, Frequency estimation of internet packet streams with limited space. In Proceedings of the 10th Annual European Symposium on Algorithms, pages 348-360, 2002.
12. P. Domingos and G. Hulten, A general method for scaling up machine learning algorithms and its application to clustering. In Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001), pages 106-113, 2001.
13. M. Ester, H.-P. Kriegel, J. Sander and X. Xu, A density-based algorithm for discovering clusters in large spatial databases with noise, in: Second International Conference on Knowledge Discovery and Data Mining, E. Simoudis, J. Han and U. Fayyad, editors, Portland, Oregon, 1996. AAAI Press, pp. 226-231
14. J. Gama and C. Pinto, Discretization from data streams: applications to histograms and data mining, in: Proceedings of the 2006 ACM Symposium on Applied Computing (SAC 2006), H. Haddad, ed., Dijon, France, April 2006, ACM Press, pp. 662-667.
15. J. Gama and P.P. Rodrigues, Data stream processing, in: Learning from Data Streams - Processing Techniques in Sensor Networks, (Chapter 3), J. Gama and M.M. Gaber, eds, Springer Verlag, 2007, pp. 25-39.
16. J. Gama, P.P. Rodrigues and R. Sebastião, Evaluating algorithms that learn from data streams. In Proceedings of the 24th Annual ACM Symposium on Applied Computing (SAC 2009), pages 1496-1500, Honolulu, Hawaii, USA, 2009. ACM Press.
17. T.F. Gonzalez, Clustering to minimize the maximum inter-cluster distance, Theoretical Computer Science 38 (1985), 293-306.
18. S. Guha, R. Rastogi and K. Shim, CURE: An efficient clustering algorithm for large databases, in: Proceedings of the 1998 ACM-SIGMOD International Conference on Management of Data, L.M. Haas and A. Tiwary, editors, ACM Press, 1998, pp. 73-84.
19. L. Luo, T. Abdelzaher, T. He and J. Stankovic, EnviroSuite: An Environmentally Immersive Programming Framework for Sensor Networks, ACM TECS 5(3) (2006), 543-576.
20. G. Manku and R. Motwani, Approximate frequency counts over data streams, In Proceedings of the 28th International Conference on Very Large Data Bases, pages 346-357, 2002.
21. A. Metwally, D. Agrawal and A. E. Abbadi, Efficient computation of frequent and top-k elements in data streams. In Proceedings of the 10th International Conference on Database Theory, pages 398-412. Springer Verlag, 2005.
22. R. Newton and M.Welsh, Region Streams: Functional Macroprogramming for Sensor Networks. In DMSN'04Workshop, 2004.
23. L. O'Callaghan, A.Meyerson, R. Motwani, N. Mishra and S. Guha, Streaming-data algorithms for high-quality clustering. In Proceedings of the Eighteenth Annual IEEE International Conference on Data Engineering, pages 685-696. IEEE Computer Society, 2002.
24. N.H. Park and W.S. Lee, Statistical grid-based clustering over data streams, SIGMOD Record 33(1) (2004), 32-37.
25. P.P. Rodrigues and J. Gama, Clustering techniques in sensor networks, in: Learning from Data Streams - Processing Techniques in Sensor Networks, (Chapter 9), J. Gama and M.M. Gaber, eds, Springer Verlag, 2007, pp. 125-142.
26. P.P. Rodrigues and J. Gama, A system for analysis and prediction of electricity load streams, Intelligent Data Analysis 13(3) (2009), 477-496.
27. P.P. Rodrigues, J. Gama and L. Lopes, Knowledge discovery for sensor network comprehension, in: Intelligent Techniques for Warehousing and Mining Sensor Network Data, A. Cuzzocrea, ed., IGI Global, 2009.
28. P.P. Rodrigues, J. Gama and L. Lopes, Requirements for clustering streaming sensors, in: Knowledge Discovery from Sensor Data, (Chapter 4), A.R. Ganguly, J. Gama, O.A. Omitaomu, M.M. Gaber and R.R. Vatsavai, eds, CRC Press, 2009, pp. 33-51.
29. S. Subramaniam, T. Palpanas, D. Papadopoulos, V. Kalogeraki and D. Gunopulos, Online outlier detection in sensor data using non-parametric models, In VLDB, pages 187-198, 2006.
30. W.Wang, J. Yang and R.R. Muntz, STING:A statistical information grid approach to spatial data mining, in: Proceedings of the Twenty-Third International Conference on Very Large Data Bases, M. Jarke, M.J. Carey, K.R. Dittrich, F.H. Lochovsky, P. Loucopoulos and M.A. Jeusfeld, editors, Athens, Greece, 1997. Morgan Kaufmann, pp. 186-195.
31. T. Zhang, R. Ramakrishnan and M. Livny, BIRCH: An efficient data clustering method for very large databases, In Proceedings of the 1996 ACM SIGMOD International Conference on Management of Data, pages 103-114. ACM Press, 1996.