Clustering distributed data streams in peer-to-peer environments

Information Sciences

Volumn 176, Issue 14, 2006, Pages 1952-1985

  Bandyopadhyay, Sanghamitra ^a   Giannella, Chris ^a   Maulik, Ujjwal ^a   Kargupta, Hillol ^a   Liu, Kun ^a   Datta, Souptik ^a  

^a Baltimore County   (United States)

Author keywords

Cluster analysis; Data mining; Data streams; Peer to peer

Indexed keywords

ALGORITHMS; COMMUNICATION SYSTEMS; SENSORS;

CLUSTER ANALYSIS; COMMUNICATION COST; DATA STREAMS; PEER-TO-PEER;

DATA REDUCTION;

EID: 33646164394     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2005.11.007     Document Type: Article

References (56)

1. Jain A.K., and Dubes R.C. Algorithms for Clustering Data (1988), Prentice-Hall, Englewood Cliffs, NJ
2. Kowalczyk W., Jelasity M., and Eiben A.E. Towards data mining in large and fully distributed peer-to-peer overlay networks. In: Heskes T., Lucas P., Vuurpijl L., and Wiegerinck W. (Eds). Proceedings of the Fifteenth Belgium Netherland Conference on Artificial Intelligence (2003), University of Nijmegen 203-210
3. Wolff R., and Schuster A. Association rule mining in peer-to-peer systems. IEEE Trans. Syst. Man Cyberns. Part B 34 6 (2004)
4. Guha S., Mishra N., Motwani R., and O'Callaghan L. Clustering data streams. Proceedings of the Annual Symposium on Foundations of Computer Science (2000), IEEE Computer Society, Washington, DC, USA
5. Tou J.T., and Gonzalez R.C. Pattern Recognition Principles (1974), Addison-Wesley, Reading
6. Han J., and Kamber M. In: Jim Gray (Ed). Data Mining: Concepts and Techniques. The Morgan Kaufmann Series in Data Management Systems (2000), Morgan Kaufmann
7. Domingos P., and Hulten G. A general method for scaling up machine learning algorithms and its application to clustering. Proceedings of the Eighteenth International Conference on Machine Learning (2001), Morgan Kaufmann, MA 106-113
8. C. Aggarwal, J. Han, J. Wang, P. Yu, A framework for clustering evolving data streams, in: Proceedings of the 29th VLDB, 2003, pp. 81-92.
9. B. Babcock, M. Datar, R. Motwani, L. O'Callaghan, Maintaining variance and k-medians over data stream windows, in: ACM SIGMOD Principles of Database Systems (PODS), 2003. Available from: l.
10. Domingos P., and Hulten G. Mining high speed data streams. Proceedings of the Sixth International Conference on Knowledge Discovery and Data Mining (2001), ACM Press, Boston, MA 71-80
11. Domingos P., Spencer L., and Hulten G. Mining time-changing data streams. Proceedings of the Seventh International Conference on Knowledge Discovery and Data Mining (2001), ACM Press, San Francisco 97-106
12. Lin J., Vlachos M., Keogh E., and Gunopulos D. Iterative incremental clustering of time series. Proceedings of the IX Conference on Extending Database Technology (EDBT 2004) (2004), IEEE Computer Society, Crete, Greece
13. E. Keogh, J. Lin, W. Truppel, Clustering of time series subsequences is meaningless: implications for past and future research, in: Proceedings of the 3rd IEEE International Conference on Data Mining, 2003, pp. 115-122.
14. I. Dhillon, D. Modha, A data-clustering algorithm on distributed memory multiprocessors, in: Proceedings of the KDD'99 Workshop on High Performance Knowledge Discovery, 1999, pp. 245-260.
15. Forman G., and Zhang B. Distributed data clustering can be efficient and exact. SIGKDD Explorations 2 2 (2000) 34-38
16. Kargupta H., Huang W., Sivakumar K., and Johnson E. Distributed clustering using collective principal component analysis. Knowledge Inform. Syst. J. 3 (2001) 422-448
17. M. Klusch, S. Lodi, G. Moro, Distributed clustering based on sampling local density estimates, in: Proceedings of the Joint International Conference on AI (IJCAI 2003), 2003.
18. A. Hinneburg, D. Keim, An efficient approach to clustering in large multimedia databases with noise, in: Proceedings of the 1998 International Conference on Knowledge Discovery and Data Mining (KDD), 1998, pp. 58-65.
19. M. Eisenhardt, W. Muller, A. Henrich, Classifying documents by distributed P2P clustering, in: Proceedings of Informatik 2003, GI Lecture Notes in Informatics, Frankfort, Germany, 2003.
20. S. Merugu, J. Ghosh, Privacy-preserving distributed clustering using generative models, in: Proceedings of the IEEE Conference on Data Mining (ICDM), 2003.
21. Johnson E., and Kargupta H. Collective, hierarchical clustering from distributed, heterogeneous data. In: Zaki M., and Ho C. (Eds). Large-Scale Parallel KDD Systems. Lecture Notes in Computer Science vol. 1759 (1999), Springer-Verlag 221-244
22. A. Lazarevic, D. Pokrajac, Z. Obradovic, Distributed clustering and local regression for knowledge discovery in multiple spatial databases, in: Proceedings of the 8th European Symposium on Artificial Neural Networks, 2000, pp. 129-134.
23. Samatova N., Ostrouchov G., Geist A., and Melechko A. RACHET: An efficient cover-based merging of clustering hierarchies from distributed datasets. Distrib. Parallel Databases 11 2 (2002) 157-180
24. Strehl A., and Ghosh J. Cluster ensembles-a knowledge reuse framework for combining multiple partitions. J. Mach. Learning Res. 3 (2002) 583-617
25. A. Fred, A. Jain, Data clustering using evidence accumulation, in: Proceedings of the International Conference on Pattern Recognition 2002, 2002, pp. 276-280.
26. P. Jouve, N. Nicoloyannis, A new method for combining partitions, applications for distributed clustering, in: Proceedings of Workshop on Parallel and Distributed Computing for Machine Learning as part of the 14th European Conference on Machine Learning, 2003.
27. E. Januzaj, H.-P. Kriegel, M. Pfeifle, DBDC: density based distributed clustering, in: Proceedings of EDBT in Lecture Notes in Computer Science, vol. 2992, 2004, pp. 88-105.
28. A. Mainwaring, J. Polastre, R. Szewczyk, D. Culler, J. Anderson, Wireless sensor networks for habitat monitoring, in: ACM International Workshop on Wireless Sensor Networks and Applications (WSNA'02), Atlanta, GA, 2002.
29. D. Estrin, R. Govindan, J. Heidemann, Scalable coordination in sensor networks, Tech. Rep. Technical Report 99-692, University of Southern California, 1999.
30. D. Estrin, R. Govindan, J. Heidemann, S. Kumar, Next century challenges: scalable coordination in sensor networks, in: Proceedings of the 5th Annual ACM/IEEE International Conference on Mobile Computing and Networking Seattle, WA USA, 1999, pp. 263-270.
31. W. Heinzelman, A. Chandrakasan, H. Balakrishnan, Energy-efficient communication protocol for wireless microsensor networks, in: Proceedings of the Hawaii Conference on System Sciences, January 2000.
32. Pottie G.J., and Kaiser W.J. Wireless integrated network sensors. Commun. ACM 43 5 (2000) 551-558
33. Gharavi H., and Kumar S.P. Proc. IEEE, Special Issue on Sensor Networks and Applications 91 8 (2003)
34. Akyildiz I.F., Su W., Sankarasubramaniam Y., and Cayirci E. A survey on sensor networks. IEEE Commun. Mag. 40 (2002) 102-114
35. Akyildiz I.F., Su W., Sankarasubramaniam Y., and Cayirci E. Wireless sensor networks: a survey. Computer Networks 38 (2002) 393-422
36. .
37. .
38. J. Hill, R. Szewczyk, A. Woo, S. Hollar, D.E. Culler, K.S.J. Pister, System architecture directions for networked sensors, in: International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2000. Available from: .
39. Zhao F., Liu J., Liu J., Guibas L., and Reich J. Collaborative signal and information processing: an information-directed approach. Proc. IEEE 91 8 (2003) 1199-1209
40. C. Intanagonwiwat, R. Govindan, D. Estrin, Directed diffusion: a scalable and robust communication paradigm for sensor networks, in: Proceedings of the Sixth Annual International Conference on Mobile Computing and Networking, Boston, MA USA, 2000, pp. 56-67.
41. Sohrabi K., Gao J., Ailawadhi V., and Pottie G.J. Protocols for self-organization of a wireless sensor network. IEEE Personal Commun. 7 5 (2000) 16-27
42. A. Cerpa, D. Estrin, ASCENT: adaptive self-configuring sensor networks topologies, in: Proceedings of the 21st International Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM), New York, NY, USA, 2002.
43. Heinzelman W., Chandrakasan A., and Balakrishnan H. An application-specific protocol architecture for wireless microsensor networks. IEEE Trans. Wireless Commun. 1 4 (2002) 660-670
44. Lindsey S., Raghavendra C., and Sivalingam K.M. Data gathering algorithms in sensor networks using energy metrics. IEEE Trans. Parallel Distrib. Syst., Special Issue on Mobile Computing 13 9 (2002) 924-935
45. A. Sinha, A. Wang, A. Chandrakasan, Algorithmic transforms for efficient energy scalable computation, in: Proceedings of the International Symposium on Low Power Electronics and Design (ISLPED), 2000.
46. P. Radivojac, U. Korad, K.M. Sivalingam, Z. Obradovic, Learning from class-imbalanced data in wireless sensor networks, in: 58th IEEE Semiannual Conference on Vehicular Technology Conference (VTC), Orlando, FL, October 2003, vol. 5, pp. 3030-3034.
47. Chawla N.V., Bowyer K.W., Hall L.O., and Kegelmeyer W.P. Smote: synthetic minority over-sampling technique. J. Artificial Intell. Res. 16 (2002) 321-357
48. Palpanas T., Papadopoulos D., Kalogeraki V., and Gunopulos D. Distributed deviation detection in sensor networks. SIGMOD Record 32 4 (2003) 77-82
49. Krishnamachari B., and Iyengar S. Distributed Bayesian algorithms for fault tolerant event region detection in wireless sensor networks. IEEE Trans. Comput. 53 3 (2004) 241-250
50. Ghiasi S., Srivastava A., Yang X., and Sarrafzadeh M. Optimal energy aware clustering in sensor networks. Sensors 2 (2002) 258-269
51. Younis O., and Fahmy S. Heed: a hybrid energy-efficient distributed clustering approach for ad-hoc sensor networks. IEEE Trans. Mobile Comput. 3 4 (2004)
52. Chen W., Hou J.C., and Sha L. Dynamic clustering for acoustic target tracking in wireless sensor networks. IEEE Trans. Mobile Comput. 3 3 (2004) 258-271
53. H. Kargupta, R. Bhargava, K. Liu, M. Powers, P. Blair, M. Klein, VEDAS: a mobile distributed data stream mining system for real-time vehicle monitoring, in: Proceedings of the 2004 SIAM International Conference on Data Mining, 2004.
54. MacQueen J. Some methods for classification and analysis of multivariate observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability (1967), University of California Press, Berkeley, CA 281-297
55. Cochran W. Sampling Techniques. third ed. (1977), John Wiley & Sons Inc., New York
56. Hoeffding W. Probability inequalities for sums of bounded random variables. J. Am. Statist. Assoc. 58 (1963) 13-30