Efficient map/reduce-based DBSCAN algorithm with optimized data partition

Proceedings - 2012 IEEE 5th International Conference on Cloud Computing, CLOUD 2012

Volumn , Issue , 2012, Pages 59-66

  Dai, Bi Ru ^a   Lin, I Chang ^a  

^a NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

Author keywords

cloud computing; data clustering; data mining; data partition; DBSCAN; Hadoop; Map Reduce

Indexed keywords

DATA CLUSTERING; DATA PARTITION; DBSCAN; HADOOP; MAP/REDUCE;

CLOUD COMPUTING; DATA MINING; SCALABILITY;

CLUSTERING ALGORITHMS;

EID: 84866768237     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLOUD.2012.42     Document Type: Conference Paper

References (23)

1. Fayyad, Usama; Gregory Piatetsky-Shapiro, and Padhraic Smyth (1996). "From Data Mining to Knowledge Discovery in Databases"
2. Han, P.N., Kamber, M.: Data Mining: Concepts and Techniques, 2ed(2006)
3. Tan, P.N., Steinbach, M., Kumar, V.: Introduction to Data Mining (2006) .
4. J. Han, M. Kamber, Data Mining Concepts and Techniques, Morgan Kaufmann Publishers, San Francisco, CA, 2001, pp. 335-391.
5. Jen-Wei Huang, Su-Chen Lin and Ming-Syan Chen, "DPSP: Distributed Progressive Sequential Pattern Mining on the Cloud," Lecture Notes in Computer Science, 2010, Volume 6119/2010, 27-34
6. C. Moretti, J. Bulosan, D. Thain, and P. Flynn. All-pairs: An abstraction for data-intensive cloud computing. In IEEE/ACM International Parallel and Distributed Processing Symposium, April 2008.
7. WHITE, B., YEH, T., LIN, J., AND DAVIS, L. 2010. Web-scale computer vision using mapreduce for multimedia data mining. Proceedings of the Tenth International Workshop on Multimedia Data Mining, 1-10.
8. M. Ester, H.-P. Kriegel, J. Sander, X. Xu, A density-based algorithm for discovering clusters in large spatial databases with noise, in: Proceedings of Second International Conference on Knowledge Discovery and Data Mining, Portland, OR, 1996, pp. 226-231.
9. Kryszkiewicz, M., Lasek, P.: TI-DBSCAN: Clustering with DBSCAN by Means of the Triangle Inequality. In: Szczuka, M. (ed.) RSCTC 2010. LNCS, vol. 6086, pp. 60-69. Springer, Heidelberg (2010)
10. EL-SONBATY, Y., ISMAIL, M. A., AND FAROUK, M. 2004. An efficient density-based clustering algorithm for large databases. In Proceedings of the 16th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'04). IEEE Computer Society, 673-677.
11. R.T. Ng and J. Han.:" Efficient and Effective Clustering Methods for spatial data mining", Proc. 20th Int. Conf. on Very Large Data Bases, santiago, Chile, 1994, pages 144-155
12. Ozge Uncu, William A. Gruver, Dilip B. Kotak. GRIDBSCAN: GRId Density-Based Spatial Clustering of Applications with Noise. In IEEE International Conference on Systems, Man and Cybernetics, Taipei, Taiwan, 2006 , pp. 2976-2981
13. Dean, J., Ghemawat, S.: Mapreduce: Simplified dataprocessing on large clusters. In: Symp. on Operating System Design and Implementation (2004).
14. Hadoop, http://hadoop.apache.org.
15. M. Ankerst, M.M. Breunig, H.-P. Kriegel, J. Sander, OPTICS: Ordering points to identify the clustering structure, in: Proceedings of ACM SIGMOD International Conference on Management of Data, Philadelphia, PA, 1999, pp. 49-60
16. th International Conference on Knowledge Discovery and Data Mining, New York City, NY, 1998, pp. 58-65.
17. S. Ma, T.J. Wang, S.W. Tang, D.Q. Yang, J. Gao, A new fast clustering algorithm based on reference and density, in: Proceedings of WAIM, Lectures Notes in Computer Science, 2762, Springer, 2003, pp. 214-225
18. Cheng, H., Tan, P.-N., Sticklen, J., Punch, W.F.: Recommendation via query cen-tered random walk on k-partite graph. In: Proc. of Intl. Conf. on Data Mining, pp. 457-462 (2007).
19. Chilson, J., Ng, R., Wagner, A., Zamar, R.: Parallel computation of high dimen-sional robust correlation and covariance matrices. In: Proc. of Intl. Conf. on Knowl-edge Discovery and Data Mining, August 2004, pp. 533-538 (2004).
20. Kargupta, H., Das, K., Liu, K.: Multi-party, privacy-preserving distributed data mining using a game theoretic framework. In: Proc. of European Conf. on Principles and Practice of Knowledge Discovery in Databases, pp. 523-531 (2007)
21. V. Gaede and O. Günther, "Multidimensional access methods," ACM Comput. Surv., vol. 30, no. 2, pp. 170-231, 1998.
22. G. Karypis, E. H. Han, and V. Kumar, "CHAMELEON: A hierarchical clustering algorithm using dynamic modeling," Computer, vol. 32, no. 8, pp. 68-75, 1999.
23. USGS geoname datasets; http://geonames.usgs.gov/.