On the performance of high dimensional data clustering and classification algorithms

Future Generation Computer Systems

Volumn 29, Issue 4, 2013, Pages 1024-1034

  Ericson, Kathleen ^a   Pallickara, Shrideep ^a  

^a Veterinary Dentistry and Oral Surgery   (United States)

Author keywords

Classification; Clustering; Distributed stream processing; Granules; Hadoop; Machine learning; Mahout

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); DATA MINING; DISTRIBUTED PARAMETER CONTROL SYSTEMS; GRANULATION; LEARNING SYSTEMS; PATTERN RECOGNITION; PATTERN RECOGNITION SYSTEMS;

CLUSTERING; DISTRIBUTED STREAM PROCESSING; GRANULES; HADOOP; MAHOUT;

CLUSTERING ALGORITHMS;

EID: 84863770788     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2012.05.026     Document Type: Article

References (34)

1. [1] Dean, J., Ghemawat, S., MapReduce: simplified data processing on large clusters. ACM Communications 51 (2008), 107–113.
2. [2] Owen, S., et al. Mahout in Action. 2011, Manning Publications (est.).
3. [3] White, T., Hadoop: The Definitive Guide. first ed., 2009, O'Reilly Media.
4. [4] Berkhin, P., A survey of clustering data mining techniques. Kogan, J., Nicholas, C.K., (eds.) Grouping Multidimensional Data: Recent Advances in Clustering, 2006, Springer, 25–83.
5. [5] L. Qing, K. Byeong Man, Clustering approach for hybrid recommender system, in: Proceedings IEEE/WIC International Conference on Web Intelligence, WI 2003, 2003, pp. 33–38.
6. [6] C.W. Anderson, J.A. Bratman, Translating thoughts into actions by finding patterns in brainwaves, in: Fourteenth Yale Workshop on Adaptive and Learning Systems, New Haven, CT, 2008, pp. 1–6.
7. [7] Yeung, K.Y., et al. Validating clustering for gene expression data. Bioinformatics 17 (2001), 309–318.
8. [8] E.M. Forney, C.W. Anderson, Classification of EEG during imagined mental tasks by forecasting with Elman Recurrent Neural Networks, in: The 2011 International Joint Conference on Neural Networks, IJCNN, 2011, pp. 2749–2755.
9. [9] A.C. Tan, D. Gilbert, An empirical comparison of supervised machine learning techniques in bioinformatics, Presented at the Proceedings of the First Asia-Pacific Bioinformatics Conference on Bioinformatics 2003—Volume 19, Adelaide, Australia, 2003.
10. [10] S. Pallickara, et al. Granules: a lightweight, streaming runtime for cloud computing with support for map-reduce, in: IEEE International Conference on Cluster Computing, New Orleans, LA, 2009.
11. [11] S. Pallickara, et al. An Overview of the granules runtime for cloud computing, in: IEEE International Conference on e-Science, Indianapolis, 2008.
12. [12] Lloyd, S., Least squares quantization in PCM. IEEE Transactions on Information Theory 28 (1982), 129–137.
13. [13] Bezdek, J.C., Pattern Recognition with Fuzzy Objective Function Algorithms. 1981, Kluwer Academic Publishers, Norwell, MA.
14. [14] McCullagh, P., Yang, J., How many clusters?. Bayesian Analysis 3 (2008), 101–120.
15. [15] Blei, D.M., et al. Latent Dirichlet Allocation. Journal of Machine Learning Research 3 (2003), 993–1022.
16. [16] D. Lewis, Naive (Bayes) at forty: the independence assumption in information retrieval.
17. [17] Gardner, W.A., Learning characteristics of stochastic-gradient-descent algorithms: a general study, analysis, and critique. Signal Process. 6 (1984), 113–133.
18. [18] Chu, C.-T., et al. Map-reduce for machine learning on multicore. Advances in Neural Information Processing Systems, NIPS, 2006, Vancouver, Canada.
19. [19] B. Catanzaro, et al. Fast support vector machine training and classification on graphics processors, Presented at the Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland, 2008.
20. [20] Y. Yu, et al. DryadLINQ: a system for general-purpose distributed data-parallel computing using a high-level language, Presented at the Proceedings of the 8th USENIX Conference on Operating Systems Design and Implementation, San Diego, California, 2008.
21. [21] Resnick, P., Varian, H.R., Recommender systems. Communications of ACM 40 (1997), 56–58.
22. [22] C. Hemmerich, et al. Map-reduce expansion of the ISGA genomic analysis web server, Presented at the CloudCom 2010, Indianapolis, USA, 2010.
23. [23] Ericson, K., Pallickara, S., Adaptive heterogeneous language support within a cloud runtime. Future Generation Computer Systems 28 (2012), 128–135.
24. [24] D. Borthakur, 2007, The Hadoop distributed file system: architecture and design. Available: http://hadoop.apache.org/common/docs/r0.18.0/hdfs_design.pdf.
25. [25] M. Isard, et al. Dryad: distributed data-parallel programs from sequential building blocks, in: 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems, Lisbon, Portugal, 2007.
26. [26] Ericson, K., et al. Handwriting recognition using a cloud runtime. Colorado Celebration of Women in Computing, 2010, Golden.
27. [27] K. Ericson, et al. Analyzing electroencephalograms using cloud computing techniques, in: IEEE Conference on Cloud Computing Technology and Science, Indianapolis, USA, 2010.
28. [28] A. McCallum, et al. Efficient clustering of high-dimensional data sets with application to reference matching, Presented at the Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Boston, Massachusetts, United States, 2000.
29. [29] D.D. Lewis, Reuters-21578 text categorization test collection, Distribution 1.0, A.T.L.-. Research, Ed., 1.0 ed: UCI Machine Learning Repository, 1997.
30. [30] T. Mitchell, Twenty newsgroups data set, ed: UCI Machine Learning Repository, 1999.
31. [31] Yegnanarayana, B., Artificial Neural Networks. 2004, Prentice-Hall of India.
32. [32] Juang, B.-H., Hidden Markov models. Wiley Encyclopedia of Telecommunications, 2003, John Wiley & Sons, Inc.
33. [33] J. Bennet, S. Lanning, The netflix prize, KDD Cup and Workshop, 2007. www.netflixprize.com.
34. [34] Linden, G., et al. Amazon.com recommendations: item-to-item collaborative 54 filtering. IEEE Internet Computing 7 (2003), 76–80.