Why naive ensembles do not work in cloud computing

ICDM Workshops 2009 - IEEE International Conference on Data Mining

Volumn , Issue , 2009, Pages 282-289

  Gao, Wenxuan ^a   Grossman, Robert ^a   Yu, Philip S ^a   Gu, Yunhong ^a  

^a University of Illinois at Chicago   (United States)

Author keywords

Cloud computing; Decision tree; Ensemble; Parellel

Indexed keywords

CLOUD COMPUTING; DATA MINING ALGORITHM; EXPERIMENTAL STUDIES; LARGE DATASETS; PERFORMANCE DATA;

DECISION TREES; TECHNICAL PRESENTATIONS;

DATA MINING;

EID: 77951145852     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDMW.2009.85     Document Type: Conference Paper

References (25)

1. Y. Gu and R. Grossman, "Sector and Sphere: The Design and Implementation of a High Performance Data Cloud", Phil. Trans. R. Soc. A 28 June 2009 vol. 367 no. 1897 2429-2445.
2. W. Fan, H. Wang, P.S. Yu, and S. Ma, "Is random model better? on its accuracy and efficiency", Proc. 3rd IEEE Intl. Conf. on Data Mining (ICDM-2003), Nov 2003, pp.51-58.
3. http://sector.sourceforge.net/.
4. M. Joshi, G. Karypis and V. Kumar, "ScalParC: A New Scalable and Efficient Parallel Classification Algorithm for Mining Large Datasets." Proc. 1998 Intl. Parallel Processing Symp., April 1998, pp.573-579.
5. M.J. Zaki and C.-T. Ho (Eds.), Large-Scale Parallel Data Mining, LNAI State-of-the-Art Survey, Vol. 1759, Springer-Verlag: Berlin, 2000.
6. H. Kargupta and P. Chan (Eds.), Advances in Distributed and Parallel Knowledge Discovery, AAAI Press/MIT Press, 2000.
7. P.S. Bradley, U. Fayyad and C. Reina, "Scaling Clustering Algorithms to Large Databases", Proc. 4th Intl. Conf. on Knowledge Discovery & Data Mining (KDD98), AAAI Press, 1998, pp9-15.
8. M. Mehta, R. Agrawal, and J. Rissanen, "SLIQ: A Fast Scalable Classifier for Data Mining" In 5th Intl. Conference on Extending Database Technology, pp.18-32, 1996.
9. R. Musick, J. Catlett, and S. Russell, "Decision theoretic subsampling for induction on large databases", In Proc. of 10th Intl. Conf. on Machine Learning, pp.212 - 219, Amherst, MA, 1993.
10. F. Provost, D. Jensen and T. Oates, "Efficient Progressive Sampling", Proc. Fifth Intl. Conf. on Knowledge Discovery and Data Mining, pp.23-32, 1999.
11. C. Moretti, K. Steinhaeuser, D. Thain and N.V. Chawla, "Scaling up Classifiers to Cloud Computers", In 8th IEEE Intl. Conf. on Data Mining(ICDM08), pp.472-481, Dec 2008.
12. A. Srivastava, E. Han, V. Kumar, and V. Singh, "Parallel Formulations of Decision-Tree Classification Algorithms, " Data Mining and Knowledge Discovery: An Intl. Journal, vol. 3, no. 3, September 1999, pp.237-261.
13. E. Han, G. Karypis and V. Kumar, "Scalable Parallel Data Mining for Association Rules", IEEE Trans. on Knowledge and Data Engineering, Vol. 12, No. 3, May/June 2000, pp.372-390.
14. V. Ganti, R. Ramakrishnan, and J. Gehrke, "Clustering Large Datasets in Arbitrary Metric Spaces", Proc. 15th Intl. Conf. on Data Engineering, p.502, March 23-26, 1999.
15. R. Agrawaland J.C. Shafer, "Parallel Mining of Association Rules", IEEE Trans. On Knowledge and Data Eng., 8(6):962-969, December 1996.
16. J. Shafer, R. Agrawal, and M. Mehta, "SPRINT: A Scalable Parallel Classifier for Data Mining", Proc. 22nd Int. Conf. On Very Large Databases, Morgan Kaufmann, 1996, pp.544-555.
17. http://www.opencloudconsortium.org/.
18. J. Dean and S. Ghemawat. "MapReduce: Simplied data processing on large clusters", In OSDI'04: 6th Symp. on Operating System Design and Implementation, 2004.
19. S. Ghemawat, H. Gobioff, and Shun-TakLeung. "The Google File System", SOSP'03, October 19-22, 2003.
20. Amazon Web Services, http://aws.amazon.com.
21. A. Bialecki, M. Cafarella, D. Cutting, O. O'Malley. "Hadoop: a framework for running applications on large clusters built of commodity hardware", http://lucene.apache.org/hadoop/, 2005.
22. A.S. Das, M. Datar, A. Garg and S. Rajaram, "Google News Personalization: Scalable Online Collaborative Filtering", Proc. 16th Intl. Conf. on World Wide Web, 2007, pp.271-280.
23. M.A. Bayir, I. H. Toroslu, A. Cosar and G. Fidan, "Smart Miner: a new framework for mining large scale web usage data", Proc. 18th Intl. Conf. on World Wide Web, 2009, pp.161-170.
24. S. Zhao, J. Betz, "Corroborate and learn facts from the web", Proc. 13th ACM SIGKDD Intl. Conf. on Knowledge Discovery and Data Mining, 2007, pp.995-1003.
25. N. V. Chawla, L. O. Hall, K. W. Bowyer, and W. P. Kegelmeyer, "Learning Ensembles from Bites: A Scalable and Accurate Approach", Journal of Machine Learning, 5:421-451, 2004.