Comparing map-reduce and FREERIDE for data-intensive applications

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2009, Pages

  Jiang, Wei ^a   Ravi, Vignesh T ^a   Agrawal, Gagan ^a  

^a The Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APRIORI; ASSOCIATION MINING; DATA MINING ALGORITHM; DATA MINING APPLICATIONS; DATA MINING COMPUTATIONS; DATA SCANNING; DATA SET SIZE; DATA SETS; DATA-INTENSIVE APPLICATION; K NEAREST NEIGHBOR SEARCH; K-MEANS CLUSTERING; PERFORMANCE ASPECTS; RELATIVE PERFORMANCE;

CLUSTER COMPUTING; COMPUTER SCIENCE; DATA MINING; SORTING; TECHNICAL PRESENTATIONS;

APPLICATION PROGRAMMING INTERFACES (API);

EID: 72049116296     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2009.5289199     Document Type: Conference Paper

References (23)

1. R. E. Bryant, "Data-intensive supercomputing: The case for disc," School of Computer Science, Carnegie Mellon University, Tech. Rep. Technical Report CMU-CS-07-128, 2007.
2. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," in Proceedings of OSDI, 2004, pp. 137-150.
3. J. Ekanayake, S. Pallickara, and G. Fox, "Mapreduce for data intensive scientific analyses," in IEEE Fourth International Conference on e-Science, Dec 2008, pp. 277-284.
4. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, "Dryad: distributed data-parallel programs from sequential building blocks," in Proceedings of the 2007 EuroSys Conference. ACM, 2007, pp. 59-72.
5. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins, "Pig latin: a not-so-foreign language for data processing," in Proceedings of SIGMOD Conference. ACM, 2008, pp. 1099-1110.
6. R. Pike, S. Dorward, R. Griesemer, and S. Quinlan, "Interpreting the data: Parallel analysis with sawzall," Scientific Programming, vol.13, no.4, pp. 277-298, 2005.
7. D. Gillick, A. Faria, and J. Denero, "Mapreduce: Distributed computing for machine learning," 2008. [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/summary10.1.1.111.9204
8. C. Ranger, R. Raghuraman, A. Penmetsa, G. R. Bradski, and C. Kozyrakis, "Evaluating mapreduce for multi-core and multiprocessor systems," in Proceedings of 13th International Conference on High-Performance Computer Architecture (HPCA). IEEE Computer Society, 2007, pp. 13-24.
9. R. Jin and G. Agrawal, "A middleware for developing parallel data mining implementations," in Proceedings of the first SIAM conference on Data Mining, Apr. 2001.
10. R. Jin and G. Agrawal, "Shared Memory Parallelization of Data Mining Algorithms: Techniques, Programming Interface, and Performance," in Proceedings of the second SIAM conference on Data Mining, Apr. 2002.
11. R. Jin and G. Agrawal, "Shared Memory Parallelization of Data Mining Algorithms: Techniques, Programming Interface, and Performance," IEEE Transactions on Knowledge and Data Engineering (TKDE), 2005.
12. R. Agrawal and J. Shafer, "Parallel mining of association rules," IEEE Transactions on Knowledge and Data Engineering, vol.8, no.6, pp. 962 - 969, Jun. 1996.
13. P. Cheeseman and J. Stutz, "Bayesian classification (autoclass): Theory and practice," in Advances in Knowledge Discovery and Data Mining. AAAI Press / MIT Press, 1996, pp. 61 - 83.
14. A. K. Jain and R. C. Dubes, Algorithms for Clustering Data. Prentice Hall, 1988.
15. J. Han and M. Kamber, Data Mining: Concepts and Techniques. Morgan Kaufmann Publishers, 2000.
16. S. K. Murthy, "Automatic construction of decision trees from data: A multi-disciplinary survey," Data Mining and Knowledge Discovery, vol.2, no.4, pp. 345-389, 1998.
17. C.-T. Chu, S. K. Kim, Y.-A. Lin, Y. Yu, G. R. Bradski, A. Y. Ng, and K. Olukotun, "Map-reduce for machine learning on multicore," in Proceedings of the Twentieth Annual Conference on Neural Information Processing Systems (NIPS). MIT Press, 2006, pp. 281-288.
18. "Hadoop core," http://hadoop.apache.org/core/.
19. S. Ghemawat, H. Gobioff, and S.-T. Leung, "The google file system," in Proceedings of SOSP. ACM, 2003, pp. 29-43.
20. V. T. Ravi and G. Agrawal, "Performance Issues in Parallelizing Data-Intensive Applications on a Multi-core Cluster," in Proceedings of Conference on Clustering Computing and Grids (CCGRID), 2009.
21. R. Agrawal and R. Srikant., "Fast algorithms for mining association rules." in Proc. 1994 Int. conf. Very Large DataBases (VLDB'94), Santiago,Chile, Sep. 1994, pp. 487-499.
22. "Disco project," http://discoproject.org/.
23. H. chih Yang, A. Dasdan, R.-L. Hsiao, and D. S. P. Jr., "Mapreduce- merge: simplified relational data processing on large clusters," in Proceedings of SIGMOD Conference. ACM, 2007, pp. 1029-1040.