A Map-reduce system with an Alternate API for multi-core environments

CCGrid 2010 - 10th IEEE/ACM International Conference on Cluster, Cloud, and Grid Computing

Volumn , Issue , 2010, Pages 84-93

  Jiang, Wei ^a   Ravi, Vignesh T ^a   Agrawal, Gagan ^a  

^a Ohio State University   (United States)

Author keywords

Data intensive computing; Map reduce; Middleware; Multi core architectures

Indexed keywords

DATA MINING APPLICATIONS; DATA-INTENSIVE APPLICATION; DATA-INTENSIVE COMPUTING; EFFICIENT IMPLEMENTATION; GENERALIZED REDUCTION; HIGH PRODUCTIVITY; LARGE-SCALE CLUSTERS; LOWER MEMORY REQUIREMENT; MULTI CORE; MULTI-CORE SYSTEMS; MULTICORE ARCHITECTURES; RUNTIMES; SCALABLE IMPLEMENTATION; STANFORD;

CLUSTER COMPUTING; GRID COMPUTING; MIDDLEWARE;

MICROPROCESSOR CHIPS;

EID: 77954894186     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGRID.2010.10     Document Type: Conference Paper

References (21)

1. Disco project. http://discoproject.org/.
2. R. Agrawal and R. Srikant. Fast algorithms for mining association rules. In Proc. 1994 Int. conf. Very Large DataBases (VLDB'94), pages 487-499, Santiago, Chile, September 1994.
3. Rakesh Agrawal, Tomasz Imielinski, and Arun Swami. Mining association rules between sets of items in large databases. In Proceedings of the 1993 ACM SIGMOD Conference, pages 207-216, May 1993.
4. Hung chih Yang, Ali Dasdan, Ruey-Lung Hsiao, and Douglas Stott Parker Jr. Map-reduce-merge: simplified relational data processing on large clusters. In Proceedings of SIGMOD Conference, pages 1029-1040. ACM, 2007.
5. Cheng-Tao Chu, Sang Kyun Kim, Yi-An Lin, YuanYuan Yu, Gary R. Bradski, Andrew Y. Ng, and Kunle Olukotun. Map-reduce for machine learning on multicore. In Proceedings of the Twentieth Annual Conference on Neural Information Processing Systems (NIPS), pages 281-288. MIT Press, 2006.
6. Jeffrey Dean and Sanjay Ghemawat. Mapreduce: Simplified data processing on large clusters. In Proceedings of OSDI, pages 137-150, 2004.
7. J. Ekanayake, S. Pallickara, and G. Fox. Mapreduce for data intensive scientific analyses. In IEEE Fourth International Conference on e-Science, pages 277-284, Dec 2008.
8. Reza Farivar, Abhishek Verma, Ellick Chan, and Roy Campbell. Mithra: Multiple data independent tasks on a heterogeneous resource architecture. In Proceedings of the 2009 IEEE Cluster. IEEE, 2009.
9. Dan Gillick, Arlo Faria, and John Denero. Mapreduce: Distributed computing for machine learning. 2008.
10. Bingsheng He, Wenbin Fang, Qiong Luo, Naga K. Govindaraju, and Tuyong Wang. Mars: a mapreduce framework on graphics processors. In Proceedings of PACT 2008, pages 260-269. ACM, 2008.
11. Michael Isard, Mihai Budiu, Yuan Yu, Andrew Birrell, and Dennis Fetterly. Dryad: distributed data-parallel programs from sequential building blocks. In Proceedings of the 2007 EuroSys Conference, pages 59-72. ACM, 2007.
12. A. K. Jain and R. C. Dubes. Algorithms for Clustering Data. Prentice Hall, 1988.
13. Wei Jiang, Vignesh T. Ravi, and Gagan Agrawal. Comparing map-reduce and freeride for data-intensive applications. In Proceedings of the 2009 IEEE Cluster. IEEE, 2009.
14. Ruoming Jin and Gagan Agrawal. A middleware for developing parallel data mining implementations. In Proceedings of the first SIAM conference on Data Mining, April 2001.
15. Ruoming Jin and Gagan Agrawal. Shared Memory Parallelization of Data Mining Algorithms: Techniques, Programming Interface, and Performance. In Proceedings of the second SIAM conference on Data Mining, April 2002.
16. Christopher Olston, Benjamin Reed, Utkarsh Srivastava, Ravi Kumar, and Andrew Tomkins. Pig latin: a not-soforeign language for data processing. In Proceedings of SIGMOD Conference, pages 1099-1110. ACM, 2008.
17. Rob Pike, Sean Dorward, Robert Griesemer, and Sean Quinlan. Interpreting the data: Parallel analysis with sawzall. Scientific Programming, 13(4):277-298, 2005.
18. Colby Ranger, Ramanan Raghuraman, Arun Penmetsa, Gary R. Bradski, and Christos Kozyrakis. Evaluating mapreduce for multi-core and multiprocessor systems. In Proceedings of 13th HPCA, pages 13-24. IEEE Computer Society, 2007.
19. Sangwon Seo, Ingook Jang, Kyungchang Woo, Inkyo Kim, Jin-Soo Kim, and Seungryoul Maeng. Hpmr: Prefetching and pre-shuffling in shared mapreduce computation environment. In Proceedings of the 2009 IEEE Cluster. IEEE, 2009.
20. Ashish Thusoo, Joydeep Sen Sarma, Namit Jain, Zheng Shao, Prasad Chakka, Suresh Anthony, Hao Liu, Pete Wyckoff, and Raghotham Murthy. Hive - a warehousing solution over a map-reduce framework. PVLDB, 2(2):1626-1629, 2009.
21. Matei Zaharia, Andy Konwinski, Anthony D. Joseph, Randy H. Katz, and Ion Stoica. Improving mapreduce performance in heterogeneous environments. In Proceedings of OSDI, pages 29-42. USENIX Association, 2008.