Speeding up distributed mapreduce applications using hardware accelerators

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2009, Pages 42-49

  Becerra, Yolanda ^a   Beltran, Vicenç ^a   González, Marc ^a   Torres, Jordi ^a   Ayguadé, Eduard ^a  

^a BARCELONA SUPERCOMPUTING CENTER   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

DATA-DRIVEN; DISTRIBUTED APPLICATIONS; DISTRIBUTED CLUSTERS; DISTRIBUTED ENVIRONMENTS; EXECUTION ENVIRONMENTS; HARDWARE ACCELERATORS; HETEROGENEOUS PROCESSORS; MULTI-LEVEL PARALLELISM; MULTIPLE LEVELS; OPERATING SYSTEMS; PARALLEL AND DISTRIBUTED PROGRAMMING; PERFORMANCE/COST RATIO; PROGRAMMING MODELS; RUNTIMES;

COMPUTER OPERATING SYSTEMS; PROGRAM PROCESSORS;

PARALLEL PROGRAMMING;

EID: 77951475353     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2009.59     Document Type: Conference Paper

References (27)

1. DARPA project: High Productivity Computing Systems. http://www. highproductivity.org
2. Hadoop Map/Reduce Tutorial http://hadoop.apache.org/core/docs/current/ mapred-tutorial.html.
3. HDFS Architecture http://hadoop.apache.org/core/docs/current/hdfs-design. html.
4. Los Alamos Lab: High-Performance Computing: Roadrunner. http://www.lanl.gov/roadrunner
5. The OpenMP Programming Model (OpenMP). http://www.openmp.org.
6. Terabyte Sort Benchmark. http://www.hpl.hp.com/hosted/sortbenchmark
7. E. Ayguadé, R. M. Badia, D. Cabrera, F. I. Alejandro Duran, M. Gon-zalez, D. Jimenez, J. Labarta, X. Martorell, R. Mayo, J. M. Perez, and E. S. Quintana-Ort. A proposal to extend the openmp tasking model for heterogeneous multicores. In 5th International Workshop of OpenMP IWOMP 2009), 2009.
8. E. Ayguadé, N. Copty, A. Duran, J. Hoeflinger, Y. Lin, F. Massaioli, X. Teruel, P. Unnikrishnan, and G. Zhang. The design of openmp tasks. IEEE Transactions on Parallel and Distributed Systems, 20(3):404-418, 2009.
9. V. Beltran, J. Torres, and E. Ayguadé. Improving web server perfor mance through main memory compression. In 14th IEEE International Conference on Parallel and Distributed Systems (ICPADS), pages 303- 310, 2008
10. F. Cantonnet, Y. Yao, M. M. Zahran, and T. A. El-Ghazawi. Productivity analysis of the upc language. In Proceedings of the 18th International Parallel and Distributed Processing Symposium, page 254, 2004.
11. D. Carrera, M. Steinder, I. Whalley, J. Torres, and E. Ayguadé. Enabling resource sharing between transactional and batch workloads using dynamic application placement. In 9th ACM/IFIP/USENIX International Conference on Middleware, pages 203-222, 2008.
12. B. Chamberlain, D. Callahan, and H. Zima. Parallel programmability and the chapel language. Int. J. High Perform. Comput. Appl., 21(3):291-312, 2007.
13. C. Coarfa, Y. Dotsenko, J. Mellor-Crummey, D. Chavarria-Miranda, F. Cantonnet, T. El-Ghazawi, A. Mohanti, and Y. Yao. An evaluation of global address space languages: Co-array fortran and unified parallel c. In Proceedings of the 10th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP 2005), 2005.
14. K. Datta, D. Bonachea, and K. Yelick. Titanium performance and poten-tial: An npb experimental study. In Proceedings of the 18th International Workshop on Languages and Compilers for Parallel Computing, 2005.
15. M. de Kruijf and K. Sankaralingam. MapReduce for the Cell B.E. Architecture. Technical Report TR1625, Department of Computer Sciences, The University of Wisconsin-Madison, Madison, WI, 2007.
16. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In OSDI '04: Proceedings of the Sixth Symposium on Operating System Design and Implementation, San Francisco, pages 137-150, December 2004.
17. N. Drosinos and N. Koziris. Performance comparison of pure mpi vs hybrid mpi-openmp parallelization models on smp clusters. In Proceedings of the 18th International Parallel and Distributed ProcessingSymposium (IPDPS04), 2004.
18. K. Ebcioglu, V. Saraswat, and V. Sarkar. X10: An experimental language for high productivity programming of scalable systems. In Proceedings of the 2005 P-PHEC workshop, co-located with HPCA 2005, 2005.
19. A. E. Eichenberger, K. ÓBrien, K. ÓBrien, P. Wu, T. Chen, P. H. Oden, D. A. Prener, J. C. Shepherd, B. So, Z. Sura, A. Wang, T. Zhang, P. Zhao, and M. Gschwind. Optimizing compiler for the cell processor. In PACT '05: Proceedings of the 14th International Conference on Parallel Architectures and Compilation Techniques, pages 161-172, 2005.
20. S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. SIGOPS Oper. Syst. Rev., 37(5):29-43, 2003.
21. M. Gschwind, P. Hofstee, B. Flachs, M. Hopkins, Y. Watanabe, and T. Yamazaki. A novel simd architecture for the cell heterogeneous chip-multiprocessor. 2005.
22. G. Jost, H. Jin, D. an Mey, and F. F. Hatay. Comparing the openmp, mpi, and hybrid programming paradigms on an smp cluster. In NAS Technical Report NAS-03-019, 2003.
23. G. Mahinthakumar and F. Saied. A hybrid mpi-openmp implementation of an implicit finite-element code on parallel architectures. In Proceedings of the International Journal of High Performance Computing Applications, pages Vol 16. 371-393, 2002.
24. C. Ranger, R. Raghuraman, A. Penmetsa, G. Bradski, and C. Kozyrakis. Evaluating mapreduce for multi-core and multiprocessor systems. In HPCA '07: Proceedings of the 2007 IEEE 13th International Symposium on High Performance Computer Architecture, pages 13-24, 2007.
25. S. Siewior. Diploma thesis: Acceleration of encrypted communication using co-processors http://diploma-thesis.siewior.net/html
26. Sun Microsystems, Inc. Java Native Interface. http://java.sun.com/docs/ books/jni
27. The Message Passing Interface. The Message Passing Interface (MPI). http://www-unix.mcs.anl.gov/mpi