Multi-GPU MapReduce on GPU clusters

Proceedings - 25th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2011

Volumn , Issue , 2011, Pages 1068-1079

  Stuart, Jeff A ^a   Owens, John D ^a  

^a University of California   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

GPU CLUSTERS; LARGE-SCALE COMPUTING; MAP-REDUCE; MULTI CORE; PARTIAL REDUCTION;

DISTRIBUTED PARAMETER NETWORKS;

EID: 80053262523     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2011.102     Document Type: Conference Paper

References (22)

1. M. Ekman, F. Warg, and J. Nilsson, "An in-depth look at computer performance growth," ACM SIGARCH Computer Architecture News, vol. 33, no. 1, pp. 144-147, Mar. 2005.
2. J. Dean and S. Ghemawat, "MapReduce: Simplified data processing on large clusters," Communications of the ACM, vol. 51, no. 1, pp. 107-113, Jan. 2008.
3. J. Nickolls, I. Buck, M. Garland, and K. Skadron, "Scalable parallel programming with CUDA," ACM Queue, pp. 40-53, Mar./Apr. 2008.
4. D. B. Kirk and W. W. Hwu, Programming Massively Parallel Processors. Morgan Kaufmann, 2010.
5. M. Harris, J. D. Owens, S. Sengupta, Y. Zhang, and A. Davidson, "CUDPP: CUDA data parallel primitives library," 2009, http://gpgpu.org/developer/cudpp/.
6. M. Harris, S. Sengupta, and J. D. Owens, "Parallel prefix sum (scan) with CUDA," in GPU GemsEd. Addison Wesley, Aug. 2007, ch. 39, pp. 851-876.
7. N. Satish, M. Harris, and M. Garland, "Designing efficient sorting algorithms for manycore GPUs," in Proceedings of the 23rd IEEE International Parallel and Distributed Processing Symposium, May 2009.
8. C. Ranger, R. Raghuraman, A. Penmetsa, G. Bradski, and C. Kozyrakis, "Evaluating mapreduce for multicore and multiprocessor systems," in International Symposium on High-Performance Computer Architecture. Los Alamitos, CA, USA: IEEE Computer Society, 2007, pp. 13-24.
9. B. He, W. Fang, Q. Luo, N. K. Govindaraju, and T. Wang, "Mars: a MapReduce framework on graphics processors," in Proceedings of the 17th International Conference on Parallel Architectures and Compilation Techniques, Oct. 2008, pp. 260-269.
10. J. Ekanayake and G. Fox, "High performance parallel computing with clouds and cloud technologies," in Proceedings of the First International Conference on Cloud Computing, Oct. 2009.
11. B. Catanzaro, N. Sundaram, and K. Keutzer, "A Map Reduce framework for programming graphics processors,"in Third Workshop on Software Tools for Multi-Core Systems, Apr. 2008.
12. C. Hong, D. Chen, W. Chen, W. Zheng, and H. Lin, "MapCG: Writing parallel program portable between CPU and GPU," in Proceedings of the 19th International Conference on Parallel Architectures and Compilation Techniques, Sep. 2010, pp. 217-226.
13. M. M. Rafique, B. Rose, A. R. Butt, and D. S. Nikolopoulos, "CellMR: A framework for supporting MapReduce on asymmetric Cell-based clusters," in Proceedings of the 23rd IEEE International Parallel and Distributed Processing Symposium, May 2009.
14. H. Yang, A. Dasdan, R.-L. Hsiao, and D. S. Parker, "Map-Reduce- Merge: Simplified relational data processing on large clusters," in SIGMOD '07: Proceedings of the 2007 ACM SIGMOD International Conference on Management of Data, Jun. 2007, pp. 1029-1040.
15. C. Jin and R. Buyya, "MapReduce programming model for. NET-based cloud computing," in Euro-Par '09: Proceedings of the 15th International Euro-Par Conference on Parallel Processing. Berlin: Springer-Verlag, Aug. 2009, pp. 417-428.
16. S. Chen and S. W. Schlosser, "Map-Reduce meets wider varieties of applications," Intel Research Pittsburgh, Tech. Rep. IRP-TR-08-05, May 2008. [Online]. Available: http://www.pittsburgh.intel-research.net/~chensm/ papers/IRP-TR-08-05.pdf
17. J. H. C. Yeung, C. C. Tsang, K. H. Tsoi, B. S. H. Kwan, C. C. C. Cheung, A. P. C. Chan, and P. H. W. Leong, "Map-Reduce as a programming model for custom computing machines," in FCCM '08: Proceedings of the 2008 16th International Symposium on Field-Programmable Custom Computing Machines, Apr. 2008, pp. 149-159.
18. R. Lämmel, "Google's MapReduce programming model - revisited," Science of Computer Programming, vol. 68, no. 3, pp. 208-237, Oct. 2007. (Pubitemid 47379880)
19. Y. Gu and R. L. Grossman, "Sector and sphere: the design and implementation of a high-performance data cloud." Philosophical transactions. Series A, Mathematical, physical, and engineering sciences, vol. 367, no. 1897, pp. 2429-2445, Jun. 2009. [Online]. Available: 10.1098/rsta.2009.0053
20. H. Prokop, "Cache-oblivious algorithms," Master's thesis, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Jun. 1999.
21. R. J. Cichelli, "Minimal perfect hash functions made simple," Communications of the ACM, vol. 23, pp. 17-19, January 1980.
22. T. Aila and S. Laine, "Understanding the efficiency of ray traversal on GPUs," in Proceedings of High Performance Graphics 2009, Aug. 2009, pp. 145-149.