CloudRAMSort: Fast and efficient large-scale distributed RAM sort on shared-nothing cluster

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2012, Pages 841-850

  Kim, Changkyu ^a   Park, Jongsoo ^a   Satish, Nadathur ^a   Lee, Hongrae ^b   Dubey, Pradeep ^a   Chhugani, Jatin ^a  

^a INTEL CORPORATION   (United States)

^b GOOGLE INC   (United States)

Author keywords

cloud computing; distributed; many core; multi core; ram sort; simd; sorting

Indexed keywords

ARCHITECTURAL FEATURES; DISTRIBUTED; DISTRIBUTED SORTING; EFFICIENT SYSTEMS; HIGH-SPEED; HIGH-SPEED DATA; INTER-NODE COMMUNICATION; INTERCONNECT BANDWIDTH; LOAD-BALANCING; MANY CORE; MULTI CORE; MULTI-STAGE; ON CURRENTS; PERFORMANCE BOTTLENECKS; PROJECT PERFORMANCE; RANDOM SAMPLING; SHARED NOTHING; SIMD; SINGLE INSTRUCTION MULTIPLE DATA; SORTING SYSTEM; SYSTEM USE; ZIPF DISTRIBUTION;

ANALYTICAL MODELS; BANDWIDTH; CLOUD COMPUTING; COMMUNICATION; COMPUTER SIMULATION; MODELS; RANDOM ACCESS STORAGE; SORTING;

CACHE MEMORY;

EID: 84862674743     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2213836.2213965     Document Type: Conference Paper

References (57)

1. Apache Hadoop. http://hadoop.apache.org.
2. bonnie++: a program to test hard drive performance. http://www.coker.com. au/bonnie++.
3. Data Generator For Sorting Benchmarks. www.ordinal.com/gensort.html.
4. Hadoop Cluster Setup. http://hadoop.apache.org/common/docs/current/ cluster-setup.html.
5. OpenFabrics Alliance. https://www.openfabrics.org/index.php.
6. SAS In-Memory Analytics. http://www.sas.com/software/high-performance- computing/in-memory-analytics/.
7. Sort Benchmark Home Page. http://sortbenchmark.org.
8. The Message Passing Interface (MPI) standard. http://www.mcs.anl.gov/ research/projects/mpi/.
9. B. Abali, F. Özgüner, and A. Bataineh. Balanced Parallel Sort on Hypercube Multiprocessors. IEEE Transactions on Parallel and Distributed Systems, 4(5):572-581, 1993.
10. D. Abts, M. R. Marty, P. M. Wells, P. Klausler, and H. Liu. Energy Proportional Datacenter Networks. In International Symposium on Computer Architecture (ISCA), 2010.
11. E. Anderson and J. Tucek. Efficiency Matters! ACM SIGOPS Operating Systems Review, 44(1), 2010.
12. A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, D. E. Culler, J. M. Hellerstein, and D. A. Patterson. High-Performance Sorting on Networks of Workstations. In SIGMOD, pages 243-254.
13. G. E. Blelloch, C. E. Leiserson, B. M. Maggs, C. G. Plaxton, S. J. Smith, and M. Zagha. A Comparison of Sorting Algorithms for the Connection Machine CM-2. In Symposium on Parallel Algorithms and Architectures (SPAA), pages 3-16, 1991.
14. L. Breslau, P. Cue, P. Cao, L. Fan, et al. Web caching and zipf-like distributions: Evidence and implications. In INFOCOM, pages 126-134, 1999.
15. R. E. Bryant. Data-Intensive Supercomputing: The case for DISC. Technical Report CMU-CS-07-128, 2007.
16. A. M. Caulfield, A. De, J. Coburn, T. I. Mollow, R. K. Gupta, and S. Swanson. Moneta: A high-performance storage array architecture for next-generation, non-volatile memories. In MICRO, pages 385-395, 2010.
17. J. Chhugani, A. D. Nguyen, V. W. Lee, W. Macy, M. Hagog, Y.-K. Chen, A. Baransi, S. Kumar, and P. Dubey. Efficient implementation of sorting on multi-core SIMD CPU architecture. PVLDB, 1(2):1313-1324, 2008.
18. H. Cho, P. Kapur, and K. C. Saraswat. Power Comparison Between High-Speed Electrical and Optical Interconnects for Interchip Communication. Journal of Lightwave Technology, 22(9), 2004.
19. J. Cieslewicz and K. A. Ross. Adaptive aggregation on chip multiprocessors. In VLDB, pages 339-350, 2007.
20. J. Coburn, A. M. Caulfield, A. Akel, L. M. Grupp, R. K. Gupta, R. Jhala, and S. Swanson. NV-Heaps: Making Persistent Objects Fast and Safe with Next-Generation, Non-Volatile Memories. In International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), pages 105-118, 2011.
21. J. Condit, E. B. Nightingale, C. Frost, E. Ipek, B. Lee, D. Burger, and D. Coetzee. Better I/O Through Byte-Addressable, Persistent Memory. In Symposium on Operating Systems Principles (SOSP), pages 133-146, 2009.
22. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In OSDI, pages 137-150, 2004.
23. D. J. DeWitt, S. Ghandeharizadeh, D. A. Schneider, A. Bricker, H.-I. Hsiao, and R. Rasmussen. The gamma database machine project. IEEE Trans. Knowl. Data Eng., 2(1):44-62, 1990.
24. D. J. DeWitt, J. F. Naughton, and D. A. Schneider. Parallel Sorting on a Shared-Nothing Architecture using Probabilistic Splitting. In International Conference on Parallel and Distributed Information Systems, pages 280-291.
25. M. Glick. Optical interconnects in next generation data centers: An end to end view. In Hot Interconnects, pages 178-181, 2008.
26. H. Gonzalez, A. Y. Halevy, C. S. Jensen, A. Langen, J. Madhavan, R. Shapley, W. Shen, and J. Goldberg-Kidon. Google fusion tables: web-centered data management and collaboration. In SIGMOD Conference, pages 1061-1066, 2010.
27. J. Gray and F. Putzolu. The 5 minute Rule for Trading Memory for Disc Accesses and the 10 Byte Rule for Trading Memory for CPU Time. In SIGMOD, pages 395-398, 1987.
28. J. Gray, P. Sundaresan, S. Englert, K. Baclawski, and P. J. Weinberger. Quickly generating billion-record synthetic databases. In SIGMOD Conference, pages 243-252, 1994.
29. J. S. Huang and Y. C. Chow. Parallel sorting and data partitioning by sampling. In International Computer Software and Applications Conference, 1983.
30. Intel Research. Light Peak: Overview. Intel White Paper, 2010.
31. M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: distributed data-parallel programs from sequential building blocks. In EuroSys, pages 59-72, 2007.
32. B. R. Iyer, G. R. Ricard, and P. J. Varman. Percentile Finding Algorithm for Multiple Sorted Runs. In VLDB, pages 135-144, 1989.
33. L. V. Kalé and S. Krishnan. A Comparison Based Parallel Sorting Algorithm. In International Conference on Paralllel Processing (ICPP), pages 196-200, 1993.
34. C. Kim, J. Chhugani, N. Satish, et al. FAST: Fast Architecture Sensitive Tree search on modern CPUs and GPUs. In SIGMOD, pages 339-350, 2010.
35. C. Kim, E. Sedlar, J. Chhugani, T. Kaldewey, A. D. Nguyen, A. D. Blas, V. W. Lee, N. Satish, and P. Dubey. Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs. PVLDB, 2(2):1378-1389, 2009.
36. J. Kim, W. J. Dally, and D. Abts. Flattened Butterfly : A Cost-Efficient Topology for High-Radix Networks. In International Symposium on Computer Architecture (ISCA), 2007.
37. J. Kim, W. J. Dally, B. Towles, and A. Gupta. Microarchitecture of a High-Radix Router. In International Symposium on Computer Architecture (ISCA), 2005.
38. M. H. Kryder and C. S. Kim. After Hard Drives - What Comes Next? IEEE Transactions on Magnetics, 45(10), 2009.
39. B. C. Lee, E. Ipek, O. Mutlu, and D. Burger. Phase change memory architecture and the quest for scalability. Commun. ACM, 53(7):99-106, 2010.
40. C. E. Leiserson. Fat-Trees: Universal Networks for Hardware-Efficient Supercomputing. IEEE Transactions on Computers, 34(10), 1985.
41. D. L. Lewis and H.-H. S. Lee. Architectural evaluation of 3d stacked rram caches. In 3DIC, pages 1-4, 2009.
42. K. Lim, P. Ranganathan, J. Chang, C. Patel, T. Mudge, and S. Reinhardt. Understanding and Designing New Server Architectures for Emerging Warehouse-Computing Environments. In International Symposium on Computer Architecture (ISCA), pages 315-326, 2008.
43. H. Liu, C. F. Lam, and C. Johnson. Scaling optical interconnects in datacenter networks: Opportunities and challenges for wdm. In Hot Interconnects, 2010.
44. M. LLC. In-Memory Database Systems: Myths and Facts. 2010.
45. O. O'Malley and A. C. Murthy. Winning a 60 Second Dash with a Yellow Elephant. http://sortbenchmark.org/Yahoo2009.pdf, 2009.
46. J. Ousterhout, P. Agrawal, D. Erickson, C. Kozyrakis, J. Leverich, D. Mazières, S. Mitra, A. Narayanana, G. Parulkar, M. Rosenblum, S. M. Rumble, E. Stratmann, and R. Stutsman. The Case for RAMClouds: Scalable High-Performance Storage Entirely in DRAM. ACM SIGOPS Operating Systems Review, 43(4), 2010.
47. D. A. Patterson. Latency Lags Bandwidth. Communications of the ACM, 47(10), 2004.
48. A. Pavlo, E. Paulson, A. Rasin, D. J. Abadi, D. J. DeWitt, S. Madden, and M. Stonebraker. A Comparison of Approaches to Large-Scale Data Analysis. In SIGMOD, pages 165-178, 2009.
49. P. Ranganathan. From Microprocessors to Nanostores: Rethinking Data-Centric Systems. IEEE Computer, 44(1):39-48, 2011.
50. A. Rasmussen, G. Porter, M. Conley, H. V. Madhyastha, R. N. Mysore, A. Pucher, and A. Vahdat. TritonSort: A Balanced Large-Scale Sorting System. In USENIX conference on Networked System Design and Implementation, 2011.
51. N. Satish, C. Kim, J. Chhugani, et al. Fast sort on CPUs and GPUs: a case for bandwidth oblivious SIMD sort. In SIGMOD, pages 351-362. ACM, 2010.
52. L. Seiler, D. Carmean, E. Sprangle, T. Forsyth, M. Abrash, P. Dubey, S. Junkins, A. Lake, J. Sugerman, R. Cavin, R. Espasa, E. Grochowski, T. Juan, and P. Hanrahan. Larrabee: A Many-Core x86 Architecture for Visual Computing. SIGGRAPH, 27(3), 2008.
53. S. Seshadri and J. F. Naughton. Sampling Issues in Parallel Database Systems. In Advanced in Database Technology - EDBT.
54. H. Shi and J. Schaeffer. Parallel Sorting by Regular Sampling. Journal of Parallel and Distributed Computing, 14(4):361-372, 1992.
55. E. Solomonik and L. V. Kalé. Highly scalable parallel sorting. In International Symposium on Parallel and Distributed Processing (IPDPS), pages 1-12.
56. M. Stonebraker, D. J. Abadi, D. J. DeWitt, S. Madden, E. Paulson, A. Pavlo, and A. Rasin. Mapreduce and parallel dbmss: friends or foes? Commun. ACM, 53(1):64-71, 2010.
57. T. Willhalm, N. Popovici, Y. Boshmaf, H. Plattner, A. Zeier, and J. Schaffner. SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units. PVLDB, 2(1):385-394, 2009.