Scalable distributed-memory external sorting

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2010, Pages 685-688

  Rahn, Mirko ^a   Sanders, Peter ^a   Singler, Johannes ^a  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION OVERHEADS; DATA SETS; DISTRIBUTED MEMORY; LOWER BOUNDS; MASSIVELY PARALLEL MACHINE;

ALGORITHMS; COMPETITION; COST REDUCTION; SORTING;

MERGING;

EID: 77952755938     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2010.5447865     Document Type: Conference Paper

References (14)

1. A. Aggarwal and C. G. Plaxton. Optimal parallel sorting in multi-level storage. In 5th ACM-SIAM Symposium on Discrete Algorithms, pages 659-667, 1994.
2. A. C. Arpaci-Dusseau, R. Arpaci-Dusseau, D. E. Culler, J. M. Hellerstein, and D. A. Patterson. High-performance sorting on networks of workstations. In Proceedings of the 1997 ACM SIGMOD International Conference on Management of Data, pages 243-254, 1997.
3. G. Chaudhry and T. H. Cormen. Slabpose columnsort: A new oblivious algorithm for out-of-core sorting on distributed-memory clusters. Algorithmica, 45:483-508, 2006.
4. F. Dehne, W. Dittrich, D. Hutchinson, and A. Maheshwari. Bulk synchronous parallel algorithms for the external memory model. Theory of Computing Systems, 35:567-597, 2002.
5. R. Dementiev, L. Kettner, and P. Sanders. STXXL: Standard Template Library for XXL data sets. Software Practice & Experience, 38(6):589-637, 2008.
6. R. Dementiev and P. Sanders. Asynchronous parallel disk sorting. In 15th ACM Symposium on Parallelism in Algorithms and Architectures, pages 138-148, San Diego, 2003.
7. P. J. Varman et al. Merging multiple lists on hierarchical-memory multiprocessors. J. Par. & Distr. Comp., 12(2):171-177, 1991.
8. D. A. Hutchinson, P. Sanders, and J. S. Vitter. Duality between prefetching and queued writing with parallel disks. SIAM Journal on Computing, 34(6):1443-1463, 2005.
9. M. H. Nodine and J. S. Vitter. Deterministic distribution sort in shared and distributed memory multiprocessors. In 5th ACM Symposium on Parallel Algorithms and Architectures, pages 120-129, 1993.
10. C. Nyberg, T. Barclay, Z. Cvetanovic, J. Gray, and D. Lomet. AlphaSort: A RISC machine sort. In SIGMOD, pages 233-242, 1994.
11. Mirko Rahn, Peter Sanders, and Johannes Singler. Scalable distributed-memory external sorting. CoRR, abs/0910.2582, 2009.
12. Rajasekaran. Out-of-core computing on mesh connected computers. JPDC: Journal of Parallel and Distributed Computing, 64, 2004.
13. J. Singler, P. Sanders, and F. Putze. MCSTL: The multi-core standard template library. In 13th International Euro-Par Conference, volume 4641 of LNCS, pages 682-694, 2007.
14. J. S. Vitter and E. A. M. Shriver. Algorithms for parallel memory, I/II. Algorithmica, 12(2/3):110-169, 1994.