Billion-particle SIMD-friendly two-point correlation on large-scale HPC cluster systems

International Conference for High Performance Computing, Networking, Storage and Analysis, SC

Volumn , Issue , 2012, Pages

  Chhugani, Jatin ^a   Kim, Changkyu ^a   Shukla, Hemant ^b   Park, Jongsoo ^a   Dubey, Pradeep ^a   Shalf, John ^b   Simon, Horst D ^b  

^a INTEL CORPORATION   (United States)

^b LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARK APPLICATIONS; CORRELATION COMPUTATIONS; LAWRENCE LIVERMORE NATIONAL LABORATORIES; LOAD-BALANCING SCHEMES; PARALLEL EFFICIENCY; TWO-POINT CORRELATION; TWO-POINT CORRELATION FUNCTION; UPDATE ALGORITHMS;

BENCHMARKING; GRAPHIC METHODS; SUPERCOMPUTERS;

DIGITAL STORAGE;

EID: 84877715459     PISSN: 21674329     EISSN: 21674337     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2012.24     Document Type: Conference Paper

References (41)

1. J. Dolence and R. J. Brunner, "Fast Two-Point Correlations of Extremely Large Data Sets," in 9th LCI International Conference on High-Performance Clustered Computing, 2008.
2. "Accelerating Cosmological Data Analysis with FPGAs," 2009, http://www.ncsa.illinois.edu/ kindr/projects/hpca/files/fccm09-presentation-v2. pdf.
3. A. Ptak et al., "Galaxy Evolution with LSST," American Astronomical Society, vol. 43, no. 16, pp. 217-252, 2011.
4. D. G. Andersen, J. Franklin, M. Kaminsky, A. Phanishayee, L. Tan, and V. Vasudevan, "Fawn: a fast array of wimpy nodes," in SOSP, 2009, pp. 1-14.
5. J. G. Koomey, "Worldwide electricity used in data centers," Environmental Research Letters, vol. 3, no. 3, p. 034008, 2008. [Online]. Available: http://stacks.iop.org/1748-9326/3/i=3/a=034008
6. "Intel Advanced Vector Extensions Programming Reference," 2008, http://softwarecommunity.intel.com/isn/downloads/intelavx/Intel-AVX- Programming-Reference-31943302.pdf.
7. L. Seiler, D. Carmean, E. Sprangle, T. Forsyth, M. Abrash, P. Dubey, S. Junkins, A. Lake, J. Sugerman, R. Cavin, R. Espasa, E. Grochowski, T. Juan, and P. Hanrahan, "Larrabee: A Many-Core x86 Architecture for Visual Computing," Proceedings of SIGGRAPH, vol. 27, no. 3, 2008.
8. K. B. Skaugen, "HPC Technology - Scale-Up and Scale-Out," http://lecture2go.uni-hamburg.de/konferenzen/-/k/10940, 2010, keynote at SC10.
9. S. Kumar, D. Kim, M. Smelyanskiy, Y.-K. Chen, J. Chhugani, C. J. Hughes, C. Kim, V. W. Lee, and A. D. Nguyen, "Atomic vector operations on chip multiprocessors," in ISCA, 2008, pp. 441-452.
10. J. Weiland, N. Odegard, R. Hill, E. Wollack, G. Hinshaw et al., "Seven-Year Wilkinson Microwave Anisotropy Probe (WMAP) Observations: Planets and Celestial Calibration Sources," Astrophys.J.Suppl., vol. 192, p. 19, 2011.
11. P. J. E. Peebles and B. Ratra, "The cosmological constant and dark energy," Rev. Mod. Phys., vol. 75, pp. 559-606, Apr 2003. [Online]. Available: http://link.aps.org/doi/10.1103/RevModPhys.75.559
12. "The Nobel Prize in Phsics, 2011," 2011, http://www.nobelprize. org/nobel prizes/physics/laureates/2011/index.html.
13. "The Square Kilometer Array," 2011, http://www.skatelescope. org/wp-content/uploads/2011/03/SKA-Brochure-web.pdf.
14. "Large Synoptic Survey Telescope PetaScale Data R&D Challenges," 2012, http://www.lsst.org/lsst/science/petascale.
15. P. C. Broekema, A.-J. Boonstra et al., "DOME: Towards the ASTRON AND IBM Center for Exascale Technology," IBM, Tech. Rep., 2012. [Online]. Available: http://domino.research.ibm.com/library/CYBERDIG.NSF/papers/ D30B773CBFF6EB39852579EB0051279C/$File/rz3822.pdf
16. R. P. Norris, "Data challenges for next-generation radio telescopes," in Proceedings of the 2010 Sixth IEEE International Conference on e-Science Workshops, ser. E-SCIENCEW '10. Washington, DC, USA: IEEE Computer Society, 2010, pp. 21-24. [Online]. Available: http://dx.doi.org/10.1109/ eScienceW.2010.13
17. P. J. E. Peebles, Large-Scale Structure of the Universe. Princeton University Press, 1980.
18. S. D. Landy and A. S. Szalay, "Bias and variance of angular correlation functions," Astrophysical Journal, vol. 412, no. 1, pp. 64-71, 1993.
19. D. W. Roeh, V. V. Kindratenko, and R. J. Brunner, "Accelerating Cosmological Data Analysis with Graphics Processors," in Workshop on General Purpose Processing on Graphics Processing Units (GPGPU), 2009, pp. 1-8.
20. V. V. Kindratenko, A. D. Myers, and R. J. Brunner, "Implementation of the two-point angular correlation function on a high-performance reconfigurable computer," Scientific Programming, vol. 17, no. 3, pp. 247-259, 2009.
21. J. W. Tukey, "Bias and confidence in not-quite large samples," The Annals of Mathematical Statistics, vol. 29, no. 2, p. 614, 1958.
22. A. G. Gray and A. W. Moore, "'N-Body' Problems in Statistical Learning," in Advances in Neural Information Processing Systems (NIPS), 2000, pp. 521-527.
23. A. W. Moore, A. J. Connolly, C. Genovese, A. Gray, L. Grone, N. Kanidoris II, R. Nichol, J. Schneider, A. Szalay, I. Szapudi, and L. Wasserman, "Fast algorithms and efficient statistics: N-point correlation functions," in Mining the Sky, ser. ESO Astrophysics Symposia, A. Banday, S. Zaroubi, and M. Bartelmann, Eds., 2001, vol. 20, pp. 71-82.
24. J. L. Bentley, "Multidimensional Binary Search Trees Used for Associative Searching," Communications of the ACM, vol. 18, pp. 509-517, 1975.
25. NVIDIA, "Fermi Architecture White Paper," 2009. [Online]. Available: http://www.nvidia.com/content/PDF/fermi-white-papers/NVIDIA-Fermi- Compute-Architecture-Whitepaper.pdf
26. C. Kim, E. Sedlar, J. Chhugani, T. Kaldewey, A. D. Nguyen, A. D. Blas, V. W. Lee, N. Satish, and P. Dubey, "Sort vs. hash revisited: Fast join implementation on modern multi-core cpus," PVLDB, vol. 2, no. 2, pp. 1378-1389, 2009.
27. N. Satish, C. Kim, J. Chhugani, A. D. Nguyen, V. W. Lee, D. Kim, and P. Dubey, "Fast sort on cpus and gpus: a case for bandwidth oblivious simd sort," in SIGMOD Conference, 2010, pp. 351-362.
28. T. P. chun Chen, D. Budnikov, C. J. Hughes, and Y.-K. Chen, "Computer vision on multi-core processors: Articulated body tracking," in ICME, 2007, pp. 1862-1865.
29. C. J. Hughes, R. Grzeszczuk, E. Sifakis, D. Kim, S. Kumar, A. P. Selle, J. Chhugani, M. Holliman, and Y.-K. Chen, "Physical simulation for animation and visual effects: parallelization and characterization for chip multiprocessors," in Proceedings of the 34th annual international symposium on Computer architecture, ser. ISCA '07. New York, NY, USA: ACM, 2007, pp. 220-231. [Online]. Available: http://doi.acm.org/10.1145/1250662.1250690
30. E. Mohr, D. A. Kranz, and R. H. Halstead, "Lazy task creation: a technique for increasing the granularity of parallel programs," IEEE Transactions on Parallel and Distributed Systems, vol. 2, pp. 185-197, 1991.
31. R. D. Blumofe and C. E. Leiserson, "Scheduling multithreaded computations by work stealing," J. ACM, vol. 46, no. 5, pp. 720-748, Sep. 1999. [Online]. Available: http://doi.acm.org/10.1145/324133.324234
32. S. Kumar, C. J. Hughes, and A. Nguyen, "Carbon: architectural support for fine-grained parallelism on chip multiprocessors," in Proceedings of the 34th annual international symposium on Computer architecture, ser. ISCA '07. New York, NY, USA: ACM, 2007, pp. 162-173. [Online]. Available: http://doi.acm.org/10.1145/1250662.1250683
33. C. Mei, Y. Sun, G. Zheng, E. J. Bohm, L. V. Kalé, J. C.Phillips, and C. Harrison, "Enabling and scaling biomolecular simulations of 100 million atoms on petascale machines with a multicore-optimized message-driven runtime," in Proceedings of the 2011 ACM/IEEE conference on Supercomputing, Seattle, WA, November 2011.
34. J. Dinan, D. Larkins, P. Sadayappan, S. Krishnamoorthy, and J. Nieplocha, "Scalable work stealing," in Proceedings of the 2009 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, ser. SC '09, 2009, pp. 1-9.
35. M. Deisher, M. Smelyanskiy, B. Nickerson, V. W. Lee, M. Chuvelev, and P. Dubey, "Designing and dynamically load balancing hybrid lu for multi/many-core," Computer Science - R&D, vol. 26, no. 3-4, pp. 211-220, 2011.
36. B. Choi, R. Komuravelli, V. Lu, H. Sung, R. L. B. Jr., S. V. Adve, and J. C. Hart, "Parallel sah k-d tree construction," in High Performance Graphics, 2010, pp. 77-86.
37. A. Becker, G. Zheng, and L. Kale, "Distributed Memory Load Balancing," in Encyclopedia of Parallel Computing, D. Padua, Ed. Springer Verlag, 2011.
38. "The Message Passing Interface (MPI) standard," http://www.mcs.anl.gov/research/projects/mpi/.
39. D. A. Bader and J. JáJá, "Practical parallel algorithms for dynamic data redistribution, median finding, and selection," in Proceedings of the 10th International Parallel Processing Symposium, ser. IPPS '96. Washington, DC, USA: IEEE Computer Society, 1996, pp. 292-301. [Online]. Available: http://portal.acm.org/citation.cfm?id=645606.661174
40. T. Hamada and K. Nitadori, "190 tflops astrophysical n-body simulation on a cluster of gpus," in SC, 2010, pp. 1-9.
41. J. Barnes and P. Hut, "A hierarchical O(N log N) force-calculation algorithm," Nature, vol. 324, pp. 446-449, 1986.