Diagnosis, tuning, and redesign for multicore performance: A case study of the fast multipole method

2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2010

Volumn , Issue , 2010, Pages

  Chandramowlishwaran, Aparna ^a   Madduri, Kamesh ^b   Vuduc, Richard ^a  

^a Georgia Institute of Technology   (United States)

^b LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATED PERFORMANCE ANALYSIS; END USER PROGRAMMERS; FAST MULTIPOLE METHOD; MULTI CORE; MULTI-CORE SYSTEMS; MULTI-THREADED IMPLEMENTATION; PERFORMANCE ANALYSIS;

PROGRAM PROCESSORS;

SCALABILITY;

EID: 78650822594     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2010.19     Document Type: Conference Paper

References (47)

1. A. Chandramowlishwaran, S. Williams, L. Oliker, I. Lashuk, G. Biros, and R. Vuduc, "Optimizing and tuning the fast multipole method for state-of-the-art multicore architectures, "in Proc. IEEE Int'l. Parallel and Distributed Processing Symp. (IPDPS), Atlanta, GA, USA, April 2010, (to appear).
2. R. J. Fowler, T. Gamblin, A. K. Porterfield, P. Dreher, S. Huang, and B. Joó, "Performance engineering challenges: The view from RENCI, "Proc. SciDAC, J. Physics: Conf. Ser., vol. 125, no. 1, pp. 1-6, July 2008.
3. K. Yotov, X. Li, G. Ren, M. J. Garzarán, D. Padua, K. Pingali, and P. Stodghill, "Is search really necessary to generate high-performance BLAS?" Proc. IEEE, vol. 93, no. 2, pp. 358-386, February 2005.
4. K. Yotov, T. Roeder, K. Pingali, J. Gunnels, and F. Gustavson, "An experimental comparison of cache-oblivious and cache-conscious programs, "in Proc. ACM Symp. Parallelism in Algorithms and Architectures (SPAA), San Diego, CA, USA, June 2007, pp. 93-104.
5. K. Goto and R. A. van de Geijn, "Anatomy of high-performance matrix multiplication, "ACM Trans. Mathematical Software (TOMS), vol. 34, no. 12, p. 25pp, May 2008.
6. L. Peng, J.-K. Peir, T. K. Prakash, C. Staelin, Y.-K. Chen, and D. Koppelman, "Memory hierarchy performance measurement of commercial dual-core desktop processors, "J. Sys. Arch., vol. 54, no. 8, pp. 816-828, August 2008.
7. G. Hager, T. Zeiser, and G. Wellein, "Data access optimization for highly threaded multi-core CPUs with multiple memory controllers, "in Proc. IEEE Int'l. Parallel and Distributed Processing Symp. (IPDPS), Miami, FL, USA, April 2008, pp. 1-7.
8. A. Mandal, R. Fowler, and A. Porterfield, "Modeling memory concurrency for multi-socket multi-core systems, " in Proc. IEEE Int'l. Symp. Performance Analysis of Systems and Software (ISPASS), March 2010.
9. S. Williams, A. Waterman, and D. Patterson, "Roofline: An insightful visual performance model for multicore architectures, "Comm. ACM (CACM), vol. 52, no. 4, pp. 65-76, April 2009.
10. F. Song, S. Moore, and J. Dongarra, "Analytical modeling and optimization for affinity based thread scheduling on multicore systems, "in Proc. IEEE Int'l. Conf. Cluster Computing (CLUSTER), New Orleans, LA, USA, October 2009.
11. B. J. Barnes, B. Rountree, D. K. Lowenthal, J. Reeves, B. de Supinski, and M. Schulz, "A regression-based approach to scalability prediction, "in Proc. ACM Int'l. Conf. Supercomputing (ICS), Island of Kos, Greece, June 2008, pp. 368-377.
12. S. R. Alam, N. Bhatia, and J. S. Vetter, "An exploration of performance attributes for symbolic modeling of emerging processing devices," in Proc. High Performance Computation Conference (HPCC), Houston, TX, USA, September 2007. [Online]. Available: http://www2.cs.uh.edu/ ∼openuh/hpcc07/papers/64-Alam.pdf.
13. N. Tallent, J. Mellor-Crummey, L. Adhianto, M. Fagan, and M. Krentel, "HPCToolkit: Performance tools for scientific computing, "Proc. Sci-DAC, J. Physics: Conf. Ser., vol. 125, 2008.
14. M. M. Tikir, L. Carrington, E. Strohmaier, and A. Snavely, "A genetic algorithms approach to modeling the performance of memory-bound computations, "in Proc. ACM/IEEE Conf. Supercomputing (SC), no. 47, Reno, NV, USA, November 2007.
15. H. Mathis, A. Mericas, J. D. McCalpin, R. Eickemeyer, and S. Kunkel, "Characterization of simultaneous multithreading (SMT) efficiency in POWER5, "IBM Journal of Research and Development, vol. 49, no. 4/5, pp. 555-564, July/September 2005.
16. E. D. Lazowska, J. Zahorjan, G. S. Graham, and K. C. Sevcik, Quantitative system performance: Computer system analysis using queueing network models. Upper Saddle River, NJ, USA: Prentice-Hall, 1984.
17. L. Greengard and V. Rokhlin, "A fast algorithm for particle simulations, "J. Comp. Phys., vol. 73, pp. 325-348, 1987.
18. L. Ying, D. Zorin, and G. Biros, "A kernel-independent adaptive fast multipole method in two and three dimensions, "J. Comp. Phys., vol. 196, pp. 591-626, May 2004.
19. I. Lashuk, A. Chandramowlishwaran, H. Langston, T.-A. Nguyen, R. Sampath, A. Shringarpure, R. Vuduc, L. Ying, D. Zorin, and G. Biros, "A massively parallel adaptive fast multipole method on heterogeneous architectures, "in Proc. ACM/IEEE Conf. Supercomputing (SC), Portland, OR, USA, November 2009.
20. J. Dongarra and F. Sullivan, Eds., Computing in Science and Engineering: Special issue on The Top 10 Algorithms. IEEE, 2000, vol. 2, no. 1, pp. 22-79, http://doi.ieeecomputersociety.org/10.1109/MCISE.2000.814652.
21. J. Board and K. Schulten, "The fast multipole algorithm, "Computing in Science and Engineering, vol. 2, no. 1, pp. 76-79, January/February 2000.
22. A. G. Gray and A.W. Moore, "'n-body' problems in statistical learning, "in Proc. Advances in Neural Information Processing Systems (NIPS), Vancouver, British Columbia, Canada, December 2000.
23. P. Ram, D. Lee, W. March, and A. Gray, "Linear-time algorithms for pairwise statistical problems, "in Proc. Advances in Neural Information Processing Systems (NIPS), Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, Eds. MIT Press, 2009, pp. 1527-1535. [Online]. Available: http://books.nips.cc/papers/files/nips22/NIPS20090436.pdf.
24. TMPerformance Analyzer, "http://software.intel.com/en-us/intel-vtune/, April 2010. [Online]. Available: http://software.intel. com/en-us/intel-vtune/.
25. J. Levon, "OProfile manual, "http://oprofile.sourceforge.net/ doc/index.html, 2004. [Online]. Available: http://oprofile.sourceforge.net/doc/ index.html.
26. S. Shende and A. D. Maloney, "The TAU parallel performance system, "Int'l. J. High Performance Computing Applications (IJHPCA), vol. 20, no. 2, pp. 287-311, 2006.
27. TM, version 1.9.3, "http://www. openspeedshop.org/wp/, October2009. [Online]. Available: http://www. openspeedshop.org/wp/.
28. A. Snavely, L. Carrington, N. Wolter, J. Labarta, R. Badia, and A. Purkayastha, "A framework for performance modeling and prediction, "in Proc. ACM/IEEE Conf. Supercomputing (SC), Baltimore, MD, USA, November 2002. [Online]. Available: http://portal.acm.org/citation.cfm?id=762785.
29. L. McVoy and C. Staelin, "lmbench: Portable tools for performance analysis, "in Proc. USENIX Ann. Technical Conf., San Diego, CA, USA, January 1996. [Online]. Available: http://lmbench.sourceforge.net/.
30. J. McCalpin, "Memory bandwidth and machine balance in high performance computers, "IEEE Technical Committee on Computer Architecture (TCCA) Newsletter, December 1995. [Online]. Available: http://www.cs.virginia. edu/∼mccalpin/papers/balance/index.html.
31. D. Pase, "pChase benchmark, "http://pchase.org, March 2008.
32. O. Coulaud, P. Fortin, and J. Roman, "High performance BLAS formulation of the multipole-to-local operator in the fast multipole method, "J. Comp. Phys., vol. 227, no. 3, pp. 1836-1862, January 2008.
33. L. Ying, G. Biros, D. Zorin, and H. Langston, "A new parallel kernel-independent fast multipole method, "in Proc. ACM/IEEE Conf. Supercomputing (SC), Phoenix, AZ, USA, November 2003. [Online]. Available: http://portal.acm.org/citation.cfm?id=1050165.
34. N. A. Gumerov and R. Duraiswami, "Fast multipole methods on graphics processors, "J. Comp. Phys., vol. 227, pp. 8290-8313, 2008.
35. J. C. Phillips, J. E. Stone, and K. Schulten, "Adapting a message-driven parallel application to GPU-accelerated clusters, "in Proc. ACM/IEEE Conf. Supercomputing (SC), Austin, TX, USA, November 2008.
36. P. Ajmera, R. Goradia, S. Chandran, and S. Aluru, "Fast, parallel, GPUbased construction of space filling curves and octrees, "in Proc. Symp. Interactive 3D Graphics (I3D), Redwood City, CA, USA, 2008, (poster).
37. T. Hamada, T. Narumi, R. Yokota, K. Y. K. Nitadori, and M. Taiji, "42 TFlops hierarchical n-body simulations on GPUs with applications in both astrophysics and turbulence, "in Proc. ACM/IEEE Conf. Supercomputing (SC), Portland, OR, USA, November 2009.
38. J. Kurzak and B. M. Pettitt, "Massively parallel implementation of a fast multipole method for distributed memory machines, "J. Parallel Distrib. Comput., vol. 65, pp. 870-881, July 2005.
39. S. Ogata, T. J. Campbell, R. K. Kalia, A. Nakano, P. Vashishta, and S. Vemparala, "Scalable and portable implementation of the fast multipole method on parallel comptuers, "Computer Phys. Comm., vol. 153, no. 3, pp. 445-461, July 2003.
40. M. S. Warren and J. K. Salmon, "A parallel hashed oct-tree n-body algorithm, "in Proc. ACM/IEEE Conf. Supercomputing (SC), Portland, OR, USA, November 1993, pp. 12-21.
41. B. Hariharan and S. Aluru, "Efficient parallel algorithms and software for compressed octrees with applications to hierarchical methods, "Parallel Computing (ParCo), vol. 31, no. 3-4, pp. 311-331, March- April 2005.
42. G. M. Amdahl, "Validity of the single processor approach to achieving large-scale computing capabilities, "in Proc. AFIPS Joint Computer Conf., vol. 30, Atlantic City, NJ, USA, April 1967, pp. 483-485.
43. "Intel ® 64 and IA-32 architectures software developer's manuals, "http://www.intel.com/products/processor/manuals/.
44. M. Frigo and S. G. Johnson, "The design and implementation of FFTW3, "Proc. IEEE: Special issue on "Program Generation, Optimization, and Platform Adaptation", vol. 93, no. 2, pp. 216-231, 2005.
45. A. Buttari, J. Langou, J. Kurzak, and J. Dongarra, "A class of parallel tiled linear algebra algorithms for multicore architectures." Innovative Computing Laboratory, University of Tennessee Knoxville, Tech. Rep. UT-CS-07-600 (LAPACK Working Note 191), September 2007, http://www.netlib.org/ lapack/lawnspdf/lawn191.pdf.
46. E. Chan, E. S. Quintana-Ortí, G. Quintana-Ortí, and R. van de Geijn, "SuperMatrix out-of-order scheduling of matrix operations for SMP and multi-core architectures, "in Proc. ACM Symp. Parallelism in Algorithms and Architectures (SPAA), San Diego, CA, USA, June 2007, pp. 116- 125.
47. A. Chandramowlishwaran, K. Knobe, and R. Vuduc, "Performance evaluation of Concurrent Collections on high-performance multicore computing systems, "in Proc. IEEE Int'l. Parallel and Distributed Processing Symp. (IPDPS), Atlanta, GA, USA, April 2010, (to appear).