Exploiting 162-nanosecond end-to-end communication latency on Anton

2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2010

Volumn , Issue , 2010, Pages

  Dror, Ron O ^a   Grossman, J P ^a   Mackenzie, Kenneth M ^a   Towles, Brian ^a   Chow, Edmond ^a   Salmon, John K ^a   Young, Cliff ^a   Bank, Joseph A ^a   Batson, Brannon ^a   Deneroff, Martin M ^a   Kuskin, Jeffrey S ^a   Larson, Richard H ^a   Moraes, Mark A ^a   Shaw, David E ^a,b  

^a D E SHAW RESEARCH   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION HARDWARE; COMMUNICATION LATENCY; COMMUNICATION PATTERN; COMMUNICATION TIME; CRITICAL PATHS; END-TO-END COMMUNICATION; HARDWARE MECHANISM; INTER-NODE LATENCIES; KEY ELEMENTS; MD SIMULATION; MOLECULAR DYNAMICS SIMULATIONS; NETWORK LATENCIES; ORDERS OF MAGNITUDE; PARALLEL MACHINE; SCIENTIFIC APPLICATIONS; SOFTWARE CONSTRUCTS; SPECIAL-PURPOSE MACHINES; STATE OF THE ART; SYNCHRONIZATION COST; TECHNIQUES USED;

COMPUTER SOFTWARE; DATA TRANSFER; MOLECULAR DYNAMICS; PARALLEL ARCHITECTURES;

COMMUNICATION;

EID: 78650830897     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2010.23     Document Type: Conference Paper

References (47)

1. N. R. Adiga, G. Almasi, G. S. Almasi, Y. Aridor, R. Barik, et al., "An overview of the BlueGene/L supercomputer, "in Proc. ACM/IEEE Conf. on Supercomputing (SC02), Baltimore, MD, Nov. 2002.
2. S. R. Alam, J. A. Kuehn, R. F. Barrett, J. M. Larkin, M. R. Fahey, et al., "Cray XT4: an early evaluation for petascale scientific simulation, "in Proc. ACM/IEEE Conf. on Supercomputing (SC07), Reno, NV, Nov. 2007.
3. S. Alam, R. Barrett, M. Bast, M. R. Fahey, J. Kuehn, et al., "Early evaluation of IBM BlueGene/P, "in Proc. ACM/IEEE Conf. on Supercomputing (SC08), Austin, TX, Nov. 2008.
4. F. Allen, G. Almasi, W. Andreoni, D. Beece, B. J. Berne, et al., "Blue Gene: a vision for protein science using a petaflop supercomputer, "IBM Systems J., vol. 40, no. 2, pp. 310-327, Feb. 2001.
5. G. Almási, P. Heidelberger, C. J. Archer, X. Martorell, C. C. Erway, et al., "Optimization of MPI collective communication on BlueGene/L systems, "in Proc. 19th Annu. Int. Conf. on Supercomputing, Cambridge, MA, June 2005.
6. J. A. Anderson, C. D. Lorenz, and A. Travesset, "General purpose molecular dynamics simulations fully implemented on graphics processing units, "J. Comp. Phys., vol. 227, no. 10, pp. 5342-5359, May 2008.
7. K. J. Barker, K. Davis, A. Hoisie, D. J. Kerbyson, M. Lang, et al., "Entering the petaflop era: the architecture and performance of Roadrunner, "in Proc. ACM/IEEE Conf. on Supercomputing (SC08), Austin, TX, Nov. 2008.
8. J. Beecroft, D. Addison, D. Hewson, M. McLaren, D. Roweth, et al., "QsNetII: defining High-performance network design, "IEEE Micro, vol. 25, no. 4, pp. 34-47, Aug. 2005.
9. A. Bhatele, S. Kumar, C. Mei, J. C. Phillips, G. Zheng, and L. V. Kalé, "Overcoming scaling challenges in biomolecular simulations across multiple platforms, "in Proc. IEEE Int. Parallel and Distributed Processing Symp., Miami, FL, Apr. 2008.
10. R. Biswas, M. J. Djomehri, R. Hood, H. Jin, C. Kiris, and S. Saini, "An application-based performance characterization of the Columbia supercomputer, "in Proc. ACM/IEEE Conf. on Supercomputing (SC05), Seattle, WA, Nov. 2005.
11. M. Blocksome, C. Archer, T. Inglett, P. McCarthy, M. Mundy, et al., "Design and implementation of a one-sided communication interface for the IBM eServer Blue Gene® supercomputer, "in Proc. ACM/IEEE Conf. on Supercomputing (SC06), Tampa, FL, Nov. 2006.
12. K. J. Bowers, E. Chow, H. Xu, R. O. Dror, M. P. Eastwood, et al., "Scalable algorithms for molecular dynamics simulations on commodity clusters, "in Proc. ACM/IEEE Conf. on Supercomputing (SC06), Tampa, FL, Nov. 2006.
13. P. A. Boyle, D. Chen, N. H. Christ, M. Clark, S. Cohen, et al., "QCDOC: a 10 teraflops computer for tightly-coupled calculations, "in Proc. ACM/IEEE Conf. on Supercomputing (SC04), Pittsburgh, PA, Nov. 2004.
14. G. Buzzard, D. Jacobson, M. Mackey, S. Marovich, and J. Wilkes, "An implementation of the Hamlyn sender-managed interface architecture, "in Proc. 2nd USENIX Symp. on Operating Systems Design and Implementation, Seattle, WA, Oct. 1996.
15. E. Chow, C. A. Rendleman, K. J. Bowers, R. O. Dror, D. H. Hughes, et al., "Desmond performance on a cluster of multicore processors, "D. E. Shaw Research Technical Report DESRES/TR-2008-01, http://www.deshawresearch.com/ publications/ Desmond%20Performance%20on%20a%20Cluster%20of%20Multicore%20Processors.pdf, July 2008.
16. S. Coll, D. Duato, F. Petrini, F. J. Mora, "Scalable hardwarebased multicast trees, "in Proc. ACM/IEEE Conf. on Supercomputing (SC03), Phoenix, AZ, Nov. 2003.
17. G. De Fabritiis, "Performance of the Cell processor for biomolecular simulations, "Comput. Phys. Commun., vol. 176, no. 11-12, pp. 660-664, June 2007.
18. R. Fatoohi, S. Saini, and R. Ciotti, "Interconnect performance evaluation of SGI Altix 3700 BX2, Cray X1, Cray Opteron Cluster, and Dell PowerEdge, "in Proc. 20th Int. Parallel and Distributed Processing Symp., Rhodes Island, Greece, Apr. 2006.
19. M. Fillo, S. W. Keckler, W. J. Dally, N. P. Carter, A. Chang, et al., "The M-Machine multicomputer, "in Proc. 28th Annu. Int. Symp. on Microarchitecture, Ann Arbor, MI, Nov. 1995.
20. B. G. Fitch, A. Rayshubskiy, M. Eleftheriou, T. J. C. Ward, M. Giampapa, et al., "Blue Matter: approaching the limits of concurrency for classical molecular dynamics, "in Proc. ACM/IEEE Conf. on Supercomputing (SC06), Tampa, FL, Nov. 2006.
21. M. S. Friedrichs, P. Eastman, V. Vaidyanathan, M. Houston, S. LeGrand, et al., "Accelerating molecular dynamic simulation on graphics processing units, "J. Comp. Chem., vol. 30, no. 6, pp. 864-72, Apr. 2009.
22. R. Garg and Y. Sabharwal, "Software routing and aggregation of messages to optimize the performance of HPCC randomaccess benchmark, "in Proc. ACM/IEEE Conf. on Supercomputing (SC06), Tampa, FL, Nov. 2006.
23. M. J. Harvey, G. Giupponi, and G. De Fabritiis, "ACEMD: accelerating biomolecular dynamics in the microsecond time scale, "J. Chem. Theory Comput., vol. 5, no. 6, pp. 1632-1639, May 2009.
24. B. Hess, C. Kutzner, D. van der Spoel, and E. Lindahl, "GROMACS 4: algorithms for highly efficient, load-balanced, and scalable molecular simulation, "J. Chem. Theory Comp., vol. 4, no. 3, pp. 435-447, Feb. 2008.
25. A. Hoisie, G. Johnson, D. J. Kerbyson, M. Lang, and S. Pakin, "A performance comparison through benchmarking and modeling of three leading supercomputers: Blue Gene/L, Red Storm, and Purple, "in Proc. ACM/IEEE Conf. on Supercomputing (SC06), Tampa, FL, Nov. 2006.
26. D. Kerbyson, A. Hoisie, S. Pakin, F. Petrini, and H. Wasserman, "Performance evaluation of an EV7 AlphaServer machine, "in Proc. LACSI Symp., Los Alamos, NM, 2002.
27. J. S. Kuskin, C. Young, J.P. Grossman, B. Batson, M. M. Deneroff, et al., "Incorporating flexibility in Anton, a specialized machine for molecular dynamics simulation, "in Proc. 14th Annu. Int. Symp. on High-Performance Computer Architecture, Salt Lake City, UT, Feb. 2008.
28. R. H. Larson, J. K. Salmon, R. O. Dror, M. M. Deneroff, C. Young, et al., "High-throughput pairwise point interactions in Anton, a specialized machine for molecular dynamics simulation, "in Proc. 14th Annu. Int. Symp. on High-Performance Computer Architecture, Salt Lake City, UT, Feb. 2008.
29. E. Luttmann, D. Ensign, V. Vaidyanathan, M. Houston, N. Rimon, et al., "Accelerating molecular dynamic simulation on the cell processor and Playstation 3, "J. Comput. Chem., vol. 30, no. 2, pp. 268-274, Jan 2008.
30. "MPI-2: extensions to the message-passing interface, "Message Passing Interface Forum, http://www.mpi-forum.org/docs/mpi2-report.pdf, Nov. 2003.
31. T. Narumi, Y. Ohno, N. Okimoto, T. Koishi, A. Suenaga, et al., "A 55 TFLOPS simulation of amyloid-forming peptides from yeast prion Sup35 with the special-purpose computer system MDGRAPE-3, "in Proc. ACM/IEEE Conf. on Supercomputing (SC06), Tampa, FL, Nov. 2006.
32. M. D. Noakes, D. A. Wallach, and W. J. Dally, "The J-Machine multicomputer: an architectural evaluation, "ACM SIGARCH Computer Architecture News, vol. 21, no. 2, pp. 224-235, May 1993.
33. F. Petrini, S. Coll, E. Frachtenberg, and A. Hoisie, "Performance evaluation of the Quadrics interconnection network, "Cluster Computing, vol. 6, no. 2, pp. 125-142, Oct. 2004.
34. J. C. Phillips, J. E. Stone, and K. Schulten, "Adapting a message-driven parallel application to GPU-accelerated clusters, "in Proc. ACM/IEEE Conf. on Supercomputing (SC08), Austin, TX, Nov. 2008.
35. S. Plimpton, "Fast parallel algorithms for short-range molecular dynamics, "J. Comp. Phys., vol. 117, no. 1, pp. 1-19, Mar. 1995.
36. M. Schlansker, N. Chitlur, E. Oertli, P. M. Stillwell, L. Rankin, et al., "High-performance ethernet-based communications for future multi-core processors, "in Proc. ACM/IEEE Conf. on Supercomputing (SC07), Reno, NV, Nov. 2007.
37. S. L. Scott, "Synchronization and communication in the T3E multiprocessor, "in Proc. 7th Int. Conf. on Architectural Support for Programming Languages and Operating Systems, Cambridge, MA, 1996.
38. S. L. Scott, Cray Inc., Chippewa Falls, WI, private communication, July 2010.
39. Y. Shan, J. L. Klepeis, M. P. Eastwood, R. O. Dror, and D. E. Shaw, "Gaussian split Ewald: a fast Ewald mesh method for molecular simulation, "J. Chem. Phys., vol. 122, no. 5, pp. 054101:1-13, 2005.
40. D. E. Shaw, R. O. Dror, J. K. Salmon, J.P. Grossman, K. M. Mackenzie, et al., "Millisecond-scale molecular dynamics simulations on Anton, "in Proc. Conf. on High Performance Computing, Networking, Storage and Analysis (SC09), Portland, OR, Nov. 2009.
41. D. E. Shaw, M. M. Deneroff, R. O. Dror, J. S. Kuskin, R. H. Larson, et al., "Anton: a special-purpose machine for molecular dynamics simulation, "in Proc. 34th Annu. Int. Symp. on Computer Architecture, San Diego, CA, June 2007.
42. S. J. Sistare and C. J. Jackson, "Ultra-high performance communication with MPI and the Sun FireTM link interconnect, "in Proc. ACM/IEEE Conf. on Supercomputing (SC02), Baltimore, MD, Nov. 2002.
43. C. Sosa and G. Lakner, "IBM system Blue Gene solution: Blue Gene/P application development, "IBM Red-Book, SG24-7287, www.redbooks.ibm.com/ redbooks/pdfs/sg247287.pdf, 2008.
44. H. Subramoni, M. Koop, D. K. Panda, "Designing next generation clusters: evaluation of InfiniBand DDR/QDR on Intel computing platforms, "in Proc. 17th IEEE Symp. on High Performance Interconnects, New York, NY, Aug. 2009.
45. O. Tatebe, U. Nagashima, S. Sekiguchi, H. Kitabayashi, and Y. Hayashida, "Design and implementation of FMPL, a fast message-passing library for remote memory operations, "in Proc. ACM/IEEE Conf. on Supercomputing (SC01), Denver, CO, Nov. 2001.
46. M. Woodacre, D. Robb, D. Roe, and K. Feind, "The SGI® AltixTM 3000 global shared-memory architecture, "http://moodle.risc.uni-linz.ac.at/ file.php/50/altix-shared-memory.pdf, 2005.
47. C. Young, J. A. Bank, R. O. Dror, J.P. Grossman, J. K. Salmon, and D. E. Shaw, "A 32×32×32, spatially distributed 3D FFT in four microseconds on Anton, "Proc. Conf. on High Performance Computing, Networking, Storage and Analysis (SC09), Portland, OR, Nov. 2009.