Influences, challenges, and strategies for automotive HPC benchmarking and performance improvement

Parallel Computing

Volumn 25, Issue 12, 1999, Pages 1459-1476

  Ginsberg, Myron ^a  

^a HPC Research and Education   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMOTIVE INDUSTRY; BENCHMARKING; JAVA PROGRAMMING LANGUAGE; VIRTUAL REALITY; WORLD WIDE WEB;

HIGH PERFORMANCE COMPUTING (HPC); WEB-BASED COMPUTING;

PARALLEL PROCESSING SYSTEMS;

EID: 0033354445     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-8191(99)00059-9     Document Type: Article

References (100)

1. D.H. Bailey, Twelve Ways to Fool the Masses When Giving Performance Results on Parallel Computers, 11 June 1991; http://science.nas.nasa.gov/Pubs/TechReports/RNRreports/dbailey/RNR-91-020/RNR- 91-020.ps.
2. D.H. Bailey, Misleading Performance Reporting in the Supercomputing Field, 1 December 1992; http://science.nas.nasa.gov/Pubs/TechReports /RNReports/dbailey/RNR-92-005/RNR-92-005.ps.
3. A.J.C. Bik, F. Breg, D.B. Gannon, Compiler support for Java parallelization, Comput. Phys. 12 (1) (1998) 45-52.
4. A.J.C. Bik, D.B. Gannon, Exploiting implicit parallelism in Java, Concurrency Practice and Experience 9 (1997) 579-619.
5. A.J.C. Bik, D.B. Gannon, A note on native level 1 BLAS in Java, Concurrency, Practice and Experience, 1998; http://www.extreme.indiana.edu/hpjava/JAVAR/native.ps.
6. J. Boisseau et al., NAS Benchmarks on the Tera MTA, February 1998, see http://www.sdsc.edu/ allans/papers.html (the paper is under m-teac.ps).
7. J. Boisseau et al., CRAY T90 vs. Tera MTA: The Old Champ Faces a New Challenger, CUG Meeting, Stuttgart, June 1998, see http://www.sdsc.edu/allans/cug.html.
8. R.F. Boisvert, J.J. Dongarra, R. Pozo, K.A. Remington, G.W. Stewart, Developing Numerical Libraries in Java, presented at ACM 1998 Workshop on Java for High-Performance Network Computing, ACM SIGPLAN (March 1998); postscript and PDF versions available at http://math.nist.gov/javanumerics/ and at http://www.cs.ucsb.edu/conferences/ java98.
9. S. Bryson, Virtual envrionments in scientific visualization, Proceedings, Virtual Reality Software and Technology, Singapore, August 1994; http://science.nas.nasa.gov/bryson/papers/vr.sciviz.ps.
10. S. Bryson et al., Initial User Reaction to the Virtual Windtunnel, AIAA 95-0114, 33rd AIAA Aerospace Sciences Meeting and Exhibit, Reno, NV, January 1995; http://science.nas.nasa.gov/ bryson/papers/vwt.reaction.ps.
11. S. Bryson, S. Johan, L. Schlecht, An Extensible Interactive Visualization Framework for the Virtual Windtunnel, VRAIS '97 Proceedings; http://science.nas.nasa.gov/bryson/papers/interaction.ps.
12. Z. Budimlic, K. Kennedy, Optimizing Java: theory and practice, Concurrency, Practice and Experience 9 (1997) 445-463; Java for Computational Science and Engineering, Simulation and Modeling II, Las Vegas, NV, 21 June 1997.
13. Z. Budimlic, K. Kennedy, Optimizing Java: theory and practice, Concurrency, Practice and Experience 9 (1997) 445-463; Java for Computational Science and Engineering, Simulation and Modeling II, Las Vegas, NV, 21 June 1997.
14. H. Casanova, J.J. Dongarra, K. Seymour, User's Guide to NetSolve Version 1.1.b (Client and Server) (14 May 1998); http://www.cs.utk.edu/netsolve/ug.ps.
15. M. Cierniak, W. Li, Just-in-time optimization for high-performance Java programs, Concurrency, Practice and Experience 9 (1997) 1063-1073; Java for Computational Science and Engineering, Simulation and Modeling II, Las Vegas, NV, 21 June 1997.
16. M. Cierniak, W. Li, Just-in-time optimization for high-performance Java programs, Concurrency, Practice and Experience 9 (1997) 1063-1073; Java for Computational Science and Engineering, Simulation and Modeling II, Las Vegas, NV, 21 June 1997.
17. J. Clinckemaillie, Experience with MPP on the Simulation of Large Models, PAM-96 Conference, Strasbourg (November 1996); http://www.esi.fr./pubs/papers/jan2/index.html.
18. J. Clinckemaille et al., Performance Issues of the Parallel PAM-CRASH Code; http://www.esi.fr./ pubs/papers/jan1/index.html
19. J. Clinckemaille, E. Haug, H. Charlier, New CAE Applications in Virtual Prototyping on Parallel Systems, HP-CONVEX MCAE Seminars (1996); http://www.esi.fr/pubs/papers/parallel_systems/ parall.html.
20. J.J. Dongarra, Java Access to Numerical Libraries: Compiling Fortran to Java, 2 June 1998; http:// www.cs.utk.edu/f2j/f2jppt/index.html.
21. J.J. Dongarra, R. Wade, Linpack Benchmark - Java Version; http://www.netlib.org/benchmark/ linpackjava.
22. J.J. Dongarra, J.L. Martin, J. Worlton, Computer benchmarking: paths and pitfalls, IEEE Spectrum 24 (7) (1987) 38-43.
23. D.M. Doolin, J. Dongarra, K. Seymour, JLAPACK-Compiling LAPACK Fortran to Java, Phase III, Technical Report; http://www.cs.utk.edu/f2j/f2jreport/f2jreport.html.
24. R. Eigenmann, S. Hassanzadeh, Benchmarking with real industrial applications: the SPEC high-performance group, IEEE Comput. Sci. Engrg. 3 (1) (1996) 18-22.
25. M. Eldredge, T.J.R. Hughes, R.M. Ferencz, S.M. Rifai, High-performance parallel computing in industry, Parallel Computing 23 (1997) 1217-1233.
26. I. Foster, C. Kesselman (Eds.), The Grid: Blueprint for a New Computing Infrastructure, Morgan-Kaufmann, Los Altos, CA, August 1998.
27. M. Ginsberg, Challenges to the use of supercomputers and scientific visualization for automotive applications, Computers and Graphics 17 (1993) 507-515.
28. M. Ginsberg, Issues concerning the benchmarking of massively parallel computers for automotive applications, in: Proceedings of the Sixth SIAM Conference on Parallel Processing for Scientific Computing vol. 1, SIAM, Philadelphia, 1993, pp. 292-295.
29. M. Ginsberg, Panel session on parallelism issues for commercial finite element software, in: R.G. Dubensky (Ed.), Simulation and Development in Automotive Simultaneous Engineering SP-973, SAE, Warrendale, PA, 1993, pp. 163-169.
30. M. Ginsberg, An overview of supercomputing at General Motors Corporation, in: K.R. Ames, A.G. Brenner (Eds.), Frontiers of Superconducting II: A National Reassessment, volume in the Los Alamos Series in Basic and Applied Sciences, University of California Press, Berkeley, CA, 1994, pp. 359-371.
31. M. Ginsberg, Creating an automotive industry benchmark suite for assessing the effectiveness of high performance computers, SAE Trans. J. Passenger Cars, Sec. 6 104 (2) (1995) 2048-2057.
32. M. Ginsberg, AUTOBENCH: A 21st century vision for an automotive computing benchmark suite, in: M. Sheh (Ed.), High Performance Computing in Automotive Design, Engineering, and Manufacturing, Cray Research Inc., Eagan, MN, 1997, pp. 67-76.
33. M. Ginsberg, B. Alpern, C. Grassl, T. Sterling, D.E. Stevenson, Diverging Directions of HPC Hardware and Software Paradigms?, High Performance Computing '98, SCS Advanced Simulation Technologies Conference, Boston, April 1998, pp. 7-12.
34. M. Ginsberg, G. Clifford, F. Felker, L. Komzsik, S. Yunus, Panel Session: Future Directions for Commercial Finite Element Software, Special Issue on the Proceedings of the Fourth NASA National symposium on Large-Scale Analysis and Design on High-Performance Computers and Workstations, Advances in Engineering Software including Computing Systems in Engineering 29 (2) (1998), pp. 487-492.
35. M. Ginsberg, J.P. Johnson, Benchmarking the performance of physical impact simulation software on vector and parallel computers, in: J.L. Martin, S.F. Lundstrom (Eds.), Supercomputing 88: vol. 2 -Science and Applications, IEEE Computer Society Press, Washington, DC, 1989, pp. 180-190.
36. A.J.G. Hey, The GENESIS distributed memory benchmarks, Parallel Comput. 17 (1991) 1275-1283.
37. R.W. Hockney, The Science of Computer Benchmarking, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1996.
38. G. Kaplan, Auto Manufacture Digitizes in Depth, IEEE Spectrum 14, November 1997, pp. 62-69.
39. D.J. Kuck, High Performance Computing: Challenges for Future Systems, Oxford University Press, New York, 1996.
40. S. Kuschfeldt et al., Advanced visualization of crashworthiness simulations using virtual reality techniques, in: M. Sheh (Ed.), High Performance Computing in Automotive Design, Engineering, and Manufacturing, Cray Research, Inc., Eagan MN, 1997, pp. 455-462.
41. G. Lonsdale, J. Clinckemaillie, S. Vlachoutsis, J. Dubois, Communication Requirements in Parallel Crashworthiness Simulation, 1994; http://www.esi.fr/pubs/papers/hpcn94/hpcn94.html.
42. S.P. Midkiff, J.E. Moreira, M. Snir, Optimizing Array Reference Checking in Java Programs, Research Report RC 21184 (94652), Computer Science/Mathematics, IBM Research Division, T.J. Watson Research Center, Yorktown Heights, New York, 18 May 1998; IBM Systems J., to appear.
43. J.E. Moreira, S.P. Midkiff, M. Gupta, From Flop to MegaFlops: Java for Technical Computing, Research Report RC 21166 (94594), Computer Science/Mathematics, IBM Research Division, T.J. Watson Research Center, Yorktown Heights, New York, 28 April (submitted for publication).
44. L. Nilsson, K. Schweizerhof, B. Wainscott, J. Hallquist, Crashworthiness and Metal Forming: Simulations on Massively Parallel Computers Using the Explicit Finite Element Program LS_DYNA3D, Speedup J. 9 No. 2, December 1995, pp. 70-75.
45. L. Nilsson, P. Persson, Z.-H. Zhong, B. Wainscott, J. Hallquist, Explicit FE-Analysis of Sheet Metal Forming and Vehicle Collisions Using MPP Computers, in: Z. Zhihua (Ed.), Proceedings of the First International Conference on Engineering Computation and Computer Simulation - Theories and Applications, Hunan University Press, Changsha, China, 27-29 November 1995, pp. 66-75.
46. W. Pfeiffer et al., JNNIE: The Joint NSF-NASA Initiative on Evaluation, Report GA-A22123, San Diego Supercomputer Center, San Diego, CA, 1995.
47. M. Schulz, T. Ertl, T. Reuding, Crashing in Cyberspace - evaluating structural behavior of car bodies in a virtual environment, Proc. IEEE VRAIS '98 (1998) 160-166.
48. M. Schulz, E. Zimmerman, T. Reuding, T. Ertl, From High-End VR to PC-based VRML Viewing: Supporting the Car Body Development Process by Adapted Virtual Environments, Proceedings, IASTED CGIM'98 Halifax Nova Scotia, Canada, May 1998.
49. SRC, ORNL to Acquire Novel Computer to Launch DOE into Next Century, June 1998, see http:// www.srccomp.com.
50. Sun Proposes Modification to Java Programming Languages's Floating Point Specification; http:// www.sun.com/smi/Press/ sunflash/9803/sunflash.980324.17.html, 1998.
51. A.J. van der Steen, The benchmark of the Euroben group, Parallel Comput. 17 (1991) 1211-1221.
52. R.C. Ward, Testimony - Computational Grids and the Next Generation Internet Initiative, 4 November 1997; http://www.hpcc.gov/testimony/ward-04Nov97.html.
53. R.P. Weicker, A detailed look at some popular benchmarks, IEEE Comput. 17 (1991) 1153-1172.
54. Z.H. Zhong, L. Nilsson, Explicit finite element analysis of contact impact problems on parallel machines, in: Z. Zhihua (Ed.), Proceedings of the First International Conference on Engineering Computation and Computer Simulation - Theories and Applications, Hunan University Press, Changsha, China, 27-29 November 1995, pp. 76-85.
55. ANSYS 5.3 Benchmarks; http://www.ansys.com/ServSupp/Hardware/bm53.html.
56. ANSYS Revision 5.2 Large-Scale Benchmark Timing Results for Five Static Analysis Examples; http://www.ansys.com/ServSupp/Hardware/benchmarks_ls52.html.
57. ANSYS Revision 5.2 PowerSolver Benchmark Timing Results; http://www.ansys.com/ServSupp/ Hardware/PCG52.htm.
58. ANSYS 5.3 Version Summary; http://www.ansys.com/ServSupp/Hardware/verl.htm.
59. DYNA3D Benchmark Comparisons for Small Car Impact with a Rigid Pole; http://www.ccad.uio-wa.edu/mhray/bench.html.
60. General Motors R&D Center Virtual Reality Room; http://www.gm.com/about/info/overview/ RD_Center/websiter/Tour/Virtual.html
61. Really Getting into Your Work: The Use of Immersive Simulations, Randall Smith, General Motors; http://www_ivri.me.uic.edu/sym96/papers/s2.html.
62. Industrial Virtual Reality Institute Home Page; http://www._ivri.me.uic.edu.
63. H. Casanova, J.J. Dongarra, Network-Enabled Solvers and the NetSolve Project; http://www.net-lib.org/utk/papers/netsolve/paper3.html.
64. Fortran to Java (f2j) Compiler Project; http://www.cs.utk.edu/f2j.
65. James Gosling, The Evolution of Numerical Computing in Java; http:// java.sun.com/people/jag/ FP.html.
66. Hough's Comments on Java Numerics; http://www.validgh.com/java/java.numerics.ps.
67. Issues in Numerical Computing with Java; http://math.nist.gov/javanumerics/issues.html
68. Java Grande Forum; http://www.javagrande.org
69. The Java Grande Forum CHARTER DOCUMENT; http://www.npac.syr.edu/javagrande/jgfcharter.html.
70. Java Grande Forum Initial Ideas; http://www.npac.syr.edu/projects/javaforcse/javagrande/Java-GrandeForum.html.
71. JavaNumerics: Main; http://math.nist.gov/javanumerics.
72. Java for Scientific Computing; http://www.npac.syr.edu/projects/javaforcse.
73. Recent Changes to JNL, A Numerical Library for Java; http://www.vni.com/products/wpd/jnl/ jnl_new.html.
74. Validgh Java Numerics Page; http://www.validgh.com/java.
75. Large-Scale Interactive Visualization Environment (LIVE) System Overview; http://science.nas.nasa.gov/Software/LIVE.
76. National Crash Analysis Center (NCAC); http://www.ncac.gwu.edu.
77. Netlib Repository at UTK/ORNL; http://netlib2.cs.utk.edu/index.html.
78. Grids '98; http://www-unix.mcs.anl.gov/grids98.
79. The Globus Project; http://www.globus.org.
80. The Globus Project: Testbeds; http://www- fp.globus.org/testbeds/default.asp.
81. The Globus Project: Details Applications; http://www.globus.org/applications.
82. The NetSolve Home Page; http://www.cs.utk.edu/netsolve.
83. NHTSA R & D: Crashworthiness Finite Element Models; http://www-nrd.nhtsa.dot.gov/nrd10/ nrd11/fea.html.
84. The GENESIS Benchmark Information Service (GBIS) Graphical Interface; http://hpcc.soton.ac.uk/ RandD/gbis/papiani-new-gbis-top.html.
85. PARKBENCH (PARallel Kernels and BENCHmarks); http://netlib2.cs.utk.edu/parkbench.
86. Partnership for a New Generation of Vehicles (PNGV): Application of High Performance Computing to Automotive Design and Manufacturing; http://www.uscar.org/pngv/technical/System.html#application.
87. The Performance Database Server (PDS) includes data for UNPACK, LINPACK-Parallel, LINPACK - Peak; http://netlib2.cs.utk.edu/performance/html/PDStop.html.
88. Exploratory SPEC/HPG - AUTOBENCH ISV-Based Benchmarks; http://www.kai.com/autobench.
89. SPEC/HPG Proposal for ISV-based Benchmark; http://www.kai.com/autobench/spechpg.html.
90. SPEC/HPG Run Rules; http://www.specbench.org/hpg.
91. Java Grande Forum Technical Reports; http://www.javagrande.org/reports.htm
92. Silicon Graphics; http://www.sgi.com/virtual_reality/free.html.
93. Alternate Reality Corporation; http://www.virtual-reality.com.
94. Java Version Linpack Performance; http://www.netlib.org/benchmark/linpackjava.
95. National Computational Science Alliance (NCSA); http://alliance.ncsa.uiuc.edu.
96. National Partnership for Advanced Computational Infrastructure (NPACI); http://www.npaci.edu.
97. Accelerated Strategic Computing Initiative (ASCI); http://www.llnl.gov/asci.
98. Northeast Parallel Architectures Center (NPAC); http://www.npac.syr.edu.
99. M. Ginsberg, Current and future status of HPC in the world automative industry; http:// www.msri.org/publications/ln/hosted/siam/1998
100. W. Kahan, J.D. Darcy, How Java floating-point hurts everyone everywhere; http://www.cs.berkeley.edu/∼w.kahan/JAVAhurt.pdf.