Benchmarking optimization software with performance profiles

Mathematical Programming, Series B

Volumn 91, Issue 2, 2002, Pages 201-213

  Dolan, Elizabeth D ^a   Moré, Jorge J ^b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

Benchmarking; Guidelines; Metric; Performance; Software; Testing; Timing

Indexed keywords

GUIDELINES; METRIC; TIMING;

BENCHMARKING; OPTIMIZATION; PROBABILITY DISTRIBUTIONS;

COMPUTER SOFTWARE;

EID: 28244496090     PISSN: 00255610     EISSN: None     Source Type: Journal    
DOI: 10.1007/s101070100263     Document Type: Article

References (19)

1. Benson, H.Y., Shanno, D.F., Vanderbci, R.J. (2000): Interior-point methods for nonconvex nonlinear programming: Jamming and comparative numerical testing. Technical Report ORFE-00-02, Princeton University, Princeton, New Jersey
2. Billups, S.C., Dirkse, S.P., Ferris, M.C. (1997): A comparison of algorithms for large-scale mixed complementarity problems. Comput. Optim. Appl. 7, 3-25
3. Bondarenko, A.S., Bortz, D.M., More, J. J. (1998): COPS: Large-scale nonlinearly constrained optimization problems. Technical Memorandum ANL/MCS-TM-237, Argonne National Laboratory, Argonne, Illinois (Revised October 1999)
4. Bongartz, I., Conn, A.R., Gould, N.I.M., Saunders, M.A., Toint, P.L. (1997): A numerical comparison between the LANCELOT and MINOS packages for large-scale numerical optimization. Report 97/13, Namur University
5. Conn, A.R., Gould, N.I.M., Toint, P.L. (1992): LANCELOT, no. 17 in Springer Ser. Comput. Math., Springer-Verlag
6. Conn, A.R., Gould, N.I.M., Toint, P.L. (1996): Numerical experiments with the LANCELOT package (Release A) for large-scale nonlinear optimization. Math. Program. 73, 73-110
7. COPS, Seehttp://www.mcs.anl.gov/-more/cops/
8. Crowder, H., Dembo, R.S., Mulvey, J.M. (1979): On reporting computational experiments with mathematical software. ACM Trans. Math. Softw. 5, 193-203
9. Dolan, E.D., More, J. J. (2000): Benchmarking optimization software with COPS. Technical Memorandum ANL/MCS-TM-246, Argonne National Laboratory, Argonne, Illinois
10. Fourer, R., Gay, D.M., Kernighan, B.W. (1993): AMPL: A Modeling Language for Mathematical Programming. The Scientific Press
11. Gill, P.E., Murray, W., Saunders, M.A. (1997): SNOPT: An algorithm for large-scale constrained optimization. Report NA97-2, University of California, San Diego
12. Higham, N.J. (1996): Accuracy and Stability of Numerical Algorithms. SIAM, Philadelphia, Pennsylvania
13. Jackson, R.H.F., Boggs, P.T., Nash, S.G., Powell, S. (1991): Guidelines for reporting results of computational experiments. Report of the ad hoc committee. Math. Program. 49, 413-126
14. Mittelmann, H.: Benchmarks for optimization software. See http://plato.la.asu.edu/bench.html
15. Mittelmann, H. (1999): Benchmarking interior point LP/QP solvers. Optim. Methods Softw. 12, 655-670
16. Murtagh, B.A., Saunders, M.A. (1995): MINOS 5.4 user's guide. Report SOL 83-20R, Stanford University
17. Nash, S.G., Nocedal, J. (1991): A numerical study of the limited memory BFGS method and the truncated Newton method for large scale optimization. SIAM J. Optim. 1, 358-372
18. Vanderbei, R.J. (1999): LOQO user's manual - Version 3.10. Opt. Meth. Software 12,485-514
19. Vanderbei, R.J., Shanno, D.F. (1999): An interior-point algorithm for nonconvex nonlinear programming. Comput. Optim. Appl. 13, 231-252