A server for automated performance analysis of benchmarking data

Optimization Methods and Software

Volumn 21, Issue 1, 2006, Pages 105-120

  Mittelmann, Hans D ^a   Pruessner, Armin ^b  

^a ARIZONA STATE UNIVERSITY   (United States)

^b GAMS Development Corporation   (United States)

Author keywords

Performance data analysis; Performance metrics; Web based service

Indexed keywords

BENCHMARKING; DATA HANDLING; DATA REDUCTION; NONLINEAR PROGRAMMING; OPTIMIZATION; PROBLEM SOLVING; ROBUSTNESS (CONTROL SYSTEMS);

COPS TEST CASE; PERFORMANCE DATA ANALYSIS; PERFORMANCE METRICS; WEB-BASED SERVICE;

SERVERS;

EID: 29644447718     PISSN: 10556788     EISSN: 10294937     Source Type: Journal    
DOI: 10.1080/10556780500065366     Document Type: Article

References (36)

1. Benson, H.Y., Shanno, D.F. and Vanderbei, R.J., 2000, Interior-point methods for nonconvex nonlinear programming: jamming and comparative numerical testing. Technical report no. ORFE-00-02, Princeton University, Princeton, New Jersey.
2. Billups, S.C., Dirkse, S.P. and Ferris, M.C., 1997, A comparison of large-scale mixed complementarity problem solvers. Computational Optimization and Applications, 7, 3-25.
3. Bixby, R.E., 2002, Solving real-world linear programs: a decade and more of progress. Operations Research, 50th Anniversary Issue, 50(1), 3-15.
4. Bixby, R.E., Ceria, S., McZeal, C.M. and Savelsbergh, M.W.P., 1998, An updated mixed integer programming library: MIPLIB 3.0. Optima, 58, 12-15.
5. Bongartz, I., Conn, A.R., Gould, N.I.M., Saunders, M.A. and Toint, Ph.L., 1997, A numerical comparison between the LANCELOT and MINOS packages for large-scale constrained optimization. Report 97/13, Namur University.
6. Brooke, A., Kendrick, D. and Meeraus, A., 1988, GAMS: A User's Guide (San Francisco, CA: The Scientific Press).
7. Bussieck, M.R., Drud, A.S. and Meeraus, A., 2002, MINLPLib - a collection of test models for mixed-integer nonlinear programming. INFORMS Journal on Computing, 15(1), 114-119.
8. Bussieck, M.R., Drud, A.S., Meeraus, A. and Pruessner, A., 2003, Quality assurance and global optimization, In: Neumaier and Arnold (Eds), First International Workshop on Global Constrained Optimization and Constraint Satisfaction COCOS 2002, Bliek, Christian; Jermann, Christophe; Valbonne-Sophia Antipolis, France, 2-4 October, Revised Selected Papers, Lecture Notes in Computer Science, LNCS 2861, Springer Verlag.
9. COPS. Available online at: www http://www-unix.mcs.anl.gov/~more/cops (accessed 2004).
10. Crowder, H., Dembo, R.S. and Mulevy, J.M., 1979, On reporting computational experiments with mathematical software. ACM Transactions of Mathematical Software, 5(2), 193-203.
11. Czyzyk, J., Mesnier, M. and Moré, J.J., 1998, The NEOS server. IEEE Journal of Computational Science and Engineering, 5, 68-75.
12. Dolan, E.D., Moré, J.J. and Munson, T.S., 2004, Optimality measures for performance profiles. Preprint ANL/MCS-P1155-504.
13. Dolan, E.D. and Moré, J.J., 2002, Benchmarking optimization software with performance profiles. Mathematical Programming, 91(2), 201-213.
14. Dolan, E.D., Moré, J.J. and Munson, T.S., 2002, Measures of optimality for constrained optimization. Available online at: www http://www-neos.mcs.anl.gov/neos/ftp/optimality.pdf (accessed 2004).
15. Dolan, E.D., 2001, The NEOS server 4.0 administrative guide. Technical Memorandum ANL/MCS-TM-250, Mathematics and Computer Science Division, Argonne National Laboratory.
16. Dolan, E.D. and Moré, J.J., 2000, Benchmarking optimization software with COPS. Technical Memorandum ANL/MCS-TM-246, Argonne National Laboratory, Argonne, Illinois.
17. Drud, A., 2002, Testing and tuning a new solver version using performance tests, Informs 2002, San Jose, session on 'Benchmarking and performance testing of optimization software'. Available online at: www http://www.gams.com/ presentations/present_performance.pdf (accessed 2004).
18. Drud, A.S., 1996, CONOPT: a System for Large Scale Nonlinear Optimization, Reference Manual for CONOPT Subroutine Library, ARK1 Consulting and Development A/S, Bagsvaerd, Denmark.
19. Fourer, R., Gay, D.M. and Kernighan, B.W., 2003, AMPL: A Modeling Language for Mathematical Programming (Pacific Grove, CA: Duxbury Press, Brooks/Cole Thomson Publishing Company).
20. GAMS, 2003, GAMS: The Solver Manuals (Washington, DC: GAMS Development Corporation).
21. Gill, P.E., Murray, W. and Saunders, M. A., 2002, SNOPT: an algorithm for large-scale constrained optimization. SIAM Journal of Optimization, 12, 979-1006.
22. GLOBALlib. Available online at: www http://www.gamsworld.org/global/ globallib.htm (accessed 2004).
23. Gropp, W. and Moré, J.J., 1997, Optimization environments and the NEOS server. In: M.D. Buhmann and A. Iserles (Eds) Approzimation Theory and Optimization (Cambridge: Cambridge University Press), pp. 167-182.
24. IPOPT: an interior point algorithm for large-scale nonlinear optimization. Available online at: www http://www-124.ibm.com/developerworks/ opensource/coin/Ipopt (accessed 2004).
25. Mittelmann, H.D. and Spellucci, P., 2003, Decision tree for optimization software. Available online at: www http://plato.la.asu.edu/guide.html (accessed 2004).
26. Mittelmann, H.D., 2003, An independent benchmarking of SDP and SOCP solvers. Mathematical Programming Series B, 95, 407-430.
27. Mittelmann, H.D. 1999, Benchmarking interior point LP/QP solvers. Optimization Methods and Software, 12, 655-670.
28. Nash, S.G. and Nocedal, J., 1991, A numerical study of the limited memory BFGS method and the truncated Newton method for large scale optimization. SIAM Journal of Optimization, 1, 358-372.
29. NEOS, 1997, Available online at: www http://www-neos.mcs.anl.gov (accessed 2004).
30. Neumaier, A., 2000, Available online at: www http://www.mat.univie.ac.at/ ~neum/glopt.html (accessed 2004).
31. Performance World, 2004, Available online at: www http://www.gamsworld. org/performance (accessed 2004).
32. Pintér, J.D., 2002, LGO - A Model Development System for Continuous Global Optimization. User's Guide (Current revised edition) (Halifax, NS: Pintér Consulting Services).
33. Pruessner, A., 2002, Automated performance testing and analysis, Informs 2002, San Jose, session on 'Benchmarking and performance testing of optimization software'. Available online at: www http://www.gams.com/presentations/ present_automation.pdf (accessed 2004).
34. Tawarmalani, M. and Sahinidis, N.V., 2002, Convexification and Global Optimization in Continuous and Mixed-Integer Nonlinear Programming: Theory, Algorithms, Software, and Applications (Dordrecht: Kluwer Academic Publishers).
35. Ugray, Z., Lasdon, L., Plummer, J., Glover, F., Kelly, J. and Marti, R., 2002, A multistart scatter search heuristic for smooth NLP and MINLP problems. INFORMS Journal on Computing, in press.
36. Waltz, R.A. and Nocedal, J., 2002, KNITRO 2.0 user's manual. Available online at: www http://www.ziena.com/knitro/manual.htm (accessed 2004).