Better than a petaflop: The power of efficient experimental design

Proceedings - Winter Simulation Conference

Volumn , Issue , 2009, Pages 60-74

  Sanchez, Susan M ^a   Wan, Hong ^b  

^a NAVAL POSTGRADUATE SCHOOL   (United States)

^b SCHOOL OF INDUSTRIAL ENGINEERING   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BASIC CONCEPTS; COMPUTATIONAL CAPABILITY; DESIGNED EXPERIMENTS; EFFICIENT EXPERIMENTAL DESIGNS; EXPERIMENTAL DESIGN; HIGH-PERFORMANCE COMPUTING; LOWER COST; SAMPLING FACTOR; SCIENCE AND ENGINEERING; SIMULATION MODEL; SIMULATION STUDIES; SINGLE COMPUTING; TRIAL-AND-ERROR APPROACH;

CLUSTER COMPUTING; STATISTICS;

DESIGN OF EXPERIMENTS;

EID: 77951541720     PISSN: 08917736     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WSC.2009.5429316     Document Type: Conference Paper

References (33)

1. Banks, J., J. S. Carson, B. L. Nelson, and D. M. Nicol. 2005. Discrete-event simulation, 4th ed. Upper Saddle River, New Jersey: Prentice-Hall.
2. Biles, W. E. 1975. A response surface method for experimental optimization of multi-response process. Industrial and Engineering Chemistry Process Design and Development, 14(2):152158.
3. Box, G. E. P., W. G. Hunter, and J. S. Hunter. 2005. Statistics for experimenters: An introduction to design, data analysis and model building. 2nd ed. New York: Wiley.
4. Box, G., and K. Wilson. 1951. On the experimental attainment of optimum conditions. Journal of Royal Statistical Society, 13:138.
5. Chang, K-H., J. L. Hong, and H. Wan. 2009. Stochastic trust region method (STRONG)a new response-surface-based algorithm in simulation optimization. School of Industrial Engineering, Purdue Unviersity. Working paper.
6. Chang, K-H., J. L. Hong, and H. Wan. 2007. Stochastic trust region gradient-free method (STRONG)-a new response-surface-based algorithm in simulation optimization. In Proceedings of the 2007 Winter Simulation Conference, ed. S. G. Henderson, B. Biller, M.-H. Hsieh, J. Shortle, J. D. Tew, and R. R. Barton, 346-354. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers.
7. Cioppa, T. M., and T. W. Lucas. 2007. Efficient nearly orthogonal and space-filling Latin hypercubes. Technometrics 49(1): 45-55.
8. Fu, M. 2002. Optimization for simulation: Theory vs. practice. INFORMS Journal on Computing, 14:192227.
9. Hernandez, A. S., W. M. Carlyle, and T. W. Lucas. 2008. Using integer programming to generate flexible nearly orthogonal Latin hypercubes. Working Paper, Operations Research Department, Naval Postgraduate School, Monterey, CA.
10. Horne, G. E., and T. E. Meyer. 2004. Data farming: Discovering surprise. In Proceedings of the 2004 Winter Simulation Conference, eds. R. G. Ingalls, M. D. Rossetti, J. S. Smith, and B. A. Peters, 171-180. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers.
11. Kelton, W. D., R. P. Sadowski, and D. P. Sturrock. 2007. Simulation with Arena. 4th ed. New York: McGraw-Hill.
12. Kleijnen, J. P. C. 2007. Design and analysis of simulation experiments. New York: Springer.
13. Kleijnen, J. P. C., S. M. Sanchez, T. W. Lucas, and T. M. Cioppa. 2005. A user's guide to the brave new world of simulation experiments. INFORMS Journal on Computing 17 (3): 263-289 (with online companion).
14. Kleijnen, J. P. C. 1975. Statistical Techniques in Simulation, part II. New York: Dekker.
15. Law, A. M. 2007. Simulation modeling and analysis. 4th ed. New York: McGraw-Hill.
16. Lucas, T. W., S. M. Sanchez, F. Martinez, L. R. Sickinger, and J. W. Roginski. 2007. Defense and homeland security applications of multi-agent simulations. In Proceedings of the 2007 Winter Simulation Conference, ed. S. G. Henderson, B. Biller, M.-H. Hsieh, J. Shortle, J. D. Tew, and R. R. Barton, 138-149. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers.
17. Markoff, J. 2008. Military supercomputer sets record. New York Times, June 9, 2008. Available via 〈http://www.nytimes.com/2008/06/09/technology/ 09petaflops.html〉 [accessed July 12, 2008].
18. Montgomery, D. C. 2005. Design and analysis of experiments. 6th ed. New York: Wiley.
19. Myers, R. and D. Montgomery. 2002. Response Surface Methodology. New York: Wiley.
20. NIST/Sematech. 2006. e-Handbook of statistical methods. Available via 〈http://www.itl.nist.gov/div898/handbook/〉 [accessed July 12, 2008].
21. Ryan, T. P. 2007. Modern experimental design. Hoboken, New Jersey: Wiley.
22. Sanchez, S. M. 2000. Robust design: Seeking the best of all possible worlds. In Proceedings of the 2000 Winter Simulation Conference, eds. J. A. Joines, R. R. Barton, K. Kang, and P. A. Fishwick, 69-76. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers.
23. Sanchez, S. M. 2008a. Better than a petaflop: The power of efficient experimental design. In Proceedings of the 2008 Winter Simulation Conference, ed. S. J. Mason, R. R. Hill, L. Moench, O. Rose, 73-84. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers.
24. Sanchez, S. M. 2008b. Simulation experiments and efficient designs in support of testing in a joint environment. Appendix to Joint Mission Effectiveness Analysis Handbook (draft version 2.1), 42 pages. Suffolk, Virginia: Joint Test & Evaluation Methodology (JTEM) Joint Test & Evaluation (JT&E).
25. Sanchez, S. M., and T. W. Lucas. 2002. Exploring the world of agent-based simulations: Simple models, complex analyses. In Proceedings of the 2002 Winter Simulation Conference, eds. E. Yücesan, C.-H. Chen, J. L. Snowdon, and J. Charnes, 116-126. Piscataway, New Jersey: Institute of Electrical and Electronics Engineers.
26. Sanchez, S. M., and P. J. Sanchez. 2005. Very large fractional factorials and central composite designs. ACM Transactions on Modeling and Computer Simulation 15(4): 362-377.
27. Sanchez, S. M., H. Wan, and T. W. Lucas. 2009. Two-phase screening procedures for simulation experiments. ACM Transactions on Modeling and Computer Simulation 19(2): Article 7. 1-24.
28. Santner, T. J., B. J.Williams, W. I. Notz. 2003. The design and analysis of computer experiments. New York: Springer-Verlag.
29. SEED Center for Data Farming. 2008. Simulation experiments & efficient designs [online]. Available via 〈http://harvest.nps.edu〉 [accessed July 12, 2008].
30. Taguchi, G. 1987. System of experimental design, vols. 1 and 2. White Plains, New York: UNIPUB/Krauss International.
31. Wan, H., B. E. Ankenman, and B. L. Nelson. 2006. Controlled sequential bifurcation: A new factor-screening method for discrete-event simulation. Operations Research 54(4): 743-755. (Pubitemid 44521584)
32. Wan, H., B. E. Ankenman, and B. L. Nelson. 2008. Improving the efficiency and efficacy of CSB for simulation factor screening. INFORMS Journal on Computing, forthcoming.
33. Wan, H., H. Shen, and S. M. Sanchez. 2008. A hybrid method for simulation factor screening. Working paper, School of Industrial Engineering, Purdue University, West Lafayette, Indiana.