Designs for Large-Scale Simulation Experiments, with Applications to Defense and Homeland Security

Design and Analysis of Experiments

Volumn 3, Issue , 2012, Pages 413-441

  Sanchez, Susan M ^a   Lucas, Thomas W ^a   Sanchez, Paul J ^a   Nannini, Christopher J ^a   Wan, Hong ^b  

^a NAVAL POSTGRADUATE SCHOOL   (United States)

^b SCHOOL OF INDUSTRIAL ENGINEERING   (United States)

Author keywords

ASC U simulation tool, modeling different scenarios with UAVs; Designs for large scale simulation, in defense, homeland security; Paradigm shift, constructive simulations and variance optimality

Indexed keywords

NETWORK SECURITY; SECURITY SYSTEMS;

LARGE SCALE SIMULATIONS; OPTIMALITY;

NATIONAL SECURITY;

EID: 84874718104     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781118147634.ch12     Document Type: Chapter

References (45)

1. Ahner, D.K., A.H. Buss, and J. Ruck (2006). Assignment scheduling capability for unmanned aerial vehicles—A discrete event simulation with optimization in the loop approach to solving a scheduling problem. In: Proceedings of the 2006 Winter Simulation Conference, L.F. Perrone, F.P. Wieland, J. Liu, B.G. Lawson, D.M. Nicol, and R.M. Fujimoto (eds.). Piscataway, NJ: Institute of Electrical and Electronics Engineers, Inc., pp. 1349-1356.
2. Bauman, M.F. (2007). Speech, Naval Postgraduate School, March 1.
3. Box, G.E.P., W.G. Hunter, and J.S. Hunter (2005). Statistics for Experimenters: An Introduction to Design, Data Analysis and Model Building (2nd ed.). New York: Wiley.
4. Cioppa, T.M. and T.W. Lucas (2007). Efficient nearly orthogonal and space-filling Latin hypercubes. Technometrics, 49(1), 45-55.
5. Defense Industry Daily (2005). Four FCS UAV sub-contracts awarded (updated). Available via [accessed August 15, 2010].
6. Fedorov, V.V. (1972). Theory of Optimal Experiments. New York: Academic Press.
7. Feickert, A., and N. J. Lucas (2009). Army future combat system (FCS) "spin-outs" and ground combat vehicle (GCV): Background and issues for Congress (RL32888). Available via [accessed August 15, 2010].
8. Goldsman, D., S.-H. Kim, and B.L. Nelson (2005). Statistical selection of the best system. In: Proceedings of the 2005 Winter Simulation Conference, M.E. Kuhl, N.M. Steiger, F.B. Armstrong, and J.A. Joines (eds.). Piscataway, NJ: Institute of Electrical and Electronic Engineers, Inc., pp. 178-187.
9. Hammersley, J.M. and D.C. Handscomb (1964). Monte Carlo Methods. London & New York: Chapman and Hall.
10. Hedayat, A.S., J. Sloane, and J. Stufken (1999). Orthogonal Arrays: Theory and Applications. New York: Springer-Verlag.
11. Hernandez, A.S., Lucas, T.W., and M. Carlyle (2011). Enabling nearly orthogonal Latin hypercube construction for any non-saturated run-variable combination. Working paper, Operations Research Department, Naval Postgraduate School, Monterey, CA.
12. Hinkelmann, K. and O. Kempthorne (2008). Design and Analysis ofExperiments, Vol. 1: Introduction to Experimental Design (2nd ed.). vol. 1. Hoboken, NJ: John Wiley & Sons.
13. Hoeber, F.P.(1981). Military Applications of Modeling: Selected Case Studies. Alexandria, VA: Military Operations Research Society.
14. JMP, Version 8 (1989-2009). SAS Institute Inc., Cary, NC.
15. Kleijnen, J.P.C. (2007). Design and Analysis of Simulation Experiments. New York: Springer.
16. Kleijnen, J.P.C., S.M. Sanchez, T.W. Lucas, and T.M. Cioppa (2005). A user's guide to the brave new world of designing simulation experiments. INFORMS Journal on Computing, 17(3), 263-289.
17. Law, A.M. (2007). Simulation Modeling and Analysis (4th ed.). New York: McGraw-Hill.
18. Lucas, T.W., S.M. Sanchez, F. Martinez, L.R. Sickinger, and J.W. Roginski (2007). Defense and homeland security applications of multi-agent simulations. In: Proceedings of the 2007 Winter Simulation Conference, S.G. Henderson, B. Biller, M.-H. Hsieh, J. Shortle, J.D. Tew, and R.R. Barton (eds.). Piscataway, NJ: Institute of Electrical and Electronic Engineers, Inc., pp. 138-149.
19. Markoff, J. (2008). Military supercomputer sets record. New York Times. Available via [accessed August 14, 2010].
20. Mitroff, I.I. and T.R. Featheringham (1974). On systemic problem solving and the error of the third kind. Behavioral Science, 19(6), 383-393.
21. Montgomery, D. (2005). Design and Analysis of Experiments (6th ed.). Hoboken, NJ: Wiley.
22. Nannini, C.J. (2006). Analysis of the Assignment Scheduling Capability for UAVs (ASC-U) simulation tool. Master's thesis, Naval Postgraduate School, Monterey, CA,.
23. NIST/Sematech (2006). e-Handbook of Statistical Methods. Available via < http:// www.itl.nist.gov/div898/handbook> [accessed August 8, 2010].
24. Office of the Secretary of Defense (2005). Unmanned aircraft system roadmap 20052030. Available via < http://www.fas.org/irp/program/collect/uavroadmap2005.pdf> [accessed Augyst 15, 2010].
25. Office of the Secretary of Defense (2009). Future Combat System (FCS) program transitions to Army Brigade Combat Team Modernization. Available via < http:// www.defense.gov/Releases/Release.aspx?ReleaseID=12763> [accessed August 15, 2010].
26. Osborn, K. (2009). FCS is dead; programs live on: U.S. Army to dissolve flagship acquisition effort. Defense News. Available via [accessed December 10, 2010].
27. Ramberg, J.S., S.M. Sanchez, P.J. Sanchez, and L.J. Hollick (1991). Designing simulation experiments: Taguchi methods and response surface metamodels. In: Proceedings of the 1991 Winter Simulation Conference, B.L. Nelson, W.D. Kelton, and G.M. Clark (eds.). Piscataway, NJ: Institute of Electrical and Electronics Engineers, Inc., pp. 167-176.
28. Ryan, T.P. (2007). Modern Experimental Design. Hoboken, NJ: Wiley.
29. Sacks, J., W.J. Welch, T.J. Mitchell, and H.P. Wynn (1989). Design and analysis of computer experiments (includes comments and rejoinder). Statistical Science, 4, 409-435.
30. Saeger, K. and J. Hinch (2001). Understanding instability in a complex deterministic combat simulation. Military Operations Research, 6(4), 43-55.
31. Sall, J., L. Creighton, and A. Lehman (2005). JMP Start Statistics: A Guide to Statistics and Data Analysis using JMP and JMP IN Software (3rd ed.). Belmont, CA: Brooks/Cole-Thomson Learning.
32. Sanchez, P.J. (2011). Efficient generation of resolution VII fractional factorial designs. Working paper.
33. Sanchez, S.M. (2000). Robust design: Seeking the best of all possible worlds. In: Proceedings of the 2000 Winter Simulation Conference Winter, J.A. Joines, R.R. Barton, K. Kang, and P.A. Fishwick (eds.). Piscataway, NJ: Institute of Electrical and Electronics Engineers, Inc., pp. 69-76.
34. Sanchez, S.M. and T.W. Lucas (2002). Exploring the world of agent-based simulation: Simple models, complex analyses. In: Proceedings of the 2002 Winter Simulation Conference, E. Yucësan, C. Chen, J.L. Snowdon, and J. Charnes (eds.). Piscataway, NJ: Institute of Electrical and Electronics Engineers, Inc., pp. 116-126.
35. Sanchez, S.M. and P.J. Sanchez (2005). Very large fractional factorial and central composite designs. ACM Transactions on Modeling and Computer Simulation, 15(4), 362-377.
36. Sanchez, S.M., H. Wan, and T. Lucas (2009). Two-phase screening procedure for simulation experiments. ACM Transactions on Modeling and Computer Simulation, 19(2), 1-24.
37. Santner, T.J., B.J. Williams, and W.I. Notz (2003). The Design and Analysis ofComputer Experiments. New York: Springer-Verlag.
38. Shen, H., H. Wan, and S.M. Sanchez (2009). A hybrid method for simulation factor screening. Naval Research Logistics, 57, 45-57.
39. Sinclair, E. J., Brigadier General. (2005). Presentation at the 2005 UAVS Symposium. Available via [accessed June 6, 2006].
40. Taguchi, G. (1987). System of Experimental Design, vol. 1 and 2. White Plains, NY: UNIPUB/Krauss International.
41. Tukey, J.W. (1986). The Collected Works ofJohn W. Tukey. In Philosophy and Principles of Data Analysis: 1965-1986, vol. IV. L.V. Jones (ed.) Monterey, CA: Wadsworth & Brooks/Cole, p. 773.
42. Vieira, H., S.M. Sanchez, K.H. Kienitz, and M.C.N. Belderrain (2011). Generating and improving orthogonal designs by using mixed integer programming. European Journal of Operation Research, 215, 629-638.
43. Wan, H., B. Ankenman, and B. Nelson (2006). Controlled sequential bifurcation: A new factor-screening method for discreteevent simulation. Operations Research, 54, 743-755.
44. Wan, H., B. Ankenman, and B.L. Nelson (2010). Improving the efficiency and efficacy of controlled sequential bifurcation for simulation factor screening. INFORMS Journal on Computing, 22 (3), 482-492.
45. Ye, K.Q. (1998). Orthogonal column Latin hypercubes and their application in computer experiments. Journal of the American Statistical Association, 93, 1430-1439.