On the complex quantification of risk: Systems-based perspective on terrorism

Risk Analysis

Volumn 31, Issue 8, 2011, Pages 1175-1186

  Haimes, Yacov Y ^a  

^a University of Virginia   (United States)

Author keywords

Resilience; Risk; State variables; Vulnerability

Indexed keywords

ASSESSMENT PROCESS; INITIATING EVENTS; INTELLIGENCE GATHERING; MANAGEMENT POLICY; MODELING PROCESS; MULTIDIMENSIONAL FUNCTION; QUALITATIVE INFORMATION; QUANTITATIVE METRICS; RESILIENCE; RISK FUNCTION; STATE VARIABLES; TERRORIST NETWORKS; TIME FRAME; VULNERABILITY; VULNERABLE SYSTEMS;

PROBABILITY; RISK MANAGEMENT; TERRORISM;

RISK ASSESSMENT;

PROBABILITY; QUANTITATIVE ANALYSIS; RISK ASSESSMENT; TERRORISM; VULNERABILITY;

EID: 80051668321     PISSN: 02724332     EISSN: 15396924     Source Type: Journal    
DOI: 10.1111/j.1539-6924.2011.01603.x     Document Type: Article

References (72)

1. Haimes YY. On the definition of vulnerabilities in measuring risks to infrastructures. Risk Analysis, 2006; 26:293-296.
2. Haimes YY. On the definition of resilience in systems. Risk Analysis, 2009; 29:498-501.
3. Haimes YY. On the complex definition of risk: A systems-based approach. Risk Analysis, 2009; 29:1647-1654.
4. Lowrance W. Of Acceptable Risk. Los Altos, CA William Kaufmann, 1976.
5. Bellman R. Adaptive Control Processes: A Guide Tour. Princeton, NJ Princeton University Press, 1961.
6. Nise N. Control Systems Engineering, Fifth Edition. Hoboken, NJ John Wiley, 2008.
7. Friedland B. Control System Design: An Introduction to State-Space Methods. New York McGraw-Hill, 1986.
8. Hinrichen D, Pritchard A. Mathematical Systems Theory I: Modeling, State Space Analysis, Stability and Robustness. Berlin, Germany Springer-Verlag, 2005.
9. Khalil H. Nonlinear Systems, Second Edition, Upper Saddle River, NJ Prentice Hall, 1996.
10. Cox LA. Some limitations of "risk = threat x vulnerability x consequence" for risk analysis of terrorist attacks. Risk Analysis, 2008; 28:1749-1761.
11. Dillon R. Risk-based decision making for terrorism applications. Risk Analysis, 2009; 29:342-342.
12. United States Government Accountability Office (GAO), Homeland Security. DHS Risk-Based Methodology is Reasonable, but Current Version's Measure of Vulnerability is Limited. GAO-08-852 Washington, DC, 2008. Available at:. Accessed on May 27, 2009.
13. National Research Council of the National Academies, Department of Homeland Security. Bioterrorism Risk Assessment. Washington, DC National Academies Press, 2008. Available at:, Accessed February 25, 2011.
14. National Research Council of the National Academies. Science and Decisions: Advancing Risk Assessment.: Washington, DC National Academies Press, 2009. Available at:, Accessed February 25, 2011.
15. Cox LA. Improving risk-based decision making for terrorism applications. Risk Analysis, 2009; 29:336-341.
16. McGill W, Ayyub B, Kaminskiy M. Risk analysis for critical asset protection. Risk Analysis, 2007; 27:1265-1281.
17. Holling C. Resilience and stability of ecological systems. Annual Review of Ecology and Systematics, 1973; 4:1-23.
18. Hollnagel E, Woods D, Leveson N (eds). Resilience Engineering: Concepts and Precepts. Aldershot, UK Ashgate, 2006.
19. Haimes Y, Matalas N, Lambert H, Jackson B, Fellows J. Reducing the vulnerability of water supply systems to attack. Journal of Infrastructural Systems, 1998; 4:164-177.
20. Haimes Y, Crowther K, Horowitz B. Homeland security preparedness: Balancing protection with resilience in emergent systems. Systems Engineering, 2008; 11:287-308.
21. Woods D. Creating foresight: Lessons for resilience from Columbia. Pp. 289-308 in Farjoun M, Starbuck W (eds). Organization at the Limit: NASA and the Columbia Disaster. Hoboken, NJ Blackwell, 2005.
22. Woods D. Essential characteristics of resilience. Pp. 21-34 in Hollnagel E, Woods D, Leveson N (eds). Resilience Engineering: Concepts and Precepts. Aldershot, UK Ashgate Press, 2006.
23. RAMCAP 2006. Available at:, Accessed on March 12, 2010.
24. Fischhoff B, Bostrom A, Marilyn J. Risk perception and communication. Annual Review of Public Health, 1993; 14:183-203.
25. Fischhoff B, Lichtenstein S, Slovic P, Derby S, Keeney R. Acceptable Risk. Cambridge, MA Cambridge University Press, 1983.
26. Fischhoff B, Lichtenstein S, Slovic P, Keeney R, Derby S. Approaches to Acceptable Risk: A Critical Guide. Eugene, OR Oak Ridge National Laboratory, Sub-7656, 1980.
27. Kunreuther H, Slovic P (eds). Challenges in Risk Assessment and Risk Management. Special Issue of the Annals of the American Academy of Political and Social Science. Thousand Oaks, CA Sage, 1996.
28. Slovic P. Terrorism as hazard: A new species of trouble. Risk Analysis, 2002; 22:425-426.
29. Slovic P, Fischhoff B, Lichtenstein S. Why study risk perception? Risk Analysis, 1982; 2:83-93.
30. Slovic P. The Perception of Risk. Sterling, VA Earthscan Publications, 2000.
31. Arquilla J, Ronfeldt D. Networks and Netwars. Pittsburgh, PA National Defense Research Institute, RAND, 2001.
32. Gnedenko B. The Theory of Probability. Translated from the Russian by Seckler, B. New York Chelsea Publishing Company, 1963.
33. Kaplan S. The words of risk analysis. Risk Analysis, 2006; 17:407-417.
34. Mosleh A, Bier V, Apostolakis G. A critique of current practice for the use of expert opinions in probabilistic risk assessment. Reliability Engineering & System Safety, 1988; 20: 63-85.
35. Haimes Y, Horowitz B Lambert J, Santos J, Crowther K, Lian C. Inoperability input-output model (IIM) for interdependent infrastructure iectors: Case study. Journal of Infrastructure System, 2005; 11:80-92.
36. Haimes Y, Horowitz B, Lambert J, Santos J, Lian C, Crowther K. Inoperability input-output model (IIM) for interdependent infrastructure sectors: Theory and methodology. Journal of Infrastructure System, 2005; 11:67-79.
37. Kaplan S, Garrick B. On the quantitative definition of risk. Risk Analysis, 1981; 1:11-27.
38. Haimes Y. Total risk management. Risk Analysis, 1991; 11:169-171.
39. Haimes Y. Risk Modeling, Assessment, and Management, Third Edition. New York Wiley, 2009.
40. Paté-Cornell E. Uncertainties in risk analysis: Six levels of treatment. Reliability Engineering System Safety, 1996; 54:95-111.
41. Pate-Cornell M. Organizational aspects of engineering system safety: The case of offshore platforms. Science, 1990; 250:1210-1217.
42. Apostolakis G. The Distinction Between Aleatory and Epistemic Uncertainties is Important: An Example from the Inclusion of Aging Effects into Probabilistic Safety Assessment. Washington, DC American Nuclear Society, Proceedings of PSA'99, August 22-25, 1999.
43. Asbeck E, Haimes Y. The partitioned multiobjective risk method (PMRM). Large Scale Systems in Information and Decision Technologies, 1984; 6:13-38.
44. Perrow C. Normal Accidents: Living with High-Risk Technologies. Princeton, NJ Princeton University Press.
45. Taleb N. The Black Swan: The Impact of the Highly Improbable. New York Random House, 2007.
46. Phimister J, Bier V, Kunreuther H. (eds.) Accident Precursors Analysis and Management: Reducing Technological Risk Through Diligence. National Academy of Engineering, Washington, DC National Academies Press, 2004.
47. Bier V, Ferson S, Haimes Y, Lambert, J, Small, M. Risk of extreme and rare events: Lessons from a selection of approaches, risk analysis and society. In McDaniels T, Small M (eds). Cambridge, MA Cambridge, 2004.
48. Ezell B, Haimes Y, Lambert J. Risk of cyber attack to water utility supervisory control and data acquisition systems. Military Operations Research, 2001; 6:23-33.
49. Haimes Y. Hierarchical holographic modeling. IEEE Transactions on Systems Man and Cybernetics Part A-Systems and Humans, 1981; 11:606-617.
50. Bier V, Oliveros S, Samuelson L. Choosing what to protect: Strategic defensive allocation against an unknown attacker. Journal of Public Economic Theory, 2007; 9:563-587.
51. Whittaker G. Asymmetric Wargaming: Toward a Game Theoretic Perspective. Washington, DC MITRE Corp, 2000. Available at:, Accessed on March 12, 2010.
52. Singer M, Long R, Stahl J, Kusumoto L, Goldberg S. Formative Evaluation of a Massively Multi-Player Persistent (MMP) Environment for Asymmetric Warfare Exercises. Arlington, VA: U.S. Army Research Institute for the Behavioral and Social Sciences. Technical Report number 1227. April 2008.
53. Ross R. PRA vs. Game Theory vs. (fill in the blank) in Terrorism Threat Assessment. Society for Risk Analysis Annual Meeting, December 6-8, 2009, Baltimore, MD.
54. Bier V. Choosing what to protect. Risk Analysis, 2007; 27:607-620.
55. Von Neumann J, Morgenstern O. Theory of Games and Economic Behavior, Princeton, NJ Princeton University Press, 1980.
56. Zhuang J, Bier V. Balancing terrorism and natural disasters-Defensive strategy with endogenous attacker effort. Operations Research, 2007;55:976-991.
57. Cox LA. What's wrong with risk matrices? Risk Analysis, 2008;28:497-512.
58. Cox LA. What's wrong with hazard-ranking systems? An expository note, perspective. Risk Analysis, 2009;29:940-948.
59. Duderstadt J, Wulf W, Zemsky R. Envisioning a transformed university. Issues in Science Technology, 2005; 22:35-41.
60. Shafer G. Perspectives on the theory and practice of belief functions. International Journal of Approximate Reasoning, 1990; 3:1-40.
61. Kaplan S, Haimes Y, Garrick B. Fitting hierarchical holographic modeling into the theory of scenario structuring and a resulting refinement of the quantitative definition of risk. Risk Analysis, 2001; 21:807-815.
62. Dombroski M, Haimes YY, Lambert JH, Schlussel K, Sulcoski M. Risk-based methodology for support of operations other than war. Military Operations Research, 2002; 7:19-38.
63. Reiss R, Griffin J. A probabilistic model for acute bystander exposure and risk assessment for soil fumigants. Atmospheric Environment, 2006; 40:3548-3560.
64. Hertwich E, McKone T, Pease W. A systematic uncertainty analysis of an evaluative fate and exposure model. Risk Analysis, 2000; 20:439-454.
65. Lee L, Mao C, Thompson K. Demographic factors and their association with outcomes in pediatric submersion injury. Academic Emergency Medicine, 2006; 13:308-313.
66. Thompson K, Duinter TR, Pallansch M. Evaluation of response scenarios to potential polio outbreaks using mathematical models. Risk Analysis, 2006; 26:1541-1556.
67. Nauta MJ, Jacobs-Reitsma W, Havelaar A. A risk assessment model for campylobacter in broiler meat. Risk Analysis, 2007; 27:845-861.
68. Haimes Y. Phantom system models for emergent multiscale systems. Journal of Infrastructural Systems, 2007; 13:81-87.
69. Hall III A. Metasystems Methodology: A New Synthesis and Unification. Elmsford, NY Pergamon Press, 1989.
70. Haimes YY. Phantom system models and the art and science of modeling systems of systems. Submitted for publication in Systems Engineering February 16, 2011.
71. Luenberger D, Introduction to Dynamic Systems: Theory, Models, & Applications. Hoboken, NJ John Wiley & Sons, 1979.
72. Chen C-T. Linear System Theory and Design, Third Edition. NY Oxford University Press, 1999.