Structuring and analyzing competing hypotheses with Bayesian networks for intelligence analysis

EURO Journal on Decision Processes

Volumn 1, Issue 3-4, 2013, Pages 205-231

  Karvetski, Christopher W ^a   Olson, Kenneth C ^a   Gantz, Donald T ^a   Cross, Glenn A ^b  

^a Krasnow Institute for Advanced Study   (United States)

^b FEDERAL BUREAU OF INVESTIGATION   (United States)

Author keywords

Bayesian network; Competing hypotheses; Facilitated modeling; Intelligence analysis; Rajneeshee bioterror attack

Indexed keywords

EID: 84890892808     PISSN: 21939438     EISSN: 21939446     Source Type: Journal    
DOI: 10.1007/s40070-013-0001-x     Document Type: Article

References (62)

1. Aven T (2010) On the need for restricting the probabilistic analysis in risk assessment to variability. Risk Anal 30(3):354–360
2. Burgman MA, McBride M, Ashton R, Speirs-Bridge A, Flander L, Wintle B, Fidler F, Rumpff L, Twardy C (2011) Expert status and performance. PLoS ONE 6(7):1–7
3. Carus, W.S. 2000. The Rajneeshees. In (eds.) J.B. Tucker. Toxic Terror. MIT Press. Cambridge, MA
4. Caswell DJ, Pate-Cornell ME (2011) Probabilistic analysis of a country’s program to acquire nuclear weapons. Mil Oper Res 16(1):5–20
5. Caswell DJ, Howard RA, Pate-Cornell ME (2011) Analysis of national strategies to counter a country’s nuclear weapons program. Decis Anal 8(1):30–45
6. Clemen RT, Winkler RL (1993) Aggregating point estimates: a flexible modeling approach. Manage Sci 39(4):501–515
7. Clemen RT, Winkler RL (1999) Combining probability distributions from experts in risk analysis. Risk Anal 19(2):187–203
8. Clemen RT, Fischer GW, Winkler RL (2000) Assessing dependence: some experimental results. Manage Sci 46:1100–1115
9. Conklin J (2006) Dialogue mapping: building shared understanding of wicked problems. Wiley, West Sussex
10. De Finetti B (1990) Theory of probability. A critical introductory treatment. Wiley, New York
11. Deisler PF (2002) A perspective: risk analysis as a tool for reducing the risks of terrorism. Risk Anal 22(3):405–413
12. Duncan KA, Wilson JL (2008) A multinomial-Dirichlet model for analysis of competing hypotheses. Risk Anal 28(6):1699–1709
13. Eden C, Radford J (1990) Tackling strategic problems: the role of group decision support. Sage, London
14. Eleye-Datubo AG, Wall A, Saajedi A, Wang J (2006) Enabling a powerful maritime and offshore decision-support solution through Bayesian network technique. Risk Anal 26(3):695–721
15. Franco LA, Montibeller G (2010) Facilitated modeling in operational research. Eur J Oper Res 205:489–500
16. Heckerman D (1990) Probabilistic similarity networks, Ph.D. thesis. Program in Medical Information Sciences, Stanford University, Stanford. Report STAN-CS-90-1316
17. Heuer RJ (1999) Psychology of intelligence analysis. United States Government Printing
18. Jensen FV (2001) Bayesian networks and decision graphs. Springer, New York 268p
19. Jo D, Gartzke E (2007) Determinants of nuclear weapons proliferation. J Conflict Resolut 51(1):167–195
20. Kaplan S (1997) The words of risk analysis. Risk Anal 17(4):407–417
21. Karvetski CW, Lambert JH (2012) Evaluating deep uncertainties in strategic priority-setting with an application to facility energy investments. Syst Eng 15(4):483–493
22. Keisler JM, Noonan PS (2012) Communicating analytic results: a tutorial for decision consultants. Decis Anal 9(3):274–292
23. Kent S (1964) Words of estimative probability. Stud Intell 8:49–65
24. Lehner PE, Adelman L, Cheikes BA, Brown MJ (2008) Confirmation bias in complex analyses. IEEE Trans Syst Man Cybern A Syst Hum 38(3):584–592
25. Lord CG, Ross L, Lepper MR (1979) Biased assimilation and attitude polarization: the effects of prior theories on subsequently considered evidence. J Perspect Soc Psychol 37:2098–2109
26. Lord CG, Lepper MR, Preston E (1984) Considering the opposite: a corrective strategy for social judgment. J Perspect Soc Psychol 47:1231–1243
27. Mandel DR (2005) Are risk assessments of a terrorist attack coherent? J Exp Psychol Appl 11(4):277–288
28. Marrin S (2007) Intelligence analysis: structured methods or intuition? Am Intell J 25:1–10
29. McLaughlin J, Pate-Cornell ME (2005) A Bayesian approach to Iraq’s nuclear program intelligence analysis: a hypothetical illustration. 2005 international conference on intelligence analysis. https://analysis.mitre.org/proceedings/Final_Papers_Files/85_Camera_Ready_Paper.pdf
30. Montibeller G (2007) Action-researching MCDA interventions. In: Shaw D (ed) Key-note papers, 49th British operational research conference. The OR Society
31. Nadkarni S, Shenoy PP (2001) A Bayesian network approach to making inferences in causal maps. Eur J Oper Res 128:479–498
32. Nadkarni S, Shenoy PP (2004) A causal mapping approach to constructing Bayesian networks. Decis Support Syst 38:259–281
33. Nemeth C, Brown K, Rogers J (2001) Devil’s advocate vs. authentic dissent: stimulating quantity and quality. Eur J Soc Psychol 31:707–720
34. Palo Alto Research Center (PARC) (2006) ACH: Version 2.0.3
35. Parnell GS, Smith CM, Moxley FI (2010) Intelligent adversary risk analysis: a bioterrorism risk management model. Risk Anal 30(1):32–48
36. Pate-Cornell ME (1996) Uncertainties in risk analysis: six levels of treatment. Reliab Eng Syst Saf 54:95–111
37. Pearl J (1988) Probabilistic reasoning in intelligent systems. Morgan Kaufmann, San Francisco
38. Pherson R, Schwarts A, Manak E (2008) Anticipating rare events: the role of ACH and other structured analytic techniques. In: Anticipating rare events: a scientific perspective on problems, pitfalls, and potential solutions. Office of the Secretary of Defense/DDR&E/RTTO, Washington, DC
39. Phillips LD (1984) A theory or requisite decision models. Acta Psychol 56:29–48
40. Phillips LD (2007) Decision conferencing. In: Edwards W, Miles RF, von Winterfeldt D (eds) Advances in decision analysis. Cambridge University Press, Cambridge
41. Pope S, Josang A (2005) Analysis of competing hypotheses using subjective logic. In: 10th CCRTS: the future of command and control, pp 1–30
42. Renooij S (2001) Probability elicitation for belief networks: issues to consider. Knowl Eng Rev 16(3):255–269
43. Renooij S, Witteman CLM (1999) Talking probabilities: communicating probabilistic information with words and numbers. Int J Approx Reason 22:169–194
44. Schilling MS, Oeser N, Schaub C (2007) How effective are decision analyses? Assessing decision process and group alignment effects. Decis Anal 4(4):227–242
45. Scholz RW, Hansmann R (2007) Combining experts’ risk judgments of technology performance of phytoremediation: self-confidence ratings, averaging procedures, and formative consensus building. Risk Anal 27(1):225–240
46. Schum DA (1987) Evidence and inference for the intelligence analyst, vol II. University Press of America, New York
47. Schummer J, Vohra RV (2007) Mechanism design without money. In: Nisam N, Roughgarden T, Tardos E, Vazirani VV(eds) Algorithmic game theory. Springer, New York, pp 317–332
48. Singh S, Way CR (2004) The correlates of nuclear proliferation. J Conflict Resolut 48(6):859–885
49. Staff (1984) Ill handlers suspected in Oregon food poisonings. The New York Times. http://www.nytimes.com/1984/10/21/us/ill-handlers-suspected-in-oregon-food-poisonings.html. Retrieved 15 Sep 2011
50. Stech FJ, Elasser C (2004) Midway revisited: deception by analysis of competing hypothesis. MITRE Corporation [online]. http://www.mitre.org/work/tech_papers/tech_papers_04/stech_deception/stech_deception.pdf
51. Sticha P, Buede D, Rees RL (2005) APOLLO: an analytical tool for predicting a subject’s decision making. Presented at the international conference on intelligence analysis methods and tools, McLean
52. Torok TJ, Tauxe RV, Wise RP, Livengood JR, Sokolow R, Mauvais S, Birkness KA, Skeels MR, Horan JM, Foster LR (1997) A large community outbreak of salmonellosis caused by intentional contamination of restaurant salad bars. J Am Med Assoc 278(5):389–395
53. United States Senate Select Committee on Intelligence (2004) Report on the U.S. Intelligence Community’s Prewar Intelligence Assessments on Iraq, One Hundred Eighth Congress, Second Session. U.S. Government Printing Office, Washington, DC
54. Valtorta M, Dang J, Goradia H, Huang J, Huhns M (2005) Extending Heuer’s analysis of competing hypotheses method to support complex decision analysis. International conference on intelligence analysis, Washington, DC
55. van Gelder T (2008) Can we do better than ACH? Australian Institute of Professional Intelligence Officers News, 55
56. Walshe T, Burgman M (2010) A framework for assessing and managing risks posed by emerging diseases. Risk Anal 30(2):236–249
57. Wang H, Druzdzel M (2000) User interface tools for navigation in conditional probability tables and elicitation of probabilities in Bayesian networks. In: Proceedings of the sixteenth conference on uncertainty in artificial intelligence. Morgan Kaufmann, San Francisco
58. Weaver J (1985) The town that was poisoned (PDF). Congressional Record 131(3–4). United States Government Printing Office, Washington, DC, 99th United States Congress, 1st session, pp 4185–4189. Transcription at WikiSource. http://commons.wikimedia.org/wiki/File:1985_Feb_28_Congressman_Weaver_THE_TOWN_THAT_WAS_POISONED.pdf. Retrieved 15 Sep 2011
59. Whitney CR (2005) The WMD mirage. Public Affairs, New York
60. Winkler RL, Clemen RT (2004) Multiple experts vs. multiple methods: combining correlation assessments. Decis Anal 1(3):167–176
61. Witteman C, Renooij S (2002) Evaluation of a verbal-numerical probability scale. Int J Approx Reason 33:117–131
62. Zlotnick J (1972) Bayes’ theorem for intelligence analysis. Stud Intell 16(2). https://www.cia.gov/library/center-for-the-study-of-intelligence/kent-csi/vol16no2/pdf/v16i2a03p.pdf