Results from Levels 2/3 fusion implementations: Issues, challenges, retrospectives and perspectives for the future an annotated perspective

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 6968, Issue , 2008, Pages

  Kadar, Ivan ^a   Bosse, Eloi ^b   Salerno, John ^c   Lambert, Dale A ^d   Das, Subrata ^e   Ruspini, Enrique H ^f   Rhodes, Bradley J ^g   Biermann, Joachim ^h  

^a Interlink Systems Sciences Inc   (United States)

^b DEFENCE RESEARCH AND DEVELOPMENT CANADA VALCARTIER   (Canada)

^c AIR FORCE RESEARCH LABORATORY   (United States)

^d DEFENCE SCIENCE AND TECHNOLOGY ORGANISATION   (Australia)

^e CHARLES RIVER ANALYTICS   (United States)

^f SRI INTERNATIONAL   (United States)

^g BAE SYSTEMS   (United States)

^h FRAUNHOFER FKIE   (Germany)

Author keywords

Information fusion; Situation and threat impact assessment

Indexed keywords

CONTROL AND OPTIMIZATION; EVOLUTION (CO); HISTORICAL PERSPECTIVE; HUMAN FACTORS; IN ORDER; INTERNATIONAL SOCIETY; ISSUES AND CHALLENGES; KNOWLEDGE REPRESENTATION AND REASONING; LEADING EXPERTS; LESSONS LEARNED (LL); OPTICAL (PET) (OPET); PANEL DISCUSSIONS; POSITION PAPERS; SENSOR FUSION (SF); TARGET RECOGNITION; THREAT ASSESSMENT;

AEROSPACE APPLICATIONS; ARTIFICIAL INTELLIGENCE; DATA FUSION; E-LEARNING; FUSION REACTIONS; HUMAN ENGINEERING; INFORMATION THEORY; KNOWLEDGE REPRESENTATION; LIGHT AMPLIFIERS; NUCLEAR PHYSICS; OPTICAL ENGINEERING; PAPER; PHOTOACOUSTIC EFFECT; SIGNAL PROCESSING; SIMULATED ANNEALING; TANTALUM; TECHNOLOGY;

SENSOR DATA FUSION;

EID: 44949119610     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.782740     Document Type: Conference Paper

References (97)

1. E. P. Blasch, I. Kadar, J. Salerno, M. M. Kokar, S. Das, G. M. Powell, D. D. Corkill, E. H. Ruspini, "Issues and Challenges in Situation Assessment (Level 2 Fusion)", Journal on Advances in Information Fusion (JAIF), Vol. 1, No. 2, December 2006.
2. D. L. Hall and J. Llinas, "Introduction to Multisensor Data Fusion", Proc. of IEEE, Vol. 85, No. 1, pp. 6 - 23, Jan 1997.
3. E. P. Blasch, I. Kadar, J. J. Salerno, M. Kokar, S. K. Das, D. Corkill, G. M. Powell, E. H. Ruspini, "Issues and Challenges in Knowledge Representation and Reasoning Methods in Situation Assessment (Level 2 Fusion)", Proceedings Signal Processing, Sensor Fusion and Target Recognition XV, Ivan Kadar Editor, Proc. SPIE Vol.6235, April 2006.
4. E. P. Blasch, I. Kadar, K. Hintz, J. Biermann, C. Y. Chong, J. Salerno and S. Das, "Issues and challenges in resource management and its interaction with levels 2/3 fusion with applications to real-world problems: An annotated perspective", Proceedings Signal Processing, Sensor Fusion and Target Recognition XVI, Ivan Kadar Editor, Proc. SPIE Vol.6567, April 2007.
5. th International Conference on Information Fusion, July 2007, Quebec City, Canada.
6. M. R. Endsley. "Design and evaluation for situation awareness enhancement," Proceedings of the Human Factors Society 32nd Annual Meeting (pp. 97-101), Santa Monica, CA-Human Factors and Ergonomics Society. 1988.
7. E. Waltz and J. Llinas. Multisensor and Data Fusion. Artech House, Boston, MA, 1990.
8. D. Kettani and J. Roy, "A Qualitative Spatial Model for Information Fusion and Situation Analysis," Proc. SPIE, 2000.
9. E. Blasch "Assembling an Information-fused Human-Computer Cognitive Decision Making Tool," IEEE Aerospace and Electronic Systems Magazine, pp. 11-17, June 2000.
10. [JDL] U.S. DOD, Data Fusion Subpanel of the Joint Directors of Laboratories, "Data fusion lexicon," 1991.
11. A. N. Steinberg, C. Bowman and F. E. White, "Revision to the JDL Data Fusion Model", 3rd NATO/IRIS Conf. Quebec, CA. 1998
12. J. Llinas, C. Bowman, G. Rogova., A. N. Steinberg, E. Waltz, F. White, "Revisiting the JDL Data Fusion Model II, Proc. of the 7th International Conference on Information Fusion, June 2004, Stockholm, Sweden
13. th International Conference on Information Fusion, June 2001, Montreal CA.
14. th International Conference on Information Fusion, 2003
15. D. Kettani and J. Roy, ibid [8]
16. C. Metheus, M. Kokar, K. Baclawski, J. A. Letkowski, C. Call, et al., "SAWA: an assistant for higher-level fusion and situation awareness, Proc. SPIE 2005
17. K. Lee and J. Llinas, "Hybrid Model for Intent Estimation, Proc. of the 6th International Conference on Information Fusion, June 2003
18. E. Waltz, "Data Fusion in Offensive and Defensive Information Operations", NSSDF Symposium, 2000.
19. th International Conference on Information Fusion, 10-13 July 2006, Florence, Italy.
20. I. Kadar and E. Baron-Vartian, "Process Modeling: A Situation Assessment Expert System", Proc. AIAA Computers in Aerospace Conf. Wakefield, MA, October 1987.
21. I. Kadar, "Data Fusion by Perceptual Reasoning and Prediction", Proceedings 1987 Tri-Service Data Fusion Symposium, Johns Hopkins University Applied Physics Laboratory, Laurel, MD, June 1987.
22. I. Kadar, "Perceptual Reasoning Managed Situation Assessment and Adaptive Fusion Processing", Proc. Signal; Processing, Sensor Fusion & Target Recognition X, Ivan Kadar Editor, Proc. SPIE Vol. 4380, April 2001.
23. I. Kadar, "Perceptual Reasoning in Adaptive Fusion Processing", Proceedings Signal; Processing, Sensor Fusion and Target Recognition XI, Ivan Kadar Editor, Proc. SPIE Vol. 4729, April 2002.
24. th International Conference on Information Fusion, July 2007, Quebec City, CA.
25. D. Koller and B. Milch, "Multi-Agent Influence Diagrams for Representing and Solving Games", Games and Economic Behavior, Vol. 45, No.1, 2003.
26. www.ghg.net/clips/CLIPS.html A Tool for Building Expert Systems
27. www.kr.org - The Principles of Knowledge Representation and Reasoning (KRR)
28. th International Conference on Information Fusion, July 25-29, 2005, Philadelphia, PA
29. A. N. Steinberg, C. L. Bowman and F. E. White, "Revisions to the JDL Data Fusion Model", Proc. SPIE Vol. 3719, 1999.
30. M. R. Endsley and D. J. Garland, Eds., Situation Awareness Analysis and Measurement. Mahwah, New Jersey: Lawrence Erlbaum Associates, Publishers, 2000.
31. É. Bossé, J. Roy, and S. Wark, Eds., Models and Tools for Information Fusion, Artech House, Boston, 2007.
32. P. Maupin and A.-L. Jousselme, "Interpreted systems for situation analysis," Proceedings of the 10th International Conference on Information Fusion, Quebec City, Canada, 9-12 July 2007.
33. G. Klir, Uncertainty and Information: Foundations of Generalized Information Theory, John Wiley, 2006
34. P. Maupin and A.-L. Jousselme "A general algebraic framework for situation analysis," Proceedings of the 8th International Conference on Information Fusion, Philadelphia, PA, USA, July 2005.
35. th International Conference on Information Fusion, Quebec City, Canada, 2007.
36. A. R. Benaskeur, F. Rhéaume, and P. Maupin, "Clustering-based control of discrimination power in target tracking applications," WSEAS Transactions on signal processing, vol. 2, no. 6, pp. 863-868, 2006.
37. J. Y. Halpern and Y. Moses, "Characterizing solution concepts in games using knowledge-based programs," Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI2007), 2007.
38. A. N. Steinberg and C. L. Bowman, "Revisions to the JDL data fusion model," in Handbook of Multisensor Data Fusion, The Electrical Engineering and Applied Signal Processing Series, D. L. Hall and J. Llinas, Eds., Boca Raton: CRC Press, 2001.
39. N. Friedman and J. Y. Halpern, "Plausibility measures: A user's guide", Proceedings of the Eleventh Conference on Uncertainty in AI, 1995, pp. 175-184.
40. M. R. Endsley, "Toward a Theory of Situation Awareness in Dynamic Systems", Human Factors Journal, Volume 37(1), pgs 32-64, March 1995.
41. B. McGuinness and J. L. Foy, "A subjective measure of SA: The Crew Awareness Rating Scale (CARS)", Proceedings of the first human performance, situation awareness, and automation conference, Savannah, Georgia, October 2000.
42. L. Snidaro, M. Belluz, G. Foresti, "Domain knowledge for security applications", ISIF'07.
43. E. Bosse, J. Roy, and S. Wark, Concepts, Models, and Tools for Information Fusion, Artech House, Inc., 2007.
44. th International Conference on International Fusion, Montreal, 2001.
45. M. R. Endsley and D. B. Kabar, "Level of Automation Effects on Performance, Situation Awareness and Workload in a dynamic Control Task", Ergonomics, Vol. 42, No. 3, pp. 462 - 492,1999.
46. J. Reason, Human Error, Cambridge University Press, 1990.
47. M. R. Garey and D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman and Co., New York, 1979.
48. H. Rogers, Theory of Recursive Functions and Effective Computability, McGraw-Hill Book Company, New York, 1967.
49. D. Perugini, Agents for Logistics: A Provisional Agreement Approach, Doctoral Dissertation, The University of Melbourne, Australia, 2006.
50. C. McCann (Ed.). The Human in Command: Exploring the Modern Military Experience, Kluwer Academic Publishers, 2000.
51. B. Dasarathy, "Sensor Fusion Potential Exploitation-Innovative Architectures and Illustrative Applications", IEEE Proceedings, Vol. 85, No.l, 1997.
52. M. Bedworth and J. O'Brien, "The Omnibus Model: A New Model of Data Fusion?", IEEE Aerospace and Electronic Systems Magazine, Volume 15, Issue 4,2000.
53. E. Blasch and S. Piano, "Level 5: User Refinement to aid the Fusion Process", Proc. SPIE 2003.
54. th International Conference on Information Fusion, Florence, Italy, 2006.
55. M. R. Endsley, "Toward a Theory of Situation Awareness in Dynamic Systems", Human Factors Vol. 37 No. 1 p. 32-64,1995.
56. D. A. Lambert, "Ubiquitous Command and Control", Proceedings of the IEEE 1999 Information, Decision and Control Conference, Adelaide, Australia, p. 35-40,1999.
57. th International Command and Control Research and Technology Symposium (ICCRTS), MacLean, VA, 2005.
58. th International Conference on Information Fusion, p. 86-93, Cairns, Australia, 2003.
59. th International Conference on Information Fusion,. Philadelphia, U.S.A. 2005.
60. th International Conference on Information Fusion, Cairns, Australia, p. 986 - 993, 2003.
61. th International Conference on Information Fusion, Cairns, Australia, p. 213 - 219,2003.[63] D.A. Norman, "Some observations on mental models." in Mental Models by D Gentner and A. L. Stevens (Editors), Lawrence Erlbaum Associates 1983.
62. D. A. Norman, "Some observations on mental models", In Mental Models by Gentner and A. L. Stevens (Eds.), Lawrence Erlbaum Associates, 1983.
63. th International Conf. on Information Fusion, Stockholm, Sweden, 2004.
64. th International Conf. on Information Fusion, Philadelphia, PA, July 2006.
65. S. Das, P. Kanjilal, and D. Lawless, "Spatiotemporal Clustering for Aggregating Hostile Units in Cluttered Environments," Proceeding of the 9th International Conf. on Information Fusion, Florence, Italy, July 2006.
66. th International Conf. on Information Fusion, Philadelphia, PA., July 2005.
67. A. P. Dempster, "Upper and lower probabilities induced by a multivalued mapping," The Annals of Mathematical Statistics, Vol. 38, No. 2, pp. 325-339, April 1967.
68. G. Shafer, A Mathematical Theory of Evidence, Princeton University Press, 1976.
69. P. Smets and R. Kennes, "The transferable belief model," Artificial Intelligence, Vol. 66, pp. 191-34, 1994.
70. E. H. Ruspini, "The logical foundations of evidential reasoning," Technical Note 408, AI Center, SRI International, 1986.
71. E. H. Ruspini, "Epistemic logics, probability, and the calculus of evidence," Proc. of the Tenth Joint Conference on Artificial Intelligence, AAAI, 1987, pp. 924-931.
72. L. A. Zadeh, "On the validity of Dempster's rule of combination of evidence," Technical Report 79/24, University of California, Berkley, 1979.
73. E. H. Ruspini, J. D. Lowrance and T. M. Strat, "Understanding evidential reasoning," Int. J. Approx. Reasoning, Vol. 8, No. 3, pp. 401-424, 1992.
74. J. Pearl, "Reasoning with belief functions," Int. J. Approx. Reasoning, Vol. 4, No. 5-6, pp. 363-389,1990.
75. A. Kehler, "Counterintuitive results in the calculus of evidence," Private Communications, 1999.
76. J. Kohlas and P. A. Monney, "A Mathematical Theory of Hits: An Approach to the Dempster-Shafer Theory of Evidence, Vol. 425 of Lectures in Economics and Mathematical Systems, Springer, 1995.
77. J. D. Lowrance, T. M. Strat, L. P. Wesley, T. D. Garvey, E. H. Ruspini, and D. E. Wilkins, "The theory, implementation, and practice of evidential reasoning," Technical Report 769, AI Center, SRI International, June 1991.
78. R. R. Yager, "Entropy and specificity in a mathematical theory of evidence," Int. J. General Systems, Vol. 9, pp. 3-28, 1983.
79. th International Conference on Information Fusion, Annapolis, MD, USA, July 7-11, pp. 562-569,2002.
80. th International Conference on Information Fusion, Cairns, QLD, Australia, July 8-11, pp. 741-748., 2003.
81. th International Conference on Information Fusion, Quebec City, Canada, July, 2007.
82. B. J. Rhodes, N. A. Bomberger, T. M. Freyman, W. Kreamer, L. Kirschner, A. C. L'Italien, W. Mungovan, C. Stauffer, L. Stolzar, A. M. Waxman, and M. Seibert, "SeeCoast: Port surveillance and automated scene understanding for ports and coastal areas", In Proceedings of SPIE Vol. 6578: Defense Transformation and Net-Centric Systems 2007, Orlando, FL, USA, April 9-12, 2007.
83. B. J. Rhodes, "Taxonomie knowledge structure discovery from imagery-based data using the Neural Associative Incremental Learning (NAIL) algorithm". Information Fusion, 8, 295-315, 2007.
84. F. E. White, "A Model for Data Fusion", Proc. 1st National Symposium on Sensor Fusion, Vol. 2,1988.
85. Memorandum of Understanding Regarding "Demonstration of Advanced Sensor Information Processing Techniques for Reconnaissance and for Situation Development" (Short Title: Data Fusion Demonstrator Project) signed by the 13.09.1992 and extended until September 1999
86. NATO AC/243 (Panel3) Data Fusion Demonstrator Project, WP1200 Correlation, Aggregation, Fusion and Situation Determination: Dutch Algorithms, WP1200 /SRS-SDD/V4.0, November 1998.
87. W. Van Kempen, Lt. Col., et al., The Final Operational Evaluation of the NATO Data Fusion Demonstrator, NATO R&TO (1ST Panel), 1999.
88. NATO AC/323(IST-015)TP/24, RTO Task Group 004 on Information Fusion, Final Activity Report 2000-2002, RTO-TR-IST-015, May 2006.
89. J. Biermann, et al., "From Unstructured to Structured Information in Military Intelligence: Some Steps to Improve Information Fusion", SCI Panel Symposium, 25 to 27 October 2004, London, United Kingdom.
90. J. Biermann, "A Knowledge based Approach to Information Fusion for the Support of Military Intelligence", NATO RTO 1ST Symposium on Military Data and Information Fusion, 20.- 22.10, 2003, Prague.
91. J. Biennann, "Understanding Military Information Processing - An Approach to Supporting the Production of Intelligence in Defence and Security", in E. Shahbazian, et al., (Eds.) Proceedings of the NATO - Advanced Research Workshop on Data Fusion Technologies for Harbour Protection, Tallinn, Estonia, 27 June-1 July 2005, IOS Press, to be published.
92. J. Biermann, "Das Experimentalsystem HADES - Methodische Ansätze zur wissensbasierten Fusion strukturierter Informationen", FKIE Bericht Nr. 21, Wachtberg, November 2000.
93. J. R. Anderson, Kognitive Psychologie: Eine Einführung, Spektrum, Akademischer Verlag 1996.
94. J. Biermann, "Ein Expertensystem zur Fusion von Meldungen - Planung und Stand des Projektes HADES", Interner Report FGAN-FFM, Wachtberg, January 1992.
95. J. Biermann, "HADES - A Knowledge-Based System for Message Interpretation and Situation Determination" in: A. Pasqual del Pobil, J. Mira, M. Ali (Eds.) Tasks and Methods in Applied Artificial Intelligence, 11th International Conference on Industrial and Engineering Applications of Artificial Intelligence and expert Systems, IEA-98-AIE, Lecture Notes in Artificial Intelligence 1416, Springer Verlag, Berlin 1998.
96. U. Schade, J. Biermann, M. Frey, "Towards Automatic Threat Recognition", Proceedings of the NATO RTO IST Panel Specialists' Meeting on Information Fusion For Command Support (IST-055/RSM-001), 8-9 November 2005, The Hague, The Netherlands.
97. M. Hecking, "Information Extraction from Battlefield Reports", Proceedings of the 8th Inter-national C2 Research and Technology Symposium, Washington, DC, 2004: CCRP.