Towards context aware data fusion: Modeling and integration of situationally qualified human observations to manage uncertainty in a hard + soft fusion process

Information Fusion

Volumn 21, Issue 1, 2015, Pages 130-144

  Jenkins, Michael P ^a   Gross, Geoff A ^a   Bisantz, Ann M ^a   Nagi, Rakesh ^a  

^a the State University of New York   (United States)

Author keywords

Data fusion; Human observation; Human observers; Soft data sensors; Uncertainty alignment

Indexed keywords

COMPUTER SIMULATION; DATA FUSION; PATTERN MATCHING; STOCHASTIC SYSTEMS;

ACCURACY AND PRECISION; ERROR CHARACTERISTICS; ERROR CHARACTERIZATIONS; HUMAN OBSERVATIONS; HUMAN OBSERVERS; SITUATION ASSESSMENT; SITUATIONAL AWARENESS; SOFT DATA;

UNCERTAINTY ANALYSIS;

EID: 84904798986     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.inffus.2013.04.011     Document Type: Article

References (80)

1. R.J. Heuer Jr. The Psychology of Intelligence Analysis, Center for the Study of Intelligence 1999 CIA Washington, DC
2. S.G. Hutchins, P.L. Pirolli, and S.K. Card What makes intelligence analysis difficult? A cognitive task analysis of intelligence analysts P.L. Pirolli, Assisting People to Become Independent Learners in the Analysis of Intelligence 2006 Palo Alto Research Center Palo Alto 6 52
3. J. Pfautz, E. Roth, G. Powell, T. Fichtl, S. Guarino, E. Carlson, Cognitive complexities impacting army intelligence analysis, in: Proceedings of the Human Factors & Ergonomics Society 50th Annual Meeting, October 16-20, San Francisco, 2006, pp. 452-456. (Pubitemid 351741745)
4. M. P. Jenkins, G. Gross, A.M. Bisantz, R. Nagi, Towards context-aware hard/soft information fusion: incorporation of situationally qualified human observations into a fusion process for intelligence analysis, in: Proceedings of the 2011 IEEE First International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA), February 22-24, Miami Beach, 2011, pp. 74-81.
5. S.M. Taylor The several worlds of the intelligence analyst International Conference on Intelligence Analysis 2005 MITRE Corp. McLean
6. J. Scholtz, E. Morse, and M.P. Steves Evaluation metrics and methodologies for user-centered evaluation of intelligent systems Interacting with Computers 18 6 2006 1186 1214 (Pubitemid 44709891)
7. C.K. Tam, Behavioral and Psychosocial Considerations in Intelligence Analysis: A Preliminary Review of Literature on Critical Thinking Skills, Air Force Research Lab interim report, May 2008-October 2009.
8. R. Johnston Analytic Culture in the US Intelligence Community: An ethnographic study, Center for the Study of Intelligence 2005 CIA Washington, DC
9. W.C. Elm, M.J. Cook, F.L. Greitzer, R.R Hoffman, B. Moon, S.G. Hutchins, Designing support for intelligence analysis, in: Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting, September 20-24, New Orleans, 2004, pp. 406-410.
10. S. Kent Special Problems of Method in Intelligence Work, Strategic Intelligence for American World Policy 1965 Archon Books Hamden
11. S. Das Agent-based information fusion Information Fusion 11 3 2010 216 219
12. E.L. Waltz, and J. Llinas Multi-Sensor Data Fusion 1990 Avtech House Norwood
13. K. Sambhoos, J. Llinas, E. Little. Graphical methods for real-time fusion and estimation with soft message data, in: Proceedings of the 11th International Conference on Information Fusion, June 30-July 3, Cologne, Germany, 2008, pp. 1-8.
14. Department of the US ARMY, US Army Field Manual FMI 3-07/22: Counterinsurgency Operations, Interim Version of the 2006 US Army Field Manual, Department of the US Army, 2004.
15. Department of the US ARMY, US Army Field Manual FM 101-5-2: US Army Report & Message Formats, Department of the Army, 2009.
16. N. Finney, Human Terrain Team Handbook, Human Terrain System: Fort Levenworth, KS, 2008.
17. J. Atkinson, F.W. Campbell, and M.R. Francis The magic number 4 ± 0: a new look at visual numerosity judgments Perception 5 3 1976 327 334
18. P. Class Display density and judgments of number Perception and Motor Skills 34 2 1972 531 534
19. N. Ginsburg Perceived numerosity, item arrangement, and expectancy The American Journal of Psychology 91 2 1978 267 273
20. N. Ginsburg Numerosity estimation as a function of stimulus organization Perception 20 5 1991 681 686
21. E.L. Kaufman, M.W. Lord, T.W. Reese, and J. Volkmann The discrimination of visual number The American Journal of Psychology 62 4 1949 498 525
22. P. Lemaire, and M. Lecacheur Aging and numerosity estimation The Journals of Gerontology Series B: Psychological sciences and social sciences 62 6 2007 305 312
23. A.D. Baddeley, V. Lewis, and I. Nimm0-Smith When did you last...? M.M. Gruneberg, Practical Aspects of Memory 1978 Academic Press London 77 83
24. C.R. Barclay, and H.M. Wellman Accuracies and inaccuracies in autobiographical memories Journal of Memory and Language 25 1 1986 93 103
25. R.P. Ferguson, and P. Martin Long-term temporal estimation in humans Perception and Psychophysics 33 1983 585 592
26. S.M. Janssen, A.G. Chessa, and J.M. Murre Memory for time: how people date events Memory and Cognition 34 2006 138 147
27. C.P. Thompson Memory for unique personal events: the roommate study Memory and Cognition 10 1982 324 332 (Pubitemid 13244690)
28. R.T. White Memory for personal events Human Learning 1 1982 171 183
29. S. Kemp Dating recent and historical events Applied Cognitive Psychology 2 1988 181 188
30. N.R. Brown, L.J. Rips, and S.K. Shevell The subjective dates of natural events in very-long-term memory Cognitive Psychology 17 1985 139 177
31. W.J. Friedman, and A.J. Wilkins Scale effects in memory for the time of events Memory and Cognition 13 1985 168 175 (Pubitemid 15060407)
32. W.J. Friedman A follow-up to "scale effects in memory for the time of events": the earthquake study Memory and Cognition 15 1987 518 520
33. S.O. Daum, and H. Hecht Distance estimation in vista space Attention, Perception and Psychophysics 71 2009 1127 1137
34. Z.J. He, B. Wu, T.L. Ooi, G. Yarbrough, and J. Wu Judging egocentric distance on the ground: occlusion and surface integration Perception 33 2004 789 806 (Pubitemid 39305516)
35. C. Jerome, B. Witmer, The perception and estimation of egocentric distance in real and augmented reality environments, in: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Orlando, September 26-30, vol. 49(26), 2005, pp. 2249-2252. (Pubitemid 351742677)
36. C. Jerome, and B.G. Witmer The Perception and Estimation of Egocentric Distance in Real and Augmented Reality Environments 2008 Army Research Institute US
37. K.K. Niall, J.D. Reising, and E.L. Martin Distance estimation with night vision goggles: a little feedback goes a long way Human Factors 41 1999 495 506 (Pubitemid 30053139)
38. J.W. Philbeck, and J.M. Loomis Comparison of two indicators of perceived egocentric distance under full-cue and reduced-cue Journal of Experimental Psychology: Human Perception and Performance 23 1997 72 85 (Pubitemid 127456156)
39. D.R. Proffitt, J. Stefanucci, T. Banton, and W. Epstein The role of effort in perceiving distance Psychological Science 14 2003 106 112 (Pubitemid 37283093)
40. M.J. Sinai, T.L. Ooi, and Z.J. He Terrain influences the accurate judgment of distance Nature 395 1998 497 500 (Pubitemid 28462443)
41. J.K. Stefanucci, D.R. Proffitt, T. Banton, and W. Epstein Distances appear different on hills Perception and Psychophysics 67 2005 1052 1060 (Pubitemid 41766834)
42. W.B. Thompson, V. Dilda, and S.H. Creem-Regehr Absolute distance perception to locations off the ground plane Perception 36 2007 1559 1571
43. J.K. Witt, D.R. Proffitt, and W. Epstein Perceiving distance: a role of effort and intent Perception 33 2004 577 590 (Pubitemid 38882946)
44. E.J. Gibson Improvement in perceptual judgments as a function of controlled practice or training Psychological Bulletin 50 1953 401 431
45. E.J. Gibson, and R. Bergman The effect of training on absolute estimation of distance over the ground Journal of Experimental Psychology 48 1954 473 482
46. E.J. Gibson, R. Bergman, and J. Purdy The effect of prior training with a scale of distance on absolute and relative judgments of distance over ground Journal of Experimental Psychology 50 1955 97 105
47. D.R. Lampton, D.P. McDonald, M. Singer, J.P. Bliss, Distance estimation in virtual environments, in: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, San Diego, October 9-13, vol. 39(20), 1995, pp. 1268-1272.
48. B.G. Witmer, and P.B. Kline Judging perceived and traversed distance in virtual environments Presence: Teleoperators and Virtual Environments 7 1998 144 167 (Pubitemid 128344168)
49. D.M. Burt, and D.I. Perrett Perception of age in adult Caucasian male faces: computer graphic manipulation of shape and colour information Proceedings of Biological Science 259 1995 137 143
50. H. Dehon, and S. Bredart An 'other-race' effect in age estimation from faces Perception 30 2001 1107 1113 (Pubitemid 33600311)
51. P.A. George, and G.J. Hole Factors influencing the accuracy of age estimates of unfamiliar faces Perception 24 1995 1059 1073
52. P.A. George, and G.J. Hole The role of spatial and surface cues in the age-processing of unfamiliar faces Visual Cognition 7 2000 485 509 (Pubitemid 30350152)
53. S.F. Klugman The effect of age upon estimation of age Journal of Social Psychology 26 1947 29 33
54. M.G. Rhodes Age estimation of faces: a review Applied Cognitive Psychology 23 2009 1 12
55. P. Sörqvist, and M. Eriksson Effects of training on age estimation Applied Cognitive Psychology 21 2007 131 135 (Pubitemid 46128497)
56. J. Vestlund, L. Langeborg, P. Sorqvist, and M. Eriksson Experts on age estimation Scandinavian Journal of Psychology 50 2009 301 307
57. R.M. Erwin Observer variability in estimating numbers - an experiment Journal of Field Ornithology 53 1982 159 167
58. E.P. Horne, and M. Allee Estimation as a function of density and contrast Journal of Psychology 78 1971 87 94
59. W. Jevons The power of numerical discrimination Nature 3 1871 281 282
60. A.L. Miller, and R.A. Baker The effects of shape, size, heterogeneity, and instructional set on the judgment of visual number The American Journal of Psychology 81 1968 83 91
61. C. McPhail, and J.D. McCarthy Who counts and how: estimating the size of protests Contexts 3 2004 12 18
62. H. Jacobs To count a crowd Columbia Journalism Review 6 1967 37 40
63. M. Nikravesh, J. Kacprzyk, and L.A. Zadeh Forging New Frontiers: Fuzzy Pioneers vol. 2 2007 Springer Berlin, Germany
64. D.L. Hall, and J. Llinas An Introduction to multisensor data fusion Proceedings of the IEEE 85 1 1997 6 23 (Pubitemid 127745544)
65. M.R. Endlsey, Design and evaluation for situation awareness enhancement, in: Proceedings of the Human Factors and Ergonomics Society 32nd Annual Meeting, Santa Monica, October 24-28, vol. 32, 1988, pp. 97-101.
66. M.R. Endsley Toward a theory of situation awareness in dynamic systems Human Factors 37 1995 32 64
67. N.B. Sarter, and D.D. Woods Situation awareness: a critical but Ill-defined phenomenon The International Journal of Aviation Psychology 1 1 1991 45 57
68. M. Prentice, M. Kandefer, S.C. Shapiro, Tractor: an architecture for soft information fusion, in: Proceedings of the 13th International Conference on Information Fusion, July 26-29, Edinburgh, UK, 2010, pp. 1-8.
69. M. Prentice, S.C. Shapiro, Using Propositional Graphs for Soft Information Fusion, in: Proceedings of the 14th International Conference on Information Fusion, July 5-8, Chicago, IL, 2011, pp. 1-8.
70. G.A. Gross, R. Nagi, K. Sambhoos, D.R. Schlegel, S.C. Shapiro, G. Tauer, Towards hard + soft data fusion: processing architecture and implementation for the joint fusion and analysis of hard and soft intelligence data, in: Proceedings of the 15th International Conference on Information Fusion, July 9-12, Singapore, 2012, pp. 955-962.
71. G. Tauer Data Association on Large Quantities of Complex Data 2012 State University of New York at Buffalo Buffalo
72. V. Lasserre, G. Mauris, and L. Foulloy Fuzzy modeling of measurement data acquired from physical sensors IEEE Transactions on Instrumentation and Measurement 49 6 2000 1201 1205 (Pubitemid 32169311)
73. D. Dubois, H. Prade, S. Sandri, On possibility/probability transformations, in: Proceedings of 4th IFSA Conference, June 29-July 2, Istanbul, Turkey, 2003, pp. 103-112.
74. D. Guha, and D. Chakraborty A new approach to fuzzy distance measure and similarity measure between two generalized fuzzy numbers Applied Soft Computing 10 2010 90 99
75. K. Sambhoos, R. Nagi, M. Sudit, and A. Stotz Enhancements to high level data fusion using graph matching and state space search Information Fusion 11 4 2010 351 364
76. G. Gross, R. Nagi, K. Sambhoos, soft information, dirty graphs and uncertainty representation/processing for situation understanding, in: Proceedings of the 13th International Conference on Information Fusion, July 26-29, Edinburgh, Scotland, 2010, pp. 1-8.
77. G.A. Gross, R. Nagi, and K. Sambhoos A fuzzy graph matching approach in intelligence analysis and maintenance of continuous situational awareness Information Fusion 18 2014 43 61
78. G. Tauer, R. Nagi, and M. Sudit The graph association problem: mathematical models and a lagrangian heuristic Conditionally accepted to Navel Research Logistics 2012
79. L. Page, S. Brin, R. Motwani, T. Winograd, The PageRank Citation Ranking: Bringing Order to the Web, Technical Report, Stanford University, Stanford, CA, 1998.
80. M. Gjoka, M. Kurant, C.T. Butts, and A. Markopoulou Practical recommendations on crawling online social networks IEEE Journal on Selected Areas in Communications 29 9 2011 1872 1892