Effects of visualizing uncertainty on decision-making in a target identification scenario

Computers and Graphics (Pergamon)

Volumn 41, Issue 1, 2014, Pages 84-98

  Riveiro, Maria ^a   Helldin, Tove ^a   Falkman, Göran ^a   Lebram, Mikael ^a  

^a UNIVERSITY OF SKÖVDE   (Sweden)

Author keywords

Confidence; Decision making; Performance; Target identification; Uncertainty visualization; Workload

Indexed keywords

DATA VISUALIZATION; DECISION MAKING; MULTIVARIANT ANALYSIS; VISUALIZATION;

CONFIDENCE; PERFORMANCE; TARGET IDENTIFICATION; UNCERTAINTY VISUALIZATION; WORKLOAD;

UNCERTAINTY ANALYSIS;

EID: 84897553740     PISSN: 00978493     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cag.2014.02.006     Document Type: Article

References (53)

1. Griethe H, Schumann H. Visualizing uncertainty for improved decision making. In: Proceedings of the 4th international conference on perspectives in business informatics research. Sweden: University of Skövde; 2005.
2. Cedilnik A, Rheingans P. Procedural annotation of uncertain information. In: 11th IEEE visualization 2000 (VIS00). Los Alamitos, CA, USA: IEEE Computer Society Press; 2000. p. 77-83.
3. Griethe H, Schumann H. The visualization of uncertain data: methods and problems. In: Proceedings SimVis06, Magdeburg, Germany; 2006.
4. Atoyan H, Robert JM, Duquet JR. Presentation of uncertain information in user interfaces to support decision making in complex military systems. In: Proceedings of the 20th international conference of the Association Francophone dInteraction Homme-Machine, IHM08. New York, NY, USA: ACM; 2008. p. 41-8. ISBN 978-1-60558-285-6.
5. Andre A, Cutler H. Displaying uncertainty in advanced navigation systems. In: Human factors and ergonomics society 42nd annual meeting, Chicago, IL, USA; 1998. p. 31-5.
6. T. Zuk, and S. Carpendale Theoretical analysis of uncertainty visualizations F. Erbacher Robert, C. Roberts Johnathan, T. Gröhn Matti, Börne Katy, Visualization and data analysis. Proceedings of SPIE-IS&T electronic imaging vol. 6060 2006
7. C.R. Johnson, and A.R. Sanderson A next step visualizing errors and uncertainty IEEE Comput Graph Appl 23 5 2003 6 10
8. Harrower M. Representing uncertainty: does it help people make better decisions? In: UCGIS workshop: geospatial visualization and knowledge discovery workshop. Landsdowne, VA: National Conference Center; 2003 [invited white paper].
9. A.M. MacEachren, A. Robinson, S. Hopper, S. Gardner, R. Murray, and M. Gahegan et al. Visualizing geospatial information uncertainty what we know and what we need to know Cartogr Geogr Inf Sci 32 3 2005 139 160 (Pubitemid 41300254)
10. A. MacEachren, R. Roth, J. OBrien, B. Li, D. Swingley, and M. Gahegan Visual semiotics uncertainty visualization an empirical study IEEE Trans Vis Comput Graph 18 12 2012 2496 2505
11. Pfautz J, Roth E, Bisantz A, Thomas-Meyers G, Llinas J, Fouse A. The role of meta-information in C2 decision-support systems. Technical Report. DTIC Document; 2006.
12. J. McGuirl, and N. Sarter Supporting trust calibration and the effective use of decision aids by presenting dynamic system confidence information Hum Factors: J Hum Factors Erg Soc 48 4 2006 656 665 (Pubitemid 46036195)
13. M. Skeels, B. Lee, G. Smith, and G.G. Robertson Revealing uncertainty for information visualization Inf Vis 9 1 2010 70 81
14. A. Pang, C. Wittenbrink, and S. Lodha Approaches to uncertainty visualization Vis Comput 13 8 1997 370 390 (Pubitemid 127583168)
15. R. Finger, and A. Bisantz Utilizing graphical formats to convey uncertainty in a decision making task Proc Hum Factors Erg Soc Annu Meet 44 1 2000 13 16
16. A. Bisantz, D. Cao, M. Jenkins, P. Pennathur, M. Farry, and E. Roth et al. Comparing uncertainty visualizations for a dynamic decision-making task J Cogn Eng Decis Making 5 3 2011 277 293
17. Lapinski AL. A strategy for uncertainty visualization design. Technical. Report. DRDC Atlantic TM 2009-151. DTIC Document; 2009.
18. H. Neyedli, J. Hollands, and G. Jamieson Beyond identity incorporating system reliability information into an automated combat identification system Hum Factors: J Hum Factors Erg Soc 53 4 2011 338 355
19. X. Dong, and C.C. Hayes Uncertainty visualizations helping decision makers become more aware of uncertainty and its implications J Cogn Eng Decis Making 6 1 2012 30 56
20. D.A. Kobus, S. Proctor, and S. Holste Effects of experience and uncertainty during dynamic decision making Int J Ind Erg 28 5 2001 275 290 (Pubitemid 32910268)
21. R. Lipshitz, G. Klein, J. Orasanu, and E. Salas Taking stock of naturalistic decision making J Behav Decis Making 14 5 2001 331 352
22. Klein G, Schmitt J, McCloskey M, Heaton J, Klinger D, Wolf S. A decision-centered study of the regimental command post. Summary report. Technical Report. Fairborn, OH: Klein Associates, Inc.; 1996.
23. John MS, Callan J, Proctor S, Holste ST. Tactical decision-making under uncertainty: experiments I and II. Technical Report 1821. San Diego, CA: Pacific Sciences and Engineering Group Inc.; 2000.
24. M. Endsley Toward a theory of situation awareness in dynamic systems Hum Factors J 37 1 1995 32 64
25. L.G. Shattuck, N.L. Miller, and K.E. Kemmerer Tactical decision making under conditions of uncertainty an empirical study Proc Hum Factors Erg Soc Annu Meet 53 4 2009 242 246
26. Kruger M, Kratzke N. Monitoring of reliability in Bayesian identification. In: 12th international conference on information fusion; 2009. p. 1241-8.
27. Gelsema S. The desirability of a nato-central database for non-cooperative target recognition of aircraft. In: Proceedings of the RTO SET symposium on target identification and recognition using rf systems, Oslo, Norway; 11-13 October 2004.
28. C. Smith, J. Johnston, and C. Paris Decision support for air warfare detection of deceptive threats Group Decis Negot 13 2 2004 129 148 (Pubitemid 39038746)
29. British Ministry of Defence. Military aircraft accident summary: aircraft accident to Royal Air Force Tornado GR MK4A ZG710. Technical Report; 2004.
30. C.W. Fisher, and B.R. Kingma Criticality of data quality as exemplified in two disasters Inf Manag 39 2 2001 109 116 (Pubitemid 32903861)
31. Paradis S, Benaskeur A, Oxenham M, Cutler P. Threat evaluation and weapons allocation in network-centric warfare. In: 8th international conference on information fusion; 2005.
32. J.N. Roux, and J.H. van Vuuren Threat evaluation and weapon assignment decision support a review of the state of the art Orion 23 2 2007
33. Steinberg A. Foundations of situation and threat assessment. In: Handbook of multisensor data fusion. electrical engineering & applied signal processing series. Boca Raton, FL: CRC Press, Taylor & Francis Group; 2008. p. 437-501.
34. Irandoust H, Benaskeur A, Kabanza F, Bellefeuille P. A mixed-initiative advisory system for threat evaluation. In: 15th ICCRTS the evolution of C2; 2010.
35. Steinberg A. An approach to threat assessment. In: 8th international conference on information fusion; 2005.
36. Liebhaber MJ, Feher B. Air threat assessment: research, model, and display guidelines. In: Proceedings of the 2002 command and control research and technology symposium; 2002.
37. Helldin T, Falkman G, Riveiro M, Dahlbom A, Lebram M. Transparency of military threat evaluation through visualizing uncertainty and system rationale. In: Proceedings of the 15th international conference on human-computer interaction (HCII 2013), Las Vegas, Nevada, USA; 2013.
38. Riveiro M, Helldin T, Lebram M, Falkman G. Towards future threat evaluation systems: User study, proposal and precepts for design, In: Proceedings of the 16th International Conference on Information Fusion (FUSION), Istanbul, Turkey, 9-12 July 2013, p. 1863-1870.
39. D. Keim, G. Andrienko, J.D. Fekete, C. Görg, J. Kohlhammer, and G. Melançon Visual analytics: definition, process, and challenges A. Kerren, J.T. Stasko, J.D. Fekete, C. North, Information visualization. Lecture notes in computer science 2008 Springer Berlin, Heidelberg 154 175
40. R.E. Kalman A new approach to linear filtering and prediction problems Trans ASME - J Basic Eng 82 Series D 1960 35 45
41. Ribeiro MI. Gaussian probability density functions: properties and error characterization. Technical Report. Lisboa: Instituto Superior Tecnico; 2004. Published at Robotics WEBook .http://www.euron.org.
42. Buttenfield B, Weibel R. Visualizing the quality of cartographic data. In: 3rd international geographic information systems symposium, GIS/LIS 88, San Antonio, TX; 1988.
43. Sandra G. Hart, Lowell E. Staveland, Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research, In: Peter A. Hancock and Najmedin Meshkati, Editor(s), Advances in Psychology, North-Holland, 1988, Vol. 52, p. 139-183, ISSN 0166-4115, ISBN 9780444703880, 10.1016/S0166-4115(08)62386- 9.
44. S. Carpendale Evaluating information visualizations A. Kerren, J. Stasko, J.D. Fekete, C. North, Information visualization. Lecture notes in computer science vol. 4950 2008 Springer-Verlag Berlin, Heidelberg 19 45
45. Deitrick S, Edsall R. The influence of uncertainty visualization on decision making: an empirical evaluation. In: Progress in Spatial Data Handling. Berlin, Heidelberg: Springer; 2006.
46. L. Nadav-Greenberg, S.L. Joslyn, and M.U. Taing The effect of uncertainty visualizations on decision making in weather forecasting J Cogn Eng Decis Making 2 1 2008 24 47
47. M. Leitner, and B.P. Buttenfield Guidelines for the display of attribute certainty Cartogr Geogr Inf Sci 27 1 2000 3 14 (Pubitemid 32778987)
48. Schweizer D, Goodchild M. Data quality and choropleth maps: an experiment with the use of color. In: Proceedings, GIS/LIS, vol. 2; 1992. p. 686-99.
49. T. Zuk, and S. Carpendale Visualization of uncertainty and reasoning Andreas Butz, Brian Fisher, Antonio Krüger, Patrick Olivier, Shigeru Owada, Proceedings of the 7th international symposium on smart graphics (June 25-27, 2007, Kyoto, Japan) vol. 4569 2007 Springer-Verlag Berlin, Heidelberg 164 177
50. A. Tversky, and D. Kahneman Judgment under uncertainty: heuristics and biases Science 185 4157 1974 1124 1131
51. R. Keith Optimization of value of aerodrome forecasts Weather Forecast 18 5 2003 808 824 (Pubitemid 37450294)
52. E.R. Stone, J.F. Yates, and A.M. Parker Effects of numerical and graphical displays on professed risk-taking behavior J Exp Psychol: Appl 3 4 1997 243 256 (Pubitemid 127462888)
53. D.C. Cliburn, J.J. Feddemab, J.R. Millerc, and T.A. Slocum Design and evaluation of a decision support system in a water balance application Comput Graph 26 2002 931 949