The Role of Uncertainty, Awareness, and Trust in Visual Analytics

IEEE Transactions on Visualization and Computer Graphics

Volumn 22, Issue 1, 2016, Pages 240-249

  Sacha, Dominik ^a   Senaratne, Hansi ^a   Kwon, Bum Chul ^a   Ellis, Geoffrey ^a   Keim, Daniel A ^a  

^a UNIVERSITY OF KONSTANZ   (Germany)

Author keywords

Analytical models; Buildings; Data models; Data visualization; Uncertainty; Visual analytics

Indexed keywords

ANALYTICAL MODELS; BUILDINGS; COGNITIVE SYSTEMS; DATA STRUCTURES; DATA VISUALIZATION; DECISION MAKING;

COGNITIVE BIAS; COMPLEX DATASETS; KNOWLEDGE CONSTRUCTION; KNOWLEDGE GENERATIONS; UNCERTAINTY; VISUAL ANALYTICS; VISUAL ANALYTICS SYSTEMS; VISUAL REPRESENTATIONS;

VISUALIZATION;

AWARENESS; BIOENGINEERING; COMPUTER GRAPHICS; HUMAN; PSYCHOLOGY; TRUST; UNCERTAINTY;

AWARENESS; COMPUTER GRAPHICS; HUMAN ENGINEERING; HUMANS; TRUST; UNCERTAINTY;

EID: 84946595461     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2015.2467591     Document Type: Article

References (83)

1. B. B. Anderson, C. B. Kirwan, J. L. Jenkins, D. Eargle, S. Howard, and A. Vance. How polymorphic warnings reduce habituation in the brain - insights from an fmri study. Proc. of CHI'15, 2013.
2. D. Arnott. Cognitive biases and decision support systems development: a design science approach. Inf. Syst. J., 16(1):55-78, 2006.
3. B. Barber. The logic and limits of trust, volume 96. Rutgers University Press New Brunswick, NJ, 1983.
4. E. J. Bass, L. A. Baumgart, and K. K. Shepley. The effect of information analysis automation display content on human judgment performance in noisy environments. Journal of cognitive engineering and decision making, 7(1):49-65, 2013.
5. M. K. Beard, B. P. Buttenfield, and S. B. Clapham. NCGIA Research Initiative 7: Visualization of Spatial Data Quality: Scientific Report for the Specialist Meeting 8-12 June 1991, Castine, Maine. National Center for Geographic Information and Analysis, 1991.
6. M. Bishr and K. Janowicz. Can we trust information?-the case of Volunteered Geographic Information. In Towards Digital Earth Search Discover and Share Geospatial Data Workshop at Future Internet Symposium, volume, volume 640, 2010.
7. K. Brodlie, R. A. Osorio, and A. Lopes. A review of uncertainty in data visualization. In Expanding the Frontiers of Visual Analytics and Visualization, pages 81-109. Springer, 2012.
8. E. T. Brown, A. Ottley, H. Zhao, Q. Lin, R. Souvenir, A. Endert, and R. Chang. Finding waldo: Learning about users from their interactions. IEEE Trans. Vis. Comput. Graph., 20(12):1663-1672, 2014.
9. B. Buttenfield and R. Weibel. Visualizing the quality of cartographic data. In Third International Geographic Information Systems Symposium (GIS/LIS 88), San Antonio, Texas, 1988.
10. H. Cai and Y. Lin. Tuning trust using cognitive cues for better human-machine collaboration. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, volume 54, pages 2437-2441. SAGE Publications, 2010.
11. C. Castelfranchi. Trust mediation in knowledge management and sharing. In Trust Management, Second International Conference, iTrust 2004, Oxford, UK, March 29-April 1, 2004, Proceedings, pages 304-318, 2004.
12. C. Castillo, M. Mendoza, and B. Poblete. Information credibility on twitter. In Proceedings of the 20th international conference on World wide web, pages 675-684. ACM, 2011.
13. A. Cedilnik and P. Rheingans. Procedural annotation of uncertain information. In Visualization 2000. Proceedings, pages 77-84. IEEE, 2000.
14. C. Chatfield. Model uncertainty. Encyclopedia of Environmetrics, 2006.
15. L. Chien, A. Tat, P. Proulx, A. Khamisa, and W. Wright. Grand challenge award 2008: Support for diverse analytic techniques - nspace2 and geotime visual analytics. In Proceedings of the IEEE Symposium on Visual Analytics Science and Technology, IEEE VAST 2008, Columbus, Ohio, USA, 19-24 October 2008, pages 199-200, 2008.
16. J. Chuang, D. Ramage, C. D. Manning, and J. Heer. Interpretation and trust: designing model-driven visualizations for text analysis. In CHI Conference on Human Factors in Computing Systems, CHI '12, Austin, TX, USA - May 05-10, 2012, pages 443-452, 2012.
17. C. Correa, Y.-H. Chan, and K.-L. Ma. A framework for uncertainty-aware visual analytics. In Visual Analytics Science and Technology, 2009. VAST 2009. IEEE Symposium on, pages 51-58. IEEE, 2009.
18. A. C. Cullen and H. C. Frey. Probabilistic techniques in exposure assessment: a handbook for dealing with variability and uncertainty in models and inputs. Springer Science & Business Media, 1999.
19. E. J. de Visser, M. S. Cohen, A. Freedy, and R. Parasuraman. A design methodology for trust cue calibration in cognitive agents. In Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments - 6th International Conference, VAMR 2014, Held as Part of HCI International 2014, Heraklion, Crete, Greece, June 22-27, 2014, Proceedings, Part I, pages 251-262, 2014.
20. W. Dou, W. Ribarsky, and R. Chang. Capturing reasoning process through user interaction. Proc. IEEE EuroVAST, 2, 2010.
21. M. T. Dzindolet, S. A. Peterson, R. A. Pomranky, L. G. Pierce, and H. P. Beck. The role of trust in automation reliance. Int. J. Hum.-Comput. Stud., 58(6):697-718, 2003.
22. A. Endert, P. Fiaux, and C. North. Semantic interaction for sensemaking: Inferring analytical reasoning for model steering. IEEE Trans. Vis. Comput. Graph., 18(12):2879-2888, 2012.
23. A. Endert, M. Hossain, N. Ramakrishnan, C. North, P. Fiaux, and C. Andrews. The human is the loop: new directions for visual analytics. Journal of Intelligent Information Systems, pages 1-25, 2014.
24. K. A. Ericsson and H. A. Simon. Protocol analysis. MIT-press, 1984.
25. C. Fernandez, E. Ley, and M. F. Steel. Model uncertainty in cross-country growth regressions. Journal of applied Econometrics, 16(5):563-576, 2001.
26. D. Fisher, S. M. Drucker, and A. C. König. Exploratory visualization involving incremental, approximate database queries and uncertainty. IEEE Computer Graphics and Applications, 32(4):55-62, 2012.
27. A. Flanagin and M. Metzger. The credibility of volunteered geographic information. GeoJournal, 72(3):137-148, 2008.
28. M. Gahegan. Beyond tools: Visual support for the entire process of giscience. Exploring geovisualization, (4):83-99, 2005.
29. K. Goddard, A. V. Roudsari, and J. C. Wyatt. Automation bias: Empirical results assessing influencing factors. I. J. Medical Informatics, 83(5):368-375, 2014.
30. T. M. Green and R. Maciejewski. A role for reasoning in visual analytics. In 46th Hawaii International Conference on System Sciences, HICSS 2013, Wailea, HI, USA, January 7-10, 2013, pages 1495-1504, 2013.
31. T. M. Green, W. Ribarsky, and B. D. Fisher. Building and applying a human cognition model for visual analytics. Information Visualization, 8(1):1-13, 2009.
32. H. Griethe and H. Schumann. The visualization of uncertain data: Methods and problems. In SimVis, pages 143-156, 2006.
33. R. B. Haber and D. A. McNabb. Visualization idioms: A conceptual model for scientific visualization systems. Visualization in scientific computing, 74:93, 1990.
34. L. Harrison, W. Dou, A. Lu, W. Ribarsky, and X. Wang. Analysts aren't machines: Inferring frustration through visualization interaction. In Visual Analytics Science and Technology (VAST), 2011 IEEE Conference on, pages 279-280. IEEE, 2011.
35. T. Hengl. Visualisation of uncertainty using the hsi colour model: computations with colours. In Proceedings of the 7th International Conference on GeoComputation, pages 8-17, 2003.
36. G. B. M. Heuvelink and P. A. Burrough. Developments in statistical approaches to spatial uncertainty and its propagation. International Journal of Geographical Information Science, 16(2):111-113, 2002.
37. D. Howard and A. M. MacEachren. Interface design for geographic visualization: Tools for representing reliability. Cartography and Geographic Information Systems, 23(2):59-77, 1996.
38. S. T. Iqbal and E. Horvitz. Disruption and recovery of computing tasks: field study, analysis, and directions. In Proceedings of the 2007 Conference on Human Factors in Computing Systems, CHI 2007, San Jose, California, USA, April 28-May 3, 2007, pages 677-686, 2007.
39. N. Kadivar, V. Y. Chen, D. Dunsmuir, E. Lee, C. Z. Qian, J. Dill, C. D. Shaw, and R. F. Woodbury. Capturing and supporting the analysis process. In Proceedings of the IEEE Symposium on Visual Analytics Science and Technology, IEEE VAST 2009, Atlantic City, New Jersey, USA, 11-16 October 2009, part of VisWeek 2009, pages 131-138, 2009.
40. D. Kahneman. Thinking, fast and slow. Macmillan, 2011.
41. D. Kahneman and A. Tversky. Subjective probability: A judgment of representativeness. In The Concept of Probability in Psychological Experiments, pages 25-48. Springer, 1974.
42. M. C. Kennedy and A. O'Hagan. Bayesian calibration of computer models. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 63(3):425-464, 2001.
43. S. R. Klemmer, M. Thomsen, E. Phelps-Goodman, R. Lee, and J. A. Landay. Where do web sites come from?: capturing and interacting with design history. In Proceedings of the CHI 2002 Conference on Human Factors in Computing Systems: Changing our World, Changing ourselves, Minneapolis, Minnesota, USA, April 20-25, 2002., pages 1-8, 2002.
44. G. J. Klir and M. J. Wierman. Uncertainty-based information: elements of generalized information theory, volume 15. Springer Science & Business Media, 1999.
45. R. Kosara and J. Mackinlay. Storytelling: The next step for visualization. Computer, 46(5):44-50, 2013.
46. D. R. Kretz, B. Simpson, and C. Graham. A game-based experimental protocol for identifying and overcoming judgment biases in forensic decision analysis. In Homeland Security (HST), 2012 IEEE Conference on Technologies for, pages 439-444. IEEE, 2012.
47. K. Kurzhals, B. D. Fisher, M. Burch, and D. Weiskopf. Evaluating visual analytics with eye tracking. In Proceedings of the Fifth Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization, BELIV 2014, Paris, France, November 10, 2014, pages 61-69, 2014.
48. B. C. Kwon, B. Fisher, and J. S. Yi. Visual analytic roadblocks for novice investigators. In 2011 IEEE Conference on Visual Analytics Science and Technology (VAST), pages 3-11, 2011.
49. S. H. Lee and W. Chen. A comparative study of uncertainty propagation methods for black-box-type problems. Structural and Multidisciplinary Optimization, 37(3):239-253, 2009.
50. V. Lush, L. Bastin, and J. Lumsden. Developing a geo label: providing the gis community with quality metadata visualisation tools. Proceedings of the 21st GIS Research UK (GISRUK 3013), Liverpool, UK, pages 3-5, 2013.
51. A. M. MacEachren. Visualizing uncertain information. Cartographic Perspectives, 13(13):10-19, 1992.
52. A. M. MacEachren. Visual Analytics and Uncertainty: Its Not About the Data. In EuroVis Workshop on Visual Analytics (EuroVA). The Eurographics Association, 2015.
53. A. M. MacEachren and J. H. Ganter. A pattern identification approach to cartographic visualization. Cartographica: The International Journal for Geographic Information and Geovisualization, 27(2):64-81, 1990.
54. A. M. MacEachren, A. Robinson, S. Hopper, S. Gardner, R. Murray, M. Gahegan, and E. Hetzler. Visualizing geospatial information uncertainty: What we know and what we need to know. Cartography and Geographic Information Science, 32(3):139-160, 2005.
55. A. M. MacEachren, R. E. Roth, J. O'Brien, B. Li, D. Swingley, and M. Gahegan. Visual semiotics & uncertainty visualization: An empirical study. Visualization and Computer Graphics, IEEE Transactions on, 18(12):2496-2505, 2012.
56. D. Manzey, J. Reichenbach, and L. Onnasch. Human performance consequences of automated decision aids: The impact of degree of automation and system experience. Journal of Cognitive Engineering and Decision Making, pages 57-87, 2012.
57. P. Maué. Reputation as tool to ensure validity of vgi. In Workshop on volunteered geographic information, 2007.
58. B. M. Muir. Trust between humans and machines, and the design of decision aids. International Journal of Man-Machine Studies, 27(5-6):527-539, 1987.
59. P. H. Nguyen, K. Xu, and B. Wong. A survey of analytic provenance. Middlesex University, 2014.
60. A. Pang. Visualizing uncertainty in geo-spatial data. In Proceedings of the Workshop on the Intersections between Geospatial Information and Information Technology, pages 1-14, 2001.
61. A. T. Pang, C. M. Wittenbrink, and S. K. Lodha. Approaches to uncertainty visualization. The Visual Computer, 13(8):370-390, 1997.
62. B. K. Phillips, V. R. Prybutok, and D. A. Peak. Decision confidence, information usefulness, and information seeking intention in the presence of disconfirming information. InformingSciJ, 17:1-24, 2014.
63. E. D. Ragan and J. R. Goodall. Evaluation methodology for comparing memory and communication of analytic processes in visual analytics. In Proceedings of the Fifth Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization, BELIV 2014, Paris, France, November 10, 2014, pages 27-34, 2014.
64. D. Sacha, A. Stoffel, F. Stoffel, B. C. Kwon, G. P. Ellis, and D. A. Keim. Knowledge generation model for visual analytics. IEEE Trans. Vis. Comput. Graph., 20(12):1604-1613, 2014.
65. G. S. Schmidt, S.-L. Chen, A. N. Bryden, M. A. Livingston, L. J. Rosenblum, and B. R. Osborn. Multidimensional visual representations for underwater environmental uncertainty. Computer Graphics and Applications, IEEE, 24(5):56-65, 2004.
66. J. Scholtz. Beyond usability: Evaluation aspects of visual analytic environments. In IEEE Symposium On Visual Analytics Science And Technology, IEEE VAST 2006, October 31-November 2, 2006, Baltimore, Maryland, USA, pages 145-150, 2006.
67. H. Senaratne and L. Gerharz. An assessment and categorisation of quantitative uncertainty visualisation methods for geospatial data. In 14th AGILE international conference on geographic information science-advancing geoinformation science for a changing world. AGILE, 2011.
68. H. Senaratne, L. Gerharz, E. Pebesma, and A. Schwering. Usability of spatio-temporal uncertainty visualisation methods. In Bridging the Geographic Information Sciences, pages 3-23. Springer, 2012.
69. B. Shneiderman. The eyes have it: A task by data type taxonomy for information visualizations. In Visual Languages, 1996. Proceedings., IEEE Symposium on, pages 336-343. IEEE, 1996.
70. Y. L. Simmhan, B. Plale, and D. Gannon. A survey of data provenance techniques. Computer Science Department, Indiana University, Bloomington IN, 47405, 2005.
71. M. M. Skeels, B. Lee, G. Smith, and G. G. Robertson. Revealing uncertainty for information visualization. Information Visualization, 9(1):70-81, 2010.
72. S. Tak and A. Toet. Color and uncertainty: It is not always black and white. 2014.
73. A. Tatu, G. Albuquerque, M. Eisemann, P. Bak, H. Theisel, M. A. Magnor, and D. A. Keim. Automated analytical methods to support visual exploration of high-dimensional data. IEEE Trans. Vis. Comput. Graph., 17(5):584-597, 2011.
74. T. Tenbrink. Cognitive discourse analysis: accessing cognitive representations and processes through language data. Language and Cognition, 7:98-137, 3 2015.
75. J. Thomson, E. Hetzler, A. MacEachren, M. Gahegan, and M. Pavel. A typology for visualizing uncertainty. In Electronic Imaging 2005, pages 146-157. International Society for Optics and Photonics, 2005.
76. M. Tory and T. Möller. Human factors in visualization research. IEEE Trans. Vis. Comput. Graph., 10(1):72-84, 2004.
77. A. Uggirala, A. K. Gramopadhye, B. J. Melloy, and J. E. Toler. Measurement of trust in complex and dynamic systems using a quantitative approach. International Journal of Industrial Ergonomics, 34(3):175-186, 2004.
78. F. J. Van der Wel, L. C. Van der Gaag, and B. G. Gorte. Visual exploration of uncertainty in remote-sensing classification. Computers & Geosciences, 24(4):335-343, 1998.
79. C. Ware. Information visualization: perception for design. Elsevier, 2012.
80. K. M. Winters, D. Lach, and J. B. Cushing. Considerations for characterizing domain problems. In Proceedings of the Fifth Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization, BELIV 2014, Paris, France, November 10, 2014, pages 16-22, 2014.
81. W. Wright, D. Schroh, P. Proulx, A. Skaburskis, and B. Cort. The sandbox for analysis: Concepts and methods. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '06, pages 801-810, New York, NY, USA, 2006. ACM.
82. L. Zhou, J. K. Burgoon, J. F. Nunamaker, and D. Twitchell. Automating linguistics-based cues for detecting deception in text-based asynchronous computer-mediated communications. Group decision and negotiation, 13(1):81-106, 2004.
83. T. Zuk and M. S. T. Carpendale. Visualization of uncertainty and reasoning. In Smart Graphics, 7th International Symposium, SG 2007, Kyoto, Japan, June 25-27, 2007, Proceedings, pages 164-177, 2007.