Visual parameter space analysis: A conceptual framework

IEEE Transactions on Visualization and Computer Graphics

Volumn 20, Issue 12, 2014, Pages 2161-2170

  Sedlmair, Michael ^a   Heinzl, Christoph ^b   Bruckner, Stefan ^c   Piringer, Harald ^d   Moller, Torsten ^a  

^a UNIVERSITY OF VIENNA   (Austria)

^b UNIVERSITY OF APPLIED SCIENCES UPPER AUSTRIA   (Austria)

^c UNIVERSITY OF BERGEN   (Norway)

^d VRVis ^*  (Norway)

Author keywords

input output model; literature analysis; Parameter space analysis; simulation; task characterization

Indexed keywords

CONCEPTUAL FRAMEWORKS; INPUT OUTPUT MODEL; LITERATURE ANALYSIS; PARAMETER SPACES; SIMULATION;

EID: 84910071161     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2014.2346321     Document Type: Article

References (77)

1. S. Afzal, R. Maciejewski, and D. Ebert. Visual analytics decision support environment for epidemic modeling and response evaluation. In IEEE Conf. on Visual Analytics in Science and Technology (VAST), pages 191-200, 2011.
2. R. A. Amar, J. Eagan, and J. T. Stasko. Low-level components of analytic activity in information visualization. In IEEE Symp. on Information Visualization (InfoVis), pages 111-117, 2005.
3. R. A. Amar and J. T. Stasko. Knowledge precepts for design and evaluation of information visualizations. IEEE Trans. on Visualization and Computer Graphics, 11(4):432-442, 2005.
4. A. Amirkhanov, C. Heinzl, M. Reiter, and E. Gröller. Visual optimality and stability analysis of 3DCT scanpositions. IEEE Trans. on Visualization and Computer Graphics, 16:1477-1487, 2010.
5. N. Andrienko and G. Andrienko. Exploratory analysis of spatial and temporal data. Springer Berlin, Germany, 2006.
6. L. Bavoil, S. Callahan, P. Crossno, J. Freire, C. Scheidegger, C. Silva, and H. Vo. VisTrails: Enabling interactive multiple-view visualizations. In IEEE Conf. on Visualization, pages 135-142, 2005.
7. M. Beaudouin-Lafon. Designing interaction, not interfaces. In Conf. on Advanced Visual Interfaces (AVI), pages 15-22. ACM, 2004.
8. B. B. Bederson and B. Shneiderman. The craft of information visualization: readings and reflections (Chapter 8). Morgan Kaufmann, 2003.
9. W. Berger, H. Piringer, P. Filzmoser, and E. Gröller. Uncertainty-aware exploration of continuous parameter spaces using multivariate prediction. Computer Graphics Forum, 30(3):911-920, 2011.
10. S. Bergner, M. Sedlmair, T. Möller, S. Nabi Abdolyousefi, and A. Saad. ParaGlide: Interactive parameter space partitioning for computer simulations. IEEE Trans. on Visualization and Computer Graphics, 19(9):1499-1512, 2013.
11. E. Bertini, A. Tatu, and D. Keim. Quality metrics in high-dimensional data visualization: An overview and systematization. IEEE Trans. on Visualization and Computer Graphics, 17(12):2203-2212, 2011.
12. J. Beyer, A. Al-Awami, N. Kasthuri, J. W. Lichtman, H. Pfister, and M. Hadwiger. ConnectomeExplorer: Query-guided visual analysis of large volumetric neuroscience data. IEEE Trans. on Visualization and Computer Graphics, 19(12):2868-2877, 2013.
13. C. M. Bishop. Pattern Recognition and Machine Learning. Springer-Verlag New York, Inc., 2006.
14. M. Booshehrian, T. Möller, R. M. Peterman, and T. Munzner. Vismon: Facilitating analysis of trade-offs, uncertainty, and sensitivity in fisheries management decision making. Computer Graphics Forum, 31(3):1235-1244, 2012.
15. S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, 2009.
16. R. Brecheisen, A. Vilanova, B. Platel, and B. ter Haar Romeny. Parameter sensitivity visualization for DTI fiber tracking. IEEE Trans. on Visualization and Computer Graphics, 15(6):1441-1448, 2009.
17. M. Brehmer and T. Munzner. A multi-level typology of abstract visualization tasks. IEEE Trans. on Visualization and Computer Graphics, 19(12):2376-2385, 2013.
18. S. Bruckner and T. Möller. Result-driven exploration of simulation parameter spaces for visual effects design. IEEE Trans. on Visualization and Computer Graphics, 16(6):1467-1475, 2010.
19. K. Charmaz. Constructing grounded theory. A practical guide through qualitative analysis. Sage Publications, Inc, 2006.
20. W. Cheney and W. Light. A Course in Approximation Theory. American Mathematical Society, 2009.
21. D. Coffey, C.-L. Lin, A. Erdman, and D. Keefe. Design by dragging: An interface for creative forward and inverse design with simulation ensembles. IEEE Trans. on Visualization and Computer Graphics, 19(12):2783-2791, 2013.
22. Committee on Mathematical Foundations of Verification, Validation, and Uncertainty Quantification; Board on Mathematical Sciences and Their Applications, Division on Engineering and Physical Sciences, National Research Council. Assessing the Reliability of Complex Models: Mathematical and Statistical Foundations of Verification, Validation, and Uncertainty Quantification. The National Academies Press, 2012.
23. J. Freire, D. Koop, E. Santos, and C. T. Silva. Provenance for computational tasks: A survey. Computing in Science and Engineering, 10(3):11-21, 2008.
24. D. Furniss, A. Blandford, and P. Curzon. Confessions from a grounded theory PhD: Experiences and lessons learnt. In ACM Trans. Computer-Human Interaction (ToCHI), pages 113-122, 2011.
25. M. Gleicher. Explainers: Expert explorations with crafted projections. IEEE Trans. on Visualization and Computer Graphics, 19(12):2042-2051, 2013.
26. Z. Guo, M. O. Ward, and E. A. Rundensteiner. Model space visualization for multivariate linear trend discovery. In IEEE Conf. on Visual Analytics in Science and Technology (VAST), pages 75-82, 2009.
27. Z. Guo, M. O. Ward, E. A. Rundensteiner, and C. Ruiz. Pointwise local pattern exploration for sensitivity analysis. In IEEE Conf. on Visual Analytics in Science and Technology (VAST), pages 131-140, 2011.
28. S. Ingram, T. Munzner, V. Irvine, M. Tory, S. Bergner, and T. Möller. Dimstiller: Workflows for dimensional analysis and reduction. In IEEE Conf. on Visual Analytics in Science and Technology (VAST), pages 3-10, 2010.
29. S. Ingram, T. Munzner, and M. Olano. Glimmer: Multilevel MDS on the GPU. IEEE Trans. on Visualization and Computer Graphics, 15(2):249-261, 2009.
30. P. Isenberg, N. Elmqvist, J. Scholtz, D. Cernea, K.-L. Ma, and H. Hagen. Collaborative visualization: Definition, challenges, and research agenda. Information Visualization, 10(4):310-326, 2011.
31. T. Isenberg, P. Isenberg, J. Chen, M. Sedlmair, and T. Möller. A systematic review on the practice of evaluating visualization. IEEE Trans. on Visualization and Computer Graphics, 19(12):2818-2827, 2013.
32. T. Jankun-Kelly and K.-L. Ma. Visualization exploration and encapsulation via a spreadsheet-like interface. IEEE Trans. on Visualization and Computer Graphics, 7(3):275-287, 2001.
33. T. Jankun-Kelly, K.-L. Ma, and M. Gertz. A model and framework for visualization exploration. IEEE Trans. on Visualization and Computer Graphics, 13(2):357-369, 2007.
34. S. Kandel, A. Paepcke, J. M. Hellerstein, and J. Heer. Enterprise data analysis and visualization: An interview study. IEEE Trans. on Visualization and Computer Graphics, 18(12):2917-2926, 2012.
35. Y.-A. Kang and J. T. Stasko. Examining the use of a visual analytics system for sensemaking tasks: Case studies with domain experts. IEEE Trans. on Visualization and Computer Graphics, 18(12):2869-2878, 2012.
36. P. R. Keller and M. M. Keller. Visual cues: practical data visualization (Appendix B). IEEE Computer Society Press, 1993.
37. Z. Konyha, K. Matkovic, D. Gracanin, M. Jelovic, and H. Hauser. Interactive visual analysis of families of function graphs. IEEE Trans. on Visualization and Computer Graphics, 12(6):1373-1385, 2006.
38. J. Kronander, J. Unger, T. Möller, and A. Ynnerman. Estimation and modeling of actual numerical errors in volume rendering. Computer Graphics Forum, 29(3):893-902, 2010.
39. H. Lam, E. Bertini, P. Isenberg, C. Plaisant, and S. Carpendale. Empirical studies in information visualization: Seven scenarios. IEEE Trans. on Visualization and Computer Graphics, 18(9):1520-1536, 2012.
40. B. Lee, C. Plaisant, C. S. Parr, J.-D. Fekete, and N. Henry. Task taxonomy for graph visualization. In Proc. BELIV, pages 1-5. ACM, 2006.
41. Z. Liu and J. T. Stasko. Mental models, visual reasoning and interaction in information visualization: A top-down perspective. IEEE Trans. on Visualization and Computer Graphics, 16(6):999-1008, 2010.
42. D. G. Lowe. Object recognition from local scale-invariant features. In IEEE Conf. on Computer Vision, volume 2, pages 1150-1157 vol.2, 1999.
43. M. Luboschik, S. Rybacki, F. Haack, and H.-J. Schulz. Supporting the integrated visual analysis of input parameters and simulation trajectories. Computers & Graphics, 39(0):37-47, 2014.
44. J. Marks, B. Andalman, P. A. Beardsley, W. Freeman, S. Gibson, J. Hod-gins, T. Kang, B. Mirtich, H. Pfister, W. Ruml, K. Ryall, J. Seims, and S. Shieber. Design Galleries: A general approach to setting parameters for computer graphics and animation. In Proc. SIGGRAPH, pages 389-400, 1997.
45. K. Matkovic, D. Gracanin, M. Jelovic, and H. Hauser. Interactive visual steering-rapid visual prototyping of a common rail injection system. IEEE Trans. on Visualization and Computer Graphics, 14(6):1699-1706, 2008.
46. K. Matkovic, D. Gracanin, B. Klarin, and H. Hauser. Interactive visual analysis of complex scientific data as families of data surfaces. IEEE Trans. on Visualization and Computer Graphics, 15(6):1351-1358, 2009.
47. M. Meyer, M. Sedlmair, P. S. Quinan, and T. Munzner. The nested blocks and guidelines model. Information Visualization, pages 1-16, 2013.
48. G. A. Miller. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological review, 63(2):81, 1956.
49. T. Mühlbacher and H. Piringer. A partition-based framework for building and validating regression models. IEEE Trans. on Visualization and Computer Graphics, 19(12):1962-1971, 2013.
50. J. D. Mulder, J. J. van Wijk, and R. van Liere. A survey of computational steering environments. Future generation computer systems, 15(1):119-129, 1999.
51. T. Munzner. A nested model for visualization design and validation. IEEE Trans. on Visualization and Computer Graphics, 15(6):921-928, 2009.
52. T. Munzner. Visualization Analysis and Design (Chapter 2). A K Peters Visualization Series. Taylor and Francis/CRC Press, 2014. to appear.
53. H. Niederreiter. Random number generation and quasi-Monte Carlo methods. Society for Industrial and Applied Mathematics, 1992.
54. T. Nocke, M. Flechsig, and U. Böhm. Visual exploration and evaluation of climate-related simulation data. In Winter Simulation Conf., pages 703-711, 2007.
55. H. Piringer, W. Berger, and J. Krasser. HyperMoVal: Interactive visual validation of regression models for real-time simulation. In Computer Graphics Forum, pages 983-992, 2010.
56. K. Potter, A. Wilson, P.-T. Bremer, D. Williams, C. Doutriaux, V. Pas-cucci, and C. Johnson. Ensemble-Vis: A framework for the statistical visualization of ensemble data. In IEEE Conf. on Data Mining Workshops, pages 233-240, 2009.
57. A. Pretorius, M.-A. Bray, A. Carpenter, and R. Ruddle. Visualization of parameter space for image analysis. IEEE Trans. on Visualization and Computer Graphics, 17(12):2402-2411, 2011.
58. R. E. Roth. An empirically-derived taxonomy of interaction primitives for interactive cartography and geovisualization. IEEE Trans. on Visualization and Computer Graphics, 19(12):2356-2365, 2013.
59. A. Saltelli, M. Ratto, T. Andres, F. Campolongo, J. Cariboni, D. Gatelli, M. Saisana, and S. Tarantola. Global Sensitivity Analysis: The Primer. John Wiley & Sons, Ltd, 2008.
60. T. J. Santner, B. J. Williams, and W. I. Notz. The Design and Analysis of Computer Experiments. Springer-Verlag, 2003.
61. H.-J. Schulz, T. Nocke, M. Heitzler, and H. Schumann. A design space of visualization tasks. IEEE Trans. on Visualization and Computer Graphics, 19(12):2366-2375, 2013.
62. M. Sedlmair, M. Brehmer, S. Ingram, and T. Munzner. Dimensionality reduction in the wild: Gaps and guidance. Technical Report TR-2012-03, Dept. of Computer Science, University of British Columbia, 2012.
63. M. Sedlmair, P. Isenberg, D. Baur, and A. Butz. Information visualization evaluation in large companies: Challenges, experiences and recommendations. Information Visualization, 10(3):248-266, 2011.
64. M. Sedlmair, M. Meyer, and T. Munzner. Design study methodology: Reflections from the trenches and the stacks. IEEE Trans. on Visualization and Computer Graphics, 18(12):2431-2440, 2012.
65. B. Shneiderman. The eyes have it: A task by data type taxonomy for information visualizations. In IEEE Symp. on Visual Languages, pages 336-343, 1996.
66. M. Sips, B. Neubert, J. P. Lewis, and P. Hanrahan. Selecting good views of high-dimensional data using class consistency. Computer Graphics Forum, 28(3):831-838, 2009.
67. R. Smith, R. Pawlicki, I. Kokai, J. Finger, and T. Vetter. Navigating in a shape space of registered models. IEEE Trans. on Visualization and Computer Graphics, 13(6):1552-1559, 2007.
68. B. Spence, L. Tweedie, H. Dawkes, and H. Su. Visualization for functional design. In IEEE Symp. on Information Visualization (InfoVis), pages 4-10, 1995.
69. T. Torsney-Weir, A. Saad, T. Möller, H.-C. Hege, B. Weber, and J.-M. Verbavatz. Tuner: Principled parameter finding for image segmentation algorithms using visual response surface exploration. IEEE Trans. on Visualization and Computer Graphics, 17(12):1892-1901, 2011.
70. M. Tory. User studies in visualization: A reflection on methods. In Handbook of Human Centric Visualization, pages 411-426. Springer, 2014.
71. M. Tory, S. Potts, and T. Möller. A parallel coordinates style interface for exploratory volume visualization. IEEE Trans. on Visualization and Computer Graphics, 11(1):71-80, 2005.
72. M. Tory and S. Staub-French. Qualitative analysis of visualization: A building design field study. In Proc. BELIV, pages 7:1-7:8. ACM, 2008.
73. A. Unger, S. Schulte, V. Klemann, and D. Dransch. A visual analysis concept for the validation of geoscientific simulation models. IEEE Trans. on Visualization and Computer Graphics, 18(12):2216-2225, 2012.
74. A. Unger and H. Schumann. Visual support for the understanding of simulation processes. In IEEE Pacific Visualization Symp., pages 57-64, 2009.
75. J. J. van Wijk and R. van Liere. HyperSlice: Visualization of scalar functions of many variables. In IEEE Conf. on Visualization, pages 119-125, 1993.
76. J. Waser, R. Fuchs, H. Ribicic, B. Schindler, G. Blöschl, and E. Gröller. World lines. IEEE Trans. on Visualization and Computer Graphics, 16(6):1458-1467, 2010.
77. L. Wilkinson, A. Anand, and R. L. Grossman. Graph-theoretic scagnos-tics. In IEEE Symp. on Information Visualization (InfoVis), pages 157-164, 2005.