Opening the black box: Strategies for increased user involvement in existing algorithm implementations

IEEE Transactions on Visualization and Computer Graphics

Volumn 20, Issue 12, 2014, Pages 1643-1652

  Muhlbacher, Thomas ^a   Piringer, Harald ^a   Gratzl, Samuel ^b   Sedlmair, Michael ^c   Streit, Marc ^b  

^a VRVIS RESEARCH CENTER   (Austria)

^b JOHANNES KEPLER UNIVERSITY LINZ   (Austria)

^c UNIVERSITY OF VIENNA   (Austria)

Author keywords

integration; interactive algorithms, user involvement; problem subdivision; Visual analytics infrastructures

Indexed keywords

ALGORITHM IMPLEMENTATION; BLACK BOXES; PROBLEM SUBDIVISION; USER INVOLVEMENT; VISUAL ANALYTICS;

INTEGRATION;

ALGORITHM; COMPUTER GRAPHICS; COMPUTER INTERFACE; COMPUTER PROGRAM; HUMAN;

ALGORITHMS; COMPUTER GRAPHICS; HUMANS; SOFTWARE; USER-COMPUTER INTERFACE;

EID: 84910028061     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2014.2346578     Document Type: Article

References (52)

1. M. Angelini and G. Santucci. Modeling Incremental Visualizations. In Proc. of the EuroVis Workshop on Visual Analytics (EuroVA '13), pages 13-17. Eurographics Association, 2013.
2. S. Arya, D. M. Mount, N. S. Netanyahu, R. Silverman, and A. Y. Wu. An Optimal Algorithm for Approximate Nearest Neighbor Searching Fixed Dimensions. Journal of the ACM, 45(6):891-923, 1998.
3. E. Bertini and D. Lalanne. Investigating and Reflecting on the Integration of Automatic Data Analysis and Visualization in Knowledge Discovery. ACM SIGKDD Explorations Newsletter, 11(2):9-18, 2010.
4. E. Bertini and G. Santucci. Give Chance a Chance: Modeling Density to Enhance Scatter Plot Quality Through Random Data Sampling. Information Visualization, 5(2):95-110, 2006.
5. E. Bertini, A. Tatu, and D. Keim. Quality Metrics in High-Dimensional Data Visualization: An Overview and Systematization. IEEE Trans. on Visualization and Computer Graphics, 17(12):2203-2212, 2011.
6. G. Brassard and P. Bratley. Fundamentals of Algorithmics. Prentice-Hall, 1996.
7. E. Brown, J. Liu, C. Brodley, and R. Chang. Dis-Function: Learning Distance Functions Interactively. In Proc. of the IEEE Conference on Visual Analytics in Science and Technology, pages 83-92. IEEE, 2012.
8. S. Callahan, L. Bavoil, V. Pascucci, and C. Silva. Progressive Volume Rendering of Large Unstructured Grids. IEEE Trans. on Visualization and Computer Graphics, 12(5):1307-1314, 2006.
9. S. K. Card, G. G. Robertson, and J. D. Mackinlay. The Information Vi-sualizer, an Information Workspace. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems, page 181-186. ACM, 1991.
10. J. Choo, C. Lee, C. Reddy, and H. Park. UTOPIAN: User-Driven Topic Modeling Based on Interactive Nonnegative Matrix Factorization. IEEE Trans. on Visualization and Computer Graphics, 19(12):1992-2001, 2013.
11. R. Crouser and R. Chang. An Affordance-Based Framework for Human Computation and Human-Computer Collaboration. IEEE Trans. on Visualization and Computer Graphics, 18(12):2859-2868, Dec. 2012.
12. J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. Communications of the ACM, 51(1):107-113, 2004.
13. A. Dix and G. Ellis. by chance: enhancing interaction with large data sets through statistical sampling. In Proc. of the Conference on Advanced Visual Interfaces (AVI '02), page 167-176. ACM, 2002.
14. A. Endert, C. Han, D. Maiti, L. House, S. Leman, and C. North. Observation-Level Interaction with Statistical Models for Visual Analytics. In Proc. of the IEEE Conference on Visual Analytics in Science and Technology (VAST '11), pages 121-130. IEEE, Oct. 2011.
15. J.-D. Fekete. Visual Analytics Infrastructures: From Data Management to Exploration. Computer, 46(7):22-29, 2013.
16. D. Fisher. Incremental, Approximate Database Queries and Uncertainty for Exploratory Visualization. In Proc. of the IEEE Symp. on Large Data Analysis and Visualization (LDAV '11), pages 73-80. IEEE, 2011.
17. D. Fisher, I. Popov, S. Drucker, and mc schraefel. Trust Me, I'm Partially Right: Incremental Visualization Lets Analysts Explore Large Datasets Faster. In Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), page 1673-1682. ACM, 2012.
18. E. Gamma, R. Helm, R. Johnson, and J. Vlissides. Design Patterns: Elements of Reusable Object-oriented Software. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 1995.
19. M. Gleicher, D. Albers, R. Walker, I. Jusufi, C. D. Hansen, and J. C. Roberts. Visual Comparison for Information Visualization. Information Visualization, 10(4):289-309, 2011.
20. H. Griethe and H. Schumann. The Visualization of Uncertain Data: Methods and Problems. In Proc. of Conference Simulation and Visualization (SimVis '06), page 143-156, 2006.
21. S. Guha, R. Hafen, J. Rounds, J. Xia, J. Li, B. Xi, and W. S. Cleveland. Large Complex Data: Divide and Recombine (D&R) with RHIPE. Stat, 1(1):53-67, 2012.
22. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning, volume 1. Springer, 2nd edition, 2009.
23. J. M. Hellerstein, R. Avnur, A. Chou, C. Hidber, C. Olston, V. Raman, T. Roth, and P. J. Haas. Interactive Data Analysis: The CONTROL Project. Computer, 32(8):51-59, 1999.
24. J. Kehrer, R. N. Boubela, P. Filzmoser, and H. Piringer. A Generic Model for the Integration of Interactive Visualization and Statistical Computing using R. In Poster Proc. of the IEEE Conference on Visual Analytics Science and Technology (VAST '12), page 233-234. IEEE, 2012.
25. D. A. Keim, J. Kohlhammer, G. Ellis, and F. Mansmann, editors. Mastering The Information Age-Solving Problems with Visual Analytics. Eurographics, 2010.
26. D. A. Keim, F. Mansmann, J. Schneidewind, J. Thomas, and H. Ziegler. Visual Analytics: Scope and Challenges. In Visual Data Mining, number 4404 in Lecture Notes in Comp. Science, pages 76-90. Springer, 2008.
27. D. A. Keim, F. Mansmann, and J. Thomas. Visual Analytics: How Much Visualization and How Much Analytics. SigKDD Explorations, 2009.
28. Z. Liu, B. Jiang, and J. Heer. imMens: Real-Time Visual Querying of Big Data. Computer Graphics Forum, 32(3pt4):421-430, 2013.
29. M. J. McGuffin and I. Jurisica. Interaction Techniques for Selecting and Manipulating Subgraphs in Network Visualizations. IEEE Trans. on Visualization and Computer Graphics, 15(6):937-944, 2009.
30. T. Mühlbacher and H. Piringer. A Partition-Based Framework for Building and Validating Regression Models. IEEE Trans. on Visualization and Computer Graphics (VAST '13), 19(12):1962-1971, 2013.
31. E. J. Nam, Y. Han, K. Mueller, A. Zelenyuk, and D. Imre. ClusterSculp-tor: A Visual Analytics Tool for High-Dimensional Data. In Proc. of the IEEE Symp. on Visual Analytics in Science and Technology (VAST '07), pages 75-82, Oct. 2007.
32. J. Nielsen. Usability Engineering. Morgan Kaufmann, 1993.
33. F. Olken and D. Rotem. Random Sampling from Database Files: A Survey. In Statistical and Scientific Database Management, number 420 in Lecture Notes in Comp. Science, pages 92-111. Springer, 1990.
34. C. Olston and J. D. Mackinlay. Visualizing Data with Bounded Uncertainty. In Proc. of the IEEE Symp. on Information Visualization (Info-Vis'02), page 37-. IEEE, 2002.
35. H. Piringer, W. Berger, and J. Krasser. HyperMoVal: Interactive Visual Validation of Regression Models for Real-Time Simulation. Computer Graphics Forum (EuroVis '10), 29(3):983-992, 2010.
36. H. Piringer, C. Tominski, P. Muigg, and W. Berger. A Multi-Threading Architecture to Support Interactive Visual Exploration. IEEE Trans. on Visualization and Computer Graphics, 15(6):1113-1120, 2009.
37. J. Platt. Sequential Minimal Optimization: A Fast Algorithm for Training Support Vector Machines. Advances in Kernel Methods-Support Vector Learning, 1998.
38. O. Rübel, S. V. E. Keränen, M. Biggin, D. W. Knowles, G. H. Weber, H. Hagen, B. Hamann, and E. W. Bethel. Linking Advanced Visualization and MATLAB for the Analysis of 3D Gene Expression Data. In Visualization in Medicine and Life Sciences II, Mathematics and Visualization, pages 265-283. Springer, 2012.
39. S. Roweis. EM Algorithms for PCA and SPCA. In Proc. of the Conference on Advances in Neural Information Processing Systems, page 626-632. MIT Press, 1998.
40. T. Schreck, J. Bernard, T. Tekusova, and J. Kohlhammer. Visual Cluster Analysis of Trajectory Data with Interactive Kohonen Maps. In Proc. of the IEEE Symp. on Visual Analytics in Science and Technology (VAST '08), pages 3-10. IEEE, 2008.
41. M. Sedlmair, C. Heinzl, S. Bruckner, H. Piringer, and T. Möller. Visual Parameter Space Analysis: A Conceptual Framework. IEEE Trans. on Visualization and Computer Graphics (cond. accepted for InfoVis), 2014.
42. B. Shneiderman. Dynamic Queries for Visual Information Seeking. IEEE Software, 11(6):70-77, 1994.
43. M. Streit and O. Bimber. Visual Analytics: Seeking the Unknown. Computer, 46(7):20-21, 2013. Guest Editors' Introduction.
44. D. Temple Lang and D. F. Swayne. GGobi Meets R: An Extensible Environment for Interactive Dynamic Data Visualization. In Proc. of the 2nd International Workshop on Distributed Statistical Computing, 2001.
45. J. J. Thomas and K. A. Cook. Illuminating the Path: The Research and Development Agenda for Visual Analytics. IEEE, 2005.
46. C. Turkay, F. Jeanquartier, A. Holzinger, and H. Hauser. On Computationally-Enhanced Visual Analysis of Heterogeneous Data and its Application in Biomedical Informatics. In A. Holzinger and I. Jurisica, editors, Interactive Knowledge Discovery and Data Mining in Biomedical Informatics, number 8401 in Lecture Notes in Computer Science, pages 117-140. Springer Berlin Heidelberg, Jan. 2014.
47. S. Urbanek. No Need to Talk to Strangers-Cooperation of Interactive Software with R as Moderator. In Proc. of the Symp. of the Interface of Computing Science and Statistics, 2002.
48. S. van den Elzen and J. van Wijk. BaobabView: Interactive Construction and Analysis of Decision Trees. In Proc. of the IEEE Symp. on Visual Analytics Science and Technology (VAST '11), pages 151-160. IEEE, 2011.
49. V. V. Vazirani. Approximation Algorithms. Springer, 2001.
50. M. Williams and T. Munzner. Steerable, Progressive Multidimensional Scaling. In IEEE Symp. on Information Visualization, 2004. INFOVIS 2004, pages 57-64, 2004.
51. P. C. Wong, H. Foote, D. Adams, W. Cowley, and J. Thomas. Dynamic Visualization of Transient Data Streams. In Proc. of the IEEE Symp. on Information Visualization (InfoVis '03), pages 97-104. IEEE, 2003.
52. J. S. Yi, Y. a. Kang, J. Stasko, and J. Jacko. Toward a Deeper Understanding of the Role of Interaction in Information Visualization. IEEE Trans. on Visualization and Computer Graphics (InfoVis '07), 13(6):1224-1231, 2007.