Using visualizations to monitor changes and harvest insights from a global-scale logging infrastructure at Twitter

2014 IEEE Conference on Visual Analytics Science and Technology, VAST 2014 - Proceedings

Volumn , Issue , 2015, Pages 113-122

  Wongsuphasawat, Krist ^a   Lin, Jimmy ^a  

^a TWITTER INC   (United States)

Author keywords

Funnel Analysis; Information Visualization; Log Analysis; Log Visualization; Session Analysis; Visual Analytics

Indexed keywords

DATA VISUALIZATION; GRAPHICAL USER INTERFACES; INFORMATION ANALYSIS; INFORMATION SYSTEMS; SOCIAL NETWORKING (ONLINE); WELL LOGGING;

FUNNEL ANALYSIS; INFORMATION VISUALIZATION; LOG ANALYSIS; SESSION ANALYSIS; VISUAL ANALYTICS;

VISUALIZATION;

EID: 84929454534     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/VAST.2014.7042487     Document Type: Conference Paper

References (45)

1. R. Agrawal and R. Srikant. Mining sequential patterns. In International Conference on Data Engineering (ICDE), pages 3-14, 1995.
2. R. Bade, S. Schlechtweg, and S. Miksch. Connecting time-oriented data and information to a coherent interactive visualization. In ACMCHI Conference on Human Factors in Computing Systems, pages 105-112, 2004.
3. M. Bostock, V. Ogievetsky, and J. Heer. D3: Data-Driven Documents. IEEE Transactions on Visualization and Computer Graphics, 17(12):2301-2309, 2011.
4. M. Burch, F. Beck, and S. Diehl. Timeline trees: Visualizing sequences of transactions in information hierarchies. In Working Conference on Advanced Visual Interfaces (AVI), pages 75-82, 2008.
5. I. Cadez, D. Heckerman, C. Meek, P. Smyth, and S. White. Visualization of navigation patterns on a web site using model-based clustering. In ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), pages 280-284, 2000.
6. E. H. Chi. Improving web usability through visualization. IEEE Internet Computing, 6(2):64-71, 2002.
7. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In USENIX Symposium on Operating Systems Design and Implementation (OSDI), 2004.
8. J. Fails, A. Karlson, L. Shahamat, and B. Shneiderman. A visual interface for multivariate temporal data: Finding patterns of events across multiple histories. In IEEE Symposium on Visual Analytics Science and Technology (VAST), pages 167-174, 2006.
9. J.-D. Fekete. The InfoVis Toolkit. In IEEE Symposium on Information Visualization (InfoVis), pages 167-174, 2004.
10. M. Ghoniem, G. Shurkhovetskyy, A. Bahey, and B. Otjacques. VAFLE: Visual analytics of firewall log events. In Visualization and Data Analysis, 2013.
11. M. Gray, A. Badre, and M. Guzdial. Visualizing usability log data. In IEEE Symposium on Information Visualization (InfoVis), pages 93-98, 1996.
12. J. Guerra-Gomez, M. L. Pack, C. Plaisant, and B. Shneiderman. Visualizing change over time using dynamic hierarchies: TreeVersity2 and the StemView. IEEE Transactions on Visualization and Computer Graphics, 19(12):2566-2275, Dec. 2013.
13. B. L. Harrison, R. Owen, and R. M. Baecker. Timelines: An interactive system for the collection and visualization of temporal data. In Graphics Interface (GI), pages 141-148, 1994.
14. H. Hochheiser and B. Shneiderman. Using interactive visualizations of WWW log data to characterize access patterns and inform site design. Journal of the American Society for Information Science and Technology, 52(4):331-343, 2001.
15. J. I. Hong and J. A. Landay. WebQuilt: A framework for capturing and visualizing the web experience. In International Conference on World Wide Web (WWW), pages 717-724, 2001.
16. B. Johnson and B. Shneiderman. Tree-Maps: A space-filling approach to the visualization of hierarchical information structures. In IEEE Conference on Visualization (VIS), pages 284-291, 1991.
17. S. Kandel, J. Heer, C. Plaisant, J. Kennedy, F. van Ham, N. H. Riche, C. Weaver, B. Lee, D. Brodbeck, and P. Buono. Research directions in data wrangling: Visualizations and transformations for usable and credible data. Information Visualization, 10(4):271-288, Sept. 2011.
18. G. M. Karam. Visualization using timelines. In ACM SIGSOFT International Symposium on Software Testing and Analysis, pages 125-137, 1994.
19. D. A. Keim, F. Mansmann, J. Schneidewind, and H. Ziegler. Challenges in visual data analysis. In International Conference on Information Visualization (IV), pages 9-16, 2006.
20. J. B. Kruskal and J. M. Landwehr. Icicle plots: Better displays for hierarchical clustering. The American Statistician, 37(2):162-168, 1983.
21. H. Lam, D. Russell, D. Tang, and T. Munzner. Session viewer: Visual exploratory analysis of web session logs. In IEEE Symposium on Visual Analytics Science and Technology (VAST), pages 147-154, 2007.
22. J. Lamping and R. Rao. The Hyperbolic Browser: A focus+context technique for visualizing large hierarchies. Journal of Visual Languages &Computing, 7(1):33-55, Mar. 1996.
23. G. Lee, J. Lin, C. Liu, A. Lorek, and D. Ryaboy. The unified logging infrastructure for data analytics at Twitter. In International Conference on Very Large Data Bases (VLDB), pages 1771-1780, 2012.
24. T. Mah, H. Hoek, and Y. Li. Funnel report mining for the MSN network. In ACMSIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), pages 450-455, 2001.
25. M. Monroe, R. Lan, H. Lee, C. Plaisant, and B. Shneiderman. Temporal event sequence simplification. IEEE transactions on visualization and computer graphics, 19(12):2227-2236, Dec. 2013.
26. T. Munzner. H3: Laying out large directed graphs in 3D hyperbolic space. In Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium (VIZ), pages 2-10, 1997.
27. T. Munzner, F. Guimbretiere, S. Tasiran, L. Zhang, and Y. Zhou. TreeJuxtaposer: Scalable tree comparison using focus+context with guaranteed visibility. ACM Transactions on Graphics, 22(3):453-462, 2003.
28. D. Phan, A. Paepcke, and T. Winograd. Progressive multiples for communication-minded visualization. In Graphics Interface (GI), pages 225-232, 2007.
29. J. E. Pitkow and K. A. Bharat. Webviz: A tool for world wide web access log analysis. In International Conference on World Wide Web (WWW), 1994.
30. C. Plaisant, R. Mushlin, A. Snyder, J. Li, D. Heller, and B. Shneiderman. LifeLines: Using visualization to enhance navigation and analysis of patient records. In AMIA Annual Symposium, pages 76-80, 1998.
31. E. M. Reingold and J. S. Tilford. Tidier Drawings of Trees. IEEE Transactions on Software Engineering, SE-7(2):223-228, Mar. 1981.
32. G. G. Robertson, S. K. Card, and J. D. Mackinlay. Information visualization using 3D interactive animation. Communications of the ACM, 36(4):57-71, 1993.
33. Z. Shen, J. Wei, N. Sundaresan, and K.-L. Ma. Visual analysis of massive web session data. In IEEE Symposium on Large Data Analysis and Visualization (LDAV), pages 65-72, Oct. 2012.
34. J. Stasko and E. Zhang. Focus+context display and navigation techniques for enhancing radial, space-filling hierarchy visualizations. In IEEE Symposium on Information Visualization (InfoVis), pages 57-65, 2000.
35. T. Takada and H. Koike. Mielog: A highly interactive visual log browser using information visualization and statistical analysis. In USENIX Conference on System Administration (LISA), pages 133-144, 2002.
36. A. Thusoo, Z. Shao, S. Anthony, D. Borthakur, N. Jain, J. Sen Sarma, R. Murthy, and H. Liu. Data warehousing and analytics infrastructure at Facebook. International Conference on Management of Data (SIGMOD), pages 1013-1020, 2010.
37. Y. Tu and H.-W. Shen. Visualizing changes of hierarchical data using treemaps. IEEE Transactions on Visualization and Computer Graphics, 13(6):1286-1293, 2007.
38. K. Vrotsou, J. Johansson, and M. Cooper. ActiviTree: Interactive visual exploration of sequences in event-based data using graph similarity. IEEE Transactions on Visualization and Computer Graphics, 15(6):945-52, 2009.
39. T. D. Wang, C. Plaisant, A. J. Quinn, R. Stanchak, S. Murphy, and B. Shneiderman. Aligning temporal data by sentinel events: Discovering patterns in electronic health records. In ACM CHI Conference on Human Factors in Computing Systems, pages 457-466, 2008.
40. M. Wattenberg. Visualizing the stock market. In ACM CHI Conference on Human Factors in Computing Systems, pages 188-189, 1999.
41. J. Wei, Z. Shen, N. Sundaresan, and K.-L. Ma. Visual cluster exploration of web clickstream data. In IEEE Conference on Visual Analytics Science and Technology (VAST), pages 3-12, 2012.
42. C.Wetherell and A. Shannon. Tidy drawings of trees. IEEE Transactions on Software Engineering, SE-5(5):514-520, Sept. 1979.
43. K. Wongsuphasawat and D. Gotz. Exploring flow, factors, and outcomes of temporal event sequences with the outflow visualization. IEEE Transactions on Visualization and Computer Graphics, 18(12):2659-2668, Dec. 2012.
44. K. Wongsuphasawat, J. A. Guerra Gomez, C. Plaisant, T. D. Wang, M. Taieb-Maimon, and B. Shneiderman. LifeFlow: Visualizing an overview of event sequences. In ACMCHI Conference on Human Factors in Computing Systems, pages 1747-1756, 2011.
45. K. Wongsuphasawat, C. Plaisant, M. Taieb-Maimon, and B. Shneiderman. Querying event sequences by exact match or similarity search: Design and empirical evaluation. Interacting with computers, 24(2):55-68, Mar. 2012.