MotionFlow: Visual Abstraction and Aggregation of Sequential Patterns in Human Motion Tracking Data

IEEE Transactions on Visualization and Computer Graphics

Volumn 22, Issue 1, 2016, Pages 21-30

  Jang, Sujin ^a   Elmqvist, Niklas ^b   Ramani, Karthik ^a  

^a PURDUE UNIVERSITY   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Context; Data visualization; Layout; Pattern analysis; Three dimensional displays; Tracking; Visualization

Indexed keywords

CLUSTERING ALGORITHMS; FLOW VISUALIZATION; KNOWLEDGE MANAGEMENT; MOTION ANALYSIS; SURFACE DISCHARGES; TARGET TRACKING; THREE DIMENSIONAL COMPUTER GRAPHICS; TIME AND MOTION STUDY; VISUALIZATION;

CONTEXT; GESTURE-BASED INTERACTION; HUMAN MOTION TRACKING; LAYOUT; PARTITION-BASED CLUSTERING; PATTERN ANALYSIS; THREE-DIMENSIONAL DISPLAY; VISUAL ANALYTICS SYSTEMS;

DATA VISUALIZATION;

AUTOMATED PATTERN RECOGNITION; CLUSTER ANALYSIS; COMPUTER GRAPHICS; HUMAN; IMAGE PROCESSING; MOVEMENT (PHYSIOLOGY); PROCEDURES; VIDEORECORDING;

CLUSTER ANALYSIS; COMPUTER GRAPHICS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MOVEMENT; PATTERN RECOGNITION, AUTOMATED; VIDEO RECORDING;

EID: 84946606230     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2015.2468292     Document Type: Article

References (46)

1. Z. Ahmed, P. Yost, A. McGovern, and C. Weaver. Steerable clustering for visual analysis of ecosystems. In Proceedings of the EuroVis Workshop on Visual Analytics, 2011.
2. D. S. Alexiadis, P. Kelly, P. Daras, N. E. O'Connor, T. Boubekeur, and M. B. Moussa. Evaluating a dancer's performance using kinect-based skeleton tracking. In Proceedings of the ACM Conference on Multimedia, pages 659-662, 2011.
3. M.-F. Balcan and A. Blum. Clustering with interactive feedback. In Algorithmic Learning Theory, pages 316-328. Springer, 2008.
4. P. Berkhin. A survey of clustering data mining techniques. In Grouping multidimensional data, pages 25-71. Springer, 2006.
5. J. Bernard, N. Wilhelm, B. Kruger, T. May, T. Schreck, and J. Kohlhammer. MotionExplorer: Exploratory search in human motion capture data based on hierarchical aggregation. IEEE Transactions on Visualization and Computer Graphics, 19(12):2257-2266, 2013.
6. J. Blaas, C. P. Botha, E. Grundy, M. Jones, R. S. Laramee, and F. H. Post. Smooth graphs for visual exploration of higher-order state transitions. IEEE Transactions on Visualization and Computer Graphics, 15(6):969-976, 2009.
7. P. Blikstein. Unraveling students' interaction around a tangible interface using gesture recognition. In Educational Data Mining 2014, 2014.
8. T. L. Booth. Sequential machines and automata theory, volume 3. Wiley New York, 1967.
9. L. Bourdev and J. Malik. Poselets: Body part detectors trained using 3D human pose annotations. In Proceedings of the IEEE Conference on Computer Vision, pages 1365-1372, 2009.
10. M. Burch, F. Beck, and S. Diehl. Timeline trees: visualizing sequences of transactions in information hierarchies. In Proceedings of the ACM Conference on Advanced Visual Interfaces, pages 75-82, 2008.
11. W. Cui, S. Liu, L. Tan, C. Shi, Y. Song, Z. Gao, H. Qu, and X. Tong. TextFlow: Towards better understanding of evolving topics in text. IEEE Transactions on Visualization and Computer Graphics, 17(12):2412-2421, 2011.
12. I. Davidson, S. Ravi, and M. Ester. Efficient incremental constrained clustering. In Proceedings of the ACM Conference on Knowledge Discovery and Data Mining, pages 240-249, 2007.
13. E. Fredkin. Trie memory. Communications of the ACM, 3(9):490-499, 1960.
14. D. Gotz and H. Stavropoulos. DecisionFlow: Visual analytics for high-dimensional temporal event sequence data. IEEE Transactions on Visualization and Computer Graphics, 20(12):1783-1792, 2014.
15. D. Guo, D. Peuquet, and M. Gahegan. Opening the black box: interactive hierarchical clustering for multivariate spatial patterns. In Proceedings of the ACM Symposium on Advances in Geographic Information Systems, pages 131-136, 2002.
16. M. Harrower and C. A. Brewer. Colorbrewer. org: an online tool for selecting colour schemes for maps. The Cartographic Journal, 40(1):27-37, 2003.
17. M. S. Hossain, P. K. R. Ojili, C. Grimm, R. Muller, L. T. Watson, and N. Ramakrishnan. Scatter/gather clustering: Flexibly incorporating user feedback to steer clustering results. IEEE Transactions on Visualization and Computer Graphics, 18(12):2829-2838, 2012.
18. S. Jang, N. Elmqvist, and K. Ramani. GestureAnalyzer: visual analytics for pattern analysis of mid-air hand gestures. In Proceedings of the ACM Symposium on Spatial User Interaction, pages 30-39, 2014.
19. T. Kamada and S. Kawai. An algorithm for drawing general undirected graphs. Information Processing Letters, 31(1):7-15, 1989.
20. L. Kovar, M. Gleicher, and F. Pighin. Motion graphs. ACM Transactions on Graphics, 21(3):473-482, 2002.
21. G. Kurtenbach and E. A. Hulteen. Gestures in human-computer communication. The Art of Human-Computer Interface Design, pages 309-317, 1990.
22. S. Liu, Y. Wu, E. Wei, M. Liu, and Y. Liu. StoryFlow: Tracking the evolution of stories. IEEE Transactions on Visualization and Computer Graphics, 19(12):2436-2445, 2013.
23. M. Monroe, R. Lan, H. Lee, C. Plaisant, and B. Shneiderman. Temporal event sequence simplification. IEEE Transactions on Visualization and Computer Graphics, 19(12):2227-2236, 2013.
24. J. Pei, J. Han, B. Mortazavi-Asl, H. Pinto, Q. Chen, U. Dayal, and M.-C. Hsu. PrefixSpan: Mining sequential patterns efficiently by prefix-projected pattern growth. In Proceedings of the IEEE Conference on Data Engineering, pages 215-224, 2001.
25. C. A. Pickering, K. J. Burnham, and M. J. Richardson. A research study of hand gesture recognition technologies and applications for human vehicle interaction. In Proceedings of the IEEE Conference on Automotive Electronics, pages 1-15, 2007.
26. A. J. Pretorius and J. J. Van Wijk. Visual analysis of multivariate state transition graphs. IEEE Transactions on Visualization and Computer Graphics, 12(5):685-692, 2006.
27. M. Rasmussen and G. Karypis. gcluto: An interactive clustering, visualization, and analysis system. UMN-CS TR-04, 21, 2004.
28. P. Riehmann, M. Hanfler, and B. Froehlich. Interactive Sankey diagrams. In Proceedings of the IEEE Symposium on Information Visualization, pages 233-240, 2005.
29. J. Ruiz, Y. Li, and E. Lank. User-defined motion gestures for mobile interaction. In Proceedings of the ACM Conference on Human Factors in Computing Systems, pages 197-206, 2011.
30. T. Schultz and G. L. Kindlmann. Open-box spectral clustering: applications to medical image analysis. IEEE Transactions on Visualization and Computer Graphics, 19(12):2100-2108, 2013.
31. J. Seo and B. Shneiderman. Interactively exploring hierarchical clustering results [gene identification]. IEEE Computer, 35(7):80-86, 2002.
32. B. Shneiderman. Tree visualization with tree-maps: 2-D space-filling approach. ACM Transactions on Graphics, 11(1):92-99, 1992.
33. M. Tory and T. Möller. Evaluating visualizations: Do expert reviews work? IEEE Computer Graphics and Applications, 25(5):8-11, 2005.
34. H. Y. Tsang, M. Tory, and C. Swindells. eSeeTrack - visualizing sequential fixation patterns. IEEE Transactions on Visualization and Computer Graphics, 16(6):953-962, 2010.
35. J. R. Ullmann. An algorithm for subgraph isomorphism. Journal of the ACM, 23(1):31-42, 1976.
36. F. Van Ham, H. Van de Wetering, and J. J. van Wijk. Interactive visualization of state transition systems. IEEE Transactions on Visualization and Computer Graphics, 8(4):319-329, 2002.
37. Vinayak, S. Murugappan, H. Liu, and K. Ramani. Shape-It-Up: Hand gesture based creative expression of 3D shapes using intelligent generalized cylinders. Computer-Aided Design, 45(2):277-287, 2013.
38. K. Wagstaff, C. Cardie, S. Rogers, S. Schrödl, et al. Constrained k-means clustering with background knowledge. In Proceedings of the International Conference on Machine Learning, pages 577-584, 2001.
39. X. Wang and I. Davidson. Flexible constrained spectral clustering. In Proceedings of the ACM Conference on Knowledge Discovery and Data Mining, pages 563-572, 2010.
40. M. Wattenberg and F. B. Viégas. The Word Tree, an interactive visual concordance. IEEE Transactions on Visualization and Computer Graphics, 14(6):1221-1228, 2008.
41. A. Wexelblat. Research challenges in gesture: Open issues and unsolved problems. In Gesture and Sign Language in Human-Computer Interaction, volume 1371 of Lecture Notes in Computer Science, pages 1-11. Springer, 1998.
42. J. O. Wobbrock, H. H. Aung, B. Rothrock, and B. A. Myers. Maximizing the guessability of symbolic input. In Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, pages 1869-1872, 2005.
43. K. Wongsuphasawat and D. Gotz. Exploring flow, factors, and outcomes of temporal event sequences with the Outflow visualization. IEEE Transactions on Visualization and Computer Graphics, 18(12):2659-2668, 2012.
44. K. Wongsuphasawat, J. A. Guerra Gómez, C. Plaisant, T. D. Wang, M. Taieb-Maimon, and B. Shneiderman. LifeFlow: visualizing an overview of event sequences. In Proceedings of the ACM Conference on Human Factors in Computing Systems, pages 1747-1756, 2011.
45. Y. Wu, S. Liu, K. Yan, M. Liu, and F. Wu. OpinionFlow: Visual analysis of opinion diffusion on social media. IEEE Transactions on Visualization and Computer Graphics, 20(12):1763-1772, 2014.
46. H. Zhou and H. Hu. Human motion tracking for rehabilitation - a survey. Biomedical Signal Processing and Control, 3(1):1-18, 2008.