Hand motion gesture frequency properties and multimodal discourse analysis

International Journal of Computer Vision

Volumn 69, Issue 3, 2006, Pages 353-371

  Xiong, Yingen ^a   Quek, Francis ^a  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

Author keywords

Frequency ridges; Gesticulatory oscillation; Hand gesture; Hand motion; Multimodal discourse analysis; Speech analysis

Indexed keywords

BANDPASS FILTERS; DATA ACQUISITION; FOURIER TRANSFORMS; IMAGE PROCESSING; OSCILLATIONS; WAVELET TRANSFORMS;

FREQUENCY RIDGES; GESTICULATORY OSCILLATION; HAND GESTURE; MULTIMODAL DISCOURSE ANALYSIS;

GESTURE RECOGNITION;

EID: 33744926915     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-006-8112-5     Document Type: Article

References (35)

1. McNeill, D. 2000. Growth points, catchments, and contexts. Cognitive Studies: Bulletin of the Japanese Cognitive Science Society, vol. 7, no. 1.
2. Quek, F., McNeill, D., Ansari, R., Ma, X., Bryll, R., Duncan, S., and McCullough, K.-E. 2002. Multimodal human discourse: Gesture and speech. ACM Transaction on Computer-Human Interaction (TOCHI), 9:171-193.
3. Quek, F. 2003. The catchment feature model for multimodal language analysis. In ICCV, (Nice, France), 13-16.
4. McNeill, D. 2000. Catchments and context: Non-modular factors in speech and gesture. In Language and Gesture (D. McNeill, ed.), ch. 15, 312-328, Cambridge: Cambridge U. Press.
5. McNeill, D., Quek, F., McCullough, K.-E., Duncan, S., Furuyama, N., Bryll, R., and Ansari, R. 2001. Catchments, prosody and discourse. In Oralité et Gestualité, ORAGE (Speech and Gesture 2001) (C. Cavé, I. Guaïtella, and S. Santi, eds.), (Aix-en-Provence, France), 474-481.
6. Seitz, S., and Dyer, C. 1997. View-invariant analysis of cyclic motion. International Journal of Computer Vision, 25(3):231-251.
7. Tsai, P.-S., Keiter, K., Kasparis, T., and Shah, M. 1994. Cyclic motion detection. Pattern Recognition, 27(12):1591-1603.
8. Liu, C. and Wechsler, H. 1998. Probabilistic reasoning models for face recognition. In Proc. of the IEEE Conf. on CVPR, (Santa Barbara, CA), 827-832, IEEE Comp. Soc.
9. Polana, R. and Nelson, R.C. 1997. Detection and recognition of periodic, non-rigid motion. International Journal of Computer Vision, 23:261-282.
10. Niyogi, S. and Adelson, E. 1994. Analyzing gait with spatiotemporal surfaces. In the 1994 IEEE Workshop on Motion of Non-Rigid and Articulated Objects, 64-69.
11. Fujiyoshi, H. and Lipton, A. 1998. Real-time human motion analysis by image skeletonization. In IEEE Workshop on Applications of Computer Vision.
12. Heisele, B. and Woehler, C. 1998. Motion-based recognition of pedestrians. In Proc. Int. Conf. Pattern Rec., 2, (Brisbane, AU), IEEE Comp. Soc.
13. Niyogi, S. and Adelson, E. 1994. Analyzing and recognizing walking figures in xyt," in 1994 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '94), 469-474.
14. Cohen, C.J., Conway, L., Koditschek, D., and Roston, G.P. 1997. Dynamic system representation of basic and non-linear- in-parameters oscillatory motion gestures. In 1997 IEEE International Conference on Systems, Man, and Cybernetics, vol. 5, (Orlando, FL), 4513-4518.
15. Davis, J., Bobick, A., and Richards, W. 2000. Categorical representation and recognition of oscillatory motion patterns. In Proc. of the IEEE Conf. on CVPR, vol. 1, (Hilton Head Is., SC), 628-635, IEEE Comp. Soc.
16. Cutler, R. and Davis, L. 2000. Robust real-time periodic motion detection, analysis, and applications. PAMI, 22:781-796.
17. Plotnik, A. and Rock, S. 2002. Quantification of cyclic motion of marine animals from computer vision. In IEEE OCEANS Conference, 1575-1581.
18. Quek, F. K. H. and Bryll, R.K. 1998. Vector coherence mapping: A parallelizable approach to image flow computation, in ACCV, vol. II, (Hong Kong, China), 591-598.
19. Quek, F., Ma, X., and Bryll, R. 1999. A parallel algorithm for dynamic gesture tracking. In ICCV'99 Wksp on RATFG-RTS., (Corfu, Greece), 119-126.
20. Bryll, R. 2003. A robust agent-based gesture tracking system. PhD thesis, Wright State University, CSE Dept.
21. Quek, F. 1994. Toward a vision-based hand gesture interface In Virtual Reality Software and Technology Conference, (Singapore), 17-29.
22. Quek, F. 1996. Unencumbered gestural interaction. IEEE Multimedia, 4(3):36-47.
23. Tsai, R. 1987. A versatile camera calibration technique for high accuracy 3d machine vision metrology using off-the-shelf TV cameras and lenses. IEEE Journal of Robotics and Automation, RA-3(4):323-344.
24. McCullough, K.-E. 1992. Visual imagery in language and gesture. In Annual Meeting of the Belgian Linguistic Society, (Brussels, Belgium).
25. McNeill, D. 1992. Hand and Mind: What Gestures Reveal about thought. Chicago: U. Chicago Press.
26. Pedelty, L. 1987. Gesture in Aphasia. PhD thesis, Department of Psychology, The University of Chicago.
27. Gabor, D. 1946. Theory of communication. Journal of the Institution of Electrical Engineers, 93:429-441.
28. Rao, R. and Bopardikar, A. 1998. Wavelet Transforms: Introduction to Theory and Applications. Addison-Wesley.
29. Goupillaud, P., Grossmann, A., and Morlet, J. 1984-1985. Cycleoctave and related transforms in seismic signal analysis. Geoexploration, 23:85-102.
30. Hall, P., Qian, W., and Titterington, D.M. 1992. Ridge finding from noisy data. Journal of Computational and Graphical Statistics, 1(1):197-211.
31. Carmona, R., Hwang, W., and Torresani, B. 1999. Multiridge detection and time-frequency reconstruction. IEEE Transactions on Signal Processing, 47:480-492.
32. Cascia, M.L., Scaroff, S., and Athitsos, V. 2000. Fast, reliable head tracking under varying illumination: An approach based on registration of texure-mapped 3d models. PAMI, 22:322-336.
33. Boersma, P. and Weenik, D. 1996. Praat, a system for doing phonetics by computer. Tech. Rep. Report 132, Institute of Phonetic Sciences of the University of Amsterdam, version 3.4., http://www.fon.hum.uva.nl/praat/.
34. Nakatani, C., Grosz, B., Ahn, D., and Hirschberg, J. 1995. Instructions for annotating discourses Tech. Rep. TR-21-95, Ctr for Res. in Comp. Tech., Harvard U., MA.
35. Mallat, S. 1998. A wavelet tour of signal processing. San Diego, Academic Press.