The catchment feature model for multimodal language analysis

Proceedings of the IEEE International Conference on Computer Vision

Volumn 1, Issue , 2003, Pages 540-547

  Quek, Francis ^a  

^a WRIGHT STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; IMAGE PROCESSING; IMAGE SEGMENTATION; ROBOTICS; SPEECH PROCESSING; USER INTERFACES;

CATCHMENT FEATURE MODEL; MULTIMODAL LANGUAGE ANALYSIS;

INFORMATION ANALYSIS;

EID: 0345414064     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/iccv.2003.1238394     Document Type: Conference Paper

References (20)

1. R. Bryll and F. Quek. Accurate tracking by vector coherence mapping and vector-centroid fusion. In Review, IJCV, pages 155-160, 2002. Also as Wright State U., VISLab Report: VISLab-02-09.
2. R. Bryll, F. Quek, and A. Esposito. Automatic hold detection in natural conversation. In IEEE Wksp Cues in Comm., Kauai, Hawaii, Dec. 9 2001.
3. J. Cole. Pride and a Daily Marathon. MIT Press, 1995.
4. G. Fauconnier. Mental Spaces: Aspects of Meaning Construction in Natural Language. MIT Press, Cambridge, MA, 1985.
5. A. Kendon. Gesticulation and speech: Two aspects of the process of utterance. In M. Key, editor, Relationship Between Verbal and Nonverbal Communication, pages 207-227. Mouton, The Hague, 1980.
6. D. McNeill. Hand and Mind: What Gestures Reveal About Thought. U. Chicago Press, Chicago, 1992.
7. D. McNeill. Catchments and context: Non-modular factors in speech and gesture. In D. McNeill, editor, Language and Gesture, chapter 15, pages 312-328. Cambridge U. Press, Cambridge, 2000.
8. D. McNeill. Gesture and language dialectic. Acta Linguistica Hafniensia, 34:7-37, 2002.
9. C. Nakatani, B. Grosz, D. Ahn, and J. Hirschberg. Instructions for annotating discourses. Technical Report TR-21-95, Ctr for Res. in Comp. Tech., Harvard, U., MA, 1995.
10. V. Pavlović, R. Sharma, and T. Huang. Visual interpretation of hand gestures for human-computer interaction: A review. PAMI, 19(7):677-695, July 1997.
11. F. Quek. The catchment feature model: A device for multimodal fusion and a bridge between signal and sense. In Review, EURASIP JASP, 2002. Also as VISLab Report: VISLab-02-14.
12. F. Quek, R. Bryll, H. Arslan, C. Kirbas, and D. McNeill. A multimedia database system for temporally situated perceptual psycholinguistic analysis. Multimedia Tools & Apps., 18(2):91-113, 2002.
13. F. Quek, McNeill, R. D., Bryll, C. Kirbas, H. Arslan, K.-E. McCullough, N. Furuyama, and R. Ansari. Gesture, speech, and gaze cues for discourse segmentation. In Proc. of the IEEE Conf. on CVPR, volume 2, pages 247-254, Hilton Head Island, South Carolina, June 13-15 2000.
14. F. Quek, D. McNeill, R. Ansari, X. Ma, R. Bryll, S. Duncan, and K.-E. McCullough. Gesture cues for conversational interaction in monocular video. In ICCV'99 Wksp on RATFGRTS., pages 64-69, Corfu, Greece, Sept. 26-27 1999.
15. F. Quek, D. McNeill, R. Ansari, X. Ma, R. Bryll, S. Duncan, and K.-E. McCullough. Multimodal human discourse: Gesture and speech. In Press, ToCHI, 2002. VISLab, Wright State U., Tech. Report VISLab-01-01, http://vislab.cs.wright.edu/Publications/Queetal01.html.
16. F. Quek, D. McNeill, R. Bryll, and M. Harper. Gestural spatialization in natural discourse segmentation. In 7th Int Conf on Spoken Language Proc., pages 189-192, Denver, CO, Sept. 16-20 2002.
17. F. K. H. Quek and R. K. Bryll. Vector coherence mapping: A parallelizable approach to image flow computation. In ACCV, volume II, pages 591-598, Hong Kong, China, 8 - 10 Jan. 1998.
18. I. van Gijn, S. Kita, and H. van der Hulst. How phonological is the symmetry condition in sign language. In Proc. 4th HILP, Leiden, Jan. 28-30 1999.
19. A. Wexelblat. Research challenges in gesture: Open issues and unsolved problems. In I. Wachsmuth and M. Frohlich, editors, Proc. Int'l Gest. Wksp: Gest. & Sign Lang. in HCI, pages 1-11, Bielefeld, Germany, Sept. 17-19 1997. Springer.
20. Y. Xiong, F. Quek, and D. McNeill. Hand gesture symmetric behavior detection in natural conversation. In IEEE Int Conf on Multimodal Interaction, pages 179-184, Pittsburg, PA, 2002.