An audiovisual political speech analysis incorporating eye-tracking and perception data

Proceedings of the 8th International Conference on Language Resources and Evaluation, LREC 2012

Volumn , Issue , 2012, Pages 1114-1120

  Scherer, Stefan ^a   Layher, Georg ^b   Kane, John ^c   Neumann, Heiko ^b   Campbell, Nick ^c  

^a University of Southern California   (United States)

^b UNIVERSITY OF ULM   (Germany)

^c TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

Audiovisual; Eye tracking; Political speeches; Speaking style; Speech analysis; Statistical measurement

Indexed keywords

BEHAVIORAL RESEARCH; SPEECH ANALYSIS; SPEECH RECOGNITION;

AUDIO-VISUAL FEATURES; AUDIOVISUAL; EYE-TRACKING; EYE-TRACKING ANALYSIS; FOCUS OF ATTENTION; MULTIMODAL FEATURE ANALYSIS; SALIENCY REGIONS; SPEAKING STYLES;

QUALITY CONTROL;

EID: 84919326940     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. L. Albright, D. A. Kenny, and T. E. Malloy. 1988. Consensus in personality judgements at zero acquaintance. J. of Personality and Social Psychology, 55 (3):387-395.
2. P. Alku, T. Bäckström, and E. Vilkman. 2002. Normalized amplitude quotient for parameterization of the glottal flow. Journal of the Acoustical Society of America, 112 (2):701-710.
3. M. Argyle. 1975. Bodily Communication. Londoin, Routledge.
4. A. Bobick and J. W. Davis. 2001. The recognition of human movement using temporal templates. IEEE Trans. on Pattern Analysis and Machine Intelligence, 23:257-267.
5. T. Brox, A. Bruhn, N. Papenberg, and J. Weickert. 2004. High Accuracy Optical Flow Estimation Based on a Theory for Warping. In Tomás Pajdla, Jiri Matas, Tomás Pajdla, and Jiri Matas, editors, ECCV (4), volume 3024 of Lecture Notes in Computer Science, pages 25-36. Springer.
6. T. J. Clarke, M. F. Bradshaw, D. T. Field, S. E. Hampson, and D. Rose. 2005. The perception of emotion from body movement in point-light displays of interperonal dialogue. Perception, 34:1171-1180.
7. C. Gallois and V. J. Callan. 1988. Communication accomodation and the prototypical speaker: predicting evaluations of status and solidarity. Language & Communication, 8 (3/4):271-283.
8. K. Grammer, B. Fink, and L. Renninger. 2002. Dynamic systems and inferential information processing in human communication. Neuroendocrinology Letters, 23 (suppl. 4):15-22.
9. J. Kane and C. Gobl. 2011. Identifying regions of nonmodal phonation using features of the wavelet transform. In Proceedings of Interspeech 2011, pages 177-180. ISCA.
10. M. Koppenheimer and K. Grammer. 2010. Motion patterns in political speech and their influence on personality ratings. J. of Res. in Personality, 44:374-379.
11. A. Rosenberg and J. Hirschberg. 2005. Acoustic/prosodic and lexical correlates of charismatic speech. In Proceedings of Interspeech 2005, pages 513-516. ISCA.
12. C. A. Rothkopf, D. H. Ballard, and M. M. Hayhoe. 2007. Task and context determine where you look. J. of Vision, 7 (14):16:1-20.
13. D. R. Saunders, D. K. Williamson, and N. F. Troje. 2010. Gaze patterns during perception of direction and gender from biological motion. J. of Vision, 10 (11):9:1-10.
14. S. G. Shanker and B. J. King. 2002. The emergence of a new paradigm in ape language research. Behav. And Brain Sciences, 25:605-656.
15. E. Strangert and J. Gustafson. 2008. What makes a good speaker? subject ratings, acoustic measurements and perceptual evaluations. In Proceedings of Interspeech 2008, pages 1688-1691. ISCA.
16. E. Vig, M. Dorr, T. Martinetz, and E. Barth. 2012. Intrinsic dimensionality predicts the saliency of natural dynamic scenes. IEEE Trans. on Pattern Analysis and Machine Intelligence, (in press).
17. P. Viola and M. J. Jones. 2004. Robust real-time face detection. International journal of computer vision, 57 (2):137-154.