An audio-visual approach to measuring discourse synchrony in multimodal conversation data

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2009, Pages 2159-2162

  Campbell, Nick ^a  

^a TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

Active listening; Conversation; Discourse interaction; Image and audio processing; Synchrony

Indexed keywords

AUDIO PROCESSING; AUDIO-VISUAL; AUTOMATIC EXTRACTION; MULTIMODAL CONVERSATION; SPEECH TECHNOLOGY;

FLUORINE CONTAINING POLYMERS; IMAGE PROCESSING;

SPEECH COMMUNICATION;

EID: 70450163547     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (20)

1. Chapple, Eliot, D., (1939) "Quantitative analysis of the interaction of individuals", pp.58-67 in Proceedings of the National Academy of Science U S A. February; 25(2).
2. Thomas, Dorothy A., Loomis, Alice M., and Arrington, Ruth, E., (1934) "Observaional studies of social behaviour", pp.194-195 in Annals of the American Academy of Political and Social Science, Vol. 172, No. 1.
3. Schegloff, Emanuel A. (2007) Sequence Organization in Interaction: A Primer in Conversation Analysis, Volume 1, Cambridge: Cambridge University Press.
4. Goffman, Erving (1961) Encounters. Indianapolis: Bobbs-Merrill.
5. Kendon, Adam, (1990) Conducting Interaction: Patterns of Behaviour in Focused Encounters. Cambridge: Cambridge University Press.
6. Kendon, Adam and Andrew Ferber (1973) "A description of some human greetings". In R. P. Michael and J. H. Crook (eds.) Comparative Ecology and the Behaviour of Primates. London: Academic Press. 591668.
7. Hutchby, Ian, (1999) "Frame attunement and footing in the organisation of talk radio openings", Journal of Sociolinguistics 3/1, pp.41-63.
8. Kendom, Adam (2008) personal communication to the author.
9. AMI: Augmented Multi-party Interaction (http://www.amiproject.org)
10. CHIL: Computers in the Human Interaction Loop (http://chil.server.de/)
11. Campbell, Nick (2007) "On the Use of Nonverbal Speech Sounds in Human Communication", pp.117-128 in Verbal and Nonverbal Communication Behaviors, LNAI Vol.4775,.
12. Campbell, Nick (2008) "Individual traits of speaking style and speech rhythm in a spoken discourse", pp.107-120 in Esposito, A., et al (Eds) Verbal and Nonverbal Features of HH and HM Interaction, Springer-Verlag, Berlin.
13. JST/CREST Expressive Speech Processing project, introductory web pages at: http://feast.his.atr.co.jp/
14. Campbell, Nick (2006) "A multimedia database of meetings and informal interactions for tracking participant involvement and discourse ow", in Proc LREC 2006, Lisbon.
15. Campbell, Nick (2008) "Multimodal Processing of Discourse Information; The Effect of Synchrony," ISUC, pp.12-15, 2008 Second International Symposium on Universal Communication, Osaka, Japan.
16. SSPNET: Social Signal Processing (http://www.sspnet.eu/)
17. Atwater, Eastwood (1981). I Hear You. Prentice-Hall. p. 83. ISBN 0-13-450684-7.
18. The MUMIN coding scheme for the annotation of feedback, turn management and sequencing phenomena by: Jens Allwood, Loredana Cerrato, Kristiina Jokinen, Costanza Navarretta, Patrizia Paggio, in Language Resources and Evaluation, Vol. 41, No. 3. (16 December 2007), pp. 273-287.
19. Viola, P., and Jones, M., "Robust Real-Time Face Detection", International Journal of Computer Vision, vol. 57, no. 2, pp.137-154, May 2004.
20. Nick Campbell, Damien Douxchamps (2007) "Robust real time face tracking for the analysis of human behavior", pp.1-15, in Machine Learning & Multimodal Interaction, Springers LNCS series, 4892.