Addressee detection for dialog systems using temporal and spectral dimensions of speaking style

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2013, Pages 2559-2563

  Shriberg, Elizabeth ^a,b   Stolcke, Andreas ^a,b   Ravuri, Suman ^b  

^a MICROSOFT RESEARCH   (United States)

^b INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

Author keywords

Addressee detection; Dialog system; Language model; Online processing; Out of domain data; Prosody; Speaking style; Spectral tilt; Vocal effort

Indexed keywords

COMPUTATIONAL LINGUISTICS; EXPERIMENTS; SPEECH SYNTHESIS;

DIALOG SYSTEMS; LANGUAGE MODEL; ONLINE PROCESSING; OUT-OF-DOMAIN DATA; PROSODY; SPEAKING STYLES; SPECTRAL TILT; VOCAL EFFORTS;

SPEECH RECOGNITION;

EID: 84906248474     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. R. op den Akker and D. Traum, A comparison of addressee detection methods for multiparty conversations, Proceedings of Diaholmia, pp. 99-106, 2009.
2. N. Baba, H.-H. Huang, and Y. I. Nakano, Addressee identification for human-human-agent multiparty conversations in different proxemics, Proceedings 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction. ACM, Oct. 2012, Article no. 6.
3. D. Bohus and E. Horvitz, Multiparty turn taking in situated dialog: Study, lessons, and directions, Proceedings ACL SIGDIAL, pp. 98-109, Portland, OR, June 2011.
4. T. Paek, E. Horvitz, and E. Ringger, Continuous listening for unconstrained spoken dialog, B. Yuan, T. Huang, and X. Tang, editors, Proc. ICSLP, vol. 1, pp. 138-141, Beijing, Oct. 2000. China Military Friendship Publish.
5. J. Dowding, R. Alena, W. J. Clancey, M. Sierhuis, and J. Graham, Are you talking to me? dialogue systems supporting mixed teams of humans and robots, Proccedings AAAI Fall Symposium: Aurally Informed Performance: Integrating Machine Listening and Auditory Presentation in Robotic Systems, Washington, DC, Oct. 2006.
6. M. Katzenmaier, R. Stiefelhagen, and T. Schultz, Identifying the addressee in human-human-robot interactions based on head pose and speech, Proceedings of the 6th international conference on Multimodal interfaces, pp. 144-151, State College, PA, USA, 2004. ACM.
7. D. Reich, F. Putze, D. Heger, J. Ijsselmuiden, R. Stiefelhagen, and T. Schultz, A real-time speech command detector for a smart control room, Proc. Interspeech, pp. 2641-2644, Florence, Italy, Aug. 2011.
8. E. Shriberg, A. Stolcke, D. Hakkani-Tr, and L. Heck, Learning when to listen: Detecting system-addressed speech in humanhuman- computer dialog, Proc. Interspeech, pp. 334-337, Portland, Oregon, Sep. 2012.
9. H. Lee, A. Stolcke, and E. Shriberg, Using out-of-domain data for lexical addressee detection in human-human-computer dialog, Proceedings North American ACL/Human Language Technology Conference, Atlanta, GA, June 2013.
10. L. Heck, D. Hakkani-Tür, M. Chinthakunta, G. Tur, R. Iyer, P. Parthasarathy, L. Stifelman, A. Fidler, and E. Shriberg, Multimodal conversational search and browse, Proceedings IEEE Workshop on Speech, Language and Audio in Multimedia, Marseille, Aug. 2013.
11. MADCOW, Multi-site data collection for a spoken language corpus, Proc. DARPA SNP Workshop, pp. 7-14, Harriman, NY, Feb. 1992. Defense Advanced Research Projects Agency, Information Science and Technology Office.
12. M. Walker, J. Aberdeen, J. Boland, E. Bratt, J. Garofolo, L. Hirschman, A. Le, S. Lee, S. Narayanan, K. Papineni, B. Pellom, J. Polifroni, A. Potamianos, P. Prabhu, A. Rudnicky, G. Sanders, S. Seneff, D. Stallard, and S. Whittaker, DARPA Communicator dialog travel planning systems: The June 2000 data collection, P. Dalsgaard, B. Lindberg, H. Benner, and Z. Tan, editors, Proc. EUROSPEECH, Aalborg, Denmark, Sep. 2001.
13. C. Cieri, D. Miller, and K.Walker, The Fisher corpus: A resource for the next generations of speech-to-text, Proceedings 4th International Conference on Language Resources and Evaluation, pp. 69-71, Lisbon, May 2004.
14. A. Janin, D. Baron, J. Edwards, D. Ellis, D. Gelbart, N. Morgan, B. Peskin, T. Pfau, E. Shriberg, A. Stolcke, and C. Wooters, The ICSI Meeting Corpus, Proc. ICASSP, vol. 1, pp. 364-367, Hong Kong, Apr. 2003.
15. J.-S. Lienard and M.-G. Di Benedetto, Effect of vocal effort on spectral properties of vowels, Journal of the Acoustical Society of America, vol. 106, pp. 411-422, 1999.
16. H. Hanson, Glottal characteristics of female speakers: Acousticcorrelates, Journal of the Acoustical Society of America, vol. 101, pp. 466-481, 1997.
17. H. Traunmüller and A. Eriksson, Acoustic effects of variation in vocal effort by men, women, and children, Journal of the Acoustical Society of America, vol. 107, pp. 3438-3451, 2000.
18. N. Obin, Cries and whispers - classification of vocal effort in expressive speech, Proc. Interspeech, Portland, Oregon, Sep. 2012.
19. S. Takeda, Y. Ueno, N. Nakasako, H. N. M. Tsuru, R. Isobe, and S. Kiryu, Spectral-tilt features of emotional speech, International Conference on Kansei Engineering and Emotion Research, Paris, Mar. 2010.
20. Y.-L. Shue, The Voice Source in Speech Production: Data, Analysis and Models, PhD thesis, University of California Los Angeles, 2010.
21. F. Plante, G. F. Meyer, and W. A. Ainsworth, A pitch extraction reference database, in J. M. Pardo, E. Enŕiquez, J. Ortega, J. Ferreiros, J. Maćias, and F. J. Valverde, editors, Proc. EUROSPEECH, pp. 837-840, Madrid, Sep. 1995.
22. P. C. Bagshaw, S. M. Hiller, and M. A. Jack, Enhanced pitch tracking and the processing of F0 contours for computer aided intonation teaching, Proc. EUROSPEECH, pp. 1003-1006, Berlin, Sep. 1993.
23. M. Iseli, Y.-L. Shue, and A. Alwan, Age, sex, and vowel dependencies of acoustic measures related to the voice source, Journal of the Acoustical Society of America, vol. 121, pp. 2283-2295, 2007.
24. N. Morgan, E. Fosler, and N. Mirghafori, Speech recognition using on-line estimation of speaking rate, in G. Kokkinakis, N. Fakotakis, and E. Dermatas, editors, Proc. EUROSPEECH, vol. 4, pp. 2079-2082, Rhodes, Greece, Sep. 1997.
25. T. Alumäe and M. Kurimo, Efficient estimation of maximum entropy language models with N-gram features: An SRILM extension, Proc. Interspeech, pp. 1820-1823, Portland, Oregon, Sep. 2012.
26. R. E. Schapire and Y. Singer, Boostexter: A boosting-based system for text categorization, Machine Learning, vol. 39, pp. 135- 168, 2000.
27. B. Favre, D. Hakkani-Tür, and S. Cuendet, icsiboost. open-source implementation of Boostexter, http://code.google.come/p/icsiboost, 2007.
28. S. Pigeon, P. Druyts, and P. Verlinde, Applying logistic regression to the fusion of the NIST'99 1-speaker submissions, Digital Signal Processing, vol. 10, pp. 237-248, Jan. 2000.