Investigating automatic measurements of prosodic accommodation and its dynamics in social interaction

Speech Communication

Volumn 58, Issue , 2014, Pages 11-34

  De Looze, Céline ^a   Scherer, Stefan ^b   Vaughan, Brian ^a   Campbell, Nick ^a  

^a TRINITY COLLEGE DUBLIN   (Ireland)

^b University of Southern California   (United States)

Author keywords

Dynamics; Information exchange; Interactional conversation; Prosodic accommodation; Speakers' involvement and affinity

Indexed keywords

AUTOMATIC MEASUREMENTS; HUMAN COMMUNICATIONS; INFORMATION EXCHANGES; INTERACTIONAL CONVERSATION; PROSODIC ACCOMMODATION; SPEAKERS' INVOLVEMENT AND AFFINITY; SPOKEN DIALOGUE SYSTEM; TELEPHONE CONVERSATION;

COMMUNICATION; DYNAMICS; ECONOMIC AND SOCIAL EFFECTS; SOCIAL ASPECTS; SPEECH PROCESSING;

MEASUREMENTS;

EID: 84888373169     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2013.10.002     Document Type: Article

References (102)

1. S.K. Agarwal, T. Paek, N. Rajput, and B. Thies 2nd international workshop on intelligent user interfaces for developing regions: IUI4DR IUI 2011 2011
2. Apple Inc. Apple SIRI Homepage, 2011.
3. V. Aubanel, and N. Nguyen Automatic recognition of regional phonological variation in conversational interaction Speech Communication 52 6 2010 577 586
4. M. Babel, and D. Bulatov The role of fundamental frequency in phonetic accommodation Language and Speech 55 2 2011 231 248
5. Bailly, G., Lelong, A., 2010. Speech dominoes and phonetic convergence. In: Interspeech 2010, pp. 1153-1156.
6. R. Banse, and K.R. Scherer Acoustic profiles in vocal emotion expression Journal of Personality and Social Psychology 70 3 1996 614 636 (Pubitemid 126420699)
7. J.B. Bavelas, A. Black, C.R. Lemery, and J. Mullett I show how you feel: motor mimicry as a communicative act Journal of Personality and Social Psychology 50 2 1986 322
8. L. Bell, J. Gustafson, and M. Heldner Prosodic adaptation in human-computer interaction Proceedings of ICPhS vol. 3 2003 Citeseer 833 836
9. F.J. Bernieri, and R. Rosenthal Interpersonal coordination: behavior matching and interactional synchrony Fundamentals of Nonverbal Behavior 1991 401
10. J.W. Black The intensity of oral responses to stimulus words Journal of Speech and Hearing Disorders 14 1 1949 16
11. Boersma, P., Weenink, D., 2006. Praat: Doing Phonetics by Computer. Available from: .
12. Boylan, P., 2004. Accommodation theory revisited. Technical report, University of Rome III (Italy), Rome.
13. H.P. Branigan, M.J. Pickering, J. Pearson, and J.F. McLean Linguistic alignment between people and computers Journal of Pragmatics 42 9 2010 2355 2368
14. C. Breazeal Regulation and entrainment in human-robot interaction The International Journal of Robotics Research 21 10-11 2002 883 902
15. Brennan, S.E., 1996. Lexical entrainment in spontaneous dialog. In: Proceedings of ISSD, pp. 41-44.
16. J.K. Burgoon, L.A. Stern, and L. Dillman Interpersonal adaptation: dyadic interaction patterns Number Cambridge 1995 Cambridge University Press UK
17. Campbell, N., 2004. Speech and expression; the value of a longitudinal corpus'. In: Proceedings Fourth International Conference on Language Resources and Evaluation (LREC'04), pp. 183-186.
18. T.L. Chartrand, and J.A. Bargh The chameleon effect: the perception-behavior link and social interaction Journal of Personality and Social Psychology 76 6 1999 893
19. A.A. Cleland, and M.J. Pickering The use of lexical and syntactic information in language production: evidence from the priming of noun-phrase structure Journal of Memory and Language 49 2 2003 214 230 (Pubitemid 36963767)
20. Collins, B., 1998. Convergence of fundamental frequencies in conversation: if it happens, does it matter? In: Fifth International Conference on Spoken Language Processing.
21. W.S. Condon, and L.W. Sander Synchrony demonstrated between movements of the neonate and adult speech Child Development 1974 456 462
22. R. Coulston, S. Oviatt, and C. Darves Amplitude convergence in children's conversational speech with animated personas Proceedings of the Seventh International Conference on Spoken Language Processing vol. 4 2002 Citeseer 2689 2692
23. D.P. Crowne, and D. Marlowe A new scale of social desirability independent of psychopathology Journal of Consulting Psychology 24 4 1960 349
24. N.H. De Jong, and T. Wempe Praat script to detect syllable nuclei and measure speech rate automatically Behavior Research Methods 41 2 2009 385 390
25. De Looze, C., 2010. Analyse et interprétation de l'empan temporel des variations prosodiques en français et en anglais contemporain. PhD Thesis, Doctoral Thesis, Université de Provence.
26. C. De Looze, and S. Rauzy Measuring speakers' similarity in speech by means of prosodic cues: methods and potential Proceedings of Interspeech 2 011 2011 ISCA 1393 1396
27. C. De Looze, C. Oertel, S. Rauzy, and N. Campbell Measuring dynamics of mimicry by means of prosodic cues in conversational speech Proceedings of ICPhS 2011 Springer 1294 1297
28. V. Delvaux, and A. Soquet The influence of ambient speech on adult speech productions through unintentional imitation Phonetica 64 2-3 2007 145 173
29. Edlund, J., Heldner, M., Hirschberg, J., 2009. Pause and gap length in face-to-face interaction. In 10th Annual Conference of the International Speech Communication Association, pp. 2779-2782.
30. C.A. Ferguson Toward a characterization of english foreigner talk Anthropological Linguistics 17 1 1975 1 14
31. A. Fernald, T. Taeschner, J. Dunn, M. Papousek, B. de Boysson-Bardies, and I. Fukui A cross-language study of prosodic modifications in mothers' and fathers' speech to preverbal infants Journal of Child Language 16 03 1989 477 501
32. C. Gallois, and V.J. Callan Communication accommodation and the prototypical speaker: predicting evaluations of status and solidarity Language and Communication 8 3 1988 271 283
33. C. Gallois, and V.J. Callan Interethnic accommodation: the role of norms Contexts of Accommodation: Developments in Applied Sociolinguistics 1991 245 269
34. H. Giles, N. Coupland, and J. Coupland Accommodation theory: communication, context, and consequence Contexts of Accommodation: Developments in Applied Sociolinguistics 1991 1 68
35. F. Goldman-Eisler The significance of changes in the rate of articulation Language and Speech 4 3 1961 171 174
36. F. Goldman-Eisler Psycholinguistics: Experiments in Spontaneous Speech 1968 Academic Press
37. Google, 2011. Google Voice Search.
38. S.W. Gregory, and K. Dagan Evaluating the relation of vocal accommodation in conversation partners' fundamental frequencies to perceptions of communication quality Journal of Nonverbal Behavior 21 1 1997 23 43 (Pubitemid 127173910)
39. S.W. Gregory, and B.R. Hoyt Conversation partner mutual adaptation as demonstrated by Fourier series analysis Journal of Psychological Research 11 1982 35 46
40. S.W. Gregory, S. Webster, and G. Huang Voice pitch and amplitude convergence as a metric of quality in dyadic interviews Language and Communication 13 1993 195 217
41. F. Grosjean, and A. Deschamps Analyse contrastive des variables temporelles de l'anglais et du français: vitesse de parole et variables composantes, phénomènes d'hésitation Phonetica 31 3-4 1975 144 184
42. S.L. Haywood, M.J. Pickering, and H.P. Branigan Do speakers avoid ambiguities during dialogue? Psychological Science 16 5 2005 362 366 (Pubitemid 40763681)
43. Heldner, J., Edlund, M., Hirschberg, J., 2010. Pitch similarity in the vicinity of backchannels. In: Proceedings of Interspeech 2010, pp. 1-4.
44. U. Hess, and S. Blairy Facial mimicry and emotional contagion to dynamic emotional facial expressions and their influence on decoding accuracy International Journal of Psychophysiology 40 2 2001 129 141 (Pubitemid 32109244)
45. J. Jaffe Rhythms of Dialogue in Infancy: Coordinated Timing in Development 2001 Wiley-Blackwell
46. Jaffe, J., Feldstein, S., 1970. Rhythms of Dialogue, Academic Press, New York.
47. P.N. Juslin, and K.R. Scherer Vocal expression of affect The New Handbook of Methods in Nonverbal Behavior Research 2005 Oxford University Press Oxford, UK
48. T. Kleinberger, M. Becker, E. Ras, and A. Holzinger Ambient intelligence in assisted living: enable elderly people to handle future interfaces Access 2007 103 112
49. S. Kopp Social resonance and embodied coordination in face-to-face conversation with artificial interlocutors Speech Communication 52 6 2010 587 597
50. Kousidis, S., Dorran, D., McDonnell, C., Coyle, E., 2008. Times series analysis of acoustic feature convergence in human dialogues. In: Proceedings of Interspeech.
51. Kousidis, S., Dorran, D., Mcdonnell, C., Coyle, E., 2009. Convergence in human dialogues time series analysis of acoustic feature. In: Proceedings of SPECOM 2009, St. Petersburg, Russia, p. 2.
52. J.L. Lakin, and T.L. Chartrand Using nonconscious behavioral mimicry to create affiliation and rapport Journal of Psychological Science 14 4 2003 334 339 (Pubitemid 37282830)
53. Lee, C.C., Black, M., Katsamanis, A., Lammert, A.C., Baucom, B.R., Christensen, A., Georgiou, P.G., Narayanan, S.S., 2010. Quantification of prosodic entrainment in affective spontaneous spoken interactions of married couples. In 11th Annual Conference of the International Speech Communication Association, pp. 793-796.
54. W.J.M. Levelt Linearization in describing spatial networks Processes, Beliefs, and Questions 1982 199 220
55. Levitan, R., Hirschberg, J., 2011. Measuring acoustic-prosodic entrainment with respect to multiple levels and dimensions. In: 12th Annual Conference of the International Speech Communication Association, 2011.
56. Levitan, R., Gravano, A., Hirschberg, J., Entrainment in speech preceding backchannels. In: Proc. of ACL 2011, pp. 113-117.
57. Levitan, R., Gravano, A., Willson, L., 2011. Acoustic-prosodic entrainment and social behavior, In: INTERSPEECH, pp. 3081-3084.
58. H. Lu, A. Brush, B. Priyantha, A.K. Karlson, and J. Liu SpeakerSense: energy efficient unobtrusive speaker identification on mobile phones Work 2011 188 205
59. H.K. Maganti, P. Motlicek, and D. Gatica-Perez Unsupervised speech/non-speech detection for automatic speech recognition in meeting rooms Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2007) vol. 4 2007 IEEE IV-1037 IV-1040
60. J.D. Matarazzo, and A.N. Wiens Interviewer influence on durations of interviewee silence Journal of Experimental Research in Personality 2 1 1967 56 69
61. R.E. Maurer, and J.H. Tindall Effect of postural congruence on client's perception of counselor empathy Journal of Counseling Psychology 30 2 1983 158
62. A.R. McGarva, and R.M. Warner Attraction and social coordination: mutual entrainment of vocal activity rhythms Journal of Psycholinguistic Research 32 3 2003 335 354 (Pubitemid 39015268)
63. L.E.O. Meltzer, and W.N. Morris Interruption outcomes and vocal amplitude: explorations in social psychophysics Journal of Personality and Social Psychology 18 3 1971 392 402
64. A.N. Meltzoff, and M.K. Moore Imitation of facial and manual gestures by human neonates Science 198 4312 1977 75 78 (Pubitemid 8196230)
65. L.K. Miles, L.K. Nind, and C.N. Macrae The rhythm of rapport: interpersonal synchrony and social perception Journal of Experimental Social Psychology 45 3 2009 585 589
66. L. Mondada Pour une linguistique interactionnelle Marges Linguistiques 1 2001 1 21
67. M. Natale Convergence of mean vocal intensity in dyadic communication as a function of social desirability Journal of Personality and Social Psychology 32 5 1975 790
68. A. Nenkova, A. Gravano, and J. Hirschberg High frequency word entrainment in spoken dialogue Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers 2008 Association for Computational Linguistics 169 172
69. Nishimura, R., Kitaoka, N., Nakagawa, S., 2008. Analysis of relationship between impression of human-to-human conversations and prosodic change and its modeling. In: Ninth Annual Conference of the International Speech Communication Association - INTERSPEECH, pp. 534-537.
70. J.J. Ohala Cross-language use of pitch: an ethological view Phonetica 40 1 1981 1 18
71. S. Oviatt User-centered modeling for spoken language and multimodal interfaces IEEE Multimedia 3 4 1996 26 35 (Pubitemid 126574421)
72. J.S. Pardo On phonetic convergence during conversational interaction The Journal of the Acoustical Society of America 119 2006 2382
73. F. Parrill, and I. Kimbara Seeing and hearing double: the influence of mimicry in speech and gesture on observers Journal of Nonverbal Behavior 30 4 2006 157 166 (Pubitemid 44757598)
74. A. Pentland Honest Signals - How They Shape Our World 2008 MIT Press Cambridge
75. M.J. Pickering, and V.S. Ferreira Structural priming: a critical review Psychological Bulletin 134 3 2008 427
76. M.J. Pickering, and S. Garrod Toward a mechanistic psychology of dialogue The Behavioral and Brain Sciences 27 2 2004 169 190 (Discussion 190-226) (Pubitemid 40823055)
77. M.J. Pickering, and S. Garrod Alignment as the basis for successful communication Research on Language and Computation 4 2-3 2006 203 228 (Pubitemid 44411814)
78. W.B. Putman, and R.L. Street The conception and perception of noncontent speech performance: implications for speech-accommodation theory International Journal of the Sociology of Language 1984 46 1984 97 114
79. F. Ramseyer, and W. Tschacher Nonverbal synchrony or random coincidence? How to tell the difference Development of Multimodal Interfaces: Active Listening and Synchrony 2010 182 196
80. M.J. Richardson, K.L. Marsh, R.W. Isenhower, J.R.L. Goodman, and R.C. Schmidt Rocking together: dynamics of intentional and unintentional interpersonal coordination Human Movement Science 26 6 2007 867 891 (Pubitemid 350091326)
81. F. Rumsey, and T. McCormick Sound and Recording: An Introduction 2002 Focal Press
82. K.R. Scherer, and H.G. Wallbott Evidence for universality and cultural variation of differential emotion response patterning Journal of Personality and Social Psychology 66 2 1994 310
83. Shepard, C.A., Giles, H., Le Poire, B.A., 2001. Communication accommodation theory, The New Handbook of Language and Social Psychology, vol. 1.2, John Wiley & Sons Incorporated. pp. 33-56.
84. K. Shockley, A.A. Baker, M.J. Richardson, and C.A. Fowler Articulatory constraints on interpersonal postural coordination Journal of Experimental Psychology: Human Perception and Performance 33 1 2007 201
85. K. Shockley, D.C. Richardson, and R. Dale Conversation and coordinative structures Topics in Cognitive Science 1 2 2009 305 319
86. Smith, C., 2007. Prosodic accommodation by French speakers to a non-native interlocutor. In: Proceedings of the XVIth International Congress of Phonetic Sciences, pp. 313-348.
87. G.W. Stanford, and S. Webster A nonverbal signal in voices of interview partners effectively predicts communication accommodation and social status perceptions Journal of Personality and Social Psychology 70 6 1996 1231 1240 (Pubitemid 126418523)
88. Richard L. Street Jr., Nancy James Street, and Anne Van Kleek Speech convergence among talkative and reticent three year-olds Language Sciences 5 1 1983 79 96
89. N. Suzuki, and Y. Katagiri Prosodic alignment in human-computer interaction Connection Science 19 2 2007 131 141
90. L. Tickle-Degnen, and R. Rosenthal The nature of rapport and its nonverbal correlates Psychological inquiry 1 4 2007 285 293
91. W. Van Summers, D.B. Pisoni, R.H. Bernacki, R.I. Pedlow, and M.A. Stokes Effects of noise on speech production: acoustic and perceptual analyses The Journal of the Acoustical Society of America 84 1988 917
92. B. Vaughan Prosodic synchrony in co-operative task-based dialogues: a measure of agreement and disagreement Proceedings of Interspeech 2011 2011 ISCA 1865 1868
93. A. Vinciarelli Capturing order in social interactions [social sciences] IEEE Signal Processing Magazine 26 5 2009 133 152
94. Ward, Diane, Litman, Arthur, 2007. Automatically measuring lexical and acoustic/prosodic convergence in tutorial dialog corpora. In: ISCA Tutorial and Research Workshop, p. 4.
95. Ward, N., Nakagawa, S., 2002. Automatic user-adaptive speaking rate selection for information delivery. In: 7th International Conference on Spoken Language Processing (ICSLP2002 - INTERSPEECH 2002).
96. J.T. Webb Interview synchrony: an investigation of two speech rate measures in an automated standardized interview Studies in Dyadic Communication 1972 115 133
97. J. Welkowitz, and M. Kuc Interrelationships among warmth, genuineness, empathy, and temporal speech patterns in interpersonal interaction Journal of Consulting and Clinical Psychology 41 3 1973 472 473
98. G.W. Woodall, and J.K. Burgoon Talking fast and changing attitudes: a critique and clarification Journal of Nonverbal Behavior 8 2 1983 126 142
99. L.A. Zebrowitz, S. Brownlow, and K. Olson Baby talk to the babyfaced Journal of Nonverbal Behavior 16 3 1992 143 158
100. L. Zeine, and J.F. Brandt The lombard effect on alaryngeal speech Journal of Communication Disorders 21 5 1988 373 383
101. J. Zhou, X. Su, M. Ylianttila, and J. Riekki Exploring pervasive service computing opportunities for pursuing successful ageing The Gerontologist 2012 73 82
102. J. Zuengler Accommodation in native-non-native interactions: going beyond the 'what' to the 'why' in second language research Contexts of Accommodation: Developments in Applied Sociolinguistics 1991 Cambridge UP Cambridge pp. 223-244