What do you mean by that?! An electrophysiological study of emotional and attitudinal prosody

PLoS ONE

Volumn 10, Issue 7, 2015, Pages

  Wickens, Steven ^a   Perry, Conrad ^a  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ANGER; ARTICLE; ATTITUDINAL PROSODY; BEHAVIOR; BRAIN ELECTROPHYSIOLOGY; CONTROLLED STUDY; CROSS SPLICED SENTENCE; ELECTROENCEPHALOGRAM; EMOTIONAL PROSODY; EVENT RELATED POTENTIAL; EXPERIMENTAL BEHAVIORAL TEST; FEMALE; HUMAN; HUMAN EXPERIMENT; INTERPERSONAL COMMUNICATION; MALE; NEUTRAL; NORMAL HUMAN; PERCEPTION; PROBE VERIFICATION TASK; PROSODIC CLASSIFICATION TASK; PROSODIC EXPECTANCY VIOLATION PARADIGM; SARCASM; SOCIAL BEHAVIOR; SPEECH AND LANGUAGE; STIMULUS; TASK DEMAND; TASK PERFORMANCE; ADOLESCENT; ANATOMY AND HISTOLOGY; ATTITUDE; AUDITORY EVOKED POTENTIAL; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EMOTION; EVOKED RESPONSE; PHYSIOLOGY; REACTION TIME; SPEECH; SPEECH PERCEPTION;

ADOLESCENT; ADULT; ANGER; ATTITUDE; BRAIN; BRAIN MAPPING; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; EVOKED POTENTIALS, AUDITORY; EXPRESSED EMOTION; FEMALE; HUMANS; MALE; REACTION TIME; SPEECH ACOUSTICS; SPEECH PERCEPTION;

EID: 84941619347     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0132947     Document Type: Article

References (57)

1. Hirst D, Di Cristo A, editors (1998) Intonation Systems. A Survey of Twenty Languages. Cambridge, United Kingdom: Cambridge University Press.
2. Mitchell RL, Ross ED (2013) Attitudinal prosody: What we know and directions for future study. Neuroscience & Biobehavioral Reviews 37:471-479.
3. Wichmann A (2000) The attitudinal effects of prosody, and how they relate to emotion. ISCA Tutorial and Research Workshop (ITRW) on Speech and Emotion. New Castle, Northern Ireland, UK. pp. 143-148.
4. Pell MD (2006) Judging emotion and attitudes from prosody following brain damage. Progress in Brain Research, 156:303-317. PMID: 17015088
5. Grichkovtsova I, Morel M, Lacheret A (2012) The role of voice quality and prosodic contour in affective speech perception. Speech Communication 54:414-429.
6. Blanc JM, Dominey PF (2003) Identification of prosodic attitudes by a temporal recurrent network. Cognitive Brain Research 17:693-699. PMID: 14561456
7. Morlec Y, Bailly G, Auberge V (2001) Generating prosodic attitudes in French: data, model and evaluation. Speech Communication 33:357-371.
8. Mozziconacci SJ (2011) Modeling emotion and attitude in speech by means of perceptually based parameter values. User Modeling and User-Adapted Interaction 11:297-326.
9. Yildrim S, Bulut M, Lee CM, Kazemzadeh A, Carlos B, Deng Z, et al. (2004) An acoustic study of emotions expressed in speech. Proceedings of the International Conference on Spoken Language Processing (ICSLP'04) 1:2193-2196.
10. Breitenstein C, Van Lacker D, Daum I (2001) The contribution of speech rate and pitch variation to the perception of vocal emotions in a German and an American sample. Cognition and Emotion 15:57-79.
11. Sobin C, Alpert M (1999) Emotion in speech: The acoustic attributes of fear, anger, sadness, and joy. Journal of Psycholinguistic Research 28:347-365. PMID: 10380660
12. Pell MD, Paulmann S, DaraC, Alasseri A, KotzSA (2009) Factors in the recognition o fvocally expressed emotions: A comparison of fourlanguages. Journal of Phonetics 37:417-435.
13. Rockwell P (2000) Lower, slower, louder: Vocal cues of Sarcasm. Journal of Psycholingusitic Research 29:483-495.
14. Bryant GA, Fox Tree JE (2005) Is there an ironic tone of voice? Language and Speech 48:257-277. PMID: 16416937
15. Warren P (2005) Patterns of late rising in New Zealand English: Intonational variation or intonational change? Language Variation and Change, 17:209-230.
16. Witteman J, van Jzendoorn MH, van de Velde D, van Heuven VJ, Schiller NO (2011) The nature of hemispheric specialization for linguistic and emotional prosodic perception: A meta-analysis of the lesion literature. Neuropsychologia 49:3722-3738. doi: 10.1016/j.neuropsychologia.2011.09.028 PMID: 21964199
17. Kotz SA, Meyer M, Alter K, Besson M, von Cramon DY, Friederici AD (2003) On the lateralization of emotional prosody: an event-related functional MR investigation. Brain and Language 86:366-376. PMID: 12972367
18. Wildegruber D, Hertrich I, Riecker A, Erb M, Anders S, Grodd W, et al. (2004) Linguistic and emotional aspects of speech intonation. Cerebral Cortex 14:1384-1389.
19. Sidtis JJ, Van Lacker Sidtis D (2003) A neurobehavioral approach to dysprosody. Seminars in Speech and Language 24:93-106. PMID: 12709883
20. Van Lacker D, Sidtis JJ (1992) The identification of affective-prosodic stimuli by left- and right-hemisphere-damaged subjects: All errors are not created equal. Journal of Speech and Hearing Research 35:963-970. PMID: 1447930
21. Meyer M, Steinhauer K, Alter K, Friederici AD, von Cramon DY (2004) Brain activity varies with modulation of dynamic pitch variance in sentence melody. Brain and Language 89:277-289. PMID: 15068910
22. Scherer KR (2003) Vocal communication of emotion: A review of research paradigms. Speech Communication 40:227-256.
23. Schirmer A, Kotz SA (2006) Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing. Trends in Cognitive Sciences 10:24-30. PMID: 16321562
24. Astesano C, Besson M, Alter K (2003) Brain potentials during semantic and prosodic processing in French. Cognitive Brain Research 18:172-184.
25. Chen X, Zhao L, Jiang A, Yang Y (2011) Event-related potential correlates of the expectancy violation during emotional prosody processing. Biological Psychology 86:158-167. doi: 10.1016/j.biopsycho. 2010.11.004 PMID: 21093531
26. Eckstein K, Friederici AD (2006) Late interaction of syntactic and prosodic processes in sentence comprehension as revealed by ERPs. Cognitive Brain Research 52:130-143.
27. Kotz SA, Paulmann S (2007) When emotional prosody and semantics dance cheek to cheek: ERP evidence. Brain Research 1151:107-118. PMID: 17445783
28. Paulmann S, Kotz SA (2008) An ERP investigation on the temporal dynamics of emotional prosody and emotional semantics in pseudo- and lexical-sentence context. Brain and Language 105:59-69. doi: 10.1016/j.bandl.2007.11.005 PMID: 18177699
29. Paulmann S, Jessen S, Kotz SA (2012) It's special the way you say it: An ERP investigation on the temporal dynamics of two types of prosody. Neuropsychologia 50:1609-1620. doi: 10.1016/j. neuropsychologia.2012.03.014 PMID: 22465251
30. Sauter DA, Eimer M (2010) Rapid detection of emotion from human vocalizations. Journal of Cognitive Neuroscience 22:474-481. doi: 10.1162/jocn. 2009.21215 PMID: 19302002
31. Schirmer A, Striano T, Friederici AD (2005) Sex differences in the pre-attentive processing of vocal emotional expressions. NeuroReport 16:635-639. PMID: 15812323
32. Liu T, Pinheiro AP, Deng G, Nestor PG, McCarley RW, Niznikiewicz MA (2012) Electrophysiological insights into processing nonverbal emotional vocalizations. NeuroReport 23:108-112. doi: 10.1097/WNR.0b013e32834ea757 PMID: 22134115
33. Paulmann S, Kotz SA (2008) Early emotional prosody perception based on different speaker voices. Neuroreport 19:209-213. doi: 10.1097/WNR.0b013e3282f454db PMID: 18185110
34. Gandour JT (2006) Tone: Neurophonetics. In: Brown K, editor. Encyclopedia of Language & Linguistics, 2nd edition. Oxford, UK: Elsevier Ltd. pp. 751-761.
35. Woodman GF (2010) A brief introduction to the use of event-related potentials (ERP) in studies of perception and attention. Attention, Perception, Psychophysics 72:2031-2046.
36. Banse R, Scherer KR (1996) Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology 70:614-636. PMID: 8851745
37. Regel S, Gunter TC, Friederici AD (2011) Isn't it ironic? An electrophysiological exploration of figurative language processing. Journal of Cognitive Neuroscience 23:277-293. doi: 10.1162/jocn. 2010.21411 PMID: 20044894
38. RigoulotS, Fish K, Pell MD (2014) Neural correlates of inferring speaker sincerity from white lies: An event-related potential source localization study. Brain Research 1565:48-62. doi: 10.1016/j.brainres. 2014.04.022 PMID: 24751571
39. Culpeper J (1996) Towards an anatomy of impoliteness. Journal of Pragmatics 25:349-367.
40. ToplakM, Katz AN (2000) On the uses of sarcastic irony. Journal of Pragmatics 32:1467-1488.
41. Jorgensen J (1996) The functions of sarcastic irony in speech. Journal of Pragmatics 26:613-634.
42. Cheang HS, Pell MD (2008) The sound of sarcasm. Speech Communication 50:366-381.
43. Lrevenbruck H, Jannet M A B, D'Imperio M, Spini M, Champagne-Lavau M (2013) Prosodic cues of sarcastic speech in French: slower, higher, wider. In: Bimbot F, editor. Proceedings of Interspeech 2013. Lyon, France: Curran Associates, Inc..
44. Rockwell (2000) Lower, slower, louder: Vocal cues of sarcasm. Journal of Psycholinguistic Research 29:483-495.
45. Bryant GA, Tree J E F (2005) Is there an ironic tone of voice? Language and Speech 48:257-277. PMID: 16416937
46. Pell MD, Kotz SA (2011) On the time course of vocal emotion recognition. PLoSONE 6:e27256. doi: 10.1371/journal.pone.0027256 PMID: 22087275
47. Boersma P, WeeninkD (2012) Praat: doing phonetics by computer
48. Delorme A, Makeig S (2004) EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics. Journal of Neuroscience Methods 124:9-21.
49. Paulmann S, Bleichner M, Kotz SA (2013) Valence, arousal, and task effects in emotional prosody processing. Frontiers in Psychology 4:345. doi: 10.3389/fpsyg.2013.00345 PMID: 23801973
50. Regel S, Meyer L, Gunter TC (2014) Distinguishing neurocognitive processes reflected by P600 effects: Evidence from ERPs and neural oscillations. PLoS ONE 9:e96840. doi: 10.1371/journal.pone. 0096840 PMID: 24844290
51. Picton TW, Bentin S, Berg P, Donchin E, Hillyard SA, Johnson R Jr, et al. (2000) Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. Psychophysiology 37:127-152. PMID: 10731765
52. Thonnessen H, Boers F, Dammers J, Chen YH, NorraC, Mathiak K (2010) Early sensory encoding of affective prosody: Neuromagnetic tomography of emotional category changes. NeuroImage 50:250-259. doi: 10.1016/j.neuroimage.2009.11.082 PMID: 19969096
53. Naatanen R, Alho K (1995) Mismatch negativity-a unique measure of sensory processing in audition. International Journal of Neuroscience 80:317-337. PMID: 7775056
54. Hillyard SA, Hink RF, Schwent VL, Picton TW (1973) Electrical signs of selective attention in the Human Brain. Science 182:177-180. PMID: 4730062
55. Spachtholz P, KuhbandnerC, Pekrun R (2014) Negative affect improves the quality of memories: Trading capacity for precision in sensory and working memoty. Journal of Experimental Psychology: General 143:1450-1456.
56. Bidelman GM, Hutkam S, Moreno S (2013) Tone language speakers and musicians share enhanced perceptual and cognitive abilities for musical pitch: Evidence for bidirectionality between the domains of language and music. PLoS ONE 8:e60676. doi: 10.1371/journal.pone.0060676 PMID: 23565267
57. Kochunov P, Fox P, Lancaster J, Tan LH, Amunts K, Zilles J, et al. (2003) Localized morphological brain diierences between English-speaking Caucasians and Chinese-speaking Asians: new evidence of anatomical plasticity. Neuroreport 14:961-964. PMID: 12802183