Crossmodal integration of conspecific vocalizations in rhesus macaques

PLoS ONE

Volumn 8, Issue 11, 2013, Pages

  Payne, Christa ^a   Bachevalier, Jocelyne ^a  

^a EMORY UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL EXPERIMENT; ARTICLE; AUDITORY DISCRIMINATION; AUDITORY STIMULATION; CONTROLLED STUDY; CROSSMODAL INTEGRATION; EMOTIONALITY; EYE TRACKING; FEMALE; MALE; NERVOUS SYSTEM FUNCTION; NONHUMAN; RHESUS MONKEY; SEX DIFFERENCE; SIGNAL DETECTION; SOCIAL BEHAVIOR; TASK PERFORMANCE; VISUAL DISCRIMINATION; VISUAL STIMULATION; VOCALIZATION;

ACOUSTIC STIMULATION; ANIMAL COMMUNICATION; ANIMALS; CUES; FACIAL EXPRESSION; FEMALE; MACACA MULATTA; MALE; PHOTIC STIMULATION; RECOGNITION (PSYCHOLOGY); VOCALIZATION, ANIMAL;

EID: 84893426324     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0081825     Document Type: Article

References (53)

1. Baron-Cohen S, Ring HA, Wheelwright S, Bullmore ET, Brammer MJ et al. (1999) Social intelligence in the normal and autistic brain: an fMRI study. Eur-J Neurosci 11: 1891-1898. doi:10.1046/j.1460-9568.1999.00621.x. PubMed: 10336657. (Pubitemid 29240553)
2. Adolphs R, Sears L, Piven J (2001) Abnormal processing of social information from faces in autism. J Cogn Neurosci 13: 232-240. doi:10.1162/089892901564289. PubMed: 11244548. (Pubitemid 32209765)
3. Brothers L (1995) Neurophysiology of the perception of intention by primates. In: M Gazzaniga. The Cognitive Neurosciences. Cambridge, MA: The MIT Press. p. 1107.
4. Byrne RW, Whiten A (1988) Machiavellian intelligence: social expertise and the evolution of intellect in monkeys, apes and humans. Oxford: Clarendon Press.
5. Cheney DL, Seyfarth RM (1990) How Monkeys See the World. Chicago: University of Chicago Press.
6. de Waal FBM (1989) Peacemaking among primates. Boston: Harvard University Press.
7. Hauser MD (1993) Right hemisphere dominance for the production of facial expression in monkeys. Science 261: 475-477. doi:10.1126/science.8332914. PubMed: 8332914.
8. Hinde R, Roswell T (1962) Communication by postures and facial expressions in the rhesus monkey (Macaca mulatta). Proc Roy Soc Lon B 138.
9. Partan SR (2004) Multisensory animal communication. In: G CalvertC SpenceB Stein. The Handbook of Multisensory Processes. Cambridge, MA: The MIT Press. pp. 225-242.
10. Romanski LM, Ghazanfar AA (2010) The primate frontal and temporal lobes and their role in multisensory vocal communication. In: M PlattA Ghazanfar. Primate Neuroethology. New York: Oxford University Press. pp. 500-524.
11. Ghazanfar AA, Logothetis NK (2003) Neuroperception: facial expressions linked to monkey calls. Nature 423: 937-938. doi:10.1038/423937a. PubMed: 12827188. (Pubitemid 36806899)
12. Ghazanfar AA, Maier JX, Hoffman KL, Logothetis NK (2005) Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J Neurosci 25: 5004-5012. doi:10.1523/JNEUROSCI.0799-05.2005. PubMed: 15901781. (Pubitemid 40712843)
13. Buchan JN, Paré M, Munhall KG (2008) The effect of varying talker identity and listening conditions on gaze behavior during audiovisual speech perception. Brain Res 1242: 162-171. doi:10.1016/j.brainres.2008.06.083. PubMed: 18621032.
14. Lansing CR, McConkie GW (1999) Attention to facial regions in segmental and prosodic visual speech perception tasks. J Speech Lang Hear Res 42: 526-539. PubMed: 10391620. (Pubitemid 29287933)
15. Lansing CR, McConkie GW (2003) Word identification and eye fixation locations in visual and visual-plus-auditory presentations of spoken sentences. Percept Psychophys 65: 536-552. doi:10.3758/BF03194581. PubMed: 12812277. (Pubitemid 37544860)
16. Vatikiotis-Bateson E, Eigsti IM, Yano S, Munhall KG (1998) Eye movement of perceivers during audiovisual speech perception. Percept Psychophys 60: 926-940. doi:10.3758/BF03211929. PubMed: 9718953. (Pubitemid 128462142)
17. Collignon O, Girard S, Gosselin F, Saint-Amour D, Lepore F et al. (2010) Women process multisensory emotion expressions more efficiently than men. Neuropsychologia 48: 220-225. doi:10.1016/j.neuropsychologia.2009.09.007. PubMed: 19761782.
18. Ghazanfar AA, Nielsen K, Logothetis NK (2006) Eye movements of monkey observers viewing vocalizing conspecifics. Cognition 101: 515-529. doi:10.1016/j.cognition.2005.12.007. PubMed: 16448641. (Pubitemid 44511927)
19. Goursaud AP, Bachevalier J (2007) Social attachment in juvenile monkeys with neonatal lesion of the hippocampus, amygdala and orbital frontal cortex. Behav Brain Res 176: 75-93. doi:10.1016/j.bbr.2006.09.020. PubMed: 17084912.
20. Roma PG, Champoux M, Suomi SJ (2006) Environmental control, social context, and individual differences in behavioral and cortisol responses to novelty in infant rhesus monkeys. Child Dev 77: 118-131. doi:10.1111/j.1467- 8624.2006.00860.x. PubMed: 16460529. (Pubitemid 43412367)
21. Sackett GP, Ruppenthal GC, Davis AE (2002) Survival, growth, health, and reproduction following nursery rearing compared with mother rearing in pigtailed monkeys (Macaca nemestrina). Am J Primatol 56: 165-183. doi:10.1002/ajp.1072. abs. PubMed: 11857653. (Pubitemid 34788820)
22. Payne C, Machado CJ, Bliwise NG, Bachevalier J (2010) Maturation of the hippocampal formation and amygdala in Macaca mulatta: a volumetric magnetic resonance imaging study. Hippocampus 20: 922-935. doi:10.1002/hipo.20688. PubMed: 19739247.
23. Dixon NF, Spitz L (1980) The detection of auditory visual desynchrony. Perception 9: 719-721. doi:10.1068/p090719. PubMed: 7220244. (Pubitemid 11114821)
24. Adolphs R, Gosselin F, Buchanan TW, Tranel D, Schyns P et al. (2005) A mechanism for impaired fear recognition after amygdala damage. Nature 433: 68-72. doi:10.1038/nature03086. PubMed: 15635411. (Pubitemid 40101144)
25. Farzin F, Rivera SM, Hessl D (2009) Brief report: Visual processing of faces in individuals with fragile X syndrome: an eye tracking study. J Autism Dev Disord 39: 946-952. doi:10.1007/s10803-009-0744-1. PubMed: 19399604.
26. Gamer M, Büchel C (2009) Amygdala activation predicts gaze toward fearful eyes. J Neurosci 29: 9123-9126. doi:10.1523/JNEUROSCI. 1883-09.2009. PubMed: 19605649.
27. Gothard KM, Brooks KN, Peterson MA (2009) Multiple perceptual strategies used by macaque monkeys for face recognition. Anim Cogn 12: 155-167. doi:10.1007/s10071-008-0179-7. PubMed: 18787848.
28. Gothard KM, Erickson CA, Amaral DG (2004) How do rhesus monkeys (Macaca mulatta) scan faces in a visual paired comparison task? Anim Cogn 7: 25-36. doi:10.1007/s10071-003-0179-6. PubMed: 14745584. (Pubitemid 40549608)
29. Guo K, Robertson RG, Mahmoodi S, Tadmor Y, Young MP (2003) How do monkeys view faces? - A study of eye movements. Exp Brain Res 150: 363-374. PubMed: 12707744. (Pubitemid 36693717)
30. Kennedy DP, Adolphs R (2010) Impaired fixation to eyes following amygdala damage arises from abnormal bottom-up attention. Neuropsychologia 48: 3392-3398. doi:10.1016/j.neuropsychologia.2010.06.025. PubMed: 20600184.
31. Machado CJ, Nelson EE (2011) Eye-tracking with nonhuman primates is now more accessible than ever before. Am J Primatol 73: 562-569. doi:10.1002/ajp.20928. PubMed: 21319204.
32. Pelphrey KA, Sasson NJ, Reznick JS, Paul G, Goldman BD et al. (2002) Visual scanning of faces in autism. J Autism Dev-Disord 32: 249-261. doi:10.1023/A:1016374617369. PubMed: 12199131.
33. Riby DM, Hancock PJ (2008) Viewing it differently: social scene perception in Williams syndrome and autism. Neuropsychologia 46: 2855-2860. doi:10.1016/j.neuropsychologia.2008.05.003. PubMed: 18561959.
34. Spezio ML, Huang PY, Castelli F, Adolphs R (2007) Amygdala damage impairs eye contact during conversations with real people. J Neurosci 27: 3994-3997. doi:10.1523/JNEUROSCI.3789-06.2007. PubMed: 17428974. (Pubitemid 46597142)
35. Buchan JN, Paré M, Munhall KG (2007) Spatial statistics of gaze fixations during dynamic face processing. Soc Neurosci 2: 1-13. doi:10.1080/17470910601043644. PubMed: 18633803. (Pubitemid 46738956)
36. Everdell IT, Marsh HO, Yurick MD, Munhall KG, Paré M (2007) Gaze behaviour in audiovisual speech perception: asymmetrical distribution of face-directed fixations. Perception 36: 1535-1545. doi:10.1068/p5852. PubMed: 18265836.
37. Klin A, Jones W, Schultz R, Volkmar F, Cohen D (2002) Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch Gen Psychiatry 59: 809-816. doi:10.1001/archpsyc.59.9.809. PubMed: 12215080. (Pubitemid 35001146)
38. Emery NJ (2000) The eyes have it: the neuroethology, function and evolution of social gaze. Neurosci Biobehav Rev 24: 581-604. doi: 10.1016/S0149-7634(00)00025-7. PubMed: 10940436.
39. Hobson RP, Ouston J, Lee A (1988) Emotion recognition in autism: coordinating faces and voices. Psychol-Med 18: 911-923. PubMed: 3270834.
40. Loveland K (2005) Social-emotional impairment and self-regulation in autism spectrum disorders. In: J NadelD Muir. Typical and impaired emotional development. Oxford: Oxford University Press. pp. 365-382.
41. Loveland K, Pearson D, Reddoch S (2005) Anxiety symptoms in children and adolescents with autism. International Meeting for Autism Research. Boston, MA
42. Loveland K, Tunali-Kotoski B, Chen R, Brelsford K, Ortegon J et al. (1995) Intermodal perception of affect in persons with autism or Down syndrome. Dev Psychopathol 7.
43. Magnée MJ, de Gelder B, van Engeland H, Kemner C (2007) Facial electromyographic responses to emotional information from faces and voices in individuals with pervasive developmental disorder. J Child Psychol Psychiatry 48: 1122-1130. doi:10.1111/j.1469-7610.2007.01779.x. PubMed: 17995488. (Pubitemid 350086156)
44. Magnée MJ, de Gelder B, van Engeland H, Kemner C (2008) Audiovisual speech integration in pervasive developmental disorder: evidence from event-related potentials. J Child Psychol Psychiatry 49: 995-1000. doi:10.1111/j.1469-7610.2008.01902.x. PubMed: 18492039.
45. de Gelder B, Vroomen J, de Jong SJ, Masthoff ED, Trompenaars FJ et al. (2005) Multisensory integration of emotional faces and voices in schizophrenics. Schizophr Res 72: 195-203. doi:10.1016/j.schres.2004.02.013. PubMed: 15560964. (Pubitemid 39550990)
46. de Jong JJ, Hodiamont PP, de Gelder B (2010) Modality-specific attention and multisensory integration of emotions in schizophrenia: reduced regulatory effects. Schizophr Res 122: 136-143. doi:10.1016/j.schres.2010.04.010. PubMed: 20554159.
47. de Jong JJ, Hodiamont PP, Van den Stock J, de Gelder B (2009) Audiovisual emotion recognition in schizophrenia: reduced integration of facial and vocal affect. Schizophr Res 107: 286-293. doi:10.1016/j.schres.2008.10.001. PubMed: 18986799.
48. Dolan RJ, Morris JS, de Gelder B (2001) Crossmodal binding of fear in voice and face. Proc-Natl-Acad-Sci-U-S-A 98: 10006-10010. PubMed: 11493699.
49. Pourtois G, de Gelder B, Bol A, Crommelinck M (2005) Perception of facial expressions and voices and of their combination in the human brain. Cortex 41: 49-59. doi:10.1016/S0010-9452(08)70177-1. PubMed: 15633706. (Pubitemid 39600225)
50. Kreifelts B, Ethofer T, Grodd W, Erb M, Wildgruber D (2007) Audiovisual integration of emotional signals in voice and face: an event-related fMRI study. NeuroImage 37: 1445-1456. doi:10.1016/j.neuroimage.2007.06.020. PubMed: 17659885. (Pubitemid 47385290)
51. Izumi A, Kojima S (2004) Matching vocalizations to vocalizing faces in a chimpanzee (Pan troglodytes). Anim Cogn 7: 179-184. PubMed: 15015035.
52. Martinez L, Matsuzawa T (2009) Auditory-visual intermodal matching based on individual recognition in a chimpanzee (Pan troglodytes). Anim Cogn 12 Suppl 1: S71-S85. doi:10.1007/s10071-009-0269-1. PubMed: 19701656.
53. Parr LA (2004) Perceptual biases for multimodal cues in chimpanzee (Pan troglodytes) affect recognition. Anim Cogn 7: 171-178. PubMed: 14997361.