Auditory feedback of one's own voice is used for high-level semantic monitoring: The "self-comprehension" hypothesis

Frontiers in Human Neuroscience

Volumn 8, Issue MAR, 2014, Pages

  Lind, Andreas ^a   Hall, Lars ^a   Breidegard, Björn ^b   Balkenius, Christian ^a   Johansson, Petter ^a,c  

^a LUND UNIVERSITY COGNITIVE SCIENCE   (Sweden)

^b LUND UNIVERSITY   (Sweden)

^c UPPSALA UNIVERSITY   (Sweden)

Author keywords

Agency; Auditory feedback; Feedback manipulation; Real time speech exchange; Self comprehension; Self monitoring; Speech production

Indexed keywords

ARTICLE; AUDITORY FEEDBACK; AUDITORY MASKING; COGNITION; COMPREHENSION; CONVERSATION; HUMAN; LANGUAGE PROCESSING; LINGUISTICS; PROPRIOCEPTIVE FEEDBACK; SELF COMPREHENSION; SEMANTICS; SENSE OF AGENCY; SPEECH ARTICULATION; SPEECH DISCRIMINATION; SPEECH INTELLIGIBILITY; STROOP TEST; VERBAL COMMUNICATION; VERBALIZATION; VOCAL CORD; VOICE;

EID: 84904621742     PISSN: None     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2014.00166     Document Type: Article

References (113)

1. Baars, B. J. (1980). "The competing plans hypothesis: an heuristic viewpoint on the causes of errors in speech, " inTemporal Variables in Speech: Studies in Honour of Frieda Goldman-Eisler, eds H. Dechert and M. Raupach (The Hague: Mouton), 39-49.
2. Behroozmand, R., Karvelis, L., Liu, H., and Larson, C. R. (2009). Vocalization-induced enhancement of the auditory cortex responsiveness during voice F0 feedback perturbation. Clin. Neurophysiol. 120, 1303-1312. doi: 10.1016/j.clinph.2009.04.022
3. Behroozmand, R., Liu, H., and Larson, C. R. (2011). Time-dependent neural processing of auditory feedback during voice pitch error detection. J. Cogn. Neurosci. 23, 1205-1217. doi: 10.1162/jocn.2010.21447
4. Blackmer, E. R., and Mitton, J. L. (1991). Theories of monitoring and the timing of repairs in spontaneous speech. Cognition 39, 173-194. doi: 10.1016/0010-0277(91)90052-6
5. Blakemore, S. J., Wolpert, D. M., and Frith, C. D. (2002). Abnormalities in the awareness of action. Trends Cogn. Sci.6, 237-242. doi: 10.1016/s1364-6613(02)01907-1
6. Borden, G. J. (1979). An interpretation of research on feedback interruption in speech. Brain Lang. 7, 307-319. doi: 10.1016/0093-934x(79)90025-7
7. Burnett, T. A., Freedland, M. B., Larson, C. R., and Hain, T. C. (1998). Voice F0 responses to manipulations in pitch feedback. J. Acoust. Soc. Am. 103, 3153-3161. doi: 10.1121/1.423073
8. Burnett, T. A., Senner, J. E., and Larson, C. R. (1997). Voice F0 responses to pitch-shifted auditory feedback: a preliminary study. J. Voice 11, 202-211. doi: 10.1016/s0892-1997(97)80079-3
9. Cai, S., Ghosh, S. S., Guenther, F. H., and Perkell, J. S. (2011). Focal manipulations of formant trajectories reveal a role of auditory feedback in the online control of both within-syllable and between-syllable speech timing. J. Neurosci. 31, 16483-16490. doi: 10.1523/jneurosci.3653-11.2011
10. Casserly, E. D. (2011). Speaker compensation for local perturbation of fricative acoustic feedback. J. Acoust. Soc. Am. 129, 2181-2190. doi: 10.1121/1.3552883
11. Casserly, E. D., and Pisoni, D. B. (2010). Speech perception and production. Wiley Interdiscip. Rev. Cogn. Sci. 1, 629-647. doi: 10.1002/wcs.63
12. Chang, E. F., Niziolek, C. A., Knight, R. T., Nagarajan, S. S., and Houde, J. F. (2013). Human cortical sensorimotor network underlying feedback control of vocal pitch. Proc. Natl. Acad. Sci. U S A 110, 2653-2658. doi: 10.1073/pnas.1216827110
13. Chen, Z., Jones, J. A., Liu, P., Li, W., Huang, D., and Liu, H. (2013). Dynamics of vocalization-induced modulation of auditory cortical activity at mid-utterance. PLoS One 8:e60039. doi: 10.1371/journal.pone.0060039
14. Christoffels, I., Formisano, E., and Schiller, N. (2007). Neural correlates of verbal feedback processing: an fMRI study employing overt speech. Hum. Brain Mapp. 28, 868-879. doi: 10.1002/hbm.20315
15. Cowie, R., Douglas-Cowie, E., and Kerr, A. G. (1982). A study of speech deterioration in post-lingually deafened adults. J. Laryngol. Otol. 96, 101-112. doi: 10.1017/s002221510009229x
16. Curio, G., Neuloh, G., Numminen, J., Jousmäki, V., and Hari, R. (2000). Speaking modifies voice-evoked activity in the human auditory cortex. Hum. Brain Mapp. 9, 183-191. doi: 10.1002/(sici)1097-0193(200004)9:4<183::aid-hbm1>3.0.co;2-z
17. Daprati, E., Nico, D., Franck, N., and Sirigu, A. (2003). Being the agent: memory for action events. Conscious. Cogn.12, 670-683. doi: 10.1016/s1053-8100(03)00074-6
18. David, N. (2012). New frontiers in the neuroscience of the sense of agency. Front. Hum. Neurosci. 6:161. doi: 10.3389/fnhum.2012.00161
19. Dell, G. (1986). A spreading-activation theory of retrieval in sentence production. Psychol. Rev. 93, 283-321. doi: 10.1037//0033-295x.93.3.283
20. Dell, G., Juliano, C., and Govindjee, A. (1993). Structure and content in language production: a theory of frame constraints in phonological speech errors. Cogn. Sci. 17, 149-195. doi: 10.1207/s15516709cog1702_1
21. Denes, P. B., and Pinson, E. N. (1963). The Speech Chain. Baltimore: Bell Telephone Laboratories.
22. Dennett, D. C. (1987). The Intentional Stance. Cambridge, MA: MIT Press.
23. Dennett, D. C. (1991). Consciousness Explained. Boston, MA: Little, Brown and Company.
24. Elman, J. L. (1995). "Language as a dynamical system, " in Mind as Motion: Explorations in the Dynamics of Cognition, eds R. F. Port and T. van Gelder (Cambridge, MA: MIT Press), 195-225.
25. Feng, Y., Gracco, V. L., and Max, L. (2011). Integration of auditory and somatosensory error signals in the neural control of speech movements. J. Neurophysiol. 106, 667-679. doi: 10.1152/jn.00638.2010
26. Fodor, J. A., Bever, T. G., and Garrett, M. F. (1974). The Psychology of Language-An Introduction to Psycholinguistics and Generative Grammar. New York: McGraw-Hill.
27. Fourneret, P., and Jeannerod, M. (1998). Limited conscious monitoring of motor performance in normal subjects. Neuropsychologia 36, 1133-1140. doi: 10.1016/s0028-3932(98)00006-2
28. Fowler, C. A. (1980). Coarticulation and theories of extrinsic timing. J. Phon. 8, 113-133.
29. Fowler, C. A., Rubin, P., Remez, R. E., and Turvey, M. T. (1980). "Implications for speech production of a general theory of action, " in Language Production Vol. 1: Speech and Talk, ed B. Butterworth (London: Academic Press), 373-420.
30. Frith, C. D. (2014). Action, agency and responsibility. Neuropsychologia 55, 137-142. doi: 10.1016/j.neuropsychologia.2013.09.007
31. Fromkin, V. A. (1971). The nonanomalous nature of anomalous utterances. Language 47, 27-52. doi: 10.2307/412187
32. Fry, D. B. (1969). The linguistic evidence of speech errors. Brno Stud. Engl. 8, 69-74.
33. Gallagher, S. (2000). Philosophical conceptions of the self: implications for cognitive science. Trends Cogn. Sci. 4, 14-21. doi: 10.1016/s1364-6613(99)01417-5
34. Garrett, M. F. (1975). "The analysis of sentence production, " in The Psychology of Learning and Motivation, ed G. H. Bower (New York: Academic Press), 133-177.
35. Garrett, M. F. (1976). "Syntactic processes in sentence production, " in New Approaches to Language Mechanisms, eds R. Wales and E. C. T. Walker (Amsterdam: North-Holland Press), 231-255.
36. Garrett, M. F. (1980). "Levels of processing in sentence production, " in Language Production Vol. 1: Speech and Talk, ed B. L. Butterworth (London: Academic Press), 177-220.
37. Goldstein, L. (2004). Philosophical integrations. Lang. Sci. 26, 545-563. doi: 10.1016/j.langsci.2004.09.004
38. Greenlee, J. D. W., Behroozmand, R., Larson, C. R., Jackson, A. W., Chen, F., Hansen, D. R., et al. (2013). Sensory-motor interactions for vocal pitch monitoring in non-primary human auditory cortex. PLoS One 8:e60783. doi: 10.1371/journal.pone.0060783
39. Guenther, F. H., Ghosh, S. S., and Tourville, J. A. (2006). Neural modeling and imaging of the cortical interactions underlying syllable production. Brain Lang. 96, 280-301. doi: 10.1016/j.bandl.2005.06.001
40. Haggard, P., and Clark, S. (2003). Intentional action: conscious experience and neural prediction. Conscious. Cogn.12, 695-707. doi: 10.1016/s1053-8100(03)00052-7
41. Hall, L., Johansson, P., and Strandberg, T. (2012). Lifting the veil of morality: choice blindness and attitude reversals on a self-transforming survey. PLoS One 7:e45457. doi: 10.1371/journal.pone.0045457
42. Hall, L., Strandberg, T., Pärnamets, P., Lind, A., Tärning, B., and Johansson, P. (2013). How the polls can be both spot on and dead wrong: using choice blindness to shift political attitudes and voter intentions. PLoS One 8:e60554. doi: 10.1371/journal.pone.0060554
43. Hammarberg, R. (1976). The metaphysics of coarticulation. J. Phon. 4, 353-363.
44. Harris, R. (1981). The Language Myth. London: Duckworth.
45. Hartsuiker, R. J., and Kolk, H. H. J. (2001). Error monitoring in speech production: a computational test of the perceptual loop theory. Cogn. Psychol. 42, 113-157. doi: 10.1006/cogp.2000.0744
46. Heinks-Maldonado, T. H., Mathalon, D. H., Gray, M., and Ford, J. M. (2005). Fine-tuning of auditory cortex during speech production. Psychophysiology 42, 180-190. doi: 10.1111/j.1469-8986.2005.00272.x
47. Heinks-Maldonado, T. H., Nagarajan, S. S., and Houde, J. F. (2006). Magnetoencephalographic evidence for a precise forward model in speech production. Neuroreport 17, 1375-1379. doi: 10.1097/01.wnr.0000233102.43526.e9
48. Hickok, G. (2012). Computational neuroanatomy of speech production. Nat. Rev. Neurosci. 13, 135-145. doi: 10.1038/nrn3158
49. Hickok, G. (2014). The architecture of speech production and the role of the phoneme in speech processing. Lang. Cogn. Neurosci. 29, 2-20. doi: 10.1080/01690965.2013.834370
50. Houde, J. F., and Jordan, M. I. (1998). Sensorimotor adaptation in speech production. Science 279, 1213-1216. doi: 10.1126/science.279.5354.1213
51. Houde, J. F., and Jordan, M. I. (2002). Sensorimotor adaptation of speech I: compensation and adaptation. J. Speech Lang. Hear. Res. 45, 295-310. doi: 10.1044/1092-4388(2002/023)
52. Houde, J., Kort, N., and Niziolek, C. (2013). Neural evidence for state feedback control of speaking. Proc. Meet. Acoust. 19, 1-9. doi: 10.1121/1.4799495
53. Houde, J. F., Nagarajan, S. S., Sekihara, K., and Merzenich, M. M. (2002). Modulation of the auditory cortex during speech: an MEG study. J. Cogn. Neurosci. 14, 1125-1138. doi: 10.1162/089892902760807140
54. Howes, C., Healey, P. G. T., Eshghi, A., and Hough, J. (2013). "Well, that's one way": interactivity in parsing and production. Behav. Brain Sci. 36:359. doi: 10.1017/S0140525X12002592
55. Huettig, F., and Hartsuiker, R. J. (2010). Listening to yourself is like listening to others: external, but not internal, verbal self-monitoring is based on speech perception. Lang. Cogn. Process. 25, 347-374. doi: 10.1080/01690960903046926
56. Isius, A., Mitsuya, T., and Munhall, K. (2013). Does compensation in auditory feedback require attention? Proc. Meet. Acoust. 19, 1-8. doi: 10.1121/1.4799040
57. Johansson, P., Hall, L., Sikström, S., and Olsson, A. (2005). Failure to detect mismatches between intention and outcome in a simple decision task. Science 310, 116-119. doi: 10.1126/science.1111709
58. Johansson, P., Hall, L., Sikström, S., Tärning, B., and Lind, A. (2006). How something can be said about telling more than we can know. Conscious. Cogn. 15, 673-692. doi: 10.1016/j.concog.2006.09.004
59. Johansson, P., Hall, L., Tärning, B., Sikström, S., and Chater, N. (2013). Choice blindness and preference change: you will like this paper better if you (believe you) chose to read it! J. Behav. Decis. Mak. doi: 10.1002/bdm.1807
60. Jones, J. A., and Munhall, K. G. (2000). Perceptual calibration of F0 production: evidence from feedback perturbation. J. Acoust. Soc. Am. 108, 1246-1251. doi: 10.1121/1.1288414
61. Jones, J. A., and Munhall, K. G. (2005). Remapping auditory-motor representations in voice production. Curr. Biol.15, 1768-1772. doi: 10.1016/j.cub.2005.08.063
62. Kelso, J. A. S., and Tuller, B. (1985). Intrinsic time in speech production: theory, methodology and preliminary observations. Haskins Laboratories: Status Report on Speech Research SR-81, 23-39.
63. Keough, D., Hawco, C., and Jones, J. A. (2013). Auditory-motor adaptation to frequency-altered auditory feedback occurs when participants ignore feedback. BMC Neurosci. 14:25. doi: 10.1186/1471-2202-14-25
64. Kühn, S., Brass, M., and Haggard, P. (2013). Feeling in control: neural correlates of experience of agency. Cortex 49, 1935-1942. doi: 10.1016/j.cortex.2012.09.002
65. Ladefoged, P. (1967). Three Areas of Experimental Phonetics. London: Oxford University Press.
66. Lane, H., and Tranel, B. (1971). The Lombard sign and the role of hearing in speech. J. Speech Lang. Hear. Res. 14, 677-709.
67. Lane, H., and Webster, J. W. (1991). Speech deterioration in postlingually deafened adults. J. Acoust. Soc. Am. 89, 859-866. doi: 10.1121/1.1894647
68. Larson, C. R., Altman, K. W., Liu, H., and Hain, T. C. (2008). Interactions between auditory and somatosensory feedback for voice F0 control. Exp. Brain Res. 187, 613-621. doi: 10.1007/s00221-008-1330-z
69. Lashley, K. S. (1951). "The problem of serial order in behavior, " in Cerebral Mechanisms in Behaviour, ed L. A. Jeffress (NY: Wiley), 112-136.
70. Lee, B. S. (1950). Effects of delayed speech feedback. J. Acoust. Soc. Am. 22, 824-826. doi: 10.1121/1.1906696
71. Levelt, W. J. M. (1983). Monitoring and self-repair in speech. Cognition 14, 41-104. doi: 10.1016/0010-0277(83)90026-4
72. Levelt, W. J. M. (1989). Speaking. Cambridge, MA: MIT Press.
73. Levelt, W. J. M., Roelofs, A., and Meyer, A. S. (1999). A theory of lexical access in speech production. Behav. Brain Sci. 22, 1-75. doi: 10.1017/S0140525X99001776
74. Levelt, W. J. M., and Wheeldon, L. (1994). Do speakers have access to a mental syllabary? Cognition 50, 239-269. doi: 10.1016/0010-0277(94)90030-2
75. Lind, A., Hall, L., Johansson, P., Breidegard, B., and Balkenius, C. (in press). Real-time speech-exchange indicates that we use auditory feedback to specify the meaning of what we say. Psychol. Sci.
76. Linell, P. (1979). "On knowing what one is going to say, " in Kommunikativ kompetens Och Fackspråk, eds M. Linnrud and J. Svartvik (Lund: Läromedelscentralen), 1-17.
77. Linell, P. (1982). The concept of phonological form and the activities of speech production and speech perception. J. Phon. 10, 37-72.
78. Linell, P. (1998). Approaching Dialogue. Amsterdam: John Benjamins.
79. Linell, P. (2009). Rethinking Language, Mind and World Dialogically. Charlotte, NC: Information Age Publishing.
80. Logan, G. D., and Crump, M. J. C. (2010). Cognitive illusions of authorship reveal hierarchical error detection in skilled typists. Science 330, 683-686. doi: 10.1126/science.1190483
81. MacDonald, E. N., Goldberg, R., and Munhall, K. G. (2010). Compensations in response to real-time formant perturbations of different magnitudes. J. Acoust. Soc. Am. 127, 1059-1068. doi: 10.1121/1.3278606
82. Moore, J., and Fletcher, P. (2012). Sense of agency in health and disease: a review of cue integration approaches. Conscious. Cogn. 21, 59-68. doi: 10.1016/j.concog.2011.08.010
83. Moore, J. W., Wegner, D. M., and Haggard, P. (2009). Modulating the sense of agency with external cues. Conscious. Cogn. 18, 1056-1064. doi: 10.1016/j.concog.2009.05.004
84. Mowrey, R. A., and MacKay, I. R. A. (1990). Phonological primitives: electromyographic speech error evidence. J. Acoust. Soc. Am. 88, 1299-1312. doi: 10.1121/1.399706
85. Munhall, K. G., MacDonald, E. N., Byrne, S. K., and Johnsrude, I. (2009). Talkers alter vowel production in response to real-time formant perturbation even when instructed not to compensate. J. Acoust. Soc. Am. 125, 384-390. doi: 10.1121/1.3035829
86. Nasir, S. M., and Ostry, D. J. (2006). Somatosensory precision in speech production. Curr. Biol. 16, 1918-1923. doi: 10.1016/j.cub.2006.07.069
87. Nelson, A., Schneider, D. M., Takatoh, J., Sakurai, K., Wang, F., and Mooney, R. (2013). A circuit for motor cortical modulation of auditory cortical activity. J. Neurosci. 33, 14342-14353. doi: 10.1523/JNEUROSCI.2275-13.2013
88. Nozari, N., Dell, G. S., and Schwartz, M. F. (2011). Is comprehension necessary for error detection? A conflict-based account of monitoring in speech production. Cogn. Psychol. 63, 1-33. doi: 10.1016/j.cogpsych.2011.05.001
89. Özdemir, R., Roelofs, A., and Levelt, W. J. M. (2007). Perceptual uniqueness point effects in monitoring internal speech. Cognition 105, 457-465. doi: 10.1016/j.cognition.2006.10.006
90. Patel, R., and Schell, K. W. (2008). The influence of linguistic content on the lombard effect. J. Speech Lang. Hear. Res. 51, 209-220. doi: 10.1044/1092-4388(2008/016)
91. Pick, H. L., Siegel, G. M., Fox, P. W., Garber, S. R., and Kearney, J. K. (1989). Inhibiting the Lombard effect. J. Acoust. Soc. Am. 85, 894-900. doi: 10.1121/1.397561
92. Pickering, M. J., and Garrod, S. (2013). An integrated theory of language production and comprehension. Behav. Brain Sci. 36, 329-392. doi: 10.1017/S0140525X12001495
93. Postma, A. (2000). Detection of errors during speech production: a review of speech monitoring models. Cognition77, 97-131. doi: 10.1016/s0010-0277(00)00090-1
94. Purcell, D. W., and Munhall, K. G. (2006a). Compensation following real-time manipulation of formants in isolated vowels. J. Acoust. Soc. Am. 119, 2288-2297. doi: 10.1121/1.2173514
95. Purcell, D. W., and Munhall, K. G. (2006b). Adaptive control of vowel formant frequency: evidence from real-time formant manipulation. J. Acoust. Soc. Am. 120, 966-977. doi: 10.1121/1.2217714
96. Reddy, M. J. (1979). "The conduit metaphor: a case of frame conflict in our language about language, " in Metaphor and Thought, ed A. Ortony (Cambridge: Cambridge University Press), 284-310.
97. Shattuck-Hufnagel, S. (1979). "Speech errors as evidence for a serial-ordering mechanism in sentence production, " in Sentence Processing: Psycholinguistic Studies Presented to Merrill Garrett, eds W. E. Cooper and E. C. T. Walker (Hillsdale, NJ: Lawrence Erlbaum), 295-342.
98. Shiller, D. M., Sato, D., Gracco, V. L., and Baum, S. R. (2009). Perceptual recalibration of speech sounds following speech motor learning. J. Acoust. Soc. Am. 125, 1103-1113. doi: 10.1121/1.3058638
99. Sperber, D., and Wilson, D. (1986). Relevance. London: Blackwell Publishing.
100. Stroop, J. R. (1935). Studies of interference in serial verbal reactions. J. Exp. Psychol. 18, 643-662. doi: 10.1037/h0054651
101. Sugimori, E., Asai, T., and Tanno, Y. (2013). The potential link between sense of agency and output monitoring over speech. Conscious. Cogn. 22, 360-374. doi: 10.1016/j.concog.2012.07.010
102. Synofzik, M., Vosgerau, G., and Newen, A. (2008). Beyond the comparator model: a multifactorial two-step account of agency. Conscious. Cogn. 17, 219-239. doi: 10.1016/j.concog.2007.03.010
103. Takaso, H., Eisner, F., Wise, R. J. S., and Scott, S. K. (2010). The effect of delayed auditory feedback on activity in the temporal lobe while speaking: a positron emission tomography study. J. Speech Lang. Hear. Res. 53, 226-236. doi: 10.1044/1092-4388(2009/09-0009)
104. Tremblay, S., Shiller, D. M., and Ostry, D. J. (2003). Somatosensory basis of speech production. Nature 423, 866-869. doi: 10.1038/nature01710
105. Ventura, M. I., Nagarajan, S. S., and Houde, J. F. (2009). Speech target modulates speaking induced suppression in auditory cortex. BMC Neurosci. 10:58. doi: 10.1186/1471-2202-10-58
106. Vigliocco, G., and Hartsuiker, R. J. (2002). The interplay of meaning, sound and syntax in sentence production. Psychol. Bull. 128, 442-472. doi: 10.1037/0033-2909.128.3.442
107. Villacorta, V. M., Perkell, J. S., and Guenther, F. H. (2007). Sensorimotor adaptation to feedback perturbations of vowel acoustics and its relation to perception. J. Acoust. Soc. Am. 122, 2306-2319. doi: 10.1121/1.2773966
108. Vološinov, V. N. (1986). Marxism and the Philosophy of Language (L. Matejka and I. R. Titunik, Trans.). Cambridge, MA: Harvard University Press.
109. Waldstein, R. S. (1990). Effects of postlingual deafness on speech production: implications for the role of auditory feedback. J. Acoust. Soc. Am. 88, 2099-2114. doi: 10.1121/1.400107
110. Wegner, D., and Sparrow, B. (2004). "Authorship processing, " in The Cognitive Neurosciences: 3rd Edition, ed M. Gazzaniga (Cambridge, MA: MIT Press), 1201-1209.
111. Wegner, D., and Wheatley, T. (1999). Apparent mental causation: sources of the experience of will. Am. Psychol.54, 480-492. doi: 10.1037//0003-066x.54.7.480
112. Weiss, C., Tsakiris, M., Haggard, P., and Schütz-Bosbach, S. (2013). Agency in the sensorimotor system and its relation to explicit action awareness. Neuropsychologia 52, 82-92. doi: 10.1016/j.neuropsychologia.2013.09.034
113. Wheeldon, L. R., and Levelt, W. J. M. (1995). Monitoring the time course of phonological encoding. J. Mem. Lang.34, 311-334. doi: 10.1006/jmla.1995.1014