Spoken language processing: Piecing together the puzzle

Speech Communication

Volumn 49, Issue 5, 2007, Pages 418-435

  Moore, Roger K ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Communicative behaviour; Sensorimotor control; Speech technology; Spoken language processing

Indexed keywords

COMPUTER SIMULATION; MATHEMATICAL MODELS; SPEECH PROCESSING; USER INTERFACES;

COMMUNICATIVE BEHAVIOR; SENSORIMOTOR CONTROL; SPEECH TECHNOLOGY; SPOKEN LANGUAGE PROCESSING;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 34247636615     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2007.01.011     Document Type: Article

References (148)

1. Abler W.L. On the particulate principle of self-diversifying systems. J. Social Biol. Struct. 12 (1989) 1-13
2. Aboitiz F., Garcia R., Brunetti E., and Bosman C. Imitation and memory in language origins. Neural Networks 18 (2005) 1357
3. Alexandrov Y.I., and Sams M.E. Emotion and consciousness: end of a continuum. Cognitive Brain Res. 25 (2005) 387-405
4. Altmann G.T. The Ascent of Babel (1997), Oxford University Press
5. Arnold K., and Zuberbühler K. Semantic combinations in primate cells. Nature 441 (2006) 303
6. Axelrod, S., Maison, B., 2004. Combination of hidden Markov models with dynamic time warping for speech recognition. In: Proc. IEEE ICASSP.
7. Bailly G. Learning to speak: sensori-motor control of speech movements. Speech Comm. 22 (1997) 251-267
8. Bara B.G. Cognitive Pragmatics (2005), MIT Press, Cambridge, MA
9. Baron-Cohen S. Mindblindness: Essay on Autism and the Theory of Mind (1997), The MIT Press
10. Baron-Cohen S., Leslie A.M., and Frith U. Does the autistic child have a "theory of mind"?. Cognition 21 (1985) 37-46
11. Barto A.G. Adaptive critics and the basal ganglia. In: Houk J.C., Davis J., and Beiser D. (Eds). Models of Information in the Basal Ganglia (1995), MIT Press, Cambridge, MA 215-232
12. Becchio C., Adenzato M., and Bara B.G. How the brain understands intention: different neural circuits identify the componential features of motor and prior intentions. Conscious. Cognit. 15 (2006) 64-74
13. Becker J. Relation of neurological findings on decoupling of brain activity from limb movement to Piagetian ideas on the origin of thought. Cognitive Develop. 21 (2006) 194-198
14. Blomberg, M., Carlson, R., Elenius, K., Granström, B., Hunnicutt, S., Lindell, R., Neovius, L., 1987. Speech recognition based on a text-to-speech synthesis system. In: Laver, J., Jack, M.A. (Eds.), European Conf. on Speech Technology, Edinburgh, pp. 369-372.
15. Bourlard H., Hermansky H., and Morgan N. Towards increasing speech recognition error rates. Speech Comm. 18 (1996) 205-231
16. Brainard M.S., and Doupe A.J. What songbirds teach us about learning. Nature 417 (2002) 351-358
17. Bregman A.S. Auditory Scene Analysis: The Perceptual Organisation of Sound Bradford Books (1990), MIT Press, Cambridge, MA
18. Bridle J.S., and Ralls M.P. An approach to speech recognition using synthesis by rule. In: Fallside F., and Woods W. (Eds). Computer Speech Processing (1985), Prentice Hall
19. Brunswik, E., 1952. The conceptual framework of psychology. In: International Encyclopaedia of Unified Science, Vol. 1, University of Chicago.
20. Burke, J. 1995. Connections. Time Warner International.
21. Chartrand T.L., and Bargh J.A. The chameleon effect: the perception-behavior link and social interaction. J. Personality Social Psychol. 76 (1999) 893-910
22. Chella A., Dindo H., and Infantino I. A cognitive framework for imitation learning. Robot. Autonom. Systems 54 (2006) 403-408
23. Cherry C. On Human Communication: A Review a Survey and a Criticism (1978), The MIT Press
24. Clarke H.H. Speaking in time. Speech Comm. 36 (2002) 5-13
25. Cooke M. Glimpsing speech. J. Phonetics 31 (2003) 579-584
26. Cooke M., Green P., Josifovski L., and Vizinho A. Robust automatic speech recognition with missing data and unreliable acoustic data. Speech Comm. 34 (2001) 267-285
27. Cowley S.J. Simulating others: the basis of human cognition. Lang. Sci. 26 (2004) 273-299
28. Cox M.T. Metacognition in computation: a selected research review. Artif. Intell. 169 (2005) 104-141
29. Darwin C. The Expression of Emotions in Man and Animals (1872), John Murray, London
30. In: Davidson R., Scherer K.R., and Goldsmith H. (Eds). Handbook of Affective Sciences (2003), Oxford University Press
31. Dawkins R. The Blind Watchmaker (1991), Penguin
32. Denes P.B., and Pinson E.N. The Speech Chain: The Physics and Biology of Spoken Language (1973), Anchor Press, New York
33. De Wachter, M., Demuynck, K., van Compernolle, D., Wambacq, P., 2003. Data driven example based continuous speech recognition. In: Proc. Eurospeech.
34. In: Douglas-Cowie E., Cowie R., and Campbell N. (Eds). Speech and emotion. Speech Communication 40 1-3 (2003) special issue
35. Doyle, L., 2006. Talking with your mouth full: the feeding calls of the humpback whale. .
36. Dutoit T. An Introduction to Text-to-Speech Synthesis (1997), Kluwer Academic Publishers
37. Ekman P. Basic emotions. In: Dalgleish T., and Power M. (Eds). Handbook of Cognition and Emotion (1999), John Wiley, New York pp. 301-320)
38. Emmorey, K., 2002. The neural systems underlying language: insights from sign language research. In: Proc. AAAS Annual Meeting, pp. 1-4.
39. Everman, G., Chan, H.Y., Gales, M.J.F, Jia, B., Mrva, D, Woodland, P.C., 2005. Training LVCSR systems on thousands of hours of data. In: Proc. IEEE ICASSP, Philadelphia, pp. 209-212.
40. Fadiga L., Craghero L., Buccino G., and Rizzolatti G. Speech listening specifically modulates the excitability of tongue muscles: a TMS study. Eur. J. Neurosci. 15 (2002) 399-402
41. Fairbanks G. Selective vocal effects of delayed auditory feedback. J. Speech Hearing Disorders 4 (1955) 333-346
42. Fallside, F., 1990. Synfrec: Speech synthesis from recognition using neural networks. In: Proc. ESCA Workshop on Speech Synthesis, pp. 237-240.
43. Figueredo A.J., Hammond K.R., and McKierman E.C. A Brunswikian evolutionary developmental theory of preparedness and plasticity. Intelligence 34 (2006) 211-227
44. Fitch W.T. The evolution of speech: a comparative review. Trends Cognitive Sci. 4 7 (2000) 258-267
45. Fitch W.T., and Hauser M.D. Computational constraints on syntactic processing in a nonhuman primate. Science 303 (2004) 377-380
46. Fowler C.A. An event approach to the study of speech perception from a direct-realist perspective. J. Phonetics 14 1 (1986) 3-28
47. Frith C. Attention to action and awareness of other minds. Conscious. Cognit. 11 (2002) 481-487
48. Fry D. Homo Loquens: Man as a Talking Animal (1977), Cambridge University Press
49. Fujisaki, H., 2005. Communication of intention and modeling the mind - lessons from a study on human-machine dialogue systems. In: Proc. Internat. Symp. on Communication Skills of Intention, Fukuoka.
50. Geers A.E., and Moog J.S. Speech perception and production skills of students with impaired hearing from oral and total communication education settings. J. Speech Hearing Res. 35 (1992) 1384-1393
51. Gerdes V.G.J., and Happee R. The use of an internal representation in fast goal-directed movements: a modeling approach. Biol. Cybernet. 70 (1994) 513-524
52. Goldinger S.D. Words and voices: episodic traces in spoken word identification and recognition memory. J. Exp. Psychol.: Learn. Memory Cogn. 22 5 (1996) 1166-1183
53. Goldinger S.D. Echoes of echoes: an episodic theory of lexical access. Psychol. Rev. 105 2 (1998) 251-279
54. Gopnik, A., Meltzoff, A.N., Kuhl, P.K., 2001. The Scientist in the Crib. Perennial.
55. Grand, S., 2003. Growing Up With Lucy, Phoenix.
56. Greenberg, S., 1996. Understanding speech understanding: towards a unified theory of speech perception. In: Proc. ESCA Workshop on Auditory Basis of Speech Perception, pp. 1-8.
57. Grush R. The emulation theory of representation: motor control, imagery, and perception. Behav. Brain Sci. 27 (2004) 377-442
58. Grush R. Perception, imagery, and the sensorimotor loop. In: Esken H. (Ed). A Consciousness Reader (1998), Schoeningh-Verlag
59. Hartsuiker R.J., and Kolk H.H. Error monitoring in speech production: a computational test of the perceptual loop theory. Cogn. Psychol. 42 (2001) 113-157
60. Hauser M.D., Chomsky N., and Fitch W.T. The faculty of language: what is it who, has it, and how did it evolve?. Science 298 (2002) 1569-1579
61. Hawkins S. Roles and representations of systematic fine phonetic detail in speech understanding. J. Phonetics 31 (2003) 373-405
62. Hawkins J. On Intelligence (2004), Times Books
63. Hawkins S. Puzzles and patterns in 50 years of research on speech perception. From Sound to Sense: 50+ Years of Discoveries in Speech Communication (2004), MIT, Cambridge, MA, USA
64. Hawkins, J, George, D., 2006. Hierarchical temporal memory. Technical White Paper, Numeta Inc.
65. Hermansky H. Should recognizers have ears?. Speech Comm. 25 (1998) 3-27
66. Hintzman D.L. Schema-abstraction in a multiple-trace memory model. Psychol. Rev. 93 (1986) 411-427
67. Hoare T., and Milner R. Grand challenges for computing research. Computer J. 48 1 (2005) 49-52
68. Holden C. The origin of speech. Science 303 (2004) 1316-1319
69. Holmes J., and Holmes W. Speech Recognition and Synthesis (2002), Taylor and Francis
70. Howard, I.S., Huckvale, M.A., 2005. Training a vocal tract synthesizer to imitate speech using distal supervised learning. In: Proc. SPECOM, pp. 159-162.
71. Howell P. A model of timing interference to speech control in normal and altered listening conditions applied to the treatment of stuttering. In: Maassen B., Hulstijn W., Kent R., Peters KF.M., and van Lieshout P.H.M.M. (Eds). Speech Motor Control in Normal and Disordered Speech (2001), Uttgevrij Vantilt, Nijmegen 91-294
72. Howell P. The EXPLAN theory of fluency control applied to the treatment of stuttering by altered feedback and operant procedures. In: Fava E. (Ed). Pathology and Therapy of Speech Disorders (2002), John Benjamins, Amsterdam
73. Huang X., Acero A., and Hon H. Spoken Language Processing (2001), Prentice-Hall
74. Jarvis E.D. Learned birdsong and the neurobiology of human language. Ann. NY Acad. Sci. 1016 (2004) 749-777
75. Jelinek F. Five speculations (and a divertimento) on the themes of H. Bourlard, H. Hermansky, and N. Morgan. Speech Comm. 18 (1996) 242-246
76. Jelinek F. Statistical Methods for Speech Recognition (1998), MIT Press
77. Junqua J.-C. The influence of acoustics on speech production: a noise-induced stress phenomenon known as the Lombard reflex. Speech Commun. 20 (1996) 13-22
78. Keller E. Towards greater naturalness: future directions of research in speech synthesis. In: Keller E., Bailly G., Monaghan A., Terken J., and Huckvale M. (Eds). Improvements in Speech Synthesis (2001), Wiley & Sons, Chichester, UK
79. In: Keller E., Bailly G., Monaghan A., Terken J., and Huckvale M. (Eds). Improvements in Speech Synthesis (2001), Wiley & Sons, Chichester, UK
80. Kuhl P.K. Early language acquisition: cracking the speech code. Nature Rev.: Neurosci. 5 (2004) 831-843
81. Lane H., and Tranel D. The Lombard sign and the role of hearing in speech. J. Speech Hearing Res. 14 (1971) 677-709
82. Lee, C.-H., 2004. From knowledge-ignorant to knowledge-rich modeling: a new speech research paradigm for next generation automatic speech recognition. In: Proc. ICSLP, Korea.
83. Leggetter, C.J., Woodland, P., 1994. Speaker adaptation of continuous density HMMs using linear regression. In: Proc. ICSLP, pp. 451-454.
84. Lengagne T., Aubin T., Lauga J., and Jouventin P. How do king penguins (Aptenodytes patagonius) apply the mathematical theory of information to communicate in windy conditions?. Proc. Roy. Soc. Lond. 266 (1999) 1623-1628
85. Levelt W.J.M. Monitoring and self-repair in speech. Cognition 14 (1983) 41-104
86. Levelt W.J.M. Speaking: from Intention to Articulation (1989), MIT Press, Cambridge, MA
87. Levelt W.J.M. The perceptual loop theory not disconfirmed: a reply to MacKay. Conscious. Cognit. 1 (1992) 226-230
88. Levelt W.J.M. Spoken word production: a theory of lexical access. Proc. Natl. Acad. Sci. 98 23 (2001) 13464-13471
89. Levelt W.J.M., Roelofs A., and Meyer A.S. A theory of lexical access in speech production. Behav. Brain Sci. 22 (1999) 1-75
90. Liberman A.M., and Mattingly I.G. The motor theory of speech perception revised. Cognition 21 (1985) 1-36
91. Lindblom B. Explaining phonetic variation: a sketch of the H&H theory. In: Hardcastle W., and Marchal A. (Eds). Speech Production and Speech Modeling (1990), Kluwer 403-439
92. Lippmann R. Speech recognition by machines and humans. Speech Comm. 22 (1997) 1-16
93. Lombard E. Le sign de l'élévation de la voix. Ann. Maladies Oreille, Larynx, Nez, Pharynx 37 (1911) 101-119
94. Maier, V., Moore, R.K., 2005. An investigation into a simulation of episodic memory for automatic speech recognition. In: Proc. InterSpeech, Lisbon, pp. 1245-1248.
95. Mairesse, F., Walker, M., 2005. Learning to personalize spoken generation for dialogue systems. In: Proc. EUROSPEECH'05, Lisbon, pp. 1881-1884.
96. Makhoul J., and Schwartz R. Ignorance modelling. In: Perkell J., and Klatt D.H. (Eds). Invariance and Variability in Speech Processes (1984), Erlbaum
97. Marr D. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information (1982), Freeman & Co., San Francisco
98. Maslow A.H. A theory of human motivation. Psychol. Rev. 50 (1943) 370-396
99. Meguerditchiana A., and Vauclair J. Baboons communicate with their right hand. Behav. Brain Res. 171 1 (2006) 170-174
100. Meltzoff M., and Moore K. Explaining facial imitation: a theoretical model. Early Develop. Parenting 6 (1997) 179-192
101. Messum, P., 2005. Learning to talk: a non-imitative account of the replication of phonetics by child learners. Unpublished Report, Department of Phonetics and Linguistics, University College London.
102. Moore, R.K., 1993. Whither a theory of speech pattern processing. In: Proc. Eurospeech, Berlin.
103. Moore R.K. Critique: the potential role of speech production models in automatic speech recognition. J. Acoust. Soc. Amer. 99 3 (1996) 1710-1713
104. Moore, R.K., 2005a. Towards a unified theory of spoken language processing. In: Proc. 4th IEEE Internat. Conf. on Cognitive Informatics, Irvine, CA, USA, 8-10 August, pp. 167-172.
105. Moore, R.K., 2005b. Cognitive informatics: the future of spoken language processing? In: Keynote talk, SPECOM - 10th Internat. Conf. on Speech and Computer, Patras, Greece, 17-19 October.
106. Moore, R.K., 2005c. Research challenges in the automation of spoken language interaction. Keynote talk, COST278 and ISCA Tutorial and Research Workshop (ITRW) on Applied Spoken Language Interaction in Distributed Environments (ASIDE 2005), Aalborg University, Denmark, 10-11 November.
107. Moore, R.K., Cutler, A., 2001. Constraints on theories of human vs. machine recognition of speech. In: Proc. SPRAAC Workshop on Human Speech Recognition as Pattern Classification, Max-Planck-Institute for Psycholinguistics, Nijmegen, 11-13 July, pp. 145-150.
108. Morgan N., Zhu Q., Stolcke A., Sönmez K., Sividas S., Shinozaki T., Ostendorf M., Jain P., Hermansky H., Ellsi D., Doddington G., Chen B., Çetin O., Bourlard H., and Athineos M. Pushing the envelope-aside. IEEE Signal Process. Mag. 22 5 (2005) 81-88
109. Mountcastle V.B. An organizing principle for cerebral function the unit model and the distributed system. In: Edelman G.M., and Mountcastle V.B. (Eds). The Mindful Brain (1978), MIT Press
110. Nicolelis M.A.L. Actions from thoughts. Nature 409 (2001) 403-407
111. Norris D.G. Shortlist: a connectionist model of continuous speech recognition. Cognition 52 3 (1994) 163-253
112. Pacherie E., and Dokic J. From mirror neurons to joint actions. Cogn. Systems Res. 7 (2006) 101-112
113. Perkell J., Matthies M., Lane H., Guenther F., Wilhelms-Tricarico R., Wozniak J., and Guiod P. Speech motor control: acoustic goals, saturation effects, auditory feedback and internal models. Speech Comm. 22 (1997) 227-250
114. Pinker S. The Language Instinct (1994), Penguin Books
115. Powers W.T. Behaviour: The Control of Perception (1973), Aldine, Hawthorne, NY
116. Powers, W.T., 2005. A brief introduction to perceptual control theory. .
117. Pulvermüller F. Brain mechanisms linking language and action. Nature Neurosci. Rev. 6 (2005) 576-582
118. Rabiner L., and Juang B.-H. Fundamentals of Speech Recognition (1993), Prentice-Hall
119. Rizzolatti G., and Arbib M.A. Language within our grasp. Trends Neurosci. 21 (1998) 188-194
120. Rizzolatti G., and Craighero L. The mirror-neuron system. Annu. Rev. Neurosci. 27 (2004) 169-192
121. Rizzolatti G., Fadiga L., Gallese V., and Fogassi L. Premotor cortex and the recognition of motor actions. Cogn. Brain Res. 3 (1996) 131-141
122. Scharenborg O., ten Bosch L., Boves L., and Norris D. Bridging automatic speech recognition and psycholinguistics: extending shortlist to an end-to-end model of human speech recognition. J. Acoust. Soc. Amer. 114 6 (2003) 3023-3035
123. Scharenborg, O., McQueen, J., ten Bosch, L., Norris, D., 2003b. Modelling human speech recognition using automatic speech recognition paradigms in SpeM. In: Proc. Eurospeech, Geneva, pp. 2097-2100.
124. Scharenborg O., Norris D., ten Bosch L., and McQueen J.M. How should a speech recogniser work?. Cogn. Sci. 29 (2005) 867-918
125. Scherer K.R. Vocal communication of emotion: a review of research paradigms. Speech Comm. 40 (2003) 227-256
126. In: Scherer K.R., Schorr A., and Johnstone T. (Eds). Appraisal Processes in Emotion: Theory, Methods Research (2001), Oxford University Press, New York and Oxford
127. Shannon C.E., and Weaver W. The Mathematical Theory of Communication (1949), University of Illinois Press
128. Sinha P. Recognizing complex patterns. Nature Neurosci. Suppl. 5 (2002) 1093-1097
129. Slaney M. A critique of pure audition. In: Rosenthal D., and Okuno H. (Eds). Computational Auditory Scene Analysis (1997), Lawrence Erlbaum, Associates 27-42
130. Slevc L.R., and Ferreira V.S. Halting in single word production: a test of the perceptual loop theory of speech monitoring. J. Memory Lang. 54 (2006) 515-540
131. Sokhi D.S., Hunter M.D., Wilkinson I.D., and Woodruff P.W.R. Male and female voices activate distinct regions in the male brain. NeuroImage 27 (2005) 572-578
132. Stevens K.N. On the quantal nature of speech. J. Phonetics 17 1/2 (1989) 3-45
133. Studdart-Kennedy M. Mirror neurons, vocal imitation, and the evolution of particulate speech. In: Stamenov M.I., and Gallese V. (Eds). Mirror Neurons and the Evolution of Brain and Language (2002), Benjamins, Philadelphia 207-227
134. Taylor M.M. Editorial: perceptual control theory and its applications. Int. J. Human-Computer Studies 50 (1999) 433-444
135. Taylor J.G., and Fragopanagos N.F. The interaction of attention and emotion. Neural Networks 18 (2005) 353-369
136. Tremblay S., Shiller D.M., and Ostry D.J. Somatosensory basis of speech production. Lett. Nature 423 (2003) 866-869
137. Tulving E. Episodic memory: from mind to brain. Annu. Rev. Psychol. 53 (2002) 1-25
138. Varga, A.P., Moore, R.K., 1990. Hidden Markov model decomposition of speech and noise. In: Proc. IEEE Internat. Conf. on Acoustics, Speech and Signal Processing, Albuquerque, 3-6 April, pp. 845-848.
139. Varga, A.P., Moore, R.K., 1991. Simultaneous recognition of concurrent speech signals using hidden Markov model decomposition. In: Proc. Eurospeech, Genova, September, pp. 1175-1178.
140. Walker M., Whittaker S., Stent A., Maloor P., Moore J., Johnston M., and Vasireddy G. Generation and evaluation of user tailored responses in multimodal dialogue. Cognitive Sci. 28 (2004) 811-840
141. Wang Y. On cognitive informatics. Brain Mind 4 (2003) 151-167
142. Warren J.E., Wise R.J.S., and Warren J.D. Sounds doable: auditory-motor transformations and the posterior temporal plane. Trends Neurosci. 28 12 (2005) 636-643
143. Wilson M., and Knoblich G. The case for motor involvement in perceiving conspecifics. Psychol. Bull. 131 3 (2005) 460-473
144. Wilson S.M., Saygin A.P., Sereno M.I., and Iacoboni M. Listening to speech activates motor areas involved in speech production. Nature Neurosci. 7 7 (2004) 701-702
145. Wundt W. Grundzüge der Physiologischen Psychologie (1874), Engelmann, Leipzig
146. Yarbus A.L. Eye Movements and Vision (1967), Plenum Press, New York
147. Yu A.C., and Margoliash D. Temporal hierarchical control of singing in birds. Science 273 (1996) 1871-1875
148. Zipf G.K. Human Behavior and the Principal of Least Effort (1949), Addision-Wesley Press, Cambridge