Multitimescale dynamical interactions between speech rhythm and gesture

Cognitive Science

Volumn 33, Issue 5, 2009, Pages 839-879

  Tilsen, Sam ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Coupled oscillators; Dynamical systems; Metrical theory; Motor coordination; Speech gesture; Speech rhythm; Task dynamics

Indexed keywords

EID: 77950766050     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1551-6709.2009.01037.x     Document Type: Article

References (85)

1. Abercrombie, D. (1967). Elements of general phonetics. Chicago: Aldine.
2. Alfonso, P., & Van Lieshout, P. (1997). Spatial and temporal variability in obstruent gestural specification by stutterers and controls: Comparisons across sessions. In W. Hulstijn, H. Peters, & P. Van Lieshout (Eds.), Speech production: Motor control, brain research, and fluency disorders (pp. 151-160). Amsterdam: Elsevier.
3. Allen, G. (1972). The location of rhythmic stress beats in English: An experimental study, parts I and II. Language and Speech, 15, 72-100, 179-195.
4. Allen, G. (1975). Speech rhythm: Its relation to performance universals and articulatory timing. Journal of Phonetics, 3, 75-86.
5. Arbib, M. (2005). From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics. Behavioral and Brain Sciences, 28, 105-167.
6. Barbosa, P. (2002). Explaining cross-linguistic rhythmic variability via a coupled-oscillator model of rhythm production. Speech Prosody 2002 Proceedings (pp. 163-166). Aix-en-Provence, France.
7. Beek, P., Peper, C., & Daffertshofer, A. (2002). Modeling rhythmic interlimb coordination: Beyond the Haken-Kelso-Bunz model. Brain and Cognition, 48, 149-165.
8. Beek, P., Peper, C., & Stegeman, D. (1995). Dynamical models of movement coordination. Human Movement Science, 14, 573-608.
9. Beer, R. (1995). A dynamical systems perspective on agent-environment interaction. Artificial Intelligence, 72, 173-215.
10. Blevins, J. (1995). The syllable in phonological theory. In J. Goldsmith (Ed.), The handbook of phonological theory (pp. 206-244). Cambridge, MA: Blackwell.
11. Browman, C., & Goldstein, L. (1988). Some notes on syllable structure in articulatory phonology. Phonetica, 45, 140-155.
12. Browman, C., & Goldstein, L. (1990). Tiers in articulatory phonology. In J. Kingston & M. Beckman (Eds.), Papers in laboratory phonology I. Between the grammar and physics of speech (pp. 341-376). Cambridge, England: Cambridge University Press.
13. Browman, C., & Goldstein, L. (2000). Competing constraints on intergestural coordination and self-organization of phonological structures. Bulletin de la Communication Parlee, 5, 25-34.
14. Carson, R., Goodman, D., Kelso, J., & Elliot, S. (1995). Phase transitions and critical fluctuations in rhythmic coordination of ipsilateral hand and foot. Journal of Motor Behavior, 27(33), 211-224.
15. Castellano, C., Fortunato, S., & Loreto, V. (2007). Statistical physics of social dynamics. arXiv:0710.3256.
16. Cummins, F., & Port, R. (1996). Rhythmic constraints on English stress timing. In H. T. Bunell & W. Idsardi (Eds.), Proceedings of the fourth international conference on spoken language processing (pp. 2036-2039). Wilmington, DE: Alfred duPont Institute.
17. Cummins, F., & Port, R. (1998). Rhythmic constraints on stress timing in English. Journal of Phonetics, 26, 145-171.
18. Dauer, R. (1983). Stress timing and syllable-timing reanalyzed. Journal of Phonetics, 11, 51-62.
19. Eriksson, A. (1991). Aspects of Swedish speech rhythm. Göteborg: University of Göteborg.
20. Fink, P., Foo, P., Jirsa, V., & Kelso, J. (2000). Local and global stabilization of coordination by sensory information. Experimental Brain Research, 134, 9-20.
21. Fowler, C. (1979). Perceptual centers in speech production and perception. Perception and Psychophysics, 25, 375-388.
22. Gabrielsson, A. (2003). Music performance research at the millennium. Psychology of Music, 31(3), 221-272.
23. Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996). Action recognition in the premotor cortex. Brain, 119 (2), 593-609.
24. Goldin-Meadow, S. (in press). Homesign: When gesture becomes language. In R. Pfau, M. Steinbach & B. Woll (Eds.), Handbook on sign language linguistics. Berlin: Mouton de Gruyter.
25. Goldstein, L., Byrd, D., & Saltzman, E. (2006). The role of vocal tract gestural action units in understanding the evolution of phonology. In M. A. Arbib (Ed.), From action to language: The mirror neuron system (pp. 215-249). Cambridge, England: Cambridge University Press.
26. Goldstein, L., & Fowler, C. (2003). Articulatory phonology: A phonology for public language use. In N. O. Schiller & A. S. Meyer (Eds.), Phonetics and phonology in language comprehension and productions (pp. 159-207). Berlin: Mouton de Gruyter.
27. Haken, H. (1975). Cooperative phenomena in systems far from thermal equilibrium and in nonphysical systems. Review of Modern Physics, 47, 67-121.
28. Haken, H. (1983). Synergetics, an introduction: Nonequilibrium phase transitions and self-organization in physics, chemistry, and biology (3rd ed.). New York: Springer-Verlag.
29. Haken, H., Kelso, J., & Bunz, H. (1985). A theoretical model of phase transitions in human hand movement. Biological Cybernetics, 51, 347-356.
30. Haken, H., Peper, C., Beek, P., & Daffertshofer, A. (1996). A model for phase transitions inhuman hand movements during multifrequency tapping. Physica D, 90, 179-196.
31. Halle, M., & Vergnaud, J. (1978). Metrical structures in phonology. Unpublished manuscript, MIT.
32. Hayes, B. (1995). Metrical stress theory: Principles and case studies. Chicago: University of Chicago Press.
33. Hoole, P. (1996). Issues in the acquisition, processing, reduction and parameterization of articulographic data. Forschungsberichte des Instituts für Phonetik und Sprachliche Kommunikation, München, 34, 158-173.
34. Howell, P. (1988). Prediction of P-center location from the distribution of energy in the amplitude envelope. Perceptual Psychophysics, 43(1), 90-93.
35. Hyman, L. (2006). Word-prosodic typology. Phonology, 23(2), 225-258.
36. de Jong, K. (1994). The correlation of P-center adjustments with articulatory and acoustic events. Perception & Psychophysics, 56(4), 447-460.
37. Keith, W., & Rand, R. (1984). 1:1 and 2:1 phase entrainment in a system of two coupled limit cycle oscillators. Journal of Mathematical Biology, 20, 122-152.
38. Kelso, J. (1981). On the oscillatory basis of movement. Bulletin of the Psychonomic Society, 18, 63.
39. Kelso, J. (1984). Phase transitions and critical behavior in human bimanual coordination. American Journal of Physiology; Regulatory, Integrative, and Comparative, 15, R1000-R1004.
40. Kelso, J. (1995). Dynamic patterns: The self-organization of brain and behavior. Cambridge, MA: MIT.
41. Kelso, J. A. S., & Fuchs, A. (1995). Self-organizing dynamics of the human brain: Critical instabilities and sil'nikov chaos. Chaos, 5(1), 64-69.
42. Kopell, N. (1988). Toward a theory of modeling central pattern generators. In A. Cohen, S. Rossignol, & S. Grillner (Eds.), Neural control of rhythmic movement in vertebrates (pp. 369-413). New York: John Wiley & Sons.
43. Liberman, M. (1975). The intonational system of English. PhD Dissertation. New York: MIT, Garland Publishing Co.
44. Liberman, M., & Prince, A. (1977). On stress and linguistic rhythm. Linguistic Inquiry, 8 (3), 249-336.
45. Mayer-Kress, G. J., & Newell, K. M. (2003). Noise and chaos in motor behavior models. Proceedings of SPIE - The International Society for Optical Engineering, 5110, 320-333.
46. Morton, J., Marcus, S., & Frankish, C. (1976). Perceptual centers (P-centers). Psychological Review, 83(5), 405-408.
47. Nam, H., & Saltzman, E. (2003). A competitive, coupled oscillator model of syllable structure. 15th International Congress of Phonetic Sciences, 3, 2253-2256.
48. Nespor, M., & Vogel, I. (1986). Prosodic phonology. Dordrecht: Foris Publications.
49. O'Dell, M., & Nieminen, T. (1999). Coupled oscillator model of speech rhythm. Proceedings of the XIV International Congress of Phonetic Sciences, 2, 1075-1078.
50. Oberman, L. M., & Ramachandran, V. S. (2007). The simulating social mind: The role of the mirror neuron system and simulation in social and communicative deficits of autism spectrum disorders. Psychological Bulletin, 133(2), 310-327.
51. Ohala, J. (1975). The temporal regulation of speech. In G. Fant & M. A. A. Tatham (Eds.), Auditory analysis and the perception of speech (pp. 431-453). New York: Academic Press.
52. Palmer, C. (1997). Music performance. Annual Review of Psychology, 48, 115-138.
53. Patel, A., Löfqvist, A., & Naito, W. (1999). The acoustics and kinematics of regularly timed speech: A database and method for the study of the p-center problem. Proceedings of the 14th International Congress of Phonetic Sciences, 1, 405-408.
54. Peper, C., & Beek, P. (1998). Distinguishing between effects of frequency and amplitude on interlimb coupling in tapping a 2:3 polyrhythm. Experimental Brain Research, 118, 78-92.
55. Peper, C., de Boer, B., de Poel, H., & Beek, P. (2008). Interlimb coupling strength scales with movement amplitude. Neuroscience Letters, 437, 10-14.
56. Pike, K. (1945). The intonation of American English. Ann Arbor, MI: University of Michigan Press.
57. Pikovsky, A., Rosenblum, M., & Kurths, J. (2001). Synchronization: A universal concept in nonlinear sciences. Cambridge: Cambridge Press.
58. de Poel, H., Peper, C., & Beek, P. (2007). Handedness-related asymmetry in coupling strength in bimanual coordination: Furthering theory and evidence. Acta Psychology, 124, 209-237.
59. Pompino-Marschall, B. (1989). On the psychoacoustic nature of the P-center phenomenon. Journal of Phonetics, 17, 175-192.
60. Port, R. (1986). Translating linguistic symbols into time. Research into phonetics and computational linguistics. Report No. 5, Bloomington, IN: Department of Linguistics and Computational Linguistics, Indiana University.
61. Port, R. (2003). Meter and Speech. Journal of Phonetics, 31, 599-611.
62. Port, R., Cummins, F., & Gasser, M. (1995). A dynamic approach to rhythm in language: Toward a temporal phonology. Technical Report No. 105. Bloomington, IN: Indiana University Cognitive Science Program.
63. Ramus, F., Nespor, M., & Mehler, J. (1999). Correlates of linguistic rhythm in the speech signal. Cognition, 73, 265-292.
64. Saltzman, E. (1986). Task dynamic coordination of the speech articulators: A preliminary model. Experimental Brain Research Series, 15, 129-144.
65. Saltzman, E., & Byrd, D. (1999). Dynamical simulations of a phase window model of relative timing. In J. Ohala, Y. Hasegawa, M. Ohala, D. Granville, & A. C. Bailey (Eds.), Proceedings of the XIVth international congress of phonetic sciences (pp. 2275-2278). New York: American Institute of Physics.
66. Saltzman, E., & Byrd, D. (2000). Task-dynamics of gestural timing: Phase windows and multifrequency rhythms. Human Movement Science, 19, 499-526.
67. Saltzman, E., & Kelso, J. (1983). Skilled actions: A task dynamic approach. Haskins Laboratories Status Report on Speech Research, SR-76, 3-50.
68. Saltzman, E., & Kelso, J. (1987). Skilled actions: A task-dynamic approach. Psychological Review, 94, 84-106.
69. Saltzman, E., & Munhall, K. (1989). A dynamical approach to gestural patterning in speech production. Ecological Psychology, 1, 333-382.
70. Saltzman, E., Nam, H., Goldstein, L., & Byrd, D. (2006). The distinctions between state, parameter and graph dynamics in sensorimotor control and coordination. In M. L. Latash & F. Lestienne (Eds.), Motor control and learning (pp. 63-73). New York: Springer Publishing.
71. Saltzman, E., Nam, H., Krivokapic, J., & Goldstein, L. (2008). A task-dynamic toolkit for modeling the effects of prosodic structure on articulation. In P. A. Barbosa, S. Madureira, & C. Reis (Eds.), Proceedings of the 4th international conference on speech prosody (speech prosody 2008). Brazil: Campinas.
72. Schmidt, R., Carello, C., & Turvey, M. (1990). Phase transitions and critical fluctuations in the visual coordination of rhythmic movements between people. Journal of Experimental Psychology, Human Perception and Performance, 16(2), 227-247.
73. Schöner, G., Haken, H., & Kelso, J. (1986). A stochastic theory of phase transitions in human hand movement. Biological Cybernetics, 53(44), 247-257.
74. Scott, S. (1993). P-centers in speech: An acoustic analysis. Unpublished Doctoral Dissertation, University College London.
75. Scott, S. (1998). The point of P-centres. Psychological Research, 61, 4-11.
76. So, W. C., Kita, S., & Goldin-Meadow, S. (in press). Using the hands to keep track of who does what to whom: Gesture and speech go hand-in-hand. Cognitive Science.
77. Sternad, D., Turvey, M., & Saltzman, E. (1999). Dynamics of 1:2 coordination: Sources of symmetry breaking. Journal of Motor Behavior, 31(3), 224-235.
78. Treffner, P., & Peter, M. (2002). Intentional and attentional dynamics of speech-hand coordination. Human Movement Science, 21, 641-697.
79. Treffner, P., & Turvey, M. (1995). Handedness and the asymmetric dynamics of bimanual rhythmic coordination. Journal of Experimental Psychology, Human Perception and Performance, 21, 318-333.
80. Tuller, B., & Fowler, C. (1980). Some articulatory correlates of perceptual isochrony. Perception and Psychophysics, 27, 277-283.
81. Van Lieshout, P. (2004). Dynamical systems theory and its application in speech. In B. Maassen, R. Kent, H. Peters, P. van Lieshout, & W. Hulstijn (Eds.), Speech motor control in normal and disordered speech (pp. 51-82). Oxford, England: Oxford University Press.
82. Vorberg, D., & Wing, A. (1996). Modeling variability and dependence in timing. In H. Heuer & S. Keele (Eds.), Handbook of perception and action, volume 2: Motor skills (pp. 181-262). London: Harcourt Brace & Company.
83. Westbury, J., Lindstrom, M., & McClean, M. (2002). Tongues and lips without jaws: A comparison of methods for decoupling speech movements. Journal of Speech, Language, and Hearing Research, 45(4), 651-662.
84. Winfree, A. T. (1980). The geometry of biological time. New York: Springer-Verlag.
85. Wing, A., & Kristofferson, A. (1973). Response delays and the timing of discrete motor responses. Perception & Psychophysics, 14(1), 5-12.