Acoustic packaging: Maternal speech and action synchrony

IEEE Transactions on Autonomous Mental Development

Volumn 3, Issue 2, 2011, Pages 154-162

  Meyer, Meredith ^a   Hard, Bridgette ^b   Brand, Rebecca J ^c   McGarvey, Molly ^c   Baldwin, Dare A ^d  

^a UNIVERSITY OF MICHIGAN   (United States)

^b STANFORD UNIVERSITY   (United States)

^c VILLANOVA UNIVERSITY   (United States)

^d UNIVERSITY OF OREGON   (United States)

Author keywords

Action processing; multimodal communication; pediatrics; speech processing

Indexed keywords

ACTION PROCESSING; ACTION UNIT; INFANT-DIRECTED SPEECH; LOW-PASS; MULTIMODAL COMMUNICATIONS; NON-ACTION;

ELECTRIC GROUNDING; SEMANTICS; SPEECH PROCESSING;

SPEECH RECOGNITION;

EID: 79959235091     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2010.2103941     Document Type: Article

References (41)

1. D. A. Baldwin and J. A. Baird, "Discerning intentions in dynamic human action," Trends Cogn. Sci., vol. 5, pp. 171-178, Apr. 2001. (Pubitemid 32243977)
2. D. Newtson and G. Engquist, "The perceptual organization of ongoing behavior," J. Exp. Soc. Psychol., vol. 12, pp. 436-450, Sep. 1976.
3. N. K. Speer, K. M. Swallow, and J. M. Zacks, "Activation of human motion processing areas during event perception," Cogn. Affect. Behav. Neurosci., vol. 3, pp. 335-345, Dec. 2003. (Pubitemid 40214839)
4. J. M. Zacks, T. S. Braver, M. A. Sheridan, D. I. Donaldson, A. Z. Snyder, and J. M. Ollinger et al., "Human brain activity time-locked to perceptual event boundaries," Nat. Neurosci., vol. 4, pp. 651-655, Jun. 2001. (Pubitemid 32507380)
5. J. M. Zacks and K. M. Swallow, "Event segmentation," Curr. Direct. Psychol. Sci., vol. 16, p. 8084, Apr. 2007.
6. B.M. Hard, B. Tversky, and D. Lang, "Making sense of abstract events: Building event schemas," Mem. Cogn., vol. 34, pp. 1221-1235, Jun. 2006. (Pubitemid 46044213)
7. R. C. Schank and R. P. Abelson, Scripts, Plans, Goals, and Understanding: An Inquiry Into Human Knowledge Structures. Hillsdale, NJ: Erlbaum, 1977.
8. D. A. Baldwin, J. Baird, M. M. Saylor, and M. A. Clark, "Infants parse dynamic action," Child Develop., vol. 72, pp. 708-718, May/June 2001.
9. M. M. Saylor, D. A. Baldwin, J. A. Baird, and J. LaBounty, "Infants' on-line segmentation of dynamic human action," J. Cogn. Develop., vol. 8, pp. 113-128, Feb. 2007. (Pubitemid 46358348)
10. K. Hirsh-Pasek and R. M. Golinkoff, The Origins of Grammar: Evidence from Early Language Comprehension. Cambridge, MA: MIT Press, 1996.
11. P. Zukow-Goldring, "Socio-perceptual bases for the emergence of language: An alternative to innatist approaches," Develop. Psychol. Biol., vol. 23, pp. 705-726.
12. L. Schillingmann, B. Wrede, and K. J. Rohlfing, "A computational model of acoustic packaging," IEEE Trans. Auton. Mental Develop., vol. 1, no. 4, pp. 226-237, Dec. 2009.
13. M. Rolf, M. Hanheide, and K. J. Rohlfing, "Attention via synchrony: Making use of multimodal cues in social learning," IEEE Trans Auton. Mental Develop., vol. 1, no. 1, pp. 55-67, May 2009.
14. Talking to Children: Language Input and Acquisition, C. E. Snow and C. A. Ferguson, Eds. Cambridge, U.K.: Cambridge Univ. Press, 1977.
15. P. K. Kuhl, "Early language acquisition: Cracking the speech code," Nat. Rev. Neurosci., vol. 5, no. 11, pp. 831-843, Nov. 2004. (Pubitemid 39482152)
16. A. Fernald, "Intonation and communicative intent in mother's speech to infants: Is the melody the message?," Child Develop., vol. 60, pp. 1497-1510, Dec. 1989.
17. G. A. Bryant and H. C. Barrett, "Recognizing intentions in infant-directed speech," Psychol. Sci., vol. 18, pp. 746-751, Aug. 2007.
18. A. Fernald, "Approval and disapproval: Infant responsiveness to vocal affect in familiar and unfamiliar languages," Child Develop., vol. 63, pp. 657-674, Jun. 1993.
19. E. D. Thiessen, E. Hill, and J. R. Saffran, "Infant-directed speech facilitates word segmentation," HIFC, vol. 7, pp. 53-71, Feb. 2005. (Pubitemid 40528902)
20. H. Bortfeld, J. Morgan, R. Golinkof, K. Rathbun, and K., "Mommy and me: Familiar names help launch babies into speech stream segmentation," Psychol. Sci., vol. 16, pp. 298-304, Apr. 2005. (Pubitemid 40550739)
21. P. W. Jusczyk, K. Hirsh-Pasek, D. G. Kemler Nelson, L. Kennedy, A. Woodward, and J. Piwoz, "Perception of acoustic correlates of major phrasal units by young infants," Cogn. Psychol., vol. 24, pp. 252-293, Apr. 1992.
22. A. Fernald, "Human maternal vocalizations to infants as biologically relevant signals: An evolutionary perspective," in The Adapted Mind, J. H. Barkow, L. Cosmides, and J. Tooby, Eds. New York: Oxford Univ. Press, 1992, pp. 391-428.
23. R. J. Brand, D. A. Baldwin, and L. A. Ashburn, "Evidence for 'motionese': Modifications in mothers' infant-directed action," Develop. Sci., vol. 5, pp. 72-83, Mar. 2002.
24. R. J. Brand, W. L. Shallcross, M. G. Sabatos, and K. P. Massie, "Finegrained analysis of motionese: Eye gaze, object exchanges, and action units in infant-versus adult-directed action," HIFC, vol. 11, pp. 203-214, May 2007. (Pubitemid 46901825)
25. Y. Nagai and K. J. Rohlfing, "Can motionese tell infants and robots 'what to imitate'?," in Proc. 4th Int. Symp. Imitation Animals Artif., New Castle, U.K., 2007, pp. 299-306.
26. J. Schmidt, J. Fritsch, and B. Kwolek, "Kernel particle filter for realtime 3D body tracking in monocular color images," in Proc. 7th Int. Conf. Autom. Face Gesture Recogn., Southampton, U.K., 2006, pp. 567-572. (Pubitemid 44711409)
27. K. J. Rohlfing, J. Fritsch, B. Wrede, and T. Jungmann, "How can multimodal cues from child-directed interaction reduce learning complexity in robots?," Adv. Robot., vol. 20, no. 10, pp. 1183-1199, Oct. 1, 2006. (Pubitemid 44671142)
28. P. K. Kuhl and A. N. Meltzoff, "Speech as an intermodal object of perception," in Perceptual Development in Infancy: The Minnesota Symposia on Child Phonology, A. Yonas, Ed. Hillsdale, NJ: Erlbaum, 1988, vol. 20, pp. 235-266.
29. K. MacKain, M. Studdert-Kennedy, S. Spieker, and D. Stern, "Infant intermodal speech perception is a left-hemisphere function," Science, vol. 219, pp. 1347-1349, Mar. 1983. (Pubitemid 13109174)
30. L. Bahrick, R. Lickliter, and R. Flom, "Intersensory redundancy guides the development of selective attention, perception, and cognition in infancy," Curr. Direct. Psychol. Sci., vol. 13, pp. 99-102, Jun. 2004. (Pubitemid 38783081)
31. L. Bahrick and R. Lickliter, "Intersensory redundancy guides attentional selectivity and perceptual learning in infancy," Dev. Psychol., vol. 36, pp. 190-210, Mar. 2000.
32. L. J. Gogate and L. E. Bahrick, "Intersensory redundancy and 7-month-old infants' memory for arbitrary syllable-object relations," HIFC, vol. 2, no. 2, pp. 219-231, May 1, 2001. (Pubitemid 33670609)
33. D. A. Baldwin, "Infants' ability to consult the speaker for clues to word reference," J. Child Lang., vol. 20, pp. 395-418, Jun. 1993.
34. L. Gogate, L. Bahrick, and J. Watson, "A study of multimodal motherese: The role of temporal synchrony between verbal labels and gestures," Child Develop., vol. 71, no. 4, pp. 878-894, Jul. 2000.
35. R. J. Brand and S. Tapscott, "Acoustic packaging of action sequences by infants," HIFC, vol. 11, pp. 321-332, May 2007. (Pubitemid 46952214)
36. M. Tomasello and A. Kruger, "Joint attention on actions: Acquiring verbs in ostensive and non-ostensive contexts," J. Child Lang., vol. 19, pp. 311-333, Jun. 1992.
37. B. Hard, "Reading the language of action: Hierarchical encoding of observed behavior," Ph.D. dissertation, Stanford Univ., Stanford, CA, 2006.
38. B. Hard and G. Recchia, "Reading the language of action," in Proc. 28th Annu. Conf. Cogn. Sci. Soc., N. A. Taatgen and H. van Rijn, Eds., Vancouver, BC, Canada, 2006, pp. 1433-1439.
39. M. Meyer, P. De Camp, B. Hard, D.A. Baldwin, and D. Roy, "Assessing behavioral and computational approaches to naturalistic action segmentation," in Proc. 32nd Annu. Conf. Cogn. Sci. Soc., S. Ohlsson and R. Catrambone, Eds., Vancouver, BC, Canada, 2010, pp. 2710-2715.
40. P. Boersma and D. Weenik, Praat: Doing Phonetics by Computer (Version 5.1.05) Computer Program [Online]. Available: http://www.praat.org
41. D. Mazzoni and R. Dannenburg, Audacity (Version 1.2.6.a) [Online]. Available: http://audacity.sourceforge.net/