A computational model of acoustic packaging

IEEE Transactions on Autonomous Mental Development

Volumn 1, Issue 4, 2009, Pages 226-237

  Schillingmann, Lars ^a   Wrede, Britta ^a   Rohlfing, Katharina J ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

Acoustic packaging; Action representation; Action segmentation; Robot action learning; Tutoring situation

Indexed keywords

ACOUSTIC INFORMATION; ACTION SEGMENTATION; ACTION SEQUENCES; COMPUTATIONAL MODEL; EVALUATION RESULTS; FURTHER DEVELOPMENT; MULTI-MODAL; ROADMAP; ROBOT ACTION LEARNING; ROBOT ACTIONS; SOCIAL INTERACTIONS; TEMPORAL INTERVALS; TEMPORAL OVERLAP;

HUMAN ROBOT INTERACTION; LINGUISTICS; PACKAGING; TECHNOLOGICAL FORECASTING;

ACOUSTICS;

EID: 77952889330     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2009.2039135     Document Type: Article

References (46)

1. K. Hirsh-Pasek and R. M. Golinkoff, The Origins of Grammar: Evidence From Early Language Comprehension. Cambridge, MA: MIT Press, 1996.
2. J. M. Zacks and B. Tversky, "Event structure in perception and conception," Psychol. Bulletin, vol.127, pp. 3-21, 2001.
3. J. M. Zacks and K. M. Swallow, "Event segmentation," Current Direct. Psychol. Sci., vol.16, no.2, pp. 80-84, Apr. 2007.
4. K. J. Rohlfing, J. Fritsch, B. Wrede, and T. Jungmann, "How can multimodal cues from child-directed interaction reduce learning complexity in robots?," Adv. Robot., vol.20, no.10, pp. 1183-1199, 2006.
5. P. Zukow-Goldring, "Sensitive caregiving fosters the comprehension of speech: When gestures speak louder than words," Early Develop. Parenting, vol.5, no.4, pp. 195-211, 1996.
6. P. Zukow-Goldring, "Assisted imitation: Affordances, effectivities, and the mirror system in early language development," in Action to Language Via the Mirror Neuron System, M. A. Arbib, Ed. Cambridge, MA: Cambridge Univ. Press, 2006, pp. 469-500.
7. L. E. Bahrick, R. Lickliter, and R. Flom, "Intersensory redundancy guides the development of selective attention, perception, and cognition in infancy," Current Direct. Psychol. Sci., pp. 99-102, Jun. 2004.
8. L. J. Gogate and L. E. Bahrick, "Intersensory redundancy and 7-month-old infants' memory for arbitrary syllable-object relations," Infancy, vol.2, no.2, pp. 219-231, 2001.
9. R. J. Brand and S. Tapscott, "Acoustic packaging of action sequences by infants," Infancy, vol.11, no.3, pp. 321-332, 2007.
10. J. K. Aggarwal, "Problems, ongoing research and future directions in motion research," Mach. Vis. Appl., vol.14, no.4, pp. 199-201, Sep. 2003.
11. U. Gargi, R. Kasturi, and S. Antani, "Performance characterization and comparison of video indexing algorithms," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Santa Barbara, CA, 1998, pp. 559-565.
12. B. Janvier, E. Bruno, T. Pun, and S. Marchand-Maillet, "Informationtheoretic temporal segmentation of video and applications: Multiscale keyframes selection and shot boundaries detection," Multimedia Tools Appl., vol.30, no.3, pp. 273-288, Sep. 2006.
13. W.Wolf, "Key frame selection by motion analysis," in Proc. Int. Conf. Acoust., Speech, Signal Process., Orlando, FL, Aug. 2002, vol.2, pp. 1228-1231.
14. J. W. Davis and A. F. Bobick, "The representation and recognition of human movement using temporal templates," in Proc. Conf. Comput. Vis. Pattern Recog., Washington, DC, 1997, p. 928.
15. C. Schuldt, I. Laptev, and B. Caputo, "Recognizing human actions: A local svm approach," in Proc. 17th Int. Conf. Pattern Recog., Barcelona, Spain, Sep. 2004, vol.3, pp. 32-36.
16. Y. Rui and P. Anandan, "Segmenting visual actions based on spatiotemporal motion patterns," in Proc. Conf. Comput. Vis. Pattern Recog., Atlantic City, NJ, Aug. 2000, vol.1, pp. 1111-1118.
17. D. Zhang, D. G. Perez, S. Bengio, I. McCowan, and G. Lathoud, "Multimodal group action clustering in meetings," in Proc. ACM 2nd Int. Workshop Video Surveillance Sensor Netw., New York, NY, USA, 2004, pp. 54-62.
18. S. Schaal, "Is imitation learning the route to humanoid robots?," Trends Cogn. Sci., vol.3, no.6, pp. 233-242, 1999.
19. M. Pardowitz, R. Haschke, J. J. Steil, and H. Ritter, "Gestalt-based action segmentation for robot task learning," in Proc. 8th IEEE-RAS Int. Conf. Humanoid Robot., Daejeon, Korea, Dec. 2008, pp. 347-352.
20. S. Ekvall and D. Kragic, "Integrating object and grasp recognition for dynamic scene interpretation," in Proc. IEEE/RSJ Int. Conf. Adv. Robot., 2005, pp. 331-336.
21. S. B. Kang and K. Ikeuchi, "Toward automatic robot instruction from perception-recognizing a grasp from observation," IEEE Trans. Robot. Autom., vol.9, pp. 432-443, Sep. 1993.
22. Y. Nagai and K. J. Rohlfing, "Computational analysis of motionese toward scaffolding robot action learning," IEEE Trans. Autonom. Mental Develop., vol.1, no.1, pp. 44-54, May 2009.
23. L. J. Gogate, L. E. Bahrick, and J. D. Watson, "A study of multimodal motherese: The role of temporal synchrony between verbal labels and gestures," Child Develop., vol.71, no.4, pp. 878-894, 2000.
24. M. Rolf, M. Hanheide, and K. J. Rohlfing, "Attention via synchrony: Making use of multimodal cues in social learning," IEEE Trans. Autonom. Mental Develop., vol.1, no.1, pp. 55-67, May 2009.
25. Y. Zhang and J. Weng, "Conjunctive visual and auditory development via real-time dialogue," in Proc. 3rd Int. Workshop Epigenetic Robot., Boston, MA, Aug. 2003, pp. 974-980.
26. C. Breazeal, G. Hoffman, and A. Lockerd, "Teaching and working with robots as a collaboration," in Proc. 3rd Int. Joint Conf. Autonom. Agents Multiagent Syst., Washington, DC, USA, 2004, pp. 1030-1037.
27. J. Hershey and J. Movellan, "Using audio-visual synchrony to locate sounds," Adv. Neural Info. Process. Syst. 12, vol.12, pp. 813-819, 1999.
28. J. Fritsch and S. Wrede, "An integration framework for developing interactive robots," Software Eng. Experimental Robot., pp. 291-305, 2007.
29. G. A. Fink, "Developing hmm-based recognizers with esmeralda," in Proc. 2nd Int. Workshop Text, Speech, Dialogue, London, U.K., 1999, pp. 229-234.
30. F. Lömker, S. Wrede, M. Hanheide, and J. Fritsch, "Building modular vision systems with a graphical plugin environment," in IEEE Int. Conf. Comput. Vis. Syst., New York, NY, 2006, p. 2.
31. J. F. Allen, "Maintaining knowledge about temporal intervals," Comm. ACM, vol.26, no.11, pp. 832-843, Nov. 1983.
32. L. Schillingmann, B. Wrede, K. Rohlfing, and K. Fischer, "The structure of robot-directed interaction compared to adult- and infant- directed interaction using a model for acoustic packaging," in Spoken Dialogue Human-Robot Interaction Workshop, Oct. 2009.
33. Y. Nagai, C. Muhl, and K. J. Rohlfing, "Toward designing a robot that learns actions from parental demonstrations," in IEEE Int. Conf. Robot. Autom., Pasadena, CA, 2008, pp. 3545-3550.
34. R. J. Brand, D. A. Baldwin, and L. A. Ashburn, "Evidence for 'motionese': modifications in mothers' infant-directed action," Develop. Sci., vol.5, no.1, pp. 72-83, Mar. 2002.
35. G. J. Hollich, K. Hirsh-Pasek, R. M. Golinkoff, R. J. Brand, E. Brown, H. L. Chung, E. Hennon, and C. Rocroi, "Breaking the language barrier: an emergentist coalition model for the origins of word learning," Monographs Soc. Res. Child Develop., vol.65, no.3, 2000.
36. B. Wrede, S. Kopp, K. J. Rohlfing, M. Lohse, and C. Muhl, "Appropriate feedback in asymmetric interactions," J. Pragmat., to be published.
37. M. Asada, K. Hosoda, Y. Kuniyoshi, H. Ishiguro, T. Inui, Y. Yoshikawa, M. Ogino, and C. Yoshida, "Cognitive developmental robotics: A survey," IEEE Trans. Autonom. Mental Develop., vol.1, no.1, pp. 12-34, May 2009.
38. K. Pitsch, A. L. Vollmer, J. Fritsch, B. Wrede, K. Rohlfing, and G. Sagerer, "On the loop of action modification and the recipient's gaze in adult-child interaction," in Gesture and Speech in Interaction. Poznan, Poland: , 2009, pp. 1-17.
39. C. Breazeal and B. Scassellati, "Challenges in building robots that imitate people," in Imitation in Animals and Artifacts. Cambridge, MA: MIT Press, 2001, pp. 363-390.
40. C. Breazeal and B. Scassellati, "Robots that imitate humans," Trends Cogn. Sci., vol.6, no.11, pp. 481-487, Nov. 2002.
41. M. Carpenter and J. Call, "The question of 'what to imitate': Inferring goals and intentions from demonstrations," in Imitation and Social Learning in Robots, Humans and Animals, C. Nehaniv and K. Dautenhahn, Eds. Cambridge, MA: Cambridge Univ. Press, 2007, pp. 135-151.
42. T. W. Boyer and B. I. Bertenthal , "Predictive tracking of social and non-social stimuli," presented at the Biennial Int. Conf. Inf. Studies, Vancouver, BC, Canada, 2008.
43. F. Tamburini and P. Wagner, "On automatic prominence detection for german," in Proc. INTERSPEECH-2007, Antwerp, Belgium, 2007, pp. 1809-1812.
44. L. W. Barsalou, "Perceptual symbol systems," Behav. Brain Sci., vol.22, no.4, pp. 577-660, Aug. 1999.
45. M. Tomasello, "First steps toward a usage-based theory of language acquisition," Cogn. Ling., vol.11, no.1-2, pp. 61-82, Feb. 2001.
46. L. Schillingmann, B. Wrede, and K. Rohlfing, "Towards a computational model of acoustic packaging," in Proc. Int. Conf. Develop. Learn., Jun. 2009.