Learning to talk about events from narrated video in a construction grammar framework

Artificial Intelligence

Volumn 167, Issue 1-2, 2005, Pages 31-61

  Dominey, Peter Ford ^a   Boucher, Jean David ^a  

^a CNRS   (France)

Author keywords

Event recognition; Grammatical construction; Language acquisition; Language technology

Indexed keywords

IMAGE RECONSTRUCTION; PATTERN RECOGNITION;

EVENT RECOGNITION; GRAMMATICAL CONSTRUCTION; LANGUAGE ACQUISITION; LANGUAGE TECHNOLOGY;

LEARNING SYSTEMS;

EID: 24144435982     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2005.06.007     Document Type: Article

References (47)

1. E. Bates, S. McNew, B. MacWhinney, A. Devescovi, and S. Smith Functional constraints on sentence processing: A cross linguistic study Cognition 11 1982 245 299
2. J.M. Blanc, C. Dodane, and P.F. Dominey Temporal processing for syntax acquisition: A simulation study Proceedings of the 25th Ann Conf. Cog. Sci. Soc. 2003 MIT Press Cambridge, MA
3. C.M. Brown, P. Hagoort, and M. ter Keurs Electrophysiological signatures of visual lexical processing: Open- and closed-class words J. Cognitive Neurosci. 11 3 1999 261 281
4. D. Caplan, C. Baker, and F. Dehaut Syntactic determinants of sentence comprehension in aphasia Cognition 21 1985 117 175
5. N. Chomsky The Minimalist Program 1995 MIT Press Cambridge, MA
6. F. Chang Symbolically speaking: A connectionist model of sentence production Cognitive Sci. 93 2002 1 43
7. N.C. Chang, T.V. Maia, Grounded learning of grammatical constructions, in: Proc. AAAI Spring Symp. on Learning Grounded Representations, Stanford, CA, 2001
8. E. Clark First Language Acquisition 2003 Cambridge University Press Cambridge
9. G.W. Cottrel, B. Bartell, and C. Haupt Grounding meaning in perception Proc. GWAI90,14th German Workshop on Artificial Intelligence 1990 Springer Berlin 307 321
10. P.F. Dominey Conceptual grounding in simulation studies of language acquisition Evolution of Communication 4 1 2000 57 85
11. P.F. Dominey, Learning grammatical constructions in a miniature language from narrated video events, in: Proceedings of the 25th Annual Meeting of the Cognitive Science Society, Boston, 2003
12. P.F. Dominey, Learning grammatical constructions from narrated video events for Human-Robot interaction, in: Proc. IEEE Conf. on Humanoid Robotics, Karlsruhe, 2003
13. P.F. Dominey, Boucher, Developmental stages of perception and language acquisition in a perceptually grounded robot, Cognitive Systems Res. (2005), in press
14. P.F. Dominey, M. Hoen, T. Lelekov, and J.M. Blanc Neurological basis of language in sequential cognition: Evidence from simulation, aphasia and ERP studies Brain and Language 86 2 2003 207 225
15. P.F. Dominey, T. Inui, A developmental model of syntax acquisition in the construction grammar framework with cross-linguistic validation in English and Japanese, in: Proceedings of the CoLing Workshop on Psycho-Computational Models of Language Acquisition, Geneva, 2004, pp. 33-40
16. P.F. Dominey, and F. Ramus Neural network processing of natural language: I. Sensitivity to serial, temporal and abstract structure of language in the infant Lang. Cognitive Processes 15 1 2000 87 127
17. J. Elman Finding structure in time Cognitive Sci. 14 1990 179 211
18. J.A. Feldman, G. Lakoff, A. Stolcke, and S.H. Weber Miniature language acquisition: A touchstone for cognitive science Proceedings of the 12th Ann Conf. Cog. Sci. Soc. 1990 MIT Press Cambridge, MA 686 693
19. J. Feldman, G. Lakoff, D. Bailey, S. Narayanan, T. Regier, and A. Stolcke L0: The first five years Artificial Intelligence Rev. 10 1996 103 129
20. A. Fern, R. Givan, and J.M. Siskind Specific-to-general learning for temporal events with application to learning event definitions from video J. Artificial Intelligence Res. 17 2002 379 449
21. F. Ferreira The misinterpretation of noncanonical sentences Cognitive Psychol. 47 2003 164 203
22. C. Fisher Structural limits on verb mapping: The role of analogy in children's interpretation of sentences Cognitive Psychol. 31 1996 41 81
23. J. Gillette, H. Gleitman, L. Gleitman, and A. Lederer Human simulation of vocabulary learning Cognition 73 1999 135 151
24. A. Goldberg Constructions: A Construction Grammar Approach to Argument Structure 1995 Univ. Chicago Press Chicago
25. P. Gorniak, and D. Roy Grounded semantic composition for visual scenes J. Artificial Intelligence Res. 21 2004 429 470
26. P.J. Kellman, H. Gleitman, and E.S. Spelke Object and observer motion in the perception of objects by infants J. Experimental Psychol. - Human Perception and Performance 13 4 1987 586 593
27. L. Kotovsky, and R. Baillargeon The development of calibration-based reasoning about collision events in young infants Cognition 67 1998 311 351
28. R. Langacker Foundations of Cognitive Grammar. Practical Applications, vol. 2 1991 Stanford University Press Stanford, CA
29. J. Mandler Preverbal representations and language P. Bloom M.A. Peterson L. Nadel M.F. Garrett Language and Space 1999 MIT Press Cambridge, MA 365 384
30. R. Miikkulainen Subsymbolic case-role analysis of sentences with embedded clauses Cognitive Sci. 20 1996 47 73
31. J.L. Morgan, R. Shi, and P. Allopenna Perceptual bases of rudimentary grammatical categories J.L. Morgan K. Demuth Signal to Syntax 1996 Lawrence Erlbaum Mahwah, NJ 263 286
32. M.J. Pickering, and S. Garrod Toward a mechanistic psychology of dialogue Behav. Brain. Sci. 27 2 2004 169 190 discussion 190-226
33. P.C. Quinn Concepts are not just for objects: Categorization of spatial relation information by infants D.H. Rakison L.M. Oakes Early Category and Concept Development: Making Sense of the Blooming, Buzzing Confusion 2003 Oxford University Press Oxford 50 76
34. P.C. Quinn, J.L. Polly, M.J. Furer, V. Dobson, and D.B. Nanter Young infants' performance in the object-variation version of the above-below categorization task Infancy 3 2002 323 347
35. T. Regier The Human Semantic Potential 1996 MIT Press Cambridge, MA
36. D. Roy Learning visually grounded words and syntax for a scene description task Computer Speech and Language 16 2002 353 385
37. D. Roy, and A. Pentland Learning words from sights and sounds: A computational model Cognitive Sci. 26 1 2002 113 146
38. A.J. Sanford, and P. Sturt Depth of processing in language comprehension: Not noticing the evidence Trends Cognitive Sci. 6 9 2002 382 386
39. R. Shi, J.F. Werker, and J.L. Morgan Newborn infants' sensitivity to perceptual cues to lexical and grammatical words Cognition 72 2 1999 B11 B21
40. J.M. Siskind A computational study of cross-situational techniques for learning word-to-meaning mappings Cognition 61 1996 39 91
41. J.M. Siskind Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic J. Artificial Intelligence Res. 15 2001 31 90
42. L. Steels Language games for autonomous robots IEEE Intelligent Syst. 16 5 2001 16 22
43. L. Steels, and J.C. Baillie Shared grounding of event descriptions by autonomous robots Robotics and Autonomous Systems 43 2-3 2003 163 173
44. A. Stolcke, and S.M. Omohundro Inducing probabilistic grammars by Bayesian model merging Grammatical Inference and Applications: Proc. 2nd Intl. Colloq. on Grammatical Inference 1994 Springer Berlin
45. L. Talmy Force dynamics in language and cognition Cognitive Sci. 10 2 1988 117 149
46. M. Tomasello The item-based nature of children's early syntactic development Trends Cognitive Sci. 4 4 1999 156 163
47. M. Tomasello Constructing a Language: A Usage-Based Theory of Language Acquisition 2003 Harvard University Press Cambridge