The minimalist grammar of action

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 367, Issue 1585, 2012, Pages 103-117

  Pastra, Katerina ^a   Aloimonos, Yiannis ^b  

^a Embodied Language Processing Group   (Greece)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

Action decomposition; Action syntax; Generative grammar of action; Minimalist grammar; Temporal sequence; Tool use

Indexed keywords

COGNITION; COMPLEXITY; HOMINID; HUMAN BEHAVIOR; LANGUAGE; LEARNING; NEUROLOGY; NUMERICAL MODEL; TOOL USE;

EID: 81555210913     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2011.0123     Document Type: Article

References (62)

1. Lashley, K. 1951 The problem of serial order in behaviour. In Cerebral mechanisms in behaviour (ed. L. Jefress), pp. 112-137. New York, NY: Wiley.
2. Leroi-Gourhan, A. 1964 Le geste et la parole, vols. 2. Paris, France: Albin Michel.
3. Bauer, P. 1995 Recalling past events: from infancy to early childhood. Ann. Child Dev. 11, 25-71.
4. Whiten, A., Flynn, E., Brown, K. & Lee, T. 2006 Imitation of hierarchical action structure by young children. Dev. Sci. 9, 574-582. (doi:10.1111/j.1467-7687.2006.00535.x)
5. Allen, K., Ibara, S., Seymour, A., Cordova, N. & Botvinick, M. 2010 Abstract structural representations of goal-directed behavior. Psychol. Sci. J. Am. Psychol. Soc. 21, 1518-1524. (doi:10.1177/0956797610383434)
6. Fadiga, L., Fogassi, L., Gallese, V. & Rizzolatti, G. 2000 Visuomotor neurons: ambiguity of the discharge or 'motor' perception? Int. J. Psychophysiol. 35, 165-177. (doi:10.1016/S0167-8760(99)00051-3)
7. Fogassi, L., Ferrari, P., Gesierich, B., Rozzi, S., Chersi, F. & Rizzolatti, G. 2005 Parietal lobe: from action organization to intention understanding. Science 308, 662-667. (doi:10.1126/science.1106138)
8. Aloimonos, Y., Guerra-Filho, G. & Ogale, A. 2009 The language of action: a new tool for human-centric interfaces. In Human centric interfaces for ambient intelligence (eds H. Aghajan, J. Augusto & R. Delgado), pp. 95-131. New York, NY: Academic Press.
9. Aloimonos, Y. 2008 HAL: human activity language. J. Vision 8. (doi:10.1167/8.6.1050)
10. Guerra-Filho, G. 2007 A sensory-motor linguistic framework for human activity understanding. PhD thesis. Department of Computer Science, University of Maryland, College Park.
11. Chomsky, N. 1995 The minimalist program. Cambridge, MA: MIT Press.
12. Chomsky, N. 2005 Three factors in language design. Linguist. Inq. 36, 1-22. (doi:10.1162/0024389052993655)
13. Fadiga, L., Craighero, L. & D'Ausilio, A. 2009 Broca's area in language, action, and music. Ann. NY Acad. Sci. 1169, 448-458. (doi:10.1111/j.1749-6632.2009.04582.x)
14. Fazio, P., Cantagallo, A., Craighero, L., D'Ausilio, A., Roy, A., Pozzo, T., Calzolari, F., Granieri, E. & Fadiga, L. 2009 Encoding of human action in Broca's area. Brain 132, 1980-1988. (doi:10.1093/brain/awp118)
15. Flash, T. & Hochner, B. 2005 Motor primitives in vertebrates and invertebrates. Curr. Opin. Neurobiol. 15, 660-666. (doi:10.1016/j.conb.2005.10.011)
16. Viviani, P. 1986 Do units of motor action really exist? In Generation and modulation of action patterns (eds H. Heuer & C. Fromm), pp. 201-216. New York, NY: Springer-Verlag.
17. Mussa-Ivaldi, F. & Bizzi, E. 2009 Motor learning through the combination of primitives. Phil. Trans. R. Soc. B 355, 1755-1769. (doi:10.1098/rstb.2000.0733)
18. Hart, C. & Giszter, S. 2004 Modular premotor drives and unit bursts as primitives for frog motor behaviours. J. Neurosci. 24, 5269-5282. (doi:10.1523/JNEUROSCI. 5626-03.2004)
19. Stein, P. 2005 Neuronal control of turtle hind limb motor rhythms. J. Comput. Physiol. 191, 213-229. (doi:10.1007/s00359-004-0568-6)
20. Roitman, A., Massaquoi, S., Takahashi, K. & Ebner, T. 2004 Kinematic analysis of manual tracking in monkeys: characterization of movement intermittencies during a circular tracking task. J. Neurophysiol. 91, 901-911. (doi:10.1152/jn.00261.2003)
21. Pasalar, S., Roitman, A. & Ebner, T. 2005 Effects of speeds and force fields on submovements during circular manual tracking in humans. Exp. Brain Res. 163, 214-225. (doi:10.1007/s00221-004-2169-6)
22. Fishbach, A., Roy, S., Bastianen, C., Miller, L. & Houk, J. 2005 Kinematic properties of on-line error corrections in the monkey. Exp. Brain Res. 164, 442-457. (doi:10.1007/ s00221-005-2264-3)
23. Jeannerod, M. 1994 Object oriented action. In Insights into the reach and grasp movement (eds K. Bennett & U. Castiello), pp. 3-15. London, UK: Elsevier Science.
24. d'Avella, A., Saltiel, P. & Bizzi, E. 2003 Combinations of muscle synergies in the construction of a natural motor behaviour. Nat. Neurosci. 6, 300-308. (doi:10.1038/ nn1010)
25. Tresch, M., Saltiel, P. & Bizzi, E. 1999 The construction of movement by the spinal cord. Nat. Neurosci. 2, 162-167. (doi:10.1038/5721)
26. Cheung, V., d'Avella, A., Tresch, M. & Bizzi, E. 2005 Central and sensory contributions to the activation and organization of muscle synergies during natural motor behaviours. J. Neurosci. 25, 6419-6434. (doi:10.1523/ JNEUROSCI.4904-04.2005)
27. Ting, L. & MacPherson, J. 2005 A limited set of muscle synergies for force control during a postural task. J. Neurophysiol. 93, 609-613. (doi:10.1152/jn.00681.2004)
28. Ivanenko, Y., Cappellini, G., Dominici, N., Poppele, R. & Lacquaniti, F. 2005 Coordination of locomotion with voluntary movements in humans. J. Neurosci. 25, 7238-7253. (doi:10.1523/JNEUROSCI.1327-05.2005)
29. Arbib, M. 1992 Schema theory. In The Encyclopedia of artificial intelligence (ed. S. Shapiro), pp. 1427-1443. New York, NY: Wiley Interscience.
30. Jeannerod, M., Arbib, M., Rizzolatti, G. & Sakata, H. 1995 Grasping objects. The cortical mechanisms of visuomotor transformation. Trends Neurosci. 18, 314-320. (doi:10.1016/0166-2236(95)93921-J)
31. Juhola, M. 1995 A syntactic analysis method for eye movements of vestibule-ocular reflex. Comput. Methods Programs Biomed. 46, 59-65. (doi:10.1016/0169-2607 (94)01599-B)
32. del Vecchio, D., Murray, R. & Perona, P. 2003 Decomposition of human motion into dynamicsbased primitives with application to drawing tasks. Automatica 39, 2085-2098. (doi:10.1016/S0005-1098 (03)00250-4)
33. Jenkins, O. & Mataric, M. 2003 Automated derivation of behavior vocabularies for autonomous humanoid motion. In Proc. Int. Conf. Autonomous Agents Multi-Agent Systems, Melbourne, Australia, July, pp. 225-232. (doi:10.1145/860575.860612)
34. Rohrer, B., Fasoli, S., Krebs, H., Hughes, R., Volpe, B., Frontera, W. R., Stein, J. & Hogan, N. 2002 Movement smoothness changes during stroke recovery. J. Neurosci. 22, 8297-8304
35. Grinyagin, I., Biryukova, E. & Maier, M. 2005 Kinematic and dynamic synergies of human precision-grip movements. J. Neurophysiol. 94, 2284-2294. (doi:10. 1152/jn.01310.2004)
36. Kang, N., Shinohara, M., Zatsiorsky, V. & Latash, M. 2004 Learning multifinger synergies: an uncontrolled manifold analysis. Exp. Brain Res. 157, 336-350. (doi:10.1007/s00221-004-1850-0)
37. Jerde, T. & Flanders, M. 2003 Coarticulation in fluent fingerspelling. J. Neurosci. 23, 2383-2393.
38. Fod, A., Mataric, M. & Jenkins, O. 2002 Automated derivation of primitives for movement classification. Auton. Robots 12, 39-54. (doi:10.1023/A:1013254 724861)
39. Kahol, K., Tripathi, P. & Panchanathan, S. 2004 Automated gesture segmentation from dance sequences. Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. 883-888. (doi:10.1109/AFGR.2004.1301645)
40. Nakazawa, A., Nakaoka, S., Ikeuchi, K. & Yokoi, K. 2002 Imitating human dance motions through motion structure analysis. Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. 2, 2539-2544. (doi:10.1109/IRDS.2002. 1041652)
41. Wang, T., Shum, H., Xu, Y. & Zheng, N. 2001 Unsupervised analysis of human gestures. Proc. IEEE Pacific Rim Conf. Multimedia 2195, 174-181.
42. Ogale, A., Karapurkar, A. & Aloimonos, Y. 2007 View invariant modeling and recognition of human action using grammar. Lect. Notes Comput. Sci. 4358, 115-126. (doi:10.1007/978-3-540-70932-9_9)
43. Chomsky, N. 1956 Three models for the description of language. IRE Trans. Inf. Theory 2, 113-124. (doi:10. 1109/TIT.1956.1056813)
44. Chomsky, N. 1957 Syntactic structures. Berlin, Germany: Mouton de Gruyter.
45. Chomsky, N. 1965 Aspects of the theory of syntax. Cambridge, MA: MIT Press.
46. Chomsky, N. 1993 Lectures on government and binding: the Pisa lectures. Berlin, Germany: Mouton de Gruyter.
47. Lasnik, H. 2002 The minimalist program in syntax. Trends Cogn. Sci. 6, 432-437. (doi:10.1016/S1364-6613(02)01977-0)
48. Iriki, A. & Sakura, O. 2008 The neuroscience of primate intellectual evolution: natural selection and passive and intentional niche construction. Phil. Trans. R. Soc. B 363, 2229-2241. (doi:10.1098/rstb.2008.2274)
49. Iriki, A., Tanaka, M. & Iwamura, Y. 1996 Coding of modified body schema during tool use by macaque postcentralneurones. Neuroreport 14, 2325-2330.
50. Mantovani, G., Bufalari, I., d'Ausilio, A. & Fadiga, L. 2011 The brain representation of objects and tools. POETICON Project, D3.2b, Athens, Greece.
51. Luria, A. 1973 The working brain. London, UK: Penguin.
52. Cangelosi, A. et al. 2010 Integration of action and language knowledge: a roadmap for developmental robotics. IEEE Trans. Auton. Mental Dev. 2, 167-195. (doi:10.1109/TAMD.2010.2053034)
53. Cattaneo, L., Fabbri-Destro, M., Boria, S., Pieraccini, C., Monti, A., Cossu, G. & Rizzolatti, G. 2007 Impairment of action chains in autism and its possible role in intention understanding. Proc. Natl Acad. Sci. USA 104, 17 825-17 830. (doi:10.1073/pnas.0706273104)
54. Li, Y. & Aloimonos, Y. 2009 The action synergies: building blocks for understanding human behavior. In Proc. IEEE Int. workshop on social signal processing, Amsterdam, The Netherlands, pp. 1-7. (doi:10.1109/ACII.2009. 5349506)
55. Pinker, S. & Jackendoff, R. 2005 The faculty of language: What's special about it? Cognition 95, 201-236. (doi:10. 1016/j.cognition.2004.08.004)
56. Hauser, M., Chomsky, N. & Fitch, W. 2002 The faculty of language:What is it,whohas it, and howdid it evolve? Science 298, 1569-1579. (doi:10.1126/science.298.5598.1569)
57. Fitch, W.,Hauser, M.&Chomsky, N. 2005 The evolution of the language faculty: clarifications and implications. Cognition 97, 179-210. (doi:10.1016/j.cognition.2005.02.005)
58. Summerstay, D. & Aloimonos, Y. 2010 Learning to recognize objects in images using anisotropic nonparametric kernels. In Proc. 1st Annu. Meet. Biologically Inspired Cognitive Architectures (BICA) Society (eds A. V. Samsonovich, K. R. Jóhannsdóttir, A. Chella & B. Goertzel), pp. 163-168. Amsterdam, The Netherlands: IOS Press. (doi:10.3233/978-1-60750-661-4-163)
59. Mishra, A. & Aloimonos, Y. 2009 Active segmentation. Int. J. Humanoid Robot. 6, 361-386. (doi:10.1142/ S0219843609001784)
60. Stout, D., Toth, N., Schick, K. & Chaminade, T. 2008 Neural correlates of early stone age toolmaking: technology, language and cognition in human evolution. Phil. Trans. R. Soc. B 363, 1939-1949. (doi:10.1098/rstb.2008.0001)
61. Clerget, E., Winderickx, A., Fadiga, L. & Olivier, E. 2009 Role of Broca's area in encoding sequential human actions: a virtual lesion study. Neuroreport 20, 1496-1499. (doi:10.1097/WNR.0b013e3283329be8)
62. Higuchi, S., Chaminade, T., Imamizu, H. & Kawato, M. 2007 Shared neural correlates for language and tool use in Broca's area. Neuroreport 20, 1376-1381. (doi:10. 1097/WNR.0b013e3283315570)