Communicating emotions and mental states to robots in a real time parallel framework using Laban movement analysis

Robotics and Autonomous Systems

Volumn 58, Issue 12, 2010, Pages 1256-1265

  Lourens, Tino ^a   Van Berkel, Roos ^a   Barakova, Emilia ^a  

^a EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Emotion recognition from body movements; Framework for motion analysis and synthesis; Laban movement analysis; Real time parallel processing

Indexed keywords

AUTISTIC CHILDREN; BODY MOVEMENTS; CODING PRINCIPLES; COMMON LANGUAGES; COMPUTER ANALYSIS; EXPERIMENTAL SETUP; FREQUENCY CHARACTERISTIC; HUMAN HANDS; HUMAN MOVEMENTS; HUMANOID ROBOT; LABAN MOVEMENT ANALYSIS; MENTAL STATE; MIRROR-NEURON SYSTEM; MOTION ANALYSIS; MOVEMENT ANALYSIS; NATURAL ENVIRONMENTS; PARALLEL FRAMEWORK; REAL TIME; TRACKING ANALYSIS; VIDEO FRAGMENTS;

ANTHROPOMORPHIC ROBOTS; BEHAVIORAL RESEARCH; EDUCATION; MAMMALS;

HUMAN ROBOT INTERACTION;

EID: 78649924523     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2010.08.006     Document Type: Article

References (65)

1. C. Breazeal Emotion and sociable humanoid robots International Journal of HumanComputer Studies 59 2003 119 155
2. E.I. Barakova, and T. Lourens Expressing and interpreting emotional movements in social games with robots Personal and Ubiquitous Computing 14 2010 457 467
3. B. Robins, P. Dickerson, K. Dautenhahn, Robots as embodied beingsinteractionally sensitive body movements in interactions among autistic children and a robot, ROMAN 2005, in: IEEE International Workshop on Robot and Human Interactive Communication, 2005, pp. 5459.
4. B. Scassellati, How social robots will help us to diagnose, treat, and understand autism, in: International Symposium of Robotics Research, ISSR&3905, 2005, pp. 552563.
5. J. Nadel Early imitation and the emergence of a sense of agency L. Berthouze, H. Kozima, C.G. Prince, G. Sandini, G. Stojanov, G. Metta, C. Balkenius, Proc. 4th Intl. Workshop on Epigenetic Robots Lund University Cognitive Studies vol. 117 2004 15 16
6. H. Kozima, C. Nakagawa, Y. Yasuda, Interactive robots for communication-care: a case-study in autism therapy, ROMAN 2005, in: IEEE International Workshop on Robot and Human Interactive Communication 2005, 2005, pp. 341346. doi:10.1109/ROMAN.2005.1513802.
7. A. Billard, and M.J. Mataric Learning human arm movements by imitation: evaluation of a biologically inspired connectionist architecture Robotics and Autonomous Systems 37 23 2001 145 160 10.1016/S0921-8890(01)00155-5
8. E. Sauser, A. Billard, Biologically inspired multimodal integration: interferences in a human-robot interaction game, in: E. Sauser (Ed.), Proceedings of IROS'2006, Beijing, China, 2006, pp. 56195624.
9. E.I. Barakova, and W. Chonnaparamutt Timing sensory integration for robot simulation of autistic behavior IEEE Robotics and Automation Magazine 16 3 2009 51 58
10. J.L. Krichmar, A.K. Seth, D.A. Nitz, J.G. Fleischer, and G.M. Edelman Spatial navigation and causal analysis in a brain-based device modeling corticalhippocampal interactions Neuroinformatics 3 3 2005 197 221 10.1385/NI:3:3:197
11. A.J. Ijspeert, A. Crespi, D. Ryczko, and J.-M. Cabelguen From swimming to walking with a salamander robot driven by a spinal cord model Science 315 5817 2007 1416 1420 10.1126/science.1138353
12. H. Kimura, Y. Fukuoka, and A.H. Cohen Biologically inspired adaptive walking of a quadruped robot Philosophical Transactions of the Royal Society A 365 2007 153 170
13. E. Chinellato, A. Morales, E. Cervera, and A.P. Del Pobil Symbol grounding through robotic manipulation in cognitive systems Robotics and Autonomous Systems 55 12 2007 851 859 10.1016/j.robot.2007.07.011 Robotics and Autonomous Systems in the 50th Anniversary of Artificial Intelligence, Campus Multidisciplinary in Perception and Intelligence
14. E. Barakova, and T. Lourens Efficient episode encoding for spatial navigation International Journal of Systems Science 36 14 2005 887 895
15. J.L. McKinstry, G.M. Edelman, and J.L. Krichmar A cerebellar model for predictive motor control tested in a brain-based device Proceedings of the National Academy of Sciences of the United States of America 103 9 2006 3387 3392 10.1073/pnas.0511281103
16. B. Porr, and F. Wrgtter Isotropic sequence order learning Neural Computation 15 4 2003 831 864 10.1162/08997660360581921
17. P. Dean, J.E.W. Mayhew, N. Thacker, and P.M. Langdon Saccade control in a simulated robot camera-head system: neural net architectures for efficient learning of inverse kinematics Biological Cybernetics 66 6 1991 27 36 10.1007/BF00196450
18. T. Lourens, E.I. Barakova, H.G. Okuno, and H. Tsujino A computational model of monkey cortical grating cells Biological Cybernetics 92 1 2005 61 70 10.1007/s00422-004-0522-2
19. T. Lourens, and E.I. Barakova Orientation contrast sensitive cells in primate v1a computational model Natural Computing 6 3 2007 241 252
20. S. Eskiizmirliler, N. Forestier, B. Tondu, and C. Darlot A model of the cerebellar pathways applied to the control of a single-joint robot arm actuated by mckibben artificial muscles Biological Cybernetics 86 5 2002 379 394
21. A. Arleo, and W. Gerstner Modeling rodent head-direction cells and place cells for spatial learning in bio-mimetic robotics ABC Journal 2000 236 245
22. N. Burgess, J.G. Donnett, K.J. Jeffery, and J. O'Keefe Robotic and neuronal simulation of the hippocampus and rat navigation Philosophical Transactions: Biological Sciences 352 1360 1997 1535 1543
23. M. Milford, R. Schulz, D. Prasser, G. Wyeth, and J. Wiles Learning spatial concepts from ratslam representations Robotics and Autonomous Systems 55 5 2007 403 410 10.1016/j.robot.2006.12.006
24. H. Wagatsuma, and Y. Yamaguchi Context-dependent adaptive behavior generated in the theta phase coding network Neural Information Processing 2008 177 184
25. A. Arleo, F. Smeraldi, W. Gerstner, Cognitive navigation based on nonuniform gabor space sampling, unsupervised growing networks, and reinforcement learning, ABC Journal.
26. O. Sporns, and W.H. Alexander Neuromodulation and plasticity in an autonomous robot Neural Networks 15 4 2002 761 774 10.1016/S0893-6080(02)00062-X
27. G. Rizzolatti, and M.A. Arbib Language within our grasp Trends in Neurosciences 21 5 1998 188 194 10.1016/S0166-2236(98)01260-0
28. S. Schaal Is imitation learning the route to humanoid robots? Trends in Cognitive Sciences 3 1999 233 242
29. S. Schaal, and N. Schweighofer Computational motor control in humans and robots Motor Sytems/Neurobiology of Behaviour Current Opinion in Neurobiology 15 6 2005 675 682 10.1016/j.conb.2005.10.009
30. K.J. Montgomery, N. Isenberg, and J.V. Haxby Communicative hand gestures and object-directed hand movements activated the mirror neuron system Social Cognitive and Affective Neuroscience 2 2 2007 114 122 10.1093/scan/nsm004
31. A.N. Meltzoff, and M.K. Moore Explaining facial imitation: a theoretical model Early Development and Parenting 6 1997 179 192
32. B. de Gelder Towards the neurobiology of emotional body language Nature Reviews Neuroscience 7 3 2006 242 249 10.1038/nrn1872
33. Baron-Cohen Social intelligence in the normal and autistic brain: an fmri study European Journal of Neuroscience 11 1999 18911898(8)
34. R. Laban Principles of Dance and Movement Notation 1956 Macdonald & Evans New York
35. I. Bartenieff, and D. Lewis Body MovementCoping with the Environment 1980 Gordon and Breach Scinece Publishers
36. E.I. Barakova, J. Gillesen, and L. Feijs Social training of autistic children with interactive intelligent agents Journal of Integrative Neuroscience 8 1 2009 23 34
37. T.R. Halfhill, Parallel processing with cuda, IN-STAT Microprocessor Report, 2008, pp. 18.
38. T. Lourens, E.I. Barakova, and H. Tsujino Interacting modalities through functional brain modeling J. Mira, J.R. lvarez, Proceedings of the International Work-Conference on Artificial and Natural Neural Networks, IWANN 2003 Lecture Notes in Computer Science vol. 2686 2003 Springer-Verlag Menorca, Spain 102 109
39. T. Lourens, Tivipetino's visual programming environment, in: The 28th Annual International Computer Software & Applications Conference, IEEE COMPSAC 2004, 2004, pp. 1015.
40. R.P. Wrtz, and T. Lourens Corner detection in color images through a multiscale combination of end-stopped cortical cells Image and Vision Computing 18 67 2000 531 541
41. T. Lourens, and E.I. Barakova Tivipe simulation of a cortical crossing cell model J. Cabastany, A. Prieto, D.F. Sandoval, IWANN 2005 Lecture Notes in Computer Science vol. 3512 2005 Springer-Verlag Barcelona, Spain 122 129
42. E.I. Barakova, and T. Lourens Mirror neuron framework yields representations for robot interaction Neurocomputing 72 46 2009 895 900
43. E.I. Barakova, and T. Lourens Efficient episode encoding for spatial navigation International Journal of Systems Science 36 14 2005 877 885
44. D. Chai, and K.N. Ngan Face segmentation using skin-color map in videophone applications IEEE Transactions on Circuits and Systems for Video Technology 9 4 1999 551 564
45. S. Zeki A Vision of the Brain 1993 Blackwell Science Ltd. London
46. B.D. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in: Proceedings of Imaging Understanding Workshop, 1981, pp. 121130.
47. I.E. Sobel, Camera models and machine perception, Ph.D. Thesis, Electrical Engineering Department, Stanford University, Stanford, CA, 1970.
48. J.G. Daugman Complete discrete 2-d Gabor transforms by neural networks for image analysis and compression IEEE Transactions on Acoustics, Speech and Signal Processing 36 7 1988 1169 1179
49. T. Lourens A Biologically Plausible Model for Corner-Based Object Recognition from Color Images 1998 Shaker Publishing B.V. Maastricht, The Netherlands
50. D.H. Hubel, and T.N. Wiesel Receptive fields of single neurones in the cat's striate cortex Journal of Physiology 148 1959 574 591
51. D.H. Hubel, and T.N. Wiesel Ferrier lecture functional architecture of macaque visual cortex Proceedings of the Royal Society London Series: B 198 1977 1 59
52. E.I. Barakova, D. Vanderelst, From spreading of behavior to dyadic interactiona robot learns what to imitate, International Journal of Intelligent Systems (in press).
53. R. Laban Schrifttanz 1928 Universal Edition Wien
54. R. Laban SchrifttanzKleine Tnze mit Vorbungen 1930 Universal Edition Wien
55. A. Knust, Kinetographie Laban, Parts AO, Eight volume, unpublished manuscript, 1953 (in German).
56. A. Knust Handbook of Kinetography Laban 1958 Das Tanzarchiv Hamburg
57. A. Hutchinson LabonationThe System for Recording Movement 1956 New Directions New York
58. A. Foroud, and S.M. Pellis The development of ldquoroughnessrdquo in the play fighting of rats: a Laban movement analysis perspective Developmental Psychobiology 42 1 2003 35 43 10.1002/dev.10088
59. L.P. Dott Aesthetic listening: contributions of dance/movement therapy to the psychic understanding of motor stereotypes and distortions in autism and psychosis in childhood and adolescence The Arts in Psychotherapy 22 3 1995 241 247 10.1016/0197-4556(95)00033-2 European Consortium for Arts Therapy Education (ECArTE)
60. P. Vasey, A. Foroud, N. Duckworth, and S. Kovacovsky Malefemale and femalefemale mounting in Japanese macaques: a comparative study of posture and movement Archives of Sexual Behavior 35 2 2006 116 128
61. A. Foroud, and I.Q. Whishaw Changes in the kinematic structure and non-kinematic features of movements during skilled reaching after stroke: a Laban movement analysis in two case studies Journal of Neuroscience Methods 158 1 2006 137 149 10.1016/j.jneumeth.2006.05.007
62. R. Fagen, J. Conitz, and E. Kunibe Observing behavioral qualities International Journal of Comparative Psychology 10 1997 167 179
63. A. Foroud, I.Q. Whishaw, and S.M. Pellis Experience and cortical control over the pubertal transition to rougher play fighting in rats Behavioural Brain Research 149 1 2004 69 76 10.1016/S0166-4328(03)00230-4
64. R. Laban, and F.C. Lawrence Effort 1947 Macdonald & Evans
65. J. Newlove, and J. Dalby Laban for All 2004 Nick Hern London