Timing sensory integration: Robot simulation of autistic behavior

IEEE Robotics and Automation Magazine

Volumn 16, Issue 3, 2009, Pages 51-58

  Barakova, Emilia I ^a   Chonnaparamutt, Winai ^b  

^a EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b GIFU UNIVERSITY   (Japan)

Author keywords

Autism; Temporal multimodal integrations

Indexed keywords

AUTISM; AUTISM SPECTRUM DISORDERS; DEVELOPMENTAL DISORDERS; MOVEMENT PATTERN; NON-VERBAL COMMUNICATIONS; ROBOT SIMULATIONS; SENSORY INTEGRATION; SOCIAL INTERACTIONS; TEMPORAL MULTIMODAL INTEGRATIONS;

COMMUNICATION; FREE RADICAL REACTIONS; REINFORCEMENT;

INTEGRATION;

EID: 70349466238     PISSN: 10709932     EISSN: None     Source Type: Journal    
DOI: 10.1109/MRA.2009.933626     Document Type: Article

References (42)

1. S.-I. Amari, "Dynamical study of formation of cortical maps," Biol. Cybern., vol. 27, no. 2, pp. 77-87, 1977.
2. G. Schöner, M. Dose, and C. Engels, "Dynamics of behavior: Theory and applications for autonomous robot architectures," Robot. Autonom. Syst., vol. 16, no. 4, pp. 213-245, 1995.
3. W. Erlhagen and E. Bicho. (2006, Sept.). The dynamic neural field approach to cognitive robotics. J. Neural Eng. [Online]. vol. 3(3), pp. R36-R54. Available: http://dx.doi.org/10.1088/1741-2560/3/3/R02
4. M. R. Leary and D. A. Hill, "Moving on: Autism and movement disturbance," Ment. Retard., vol. 34, no. 1, pp. 39-53, Feb. 1996.
5. N. Bolognini, F. Frassinetti, A. Serino, and E. Làdavas, "'Acoustical vision' of below threshold stimuli: Interactions among spatially converging audiovisual inputs," Exp. Brain Res., vol. 160, no. 3, pp. 273-282, 2005.
6. B. E. Stein, N. London, L. K. Wilkinson, and D. D. Price, "Enhancement of perceived visual intensity by auditory stimuli: A psychophysical analysis," J. Cogn. Neurosci., vol. 1, no. 1, pp. 12-24, 1989.
7. W. H. Sumby and I. Pollack, "Visual contribution to speech intelligibility in noise," J. Acoust. Soc. Amer., vol. 26, no. 2, pp. 212-215, 1954.
8. J. Brock, C. C. Brown, J. Boucher, and G. Rippon, "The temporal binding deficit hypothesis of autism," Dev. Psychopathol., vol. 14, no. 2, pp. 209-224, 2002.
9. L. Mottron and J. Burack, "Enhanced perceptual functioning in the development of autism," in The Development of Autism: Perspectives from Theory and Research, J. A. Burack, T. Charman, N. Yirmiya, and P. R. Zelazo, Eds. New York: Oxford Univ. Press, 2001, pp. 131-148.
10. M. O'Riordan, K. Plaisted, S. Baron-Cohen, and J. Driver, "Superior target detection in autism," J. Exp. Psychol. Hum. Percept. Perform. vol. 27, no. 3, pp. 719-730, 2001.
11. K. Plaisted, M. O'Riordan, and S. Baron-Cohen, "Enhanced discrimination of novel, highly similar stimuli by adults with autism during a perceptual learning task," J. Child Psychol. Psychiatr. Allied Discip., vol. 39, no. 5, pp. 777-783, 1998.
12. S. Ozonoff, D. L. Strayer, M. William, W. M. McMahon, and F. Filloux, "Executive function abilities in autism and tourette syndrome: An information processing approach," J. Child Psychol. Psychiatr., vol. 35, pp. 1015-1032, 1994.
13. N. Russo, T. Flanagan, G. Iarocci, D. Berringer, P. D. Zelazo, and J. A. Burack, "Deconstructing executive deficits among persons with autism: Implications for cognitive neuroscience," Brain Cogn., vol. 65, no. 1, pp. 77-86, 2007.
14. P. D. Zelazo and U. Müller, "Executive function in typical and atypical development," in Blackwell Handbook of Childhood Cognitive Development, G. Usha, Ed. Oxford, U.K.: Blackwell, 2007, pp. 445-469.
15. B. A. Masterton and G. B. Biederman, "Proprioceptive versus visual control in autistic children," J. Autism Dev. Disord., vol. 13, no. 2, pp. 141-152, 1983.
16. B. Gepner, C. Deruelle, and S. Grynfeltt, "Motion and emotion: A novel approach to the study of face processing by young autistic children," J. Autism Dev. Disord., vol. 31, no. 1, pp. 37-45, 2001.
17. I. M. Smith and S. E. Bryson, "Imitation and action in autism: A critical review," Psychol. Bull., vol. 116, no. 2, pp. 259-273, 1994.
18. W. L. Stone, O. Y. Ousley, and C. D. Littleford, "Motor imitation in young children with autism: What's the object?" J. Abnorm. Child Psychol., vol. 25, no. 6, pp. 475-485, 1997.
19. G. Iarocci and J. McDonald, "Sensory integration and the perceptual experience of persons with autism," J. Autism Dev. Disord., vol. 36, no. 1, pp. 77-90, 2006.
20. R. Galambos, "A comparison of certain gamma band (40-Hz) brain rhythms in cat and man," in Induced Rhythms in the Brain, 1992, pp. 201-216.
21. C. M. Gray, P. Knig, A. K. Engel, and W. Singer. (1989, Mar.). Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties. Nature [Online]. vol. 338(6213), pp. 334-337. Available: http://dx.doi.org/ 10.1038/338334a0
22. E. I. Barakova and T. Lourens, "Event based self-supervised temporal integration for multimodal sensor data," J. Integr. Neurosci., vol. 4, no. 2, pp. 265-282, June 2005.
23. A. Steinhage, "The dynamic approach to anthropomorphic robotics," in Proc. 4th Portuguese Conf. Automatic Control, 2000, pp. 1175-1181.
24. W. Erlhagen and G. Schöner, "Dynamic field theory of movement preparation," Psychol. Rev., vol. 109, no. 3, pp. 545-572, July 2002.
25. C. Faubel and G. Schöner, "Fast learning to recognize objects dynamic fields in label feature spaces," in Proc. 5th Int. Conference Development and Learning, 2006.
26. I. Iossifidis and A. Steinhage, "Controlling an 8 dof manipulator by means of neural fields," in Proc. IEEE Int. Conf. Field and Service Robotics, A. Halme, R. Chatila, and E. Prassler, Eds., Helsinki, 2001, pp. 269-274.
27. C. Schauer and H.-M. Gross, "Design and optimization of Amari neural fields for early auditory-visual integration," in Proc. 2004 IEEE Int. Joint Conf. Neural Networks, 2004, vol. 4, pp. 2523-2528.
28. E. L. Sauser and A. G. Billard, "Biologically inspired multimodal integration: Interferences in a human-robot interaction game," in Proc. 2006 IEEE/RSJ Int. Conf. Intelligent Robots and Systems, 2006, pp. 5619-5624.
29. E. Thelen, G. Schner, C. Scheier, and L. B. Smith, "The dynamics of embodiment: A field theory of infant preservative reaching," Behav. Brain Sci., vol. 24, no. 1, pp. 1-34, Feb 2001; discussion 34-86.
30. R. J. van Beers, A. C. Sittig, and J. J. D. van der Gon, "The precision of proprioceptive position sense," Exp. Brain Res., vol. 122, no. 4, pp. 367-377, Oct. 1998.
31. W. D. Hairston, J. H. Burdette, D. L. Flowers, F. B. Wood, and M. T. Wallace, "Altered temporal profile of visual-auditory multisensory interactions in dyslexia," Exp. Brain Res., vol. 166, pp. 474-480, 2005.
32. H. Mustovic, K. Scheffler, F. D. Salle, F. Esposito, J. G. Neuhoff, J. Hennig, and E. Seifritz, "Temporal integration of sequential auditory events: Silent period in sound pattern activates human planum temporale," Neuroimage, vol. 20, no. 1, pp. 429-434, Sept. 2003.
33. G. A. Calvert and T. Thesen. (2004). Multisensory integration: methodological approaches and emerging principles in the human brain. J. Physiol. Paris [Online]. vol. 98(1-3), pp. 191-205. Available: http://dx.doi.org/10.1016/j.jphysparis.2004.03.018
34. P. J. Laurienti, R. A. Kraft, J. A. Maldjian, J. H. Burdette, and M. T. Wallace. (2004, Oct.). Semantic congruence is a critical factor in multi-sensory behavioral performance. Exp. Brain Res. [Online]. vol. 158(4), pp. 405-414. Available: http://dx.doi.org/10.1007/ s00221-004-1913-2
35. S. Nishida, "Interactions and integrations of multiple sensory channels in human brain," in Proc. 2006 IEEE Int. Conf. Multimedia Expo, 2006, pp. 509-512.
36. D. Senkowski, D. Talsma, M. Grigutsch, C. S. Herrmann, and M. G. Woldorff. (2007, Feb.). Good times for multisensory integration: Effects of the precision of temporal synchrony as revealed by gamma-band oscillations. Neuropsychologia [Online]. vol. 45(3), pp. 561-571. Available: http://dx.doi.org/10.1016/j.neuropsychologia.2006.01.013
37. P. M. Bays and D. M. Wolpert. (2007, Jan.). Computational principles of sensorimotor control that minimize uncertainty and variability. J. Physiol. [Online]. vol. 578(2), pp. 387-396. Available: http://dx.doi.org/10.1113/jphysiol.2006.120121
38. K. P. Kšrding, U. Beierholm, W. J. Ma, S. Quartz, J. B. Tenenbaum, and L. Shams, "Causal inference in multisensory perception," PLoS ONE, vol. 2, no. 9, p. e943, 2007.
39. S.-I. Niculescu, Delay Effects on Stability: A Robust Control Approach (LNCS, vol. 269). Heidelberg: Springer-Verlag, 2001.
40. J. L. Hellerstein, D. M. Tilbury, Y. Diao, and S. Parekh, Feedback Control of Computing Systems. New York: IEEE Press, Aug. 2004.
41. D. Vanderelst and E. I. Barakova, "Autonomous parsing of behavior in a multi-agent setting," in Artificial Intelligence and Sort Computing (Lecture Notes in Computer Science, vol. 5097), L. Rutkowski and R. Tadeusiewicz, Eds. Berlin: Springer, 2008, pp. 1198-1209.
42. D. J. Cohen and A. Donnellan, Handbook of Autism and Pervasive Developmental Disorders. New York: Wiley, 1987.