Learning tactile skills through curious exploration

Frontiers in Neurorobotics

Volumn , Issue JULY, 2012, Pages

  Pape, Leo ^a   Oddo, Calogero M ^b   Controzzi, Marco ^b   Cipriani, Christian ^b   Förster, Alexander ^a   Carrozza, Maria C ^b   Schmidhuber, Jürgen ^a  

^a UNIVERSITY OF LUGANO   (Switzerland)

^b SCUOLA SUPERIORE SANT ANNA   (Italy)

Author keywords

Active learning; Biomimetic robotics; Curiosity; Intrinsic motivation; Reinforcement learning; Skill learning; Tactile sensing

Indexed keywords

BIOMIMETIC MATERIAL; CEMENT;

ARTICLE; BIOSENSOR; FEASIBILITY STUDY; INFORMATION; LEARNING; MOTIVATION; MOTOR PERFORMANCE; REINFORCEMENT; ROBOTICS; SKILL; TACTILE STIMULATION;

EID: 84866027577     PISSN: None     EISSN: 16625218     Source Type: Journal    
DOI: 10.3389/fnbot.2012.00006     Document Type: Article

References (36)

1. Arai, H., and Tachi, S. (1991). Position control of a manipulator with pas- sive joints using dynamic coupling. IEEE Trans. Rob. Autom. 7, 528-534.
2. Bensmaïa, S. J., and Hollins, M. (2003). The vibrations of texture. Somatosens. Mot. Res. 20, 33-43.
3. Bensmaia, S. J., and Hollins, M. (2005). Pacinian representations of fine surlace texture. Percept. Psychophys. 67, 842-854.
4. Blake, D. T., Hsiao, S. S., and Johnson, K. O. (1997). Neural coding mecha- nisms in tactile pattern recognition; the relative contributions of slowly and rapidly adapting mechanore- ceptors to perceived roughness. J. Neurosci. 17, 7480-7489.
5. Bourlard, H., and Kamp, Y. (1988). Auto-association by multilayer per- ceptrons and singular value decom- position. Biol. Cybern. 59, 291-294.
6. Buchholz, B., Armstrong, T. J., and Goldstein, S. A. (1992). Anthropometric data for describing the kinematics of the human hand. Ergonomics 35, 261-273.
7. Connor, C. E., Hsiao, S. S., Phillips, J. R., and Johnson, K. O. (1990). Tactile roughness: neural codes that account for psychophysical mag- nitude estimates. J. Neurosci. 10, 3823-3826.
8. Connor, E., and Johnson, K. O. (1992). Neural coding of tactile texture: comparison of spatial and temporal mechanisms for roughness percep- tion. J. Neurosci. 12, 3414-3426.
9. Fishel, J. A., and Loeb, G. E. (2012). Bayesian exploration for intel- ligent identification of textures. Front. Neurorobot. 6:4. doi: 10.3389/fnbot.2012.00004
10. Gardner, E. P., and Palmer, C. I. (1989). Simulation of motion of the skin.I.Receptivefieldsandtempo- ral frequency coding by cutaneous mechanoreceptors of OPTACON pulses delivered to the hand. J. Neurophysiol. 62, 1410-1436.
11. Gordon, G., and Ahissar, E. (2011). " Reinlorcement active learning hierarchical loops," in International Joint Conference of Neural Networks (IJCNN), (San Jose, CA).
12. Hollins, M., and Risner, S. R. (2000). Evidence for the duplex theory of tactile texture perception. Percept. Psychophys. 62, 695-705.
13. Hollins, M., Bensmaia, S. J., and Washburn, S. (2001). Vibrotactile adaptation impairs discrimination of fine, but not coarse, textures. Somatosens. Mot. Res. 18, 253-262.
14. Johansson, R. S., and Flanagan, J. R. (2009). Coding and use of tac- tile signals from the fingertips in object manipulation tasks. Nat. Rev. Neurosci. 10, 345-359.
15. Johansson, R. S., and Vallbo, A. B. (1979). Tactile sensibility in the human hand: relative and abso- lute densities of four types of mechanoreceptive units in glabrous skin. J. Physiol. 286, 283-300.
16. Jones, L. A., and Lederman, S. J. (2006). " Tactile sensing," in Human Hand Function, eds L. A. Jones and S. J. Lederman (New York, NY: Oxford University Press), 44-74.
17. Kaelbling, L. P., Littman, M. L., and Moore, A. W. (1996). Reinlorcement learning: a survey. J. AI Res. 4, 237-285.
18. Kompella, V. R., Pape, L., Masci, J., Frank, M., and Schmidhuber, J. (2011). " AutoIncSFA and vision- based developmental learning for humanoid robots," in IEEE- RAS International Conference on Humanoid Robots, (Bled, Slovenia)
19. Konidaris, G. D., Kuindersma, S. R., Grupen, R. A., and Barto, A. G. (2011). " Autonomous skill acqui- sition on a mobile manipulator," in Proceedings of the Twenty-Fifth Conference on Artificial Intelligence (AAAI-11), (San Francisco, CA).
20. Lagoudakis, M. G., and Parr, R. (2003). Least-squares policy iteration. J. Mach.Learn.Res.4, 1107-1149.
21. LaMotte, R. H., and Srinivasan, M. A. (1991). " Surlace micro- geometry: neural encoding and perception. Information processing in the somatosensory system," in Wenner-Gren International. Symposium Series, eds O. Franzen and J. Westman (New York, NY: Macmillan Press), 49-58.
22. Lederman, S.J., and Klatzky, R.L. (2009). Haptic perception: a tuto- rial. Atten. Percept. Psychophys. 71, 1439-1459.
23. Lloyd, S. P. (1982). Least squares quan- tization in PCM. IEEE Trans. Inf. Theory 28, 129-137.
24. Morley, J. W., Goodwin, A. W., and Darian-Smith, I. (1983). Tactile dis- crimination of gratings. Exp. Brain Res. 49, 291-299.
25. Mugan, J., and Kuipers, B. (2012). Autonomous learning of high-level states and actions in continuous environments. IEEE Trans. Auton. Ment. Dev. 4, 70-86.
26. Oddo, C. M., Beccai, L., Wessberg, J., Backlund Wasling, H., Mattioli, F., and Carrozza, M. C. (2011a). Roughness encoding in human and biomimetic artificial touch: spa- tiotemporal frequency modulation and structural anisotropy of finger- prints. Sensors 11, 5596-5615.
27. Oddo, C. M., Controzzi, M., Beccai, L., Cipriani, C., and Carrozza, M. C. (2011b). Roughness encoding for discrimination of surlaces in artifi- cial active touch. IEEE Trans. Rob. 27, 522-533.
28. Oudeyer, P. Y., Kaplan, F., and Hafner, V. (2007). Intrinsic motivation sys- tems for autonomous mental devel- opment. IEEE Trans. Auton. Ment. Dev. 11, 265-286.
29. Prescott, T. J., Diamond, M. E., and Wing, A. M. (2011). Active touch sensing. Philos. Trans. R. Soc. Lond. B Biol. Sci. 366, 2989-2995.
30. Radwin, R., Jeng, O., and Gisske, E. (1993). A new automated tactil- ity test instrument for evaluating hand sensory function. IEEE Trans. Rehabil. Eng. 1, 220-225.
31. Schmidhuber, J. (2006). Developmental robotics, optimal artificial curiosity, creativity, music, and the fine arts. Connect. Sci. 18, 173-187.
32. Schmidhuber, J. (2010). Formal the- ory of creativity, fun, and intrin- sic motivation (1990-2010). IEEE Trans. Auton. Ment. Dev. 2, 230-247
33. Sutton, R., and Barto, A. (1998). Reinforcement Learning: An Introduction.Cambridge,MA: MIT Press.
34. Vigorito,C.M.,and Barto,A.G. (2010). Autonomous learning of high-level states and actions in con- tinuous environments. IEEE Trans. Auton. Ment. Dev. 2, 132-143.
35. Yoshioka, T., Gibb, B., Dorsch, A. K., Hsiao, S. S., and Johnson, K. O. (2001). Neural coding mechanisms underlying perceived roughness of finely textured surfaces. J. Neurosci. 21, 6905-6916.
36. Yoshioka, T., Bensmaia, S. J., Craig, J. C., and Hsiao, S. S. (2007). Texture perception through direct and indi- rect touch: an analysis of perceptual space for tactile textures in two modes of exploration. Somatosens. Mot. Res. 24, 53-70.