Humanoids learn touch modalities identification via multi-modal robotic skin and robust tactile descriptors

Advanced Robotics

Volumn 29, Issue 21, 2015, Pages 1411-1425

  Kaboli, Mohsen ^a   Long, Alex ^a   Cheng, Gordon ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

artificial robotic skin; humanoid robots; tactile data processing; tactile feature descriptors; tactile learning; touch classification

Indexed keywords

ANTHROPOMORPHIC ROBOTS; ARTIFICIAL ORGANS; DATA HANDLING; ROBOTICS;

BIOLOGICALLY INSPIRED; FEATURE DESCRIPTORS; HUMANOID ROBOT; ROBOTIC SKIN; SVM CLASSIFIERS; TACTILE INFORMATION; TACTILE LEARNING; TACTILE SENSING;

CLASSIFICATION (OF INFORMATION);

EID: 84946708744     PISSN: 01691864     EISSN: 15685535     Source Type: Journal    
DOI: 10.1080/01691864.2015.1095652     Document Type: Conference Paper

References (70)

1. Tabot G, Kim S, Winberry J, et al. Restoring tactile and proprioceptive sensation through a brain interface. Dis. Neurobiol. 2014. doi:10.1016/j.nbd.2014.08.029
2. Buonomano D, Merzenich M. Cortical plasticity: from synapses to maps. Ann. Rev. Neurosci. 1998;21:149-186.
3. Kaas J, Qi H. The reorganization of the motor system in primates after the loss of a limb. Restor. Neurol. Neurosci. 2004;22:145-152.
4. Hoshi T, Shinoda H. Robot skin based on touch-areasensitive tactile element. In: IEEE International Conference on Robotics and Automation, ICRA; Orlando (FL), USA; 2006. p. 3463-3468.
5. Roncone A, Hoffmann M, Pattacini U, et al. Automatic kinematic chain calibration using artificial skin: self-touch in the icub humanoid robot. In: IEEE International Conference on Robotics and Automation, ICRA; Hong Kong, China; p. 2305-2312.
6. CadoretG, SmithA. Friction, not texture, dictates grip forces during object manipulation. J. Neurophsiol. 1996;75:1963-1969.
7. Flanagan J, Wing A. Modulation of grip force with load force during point-to-point arm movements. Exp. Brain Res. 1993;95:131-143.
8. Johansson R, Westling G. Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects. Exp. Brain Res. 1984;56:550-564.
9. Duchaine V, Lauzier N, Baril M, et al. A flexible robot skin for safe physical human robot interaction. In: IEEE International Conference on Robotics and Automation, ICRA; Kobe, Japan; 2009. p. 3676-3681.
10. Bongard J, Zykov V, Lipson H. Resilient machines through continuous self-modeling. Science. 2006;314:1118-1121.
11. Dahiya R, Metta G, Valle M, et al. Tactile sensing from humans to humanoids. IEEE Trans. Rob. 2010;26:1-20.
12. Lee M, Nicholls H. Tactile sensing for mechatronics a state of the art survey. Mechatronics. 1999;9:1-31.
13. TiwanaM, Redmond S, Lovell N.Areview of tactile sensing technologies with applications in biomedical engineering. Sen. Actuators A: Phys. 2012;179:17-31.
14. Lee HK, Chang SI, Yoon E. A flexible polymer tactile sensor: fabrication and modular expandability for large area deployment. J.Microelectromech. Syst. 2006;15:1681-1686.
15. Meister E, Zilberman I, Levi P. Fuzzy logic based sensor skin for robotic applications. Vol. 2, In: International Conference on Artificial Intelligence, ICAI; Stuttgart, Germany; 2012. p. 3-9.
16. Cannata G, Maggiali M, Metta G, et al. An embedded artificial skin for humanoid robots. In: IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI; Seoul, SouthKorea; 2008. p. 434-438.
17. Lucarotti, C. , Oddo, C.M. ,Vitiello, N. , Carrozza, M.C. "Synthetic and bio-artificial tactile sensing: A review" in Sensors , Volume 13, Issue 2, 2013, Pages 1435-1466
18. Pfeifer R, Iida F, Lungarella M. Self-organization, embodiment, and biologically inspired robotics. Science. 2007;318:1088-1093.
19. Lepora N, Martinez-Hernandez U, Evans M, et al. Tactile superresolution and biomimetic hyperacuity. IEEE Rob. Autom. Soc. 2005;31:605-618.
20. Patel G, Kaplan D, Snyder L. Topographic organization in the brain: searching for general principles. Trends Cogn. Sci. 2014;18:351-363.
21. Schmeder A, Freed A. Support vector machine learning for gesture signal estimation with a piezo resistive fabric touch surface. In: Beilharz K, Bongers B, Johnston A, Ferguson S, editors. Proceedings of the International Conference on New Interfaces for Musical Expression. Sydney: Australia; 2010. p. 244-249.
22. Johnsson M, Balkenius C. Sense of touch in robots with self-organizing maps. IEEE Trans. Rob. 2011;27:498-507.
23. Ratnasingam S, McGinnity T. Object recognition based on tactile form perception. In: IEEE Workshop on Robotic Intelligence In Informationally Structured Space (RiiSS); 2011. p. 26-31. doi: 10.1109/RIISS.2011.5945777
24. Webster J. Medical instrumentation application and design. 3rd ed. New York:Wiley; 2007.
25. AdlerA, Arnold J, Bayford R, et al. Greit: a unified approach to 2d linear eit reconstruction of lung images. Physiol. Meas. 2009;30:S35-S55.
26. Kato Y, Mukai T, Hayakawa T, et al. Tactile sensor without wire and sensing element in the tactile region based on eit method. IEEE Sen. 2007;2:792-795.
27. Yao A, Soleimani M. A pressure mapping imaging device based on electrical impedance tomography of conductive fabrics. Sen. Rev. 2012;32:310-317.
28. Nagakubo A, Alirezaei H, Kuniyoshi Y. A deformable and deformation sensitive tactile distribution sensor. In: IEEE International Conference on Robotics and Biomimetics, ROBIO; Sanya, China; 2007. p. 1301-1308.
29. Alirezaei H, Nagakubo A, KuniyoshiY.Ahighly stretchable tactile distribution sensor for smooth surfaced humanoids. In: 7th IEEE-RAS International Conference on Humanoid Robots; Pittsburgh (PA), USA; 2007. p. 167-173.
30. Alirezaei H, Nagakubo A, KuniyoshiY.Atactile distribution sensor which enables stable measurement under high and dynamic stretch. In: IEEE Symposium on 3DUser Interfaces (3DUI); Lafayette (LA), USA; 2009. p. 87-93.
31. TawilD, Rye D, Velonaki M. Improved image reconstruction for an eit-based sensitive skin with multiple internal electrodes. IEEE Trans. Rob. 2011;7:425-435.
32. Brown B, Seagar A. The sheffield data collection system. Clinical Phys. Physiol. Meas. 1987;8A;91-97.
33. Holder D, editor. Electrical impedance tomography: methods, history and applications.UK:Institute of Physics Publishing; 2005.
34. Adler A, Guardo R. Electrical impedance tomography: regularized imaging and contrast detection. IEEE Trans. Med. Imaging. 1996;15:170-179.
35. Vauhkonen M, Vadasz D, Karjalainen PA, et al. Tikhonov regularization and prior information in electrical impedance tomography. IEEE Trans. Med. Imaging. 1998;17:285-293.
36. Pugach G, Khomenko V, Melnyk A, et al. Electronic hardware design of a low cost tactile sensor device for physical human-robot interactions. In: IEEE XXXIII International Scientific Conference Electronics and Nanotechnology, ELNANO; Kiev, Ukraine; 2013. p. 445-449.
37. Heikkinen L, Vauhkonen M, Savolainen T, et al. Modelling of internal structures and electrodes in electrical process tomography. Meas. Sci. Technol. 2001;12:1012-1019.
38. Tarvainen M, Vauhkonen M, Savolainen T, et al. Boundary element method and internal electrodes in electrical impedance tomography. Int. J. Numer. Methods Eng. 2001;50:809-824.
39. Lampinen J, Vehtari A, Leinonen K.Application of bayesian neural network in electrical impedance tomography. Vol. 6, In: IEEE International Joint Conference on Neural Networks (IJCNN '99);Washington (DC), USA; 1999, p. 3942-3947.
40. Minhas AS, Reddy MR. Neural network based approach for anomaly detection in the lungs region by electrical impedance tomography. Physiol. Meas. 2005;26:489-502.
41. Wang C, Lang J, Wang HX. Rbf neural network image reconstruction for electrical impedance tomography. Vol. 4. In: IEEE Proceedings of 2004 International Conference on Machine Learning and Cybernetics; 2004. p. 2549-2552.
42. Pandey V, Clausen B. Intelligent systems based anomaly detection in thoracic region by electrical impedance tomography technique. Ganpat Univ. J. Eng. Technol. 2011;1:1-3.
43. Adler A, Guardo R. A neural network image reconstruction technique for electrical impedance tomography. IEEETrans. Med. Imaging. 1994;13:594-600.
44. Kohonen T. Self-organized formation of topologically correct feature maps. Biol. Cybern. 1982;43:59-69.
45. Kohonen T. Self-organizing maps. 3rd extended ed. Vol. 30, Springer series in information sciences. New York (NY): Springer; 2001.
46. Egmont-PetersenM, RidderD, Handels H. Image processing with neural networks - a review. Pattern Recogn. 2002;35:2279-2301.
47. Detorakis G, Rougier N. A neural field model of the somatosensory cortex: formation, maintenance and reorganization of ordered topographic maps. PLoS ONE, Pub. Lib. Sci. 2012;7:e40257.
48. Beale M, Hagan M, Demuth H. Neural network toolbox 7.0.3: users guide. Natick, USA:TheMathWorks, Inc.; 2012.
49. Gallistel C. The organization of learning. Cambridge (MA): MIT Press; 1993.
50. Lieberman D. Learning: behavior and cognition. 2nd ed. Pacific Grove (CA): Brooks/Cole; 1993.
51. Adler A, Lionheart W. Uses and abuses of eidors: an extensible software base for eit. Physiol. Meas. 2006;27:25-42.
52. Vauhkonen M, Lionheart W, Heikkinen L, et al. A matlab package for the eidors project to reconstruct twodimensional eit images. Physiol. Meas. 2001;22:107-111.
53. Fruchterman T, Reingold E. Graph drawing by forcedirected placement. Software: Pract. Experience. 1991;21:1129-1164.
54. Haykin S. Neural networks: a comprehensive foundation. New York: Macmillan; 1994.
55. Silvera-Tawil D, Rye D, Soleimani M, et al. Electrical impedance tomography for artificialsensitive robotic skin: a review. IEEE Sen. J. 2015;15:1129-1164.
56. Boyle A, Borsic A, Adler A. Addressing the computational cost of large eit solutions. Physiol. Meas. 2012;33:787-800.
57. Gallace A, Spence C. Touch and the body: the role of the somatosensory cortex in tactile awareness. Psyche. 2007;16:31-67.
58. Gallace A, Spence C. The cognitive and neural correlates of "tactile consciousness":Amultisensory perspective. Consci. Cog. 2008;17:370-407.
59. PittiA, Alirezaei H, KuniyoshiY. Cross-modal and scale-free action representations through enaction. Neural Networks. 2009;22:144-154.
60. Pitti A, Kuniyoshi Y, Quoy M, et al. Modeling the minimal newborn's intersubjectivemind: the visuotopic-somatotopic alignment hypothesis in the superior colliculus. PLoS ONE. 2013;8:e69474.
61. Nejatali A, Ciric I. Impedance image reconstruction using neural networks. Vol. 3, In: IEEE Antennas and Propagation Society International Symposium - APSURSI; Montreal (QC), Canada; 1997. p. 1726-1729.
62. Stasiaka M, Sikorab J, Filipowiczb S, et al. Principal component analysis and artificial neural network approach to electrical impedance tomography problems approximated by multi-region boundary element method. Eng. Anal. Boundary Elem. 2007;31:713-739.
63. Wang P, Xie L, Sun Y. Application of pso algorithm and rbf neural network in electrical impedance tomography. In: IEEE 9th International Conference on Electronic Measurement and Instruments, ICEMI; Beijing, China; 2009. p. 2-517-2-521.
64. Vehtari A, Lampinen J. Bayesian mlp neural networks for image analysis. Pat. Recog. Let. 2000;21:1183-1191.
65. Peng Y, Mo YL. Locating impedance change in electrical impedance tomography based on multilevel bp neural network. J. Shanghai Univ. (English Edition). 2003;7:251-255.
66. Ghasemazar M, Vahdat B. Error study of eit inverse problem solution using neural networks. In: IEEE International Symposium on Signal Processing and Information Technology; Giza, Egypt; 2007. p. 894-899.
67. Miller A, Blott B, Hames T. Neural networks for electrical impedance tomography image characterisation. Clin. Phys. Physiol. Meas. 1992;13:119-23.
68. Ratajewicz-Mikolajczak, Shirkoohi G, Sikora J. Two ann reconstruction methods for electrical impedance tomography. IEEE Trans. Magn. 1998;34:2964-2967.
69. Takeuchi J, KosugiY. Neural network representation of finite element method. Neural Networks. 1994;7:389-395.
70. Teague G, Tapson J, Smit Q. Neural network reconstruction for tomography of a gravel-air-seawater mixture. Meas. Sci. Technol. 2001;12:1102-1108.