Neuromorphic Artificial Touch for Categorization of Naturalistic Textures

IEEE Transactions on Neural Networks and Learning Systems

Volumn 28, Issue 4, 2017, Pages 819-829

  Rongala, Udaya Bhaskar ^a   Mazzoni, Alberto ^a   Oddo, Calogero Maria ^a  

^a SCUOLA SUPERIORE SANT ANNA   (Italy)

Author keywords

Neuromorphic artificial touch; neuroprosthetics; neurorobotics; spike based decoding; tactile sensing

Indexed keywords

BIOMIMETICS; NEURAL PROSTHESES;

DECODING PERFORMANCE; MECHANORECEPTORS; NEUROMORPHIC; NEUROPROSTHETICS; NEUROROBOTICS; SLIDING VELOCITIES; TACTILE SENSING; TACTILE SENSORS;

DECODING;

EID: 85027544429     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2015.2472477     Document Type: Article

References (61)

1. R. F. Service, "Minds of their own," Science, vol. 346, no. 6206, pp. 182-183, 2014.
2. S.-C. Liu and T. Delbruck, "Neuromorphic sensory systems," Current Opinion Neurobiol., vol. 20, no. 3, pp. 288-295, 2010.
3. G. Indiveri et al., "Neuromorphic silicon neuron circuits," Frontiers Neurosci., vol. 5, p. 73, May 2011.
4. S. Mitra, S. Fusi, and G. Indiveri, "Real-time classification of complex patterns using spike-based learning in neuromorphic VLSI," IEEE Trans. Biomed. Circuits Syst., vol. 3, no. 1, pp. 32-42, Feb. 2009.
5. X. Navarro, T. B. Krueger, N. Lago, S. Micera, T. Stieglitz, and P. Dario, "A critical review of interfaces with the peripheral nervous system for the control of neuroprostheses and hybrid bionic systems," J. Peripheral Nervous Syst., vol. 10, no. 3, pp. 229-258, 2005.
6. T. Boretius et al., "A transverse intrafascicular multichannel electrode (TIME) to interface with the peripheral nerve," Biosensors Bioelectron., vol. 26, no. 1, pp. 62-69, 2010.
7. R. Kwok, "Neuroprosthetics: Once more, with feeling," Nature, vol. 497, no. 7448, pp. 176-178, 2013.
8. S. Raspopovic et al., "Restoring natural sensory feedback in real-time bidirectional hand prostheses," Sci. Transl. Med., vol. 6, no. 222, p. 222ra19, 2014.
9. D. W. Tan, M. A. Schiefer, M. W. Keith, J. R. Anderson, J. Tyler, and D. J. Tyler, "A neural interface provides long-term stable natural touch perception," Sci. Transl. Med., vol. 6, no. 257, p. 257ra138, 2014.
10. I. Darian-Smith and L. E. Oke, "Peripheral neural representation of the spatial frequency of a grating moving across the monkey's finger pad," J. Physiol., vol. 309, no. 1, pp. 117-133, 1980.
11. Å. B. Vallbo and R. S. Johansson, "Properties of cutaneous mechanoreceptors in the human hand related to touch sensation," Human Neurobiol., vol. 3, no. 1, pp. 3-14, 1984.
12. M. Hollins and S. R. Risner, "Evidence for the duplex theory of tactile texture perception," Perception Psychophys., vol. 62, no. 4, pp. 695-705, 2000.
13. T. Yoshioka, B. Gibb, A. K. Dorsch, S. S. Hsiao, and K. O. Johnson, "Neural coding mechanisms underlying perceived roughness of finely textured surfaces," J. Neurosci., vol. 21, no. 17, pp. 6905-6916, 2001.
14. I. Birznieks, P. Jenmalm, A. W. Goodwin, and R. S. Johansson, "Encoding of direction of fingertip forces by human tactile afferents," J. Neurosci., vol. 21, no. 20, pp. 8222-8237, 2001.
15. H. Jöntell, F. Bengtsson, P. Geborek, A. Spanne, A. V. Terekhov, and V. Hayward, "Segregation of tactile input features in neurons of the cuneate nucleus," Neuron, vol. 83, no. 6, pp. 1444-1452, 2014.
16. Y. Vázquez, E. Salinas, and R. Romo, "Transformation of the neural code for tactile detection from thalamus to cortex," Proc. Nat. Acad. Sci. USA, vol. 110, no. 28, pp. E2635-E2644, 2013.
17. M. A. Harvey, H. P. Saal, J. F. Dammann, III, and S. J. Bensmaia, "Multiplexing stimulus information through rate and temporal codes in primate somatosensory cortex," PLoS Biol., vol. 11, no. 5, pp. e1001558-1-e1001558-11, 2013.
18. A. I. Weber et al., "Spatial and temporal codes mediate the tactile perception of natural textures," Proc. Nat. Acad. Sci. USA, vol. 110, no. 42, pp. 17107-17112, 2013.
19. R. S. Johansson and J. R. Flanagan, "Coding and use of tactile signals from the fingertips in object manipulation tasks," Nature Rev. Neurosci., vol. 10, no. 5, pp. 345-359, 2009.
20. G. Spigler, C. M. Oddo, and M. C. Carrozza, "Soft-neuromorphic artificial touch for applications in neuro-robotics," in Proc. 4th IEEE RAS EMBS Int. Conf. Biomed. Robot. Biomechatronics, Rome, Italy, Jun. 2012, pp. 1913-1918.
21. E. M. Izhikevich, "Simple model of spiking neurons," IEEE Trans. Neural Netw., vol. 14, no. 6, pp. 1569-1572, Nov. 2003.
22. R. S. Dahiya, G. Metta, M. Valle, and G. Sandini, "Tactile sensing-From humans to humanoids," IEEE Trans. Robot., vol. 26, no. 1, pp. 1-20, Feb. 2010.
23. P. Saccomandi, E. Schena, C. M. Oddo, L. Zollo, S. Silvestri, and E. Guglielmelli, "Microfabricated tactile sensors for biomedical applications: A review," Biosensors, vol. 4, no. 4, pp. 422-448, 2014.
24. C. Lucarotti, C. M. Oddo, N. Vitiello, and M. C. Carrozza, "Synthetic and bio-artificial tactile sensing: A review," Sensors, vol. 13, no. 2, pp. 1435-1466, 2013.
25. A. Adamatzky, "Slime mould tactile sensor," Sens. Actuators B, Chem., vol. 188, pp. 38-44, Nov. 2013.
26. A. R. Salgarella et al., "A bio-hybrid mechanotransduction system based on ciliate cells," Microelectron. Eng., vol. 144, pp. 51-56, Aug. 2015.
27. J. A. Fishel and G. E. Loeb, "Bayesian exploration for intelligent identification of textures," Frontiers Neurorobot., vol. 6, p. 4, Jun. 2012.
28. G. Vásárhelyi, M. Ádám, É. Vázsonyi, I. Bársony, and C. Dücs o, "Effects of the elastic cover on tactile sensor arrays," Sens. Actuators A, Phys., vol. 132, no. 1, pp. 245-251, 2006.
29. G. Vásárhelyi, B. Fodor, and T. Roska, "Tactile sensing-processing: Interface-cover geometry and the inverse-elastic problem," Sens. Actuators A, Phys., vol. 140, no. 1, pp. 8-18, Oct. 2007.
30. J. Scheibert, S. Leurent, A. Prevost, and G. Debrégeas, "The role of fingerprints in the coding of tactile information probed with a biomimetic sensor," Science, vol. 323, no. 5920, pp. 1503-1506, 2009.
31. B. Heyneman and M. R. Cutkosky, "Slip classification for dynamic tactile array sensors," Int. J. Robot. Res., pp. 1-18, Mar. 2015.
32. Y. Zhang, A. Hamilton, R. Cheung, B. Webb, P. Argyrakis, and T. Gonos, "Integration of wind sensors and analogue VLSI for an insect-inspired robot," in Computational and Ambient Intelligence, F. Sandoval, A. Prieto, J. Cabestany, and M. Granã, Eds. Berlin, Germany: Springer-Verlag, 2007.
33. P. Argyrakis, A. Hamilton, B. Webb, Y. Zhang, T. Gonos, and R. Cheung, "Fabrication and characterization of a wind sensor for integration with a neuron circuit," Microelectron. Eng., vol. 84, nos. 5-8, pp. 1749-1753, 2007.
34. B. Mitchinson et al., "Empirically inspired simulated electro-mechanical model of the rat mystacial follicle-sinus complex," Proc. Roy. Soc. London B, Biol. Sci., vol. 271, no. 1556, pp. 2509-2516, 2004.
35. M. Pearson et al., "A hardware based implementation of a tactile sensory system for neuromorphic signal processing applications," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Toulouse, France, May 2006, pp. 1-4.
36. M. J. Pearson et al., "Implementing spiking neural networks for real-time signal-processing and control applications: A model-validated FPGA approach," IEEE Trans. Neural Netw., vol. 18, no. 5, pp. 1472-1487, Sep. 2007.
37. T. J. Prescott, M. J. Pearson, B. Mitchinson, J. C. W. Sullivan, and A. G. Pipe, "Whisking with robots from rat vibrissae to biomimetic technology for active touch," IEEE Robot. Autom. Mag., vol. 16, no. 3, pp. 42-50, Oct. 2009.
38. J. C. Sullivan et al., "Tactile discrimination using active whisker sensors," IEEE Sensors J., vol. 12, no. 2, pp. 350-362, Feb. 2012.
39. S. S. Kim, A. P. Sripati, R. J. Vogelstein, R. S. Armiger, A. F. Russell, and S. J. Bensmaia, "Conveying tactile feedback in sensorized hand neuroprostheses using a biofidelic model of mechanotransduction," IEEE Trans. Biomed. Circuits Syst., vol. 3, no. 6, pp. 398-404, Dec. 2009.
40. L. L. Bologna, J. Pinoteau, R. Brasselet, M. Maggiali, and A. Arleo, "Encoding/decoding of first and second order tactile afferents in a neurorobotic application," J. Physiol.-Paris, vol. 105, nos. 1-3, pp. 25-35, 2011.
41. L. L. Bologna et al., "A closed-loop neurobotic system for fine touch sensing," J. Neural Eng., vol. 10, no. 4, p. 046019, 2013.
42. W. W. Lee, J. Cabibihan, and N. V. Thakor, "Bio-mimetic strategies for tactile sensing," in Proc. IEEE SENSORS, Nov. 2013, pp. 1-4.
43. W. W. Lee, H. Yu, and N. V. Thakor, "Gait event detection through neuromorphic spike sequence learning," in Proc. 5th IEEE RAS EMBS Int. Conf. Biomed. Robot. Biomechatronics, Saõ Paulo, Brazil, Aug. 2014, pp. 899-904.
44. E. K. Kim, S. A. Wellnitz, S. M. Bourdon, E. A. Lumpkin, and G. J. Gerling, "Force sensor in simulated skin and neural model mimic tactile SAI afferent spiking response to ramp and hold stimuli," J. NeuroEng. Rehabil., vol. 9, no. 1, pp. 45-59, 2012.
45. D. R. Lesniak et al., "Computation identifies structural features that govern neuronal firing properties in slowly adapting touch receptors," eLife, vol. 3, pp. e01488-1-e01488-20, Jan. 2014.
46. E. K. Kim et al., "An engineered tactile afferent modulation platform to elicit compound sensory nerve action potentials in response to force magnitude," in Proc. IEEE World Haptics Conf., Daejeon, Korea, Apr. 2013, pp. 241-246.
47. L. Beccai et al., "Design and fabrication of a hybrid silicon three-axial force sensor for biomechanical applications," Sens. Actuators A, Phys., vol. 120, no. 2, pp. 370-382, 2005.
48. C. M. Oddo, P. Valdastri, L. Beccai, S. Roccella, M. C. Carrozza, and P. Dario, "Investigation on calibration methods for multi-axis, linear and redundant force sensors," Meas. Sci. Technol., vol. 18, no. 3, pp. 623-631, 2007.
49. C. M. Oddo, M. Controzzi, L. Beccai, C. Cipriani, and M. C. Carrozza, "Roughness encoding for discrimination of surfaces in artificial activetouch," IEEE Trans. Robot., vol. 27, no. 3, pp. 522-533, Jun. 2011.
50. C. M. Oddo, L. Beccai, J. Wessberg, H. B. Wasling, F. Mattioli, and M. C. Carrozza, "Roughness encoding in human and biomimetic artificial touch: Spatiotemporal frequency modulation and structural anisotropy of fingerprints," Sensors, vol. 11, no. 6, pp. 5596-5615, 2011.
51. C. M. Oddo, L. Beccai, N. Vitiello, H. B. Wasling, J. Wessberg, and M. C. Carrozza, "A mechatronic platform for human touch studies," Mechatronics, vol. 21, no. 3, pp. 604-613, 2011.
52. L. A. Jones and S. J. Lederman, "Tactile sensing," in Human Hand Function, L. A. Jones and S. J. Lederman, Eds. New York, NY, USA: Oxford Univ. Press, 2006.
53. E. M. Izhikevich, "Which model to use for cortical spiking neurons" IEEE Trans. Neural Netw., vol. 15, no. 5, pp. 1063-1070, Sep. 2004.
54. N. S. Altman, "An introduction to kernel and nearest-neighbor nonparametric regression," Amer. Statist., vol. 46, no. 3, pp. 175-185, 1992.
55. R. S. Johansson and I. Birznieks, "First spikes in ensembles of human tactile afferents code complex spatial fingertip events," Nature Neurosci., vol. 7, no. 2, pp. 170-177, 2004.
56. J. D. Victor and K. P. Purpura, "Nature and precision of temporal coding in visual cortex: A metric-space analysis," J. Neurophysiol., vol. 76, no. 2, pp. 1310-1326, 1996.
57. Y. Zuo, H. Safaai, G. Notaro, A. Mazzoni, S. Panzeri, and M. E. Diamond, "Complementary contributions of spike timing and spike rate to perceptual decisions in rat S1 and S2 cortex," Current Biol., vol. 25, no. 3, pp. 357-363, 2015.
58. R. Brasselet, R. S. Johansson, and A. Arleo, "Quantifying neurotransmission reliability through metrics-based information analysis," Neural Comput., vol. 23, no. 4, pp. 852-881, 2011.
59. E. N. Brown, R. E. Kass, and P. P. Mitra, "Multiple neural spike train data analysis: State-of-the-art and future challenges," Nature Neurosci., vol. 7, no. 5, pp. 456-461, 2004.
60. I. M. Park, M. L. R. Meister, A. C. Huk, and J. W. Pillow, "Encoding and decoding in parietal cortex during sensorimotor decision-making," Nature Neurosci., vol. 17, no. 10, pp. 1395-1403, 2014.
61. V. Lopes-dos-Santos, S. Panzeri, C. Kayser, M. E. Diamond, and R. Q. Quiroga, "Extracting information in spike time patterns with wavelets and information theory," J. Neurophysiol., vol. 113, no. 3, pp. 1015-1033, 2014.