Interfacing an AER Vision Sensor with a Tactile Display: a Proposal for a New Haptic Feedback Device

Frontiers in Artificial Intelligence and Applications

Volumn 234, Issue , 2011, Pages 332-343

  Motto Ros, Paolo ^a   Pasero, Eros ^a  

^a POLITECNICO DI TORINO   (Italy)

Author keywords

Address Event Representation; Dynamic Visual Sensor; Event Based Processing; Haptic Interface; Sensory Substitution

Indexed keywords

COMPUTER HARDWARE DESCRIPTION LANGUAGES; DISPLAY DEVICES; FEEDBACK; MICE (COMPUTER PERIPHERALS);

ADDRESS-EVENT REPRESENTATION; DYNAMIC VISUAL SENSOR; EVENT-BASED; EVENT-BASED PROCESSING; HAPTIC FEEDBACK DEVICES; HAPTICS INTERFACES; SENSORY SUBSTITUTION; TACTILE DISPLAY; VISION SENSORS; VISUAL SENSOR;

HAPTIC INTERFACES;

EID: 85140256171     PISSN: 09226389     EISSN: 18798314     Source Type: Book Series    
DOI: 10.3233/978-1-60750-972-1-332     Document Type: Conference Paper

References (34)

1. D. Dakopoulos and N. Bourbakis, “Wearable obstacle avoidance electronic travel aids for blind: A survey,” Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, vol. 40, no. 1, pp. 25–35, Jan. 2010.
2. H. Shen, K.-Y. Chan, J. Coughlan, and J. Brabyn, “A mobile phone system to find crosswalks for visually impaired pedestrians,” Technology and Disability, vol. 20, no. 3, pp. 217–224, 2008.
3. V. Ivanchenko, J. Coughlan, and H. Shen, “Crosswatch: A camera phone system for orienting visually impaired pedestrians at traffic intersections,” in Computers Helping People with Special Needs, ser. Lecture Notes in Computer Science, K. Miesenberger, J. Klaus, W. Zagler, and A. Karshmer, Eds. Springer Berlin / Heidelberg, 2008, vol. 5105, pp. 1122–1128.
4. M. R. E. Thomas and T. Troscianko, “Head-mounted mobility aid for low vision using scene classification techniques,” University of Bristol, Bristol, UK, UK, Tech. Rep., 1999.
5. P. Bach-Y-Rita and S. W. Kercel, “Sensory substitution and the human-machine interface,” Trends in Cognitive Sciences, vol. 7, no. 12, pp. 541–546, 2003.
6. K. Kokjer, “The information capacity of the human fingertip,” Systems, Man and Cybernetics, IEEE Transactions on, vol. 17, no. 1, pp. 100–102, Jan. 1987.
7. C. Poirier, A. G. D. Volder, and C. Scheiber, “What neuroimaging tells us about sensory substitution,” Neuroscience & Biobehavioral Reviews, vol. 31, no. 7, pp. 1064 – 1070, 2007.
8. M. Auvray, S. Hanneton, and J. K. O’Regan, “Learning to perceive with a visuo-auditory substitution system: Localisation and object recognition with ‘The vOICe’,” Perception, vol. 36, no. 3, pp. 416–430, 2007.
9. P. Arno, A. Vanlierde, E. Streel, M.-C. Wanet-Defalque, S. Sanabria-Bohorquez, and C. Veraart, “Auditory substitution of vision: pattern recognition by the blind,” Applied Cognitive Psychology, vol. 15, no. 5, pp. 509–519, 2001.
10. J. Cronly-Dillon, K. C. Persaud, and R. Blore, “Blind subjects construct conscious mental images of visual scenes encoded in musical form,” Proceedings of the Royal Society of London. Series B: Biological Sciences, vol. 267, no. 1458, pp. 2231–2238, 2000.
11. L. Dunai, G. Fajarnes, V. Praderas, B. Garcia, and I. Lengua, “Real-time assistance prototype — a new navigation aid for blind people,” in IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society, Nov. 2010, pp. 1173–1178.
12. B. Boulebtateche, M. Bedda, and S. Bensaoula, “Electronic device for blind mobility aid,” Journal of Engineering and Applied Sciences, vol. 1, no. 4, pp. 514–522, 2006.
13. A. Fusiello, A. Panuccio, V. Murino, F. Fontana, and D. Rocchesso, “A multimodal electronic travel aid device,” in Multimodal Interfaces, 2002. Proceedings. Fourth IEEE International Conference on, 2002, pp. 39 – 44.
14. Y. Visell, “Tactile sensory substitution: Models for enaction in HCI,” Interacting with Computers, vol. 21, no. 1-2, pp. 38–53, 2009, special issue: Enactive Interfaces.
15. W. Epstein, B. Hughes, S. L. Schneider, and P. Bach-y Rita, “Perceptual learning of spatiotemporal events: Evidence from an unfamiliar modality,” Journal of Experimental Psychology: Human Perception and Performance, vol. 15, no. 1, pp. 28 – 44, 1989.
16. M.-J. Yoon and K.-H. Yu, “Psychophysical experiment of vibrotactile pattern perception by human fingertip,” Neural Systems and Rehabilitation Engineering, IEEE Transactions on, vol. 16, no. 2, pp. 171–177, april 2008.
17. T. Pietrzak, A. Crossan, S. Brewster, B. Martin, and I. Pecci, “Creating usable pin array tactons for nonvisual information,” Haptics, IEEE Transactions on, vol. 2, no. 2, pp. 61–72, april–june 2009.
18. M. Shimojo, M. Shinohara, and Y. Fukui, “Human shape recognition performance for 3D tactile display,” Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on, vol. 29, no. 6, pp. 637–644, nov 1999.
19. S. A. Wall and S. Brewster, “Sensory substitution using tactile pin arrays: Human factors, technology and applications,” Signal Processing, vol. 86, no. 12, pp. 3674–3695, 2006, special Section: Multimodal Human-Computer Interfaces.
20. P. Bach-Y-Rita, “Tactile sensory substitution studies,” Annals of the New York Academy of Sciences, vol. 1013, no. 1, pp. 83–91, 2004.
21. G. Costa, A. Gusberti, J. P. Graffigna, M. Guzzo, and O. Nasisi, “Mobility and orientation aid for blind persons using artificial vision,” Journal of Physics: Conference Series, vol. 90, no. 1, 2007.
22. P. Lichtsteiner, C. Posch, and T. Delbruck, “A 128 × 128 120 db 15 μs latency asynchronous temporal contrast vision sensor,” Solid-State Circuits, IEEE Journal of, vol. 43, no. 2, pp. 566–576, feb. 2008.
23. K. Boahen, “Point-to-point connectivity between neuromorphic chips using address events,” Circuits and Systems II: Analog and Digital Signal Processing, IEEE Transactions on, vol. 47, no. 5, pp. 416–434, may 2000.
24. T. Delbruck, “Frame-free dynamic digital vision,” in Proceeddings of Intl. Symposium on Secure-Life Electronics, Advanced Electronics for Quality Life and Society. Tokyo, Japan: University of Tokyo, Mar 2008, pp. 21–26.
25. T. Delbruck and P. Lichtsteiner, “Fast sensory motor control based on event-based hybrid neuromorphic-procedural system,” in Circuits and Systems, 2007. ISCAS 2007. IEEE International Symposium on, may 2007, pp. 845–848.
26. J. Conradt, M. Cook, R. Berner, P. Lichtsteiner, R. Douglas, and T. Delbruck, “A pencil balancing robot using a pair of AER dynamic vision sensors,” in Circuits and Systems, 2009. ISCAS 2009. IEEE International Symposium on, may 2009, pp. 781–784.
27. Z. Fu, T. Delbruck, P. Lichtsteiner, and E. Culurciello, “An address-event fall detector for assisted living applications,” Biomedical Circuits and Systems, IEEE Transactions on, vol. 2, no. 2, pp. 88–96, june 2008.
28. D. Bauer, A. N. Belbachir, N. Donath, G. Gritsch, B. Kohn, M. Litzenberger, C. Posch, P. Schön, and S. S., “Embedded vehicle speed estimation system using an asynchronous temporal contrast vision sensor,” EURASIP Journal on Embedded Systems, vol. 2007, 2007.
29. P. Motto Ros, E. Pasero, P. Del Giudice, V. Dante, and E. Petetti, “Interactive reader device for visually impaired people,” in Neural Nets WIRN09 - Proceedings of the 19th Italian Workshop on Neural Nets, Vietri sul Mare, Salerno, Italy, May 28–30 2009, ser. Frontiers in Artificial Intelligence and Applications, B. Apolloni, S. Bassis, and C. Morabito, Eds., vol. 204. Amsterdam, NLD: IOS Press, US, May 2009, pp. 306–313.
30. T. Way and K. Barner, “Automatic visual to tactile translation. I. human factors, access methods and image manipulation,” Rehabilitation Engineering, IEEE Transactions on, vol. 5, no. 1, pp. 81–94, mar 1997.
31. N. R. Pal and S. K. Pal, “A review on image segmentation techniques,” Pattern Recognition, vol. 26, no. 9, pp. 1277–1294, 1993.
32. R. C. Gonzalez and W. R. E., Digital Image Processing, 2nd ed. Prentice Hall, 2002.
33. T. Way and K. Barner, “Automatic visual to tactile translation. II. evaluation of the TACTile image creation system,” Rehabilitation Engineering, IEEE Transactions on, vol. 5, no. 1, pp. 95–105, mar 1997.
34. T. Serrano-Gotarredona, A. Andreou, and B. Linares-Barranco, “AER image filtering architecture for vision-processing systems,” Circuits and Systems I: Fundamental Theory and Applications, IEEE Transactions on, vol. 46, no. 9, pp. 1064–1071, sep 1999.