Toward local and global perception modules for vision substitution

Neurocomputing

Volumn 74, Issue 8, 2011, Pages 1182-1190

  Bologna, Guido ^a   Deville, Benot ^a   Diego Gomez, Juan ^a   Pun, Thierry ^a  

^a UNIVERSITY OF GENEVA   (Switzerland)

Author keywords

Colour sonification; Mobility experiments; Sensorial substitution; Sound spatialisation; Stereo vision

Indexed keywords

AUDITORY CHANNEL; BLIND PEOPLE; LOW COST APPROACH; MOBILITY AIDS; MOBILITY EXPERIMENTS; NEURAL IMPLANTS; QUANTISATION; REAL TIME; SENSORIAL SUBSTITUTION; SONIFICATIONS; SOUND SOURCE; SOUND SPATIALISATION; USER ACCEPTANCE; VIDEO IMAGE; VISION INFORMATION; VISUALLY IMPAIRED;

EXPERIMENTS; HANDICAPPED PERSONS; MUSICAL INSTRUMENTS; PARKS; STEREO VISION;

COLOR;

ARTICLE; COLOR VISION; DEPTH PERCEPTION; HUMAN; OBJECT RELATION; PRIORITY JOURNAL; SOUND DETECTION; TASK PERFORMANCE; VISION; VISUAL AID; VISUAL INFORMATION;

EID: 79952617414     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.07.022     Document Type: Article

References (40)

1. V.R. Algazi, R.O. Duda, D.P. Thompson, C. Avendano, The CIPIC HRTF Database, in: Proceedings of the WASPAA'01, New Paltz, NY, 2001.
2. A. Arnoldussen, C. Nemke, R. Hogle, K. Skinner, BrainPort plasticity: balance and vision applications, in: Proceedings of the Ninth International Conference on Low Vision, 2008.
3. Bach-y-Rita P., Kaczmarek K., Tyler M., Garcia-Lara J. Form perception with a 49-point electrotactile stimulus array on the tongue. J. Rehab. Res. Dev. 1998, 35:427-431.
4. R. Begault, 3-D Sound for Virtual Reality and Multimedia, Boston A.P. Professional, 1994, ISBN: 0120847353.
5. M.J. Benjamin, N.A. Ali, A.F. Schepis, A laser cane for blinds, in: Proceedings of the San Diego Biomedical Symposium, vol. 12, 1973, pp. 53-57.
6. Bliss J.C. Reading machines for the blind. Active Touch: The Mechanism of Recognition of Objects by Manipulation, A Multidisciplinary Approach 1978, Pergamon Press, Oxford, UK. G. Gordon (Ed.).
7. G. Bologna, M. Vinckenbosch, Eye tracking in coloured image scenes represented by ambisonic fields of musical instrument sounds, in: Proceedings of the International Work-Conference on the Interplay between Natural and Artificial Computation (IWINAC), (1), Las Palmas, Spain, June 2005, pp. 327-333.
8. G. Bologna, B. Deville, T. Pun, M. Vinckenbosch, Transforming 3D coloured pixels into musical instrument notes for vision substitution applications, in: A. Caplier, T. Pun, D. Tzovaras (Guest Eds.), Eurasip Journal of Image and Video Processing, 2007, Article ID 76204, 14 pp. (Open access article).
9. G. Bologna, B. Deville, M. Vinckenbosch, T. Pun, A perceptual interface for vision substitution in a color matching experiment, in: Proceedings of the International Joint Conference on Neural Networks, Part of IEEE World Congress on Computational Intelligence, Hong Kong, June 1-6, 2008.
10. Bologna G., Deville B., Pun T. On the use of the auditory pathway to represent image scenes in real-time. Neurocomputing 2009, 72:839-849. Electronic publication: 2008, Article DOI: 〈http://dx.doi.org/10.1016/j.neucom.2008.06.020〉.
11. G. Bologna, B. Deville, T. Pun, Blind navigation along a sinuous path by means of the See ColOr interface, in: J. Mira, J.M. Ferrández, J.R. Álvarez, F. Paz, F.J. Toledo (Eds.), Proceedings of the Third International Work-Conference on the Interplay between Natural and Artificial Computation: Part II: Bioinspired Applications in Artificial and Natural Computation (Santiago de Compostela, Spain, June 22-26, 2009), Lecture Notes In Computer Science, vol. 5602, Springer-Verlag, Berlin, Heidelberg.
12. J. Borenstein, I. Ulrich, The guide cane, a computerized travel aid for the active guidance of blind pedestrians, in: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Albuquerque, April 21-27 1997, pp. 1283-1288.
13. Capelle C., Trullemans C., Arno P., Veraart C. A real time experimental prototype for enhancement of vision rehabilitation using auditory substitution. IEEE T. Bio-Med. Eng. 1998, 45:1279-1293.
14. Z. Capalbo, B. Glenney, Hearing color: radical plurastic realism and SSDs, in: Proceedings of the Fifth Asia-Pacific Computing and Philosophy Conference (AP-CAP 2009), Tokyo, Japan, October 1-2 2009.
15. Deville B., Bologna G., Vinckenbosch M., Pun T. See Color: seeing colours with an orchestra. Lecture Notes in Computer Science 2009, vol. 5440:251-279. Springer-Verlag, Berlin, Heidelberg.
16. K. Doel, Soundview: sensing color images by kinesthetic audio, in: Proceedings of the International Conference on Auditory Display, Boston, MA, USA, July 6-9, 2003.
17. R. Farcy, Une aide électronique miniature pour les déplacements des déficients visuels en intérieur: Le "Tom Pouce Light, in: Proceedings of the Handicap 2008, Paris (in French).
18. J.L. Gonzalez-Mora, A. Rodriguez-Hernandez, L.F. Rodriguez-Ramos, L. Dfaz-Saco, N. Sosa, Development of a new space perception system for blind people, based on the creation of a virtual acoustic space, in: Proceedings of the International Work Conference on Artificial and Natural Networks (IWANN), Alicante, Spain, June 1999, pp. 321-330.
19. Hersh M., Johnson M.A. Assistive technology for visually impaired and blind people 2008, Spinger.
20. B.S. Hoyle, S. Dodds, The UltraCane mobility aid at work-from training programmes to in-depth use case studies, in: Proceedings of the Conference on Visual and Hearing Impairments (CVHI), Granada, 19-21 July 2006.
21. Itti L., Koch C., Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 1998, 20:1254-1259.
22. Kay L. A sonar aid to enhance spatial perception of the blind: engineering design and evaluation. Radio Electron. Engr. 1974, 44:605-627.
23. La Pierre C.M. Navigation System for the Visually Impaired 1993, Carleton University, Canada.
24. Loomis J.M., Marston J.R., Golledge R.G., Klatzky R.L. Personal guidance system for visually impaired people: comparison of spatial displays for route guidance. J. Vis. Impairment Blindness 2005, 99(4):219-232.
25. J.R. Marston, Towards an accessible city: empirical measurement and modeling of access to urban opportunities for those with vision impairments, using remote infrared audible signage, Ph.D. Thesis, Department of Geography, University of California Santa Barbara, 2002.
26. S. Meers, K. Ward, A vision system for providing 3D perception of the environment via transcutaneous electro-neural stimulation, in: Proceedings of the Information Visualisation, Eighth International Conference, July 14-16, 2004, IV, IEEE Computer Society, Washington, DC, pp. 546-552.
27. S. Meers, K. Ward, A vision system for providing the blind with 3d colour perception of the environment, in: Proceedings of the Asia-Pacific Workshop on Visual Information Processing, Hong Kong, December 2005, pp. 102-108.
28. Meijer P.B.L. An experimental system for auditory image representations. IEEE Trans. Bio. Eng. 1992, 39(2):112-121.
29. J. Pasquero, V. Hayward, STRESS: a practical tactile display systems with one millimeter spatial resolution and 7000Hz refresh rate, in: Proceedings of the Eurohaptics, Dublin, Ireland, 2003.
30. H. Petrie User requirements for a GPS-based travel aid for blind people, in: Proceedings of the Conference on Orientation and Navigation Systems for Blind Persons, 1-2 February 1995, RNIB, UK.
31. Petrie H., Johnson V., Strothotte T., Raab A., Fritz S., Michel R. MoBIC: designing a travel aid for blind and elderly people. J. Navigat. 1996, 49:45-52.
32. Ponchilla P.E., Rak E.C., Freeland A.L., LaGrow S.J. Accessible GPS: reorientation and target location among users with visual impairments. J. Visual Impairment Blindness 2007, 101(7):389-401.
33. L., Ran, S., Helal, S., Moore Drishti: an integrated indoor/outdoor blind navigation system and service, in: Proceedings of the Second IEEE International Conference on Pervasive Computing and Communications (PerCom'04), 2004, p. 23.
34. Rodriguez-Losada D., Matia F., Galan R. Building geometric feature based maps for indoor service robots. J. Robot. Autonomous Systems 2006, 54(7):546-558.
35. J. Rossi, F.J. Perales, J. Varona, M. Roca, Col.diesis: transforming colour into melody and implementing the result in a colour sensor device, in: Proceedings of the Second International Conference in Visualisation, Barcelona, Spain, July 15-17, 2009.
36. Velázquez R., Pissaloux E., Hafez M., Szewczyk J. Tactile rendering with shape memory alloy pin-matrix. IEEE Trans. Instrumentat. Meas. 2008, 57(5):1051-1057.
37. C.R. Wagner, S.J. Lederman, R.D. Howe, A tactile shape display using RC servomotors, in: Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Orlando, USA, 2002.
38. Way T.P., Barner K.E. Automatic visual to tactile translation, part I: human factors, access methods and image manipulation. IEEE Trans. Rehabil. Eng. 1997, 5:81-94.
39. Zhou D.D., Greenberg R.J. Microelectronic visual prostheses. Implantable Neural Prostheses 1: Devices and Applications 2009, Springer. D. Zhou, E. Greenbausm (Eds.).
40. Zrenner E. Will retinal implants restore vision ?. Science 2002, 295:1022-1025.