Assisting the visually impaired: Obstacle detection and warning system by acoustic feedback

Sensors (Switzerland)

Volumn 12, Issue 12, 2012, Pages 17476-17496

  Rodríguez, Alberto ^a   Javier Yebes, J ^a   Alcantarilla, Pablo F ^b   Bergasa, Luis M ^a   Almazán, Javier ^a   Cela, Andrés ^c  

^a UNIVERSITY OF ALCALÁ   (Spain)

^b UNIVERSITÉ CLERMONT AUVERGNE   (France)

^c INSTITUTO POLITÉCNICO NACIONAL   (Mexico)

Author keywords

Audio warning; Ground plane estimation; Obstacle detection; Stereo camera; Visually impaired

Indexed keywords

AUDIO WARNING; GROUND PLANES; OBSTACLE DETECTION; STEREO CAMERAS; VISUALLY IMPAIRED;

AUDITION; CAMERAS; HUMAN REHABILITATION EQUIPMENT; OBSTACLE DETECTORS;

AUDIO ACOUSTICS;

ACOUSTICS; ALGORITHM; ARTICLE; COMPUTER INTERFACE; COMPUTER PROGRAM; EQUIPMENT; EQUIPMENT DESIGN; FEMALE; HUMAN; PATIENT; SENSORY AID;

ACOUSTICS; ALGORITHMS; EQUIPMENT DESIGN; FEMALE; HUMANS; SENSORY AIDS; SOFTWARE; USER-COMPUTER INTERFACE; VISUALLY IMPAIRED PERSONS;

EID: 84871706398     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s121217476     Document Type: Article

References (36)

1. Pradeep, V.; Medioni, G.; Weiland, J. Robot Vision for the Visually Impaired. In Proceedings of 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, San Francisco, CA, USA, 13-18 June 2010; pp. 15-22.
2. Alcantarilla, P.F.; Yebes, J.J.; Almazán, J.; Bergasa, L.M. On Combining Visual SLAM and Dense Scene Flow to Increase the Robustness of Localization and Mapping in Dynamic Environments. In Proceedings of the IEEE International Conference on Robotics and Automation, Saint Paul, MN, USA, 14-18 May 2012; pp. 1290-1297.
3. Dakopoulos, D.; Bourbakis, N.G. Wearable obstacle avoidance electronic travel aids for blind: A survey. IEEE Trans. Syst. Man Cybern. C 2010, 40, 25-35.
4. Saéz, J.M.; Escolano, F.; Penalver, A. First Steps towards Stereo-Based 6DOF SLAM for the Visually Impaired. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, San Diego, CA, USA, 25 June 2005; p. 23.
5. Saéz, J.M.; Escolano, F. Stereo-Based Aerial Obstacle Detection for the Visually Impaired. In Proceedings of Workshop on Computer Vision Applications for the Visually Impaired, Marselle, France, 18 October 2008.
6. Geiger, A.; Lauer, M.; Urtasun, R. A Generative Model for 3D Urban Scene Understanding from Movable Platforms. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 20-25 June 2011; pp. 1945-1952.
7. Hesch, J.A.; Roumeliotis, S.I. Design and analysis of a portable indoor localization aid for the visually impaired. Int. J. Robot. Res. 2010, 29, 1400-1415.
8. Loomis, J.; Golledge, R.G.; Klatzky, R.L. GPS-Based Navigation Systems for the Visually Impaired. In Fundamentals of Wearable Computers and Augmented Reality; Barfield, W., Caudell, T. Eds.; Lawrence Erlbaum Associates Publishers: Mahwah, NJ, USA, 2001.
9. Oh, S.M.; Tariq, S.; Walker, B.; Dellaert, F. Map-Based Priors for Localization. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan, 28 September-2 October 2004; pp. 2179-2184.
10. Walker, B.N.; Lindsay, J. Navigation performance with a virtual auditory display: Effects of beacon sound, capture radius, and practice. Hum. Factors 2006, 48, 265-278.
11. Kulyukin, V.; Gharpure, C.; Nicholson, J. RFID in Robot-Assisted Indoor Navigation for the Visually Impaired. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan, 28 September-2 October 2004; pp. 1979-1984.
12. Vedula, S.; Baker, S.; Rander, P.; Collins, R.; Kanade, T. Three-Dimensional scene flow. IEEE Trans. Patt. Anal. Mach. Intellect. 2005, 27, 475-480.
13. Borenstein, J.; Koren, Y.; Member, S. The vector field histogram-fast obstacle avoidance for mobile robots. IEEE J. Robot. Autom. 1991, 7, 278-288.
14. Fernández, J.; Sanz, R.; Benayas, J.A.; Diéguez, A.R. Improving collision avoidance for mobile robots in partially known environments: The beam curvature method. J. Robot. Auton. Syst. 2004, 46, 205-219.
15. Durham, J.W.; Bullo, F. Smooth Nearness-Diagram Navigation. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice, France, 22-26 September 2008; pp. 690-695.
16. Kumar, S. Binocular Stereo Vision Based Obstacle Avoidance Algorithm for Autonomous Mobile Robots. In Proceedings of IEEE International Advance Computing Conference, Patiala, India, 6-7 March 2009; pp. 254-259.
17. Peng, E.; Peursum, P.; Li, L.; Venkatesh, S. A smartphone-based obstacle sensor for the visually impaired. Lect. Note Comput. Sci. 2010, 6406, 590-604.
18. Manduchi, R. Mobile vision as assistive technology for the blind: An experimental study. Lect. Note Comput. Sci. 2012, 7383, 9-16.
19. Shin, B.S.; Lim, C.S. Obstacle detection and avoidance system for visually impaired people. Lect. Note Comput. Sci. 2007, 4813, 78-85.
20. Chen, L.; Guo, B.l.; Sun, W. Obstacle Detection System for Visually Impaired People Based on Stereo Vision. In Proceedings of 2010 Fourth International Conference on Genetic and Evolutionary Computing, Shenzhen, China, 13-15 December 2010; pp. 723-726.
21. Broggi, A.; Caraffi, C.; Fedriga, R.I.; Grisleri, P. Obstacle Detection with Stereo Vision for Off-Road Vehicle Navigation. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, San Diego, CA, USA, 25 June 2005; p. 65.
22. Müller, T.; Rannacher, J.; Rabe, C.; Franke, U. Feature-and Depth-Supported Modified Total Variation Optical Flow for 3D Motion Field Estimation in Real Scenes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 20-25 June 2011; pp. 1193-1200.
23. Konolige, K. Small Vision Systems: Hardware and Implementation. In Proceedings of the 8th International Symposium in Robotic Research, Kanagawa, Japan, 4-7 October 1997; pp. 203-212.
24. Hirschmuller, H. Stereo processing by semiglobal matching and mutual information. IEEE Trans. Patt. Anal. Mach. Intellect. 2008, 30, 328-341.
25. Geiger, A.; Roser, M.; Urtasun, R. Efficient large-scale stereo matching. Lect. Note Comput. Sci. 2011, 6492, 25-38.
26. Ulrich, I.; Borenstein, J. The guidecane-applying mobile robot technologies to assist the visually impaired. IEEE Trans. Syst. Man Cybern. A Syst. Hum. 2001, 31, 131-136.
27. Bolles, R.; Fischler, M. A Ransac-Based Approach to Model Fitting and its Application to Finding Cylinders in Range Data. In Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vancouver, Canada, 24-28 August 1981; pp. 637-643.
28. Chumerin, N.; Hulle, M.M.V. Ground Plane Estimation Based on Dense Stereo Disparity. In Proceedings of the Fifth International Conference on Neural Networks and Artificial Intelligence, Minsk, Belarus, 27-30 May 2010; pp. 209-213.
29. Strumillo, P. Electronic Interfaces Aiding the Visually Impaired in Environmental Access, Mobility and Navigation. In Proceedings of the 3rd Conference on Human System Interactions, Rzeszow, Poland, 13-15 May 2010; pp. 17-24.
30. ONCE. Available online: http://www.once.es/new/otras-webs/english (accessed on 4 October 2012).
31. Stenfelt, P.Y.S.; Goode, R.L. Transmission properties of bone conducted sound: Measurements in cadaver heads. J. Acoust. Soc. Am. 2005, 118, 2373-2391.
32. Walker, B.N.; Stanley, R.M.; Przekwas, A.; Tan, X.G.; Chen, Z.J.; Yang, H.W.; Wilkerson, P.; Harrand, V.; Chancey, C.; Houtsma, A.J.M. High Fidelity Modeling and Experimental Evaluation of Binaural Bone Conduction Communication Devices. In Proceedings of the 19th International Congress on Acoustics (ICA), Madrid, Spain, 2-7 September 2007.
33. Jameson, B.; Manduchi, R. Watch Your Head: AWearable CollisionWarning System for the Blind. In Proceedings of IEEE Sensors Conference, Kona, HI, USA, 1-4 November 2010; pp. 1922-1927.
34. SDL library. Available online: http://www.libsdl.org/ (accessed on 4 October 2012).
35. Point Grey. Bumblebee2 CCD Camera. Available online: http://www.ptgrey.com/products/ bumblebee2 (accessed on 3 October 2012).
36. Ivanchenko, V.; Shen, H.; Coughlan, J.M. Elevation-based MRF Stereo Implemented in Real-Time on a GPU. In Proceedings of 2009 Workshop on Applications of Computer Vision (WACV), Snowbird, UT, USA, 7-8 December 2009; pp. 1-8.