Context-aware obstacle detection for navigation by visually impaired

Image and Vision Computing

Volumn 64, Issue , 2017, Pages 103-115

  Gharani, Pedram ^a   Karimi, Hassan A ^a  

^a University of Pittsburgh ^*  (United States)

Author keywords

Indoor navigation; Obstacle detection; Visual navigation; Visually impaired

Indexed keywords

DATA FUSION; NAVIGATION; OBSTACLE DETECTORS; SMARTPHONES; VIDEO STREAMING;

DATA FUSION TECHNIQUE; IN-DOOR NAVIGATIONS; INDOOR ENVIRONMENT; OBSTACLE DETECTION; VISUAL NAVIGATION; VISUAL OBSTACLE DETECTION; VISUALLY IMPAIRED; VISUALLY IMPAIRED PEOPLE;

AIR NAVIGATION;

EID: 85025099821     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2017.06.002     Document Type: Article

References (63)

1. Bao, L., Intille, S.S., Activity recognition from user-annotated acceleration data. Pervasive Computing, 2004, Springer, 1–17.
2. Batavia, P.H., Pomerleau, D.a., Thorpe, C.E., Overtaking vehicle detection using implicit optical flow. Comput. Stand. Interfaces, 20, 1999, 466, 10.1016/S0920-5489(99)91018-8.
3. Beauchemin, S.S., Barron, J.L., The computation of optical flow. ACM Comput. Surv. 27 (1995), 433–466, 10.1145/212094.212141.
4. Benjamin, J.M., Ali, N.A., Schepis, A.F., A laser cane for the blind. Proceedings of the San Diego Biomedical Symposium, 1973.
5. Borenstein, J., The GuideCane-applying mobile robot technologies to assist the visually impaired. IEEE Trans. Syst. Man Cybern. A Syst. Hum. 31 (2001), 131–136.
6. Boroujeni, N.S., Fast obstacle detection using targeted optical flow. (ICIP), 2012 19th IEEE … 2, 2012, 65–68, 10.1109/ICIP.2012.6466796.
7. Bousbia-Salah, M., Bettayeb, M., Larbi, A., A navigation aid for blind people. J. Intell. Robot. Syst. 64 (2011), 387–400, 10.1007/s10846-011-9555-7.
8. Browning, N.A., Grossberg, S., Mingolla, E., A neural model of how the brain computes heading from optic flow in realistic scenes. Cogn. Psychol. 59 (2009), 320–356, 10.1016/j.cogpsych.2009.07.002.
9. Camus, T., Real-Time Optical Flow. 1994, Society of Manufacturing Engineers.
10. Cheng, C.C., Li, C. Te, Chen, L.G., A novel 2Dd-to-3D conversion system using edge information. IEEE Trans. Consum. Electron. 56 (2010), 1739–1745, 10.1109/TCE.2010.5606320.
11. Cimiano, P., Hotho, A., Staab, S., Comparing conceptual, divise and agglomerative clustering for learning taxonomies from text. Proceedings of the 16th Eureopean Conference on Artificial Intelligence, ECAI’2004, Including Prestigious Applicants of Intelligent Systems, PAIS 2004, 2004.
12. Costa, P., Fernandes, H., Martins, P., Barroso, J., Hadjileontiadis, L.J., Obstacle detection using stereo imaging to assist the navigation of visually impaired people. Procedia Comput. Sci. 14 (2012), 83–93, 10.1016/j.procs.2012.10.010.
13. Cui, H., Bhatt, R., Jin, T., Sun, Y., Arbor, A., Virtual Sight: Haptic Device for Visually Impaired. 2010.
14. El-Gaaly, T., Tomaszewski, C., Valada, A., Visual Obstacle Avoidance for Autonomous Watercraft Using Smartphones. 2013.
15. Fallah, N., Apostolopoulos, I., Bekris, K., Folmer, E., Indoor human navigation systems: a survey. Interact. Comput. 25 (2013), 21–33, 10.1093/iwc/iws010.
16. Farmer, L.W., Smith, D.L., Adaptive technology for orientation and mobility. Wiener, W.R., Welsh, R.L., Blasch, B.B., (eds.) Foundations of Orientation and Mobility, 1997, AFB Press, New York, 231–259.
17. Fischler, M.a., Bolles, R.C., Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24 (1981), 381–395, 10.1145/358669.358692.
18. Ganz, A., Gandhi, S.R., Schafer, J., Singh, T., Puleo, E., Mullett, G., Wilson, C., PERCEPT: indoor navigation for the blind and visually impaired. Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. EMBS, 2011, 856–859, 10.1109/IEMBS.2011.6090223.
19. Ganz, A., Schafer, J.M., Tao, Y., Wilson, C., Robertson, M., PE RCEPT - II: smartphone based Indoor navigation system for the B lind. 36th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., 2014, 3662–3665, 10.1109/EMBC.2014.6944417.
20. Golledge, R.G., Marston, J.R., Attitudes of visually impaired persons toward the use. J. Vis. Impair. Blind., 91, 1997, 446.
21. Guerrero, L.a., Vasquez, F., Ochoa, S.F., An indoor navigation system for the visually impaired. Sensors 12 (2012), 8236–8258, 10.3390/s120608236.
22. Liu, Haiying, Chellappa, R., Rosenfeld, A., Accurate dense optical flow estimation using adaptive structure tensors and a parametric model. IEEE Trans. Image Process. 12 (2003), 1170–1180, 10.1109/TIP.2003.815296.
23. Harper, S., Pettitt, S., Goble, C., Sentinel: towards an ambient mobility network. Disabil. Rehabil., 25, 2003, 940.
24. Harris, C., Stephens, M., A combined corner and edge detector. Procedings Alvey Vis. Conf. 1988, 1988, 23.1–23.6, 10.5244/C.2.23.
25. Helal, A., Moore, S.E., Ramachandran, B., Drishti: an integrated navigation system for visually impaired and\disabled. Proc. Fifth Int. Symp. Wearable Comput, 2001, 149–156, 10.1109/ISWC.2001.962119.
26. Horn, B.K.P., Schunck, B.G., Determining optical flow. Artif. Intell., 1981, 10.1016/0004-3702(81)90024-2.
27. José, J., du Buf, J.M.H., Rodrigues, J.M.F., Visual navigation for the blind path and obstacle detection. International Conference on Pattern Recognition Applications and Methods, 2012, 515–519.
28. Katz, B.F.G., Kammoun, S., Parseihian, G., Gutierrez, O., Brilhault, A., Auvray, M., Truillet, P., Denis, M., Thorpe, S., Jouffrais, C., NAVIG: augmented reality guidance system for the visually impaired. Virtual Reality 16 (2012), 253–269, 10.1007/s10055-012-0213-6.
29. Ke, Y.K.Y., Sukthankar, R., PCA-SIFT: a more distinctive representation for local image descriptors. Proc. 2004 IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognition, 2004 CVPR 2004, Vol. 2, 2004, 2–9, 10.1109/CVPR.2004.1315206.
30. Kira, K., Rendell, L.A., A practical approach to feature selection. Proceedings of the Ninth International Workshop on Machine Learning, 1992, 10.1016/S0031-3203(01)00046-2.
31. Low, T., Wyeth, G., Obstacle detection using optical flow. Australas. Conf. Robot. Autom., 1998, 1–10.
32. Lowe, D.G., Object recognition from local scale-invariant features. IEEE Int. Conf. Comput. Vis., 1999, 10.1109/ICCV.1999.790410.
33. Lucas, B.D., Kanade, T., An iterative image registration technique with an application to stereo vision. 7th Int. Jt. Conf. Artif. Intell, 1981, 10.1145/358669.358692.
34. Marston, J.R., Golledge, R.G., The hidden demand for participation in activities and travel by persons who are visually impaired. J. Vis. Impair. Blind., 97, 2003, 475.
35. Martinez, J.M.S., Ruiz, F.E., Stereo-based aerial obstacle detection for the visually impaired. Workshop on Computer Vision Applications for the Visually Impaired, 2008.
36. Minoru 3D webcam [WWW Document], URL http://www.minoru3d.com, 2010.
37. Murray, D., Little, J.J., Using real-time stereo vision for mobile robot navigation. Auton. Robot. 8 (2000), 161–171, 10.1023/A:1008987612352.
38. Nakju, J.L., Doh, L., Kyun, W., You, C.B., Il, Y., Youm, J.-S.L.N.L.D.W.K.C.B.-J.Y.Y. Il, Door detection algorithm of mobile robot in hallway using Pc-camera. Isarc, 2004, 2004, 1.
39. O'Donovan, P., Optical flow: techniques and applications. Int. J. Comput. Vis., 1–26, 2005.
40. Ohya, A., Kosaka, A., Kak, A., Vision-based navigation by a mobile robot with obstacle avoidance using single-camera vision and ultrasonic sensing. IEEE Trans. Robot. Autom. 14 (1998), 969–978, 10.1109/70.736780.
41. Peng, E., Peursum, P., Li, L., Venkatesh, S., A smartphone-based obstacle sensor for the visually impaired. Lect. Notes Comput. Sci. (Including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics) LNCS, Vol. 6406, 2010, 590–604, 10.1007/978-3-642-16355-5-45.
42. Pradeep, V., Medioni, G., Weiland, J., Robot vision for the visually impaired. 2010 IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. - Work, 2010, 15–22, 10.1109/CVPRW.2010.5543579.
43. Qian, S., Tan, J.K., Kim, H., Ishikawa, S., Morie, T., Obstacles extraction using a moving camera. Computer Vision - ACCV 2012 Workshops, 2013, 441–453, 10.1007/978-3-642-37484-5_36.
44. Ran, L., Helal, S., Moore, S., Drishti: an integrated indoor/outdoor blind navigation system and service. Proc. - Second IEEE Annu. Conf. Pervasive Comput. Commun. PerCom, 2004, 23–30, 10.1109/PERCOM.2004.1276842.
45. Ravi, N., Dandekar, N., Mysore, P., Littman, M.L., Activity recognition from accelerometer data. AAAI, 2005, 1541–1546.
46. Ren, M., Karimi, H.A., Movement pattern recognition assisted map matching for pedestrian/wheelchair navigation. J. Navig. 65 (2012), 617–633, 10.1017/S0373463312000252.
47. Robnik-Siknja, M., Kononeko, I., Theoretical and empirical analysis of RelifF and RReliefF. Mach. Learn. 53 (2003), 23–69.
48. Rodríguez, A., Yebes, J.J., Alcantarilla, P., Bergasa, L., Almazán, J., Cela, A., Assisting the visually impaired: obstacle detection and warning system by acoustic feedback. Sensors 12 (2012), 17476–17496, 10.3390/s121217476.
49. Roentgen, U.R., Gelderblom, G.J., Soede, M., De Witte, L.P., Inventory of electronic mobility aids for persons with visual impairments: a literature review. J. Vis. Impair. Blind., 702–724, 2008.
50. Rublee, E., Bradski, G., ORB — an efficient alternative to SIFT or SURF. 2011, 10.1109/ICCV.2011.6126544.
51. Saeedi, S., Context-Aware Personal Navigation Services Using Multi-level Sensor Fusion Algorithms. Thesis, 2013, University of Calgary.
52. Saeedi, S., Moussa, A., El-Sheimy, N., Context-aware personal navigation using embedded sensor fusion in smartphones. Sensors 14 (2014), 5742–5767, 10.3390/s140405742.
53. Song, K., Huang, J., Fast optical flow estimation and its application to real-time obstacle avoidance. Proc. 2001 ICRA IEEE Int. Conf. Robot. Autom. (cat. No.01CH37164), Vol. 3, 2001, 2891–2896, 10.1109/ROBOT.2001.933060.
54. Souhila, K., Karim, A., Optical flow based robot obstacle avoidance. Int. J. Adv. Robot. Syst. 4 (2007), 13–16, 10.5772/5715.
55. Stark, L., Inverse perspective mapping simplifies optical flow computation and obstacle detection. Biol. Cybern. 185 (1991), 177–185, 10.1007/BF00201978.
56. Tang, J., Alelyani, S., Liu, H., Feature selection for classification: a review. Data Classif. Algorithms Appl, 2014, 37–64 (doi:10.1.1.409.5195).
57. Tapu, R., Mocanu, B., Bursuc, A., Zaharia, T., A smartphone-based obstacle detection and classification system for assisting visually impaired people. 2013 IEEE International Conference on Computer Vision Workshops, 2013, IEEE, 444–451, 10.1109/ICCVW.2013.65.
58. Tistarelli, M., Sandini, G., On the advantages of polar and log-polar mapping for direct estimation of time-to-impact from optical flow. IEEE Trans. Pattern Anal. Mach. Intell. 15 (1993), 401–410 (doi:0162-8828/93$03.00).
59. Xu, A., Namit, G., SURF : speeded-up robust features. Comput. Vis. Image Underst. 110 (2008), 1–30.
60. Zhang, M.-L., Zhou, Z.-H., A k-nearest neighbor based algorithm for multi-label classification. Granular Computing, 2005 IEEE International Conference on, 2005, 718–721.
61. Zheng, Y., Shen, G., Li, L., Zhao, C., Li, M., Zhao, F., Travi-navi: self-deployable indoor navigation system. Proc. 20th Annu. Int. Conf. Mob. Comput. Netw. - MobiCom ‘14, 2014, 471–482, 10.1145/2639108.2639124.
62. Zingg, S., Scaramuzza, D., Weiss, S., Siegwart, R., MAV navigation through indoor corridors using optical flow. Proc. - IEEE Int. Conf. Robot. Autom, 2010, 3361–3368, 10.1109/ROBOT.2010.5509777.
63. Szeliski, Richard, Computer vision: algorithms and applications. 2010, Springer Science & Business Media.