Stereo-based all-terrain obstacle detection using visual saliency

Journal of Field Robotics

Volumn 28, Issue 2, 2011, Pages 241-263

  Santana, Pedro ^a   Guedes, Magno ^b   Correia, Luís ^a   Barata, José ^c  

^a UNIVERSITY OF LISBON   (Portugal)

^b IntRoSys SA   (Portugal)

^c UNINOVA   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEMENTARY PROPERTY; DATA DENSITY; DETECTION ACCURACY; INPUT IMAGE; OBSTACLE DETECTION; STEREO-BASED; STEREO-IMAGE; THREE-DIMENSIONAL POINT CLOUDS; TWO DIRECTIONS; UNEVEN TERRAIN; VISUAL FIELDS; VISUAL SALIENCY; VOTING MECHANISM;

LANDFORMS; VISUALIZATION;

OBSTACLE DETECTORS;

EID: 79951471260     PISSN: 15564959     EISSN: 15564967     Source Type: Journal    
DOI: 10.1002/rob.20376     Document Type: Article

References (61)

1. Aloimonos, J., Weiss, I., &, Bandyopadhyay, A., (1988). Active vision. International Journal of Computer Vision, 1 (4), 333-356.
2. Andersen, J. C., Andersen, N. A., &, Ravn, O., (2008, July). Vision assisted laser scanner navigation for autonomous robots. In Proceedings of the International Symposium on Experimental Robotics (ISER), Rio De Janeiro, Brazil (pp. 111-120). (Pubitemid 351227238)
3. Bajcsy, R., (1988). Active perception. Proceedings of the IEEE (Special issue on Computer Vision), 76 (8), 996-1005.
4. Bajracharya, M., Tang, B., Howard, A., Turmon, M., &, Matthies, L., (2008, May). Learning long-range terrain classification for autonomous navigation. In Proceedings of the International Conference on Robotics and Automation (ICRA), Pasadena, CA (pp. 4018-4024).
5. Ballard, D. H., (1991). Animate vision. Artificial Intelligence, 48 (1), 57-86.
6. Batavia, P., &, Singh, S., (2002, May). Obstacle detection in smooth high curvature terrain. In Proceedings of the International Conference on Robotics and Automation (ICRA), Washington, DC (pp. 3062-3067). (Pubitemid 34916351)
7. Batavia, P. H., &, Singh, S., (2001, May). Obstacle detection using adaptive color segmentation and color stereo homography. In Proceedings of the International Conference on Robotics and Automation (ICRA), Seoul, Korea (pp. 705-710). (Pubitemid 32815286)
8. Bellutta, P., Manduchi, R., Matthies, L., Owens, K., &, Rankin, A., (2000, October). Terrain perception for DEMO III. In Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Dearborn, MI (pp. 326-331). (Pubitemid 32135687)
9. Biesiadecki, J. J., &, Maimone, M. W., (2006, March). The Mars Exploration Rover surface mobility flight software: Driving ambition. In Proceedings of the IEEE Aerospace Conference, Big Sky, MT (vol. 5, pp. 1-15).
10. Bradski, G., &, Kaehler, A., (2008). Learning OpenCV: Computer vision with the OpenCV library. Sebastopol, CA: O'Reilly Media, Inc.
11. Broggi, A., Caraffi, C., Fedriga, R. I., &, Grisleri, P., (2005, June). Obstacle detection with stereo vision for off-road vehicle navigation. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)-Workshops, San Diego, CA (pp. 65-72).
12. Caraffi, C., Cattani, S., &, Grisleri, P., (2007). Off-road path and obstacle detection using decision networks and stereo vision. IEEE Transactions on Intelligent Transportation Systems, 8 (4), 607-618. (Pubitemid 350231638)
13. Castano, A., &, Matthies, L., (2003, September). Foliage discrimination using a rotating ladar. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Taipei, Taiwan (pp. 1-6).
14. Chang, T., Hong, T., Legowik, S., &, Abrams, M., (1999, October). Concealment and obstacle detection for autonomous driving. In Proceedings of the Robotics and Applications Conference, Santa Barbara, CA (pp. 1-15).
15. Chumerin, N., &, Hulle, M. V., (2008, May). Ground plane estimation based on dense stereo disparity. In Proceedings of the International Conference on Neural Networks and Artificial Intelligence (ICNNAI), Minsk, Belarus (pp. 209-213).
16. Dang, T., &, Hoffmann, C., (2005, June). Fast object hypotheses generation using 3D position and 3D motion. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)-Workshops, San Diego, CA (pp. 56-61).
17. Dubbelman, G., van der Mark, W., van den Heuvel, J. C., &, Groen, F. C. A., (2007, October). Obstacle detection during day and night conditions using stereo vision. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), San Diego, CA (pp. 109-116).
18. Fischler, M., &, Bolles, R., (1981). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24 (6), 381-395. (Pubitemid 12444102)
19. Frintrop, S., (2006). VOCUS: A visual attention system for object detection and goal-directed search. Lecture Notes in Computer Science/Lecture Notes in Artificial Intelligence. Secaucus, NJ: Springer-Verlag New York.
20. Frintrop, S., Backer, G., &, Rome, E., (2005). Goal-directed search with a top-down modulated computational attention system. Lecture Notes in Computer Science, 3663, 117-124. (Pubitemid 41520645)
21. Frintrop, S., Jensfelt, P., &, Christensen, H., (2007). Simultaneous robot localization and mapping based on a visual attention system. Lecture Notes in Computer Science, 4840, 417-430. (Pubitemid 351153895)
22. Gennery, D., (1999). Traversability analysis and path planning for a planetary rover. Autonomous Robots, 6, 131-146.
23. Goldberg, S. B., Maimone, M. W., &, Matthies, L., (2002, March). Stereo vision and rover navigation software for planetary exploration. In Proceedings of the IEEE Aerospace Conference, Big Sky, MT (pp. 2025-2036).
24. Grandjean, P., &, Matthies, L., (1993, May). Perception control for obstacle detection by a cross-country rover. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Atlanta, GA (pp. 20-27). (Pubitemid 23687530)
25. Hadsell, R., Sermanet, P., Ben, J., Erkan, A., Scoffier, M., Kavukcuoglu, K., Muller, U., &, LeCun, Y., (2009). Learning long-range vision for autonomous off-road driving. Journal of Field Robotics, 26 (2), 120-144.
26. Hong, T. H., Rasmussen, C., Chang, T., &, Shneier, M., (2002, March). Fusing ladar and color image information for mobile robot feature detection and tracking. In Proceedings of the International Conference on Intelligent Autonomous Systems (IAS), Marina Del Ray, CA (pp. 1-6).
27. Hwang, A. D., Higgins, E. C., &, Pomplun, M., (2009). A model of top-down attentional control during visual search in complex scenes. Journal of Vision, 9 (5), 1-18.
28. Itti, L., Koch, C., &, Niebur, E., (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20 (11), 1254-1259. (Pubitemid 128742001)
29. Kelly, A., &, Stentz, A., (1998). Rough terrain autonomous mobility-Part 2: An active vision, predictive control approach. Autonomous Robots, 5 (2), 163-198. (Pubitemid 128514283)
30. Kolter, J. Z., Kim, Y., &, Ng, A. Y., (2009, May). Stereo vision and terrain modeling for quadruped robots. In Proceedings of the International Conference on Robotics and Automation (ICRA) Kobe, Japan (pp. 1557-1564).
31. Konolige, K., (1998, October). Small vision systems: Hardware and implementation. In Proceedings of the International Symposium on Robotics Research (ISRR), Hayama, Japan (pp. 111-116).
32. Konolige, K., Agrawal, M., Blas, M. R., Bolles, R. C., Gerkey, B., SolÃ, J., &, Sundaresan, A., (2009). Mapping, navigation, and learning for off-road traversal. Journal of Field Robotics, 26 (1), 88-113.
33. Konolige, K., &, Beymer, D., (2007). SRI small vision system users manual (Tech. Rep.). SRI International, Menlo Park, CA.
34. Labayrade, R., Aubert, D., &, Tarel, J. P., (2002, June). Real time obstacle detection in stereovision on non flat road geometry through v-disparity representation. In Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Versailles, France (pp. 646-651).
35. Lacroix, S., Mallet, A., Bonnafous, D., Bauzil, G., Fleury, S., Herrb, M., &, Chatila, R., (2002). Autonomous rover navigation on unknown terrains: Functions and integration. International Journal of Robotics Research, 21 (10-11), 917-942.
36. Lalonde, J. F., Vandapel, N., Huber, D. F., &, Hebert, M., (2006). Natural terrain classification using three-dimensional ladar data for ground robot mobility. Journal of Field Robotics, 23 (10), 839-861. (Pubitemid 44782740)
37. Manduchi, R., Castano, A., Talukder, A., &, Matthies, L., (2005). Obstacle detection and terrain classification for autonomous off-road navigation. Autonomous Robots, 18 (1), 81-102.
38. Meger, D., Forssen, P. E., Lai, K., Helmer, S., McCann, S., Southey, T., Baumann, M., Little, J. J., Lowe, D. G., &, Dow, B., (2008). Curious George: An attentive semantic robot. Robotics and Autonomous Systems, 56 (6), 503-511.
39. Moorehead, S., Simmons, R., Apostolopoulos, D., &, Whittaker, W. L., (1999, June). Autonomous navigation field results of a planetary analog robot in Antarctica. In Proceedings of the International Symposium on Artificial Intelligence, Robotics and Automation, Noordwijk, the Netherlands (pp. 237-242).
40. Moren, J., Ude, A., Koene, A., &, Cheng, G., (2008). Biologically based top-down attention modulation for humanoid interactions. International Journal of Humanoid Robotics, 5 (1), 3-24. (Pubitemid 351728648)
41. Mufti, F., Mahony, R., &, Heinzmann, J., (2008, October). Spatio-temporal RANSAC for robust estimation of ground plane in video range images for automotive applications. In Proceedings of the IEEE International Conference on Intelligent Transportation Systems (ITSC), Beijing, China (pp. 1142-1148).
42. Newman, P., &, Ho, K., (2005, April). SLAM-loop closing with visually salient features. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Barcelona, Spain (pp. 635-642). (Pubitemid 46083868)
43. Orabona, F., Metta, G., &, Sandini, G., (2005, June). Object-based visual attention: A model for a behaving robot. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)-Workshops, San Diego, CA (pp. 89-96).
44. Plagemann, C., Mischke, S., Prentice, S., Kersting, K., Roy, N., &, Burgard, W., (2008, September). Learning predictive terrain models for legged robot locomotion. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Nice, France (pp. 3545-3552).
45. Poppinga, J., Birk, A., &, Pathak, K., (2008). Hough based terrain classification for realtime detection of drivable ground. Journal of Field Robotics, 25 (1-2), 67-88.
46. Rusu, R., Sundaresan, A., Morisset, B., Hauser, K., Agrawal, M., Latombe, J., &, Beetz, M., (2009). Leaving Flatland: Efficient real-time three-dimensional perception and motion planning. Journal of Field Robotics, 26 (10), 841-862.
47. Santana, P., Santos, P., Correia, L., &, Barata, J., (2008, September). Cross-country obstacle detection: Space-variant resolution and outliers removal. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS), Nice, France (pp. 1836-1841).
48. Schafer, H., Proetzsch, M., &, Berns, K., (2005, November). Stereo-vision-based obstacle avoidance in rough outdoor terrain. In Proceedings of the International Symposium on Motor Control and Robotics (ISMCR), Brussels, Belgium (pp. 1-9).
49. Seraji, H., (1999, May). Traversability index: A new concept for planetary rovers. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Detroit, MI (pp. 2006-2013).
50. Seraji, H., (2006). Safety measures for terrain classification and safest site selection. Autonomous Robots, 21 (3), 211-225. (Pubitemid 44581801)
51. Singh, S., Simmons, R., Smith, T., Stentz, A., Verma, V., Yahja, A., &, Schwehr, K., (2000, April). Recent progress in local and global traversability for planetary rovers. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), San Francisco, CA (vol. 2, pp. 1194-1200).
52. Soquet, N., Aubert, D., &, Hautiere, N., (2007, June). Road segmentation supervised by an extended v-disparity algorithm for autonomous navigation. In Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Istanbul, Turkey (pp. 160-165).
53. Talukder, A., Manduchi, R., Rankin, A., &, Matthies, L., (2002, June). Fast and reliable obstacle detection and segmentation for cross-country navigation. In Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Versailles, France (vol. 2, pp. 610-618).
54. Thrun, S., Montemerlo, M., &, Aron, A., (2006, August). Probabilistic terrain analysis for high-speed desert driving. In Proceedings of the Robotics Science and Systems Conference, Philadelphia, PA (pp. 1-7).
55. Urmson, C., Ragusa, C., Ray, D., Anhalt, J., Bartz, D., Galatali, T., Gutierrez, A., Johnston, J., Harbaugh, S., Kato, H., Messner, W., Miller, N., Peterson, K., Smith, B., Snider, J., Spiker, S., Ziglar, J., Whittaker, W., Clark, M., Koon, P., Mosher, A., &, Struble, J., (2006). A robust approach to high-speed navigation for unrehearsed desert terrain. Journal of Field Robotics, 23 (8), 467-508. (Pubitemid 44420222)
56. van der Mark, W., Heuvel, J., &, Groen, F., (2007, June). Stereo based obstacle detection with uncertainty in rough terrain. In Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Istambul, Turkey (pp. 1005-1012).
57. Vernaza, P., Taskar, B., &, Lee, D. D., (2008, May). Online, self-supervised terrain classification via discriminatively trained submodular Markov random fields. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Pasadena, CA (pp. 2750-2757).
58. Vijayakumar, S., Conradt, J., Shibata, T., &, Schaal, S., (2001, October). Overt visual attention for a humanoid robot. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Maui, HI (pp. 2332-2337). (Pubitemid 34683990)
59. Wellington, C., &, Stentz, A., (2004, April). Online adaptive rough-terrain navigation in vegetation. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), New Orleans, LA (pp. 96-101).
60. Ye, C., (2007). Navigating a mobile robot by a traversability field histogram. IEEE Transactions on Systems Man and Cybernetics-Part B-Cybernetics, 37 (2), 361-372. (Pubitemid 46523226)
61. Yu, Y., Mann, G. K. I., &, Gosine, R. G., (2007, December). A task-driven object-based attention model for robots. In Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO), Sanya, China (pp. 1751-1756).