Topological mapping and scene recognition with lightweight color descriptors for an omnidirectional camera

IEEE Transactions on Robotics

Volumn 30, Issue 2, 2014, Pages 310-324

  Liu, Ming ^a,b   Siegwart, Roland ^a  

^a ETH ZURICH   (Switzerland)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Graphic model; non parametric learning; omnidirectional camera; scene recognition; topological segmentation

Indexed keywords

MOBILE ROBOTS; VIDEO CAMERAS;

CONDITIONAL PROBABILITIES; DIRICHLET PROCESS MIXTURE MODEL; GEOMETRIC INFORMATION; GRAPHIC MODELS; NON-PARAMETRIC; OMNIDIRECTIONAL CAMERAS; SCENE RECOGNITION; TOPOLOGICAL REPRESENTATION;

TOPOLOGY;

EID: 84898442277     PISSN: 15523098     EISSN: None     Source Type: Journal    
DOI: 10.1109/TRO.2013.2272250     Document Type: Article

References (81)

1. A. Elfes, "Using occupancy grids for mobile robot perception and navigation," Computer, vol. 22, no. 6, pp. 46-57, 1989.
2. G. Klein and D. Murray, "Parallel tracking and mapping for small AR workspaces," in Proc. 6th IEEE ACMInt. Symp. Mixed Augmented Reality, Nara, Japan, Nov. 2007, pp. 225-234.
3. A. Davison, I. Reid, N. Molton, and O. Stasse, "MonoSLAM: Real-time single camera SLAM," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 1052-1067, Jun. 2007. (Pubitemid 46667415)
4. A.Murillo, C. Sag̈úes, J. Guerrero, T. Goedeḿe, T. Tuytelaars, and L. Van Gool, "From omnidirectional images to hierarchical localization," Robot. Autonom. Syst., vol. 55, no. 5, pp. 372-382, 2007. (Pubitemid 46628749)
5. M. Liu, C. Pradalier, F. Pomerleau, and R. Siegwart, "Scale-only visual homing from an omnidirectional camera," in Proc. IEEE Int. Conf. Robot. Autom., May 2012, pp. 3944-3949.
6. M. Liu, C. Pradalier, F. Pomerleau, and R. Siegwart, "The role of homing in visual topological navigation," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Oct. 2012, pp. 567-572.
7. T. McNamara, "Mental representations of spatial relations," Cognit. Psychol., vol. 18, no. 1, pp. 87-121, 1986.
8. G. Franz, "Space, color, and perceived qualities of indoor environments," in Proc. 19th Int. Assoc. People-Envir. Stud. Conf. Envir. Health Sustainable Devel., 2006, pp. 1-8.
9. K.Bright,G. Cook, and J.Harris, "Colour, contrast and perception: Design guidance for internal built environments," Addkey, 1997, revised 2004. [Online]. Available: http://centaur.reading.ac.uk/11806/
10. T. King, "Human color perception, cognition, and culture: Why red is always red," in Proc. SPIE, 2005, vol. 5667, pp. 234-242. (Pubitemid 40948954)
11. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
12. H. Bay, T. Tuytelaars, and L. Van Gool, "SURF: Speeded up robust features," Lect. Notes Comput. Sci., vol. 3951, pp. 404-417, 2006. (Pubitemid 44029795)
13. M. Liu and R. Siegwart, "DP-FACT: Towards topological mapping and scene recognition with color for omnidirectional camera," in Proc. IEEE Int. Conf. Robot. Autom., May 2012, pp. 3503-3508.
14. J. Xiao, J. Hays, K. Ehinger, A. Oliva, and A. Torralba, "Sun database: Large-scale scene recognition from abbey to zoo," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3485-3492.
15. A. Bosch, A. Zisserman, and X.Munoz, "Scene classification via PLSA," in Proc. Eur. Conf. Comput. Vis., 2006, pp. 517-530. (Pubitemid 44029655)
16. A. Torralba, K. Murphy, W. Freeman, and M. Rubin, "Context-based vision system for place and object recognition," Proc. IEEE Int. Conf. Comput. Vis., Oct. 2003, vol. 1, pp. 273-280.
17. S. Vasudevan, S. Gachter, V. Nguyen, and R. Siegwart. (2007). Cognitive maps for mobile robots-An object based approach. Robot. Autonom. Syst. [Online]. 55(5), pp. 359-371, from Sensors to Human Spatial Concepts. Available: http://www.sciencedirect.com/science/article/B6V16-4MY0MK7-1/2/ e379fd59a33b6d0a42355ba120c444e9 (Pubitemid 46601830)
18. P. Espinace, T. Kollar, A. Soto, and N. Roy, "Indoor scene recognition through object detection," in Proc. IEEE Int. Conf. Robot. Autom., May 2010, pp. 1406-1413.
19. O. Booij, B. Terwijn, Z. Zivkovic, and B. Krose, "Navigation using an appearance based topological map," in Proc. IEEE Int. Conf. Robot. Autom., Apr. 2007, pp. 3927-3932. (Pubitemid 350140793)
20. L. Zhao, R. Li, T. Zang, L. Sun, and X. Fan, "A method of landmark visual tracking for mobile robot," in Proc. Ist Int. Conf. Intell. Robot. Appl., 2008, pp. 901-910.
21. C. Valgren and A. Lilienthal, "Sift, surf & seasons: Appearance-based long-term localization in outdoor environments," Robot. Autonom. Syst., vol. 58, no. 2, pp. 149-156, 2010.
22. M. J. Cummins and P. M. Newman, "FAB-MAP: Appearance-based place recognition and mapping using a learned visual vocabulary model," in Proc. Int. Conf. Mach. Learn., 2010, pp. 3-10.
23. C. Wu. (Apr. 10, 2012). "SiftGPU: A GPU implementation of scale invariant feature transform (SIFT)," [Online]. Available: http://www.cs.unc. edu/?ccwu/siftgpu/
24. Y. Ke and R. Sukthankar, "Pca-sift: A more distinctive representation for local image descriptors," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Patt. Recognit., Jun./Jul. 2004, vol. 2, pp. II-506-II-513.
25. J.Wu and J. Rehg, "Centrist: A visual descriptor for scene categorization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1489-1501, Aug. 2010.
26. M. Calonder, V. Lepetit, and P. Fua, "Keypoint signatures for fast learning and recognition," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 58-71.
27. J.Wu, H. Christensen, and J. Rehg, "Visual place categorization: Problem, dataset, and algorithm," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Oct. 2009, pp. 4763-4770.
28. J. Wu and J. Rehg, "Beyond the euclidean distance: Creating effective visual codebooks using the histogram intersection kernel," in Proc. IEEE Int. Conf. Comput. Vis., Sep./Oct. 2009, pp. 630-637.
29. A. Ranganathan, "PLISS: Detecting and labeling places using online change-point detection," presented at the Robot. Sci. Syst., Zaragoza, Spain, 2010.
30. X. Meng, Z. Wang, and L. Wu, "Building global image features for scene recognition," Pattern Recognit., vol. 45, pp. 373-380, 2011.
31. A. Pretto, E.Menegatti,Y. Jitsukawa,R.Ueda, and T.Arai, "Image similarity based on discrete wavelet transform for robots with low-computational resources," Robot. Autonom. Syst., vol. 58, no. 7, pp. 879-888, 2010.
32. L. Paýa, L. Ferńandez, A. Gil, and O. Reinoso, "Map building and monte carlo localization using global appearance of omnidirectional images," Sensors, vol. 10, no. 12, pp. 11 468-11 497, 2010.
33. E. Menegatti, M. Zoccarato, E. Pagello, and H. ishiguro, "Image-based monte carlo localisation with omnidirectional images," Robot. Autonom. Syst., vol. 48, no. 1, pp. 17-30, 2004.
34. A. Kawewong, S. Tangruamsub, andO.Hasegawa, "Wide-baseline visible features for highly dynamic scene recognition," in Proc. Comput. Anal. Imag. Pattern, 2009, pp. 723-731.
35. C. Siagian and L. Itti, "Rapid biologically-inspired scene classification using features shared with visual attention," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 2, pp. 300-312, Feb. 2007. (Pubitemid 46420889)
36. M. Liu, D. Scaramuzza, C. Pradalier, R. Siegwart, and Q. Chen, "Scene recognition with omnidirectional vision for topological map using lightweight adaptive descriptors," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Oct. 2009, pp. 116-121.
37. P. Lamon, A. Tapus, E. Glauser, N. Tomatis, and R. Siegwart, "Environmental modeling with fingerprint sequences for topological global localization," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Oct. 2003, vol. 4, pp. 3781-3786.
38. A. Tapus and R. Siegwart, "Incremental robot mapping with fingerprints of places," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Aug. 2005, pp. 2429-2434.
39. N. Winters, J. Gaspar, G. Lacey, and J. Santos-Victor, "Omni-directional vision for robot navigation," in Proc. IEEE Workshop Omnidirect. Vis., 2000, pp. 21-28.
40. D. Scaramuzza, A. Martinelli, and R. Siegwart, "A toolbox for easily calibrating omnidirectional cameras," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Oct. 2006, pp. 5695-5701. (Pubitemid 46928847)
41. D. Scaramuzza, A. Martinelli, and R. Siegwart, "A robust descriptor for tracking vertical lines in omnidirectional images and its use in mobile robotics," Int. J. Robot. Res., Special Issue Field Service Robots, vol. 28, no. 2, pp. 149-171, 2009.
42. Y. Teh, M. Jordan, M. Beal, and D. Blei, "Hierarchical Dirichlet processes," J. Amer. Stat. Assoc., vol. 101, no. 476, pp. 1566-1581, 2006.
43. D. Blei, A. Ng, and M. Jordan, "Latent Dirichlet allocation," J. Mach. Learn. Res., vol. 3, pp. 993-1022, 2003.
44. L. Fei-Fei and P. Perona, "A bayesian hierarchical model for learning natural scene categories," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, vol. 2, pp. 524-531.
45. I. S. Dhillon, Y. Guan, and B. Kulis, "Kernel k-means, spectral clustering and normalized cuts," in Proc. 10th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2004, pp. 551-556. (Pubitemid 40114969)
46. B. Frey and D. Dueck, "Clustering by passing messages between data points," Science, vol. 315, no. 5814, pp. 972-976, 2007. (Pubitemid 46281181)
47. M. Liu, F. Colas, and R. Siegwart, "Regional topological segmentation based on mutual information graphs," in Proc. IEEE Int. Conf. Robot. Autom., May 2011, pp. 3269-3274.
48. J. Pillow, Y. Ahmadian, and L. Paninski, "Model-based decoding, information estimation, and change-point detection techniques for multineuron spike trains," Neural Comput., vol. 23, no. 1, pp. 1-45, 2011.
49. A. Ranganathan, "PLISS: Labeling places using online changepoint detection," Autonom. Robot., vol. 32, no. 4, pp. 351-368, 2012.
50. M. Liu, F. Colas, F. Pomerleau, and R. Siegwart, "A markov semisupervised clustering approach and its application in topological map extraction," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Oct. 2012, pp. 4743-4748.
51. N. Kaempchen and K. Dietmayer, "Data synchronization strategies for multi-sensor fusion," in Proc. IEEE Conf. Intell. Transport. Syst., 2003, pp. 1-9.
52. M. Liu, L. Wang, and R. Siegwart, "DP-fusion: A generic framework for online multisensor recognition," in Proc. IEEE Conf. Multisensor Fusion Integr. Intell. Syst., Sep. 2012, pp. 7-12.
53. B. Douillard, D. Fox, and F. Ramos, "A spatiooral probabilistic model for multi-sensor multi-class object recognition," Robot. Res., pp. 123-134, 2011.
54. L. Orv́ath and P. Kokoszka, "Change-point detection with non-parametric regression," Stat. J. Theoretical Appl. Stat., vol. 36, no. 1, pp. 9-31, 2002. (Pubitemid 36325099)
55. B. Ray and R. Tsay, "Bayesian methods for change-point detection in long-range dependent processes," J. Time Series Anal., vol. 23, no. 6, pp. 687-705, 2002.
56. A. Ranganathan and F. Dellaert, "Online probabilistic topological mapping," Int. J. Robot. Res., vol. 30, no. 6, pp. 755-771, 2011.
57. D. Marinakis and G. Dudek, "Pure topological mapping in mobile robotics," IEEE Trans. Robot., vol. 26, no. 6, pp. 1051-1064, Dec. 2010.
58. B. Ryu and H. Yang, "Integration of reactive behaviors and enhanced topological map for robust mobile robot navigation," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 29, no. 5, pp. 474-485, Sep. 1999.
59. N. Tomatis, I. Nourbakhsh, and R. Siegwart, "Hybrid simultaneous localization and map building: A natural integration of topological andmetric," Robot. Autonom. Syst., vol. 44, no. 1, pp. 3-14, 2003.
60. H. Choset and K. Nagatani, "Topological simultaneous localization and mapping (slam): Toward exact localization without explicit localization," IEEE Trans. Robot. Autom., vol. 17, no. 2, pp. 125-137, Apr. 2001. (Pubitemid 32609731)
61. H. Zender, O. Mart́?nez Mozos, P. Jensfelt, G. Kruijff, and W. Burgard, "Conceptual spatial representations for indoor mobile robots," Robot. Autonom. Syst., vol. 56, no. 6, pp. 493-502, 2008.
62. J. Choi, M. Choi, and W. K. Chung. (2009, Oct.). Incremental topological modeling using sonar gridmap in home environment. in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst. (IROS), pp. 3582-3587. [Online]. Available: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=5354247
63. S. Thrun, "Learning metric-topological maps for indoor mobile robot navigation," Artif. Intell., vol. 99, no. 1, pp. 21-71, 1998. (Pubitemid 128378368)
64. M. Liu, F. Colas, and R. Siegwart, "Regional topological segmentation based on mutual information graphs," in Proc. IEEE Int. Conf. Robot. Autom., Shanghai, China, May 2011, pp. 3269-3274.
65. T. Goedeḿe, M. Nuttin, T. Tuytelaars, and L. Van Gool, "Omnidirectional vision based topological navigation," Int. J. Comput. Vis., vol. 74, no. 3, pp. 219-236, 2007. (Pubitemid 47142800)
66. M. Liu, C. Pradalier, Q. Chen, and R. Siegwart, "A bearing-only 2D/3Dhoming method under a visual servoing framework," in Proc. IEEE Int. Conf. Robot. Autom., May 2010, pp. 4062-4067.
67. A. Argyros, K. Bekris, S. Orphanoudakis, and L. Kavraki, "Robot homing by exploiting panoramic vision," Autonom. Robot., vol. 19, no. 1, pp. 7-25, 2005. (Pubitemid 40683688)
68. O. Koch, M. Walter, A. Huang, and S. Teller, "Ground robot navigation using uncalibrated cameras," in Proc. IEEE Int. Conf. Robot. Autom., May 2010, pp. 2423-2430.
69. J. Choi, M. Choi, K. Lee, and W. K. Chung, "Topological modeling and classification in home environment using sonar gridmap," in Proc. IEEE Int. Conf. Robot. Autom., May 2009, pp. 3892-3898.
70. K. Van De Sande, T. Gevers, and C. Snoek, "Evaluating color descriptors for object and scene recognition," IEEE Trans. Pattern Anal.Mach. Intell., vol. 32, no. 9, pp. 1582-1596, Sep. 2009.
71. N. Otsu, "Athreshold selectionmethod from gray-level histograms," IEEE Trans. Syst., Man, Cybern., vol. 9, no. 1, pp. 62-66, Jan. 1979.
72. A. Romero and M. Cazorla, "Topological slam using omnidirectional images: Merging feature detectors and graph-matching," Adv. Concepts Intell. Vis. Syst., vol. 6474, pp. 464-475, 2010.
73. E. Einhorn, C. Schr̈oter, and H.-M. Gross, "Building 2d and 3d adaptiveresolution occupancy maps using nd-trees," in Proc. 55th Int. Sci. Colloquiium, Ilmenau, Germany, Verlag ISLE, 2010, pp. 306-311
74. B. Font, F. Jesus et al., "An inverse-perspective-based approach to monocular mobile robot navigation," Materials, vol. 18, pp. 2005-2012, 2012.
75. J. Sethuraman, "A constructive definition of dirichlet priors," Stat. Sinica, vol. 4, pp. 639-650, 1994.
76. R. Neal, "Markov chain sampling methods for dirichlet process mixture models," J. Comput. Graph. Stat., vol. 9, no. 2, pp. 249-265, 2000.
77. C. Geyer, "Practical Markov chain monte carlo," Stat. Sci., vol. 7, pp. 473-483, 1992.
78. N. Gagunashvili, "Chi-square tests for comparing weighted histograms," Nuclear Instrum. Methods Phys. Res. Section A: Accelerat. Spectrometers Detect. Assoc. Equipment, vol. 614, no. 2, pp. 287-296, 2010.
79. S. Leutenegger, M. Chli, and R. Siegwart, "Brisk: Binary robust invariant scalable keypoints," in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, Nov. 2011, pp. 2548-2555.
80. A. Ranganathan and J. Lim, "Visual place categorization in maps," in Proc. IEEE/RSJ Int. Conf. Intell. Robot. Syst., Sep. 2011, pp. 3982-3989.
81. A. Pronobis and B. Caputo. (2009, May). COLD: COsy localization database. Int. J. Robot. Res., [Online]. 28(5), pp. 588-594, Available: http://www.pronobis.pro/publications/pronobis2009ijrr