Color learning and illumination invariance on mobile robots: A survey

Robotics and Autonomous Systems

Volumn 57, Issue 6-7, 2009, Pages 629-644

  Sridharan, Mohan ^a   Stone, Peter ^b  

^a TEXAS TECH UNIVERSITY   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Autonomous mobile robots; Color learning; Illumination adaptation; Real time robot vision

Indexed keywords

ACTION PLANNING; AUTONOMOUS LEARNING; AUTONOMOUS MOBILE ROBOTS; COLOR LEARNING; COLOR SEGMENTATIONS; ENVIRONMENTAL CHANGES; ENVIRONMENTAL FEATURES; ILLUMINATION ADAPTATION; ILLUMINATION CHANGES; ILLUMINATION INVARIANCES; INTER-DEPENDENCIES; LEARNING AND ADAPTATIONS; MOBILE ROBOT PLATFORMS; MOBILE ROBOT VISIONS; NATURAL CONDITIONS; REAL-TIME ROBOT VISION; SENSOR TECHNOLOGIES; VISION ALGORITHMS; VISION PROBLEMS;

COLOR; COMPUTER VISION; EDUCATION; INTELLIGENT ROBOTS; MOBILE ROBOTS; NAVIGATION; ROBOTICS; SURVEYS;

LEARNING ALGORITHMS;

EID: 67349215708     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2009.01.004     Document Type: Article

References (104)

1. Minten B.W., Murphy R.R., Hyams J., and Micire M. Low-order-complexity vision-based docking. IEEE Transactions on Robotics and Automation 17 6 (2001) 922-930
2. Pineau J., Montemerlo M., Pollack M., Roy N., and Thrun S. Towards robotic assistants in nursing homes: Challenges and results. Robotics and Autonomous Systems, Special Issue on Socially Interactive Robots 42 3-4 (2003) 271-281
3. Thrun S. Stanley: The robot that won the DARPA grand challenge. Journal of Field Robotics 23 9 (2006) 661-692
4. Thrun S., Fox D., Burgard W., and Dellaert F. Robust Monte Carlo localization for mobile robots. Journal of Artificial Intelligence 128 1-2 (2001) 99-141
5. Lowe D. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision (IJCV) 60 2 (2004) 91-110
6. R. Fergus, P. Perona, A. Zisserman, Object class recognition by unsupervised scale-invariant learning, in: CVPR, 2003
7. S. Fidler, A. Leonardis, Towards scalable representations of object categories: Learning a hierarchy of parts, in: The International Conference on Computer Vision and Pattern Recognition, CVPR, 2007
8. P. Viola, M. Jones, Rapid object detection using a boosted cascade of simple features, in: The International Conference on Computer Vision and Pattern Recognition, CVPR, 2001
9. P. Jensfelt, J. Folkesson, D. Kragic, H.I. Christensen, Exploiting distinguishable image features in robotic mapping and localization, in: The European Robotics Symposium, EUROS, 2006
10. Forsyth D.A., and Ponce J. Computer Vision: A Modern Approach (2002), Prentice Hall
11. Desouza G.N., and Kak A.C. Vision for mobile robot navigation: A Survey. IEEE Transactions of Pattern Analysis and Machine Intelligence 24 2 (2002) 237-267
12. Kortenkamp D., Bonasso R.P., and Murphy R. AI-based Mobile Robots: Case Studies of Successful Robot Systems (1998), MIT Press
13. Comaniciu D., and Meer P. Mean shift: A robust approach towards feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 24 5 (2002) 603-619
14. J. Shi, J. Malik, Normalized cuts and image segmentation, in: IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 22 (8)
15. B. Sumengen, B.S. Manjunath, C. Kenney, Image segmentation using multi-region stability and edge strength, in: The IEEE International Conference on Image Processing, ICIP, 2003
16. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. 2nd ed. (2000), Wiley Publishers
17. Caselles V., Kimmel R., and Shapiro G. Geodesic active contours. International Journal of Computer Vision 22 1 (1997) 61-79
18. Chan T.F., and Vese L.A. Active contours without edges. IEEE Transactions on Image Processing 10 2 (2001) 266-277
19. N. Paragios, R. Deriche, Geodesic active regions for supervised texture segmentation, in: The International Conference on Computer Vision, ICCV, 1999
20. Felzenswalb P.F., and Huttenlocher D.P. Efficient graph-based image segmentation. International Journal of Computer Vision 59 2 (2004) 167-181
21. Wu Z., and Leahy R. An optimized graph-theoretic approach to data clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 11 (1993) 1101-1113
22. J. Shi, J. Malik, Motion segmentation and tracking using normalized cuts, in: The International Conference on Computer Vision, ICCV, 1998
23. Hoiem D., Efros A., and Hebert M. Recovering surface layout from an image. International Journal of Computer Vision (IJCV) 75 1 (2007) 151-172
24. C. Pantofaru, M. Hebert, A comparison of image segmentation algorithms, cmu-ri-tr-05-40, Tech. Rep., Robotics Institute, Carnegie Mellon University, September 2005
25. T. Cour, F. Benezit, J. Shi, Spectral segmentation with multiscale graph decomposition, in: The International Conference of Computer Vision and Pattern Recognition, CVPR, 2005
26. W. Uther, S. Lenser, J. Bruce, M. Hock, M. Veloso, Cm-pack'01: Fast legged robot walking, robust localization, and team behaviors, in: The Fifth International RoboCup Symposium, Seattle, USA, 2001
27. Bishop C.M. Neural Networks for Pattern Recognition (1995), Oxford University Press
28. Chen S., Siu M., Vogelgesang T., Yik T.F., Hengst B., Pham S.B., and Sammut C. RoboCup-2001: The Fifth RoboCup Competitions and Conferences (2002), Springer-Verlag, Berlin
29. Cohen D., Ooi Y.H., Vernaza P., and Lee D.D. RoboCup-2003: The Seventh RoboCup Competitions and Conferences (2004), Springer-Verlag, Berlin
30. P. Stone, K. Dresner, P. Fidelman, N.K. Jong, N. Kohl, G. Kuhlmann, E. Lin, M. Sridharan, D. Stronger, UT Austin Villa 2004: Coming of age, TR 04-313, Tech. Rep., Department of Computer Sciences, UT-Austin, October 2004
31. M. Sridharan, P. Stone, Real-time vision on a mobile robot platform, in: The IEEE International Conference on Intelligent Robots and Systems, IROS, 2005
32. Gevers T., and Smeulders A.W.M. Color-based object recognition. Pattern Recognition 32 3 (1999) 453-464
33. Klinker G.J., Shafer S.A., and Kanade T. A physical approach to color image understanding. International Journal of Computer Vision 4 (1990) 7-38
34. Lauziere Y.B., Gingras D., and Ferrie F.P. Autonomous physics-based color learning under daylight. The EUROPTO Conference on Polarization and Color Techniques in Industrial Inspection vol. 3826 (1999)
35. J.M.G. Lammens, A computational model of color perception and color naming, Ph.D. Thesis, Computer Science Department, State University of New York at Buffalo, NY, June 1994
36. Mojsilovic A. A computational model for color naming and describing color composition of images. IEEE Transactions on Image Processing 14 5 (2005) 690-699
37. Foley J.D., Dam A.V., Feiner S.K., and Hughes J.F. Computer Graphics: Principles and Practice (1995), Addison-Wesley
38. Hyams J., Powell M.W., and Murphy R.R. Cooperative navigation of micro-rovers using color segmentation. Autonomous Robots 9 1 (2000) 7-16
39. D. Cameron, N. Barnes, Knowledge-based autonomous dynamic color calibration, in: The International RoboCup Symposium, 2003
40. Rubner Y., Tomasi C., and Guibas L.J. The earth mover's distance as a metric for image retrieval. International Journal of Computer Vision 40 2 (2000) 99-121
41. S. Chernova, E. Crawford, M. Veloso, Acquiring observation models through reverse plan monitoring, in: The 12th Portuguese Conference on Artificial Intelligence, EPIA, 2005
42. M. Jungel, Using layered color precision for a self-calibrating vision system, in: The Eighth International RoboCup Symposium, Lisbon, Portugal, 2004
43. DARPA, The DARPA Grand Challenge, http://www.grandchallenge.org/, 2005
44. LAGR, The DARPA learning applied to ground robots challenge, www.darpa.mil/ipto/programs/lagr/, 2005
45. UPenn-LAGR, The UPenn LAGR Team, http://ddlee.com/LAGR/, 2006
46. DARPA, The DARPA Urban Robot Challenge, http://www.darpa.mil/grandchallenge/index.asp, 2007
47. M. Sridharan, Robust structure-based autonomous color learning on a mobile robot, Ph.D. Thesis, Electrical and Computer Engineering, The University of Texas at Austin, USA, August 2007
48. M. Sridharan, P. Stone, Autonomous color learning on a mobile robot, in: The Twentieth National Conference on Artificial Intelligence, AAAI, 2005
49. Davison A.J., Reid I.D., Morton N.D., and Stasse O. MonoSLAM: Real-time single camera SLAM. Pattern Analysis and Machine Intelligence (PAMI) 29 6 (2007) 1052-1067
50. Finlayson G., Hordley S., and Hubel P. Color by correlation: A simple unifying framework for color constancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 11 (2001) 1209-1221
51. Maloney L.T., and Wandell B.A. Color constancy: A method for recovering surface spectral reflectance. Journal of Optical Society of America A 3 1 (1986) 29-33
52. Land E.H. The retinex theory of color constancy. Scientific American (1977) 108-129
53. Buchsbaum G. A spatial processor model for object color perception. Journal of Franklin Institute 310 (1980) 1-26
54. Brainard D.H., and Wandell B.A. Analysis of the retinex theory of color vision. Journal of Optical Society of America A 3 10 (1986) 1651-1661
55. Forsyth D. A novel algorithm for color constancy. International Journal of Computer Vision 5 1 (1990) 5-36
56. Finlayson G. Color in perspective. IEEE Transactions of Pattern Analysis and Machine Intelligence 18 10 (1996) 1034-1038
57. Finlayson G., and Hordley S. Improving gamut mapping color constancy. IEEE Transactions on Image Processing 9 10 (2000) 1774-1783
58. Brainard D.H., and Freeman W.T. Bayesian color constancy. Journal of Optical Society of America A 14 7 (1997) 1393-1411
59. Y. Tsin, R.T. Collins, V. Ramesh, T. Kanade, Bayesian color constancy for outdoor object recognition, in: The International Conference of Computer Vision and Pattern Recognition, CVPR, 2001
60. C. Rosenberg, M. Hebert, S. Thrun, Color constancy using KL-divergence, in: The IEEE International Conference on Computer Vision, ICCV, 2001
61. F. Anzani, D. Bosisio, M. Matteucci, D.G. Sorrenti, On-line color calibration in non-stationary environments, in: The Ninth International RoboCup Symposium, Osaka, Japan, 2005
62. S. Lenser, M. Veloso, Automatic detection and response to environmental change, in: The International Conference of Robotics and Automation, ICRA, 2003
63. S.R. Lenser, On-line robot adaptation to environment change, Ph.D. Thesis, Computer Science Department, Carnegie Mellon University, Pittsburgh, PA, July 2005
64. D. Schulz, D. Fox, Bayesian color estimation for adaptive vision-based robot localization, in: The IEEE International Conference on Intelligent Robots and Systems, IROS, 2004
65. Thrun S., Burgard W., and Fox D. Probabilistic Robotics (2005), MIT Press, Cambridge, USA
66. Sridharan M., and Stone P. Structure-based color learning on a mobile robot under changing illumination. Autonomous Robots 23 3 (2007) 161-182
67. M. Sridharan, P. Stone, Global action selection for illumination invariant color modeling, in: The IEEE International Conference on Intelligent Robots and Systems, IROS, 2007
68. Sutton R.L., and Barto A.G. Reinforcement Learning: An Introduction (1998), MIT Press, Cambridge, USA, MA
69. Aloimonos J.Y., Weiss I., and Bandhopadhay A. Active vision. International Journal of Computer Vision (1987) 333-356
70. Clouard R., Elmoataz A., Porquet C., and Revenu M. Borg: A knowledge-based system for automatic generation of image processing programs. IEEE Transactions on Pattern Analysis and Machine Intelligence 21 2 (1999) 128-144
71. S. Moisan, Program supervision: Yakl and pegase + reference and user manual, Rapport de Recherche 5066, INRIA, Sophia Antipolis, France, December 2003
72. Thonnat M., and Moisan S. What can program supervision do for program reuse?. IEE Proceedings on Software 147 5 (2000) 179-185
73. C. Shekhar, S. Moisan, M. Thonnat, Use of a real-time perception program supervisor in a driving scenario, in: Intelligent Vehicle Symposium '94, Paris, France, 1994
74. X. Jiang, H. Bunke, Vision planner for an intelligent multisensory vision system, Technical Report, University of Bern, Bern, Switzerland, 1994
75. T. Darrell, Reinforcement learning of active recognition behaviors, Tech. Rep. Interval Research Technical Report 1997-045, extended version of paper in NIPS-95, 1997, pp. 858-864
76. Kaelbling L., Littman M., and Cassandra A. Planning and acting in partially observable stochastic domains. Artificial Intelligence 101 (1998) 99-134
77. L. Li, V. Bulitko, R. Greiner, I. Levner, Improving an adaptive image interpretation system by leveraging, in: Australian and New Zealand Conference on Intelligent Information Systems, 2003
78. Ghallab M., Nau D., and Traverso P. Automated Planning: Theory and Practice (2004), Morgan Kaufmann, San Francisco, CA 94111
79. D. Draper, S. Hanks, D. Weld, A probabilistic model of action for least-commitment planning with information gathering, in: Uncertainty in AI, UAI, 1994
80. R. Petrick, F. Bacchus, Extending the knowledge-based approach to planning with incomplete information and sensing, in: International Conference on Automated Planning and Scheduling, ICAPS, 2004
81. Russell S.J., and Novig P. Artificial Intelligence: A Modern Approach. 2nd ed. (2003), Prentice Hall, Upper Saddle River, New Jersey
82. M. Brenner, B. Nebel, Continual planning and acting in dynamic multiagent environments, in: The International Symposium of Practical Cognitive Agents and Robots, 2006
83. D. McDermott, PDDL: The planning domain definition language, Technical Report TR-98-003/DCS TR-1165, Tech. Rep., Yale Center for Computational Vision and Control, 1998
84. Hoffmann J., and Nebel B. The FF planning system: Fast plan generation through heuristic search. Journal of Artificial Intelligence Research 14 (2001) 253-302
85. Brooks R.A. A robust layered control system for a mobile robot. Robotics and Automation 2 (1986) 14-23
86. M. Sridharan, P. Stone, Comparing two action planning approaches for color learning on a mobile robot, in: The VISAPP International Workshop on Robot Perception, 2008
87. Boutillier C., Dean T.L., and Hanks S. Decision theoretic planning: Structural assumptions and computational leverage. Journal of AI Research 11 (1999) 1-94
88. J. Goldsmith, M. Mundhenk, Complexity issues in Markov decision processes, in: IEEE Conference on Computational Complexity, 1998
89. B. Bonet, H. Geffner, Faster heuristic search algorithms for planning with uncertainty and full feedback, in: The International Joint Conference on Artificial Intelligence, IJCAI, 2003
90. T. Smith, R. Simmons, Point-based POMDP algorithms: Improved analysis and implementation, in: UAI, 2005
91. D. Aberdeen, A survey of approximate methods for solving partially observable markov decision processes, Technical Report, Australia National University, School of Information Science and Engineering, 2002
92. Hauskrecht M. Value function approximations of partially observable Markov decision processes. Journal of Artificial Intelligence 13 (2000) 33-95
93. A.F. Foka, P.E. Trahanias, Real-time hierarchical pomdps for autonomous robot navigation, in: IJCAI Workshop on Reasoning with Uncertainty in Robotics, 2005
94. Porta J.M., Spaan M.T.J., and Vlassis N. Robot planning in partially observable continuous domains. Robotics: Science and Systems (2005)
95. T. Dietterich, The MAXQ method for hierarchical reinforcement learning, in: International Conference on Machine Learning, ICML, 1998
96. M. Sridharan, J. Wyatt, R. Dearden, E-HiPPo: Extensions to hierarchical POMDP-based visual planning on a robot, in: The 27th PlanSIG Workshop, 2008
97. M. Sridharan, J. Wyatt, R. Dearden, HiPPo: Hierarchical POMDPs for planning information processing and sensing actions on a robot, in: International Conference on Automated Planning and Scheduling, ICAPS, 2008
98. M. Toussaint, L. Charlin, P. Poupart, Hierarchical POMDP controller optimization by likelihood maximization, in: Uncertainty in AI, UAI, 2008
99. The Sony Aibo robots, http://www.sonystyle.com, 2004
100. H. Kitano, M. Asada, Y. Kuniyoshi, I. Noda, E. Osawa, Robocup: The robot world cup initiative, in: International Conference on Autonomous Agents, ICAA, 1997
101. M. Sridharan, P. Stone, Autonomous planned color learning on a mobile robot without labeled data, in: The Ninth IEEE International Conference on Control, Automation, Robotics and Vision, ICARCV, 2006
102. N. Hawes, A. Sloman, J. Wyatt, M. Zillich, H. Jacobsson, G.-J. Kruiff, M. Brenner, G. Berginc, D. Skocaj, Towards an integrated robot with multiple cognitive functions, in: The Twenty-second National Conference on Artificial Intelligence, AAAI, 2007
103. Kuipers B.J. In: Jefferies M., and (Wai-Kiang) Yeap A. (Eds). An Intellectual History of the Spatial Semantic Hierarchy (2008), Springer-Verlag
104. Kruijff G.-J.M., Zender H., Jensfelt P., and Christensen H.I. Situated dialogue and spatial organization: What, where...and why?. International Journal of Advanced Robotic Systems, Special Issue on Human-Robot Interaction 4 1 (2007) 125-138