Active recognition through next view planning: A survey

Pattern Recognition

Volumn 37, Issue 3, 2004, Pages 429-446

  Dutta, Roy ^a   Chaudhury, Santanu ^b   Banerjee, Subhashis ^b  

^a INDIAN INSTITUTE OF TECHNOLOGY BOMBAY   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY DELHI   (India)

Author keywords

3 D object recognition; Active vision; Computer vision; Next view planning; Scene interpretation

Indexed keywords

SENSORS; THREE DIMENSIONAL COMPUTER GRAPHICS;

IMAGE COMPUTATION;

PATTERN RECOGNITION;

COMPUTER VISION; IMAGE ANALYSIS; PATTERN RECOGNITION;

EID: 0347478106     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2003.01.002     Document Type: Article

References (105)

1. Besl P.J. Jain R.C. Three-dimensional object recognition ACM Comput. Surveys 17 1 1985 76-145
2. Chin R.T. Dyer C.R. Model based recognition in robot vision ACM Comput. Surveys 18 1 1986 67-108
3. Zisserman A. Forsyth D. Mundy J. Rothwell C. Liu J. Pillow N. 3D object recognition using invariance Artif. Intell. 78 1995 239-288
4. Mukherjee D.P. Dutta Majumder D. On shape from symmetry Proc. Indian Nat. Sci. Acad. 62A 5 1996 415-428
5. Funt B.V. Finlayson G.D. Color constant color indexing IEEE Trans. Pattern Anal. Mach. Intell. 17 1995 522-529
6. Nayar S.K. Bolle R.M. Reflectance based object recognition Int. J. Comput. Vision 17 3 1996 219-240
7. Burns J.B. Weiss R.S. Riseman E.M. The non-existence of general-case view-invariants Zisserman A. Mundy J. Geometric Invariance in Computer Vision 1992 MIT Press Cambridge, MA, USA
8. Mukherjee D.P. Zisserman A. Brady J.M. Shape from symmetry: detecting and exploiting symmetry in affine images Philos. Trans. R. Soc. London A 351 1995 77-106
9. N. Pillow, Recognition of generalized cylinders using geometric invariance, Ph.D. Thesis, University of Oxford, 1996.
10. Pillow N. Utcke S. Zisserman A. Viewpoint invariant representation of generalized cylinders using the symmetry set Image Vision Comput. 13 5 1995 355-365
11. Van Gool L. Moons T. Ungureanu D. Pauwels E. Symmetry from shape and shape from symmetry Int. J. Robotics Res. 14 5 1995 407-424
12. Choudhury R. Chaudhury S. Srivastava J.B. A framework for reconstruction based recognition of partially occluded repeated objects J. Math. Imaging Vision 14 1 2001 5-20
13. Choudhury R. Srivastava J.B. Chaudhury S. Reconstruction based recognition of scenes with translationally repeated quadrics IEEE Trans. Pattern Anal. Mach. Intell. 23 6 2001 617-632
14. Gremban K.D. Ikeuchi K. Planning multiple observations for object recognition Int. J. Comput. Vision 12 2/3 1994 137-172
15. Aloimonos Y. Weiss I. Bandopadhyay A. Active vision Int. J. Comput. Vision 1 4 1987 333-356
16. Bajcsy R. Campos M. Active and exploratory perception Comput. Vision Graphics Image Process. 56 1 1985 31-40
17. Bajcsy R. Active perception Proc. IEEE 76 8 1988 996-1005
18. Ballard D.H. Animate vision Artif. Intell. 48 1 1991 57-86
19. Ballard D.H. Brown C.M. Principles of animate vision Comput. Vision Graphics and Image Processing: Image Understanding 56 1 1992 3-21
20. J.L. Crowley, ECVNet tutorial on active computer vision, http://wwwprima.imag.fr/ECVNet/Tutorial/avtutorial.html
21. A. Blake, A. Yuille (Eds.), Active Vision, The MIT Press, Cambridge, MA, USA, 1992.
22. Swain M.J. Stricker M.A. Promising directions in active vision Int. J. Comput. Vision 11 2 1993 109-126
23. D.W. Murray, P.F. McLauchlan, I.D. Reid, P.M. Sharkey, Reactions to peripheral image motion using a head eye platform, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), Berlin, Germany, 1993, pp. 403-411.
24. J.L. Crowley, J.M. Bedrune, M. Bekker, M. Schneider, Integration and control of reactive visual processes, in: Proceedings of the European Conference on Computer Vision (ECCV), Stockholm, Sweden, 1994, pp. II:47-58.
25. Rimey R.D. Brown C.M. Control of selective perception using Bayes nets and decision theory Int. J. Comput. Vision 12 2/3 1994 173-207
26. C. Colombo, J.L. Crowley, Uncalibrated visual tasks via linear interaction, in: Proceedings of the European Conference on Computer Vision (ECCV), Cambridge, UK, 1996, pp. II:583-592.
27. Tarabanis K.A. Allen P.K. Tsai R.Y. A survey of sensor planning in computer vision IEEE Trans. Robot. Automat. 11 1 1995 86-104
28. Tarabanis K.A. Tsai R.Y. Allen P.K. The MVP sensor planning system for robotic vision tasks IEEE Trans. Robot. Automat. 11 1 1995 72-85
29. D.R. Roberts, A.D. Marshall, Viewpoint selection for complete surface coverage of three dimensional objects, in: Proceedings of the British Machine Vision Conference (BMVC), University of Southampton, UK, 1998, pp. 740-750.
30. Cowan C.K. Kovesi P.D. Automatic sensor placement from vision task requirements IEEE Trans. Pattern. Anal. Mach. Intell. 10 3 1988 407-416
31. Tarbox G.H. Gottschlich S.N. Planning for complete sensor converge in inspection Comput. Vision Image Understanding 61 1 1995 84-111
32. Mason S.O. Grun A. Automatic sensor placement for accurate dimensional inspection Comput. Vision Image Understanding 61 1995 454-467
33. R. Kasturi, R.C. Jain, Three-dimensional object recognition, Computer Vision: Principles, IEEE Computer Society Press Tutorial, 1991 (Chapter 5).
34. Murase H. Nayar S.K. Visual learning and recognition of 3-D objects from appearance Int. J. Comput. Vision 14 1995 5-24
35. T.M. Breuel, View-based recogntion, in: Proceedings of the IAPR Workshop on Machine Vision Applications, Tokyo, Japan, 1992.
36. H. Borotsching, L. Paletta, M. Prantl, A. Pinz, Active object recognition in parametric eigenspace, in: Proceedings of the British Machine Vision Conference (BMVC), University of Southampton, UK, 1998, pp. 629-638.
37. B. Schiele, J.L. Crowley, Probabilistic object recognition using multidimensional receptive field histograms, in: Proceedings of the International Conference on Pattern Recognition (ICPR), Vienna, Austria, 1996.
38. B. Schiele, J.L. Crowley, Transinformation for active object recognition, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), Bombay, India, 1998, pp. 249-254.
39. Koenderink J.J. van Doorn A.J. The internal representation of solid shape with respect to vision Biol. Cybern. 32 1979 211-216
40. I. Chakravarty, H. Freeman, Characteristic views as a basis for three dimensional object recognition, in: Proceedings of the SPIE Conference on Robot Vision, Vol. 336, Arlington, Va., USA, 1982, pp. 37-45.
41. Gremban K.D. Ikeuchi K. Appearance-based vision and the automatic generation of object recognition programs Jain A.K. Flynn P.J. Three-dimensional Object Recognition Systems 1993 229-258 Elsevier- Science Publishers Amsterdam
42. Eggert D.W. Bowyer K.W. Dyer C.R. Christensen H.I. Goldgof D.B. The scale space aspect graph IEEE Trans. Pattern Anal. Mach. Intell. 15 11 1993 1114-1130
43. Flynn P.J. Jain A.K. BONSAI: 3-D object recognition using constrained search IEEE Trans. Pattern Anal. Mach. Intell. 13 10 1991 1066-1075
44. Dickinson S.J. Pentland A.P. Rosenfield A. Qualitative 3D shape reconstruction using distributed aspect graph matching IEEE Trans. Pattern Anal. Mach. Intell. 14 2 1992 174-198
45. Dickinson S.J. Pentland A.P. Rosenfield A. From volumes to views: an approach to 3D object recognition Comput. Vision Graphics Image Process.: Image Understanding 55 2 1992 198-211
46. Sato K. Ikeuchi K. Kanade T. Model based recognition of specular objects using sensor models Comput. Vision Graphics Image Process.: Image Understanding 55 2 1992 119-129
47. Ikeuchi K. Kanade T. Automatic generation of object recognition programs Proc. IEEE 76 8 1988 1016-1035
48. Ikeuchi K. Kanade T. Modeling sensors: towards automatic generation of object recognition programs Comput. Vision Graphics Image Process. 48 1989 50-79
49. Robey M. West G. Venkatesh S. An investigation into the use of physical modeling for the prediction of various feature types visible from different viewpoints Comput. Vision Image Understanding 61 3 1995 417-429
50. H. Lu, L.G. Shapiro, A relational pyramid approach to view class determination, in: Proceedings of the International Conference on Pattern Recognition (ICPR), Rome, Italy, 1988, pp. 379-381.
51. H. Lu, L.G. Shapiro, O.I. Camps, A relational pyramid approach to view class determination, in: Proceedings of the IEEE Workshop on Interpretation of 3D Scenes, Austin, Texas, USA, 1989, pp. 177-183.
52. O.I. Camps, L.G. Shapiro, R.M. Haralick, PREMIO: an overview, in: Proceedings of the IEEE International Workshop on Directions in Automated CAD Based Vision, Maui, Hawaii, USA, 1991, pp. 11-21.
53. Munkelt O. Aspect-trees: generation and implementation Comput. Vision Image Understanding 61 3 1995 365-386
54. Dutta Roy S. Chaudhury S. Banerjee S. Aspect graph construction with noisy feature detectors IEEE Trans. Systems Man Cybern.-Part B: Cybernetics 33 2 2003 340-351
55. Hutchinson S.A. Kak A.C. Planning sensing strategies in a robot work cell with multi-sensor capabilities IEEE Trans. Robotics and Automat. 5 6 1989 765-783
56. Dickinson S.J. Christensen H.I. Tsotsos J. Olofsson G. Active object recognition integrating attention and view point control Comput. Vision Image Understanding 67 3 1997 239-260
57. Dutta Roy S. Chaudhury S. Banerjee S. Isolated 3-D object recognition through next view planning IEEE Trans. Systems Man Cybern.-Part A: Systems Humans 30 1 2000 67-76
58. Dutta Roy S. Chaudhury S. Banerjee S. Aspect graph based modeling and recognition with an active sensor: a robust approach Proc. Indian Natl. Sci. Acad. Part A 67 2 2001 187-206
59. S. Dutta Roy, S. Chaudhury, S. Banerjee, Recognizing large 3-D objects through next view planning using an uncalibrated camera, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), Vancouver, Canada, 2001, pp. II:276-281.
60. Biederman I. Human image understanding: recent research and a theory Comput. Vision Graphics Image Process. 32 1985 29-73
61. Bergevin R. Levine M. Part decomposition of objects from single view line drawings Comput. Vision Graphics Image Process.: Image Understanding 55 1 1992 73-83
62. Bergevin R. Levine M. Generic object recognition: building and matching coarse descriptions from line drawings IEEE Trans. Pattern Anal. Mach. Intell. 15 1 1993 19-36
63. C.Y. Huang, O.I. Camps, T. Kanungo, Object recognition using appearance-based parts and relations, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), San Juan, Puerto Rico, 1997, pp. 877-883.
64. O.I. Camps, C.Y. Huang, T. Kanungo, Hierarchical organization of appearance based parts and relations for object recognition, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 1998, pp. 685-691.
65. Dempster A.P. A generalization of bayesian inference J. R. Statist. Soc. 30 Series B 1968 205-247
66. Shafer G. A Mathematical Theory of Evidence 1976 Princeton University Press Princeton, NJ
67. Zadeh L.A. Fuzzy sets Inform. Control 8 1965 338-353
68. Pearl J. Fusion, propagation and structuring in belief network Artif. Intell. 29 1986 241-288
69. Oriolo G. Ulivi G. Vendittelli M. Real-time map building and navigation for autonomous robots in unknown environments IEEE Trans. Systems Man Cybern.-Part B: Cybernetics 28 3 1998 316-333
70. Liu C.-H. Tsai W.-H. 3D curved object recognition from multiple 2D camera views Comput. Vision Graphics Image Process. 50 1990 177-187
71. F.G. Callari, F.P. Ferrie, Active recognition: using uncertainty to reduce ambiguity, in: Proceedings of the International Conference on Pattern Recognition (ICPR), Vienna, Austria, 1996, pp. 925-929.
72. M. Werman, S. Banerjee, S. Dutta Roy, M. Qiu, Robot localization using uncalibrated camera invariants, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Fort Collins, Colorado, USA, 1999, pp. II:353-359.
73. Maver J. Bajcsy R. Occlusions as a guide for planning the next view IEEE Trans. Pattern Anal. Mach. Intell. 15 5 1993 76-145
74. N.A. Massios, R.B. Fisher, A best next view selection algorithm incorporating a quality criterion, in: Proceedings of the British Machine Vision Conference (BMVC), University of Southampton, UK, 1998, pp. 780-789.
75. M.A. Garća, S. Velázquez, A.D. Sappa, A two-stage algorithm for planning the next view from range images, in: Proceedings of the British Machine Vision Conference (BMVC), University of Southampton, UK, 1998, pp. 720-729.
76. Kutulakos K.N. Dyer C.R. Recovering shape by purposive viewpoint adjustment Int. J. Comput. Vision 12 2/3 1994 113-136
77. Swain P. Ferrie F.P. From uncertainity to visual exploration IEEE Trans. Pattern Anal. Mach. Intell. 13 10 1991 1038-1049
78. Marchand E. Chaumette F. An autonomous active vision system for complete and accurate 3D scene reconstruction Int. J. Comput. Vision 32 3 1999 171-194
79. W.E.L. Grimson, A. Lakshmi Ratan, P.A. O'Donnel, G. Klanderman, An active vision system to "Play Where's Waldo", in: Proceedings of the DARPA Conference on Image Understanding, Monterey, California, USA, 1994.
80. Wixson L.E. Ballard D.H. Using intermediate objects to improve the efficiency of visual search Int. J. Comput. Vision 12 2/3 1994 209-230
81. F. Jensen, H. Christensen, J. Nielsen, Bayesian methods for interpretation and control in multiagent vision systems, in: K.W. Bowyer (Ed.), SPIE Applications of AI X: Machine Vision and Robotics, Vol. 1708, Orlando, USA, 1992, pp. 536-548.
82. Baluja S. Pomerleau D. Dynamic relevance: vision-based focus of attention using artificial neural networks Artif. Intell. 97 1-2 1997 381-395
83. Buxton H. Gong S. Visual surveillance in a dynamic and uncertain world Artif. Intell. 78 1995 431-459
84. F. Nashashibi, M. Davy, P. Fillatreau, Indoor scene terrain modeling using multiple range images for autonomous mobile robots, in: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Nice, France, 1992, pp. I:40-46.
85. X. Lebègue, J.K. Aggarwal, Extraction and interpretation of semantically significant line segments for a mobile robot, in: Proceedings of the International Conference on Robotics and Automation (ICRA), 1992, pp. I:1778-1785.
86. X. Lebègue, J.K. Aggarwal, Generation of architectural CAD models using a mobile robot, in: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 1994, pp. I:711-717.
87. O.D. Faugeras, N. Ayache, B. Faverion, Building visual maps by combining noisy stereo measurements, in: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), San Francisco, USA, 1986, pp. III:1433-1438.
88. Faugeras O. Three-Dimensional Computer Vision: A Geometric Viewpoint 1996 The MIT Press Cambridge, MA, USA
89. Tirumalai A.P. Schunck B.G. Jain R.C. Evidential reasoning for building environmental maps IEEE Trans. Systems Man Cybern. 25 1 1995 10-20
90. Asada M. Map building for a mobile robot from sensory data IEEE Trans. Systems Man Cybern. 37 6 1990 1326-1336
91. Elfes A. Sonar-based real-world mapping and navigation IEEE J. Robotics Automat. RA-3 3 1987 249-265
92. S. Thrun, A Bayesian approach to landmark discovery and active perception in mobile robot navigation, Technical Report CMU-CS-96-122, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, May 1996.
93. Thrun S. Burgard W. Fox D. A probabilistic approach to concurrent mapping and localization for mobile robots Mach. Learning 31 1998 29-53
94. B. Schiele, J.L. Crowley, A comparison of position estimation techniques using occupancy grids, in: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), San Diego, California, 1994, pp. II:1628-1634.
95. Thrun S. Learning metric topological maps for indoor mobile robot navigation Artif. Intell. 99 1 1998 21-71
96. Basri R. Rivlin E. Localization and homing using combinations of model views Artif. Intell. 78 1-2 1995 327-354
97. Ullman S. Basri R. Recognition by linear combination of models IEEE Trans. Pattern Anal. Mach. Intell. 13 1991 992-1006
98. Kosaka A. Kak A.C. Fast vision-guided mobile robot navigation using model-based reasoning and prediction of uncertainties Comput. Vision Graphics Image Process.: Image Understanding 56 3 1992 271-329
99. Fennema C. Hanson A. Riseman E. Ross Beveridge J. Kumar R. Model- directed mobile robot navigation IEEE Trans. Systems Man Cybern. 20 6 1990 1352-1369
100. F. Chenavier, J.L. Crowley, Position estimation for a mobile robot using vision and odometry, in: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Nice, France, 1992, pp. III:2588-2593.
101. Levitt T.S. Lawton D.T. Qualitative navigation for mobile robots Artif. Intell. 44 1990 305-360
102. K. Onoguchi, M. Watanabe, Y. Okamoto, Y. Kuno, H. Asada, A visual navigation system using a multi-information local map, in: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Cincinnati, Ohio, USA, 1990, pp. II:767-774.
103. Burgard W. Cremers A.B. Fox D. Hähnel D. Lakemeyer G. Schulz D. Steiner W. Thrun S. Experiences with an interactive museum tour-guide robot Artif. Intell. 114 1-2 1999 3-55
104. Chen G.Y. Tsai W.H. An incremental-learning-by-navigation approach to vision-based autonomous land vehicle guidance in indoor environments using vertical line information and multiweighted generalized hough transform technique IEEE Trans. Syst. Man Cybern.-Part B: Cybernetics 28 5 1998 740-748
105. Yamauchi B. Beer R. Spatial learning for navigation in dynamic environments IEEE Trans. Syst. Man Cybern.-Part B: Cybernetics 26 3 1996 496-505