View planning for automated three-dimensional object reconstruction and inspection

ACM Computing Surveys

Volumn 35, Issue 1, 2003, Pages 64-96

  Scott, William R ^a   Roth, Gerhard ^a   Rivest, Jean François ^b,c  

^a NATIONAL RESEARCH COUNCIL CANADA   (Canada)

^b UNIVERSITY OF OTTAWA   (Canada)

^c DEFENCE RESEARCH AND DEVELOPMENT CANADA   (Canada)

Author keywords

Object inspection; Object reconstruction; Range images; View planning

Indexed keywords

OBJECT INSPECTION; OBJECT RECONSTRUCTION; RANGE IMAGES; VIEW PLANNING;

AUTOMATION; DATA ACQUISITION; IMAGE RECONSTRUCTION; LASER APPLICATIONS; SCANNING; SENSORS;

OBJECT RECOGNITION;

EID: 6344277647     PISSN: 03600300     EISSN: 03600300     Source Type: Journal    
DOI: 10.1145/641865.641868     Document Type: Review

References (99)

1. ABRAMS, S. 1997. Sensor planning in an active robot work-cell. Ph.D. dissertation, Columbia University, New York, NY.
2. AMANN, M.-C., BOSCH, T., MYLLYLA, R., AND Rioux, M. 2001. Laser ranging: a critical review of usual techniques for distance measurement. Opt. Eng. 40, 1, 10-19.
3. ARBEL, T. AND FERRIE, F. 1999. Entropy-based gaze planning. In Proceedings of the 2nd IEEE Workshop on Perception for Mobile Agents, in association with 1999 IEEE Computer Society Conferrence on Computer Vision and Pattern Recognition (Fort Collins, CO.). 87-94.
4. AUBRY, S. 1994. 3D model construction from multiple sensor viewpoints. Ph.D. dissertation, McGill University, Montreal, P.Q., Canada.
5. BANTA, J. AND ABIDI, M. 1996. Autonomous placement of a range sensor for acquisition of optimal 3D models. In Proceedings of the IEEE 22nd International Conference on Industrial Electronics, Control and Instrumentation (Taipei, Taiwan). 1583-1588.
6. BANTA, J., ZHIEN, Y., WANG, X., ZHANG, G., SMITH, M., AND ABIDI, M. 1995. A best-next-view algorithm for three-dimensional scene reconstruction using range images. SPIE 2588, 418-429.
7. BANTA, J. E. 1996. Optimal range sensor positioning for three-dimensional model reconstruction. M.S. thesis, University of Tennessee, Knoxville, TN.
8. BARIBEAU, R., RIoux, M., AND GODIN, G. 1991. Color reflectance modeling using a polychromatic laser range sensor. IEEE Trans. PAMI 14, 2 (Feb.), 263-269.
9. BATCHELOR, B. 1989. A prolog lighting advisor. In Proceedings of the SPIE Conference on Intelligent Robots and Computer Vision VIII: Systems and Applications. Vol. 1193. 295-302.
10. BERALDIN, J.-A., EL-HAKIM, S., AND COURNOYER, L. 1993. Practical range camera calibration. In Proceedings of the SPIE Conference on Videometrics II (Boston, MA). Vol. 2067. 21-30.
11. BESL, P. 1989. Range image sensors. In Advances in Machine Vision, J. Sanz, Ed. Springer-Verlag, New York, NY.
12. BESL, P. AND McKAY, N. 1992. A method for registration of 3D shapes. IEEE Trans. PAMI 14, 2 (Feb.), 239-256.
13. BEST, L. C. 1996. Autonomous construction of three-dimensional models from range data. Ph.D. dissertation, University of Wyoming, Laramie, WY.
14. BOWYER, K. AND DYER, C. 1990. Aspect graphs: An introduction and survey of recent results. In Proceedings of the SPIE Conference on CloseRange Photogrammetry Meets Machine Vision. Vol. 1395. 200-208.
15. BUZINSKI, M. J. 1990. A comparison of touch probe and laser triangulation sensors for verifying the dimensional accuracy of manufactured parts. M.S. thesis, Purdue University, Lafayette, IN.
16. CONNOLLY, C. 1985. The determination of next best views. In Proceedings of the IEEE International Conference on Robotics and Automation. 432-435.
17. COWAN, C. AND KOVESI, P. 1988. Automatic sensor placement from vision task requirements. IEEE Trans. PAMI10, 3 (May), 407-416.
18. CURLESS, B. AND LEVOY, M. 1996. Better optical triangulation through space-time analysis. In SIGGRAPH '96. 1-10.
19. CURLESS, B. L. 1997. New methods for surface reconstruction from range images. Ph.D. dissertation, Stanford University, Stanford, CA.
20. EL-HAKIM, S. AND BERALDIN, J.-A. 1994. On the integration of range and intensity data to improve vision-based three-dimensional measurements. In Proceedings of the SPIE Conference on Videometrics III (Boston, MA). Vol. 2350. 306-321.
21. FAUGERAS, O., MUNDY, J., AHUJA, N., DYER, C., PENTLAND, A., JAIN, R., AND IKEUCHI, K. 1992. Why aspect graphs are not (yet) practical for computer vision. CVGIP: Image Understand. 55, 2, 212-218.
22. GARCIA, M., VELAZQUEZ, S., AND SAPPA, A. 1998a. A two-stage algorithm for planning the next view from range images. In British Machine Vision Conference 1998. 720-729.
23. GARCIA, M., VELAZQUEZ, S., SAPPA, A., AND BASANEZ, L. 1998b. Autonomous sensor planning for 3D reconstruction of complex objects from range images. In Proceedings of the IEEE International Conference on Robotics and Automation (Leuven, Belgium). 3085-3090.
24. GREESPAN, M. 2002. Geometric probing of dense range data. IEEE Trans. PAMI 24, 4 (April), 495-508.
25. HALL-HOLT, O. 1998. Technical report, Stanford University, Stanford, CA. Available online at www-graphics.stanford.edu/~olaf/nbv.html.
26. HÉBERT, P. 2001. A self-referenced hand-held range sensor. In 3rd International Conference on 3D Digital Imaging and Modeling (Quebec City, P.Q., Canada). 5-12.
27. HUBER, D. 2001. Automatic 3D modeling using range images obtained from unknown viewpoints. In 3rd International Conference on 3D Digital Imaging and Modeling (Quebec City, P.Q., Canada). 153-160.
28. HUTCHINSON, S. AND KAk, A. 1989. Planning sensing strategies in a robot work cell with multisensor capabilities. IEEE Trans. Robot. Automat. 5, 6 (Dec.), 765-783.
29. KAHN, J., KLAWE, M., AND KLEITMAN, D. 1980. Traditional galleries require fewer watchmen. Tech. rep. RJ3021, IBM Watson Research Center, Yorktown Heights, NY.
30. KITAMURA, Y., SATO, H., AND TAMURA, H. 1990. An expert system for industrial machine vision. In Proceedings of the 10th International Conference on Pattern Recognition. 771-773.
31. KUTULAKOS, K. AND SEITZ, S. 2000. A theory of shape by space carving. Intl. J. Comp. Vis. 38, 3, 1999-218.
32. KUTULAKOS, K. N. 1994. Exploring three-dimensional objects by controlling the point of observation. Ph.D. dissertation, University of Wisconsin-Madison, Madison, WI.
33. LAMB, D., BAIRD, D., AND GREENSPAN, M. 1999. An automation system for industrial 3D laser digitizing. In Proceedings of the 2nd International Conference on 3D Digital Imaging and Modeling (Ottawa, Ont., Canada). 148-157.
34. LANGIS, C., GREENSPAN, M., AND GODIN, G. 2001. The parallel iterative closest point algorithm. In Proceedings of the 3rd International Conference on 3D Digital Imaging and Modeling (Quebec City, P.Q., Canada). 195-202.
35. MASSIOS.N. 1997. Predicting the best next view for a laser range striper system. M.S. thesis, University of Edinburgh, Edinburgh, Scottland.
36. MASSIOS, N. AND FISHER, R. 1998. A best next view selection algorithm incorporating a quality criterion. In British Machine Vision Conference (Sept. 1998). 780-789.
37. MAVER, J. 1995. Collecting visual information using an active sensor system. Ph.D. dissertation, University of Ljubljana, Ljubljana, Slovenia.
38. MAVER, J. AND BAJCSY, R. 1990. How to decide form the first view where to look next. In Proceedings of the DARPA Image Understanding Workshop (Pittsburgh, PA). 482-496.
39. MAVER, J. AND BAJCSY, R. 1993. Occlusions as a guide for planning the next view. IEEE Trans. PAMI 17, 5 (May), 417-433.
40. MILROY, M., BRADLEY, C., AND VICKERS, G. 1996. Automated laser scanning based on orthogonal cross sections. Machine Vis. Appl. 9, 106-118.
41. MOROOKA, K., ZHA, H., AND HASEGAWA, T. 1999. Computations on a spherical view space for efficient planning of viewpoints in 3D object modeling. In Proceedings of the 2nd International Conference on 3D Digital Imaging and Modeling (Ottawa, Ont., Canada). 138-147.
42. NEWMAN, T. AND JAIN, A. 1995. A survey of automated visual inspection. Comput. Vis. Image Understand. 61, 2 (March), 231-262.
43. NOVINI, A. 1988. Lighting and optics expert system for machine vision. In Proceedings of the SPIE Conference on Optics, Illumination, andImage Sensing for Machine Vision III. Vol. 1005. 131-136.
44. PAPADOPOULOS-ORFANOS, D. 1997. Numerisation geometrique automatique a 1'aide d'une camera 3D de precision a profondeur de champ reduite. Ph.D. dissertation, Ecole nationale superieure des telecommunications, Paris, France.
45. PAPADOPOULOS-ORFANOS, D. AND SCHMITT, F. 1997. Automatic 3D digitization using a laser rangefinder with a small field of view. In Proceedings of the International Conference on Recent Advances in 3D Digital Imaging and Modeling (Ottawa, Ont., Canada). 60-67.
46. PITO, R. 1996a. Mesh integration based on comeasurements. In Proceedings of the International Conference on Image Processing (Lausanne, Switzerland). Vol. 2. 397-400.
47. PITO, R. 1996b. A sensor based solution to the next best view problem. In Proceedings of the International Conference on Pattern Recognition. 941-945.
48. PITO, R. 1997a. Automated surface acquisition using range cameras. Ph.D. dissertation, University of Pennsylvania, Philadelphia, PA.
49. PITO, R. 1997b. A registration aid. In Proceedings of the International Conference on Recent Advances in 3D Digital Imaging and Modeling (Ottawa, Ont., Canada). 85-92.
50. PITO, R. 1999. A solution to the next best view problem for automated surface acquisition. IEEE Trans. PAMI 21, 10 (Oct.), 1016-1030.
51. PITO, R. AND BAJCSY, R. 1995. A solution to the nextbest-view problem for automated cad model acquisition of free-form objects using range cameras. In Proceedings of the SPIE Symposium on Modeling, Simulation and Control Technologies for Manufacturing (Philadelphia, PA.) Vol. 2596. 78-89.
52. PRIETO, F. 1999. Métrologie assistée par ordinateur: Apport des capteurs 3D sans contact. Ph.D. dissertation, L'Institut National des Sciences Appliquées de Lyon, Lyon, France.
53. PRIETO, F., REDARCE, T., BOULANGER, P., AND LEPAGE, R. 1999. CAD-based range sensor placement for optimum 3D data acquisition. In Proceedings of the International Conférence on 3D Digital Imaging and Modeling (Ottawa, Ont., Canada). 128-137.
54. PRIETO, F., REDARCE, T., BOULANGER, P., AND LEPAGE, R. 2001. Tolerance control with high resolution 3D measurements. In 3rd International Conference on 3D Digital Imaging and Modeling (Quebec City, P.Q., Canada). 339-346.
55. PUDNEY, C. J. 1994. Surface modeling and surface following for robots equipped with range sensors. Ph.D. dissertation, University of Western Australia, Perth, Australia.
56. REED, M. AND ALLEN, P. 1997. A robotic system for 3D model acquisition from multiple range images. In Proceedings of the IEEE International Conference on Roboticsand Automation (Albuquerque, NM.). 2509-2514.
57. REED, M. AND ALLEN, P. 1999. 3D modeling from range imagery. Image Vis. Comput. 17, 1 (Feb.), 99-111.
58. REED, M., ALLEN, P., AND STAMOS, I. 1997a. 3D modeling from range imagery: An incremental method with a planning component. In Proceedings of the International Conference on Recent Advances in 3D Digital Imaging and Modeling (Ottawa, Ont., Canada). 76-83.
59. REED, M., ALLEN, P., AND STAMOS, I. 1997b. Automated model acquisition from range images with view planning. In Proceedings of the IEEE Conference Visual Pattern Recognition (San Juan, Puerto Rico). 72-77.
60. REED, M. K. 1998. Solid model acquisition form range imagery. Ph.D. dissertation, Columbia University, New York, NY.
61. ROBERTS, D. AND MARSHALL, A. 1997. A review of viewpoint planning. Tech. Rep. 97007, University of Wales College of Cardiff, Cardiff, U.K.
62. ROTH, G. 2000. Building models from sensor data: an application shared by the computer vision and the computer graphics community. In Confluence of Computer Vision and Computer Graphics, A. Leonardis et al., Eds. Kluwer The Hague, The Netherlands.
63. ROUI-ABIDI, B. 1992. Automatic sensor placement for volumetric object characterization. Ph.D. dissertation, University of Tennessee, Knoxville, TN.
64. RUSINKIEWICZ, S. AND LEVOY, M. 2001. Efficient variants of the ICP algorithm. In Proceedings of the 3rd International Conference on 3D Digital Imaging and Modeling (Quebec City, P.Q., Canada). 145-152.
65. SAKANE, S., NIEPOLD, R., SATO, T., AND SHIRAI, Y. 1992, Illumination setup planning for a hand-eye system based on an environmental model. Advan. Robot. 6, 4, 461-482.
66. SCOTT, W., ROTH, G., AND RIVEST, J.-F. 2000. Performance-oriented view planning for automatic model acquisition. In Proceedings of the 31st International Symposium on Robotics (Montreal, P.Q., Canada). 314-319.
67. SCOTT, W., ROTH, G., AND RIVEST, J.-F. 2001a. View planning as a set covering problem. Tech. Rep. NRC-44892. National Research Council of Canada, Institute for Information Technology, Ottawa, Ont., Canada.
68. SCOTT, W., ROTH, G., AND RIVEST, J.-F. 2001b. View planning for multi-stage object reconstruction. In Proceedings of the 14th International Conference on Vision Interface (Ottawa, Ont., Canada). 64-71.
69. SCOTT, W., ROTH, G., AND RIVEST, J.-F. 2002. Pose error effects on range sensing. In Proceedings of the 15th International Conference on Vision Interface (Calgary, Alta., Canada). 331-338.
70. SCOTT, W. R. 2002. Performance-oriented view planning for automated object reconstruction. Ph.D. dissertation, University of Ottawa, Ottawa, Ont., Canada.
71. SEDAS-GERSEV, S. W. 1993. Algorithms for automatic sensor placement to acquire complete and accurate information. Ph.D. dissertation, Carnegie Mellon University, Pittsburgh, PA.
72. SEQUEIRA, V. 1996. Active range sensing for three-dimensional environment reconstruction. Ph.D. dissertation, IST-Technical University of Lisbon, Lisbon, Portugal.
73. SEQUEIRA, V. AND GONÇALVES, J. 2002. 3D reality modeling: Photo-realistic 3D models of real world scenes. Proceedings of the First International Symposium on 3D Data Processing Visualization and Transmission (3DPVT02). 776-783.
74. SOUCY, G., CALLARI, F., AND FERRIE, F. 1998. Uniform and complete surface coverage with a robot-mounted laser rangefinder. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (Victoria, B.C., Canada). 1682-1688.
75. TARABANIS, K. 1992. Sensor planning and modeling for machine vision tasks. Ph.D. dissertation, Columbia University, New York, NY.
76. TARABANIS, K., ALLEN, P., AND TSAI, R. 1995a. A survey of sensor planning in computer vision. IEEE Trans. Robot. Automat. 11, 1 (Feb.), 86-104.
77. TARABANIS, K., TSAI, R., AND ALLEN, P. 1995b. The MVP sensor planning system for robotic vision tasks. IEEE Trans. Robot. Automat. 11, 1 (Feb.), 72-85.
78. TARABANIS, K., TSAI, R., AND KAUL, A. 1996. Computing occlusion-free viewpoints. IEEE Trans. PAMI18, 3 (March), 279-292.
79. TARBOX, G. AND GOTTSCHLICH, S. 1995. Planning for complete sensor coverage in inspection. Comput. Vis. Image Understand. 61, 1 (Jan.), 84-111.
80. TARBOX, G. H. 1993. A volumetric approach to automated 3D inspection. Ph.D. dissertation. Rensselaer Polytechnic Institute, Troy, NY.
81. TREMBLAY, P.-J. AND FERRIE, F. 2000. The skeptical explorer: A multi-hypotheses approach to visual modeling and exploration. Auton. Robot. 8, 2, 193-201.
82. TRUCCO, E., UMASUTHAN, M., WALLACE, A., AND ROBERTO, V. 1997. Model-based planning of optimal sensor placements for inspection. IEEE Trans. Robot. Automat. 13, 2 (April), 182-194.
83. URRUTIA, J. 2000. Art gallery and illumination problems. In Handbook of Computational Geometry, J.-R. Sack and J. Urrutia, Eds. Elsevier, New York, NY.
84. WHAITE, P. AND FERRIE, F. 1990. From uncertainty to visual exploration. In Proceedings of the 3rd International Conference on Computer Vision (Osaka, Japan). 690-697.
85. WHAITE, P. AND FERRIE, F. 1991. From uncertainty to visual exploration. IEEE Trans. PAMI 13, 10 (Oct.), 1038-1049.
86. WHAITE, P. AND FERRIE, F. 1992. Uncertain views. In Proceedings of the IEEE Conference on Visual Pattern Recognition. 3-9.
87. WHAITE, P. AND FERRIE, F. 1997. Autonomous exploration: Driven by uncertainty. IEEE Trans. PMII 19, 3 (March), 193-205.
88. WHEELER, M. D. 1996. Automatic modeling and localization for object recognition. Ph.D. dissertation, Carnegie Mellon University, Pittsburgh, PA.
89. WKSON, L. E. 1994. Gaze selection for visual search. Ph.D. thesis, University of Rochester, Rochester, NY.
90. XIE, S., CALVERT, T., AND BHATTACHARYA, B. 1986. Planning views for the incremental construction of model bodies. In Proceedings of the 8th International Conference on Pattern Recognition (Paris, France). 154-157.
91. YE, Y. 1997. Sensor planning for object search. Ph.D. dissertation, University of Toronto, Toronto, Ont., Canada.
92. YE, Y. AND TSOTSOS, J. 1999. Sensor planning for 3D object search. Comput. Vis. Image Understand. 73, 2 (Feb.), 145-168.
93. YI, S. 1990. Illumination control expert for machine vision: A goal driven approach. Ph.D. dissertation, University of Washington, Seattle, WA.
94. YI, S., HARALICK, R., AND SHAPIRO, L. 1995. Optimal sensor and light source positioning for machine vision. Comput. Vis. Image Understand. 61, 1 (Jan.), 122-137.
95. YU, Y. AND GUPTA, K 2000. An information theoretic approach to view point planning for motion planning of eye-in-hand systems. In Proceedings of the 31st International Symposium on Robotics. 306-311.
96. YUAN, X. 1993. 3D reconstruction as an automatic modeling system. Ph.D. dissertation, University of Alberta, Edmonton, Alta., Canada.
97. YUAN, X. 1995. A mechanism of automatic 3D object modeling. IEEE Trans. PAMI 17, 3 (March), 307-311.
98. ZHA, H., MOROOKA, K., AND HASEGAWA, T. 1998. Next best viewpoint (NBV) planning for active object modeling based on a learning-by-showing approach. In Proceedings of the 3rd Asian Conference on Computer Vision (Hong Kong). 185-192.
99. ZHA, H., MOROOKA, K., HASEGAWA, T., AND NAGATA, T. 1997. Active modeling of 3D objects: Planning on the next best pose (NBP) for acquiring range images. In Proceedings of the International Conference on Recent Advances in 3D Digital Imaging and Modeling (Ottawa, Ont., Canada). 68-75.