Segmentation Through Variable-Order Surface Fitting

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 10, Issue 2, 1988, Pages 167-192

  Besl, Paul J ^a   Jain, Ramesh C ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Image segmentation; range images; surface fitting

Indexed keywords

IMAGE PROCESSING - IMAGE ANALYSIS; MATHEMATICAL TECHNIQUES - APPROXIMATION THEORY; SURFACES;

IMAGE SEGMENTATION; SMOOTH SURFACE DECOMPOSITION; SURFACE FITTING;

VISION;

EID: 0023978579     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.3881     Document Type: Article

References (108)

1. G. J. Agin and T. 0. Binford, “Computer description of curved objects”, in Proc. 3rd Int. Joint Conf. Artificial Intelligence, Stanford, CA, Aug. 20-23, 1973, pp. 629-640.
2. R. L. Anderson and E. E. Houseman, Tables of Orthogonal Polynomial Values Extended to N = 104, Iowa State College Agricultural and Mechanic Arts, Ames, IA, Res. Bull. 297, Apr. 1942.
3. D. H. Ballard and C. M. Brown, Computer Vision. Englewood Cliffs, NJ: Prentice-Hall, 1982.
4. S. Barnard, “A stochastic approach to stereo vision”, in Proc. 5th Nat. Conf. Artificial Intelligence, AAAI, Philadelphia, PA, August 11-15, 1986, pp. 676-680.
5. R. H. Bartels and J. J. Jezioranski, “Least-squares fitting using orthogonal multinomials”, ACM Trans. Math. Software, vol. 11, no. 3, pp. 201–217, Sept. 1985.
6. P. R. Beaudet, “Rotationally invariant image operators”, in Proc. 4th Int. Conf. Pattern Recognition, Kyoto, Japan, Nov. 7-10, 1978, pp. 579-583.
7. G. Beheim and K. Fritsch, “Range finding using frequency-modulated laser diode”, Appl. Opt., vol. 25, no. 9, pp. 1439–1442, May 1986.
8. P. J. Besl, “Surfaces in early range image understanding”, Ph.D. dissertation, Dep. Elec. Eng. Comput. Sci., Univ. Michigan, Ann Arbor, Rep. RSD-TR-10-86, Mar. 1986; see also Surfaces in Range Image Understanding. New York: Springer-Verlag, 1988.
9. P. J. Besl and R. C. Jain, “Three dimensional object recognition”, ACM Comput. Surveys, vol. 17, no. 1, pp. 75–145, Mar. 1985.
10. P. J. Besl and R. C. Jain, “Invariant surface characteristics for three dimensional object recognition in range images”, Comput. Vision, Graphics, Image Processing, vol. 33, no. 1, pp. 33–80, Jan. 1986.
11. P. J. Besl, E. J. Delp, and R. C. Jain, “Automatic visual solder joint inspection”, IEEE J. Robotics Automation, vol. RA-1, no. 1, pp. 42–56, May 1985.
12. B. Bhanu, “Representation and shape matching of 3-D objects”, IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, no. 3, pp. 340–350, May 1984.
13. B. Bhanu, S. Lee, C. C. Ho, and T. Henderson, “Range data processing: Representation of surfaces by edges”, in Proc. Int. Pattern Recognition Conf, IAPR-IEEE, Oct. 1986, pp. 236-238.
14. R. M. Bolle and D. B. Cooper, “Bayesian recognition of local 3-D shape by approximating image intensity functions with quadric polynomials”, IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, no. 4, pp. 418–429, July 1984.
15. R. C. Bolles and M. A. Fischler, “A RANSAC-based approach to model fitting and its application to finding cylinders in range data”, in Proc. 7th Int. Joint Conf. Artificial Intelligence, Vancouver, B.C., Canada, Aug. 24-28, 1981, pp. 637-643.
16. R. C. Bolles and P. Horaud, “3DPO: A three-dimensional part orientation system”, Int. J. Robotics Res., vol. 5, no. 3, pp. 3–26, Fall 1986.
17. B. A. Boyter, “Three-dimensional matching using range data”, in Proc. 1st Conf. Artificial Intelligence Applications, IEEE Comput. Soc, 1984, pp. 211-216.
18. M. Brady, “Computational approaches to image understanding”, ACM Comput. Surveys, vol. 14, no. 1, pp. 3–71, Mar. 1982.
19. M. Brady, J. Ponce, A. Yuille, and H. Asada, “Describing surfaces”, Comput. Vision, Graphics, Image Processing, vol. 32, pp. 1–28, 1985.
20. C. Brice and C. Fennema, “Scene analysis using regions”, Artificial Intell., vol. 1, pp. 205–226, 1970.
21. B. Carrihill and R. Hummel, “Experiments with the intensity ratio depth sensor”, Comput. Vision, Graphics, Image Processing, vol. 32, pp. 337–358, 1985.
22. D. Chen, “A regression updating approach for detecting multiple curves”, in Proc. 2nd World Conf. Robotics Research, Scottsdale, AZ, Aug. 18-21, 1986, Paper RI/SME, MS86-764; also IEEE Trans. Pattern Anal. Machine Intell., to be published.
23. S. S. Chern, “A proof of the uniqueness of Minkowski's problem for convex surfaces”, Amer. J. Math., vol. 79, pp. 949–950, 1957.
24. F. S. Cohen and D. B. Cooper, “Simple parallel hierarchical and relaxation algorithms for segmenting noncausal markovian random fields”, IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-9, no. 2, pp. 195–219, Mar. 1987.
25. E. N. Coleman and R. Jain, “Obtaining shape of textured and specular surfaces using four-source photometry”, Comput. Graphics Image Processing, vol. 18, no. 4, pp. 309–328, Apr. 1982.
26. G. R. Cross and A. K. Jain, “Markov random field texture models”, IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-5, pp. 25–39, 1983.
27. C. Dane, “An object-centered three-dimensional model builder”, Ph.D. dissertation, Dep. Comput. Inform. Sci., Moore School Elec. Eng., Univ. Pennsylvania, Philadelphia, 1982.
28. W. W. Daniel, Applied Nonparametric Statistics. Boston, MA: Houghton-Mifflin, 1978.
29. L. S. Davis, “A survey of edge detection techniques”, Comput. Graphics Image Processing, vol. 4, pp. 248–270, 1975.
30. H. Derin and H. Elliot, “Modeling and segmentation of noisy and textured images using Gibbs random fields”, IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-9, no. 1, pp. 39–55, Jan. 1987.
31. S. Dizenzo, “Advances in image segmentation”, Image and Vision Comput., vol. 1, no. 4, pp. 196–210, Nov. 1983.
32. T. G. Fan, G. Medioni, and R. Nevatia, “Description of surfaces from range data using curvature properties”, in Proc. Computer Vision and Pattern Recognition Conf., IEEE Comput. Soc, Miami, FL, June 22-26, 1986, pp. 86-91.
33. O. D. Faugeras and M. Hebert, “The representation, recognition, and locating of 3-D objects”, Int. J. Robotics Res., vol. 5, no. 3, pp. 27–52, Fall 1986.
34. O. D. Faugeras, M. Hebert, and E. Pauchon, “Segmentation of range data into planar and quadric patches”, in Proc. 3rd Computer Vision and Pattern Recognition Conf., Arlington, VA, 1983, pp. 8-13.
35. I. D. Faux and M. J. Pratt, Computational Geometry for Design and Manufacture. UK: Ellis Horwood, Chichester, 1979.
36. F. P. Ferrie and M. D. Levine, “Piecing together 3D shape of moving objects: An overview”, in Proc. Computer Vision and Pattern Recognition Conf, IEEE Comput. Soc, San Francisco, CA, June 9-13, 1985, pp. 574-584.
37. K. S. Fu and J. K. Mui, “A survey on image segmentation”, Pattern Recognition, vol. 13, pp. 3–16, 1981.
38. S. Geman and D. Geman, “Stochastic relaxation, gibbs distributions, and Bayesian restoration of images”, IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-6, no. 6, pp. 721–741, Nov. 1984.
39. B. Gil, A. Mitiche, and J. K. Aggarwal, “Experiments in combining intensity and range edge maps”, Comput. Vision, Graphics, Image Processing, vol. 21, pp. 395–411, Mar. 1983.
40. D. Gilbarg and N. Trudinger, Elliptic Partial Differential Equations of Second Order. Berlin: Springer-Verlag, 1983.
41. C. Goad, “Special purpose automatic programming for 3D model-based vision”, in Proc. Image Understanding Workshop, DARPA, Arlington, VA, June 23, 1983, pp. 94-104.
42. G. H. Golub and C. F. Van Loan, Matrix Computations. Baltimore, MD: Johns Hopkins University Press, 1983.
43. W. E. L. Grimson, “A computer implementation of a theory of human stereo vision”, M.I.T. Artificial Intelligence Lab., Cambridge, MA, Memo. 565, 1980.
44. W. E. L. Grimson, From Images to Surfaces. Cambridge, MA: M.I.T. Press, 1981.
45. W. E. L. Grimson and T. Pavlidis, “Discontinuity detection for visual surface reconstruction”, Comput. Vision, Graphics, Image Processing, vol. 30, pp. 316–330, 1985.
46. E. L. Hall, J. B. K. Tio, C. A. McPherson, and F. A. Sadjadi, “Measuring curved surfaces for robot vision”, Computer, vol. 15, no. 12, pp. 42–54, Dec. 1982.
47. R. M. Haralick and L. G. Shapiro, “Image segmentation techniques”, Comput. Vision, Graphics, Image Processing, vol. 29, pp. 100–132, 1985.
48. R. M. Haralick and L. Watson, “A facet model for image data”, Comput. Graphics Image Processing, vol. 15, pp. 113–129, 1981.
49. R. M. Haralick, L. T. Watson, and T. J. Laffey, “The topographic primal sketch”, Int. J. Robotics Res., vol. 2, no. 1, pp. 50–72, Spring 1983.
50. M. Hebert and T. Kanade, “The 3-D profile method for object recognition”, in Proc. Computer Vision and Pattern Recognition Conf., IEEE Comput. Soc, San Francisco, CA, June 9-13, 1985, pp. 458-463.
51. M. Hebert and J. Ponce, “A new method for segmenting 3-D scenes into primitives”, in Proc. 6th Int. Conf. Pattern Recognition, Munich, West Germany, Oct. 19-22, 1982, pp. 836-838.
52. T. C. Henderson, “Efficient 3-D object representations for industrial vision systems”, IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-5, no. 6, pp. 609–617, Nov. 1983.
53. T. C. Henderson and B. Bhanu, “Three-port seed method for the extraction of planar faces from range data”, in Proc. Workshop Industrial Applications of Machine Vision, Research Triangle Park, NC, May 1982, pp. 181-186.
54. M. Herman, “Generating detailed scene descriptions from range images”, in Proc. Int. Conf. Robotics and Automation, St. Louis, MO, Mar. 25-28, 1985, pp. 426-431.
55. B. K. P. Horn, “Extended Gaussian images”, Proc. IEEE, vol. 72, no. 12, pp. 1656–1678, Dec. 1984.
56. K. Ikeuchi and B. K. P. Horn, “Numerical shape from shading and occluding boundaries”, Artificial Intell., vol. 17, pp. 141–184, Aug. 1981.
57. S. L. Horowitz and T. Pavlidis, “Picture segmentation by a directed split-and-merge procedure”, in Proc. 2nd Int. Joint Conf. Pattern Recognition, 1974, pp. 424-433.
58. K. Ikeuchi and B. K. P. Horn, “Numerical shape from shading and occluding boundaries”, Artificial Intell., vol. 17, pp. 141–184, Aug. 1981.
59. S. Inokuchi and R. Nevatia, “Boundary detection in range pictures”, in Proc. 5th Int. Conf. Pattern Recognition, Miami, FL, Dec. 1-4, 1980, pp. 1031-1035.
60. S. Inokuchi, T. Nita, F. Matsuday, and Y. Sakurai, “A three-dimensional edge-region operator for range pictures”, in Proc. 6th Int. Conf. Pattern Recognition, Munich, West Germany, Oct. 19-22, 1982, pp. 918-920.
61. S. Inokuchi, K. Sato, and F. Matsuda, “Range imaging system for 3-D object recognition”, in Proc. 7th Int. Conf. Pattern Recognition, Montreal, P.Q., Canada, July 30-Aug. 2, 1984, pp. 806-808.
62. R. Hoffman and A. K. Jain, “Segmentation and classification of range images”, IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-9, no. 5, pp. 608–620, Sept. 1987.
63. R. Jain, “Dynamic scene analysis”, in Progress in Pattern Recognition, vol. 2, A. Rosenfeld and L. Kanal, Eds. Amsterdam, The Netherlands: North-Holland, 1983.
64. R. A. Jarvis, “A perspective on range finding techniques for computer vision”, IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-5, no. 2, pp. 122–139, Mar. 1983.
65. T. Kanade, “Survey: Region segmentation: Signal vs. semantics”, Comput. Graphics Image Processing, vol. 13, pp. 279–297, 1980.
66. T. Kanade, “Recovery of the three-dimensional shape of an object from a single view”, Artificial Intell., vol. 17, pp. 409–460, Aug. 1981.
67. J. R. Kender and E. M. Smith, “Shape from darkness: Deriving surface information from dynamic shadows”, in Proc. 5th Nat. Conf. Artifical Intelligence, AAAI, Philadelphia, PA, Aug. 11-15, 1986, pp. 664-669.
68. G. Kinoshita, M. Idesawa, and S. Naomi, “Robotic range sensor with projection of bright ring pattern”, J. Robotic Syst., vol. 3, no. 3, pp. 249–257, 1986.
69. D. T. Kuan and R. J. Drazovich, “Model-based interpretation of range imagery”, in Proc. Nat. Conf. Artificial Intelligence, Austin, TX, Aug. 6-10, 1984, pp. 210-215.
70. C. L. Lawson and R. J. Hanson, Solving Least Squares Problems. Englewood Cliffs, NJ: Prentice-Hall, 1974.
71. R. A. Lewis and A. R. Johnston, “A scanning laser rangefinder for a robotic vehicle”, in Proc. 5th Int. Joint Conf. Artificial Intelligence, Cambridge, MA, Aug. 22-25, 1977, pp. 762-768.
72. C. Lin and M. J. Perry, “Shape description using surface triangularization”, in Proc. Workshop Computer Vision: Representation and Control, IEEE Comput. Soc, Rindge, NH, Aug. 23-25, 1982, pp. 38-43.
73. D. Marr, Vision. New York: Freeman, 1982.
74. G. Medioni and R. Nevatia, “Description of 3-D surfaces using curvature properties”, in Proc. Image Understanding Workshop, DARPA, New Orleans, LA, Oct. 3-4, 1984, pp. 291-299.
75. D. L. Milgrim and C. M. Bjorklund, “Range image processing: Planar surface extraction”, in Proc. 5th Int. Conf. Pattern Recognition, Miami, FL, Dec. 1-4, 1980, pp. 912-919.
76. B. Gil, A. Mitiche, and J. K. Aggarwal, “Experiments in combining intensity and range edge maps”, Comput. Vision, Graphics, Image Processing, vol. 21, pp. 395–411, Mar. 1983.
77. R. Nevatia and T. 0. Binford, “Structured descriptions of complex objects”, in Proc. 3rd Int. Joint Conf. Artificial Intelligence, Stanford, CA, Aug. 20-23, 1973, pp. 641-647.
78. W. M. Newman and R. F. Sproull, Principles of Interactive Computer Graphics, 2nd ed. New York: McGraw-Hill, 1979.
79. M. Oshima and Y. Shirai, “Object recognition using three-dimensional information”, IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-5, no. 4, pp. 353–361, July 1983.
80. T. Pavlidis, “Segmentation of pictures and maps through functional approximation”, Comput. Graphics Image Processing, vol. 1, pp. 360–372, 1972.
81. F. G. Peet and T. S. Sahota, “Surface curvature as a measure of image texture”, IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, no. 6, pp. 734–738, Nov. 1985.
82. T. C. Pong, L. G. Shapiro, L. T. Watson, and R. M. Haralick, “Experiments in segmentation using a facet model region grower”, Comput. Vision, Graphics, Image Processing, vol. 25, pp. 1–23, 1984.
83. R. J. Popplestone, C. M. Brown, A. P. Ambler, and G. F. Crawford, “Forming models of plane-and-cylinder faceted bodies from light stripes”, in Proc. 4th Int. Joint Conf. Artificial Intelligence, Tbilisi, Georgia, USSR, Sept. 1975, pp. 664-668.
84. M. Potmesil, “Generating models of solid objects by matching 3D surface segments”, in Proc. 8th Int. Joint Conf. Artificial Intelligence, Karlsruhe, West Germany, Aug. 8-12, 1983, pp. 1089-1093.
85. J. Prewitt, “Object enhancement and extraction”, in Picture Processing and Psychopictorics, B. Lipkin and A. Rosenfeld, Eds. New York: Academic, 1979, pp. 75–149.
86. G. T. Reid, “Automatic fringe pattern analysis: a review”, Opt. Lasers Eng., vol, 7, pp. 37-68, 1986.
87. W. Richards and D. D. Hoffman, “Codon constraints on closed 2D shapes”, Comput. Vision, Graphics, Image Processing, vol. 31, pp. 265–281, 1985.
88. E. M. Riseman and M. A. Arbib, “Computational techniques in the visual segmentation of static scenes”, Comput. Graphics Image Processing, vol. 6, pp. 221–276, 1977.
89. I. Rock, The Logic of Perception. Cambridge, MA: M.I.T. Press, 1983.
90. A. Rosenfeld and L. S. Davis, “Image segmentation and image models”, Proc. IEEE, vol. 67, no. 5, pp. 764–772, May 1979.
91. A. Rosenfeld and A. Kak, Digital Picture Processing, vols. 1 and 2. New York: Academic, 1982.
92. I. K. Sethi and S. N. Jayaramamurthy, “Surface classification using characteristic contours”, in Proc. 7th Int. Conf. Pattern Recognition, Montreal, P.Q., Canada, July 30-Aug. 2, 1984, pp. 438-440.
93. Y. Shirai, “Recognition of polyhedrons with a range finder”, Pattern Recognition, vol. 4, pp. 243–250, 1972.
94. Y. Shirai and M. Suwa, “Recognition of polyhedra with a range finder”, in Proc. 2nd Int. Joint Conf. Artificial Intelligence, London, UK, Aug. 1971, pp. 80-87.
95. D. R. Smith and T. Kanade, “Autonomous scene description with range imagery”, Comput. Vision, Graphics, Image Processing, vol. 31, pp. 322–334, 1985.
96. W. Snyder and G. Bilbro, “Segmentation of three-dimensional images”, in Proc. Int. Conf. Robotics and Automation, IEEE Comput. Soc, St. Louis, MO, Mar. 25-28, 1985, pp. 396-403.
97. K. Sugihara, “Range-data analysis guided by junction dictionary”, Artificial Intell., vol. 12, pp. 41–69, 1979.
98. D. Terzopoulos, “Computing visible surface representations”, Artificial Intell. Lab., M.I.T., Cambridge, MA, AI Memo 800, Mar. 1985.
99. W. Tiller, “Rational B-splines for curve and surface representation”, IEEE Comput. Graphics Applications, vol. 3, no. 6, pp. 61–69, 1983.
100. F. Tomita and T. Kanade, “A 3D vision system: Generating and matching shape descriptions in range images”, in Proc. Int. Conf. Robotics, IEEE Comput. Soc, Atlanta, GA, Mar. 13-15, 1984, pp. 186-191.
101. S. Ullman, The Interpretation of Visual Motion. Cambridge, MA: M.I.T. Press, 1979.
102. B. C. Vemuri, A. Mitiche, and J. K. Aggarwal, “Curvature-based representation of objects from range data”, Image and Vision Corn-put., vol. 4, no. 2, pp. 107–114, May 1986.
103. A. P. Witkin, “Recovering surface shape and orientation from texture”, Artificial Intel!., vol. 17, pp. 17–45, Aug. 1981.
104. A. P. Witkin and J. Tenenbaum, “The role of structure in vision”, in Human and Machine Vision, Beck et al., Eds. New York: Academic, 1983, pp. 481–543.
105. R. J. Woodham, “Analysing images of curved surfaces”, Artificial Intell., vol. 17, pp. 117–140, Aug. 1981.
106. J. W. Woods, “Two-dimensional discrete Markov fields”, IEEE Trans. Inform. Theory, vol. IT-18, pp. 232–240, 1972.
107. S. W. Zucker, “Region growing: Childhood and adolescence”, Comput. Graphics Image Processing, vol. 5, pp. 382–399, 1976.
108. D. M. Zuk and M. L. Delleva, “Three-dimensional vision system for the adaptive suspension vehicle”, Defense Supply Service, Washington, Final Rep. 170400-3-F, ERIM, DARPA 4468, 1983.