Dynamic 3-D Scene Analysis through Synthesis Feedback Control

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 15, Issue 6, 1993, Pages 556-568

  Koch, Reinhard ^a  

^a LEIBNIZ UNIVERSITY HANNOVER   (Germany)

Author keywords

3 D motion estimation; 3 D object tracking; 3 D scene analysis; 3 D shape adaptation; 3 D shape reconstruction; Analysis by synthesis; dynamic scene analysis; image sequence analysis; object oriented video phone coding

Indexed keywords

ALGORITHMS; BINOCULAR VISION; COMPUTER AIDED DESIGN; CONTROL THEORY; IMAGE ANALYSIS; IMAGE COMPRESSION; MACHINE VISION; THREE DIMENSIONAL COMPUTER GRAPHICS; TIME VARYING SYSTEMS; VIDEO SIGNAL PROCESSING; VIDEO TELEPHONE EQUIPMENT;

FEATURE EXTRACTION; MOTION ESTIMATION; OBJECT TRACKING; SCENE ANALYSIS; STEREO VISION; VIDEOPHONE CODING;

COMPUTER VISION;

EID: 0027607894     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.216725     Document Type: Article

References (37)

1. J. K. Aggarwal and N. Nandhakumar, “On the computation of motion from sequences of images—A review,” Proc. IEEE, vol. 76, no. 8, pp. 917–935, Aug. 1988.
2. A. Blake and A. Zissermann, Visual Reconstruction. Cambridge, MA: MIT Press, 1987.
3. D. Marr and K. H. Nishihara, “Representation and recognition of the spatial organization of three dimensional shapes,” Proc. Royal. Soc. Lond. B, vol. 200, pp. 269 -294, 1978.
4. H. G. Musmann, M. Hotter, and J. Ostermann, “Object-oriented analysis-synthesis coding of moving images,” Signal Processing: Image Com-vol. 1, no. 2, 117–138, Nov. 1989.
5. R. Forchheimer and T. Kronander, “Image coding—From waveforms to animation,” IEEE Trans. Acoustics Speech Signal Processing, vol. 37, no. 12, pp. 2008–2033, Dec. 1989.
6. H. Harashima and F. Kishino, “Intelligent image coding and communications with realistic sensations—Recent trends,” IEICE Trans., vol. E 74, no. 6, 1582–1592, June 1991.
7. R. A. Jarvis, “A perspective on range finding techniques for computer vision,” IEEE Trans. Patt. Anal. Machine Intell., vol. 5, no. 2, pp. 122–139, Mar. 1983.
8. H. H. Baker and T.O. Binford, “Depth from edge and intensity based stereo,” in Proc. Seventh Int. Joint Conf. Artificial Intell, 1981, pp. 632–636.
9. J. Aloimonos and D. Shulman, Integration of Visual Modules. San Diego: Academic, 1989.
10. B. K. P. Horn, Robot Vision. New York, McGraw-Hill, 1986.
11. A. N. Netravali and J. Salz, “Algorithms for estimation of three-dimensional motion,” AT&T Tech. J., vol. 6, no. 2, 1985.
12. R. Y. Tsai and T. S. Huang, “Uniqueness and estimation of three-dimensional motion parameters of rigid objects with curved surfaces,” IEEE Trans. Patt. Anal. Machine Intell., vol. 6, no. 1, 13–26, 1984.
13. D. Terzopoulos and D. Metaxas, “Dynamic 3-D models with local and global deformations: Deformable superquadratics,” IEEE Trans. Patt. Anal. Machine Intell., vol. 13, no. 7, pp. 703–714, July 1991.
14. A. Pentland and B. Horowitz, “Recovery of nonrigid motion and structure,” IEEE Trans. Patt. Anal. Machine Intell., vol. 13, 7, pp. 730–742, July 1991.
15. M. Rydfalk, “CANDIDE, A parametrized face,” Internal Rep. LITH-ISY-I-0866, Linkoping Univ., 1987.
16. P. Ekman and W. Friesen, Facial Action Coding System. Palo Alto, CA: Consulting Psychologists, 1977.
17. P. Roivainen, “Motion estimation in model based coding of human faces,” Thesis 225, Linköping Univ., May 1990.
18. W. Welsh, “Model-based coding of images,” Ph.D. thesis, Univ. of Essex, Jan. 1991.
19. M. Buck and N. Diehl, “Segmentation and modeling of head and shoulder scenes,” in Proc. 3rd Int. Workshop 64 kb/s Coding Moving Video (Rotterdam), Sept. 1990.
20. K. Aizawa, H. Harashima, and T. Saito, “Model-based analysis synthesis coding for a person’s face,” Signal Processing: Image Commun., vol. 1, no. 2, pp. 139–152, Oct. 1989.
21. F. Kappei and C. -E. Liedtke, “Modeling of a natural 3-D scene consisting of moving objects from a sequence of monocular TV images,” Proc. SPIE, vol. 860, 126ff, 1987.
22. F. Kappei, “Modellierung und Rekonstruktion bewegter dreidimension-aler Objekte in einer Femsehbildfolge,” Ph.D. thesis, Univ. of Hannover, Nov. 1988.
23. H. Busch, “Ein Verfahren zur Oberflächenmodellierung dreidimension-aler Objekte aus Kamerabildfolgen,” Ph.D. thesis, Univ. of Hannover, 1991.
24. C. -E. Liedtke, H. Busch, and R. Koch, “Automatic modeling of 3-D moving objects from a TV image sequence,” in Proc. SPIE Conf. Sensing Reconstruction 3D-Objects Scenes (Santa Clara, CA), Feb. 1990, pp. 230–239, vol. 1260.
25. H. Busch, “Automatic modeling of rigid 3-D objects using an analysis by synthesis system,” in Proc. SPIE Conf. Visual Commun. Image Processing IV (Philadelphia, PA), 1989, pp. 356ff, vol. 1199.
26. R. Koch, “Automatic modeling of natural scenes for generating synthetic movies,” in Proc. Euro. Comput. Graphics Conf. Eurograph'90 (Montreux, Switzerland), Sept. 1990, pp. 215–224.
27. R. Koch and C. -E. Liedtke, “3D-modeling of natural scenes from image sequences for stereo scopic reconstruction,” in Proc. 2nd Workshop Stereoscopic Television (Darmstadt, Germany), Sept. 1990.
28. R. Koch, “Model-based 3D scene analysis from stereoscopic image sequences,” in Proc. Int. Soc. Photogram. Remote Sens., (Washington, DC), Aug. 1992.
29. R. Koch, “Adaptation of a 3D facial mask to human faces in videophone sequences using model based image analysis,” in Proc. Picture Coding Symp. (Tokyo, Japan), Sept. 1991, 285–288.
30. Y. Yakimovski and R. Cunningham, “A system for extracting 3D measurements from a stereo pair of TV cameras,” Comput. Graphics Image Processing, vol 7, pp. 195–210, 1978.
31. J. Ostermann, “Modeling of 3D moving objects for an analysis-synthesis coder,” in Proc. SPIE Conf. Sensing Reconstr. 3D-Objects Scenes (Santa Clara, CA), Feb. 1990, 240–249, vol. 1260.
32. T. Aach and A. Kaup, “Partitioning of stereoscopic sequences by evaluation of stereo disparity and temporal change detection,” in Proc. Picture Coding Symp. (Tokyo, Japan), Sept. 1991, pp. 443–446.
33. M. Hotter and R Thoma, “Image segmentation based on object oriented mapping parameter estimation,” Signal Processing, vol. 15, no. 3, pp. 315–334, Oct. 1988.
34. H. Busch, “Subdividing nonrigid 3D objects into quasi rigid parts,” in Proc. IEE 3rd Int. Conf. Image Processing Applications (Warwick, UK), July 1989, pp. 1–4.
35. J. Ostermann, “Detection and coding of model failures in an analysis-synthesis coder based on moving 3D objects,” in Proc. 3rd Int. Workshop 64 kb/s Coding Moving Video (Rotterdam), Sept. 1990.
36. R. Koch, “A hierarchical strategy for analyzing motion, shape, and color of three dimensional objects from an image sequence,” in Proc. 2nd Int. Workshop 64 Kb/s Coding Moving Video (Hannover), Oct. 1989.
37. J. Ostermann and H. Li, “Coding of color parameters in an analysis-synthesis coder based on moving 3D-objects,” in Proc. Picture Coding Symposium (Tokyo, Japan), Sept. 1991, pp. 315–318.