Video representation with three-dimensional entities

IEEE Journal on Selected Areas in Communications

Volumn 16, Issue 1, 1998, Pages 71-85

  Martins, Fernando C M ^a   Moura, José M F ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

3 D object modeling; Content based video handling; Model based video coding; Range and image sequence processing; Video sequence representation

Indexed keywords

COMPUTER SIMULATION; DATA HANDLING; IMAGE COMPRESSION; IMAGE RECONSTRUCTION; IMAGE SEGMENTATION; MATHEMATICAL MODELS; OBJECT RECOGNITION; RANDOM PROCESSES; THREE DIMENSIONAL; VIDEO SIGNAL PROCESSING;

TRIDIMENSIONAL VIDEO COMPOSITING; VIDEO HANDLING; VIDEO REPRESENTATION;

IMAGE CODING;

EID: 0031695730     PISSN: 07338716     EISSN: None     Source Type: Journal    
DOI: 10.1109/49.650921     Document Type: Article

References (51)

1. R. Forchheimer, O. Fahlander, and T. Kronander, "A semantic approach to the transmission of face images," in Picture Coding Symp. (PCS'84), Cesson-Sevigne, France, July 1984.
2. K. Aizawa, H. Harashima, and T. Saito, "Model-based analysis-synthesis image coding (MBASIC) system for a person's face," Signal Processing: Image Commun., vol. 1, pp. 139-152, Oct. 1989.
3. H. G. Musmann, M. Hotter, and J. Ostermann, "Object-oriented analysis-synthesis coding of moving images," Signal Processing: Image Commun., vol. 1, pp. 112-138, Oct. 1989.
4. J. Ostermann, "Object-based analysis-synthesis coding based on the source model of moving rigid 3D objects," Signal Processing: Image Commun., vol. 6, no. 2, pp. 143-161, 1994.
5. J. Y. A. Wang, E. H. Adelson, and U. Desai, "Applying mid-level vision techniques for video data compression and manipulation," Vision and Modeling Group, MIT Media Lab., Tech. Rep. 263, May 1994.
6. R. S. Jasinschi, J. M. F. Moura, J. Cheng, and A. Asif, "Video compression via constructs," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, vol. 4, Detroit, MI, May 1995.
7. J. M. F. Moura, R. S. Jasinschi, H. Shiojiri, and J.-C. Lin, "Video over wireless," IEEE Personal Commun., vol. 6, pp. 6-16, Feb. 1996.
8. M. Kaneko, A. Koike, and Y. Hatori, "Coding of a facial image sequence based on a 3D model of the head and motion detection," J. Visual Commun. Image Representation, vol. 2, Mar. 1991.
9. V. M. Bove Jr., "Object-oriented television," SMPTE J., Dec. 1995.
10. D. V. Papadimitriou and T. J. Dennis, "Stereo in model-based image coding," in Picture Coding Seminar, 1994, pp. 296-299.
11. T. Naemura, M. Kaneko, and H. Harashima, "3-D object-based coding of multi-view images," in Picture Coding Seminar, 1996, pp. 459-464.
12. K. Aizawa, C. S. Choi, H. Harashima, and T. S. Huang, "Human facial motion analysis and synthesis with application to model-based coding," in Motion Analysis and Image Sequence Processing, M. I. Sezan and R. L. Lagendijk, Eds. Boston: Kluwer, 1993, ch. 11.
13. H. Li, A. Lundmark, and R. Forchheimer, "Image sequence coding at very low bitrates: A review," IEEE Trans. Image Processing, vol. 3, pp. 589-609, Sept. 1994.
14. P. Anandan, M. Irani, R. Kumar, and J. Bergen, "Video as an image data source: Efficient representations and applications," in Proc. IEEE Int. Conf. Image Processing (ICIP'95), Washington, DC, Oct. 1995.
15. M. Potmesil, thesis, R. P. I., Troy, NY; also, Tech. Rep. RPI IPL TR-033, 1982.
16. B. C. Vemuri and J. K. Agarwal, "3D model construction from multiple views using range and intensity data," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognition, IEEE Computer Society, 1986, pp. 435-437.
17. B. Bhanu, "Representation and shape matching of 3-D objects," IEEE Trans. Pattern Anal. Machine Intell., vol. 6, pp. 340-351, 1984.
18. N. Ahuja and J. Veenstra, "Generating octrees from object silhouettes in orthographic views," IEEE Trans. Pattern Anal. Machine Intell., vol. 11, no. 2, 1989.
19. C. Tomasi and T. Kanade, "Shape and motion from image streams under orthography: A factorization method," Int. J. Comput. Vision, vol. 9, no. 2, pp. 137-154, 1992.
20. A. J. Azerbayejani, T. Galyean, B. Horowitz, and A. Pentland, "Recursive estimation CAD model recovery," Perceptual Computing, MIT Media Lab., Tech. Rep. 242 Feb. 1994.
21. S. Becker and M. Bove, "Semiautomatic 3-D model extraction from uncalibrated 2-D camera views," in Proc. SPIE - Visual Data Exploration and Analysis II, San Jose, CA, Feb. 1995.
22. R. Koch, "Automatic reconstruction of buildings from stereoscopic image sequences," EUROGRAPHICS, vol. 12, no. 3, pp. 339-350, 1993.
23. _, "3-D surface reconstruction from stereoscopic image sequences," in Proc. IEEE Int. Cont. Comput. Vision, Cambridge, MA, June 1995.
24. G. Turk and M. Levoy, "Zippered polygon meshes from range images," in Proc. SIGGRAPH 21st Annu. Int. Conf. Comput. Graphics Interactive Techniques (SIGGRAPH'94), July 1994, pp. 311-318.
25. B. Curless and M. Levoy, "A volumetric method for building complex models from range images," in Proc. SIGGRAPH 23rd Annu. Int. Conf. Comput. Graphics Interactive Techniques (SIGGRAPH'96), ACM, Aug. 1996.
26. A. Kaufman, Volume Visualization. Los Alamitos, CA: IEEE Computer Society Press, 1991.
27. V. M. Bove, Jr., "Probabilistic method for integrating multiple sources of range data," J. Opt. Soc. Amer. A. vol. 7. Dec. 1990.
28. A. Elfes, "Occupancy grids: A stochastic spatial representation for active robot perception," in Proc. 6th Conf. Uncertainty and Al, Cambridge, MA, AAAI, July 1990.
29. F. C. M. Martins and J. M. F. Moura, "3-D video compositing: Toward a compact representation for video sequences," in Proc. IEEE Int. Conf. Image Processing (ICIP'95), Washington, DC, Oct. 1995.
30. J. Costeira and T. Kanade, "A multi-body factorization method for motion analysis," in Proc. IEEE Int. Conf. Comput. Vision, Cambridge, MA, June 1995.
31. T. Kanade, H. Kano, S. Kimura, and K. Oda, "Development of a video-rate stereo machine," in Proc. 1995 IEEE/RSJ Int. Conf. Intell. Robots and Syst., Pittsburgh, PA, Aug. 1995.
32. M. Watanabe, S. K. Nayar, and M. Noguchi, "Real-time computation of depth from defocus," in Three-Dimensional and Unconventional Imaging for Industrial Inspection and Metrology, Philadelphia, PA, SPIE, Oct. 1995.
33. P. Lacroute and M. Levoy, "Fast volume rendering using a shearwarp factorization of the viweing transformation," in Proc. SIGGRAPH 21st Annu. Int. Conf. Comput. Graphics Interactive Techniques (SIGGRAPH'94), July 1994, pp. 451-458.
34. F. Solina and R. Bajcsy, "Recovery of parametric models from range images: The case for superquadrics with global deformations," IEEE Trans. Pattern Anal. Machine Untell., vol. 12, pp. 131-147, Feb. 1990.
35. H. Hoppe, T. DeRose, T. Duchamp, J. McDonald, and W. Stuetzle, "Surface reconstruction from unorganized points," in Proc. SIGGRAPH 19th Annu. Int. Conf. Comput. Graphics Interactive Techniques (SIGGRAPH'92), 1992, pp. 71-77.
36. M. Soucy and D. Laurendeau, "A general surface approach to the integration of a set of range views," IEEE Trans. Pattern Anal. Machine Intell., vol. 17, pp. 344-358, Apr. 1995.
37. B. K. P. Horn, "Closed form solution of absolute orientations using unit quaternions," J. Opt. Soc. Amer., vol. 4, pp. 629-642, Apr. 1987.
38. O. D. Faugeras and M. Hebert, "The representation, recognition, and locating of 3D objects," Int. J. Robotic Res., vol. 5, pp. 27-52, Fall 1986.
39. P. J. Besl and H. D. McKay, "A method for registration of 3-D shapes," IEEE Trans. Pattern Anal. Machine Intell., vol. 14, pp. 239-56, Feb. 1992.
40. Y. Chen and G. Medioni, "Object modeling by registration of multiple range images," Image and Vision Computing (UK), vol. 10, pp. 145-55, Apr. 1992.
41. G. Champleboux, S. Lavallee, R. Szeliski, and L. Brunie, "From accurate range imaging sensor callibration to accurate model-based 3D object localization," in Proc. CVPR: Comput. Soc. Conf. Comput. Vision Pattern Recognition, IEEE Computer Society, 1986, pp. 435-437.
42. Z. Zhang, "Iterative point matching for registration of free-form curves and surfaces," Int. J. Comput. Vision, vol. 13, pp. 119-152, Oct. 1994.
43. D. Simon, M. Hebert, and T. Kanade, "Real time 3D pose estimation using a high-speed range sensor," Robotics Inst., Carnegie Mellon Univ., Tech. Rep. CMU-RI-TR-93-24, Nov. 1993.
44. J. Feldmar, N. Ayache, and F. Betting, "3D-2D projective registration of free-form curves and surfaces," in Proc. IEEE Int. Conf. Comput. Vision, Cambridge, MA, June 1995.
45. B. Sabata and J. K. Aggarwal, "Estimation of motion from a pair of range images: A review," CVGIP: Image Understanding, vol. 54, pp. 309-324, Nov. 1991.
46. L. G. Brown, "A survey of image registration techniques," Comput. Surveys, vol. 24, pp. 325-376, Dec. 1992.
47. F. C. M. Martins, H. Shiojiri, and J. M. F. Moura, "3-D 3-D Registration of free formed objects using shape and texture," in Conf. Visual Commun. Image Processing (VCIP'97), San Jose, CA, Feb. 1997, SPIE, 12 pp., to be published.
48. H. Van Trees, Detection, Estimation, and Modulation Theory - Vol. 1. New York: Wiley, 1968.
49. A. Watt and M. Watt, Advanced Animation and Rendering Techniques. Reading, MA: Addison-Wesley, 1992.
50. C. E. Kolb, Rayshade User's Guide und Reference Manual, Princeton Univ., Jan. 1992.
51. Y. Sato and K. Ikeuchi, "Reflectance analysis for 3D computer graphics model generation," Dept. Comput. Sci., Carnegie Mellon Univ., Tech. Rep. CS-95-146, June 1995.