MPEG-4: Audio/video and synthetic graphics/audio for mixed media

Signal Processing: Image Communication

Volumn 9, Issue 4, 1997, Pages 433-463

  Doenges, Peter K ^a   Capin, Tolga K ^b   Lavagetto, Fabio ^c,f   Ostermann, Joern ^d   Pandzic, Igor S ^e   Petajan, Eric D ^f,g  

^a Evans and Sutherland Computer Corporation   (United States)

^b EPFL   (Switzerland)

^c UNIVERSITY OF GENOA   (Italy)

^d AT AND T LABS RESEARCH   (United States)

^e UNIVERSITY OF GENEVA   (Switzerland)

^f LUCENT TECHNOLOGIES   (United States)

^g Multimedia Communications Research   (United States)

Author keywords

2D 3D graphics; Facial avatar animation; Geometry texture compression; Natural synthetic hybrid coding; Real time communications; Scalable multimedia; Structured synthetic audio; Text to speech synthesis; Text graphics integration; Virtual environments

Indexed keywords

ANIMATION; IMAGE CODING; IMAGE COMPRESSION; IMAGE SEGMENTATION; MULTIPLEXING; REAL TIME SYSTEMS; SPEECH SYNTHESIS; STANDARDIZATION; SYNCHRONIZATION; THREE DIMENSIONAL COMPUTER GRAPHICS; VIRTUAL REALITY;

GEOMETRY/TEXTURE COMPRESSION; MOTION PICTURE EXPERTS GROUP (MPEG); SYNTHETIC/NATURAL HYBRID CODING (SNHC); TEXT/GRAPHICS INTEGRATION;

INTERACTIVE COMPUTER SYSTEMS;

EID: 0031140089     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0923-5965(97)00007-6     Document Type: Article

References (41)

1. N.I. Badler, C.B. Phillips and B.L. Webber, Simulating Humans: Computer Graphics Animation and Control, Oxford University Press, Oxford, 1993.
2. J.W. Barrus, R.C. Waters and D.B. Anderson, "Locales and beacons: Efficient and precise support for large multiuser virtual environments", Proc. IEEE VRAIS, 1996.
3. F. Bossen, "Geometry compression", Contribution No. MPEG96/M1236, Chicago MPEG Meeting of ISO/IEC JTC1/SC29/WG11, October 1996.
4. R. Boulic, T. Capin, Z. Huang, P. Kalra, B. Lintermann, N. Magnenat-Thalmann, L. Moccozet, T. Molet, I. Pandzic, K. Saar, A. Schmitt, J. Shen and D. Thalmann, "The humanoid environment for interactive animation of multiple deformable human characters", Proc. Eurographics'95, 1995.
5. C. Carlsson and O. Hagsand, "DIVE - A multi-user virtual reality system", Proc. IEEE VRAIS'93, Seattle, Washington, 1993.
6. S.E. Chen, "QuickTime VR - An image-based approach to virtual environment navigation", ACM Computer Graphics Proc., Sigyraph'95, Los Angeles, August 1995, pp. 29-38.
7. M.M. Cohen and D.W. Massaro, "Modeling coarticulation in synthetic visual speech", in: Models and Techniques in Computer Animation, Springer, Berlin, 1993.
8. M. Deering, "Geometry compression", ACM Computer Graphics Proc., Siggraph'95, Los Angeles, August 1995, pp. 13-20.
9. A. Finkelstein, C. Jacobs and D. Salesin, "Multi-resolution video", ACM Computer Graphics Proc., Siggraph'96, New Orleans, August 1996, pp. 281-290.
10. T.A. Funkhouser, "Network topologies for scalable multiuser virtual environments", Proc. VRAIS'96, 1996.
11. A. Goldschen, Continuous automatic speech recognition by lipreading, Ph.D. Thesis, George Washington University, 1993.
12. A. Goldschen, O. Garcia and E. Petajan, "Continuous optical automatic speech recognition", Proc. 28th Asilomar Conf. on Signals, Systems, and Computers, IEEE, New York, 1994, pp. 572-577.
13. H. Hoppe, "Progressive meshes", ACM Computer Graphics Proc., Siygraph'96, New Orleans, August 1996, pp. 99-108.
14. P. Kalra, A. Mangili, N. Magnenat-Thalmann and D. Thalmann, "Simulation of facial muscle actions based on rational free form deformations", Proc. Eurographics'92, 1992, pp. 59-69.
15. F. Lavagetto, D. Arzarello and M. Caranzano, "Lip-readable frame animation driven by speech parameters", IEEE Internat. Symp. on Speech, Image Processing and Neural Networks, Hong Kong, 14-16 April 1994.
16. M.R. Macedonia, M.J. Zyda, D.R. Pratt, P.T. Barham and Zestwitz, "NPSNET: A network software architecture for large-scale virtual environments", Presence: Teleoperators Virtual Environments, Vol. 3, No. 4, 1994.
17. L. McMillan and G. Bishop, "Plenoptic modeling: An image-based rendering system", ACM Computer Graphics Proc., Siggraph'95, Los Angeles, August 1995, pp. 39-46.
18. MPEG-4 SNHC Group, "Draft specification of SNHC verification model 1.0", Doc. No. MPEG96/N1364, Chicago MPEG Meeting of ISO/IEC JTC1/SC29/WG11, October 1996.
19. MPEG-4 SNHC Working Group on Face/Body Animation, "Face and body definition and animation parameters", Doc. No. MPEG96/N1365, Chicago MPEG Meeting of ISO/IEC JTC1/SC29/WG11, October 1996.
20. MPEG-4 SNHC Group, "SNHC verification model 3.0", Doc. No. MPEG97/N1455, February 1997 Sevilla MPEG Meeting of ISO/IEC JTC1/SC29/WG11.
21. MPEG-4 SNHC Working Group on Face/Body Animation, "Core experiment on FAP/BAP definition & Compression Evaluation", Doc. No. MPEG97/W1552, February 1997 Sevilla MPEG Meeting of ISO/IEC JTC1/SC29/WG11.
22. MPEG-4 SNHC Working Group on Media Integration of Text and Graphics, "Core experiments on media integration of text and graphics", Doc. No. MPEG97/N1553, February 1997 Sevilla MPEG Meeting of ISO/IEC JTC1/SC29/WG11.
23. MPEG-4 SNHC Working Group on SNHC structured Audio, "Core experiments on structured audio", Doc. No. MPEG97/N1609, February 1997 Sevilla MPEG Meeting of ISO/IEC JTC1/SC29/WG11.
24. MPEG-4 SNHC Working Group on Generic SNHC Object Coding, "Core experiments on Generic SNHC Object Coding", Doc. No. MPEG97/N1555, February 1997 Sevilla MPEG Meeting of ISO/IEC JTC1/SC29/WG11.
25. J. Ohya, Y. Kitamura, F. Kishino and N. Terashima, "Virtual space teleconferencing: Real-time reproduction of 3D Human images", J. Visual Commun. Image Representation, Vol. 6, No. 1, 1995, pp. 1-25.
26. J. Ostermann, "An interface for the animation of human heads from text", Contribution No. MPEG96/M1197, Chicago MPEG Meeting of ISO/IEC JTC1/SC29/WG11, October 1996.
27. F.I. Parke, A parametric model for human faces, Ph.D. Thesis, University of Utah, 1974.
28. F.I. Parke, "A model for human faces that allows speech synchronized animation", J. Comput. Graphics, 1975.
29. F.I. Parke, "A parameterized model for facial animation", IEEE Comput. Graphics Applications, 1982.
30. E.D. Petajan, "Automatic lipreading to enhance speech recognition", Proc. Globecom Telecommunications Conf., IEEE, 1984, pp. 265-272.
31. E.D. Petajan, "Automatic lipreading to enhance speech recognition", Proc. IEEE Conf. on Computer Vision and Pattern Recognition, IEEE, 1985, pp. 40-47.
32. E.D. Petajan, N.M. Brooke, G.J. Bischoff and D.A. Bodoff, "An improved automatic lipreading system to enhance speech recognition", "Proc. Human Factors in Computing Systems", ACM, New York, 1988, pp. 19-25.
33. B. Pinkowski, "LPC spectral moments for clustering acoustic transients", IEEE Trans. Speech Audio Process., Vol. 1, No. 3, 1993, pp. 362-368.
34. J. Shade, D. Lischinski, D. Salesin, T. DeRose and J. Snyder, "Hierarchical image caching for accelerated walkthroughs of complex environments", ACM Computer Graphics Proc., Siggraph'96, New Orleans, August 1996, pp. 75-90.
35. G. Singh, L. Serra, W. Png, A. Wong and H. Ng, "Brick-Net: Sharing object behaviors on the net", Proc. IEEE VR AIS'95, 1995.
36. G. Taubin and J. Rossignac, "Geometric compression through topological surgery", Research Report, IBM Research, RC-20340(# 89924), January 1996, 22 pages.
37. D. Thalmann, T.K. Capin, N. Magnenat-Thalmann and I.S. Pandzic, "Participant, user-guided, autonomous actors in the virtual life network VLNET", Proc. ICAT/VRST '95, 1995, pp. 3-11.
38. J. Torborg and J. Kajiya, "Talisman: Commodity real-time 3D graphics for the PC", ACM Computer Graphics Proc., Siggraph'96, New Orleans, August 1996, pp. 353-363.
39. L. Williams, "Pyramidal parametrics", ACM Computer Graphics Proc., Siggraph'83, July 1983, pp. 1-11.
40. B.P. Yuhas, M.H. Goldstein Jr. and T.J. Sejnowski, "Integration of acoustic and visual speech signal using neural networks", IEEE Commun. Mag., 1989, pp. 65-71.
41. MPEG-4 SNHC Working Group on TTS, "Core Experiment on TTS", Doc. No. MPEG97/W1554, February 1997 Sevilla MPEG Meeting of ISO/IEC JTC1/ SC29/WG11.