A survey of error-concealment schemes for real-time audio and video transmissions over the Internet

Proceedings - International Symposium on Multimedia Software Engineering

Volumn , Issue , 2000, Pages 17-24

  Wah, B W ^a   Su, Xiao ^a   Lin, Dong ^a  

^a University of Illinois at Urbana Champaign   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

IMAGE COMMUNICATION SYSTEMS; INTERNET; INTERNET PROTOCOLS; SOFTWARE ENGINEERING; VIDEO RECORDING;

BLACK BOXES; DROPPED PACKETS; ERROR CONCEALMENT; IP NETWORKS; LATE ARRIVAL; POSSIBLE FUTURES; REAL-TIME AUDIO;

IMAGE CODING;

EID: 84962120837     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MMSE.2000.897185     Document Type: Conference Paper

References (86)

1. S. Aign and K. Fazel. Temporal & spatial error concealment techniques for hierarchical MPEG-2 video codec. In Proc. Globecom'95, pages 1778-1783, 1995.
2. A. Albanese, J. Bloemer, and J. Edmonds. Priority encoding transmission. In Proc. Foundations of Computer Sciences, pages 604-612, Santa Fe, NM, 1994.
3. R. Aravind, M. R. Civanlar, and A. R. Reibman. Packet loss resilience of MPEG-2 scalable video coding algorithms. IEEE Trans. on Circuits and Systems for Video Technology, 6(5):426-435, Oct. 1996.
4. S. Atungsiri, A. Kondoz, and B. Evans. Error control for low-bit-rate speech communication systems. IEE Proc. I: Communications, Speech and Vision, 140(2):97-103, Apr. 1993.
5. S. Atungsiri, A. Kondoz, and B. Evans. Multi-rate coding: a strategy for error control in mobile communication systems. In 1993 IEE Colloquium on Low Bit-Rate Speech Coding for Future Applications, pages 3/1-3/4, 1993.
6. J. C. Batllo and V. A. Vaishampayan. Asymptotic performance of multiple description transform codes. IEEE Trans. on Information Theory, 43:703-707, Mar. 1997.
7. J. C. Bolot and A. V. Garcia. Control mechanisms for packet audio in the Internet. In Proc. of IEEE INFOCOM, pages 232-239, Apr. 1996.
8. J. C. Bolot and P. Hoschka. Adaptive error control for packet video in the Internet. In Int'l Conf. on Image Processing, volume 1, pages 25-28, Sept. 1996.
9. Y.-L. Chen and B.-S. Chen. Model-based multirate representation of speech signals and its application to recovery of missing speech packets. IEEE Trans. on Speech and audio processing, 5(3):220-231, May 1997.
10. Z. G. Chen. Coding and transmission of digital video on the Internet. PhD thesis, University of Illinois at Urbana-Champaign, 1997.
11. Z. G. Chen, S. M. Tan, R. H. Campbell, and Y. Li. Real time video and audio in the World Wide Web. World Wide Web Journal, 1, Jan. 1996.
12. A. Choi and A. Constantinides. Effects of packet loss on 3 toll quality speech coders. In IEE National Conf. on Telecommunications, 1989, pages 380-385, 1989.
13. K. Cluver and P. Noll. Reconstruction of missing speech frames using sub-band excitation. In Proc. IEEE-SP Int'l Symposium on Time-Frequency and Time-Scale Analysis, 1996, pages 277-280, June 1996.
14. G. Cote, B. Erol, M. Gallant, and F. Kossentini. H.263+: video coding at low bit rates. IEEE Trans. on Circuits and Systems for Video Technology, 8(7), Nov. 1998.
15. R. V. Cox, W. B. Kleijn, and P. Kroon. Robust CELP coders for noisy backgrounds and noisy channels. In 1989 IEEE Int'l Conf. on Acoustics, Speech and Signal Processing, volume 2, pages 739-742, May 1989.
16. J. M. Danskin, G. M. Davis, and X. Song. Fast lossy Internet image transmission. In ACM Multimedia Conf., San Francisco, Nov. 1995.
17. L. DaSilva, D. Petr, and V. Frost. A class-oriented replacement technique for lost speech packets. In Proc. of the Eighth Annual Joint Conf. of the IEEE Computer and Communications Societies. Technology: Emerging or Converging, INFOCOM '89, volume 3, pages 1098-1105, 1989.
18. B. J. Dempsey, J. Liebeherr, and A. C. Weaver. A new error control scheme for packetized voice over high-speed local area networks. In Proc. 18th Conf. on Local Computer Networks, 1993, pages 91-100, 1993.
19. B. J. Dempsey and Y. Zhang. Destination buffering for low-bandwidth audio transmission using redundancy-based error control. In Proc. of 21st IEEE Local Computer Networks Conf., pages 345-355, Oct. 1996.
20. N. Erdol, C. Castelluccia, and A. Zilouchian. Recovery of missing speech packets using the short-time energy and zero-crossing measurements. IEEE Trans. on Speech and Audio Processing, 1(3):295-303, July 1993.
21. W. Erhart and J. Gibson. A speech packet recovery technique using a model based tree search interpolator. In IEEE IEEE Workshop on Speech Coding for Telecommunications, 1993, pages 77-78, 1993.
22. T. J. Ferguson and J. H. Ranowitz. Self-synchronizing huffman codes. IEEE Trans. on Information Theory, IT-30:687-693, July 1984.
23. M. Ghanbari. Two-layer coding of video signals for VBR networks. IEEE journal on Selected Areas in Communications, 7:801-806, June 1989.
24. M. Ghanbari. Postprocessing of late cells for packet video. IEEE Trans. on Circuits and Systems for Video Technology, 6:669-678, Dec. 1996.
25. M. Ghanbari and V. Seferidis. Cell-loss concealment in ATM video codecs. IEEE Trans. on Circuits and Systems for Video Technology, 3:238-247, June 1993.
26. V. Hardman, M. A. Sasse, M. Handley, and A. Watson. Reliable audio for use over the Internet. In Int'l Networking Conf., pages 171-178, June 1995.
27. S. S. Hemami and T. H.-Y. Meng. Transform coded image reconstruction exploiting interblock correlation. IEEE Trans. on Image Processing, 4(7):1023-1027, July 1995.
28. A. Ingle and V. A. Vaishampayan. DPCM system design for diversity systems with applications to packetized speech. IEEE Trans. on Speech and Audio Processing, 3(1):48-58, Jan. 1995.
29. N. S. Jayant and S. W. Christensen. Effects of packet losses in waveform coded speech and improvements due to odd-even sample-interpolation procedure. IEEE Trans. on Communications, 29(2):101-110, Feb. 1981.
30. M. Kansari and M. Vetterli. Low bit rate video transmission over fading channels for wireless microcellular systems. IEEE Trans. on Circuits and Systems for Video Technology, 6:1-11, Feb. 1996.
31. T. Kawahara and S. Adachi. Video transmission technology with effective error protection and tough synchronization for wireless channels. In Proc. IEEE Int'l Conf. on Image Processing, pages 101-104, Nov. 1996.
32. M. Khansari and M. Vetterli. Layered transmission of signals over power-constrained wireless channels. In Proc. IEEE Int'l Conf. on Image Processing, pages 380-383, Oct. 1995.
33. L. H. Kieu and K. N. Ngan. Cell-loss concealment techniques for layered video codecs in an ATM network. IEEE Trans. on Image Processing, 3:666-677, Sept. 1994.
34. T. J. Kostas, M. S. Borella, I. Sidhu, G. M. Schuster, J. Grabiec, and J. Mahler. Real-time voice over packet-switched networks. IEEE Network, 12(1):18-27, January-February 1998.
35. W. Kwok and H. Sun. Multi-directional interpolation for spatial error concealment. IEEE Trans. on Consumer Electronics, 39(3):455-460, Aug. 1993.
36. W. M. Lam and A. R. Reibman. Self-synchronizing variable length codes for image transmission. In Proc. ICASSP'92, pages 477-480, Mar. 1992.
37. M. M. Lara-Barron and G. B. Lockhart. Packet-based embedded encoding for transmission of low-bit-rate-encoded speech in packet networks. IEE Proc.-I, 139(5):482-487, Oct. 1992.
38. S. H. Lee, P. J. Lee, and R. Ansari. Cell loss detection and recovery in variable rate video. In Proc. 3rd Int'l workshop on packet video, Mar. 1990.
39. S. M. Lei and M. T. Sun. An entropy coding system for digital HDTV applications. IEEE Trans. on Circuits and Systems for Video Technology, 1:147-154, Mar. 1991.
40. D. Lin. Real-Time Voice Transmissions over the Internet. M.Sc. Thesis, Dept. of Electrical and Computer Engineering, Univ. of Illinois, Urbana, IL, Dec. 1998.
41. G. B. Lockhart and M. M. Lara-Barron. Implementation of packet-based encoding schemes for speech transmission. In Sixth Int'l Conf. on Digital Processing of Signals in Communications, pages 326-330, 1991.
42. J. W. Modestino and D. G. Daut. Combined source-channel coding of images. IEEE Trans. on Communications, COM-7:1644-1659, Nov. 1979.
43. J. W. Modestino, D. G. Daut, and A. L. Vickers. Combined source-channel coding of images using the block cosine transform. IEEE Trans. on Communications, COM-29:1261-1273, Sept. 1981.
44. J. Nonnenmacher, E. W. Biersack, and D. Towsley. Parity-based loss recovery for reliable multicast transmission. IEEE/ACM Trans. on Networking, 6:349-361, Aug. 1998.
45. M. T. Orchard, Y. Wang, V. Vaishampayan, and A. R. Reibman. Redundancy rate-distortion analysis of multiple description coding using pairwise correlating transforms. In Proc. IEEE Int'l Conf. on Image Processing, pages 608-611, Oct. 1997.
46. V. Parthasarathy, J. W. Modestino, and K. S. Vastola. Design of a transport coding scheme for high quality video over ATM networks. IEEE Trans. on Circuits and Systems for Video Technology, 7(2):358-376, Apr. 1997.
47. E. J. Posnak, S. P. Gallindo, A. P. Stephens, and H. M. Vin. Techniques for resilient transmission of JPEG video streams. In Proc. of Multimedia Computing and Networking, pages 243-252, San Jose, February 1995.
48. K. Ramchandran, A. Ortega, and K. M. Uz. Multiresolution broadcast for digital HDTV using joint source channel coding. IEEE journal on Selected Areas in Communications, 11:6-23, Jan. 1993.
49. D. W. Redmill and N. G. Kingsbury. The EREC: an error resilient technique for coding variable-length blocks of data. IEEE Trans. on Image Processing, 5:565-574, Apr. 1996.
50. K. Saito, H. Fujiya, H. Kohmura, and S. Kanno. Voice packet communication system for private networks. In IEEE Global Telecommunications Conf., 1989, and Exhibition. Communications Technology for the 1990s and Beyond. GLOBECOM '89, volume 3, pages 1874-1878, 1989.
51. H. Sanneck. Concealment of lost speech packets using adaptive packetization. In IEEE Int'l Conf. on Multimedia Computing and Systems, 1998, pages 140-149, 1998.
52. S. D. Servetto, K. Ramchandran, V. A. Vaishampayan, and K. Nahrstedt. Multiple description wavelet based image coding. IEEE Trans. on Image Processing, 9:813-826, May 2000.
53. N. Shacham. Packet recovery and error correction in high-speed wide-area networks. In 1989 IEEE Military Communications Conf. volume 2, pages 551-557, Oct. 1989.
54. N. Shacham and P. McKenney. Packet recovery in high-speed networks using coding and buffer management. In Proc. of IEEE INFOCOM, pages 124-131, May 1990.
55. A. Shah, S. Atungsiri, A. Kondoz, and B. Evans. Lossy multiplexing of low bit rate speech in thin route telephony. Electronics Letters, 32(2):95-97, Jan. 1996.
56. H. C. Shyu and J. J. Leou. Detection and concealment of transmission errors in MPEG-2 images - a genetic algorithm approach. IEEE Trans. on Circuits and Systems for Video Technology, 9(6):937-948, Sept. 1999.
57. T. Sikora. The MPEG-4 video standard verification model. IEEE Trans. on Circuits and Systems for Video Technology, 7(1):19-31, Feb. 1997.
58. X. Su and B. W. Wah. Streaming video with optimized reconstruction-based DCT. In Proc. Int'l Conf. on Multimedia and Expo. IEEE, July-Aug. 2000.
59. J. Suh and Y. Ho. Error concealment based on directional interpolation. IEEE Trans. on Consumer Electronics, 43(3):295-302, Aug. 1997.
60. H. Sun and W. Kwok. Concealment of damaged block transform coded images using projections onto convex sets. IEEE Trans. on Image Processing, 4(4):470-477, Apr. 1995.
61. J. Suzuki and M. Taka. Missing packet recovery techniques for low-bit-rate coded speech. IEEE Journal on Selected Areas in Communications, 7(5):707-717, June 1989.
62. R. Swann and N. G. Kingsbury. Transcoding of MPEG-II for enhanced resilience to transmission errors. In Proc. IEEE Int'l Conf. on Image Processing, pages 813-816, Nov. 1996.
63. J. Tang. Evaluation of double sided periodic substitution (DSPS) method for recovering missing speech in packet voice communications. In Tenth Annual Int'l Phoenix Conf. on Computers and Communications, pages 454-458, Mar. 1991.
64. R. C. F. Tucker and J. E. Flood. Optimizing the performance of packet-switch speech. In IEEE Conf. on Digital Processing of Signals in Communications, No.62, Loughborough University, pages 227-234, Apr. 1985.
65. T. Turletti and C. Huitema. Videoconferencing on the Internet. IEEE/ACM Trans. on Networking, 4(3):340-351, June 1996.
66. C. J. Turner and L. L. Peterson. Image transfer and end-to-end design. In Proc. SIGCOMM'92, pages 258-268, 1992.
67. V. A. Vaishampayan. Design of multiple description scalar quantizer. IEEE Trans. on Information Theory, 39(3):821-834, May 1993.
68. V. A. Vaishampayan. Application of multiple description codes to image and video transmission over lossy networks. In Proc. 7th Int'l Workshop on Packet Video, pages 55-60, Mar. 1996.
69. V. A. Vaishampayan and J. Domaszewicz. Design of entropy constrained multiple description scalar quantizers. IEEE Trans. on Information Theory, 40:245-251, Jan. 1994.
70. V. A. Vaishampayan and N. Farvardin. Optimal block cosine transform image coding for noisy channels. IEEE Trans. on Communications, 38:327-336, Mar. 1990.
71. R. A. Valenzuela and C. N. Animalu. A new voice-packet reconstruction technique. In 1989 IEEE Int'l Conf. on Acoustics, Speech and Signal Processing, volume 2, pages 1334-1336, May 1989.
72. B. Wah and D. Lin. Real-time voice transmissions over the Internet. IEEE Trans. on Multimedia, 1(4):342-351, Dec. 1999.
73. B. W. Wah and D. Lin. Transformation-based reconstruction for audio transmissions over the Internet. In Proc. 17th IEEE Symposium on Reliable Distributed Systems, Oct. 1998.
74. B. W. Wah and X. Su. Streaming video with transformation-based error concealment and reconstruction. In Proc. Int'l Conf. on Multimedia Computing and Systems, volume 1, pages 238-243. IEEE, June 1999.
75. Y. Wang, M. T. Orchard, and A. R. Reibman. Multiple description image coding for noisy channels by pairing transform coefficients. In Proc. IEEE First Workshop Multimedia Signal Processing, pages 419-424, June 1997.
76. Y. Wang and Q. Zhu. Error control and concealment for video communications: a review. Proc. of the IEEE, 86(5):974-997, May 1998.
77. Y. Wang, Q. Zhu, and L. Shaw. Maximally smooth image recovery in transform coding. IEEE Trans. on Communications, 41(10):1544-1551, Oct. 1993.
78. O. J. Wasem, D. J. Goodman, C. A. Dvordak, and H. G. Page. The effect of waveform substitution on the quality of PCM packet communications. IEEE Trans. on Acoutics, Speech, and Signal Processing, 36(3):342-348, Mar. 1988.
79. S. Wenger, G. Knorr, J. Ott, and F. Kossentini. Error resilience support in H.263+. IEEE Trans. on Circuits and Systems for Video Technology, 8(7):867-877, Nov. 1998.
80. M. Yong. Study of voice packet reconstruction methods applied to CELP speech coding. In 1992 IEEE Int'l Conf. on Acoustics, Speech and Signal Processing, volume 2, pages 125-128, Mar. 1992.
81. G. Yu, M. M. Liu, and M. W. Marcellin. POCS-based error concealment for packet video using multiframe overlap information. IEEE Trans. on Circuits and Systems for Video Technology, 8(4):422-434, Aug. 1998.
82. M. Yuito and N. Matsuo. A new sample-interpolation method for recovering missing speech samples in packet voice communications. In 1989 IEEE Int'l Conf. on Acoustics, Speech and Signal Processing, volume 1, pages 381-384, May 1989.
83. W. Zeng and B. Liu. Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding. IEEE Trans. on Circuits and Systems for Video Technology, 9(4):648-665, June 1999.
84. Y. Q. Zhang, Y. J. Liu, and R. L. Pickholtz. Layered image transmission over cellular radio channels. IEEE Trans. on Vehicular Technology, 43:786-796, Aug. 1994.
85. Q. Zhu, Y. Wang, and L. Shaw. Coding and cell-loss recovery in DCT-based packet video. IEEE Trans. on Circuits and Systems for Video Technology, 3(3):248-258, June 1993.
86. W. Zhu, Y. Wang, and Q. Zhu. Second-order derivative-based smoothness measure for error concealment in DCT-based codecs. IEEE Trans. on Circuits and Systems for Video Technology, 8(6):713-718, Oct. 1998.