Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation

IEEE Transactions on Multimedia

Volumn 7, Issue 2, 2005, Pages 316-329

  Belfiore, Stefano ^a   Grangetto, Marco ^a   Magli, Enrico ^a   Olmo, Gabriella ^a  

^a POLITECNICO DI TORINO   (Italy)

Author keywords

Optical flow estimation; Packet based video transmission; Video error concealment; Whole frame losses; Wireless communications

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; IMAGE COMPRESSION; LOCAL AREA NETWORKS; MATHEMATICAL MODELS; PARAMETER ESTIMATION; VECTORS; WIRELESS TELECOMMUNICATION SYSTEMS;

OPTICAL FLOW ESTIMATION; PACKET-BASED VIDEO TRANSMISSION; VIDEO ERROR CONCEALMENT; WHOLE-FRAME LOSSES;

MULTIMEDIA SYSTEMS;

EID: 16244419040     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2005.843347     Document Type: Article

References (37)

1. B. P. Crow, I. Widjaja, J.-G. Kim, and P. T. Sakai, "IEEE 802.11 wireless local area networks," IEEE Commun. Mag., pp. 116-126, Sep. 1997.
2. Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications. ANSI/IEEE Std. 802.11-1999, IEEE-SA Standards Board.
3. Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications: Higher-Speed Physical Layer Extension in the 2.4 GHz Band. IEEE Std. 802.11b-1999, IEEE-SA Standards Board.
4. A. Majumdar, D. G. Sachs, I. V. Kosintsev, K. Ramchandran, and M. M. Yeung, "Multicast and unicast real-time video streaming over wireless LANs," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 6, pp. 524-534, Jun. 2002.
5. G. S. Yu, M. M. K. Liu, and M. W. Marcellin, "POCS-based error concealment for packet video using multiframe overlap information," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 4, pp. 422-434, Aug. 1998.
6. Z. Alkachouch and M. G. Bellanger, "DCT-based spatial domain interpolation of blocks in images," IEEE Trans. Image Process., vol. 9, no. 4, pp. 729-732, Apr. 2000.
7. L. Atzori, F. G. B. De Natale, and C. Perra, "A spatio-temporal concealment technique using boundary matching algorithm and mesh-based warping (BMA-MBW)," IEEE Trans. Multimedia, vol. 3, no. 3, pp. 326-338, Sep. 2001.
8. H. Li and C. W. Chen, "Robust image transmission with bidirectional synchronization and hierarchical error correction," IEEE Trans. Circuits Syst. Video Technol., vol. 11.no. 11, pp. 1183-1187, Nov. 2001.
9. S. Belfiore, L. Crisà, M. Grangetto, E. Magli, and G. Olmo, "Robust and edge-preserving video error concealment by eoarse-to-flne block replenishment," in Proc.ICASSP-IEEE Int. Conf. Acoustics, Speech, and Signal Processing, 2002.
10. May 2002. Joint Committee Draft (JCD), Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG.
11. J. Lu, "Signal processing for Internet video streaming: A review," Proc. SPIE, Image Video Commun. Process., 2000.
12. J. G. Apostolopoulos, "Error-resilient video compression through the use of multiple states," in Proc. of ICIP-IEEE Int. Conf. Image Processing, 2000.
13. L. Wai-Man and A. R. Reibman, "An error concealment algorithm for images subject to channel errors," IEEE Trans. Image Process., vol. 4, no. 5, pp. 533-542, May 1995.
14. H. Sun and W. Kwok, "Concealment of damaged block transform coded images using projections onto convex sets," IEEE Trans. Image Process., vol. 4, no. 4, pp. 470-477, Apr. 1995.
15. X. Li and M. T. Orchard, "Novel sequential error-concealment techniques using orientation adaptive interpolation," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 10, pp. 857-864, Oct. 2002.
16. L. Atzori and F. G. B. De Natale, "Error concealment in video transmission over packet network by a sketch-based approach," Signal Process.: Image Commun., vol. 15, no. 1-2, pp. 57-76, Sept. 1999.
17. P. Salama, N. B. Schroff, and E. J. Delp, "Error concealment in MPEG video streams over ATM networks," IEEE J. Select. Areas Commun., vol. 18, no. 6, pp. 1129-1144, Jun. 2000.
18. S. Shirani, F. Kossentini, and R. Ward, "A concealment method for video communications in an error-prone environment," IEEE J. Select. Areas Commun., vol. 18, no. 6, pp. 1122-1128, Jun. 2000.
19. S. Belfiore, M. Grangetto, E. Magli, and G. Olmo, "An edge and texture preserving algorithm for video error concealment," in Proc. MMSP-IEEE Int. Workshop on Multimedia Signal Processing, 2002.
20. D. S. Turaga and T. Chen, "Model-based error concealment for wireless video," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 6, pp. 483-495, Jun. 2002.
21. Y.-C. Lee, Y. Altunbasak, and R. M. Mersereau, "Multiframe error concealment for MPEG-coded video delivery over error-prone networks," IEEE Trans. Image Process., vol. 11.no. 11,pp. 1314-1331, Nov. 2002.
22. S. Belfiore, M. Grangetto, E. Magli, and G. Olmo, "Spatiotemporal error concealment with optimized mode selection and application to H.264," Signal Process.: Image Commun., pp. 907-923, Nov. 2003.
23. X. Wu, S. Cheng, and Z. Xiong, "On packetization of embedded multimedia bitstreams," IEEE Trans. Multimedia, vol. 3, no. 1, pp. 132-140, Mar. 2001.
24. "Common Test Conditions for RTP/IP over 3GPP/3GPP2-Software and Amendments," in VCEG (SG16/Q6), XIV Meeting, Santa Barbara, CA, Sep. 2001. ITU-T VCEG-M77.
25. S. Gnavi, M. Grangetto, E. Magli, and G. Olmo, "Comparison of rate allocation strategies for H.264 video transmission over wireless lossy correlated networks," in Proc. ICME-IEEE Int. Conf. Multimedia and Expo, 2003.
26. M. Kalman, E. Steinbach, and B. Girod, "R-D optimized media streaming enhanced with adaptive media playout," in Proc. ICME-IEEE Int. Conf. Multimedia and Expo, 2002.
27. A. M. Tekalp, Digital Video Processing. Englewood Cliffs, NJ: Prentice-Hall, 1995.
28. H. H. Nagel and W. Enkelmann, "An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences," IEEE Trans. Patt. Anal. Machine Intell., vol. 8, pp. 565-593, 1986.
29. B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artif. Intell., vol. 23, pp. 309-354, 1984.
30. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. DARPA Image Understanding Workshop, 1981, pp. 121-130.
31. S. Belfiore, M. Grangetto, E. Magli, and G. Olmo, "An error concealment algorithm for streaming video," in Proc. ICIP-IEEE Int. Conf. Image Processing, 2003.
32. R. R. Schultz and R. L. Stevenson, "Extraction of high-resolution frames from video sequences," IEEE Trans. Image Process., vol. 5, no. 6, pp. 996-1011, Jun. 1996.
33. I. Pitas and A. N. Venetsanopoulos, Nonlinear Digital Filters-Principles and Applications. Norwell, MA: Kluwer, 1990.
34. B. E. Carpenter and K. Nichols, "Differentiated services in the Internet," Proc. IEEE, vol. 90, no. 9, pp. 1479-1494, Sep. 2002.
35. T. Wiegand, N. Farber, K. Stuhlmuller, and B. Girod, "Error resilient video transmission using long-term memory motion-compensated prediction," IEEE J. Select. Areas Commun., vol. 18, no. 6, pp. 1050-1062, June 2000.
36. Z. He, J. Cai, and C. W. Chen, "Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 6, pp. 511-523, Jun. 2002.
37. T. S. Huang, G. Y. Yang, and G. Y. Tang, "A fast two dimensional median filtering algorithm," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-27,no. 1, pp. 13-18, Feb. 1979.