Spatial-random-access-enabled video coding for interactive virtual pan/tilt/zoom functionality

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 5, 2011, Pages 577-588

  Mavlankar, Aditya ^a,b   Girod, Bernd ^c  

^a STANFORD UNIVERSITY   (United States)

^b Tely Labs Inc   (United States)

^c Stanford University   (United States)

Author keywords

Interactive video streaming; pan tilt zoom; region of interest

Indexed keywords

BACKGROUND EXTRACTION; BIT STREAM; BIT-RATE REDUCTION; CODING EFFICIENCY; CODING SCHEME; H.264/AVC; HIGH RESOLUTION; HIGH SPATIAL RESOLUTION; INTERACTIVE VIDEO; LONG TERM MEMORY; MOTION-COMPENSATED PREDICTION; MULTI RESOLUTION REPRESENTATION; OPTIMALITY; PAN/TILT/ZOOM; RANDOM ACCESS; REGION-OF-INTEREST; REMOTE USERS; SPATIAL RESOLUTION; TEST CASE; TRANSMISSION BIT-RATE; VIDEO CODING; VIDEO CODING SCHEMES; VIDEO CONTENTS; VIDEO ENCODINGS;

ACOUSTIC STREAMING; ENCODING (SYMBOLS); MOTION PICTURE EXPERTS GROUP STANDARDS; VIDEO STREAMING; VIDEOTEX;

IMAGE CODING;

EID: 79955621197     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2129170     Document Type: Article

References (34)

1. C. Fehn, C. Weissig, I. Feldmann, M. Mueller, P. Eisert, P. Kauff, and H. Bloss, "Creation of high-resolution video panoramas of sport events," in Proc. 8th IEEE ISM, Dec. 2006, pp. 291-298.
2. J. Kopf, M. Uyttendaele, O. Deussen, and M. F. Cohen, "Capturing and viewing gigapixel images," in Proc. ACM SIGGRAPH, vol. 26, no. 3. Aug. 2007, pp. 93.1-93.10.
3. Hewlett-Packard. (2009, Sep. 16). Halo: Video Conferencing Product by Hewlett-Packard [Online]. Available: http://www.hp.com/halo/index. html
4. A. Smolic and D. McCutchen, "3DAV exploration of video-based rendering technology in MPEG," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 3, pp. 348-356, Mar. 2004.
5. Immersive Media. (2009, Sep. 16). Dodeca 2360: An Omni-Directional Video Camera Providing Over 100 Million Pixels per Second by Immersive Media [Online]. Available: http://www.immersivemedia.com
6. Video Clip Showcasing Interactive TV with Pan/Tilt/Zoom (2009, Sep. 26) [Online]. Available: http://www.youtube.com/watch?v= Ko9jcIjBXnk
7. H.-Y. Shum, S. B. Kang, and S.-C. Chan, "Survey of image-based representations and compression techniques," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 11, pp. 1020-1037, Nov. 2003.
8. M. Levoy and P. Hanrahan, "Light field rendering," in Proc. ACM SIGGRAPH, Aug. 1996, pp. 31-42.
9. P. Kauff and O. Schreer, "Virtual team user environments: A step from tele-cubicles toward distributed tele-collaboration in mediated workspaces," in Proc. IEEE ICME, vol. 2. Aug. 2002, pp. 9-12.
10. M. Tanimoto, "Overview of FTV (free-viewpoint television)," in Proc. ICME, Jul. 2009, pp. 1552-1553.
11. D. Taubman and R. Rosenbaum, "Rate-distortion optimized interactive browsing of JPEG2000 images," in Proc. IEEE ICIP, Sep. 2000, pp. 765-768.
12. D. Taubman and R. Prandolini, "Architecture, philosophy and performance of JPIP: Internet protocol standard for JPEG2000," Proc. SPIE Intl. Symp. VCIP, vol. 5150, no. 1, pp. 791-805, Jul. 2003.
13. P. Chou and Z. Miao, "Rate-distortion optimized streaming of packetized media," IEEE Trans. Multimedia, vol. 8, no. 2, pp. 390-404, Apr. 2006.
14. B. Girod, "The efficiency of motion-compensating prediction for hybrid coding of video sequences," IEEE J. Sel. Areas Commun., vol. 5, no. 7, pp. 1140-1154, Aug. 1987.
15. B. Girod, "Motion-compensating prediction with fractional-PEL accuracy," IEEE Trans. Commun., vol. 41, no. 4, pp. 604-612, Apr. 1993.
16. B. Girod, "Efficiency analysis of multihypothesis motion-compensated prediction for video coding," IEEE Trans. Image Process., vol. 9, no. 2, pp. 173-183, Feb. 2000. (Pubitemid 30557209)
17. S. Heymann, A. Smolic, K. Mueller, Y. Guo, J. Rurainsky, P. Eisert, and T. Wiegand, "Representation, coding and interactive rendering of high-resolution panoramic images and video using MPEG-4," in Proc. PPW, Feb. 2005.
18. P. Ramanathan and B. Girod, "Rate-distortion optimized streaming of compressed light fields with multiple representations," in Proc. 14th Packet Video Workshop, Dec. 2004.
19. P. Ramanathan and B. Girod, "Random access for compressed light fields using multiple representations," in Proc. IEEE 6th Int. Workshop MMSP, Sep. 2004, pp. 383-386.
20. M. Karczewicz and R. Kurceren, "The SP- and SI-frames design for H.264/AVC," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 637-644, Jul. 2003.
21. X. Zhu, A. Aaron, and B. Girod, "Distributed compression for large camera arrays," in Proc. IEEE Workshop Statist. Signal Process., Sep. 2003, pp. 30-33.
22. A. Aaron, P. Ramanathan, and B. Girod, "Wyner-Ziv coding of light fields for random access," in Proc. IEEE 6th Workshop MMSP, Sep. 2004, pp. 323-326. (Pubitemid 40197199)
23. I. Bauermann and E. Steinbach, "RDTC optimized compression of image-based scene representations (part I): Modeling and theoretical analysis," IEEE Trans. Image Process., vol. 17, no. 5, pp. 709-723, May 2008. (Pubitemid 351597162)
24. I. Bauermann and E. Steinbach, "RDTC optimized compression of image-based scene representations (part II): Practical coding," IEEE Trans. Image Process., vol. 17, no. 5, pp. 724-736, May 2008. (Pubitemid 351597163)
25. E. Kurutepe, M. R. Civanlar, and A. M. Tekalp, "Interactive transport of multi-view videos for 3DTV applications," J. Zhejiang Univ. Sci. A, vol. 7, no. 5, pp. 830-836, May 2006. (Pubitemid 43895686)
26. J. Bernstein, B. Girod, and X. Yuan, "Hierarchical encoding method and apparatus employing background references for efficiently communicating image sequences," U.S. Patent 5 155 594, Oct. 1992.
27. M. Massey and W. Bender, "Salient stills: Process and practice," IBM Syst. J., vol. 35, nos. 3-4, pp. 557-573, 1996. (Pubitemid 126593289)
28. D. Farin, P. de With, and W. Effelsberg, "Robust background estimation for complex video sequences," in Proc. IEEE ICIP, vol. 1. Sep. 2003, pp. 145-148.
29. T. Wiegand, X. Zhang, and B. Girod, "Long-term memory motion-compensated prediction," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 1, pp. 70-84, Feb. 1999.
30. D. Hepper, "Efficiency analysis and application of uncovered background prediction in a low bit rate image coder," IEEE Trans. Commun., vol. 38, no. 9, pp. 1578-1584, Sep. 1990.
31. A. Mavlankar, D. Varodayan, and B. Girod, "Region-of-interest prediction for interactively streaming regions of high resolution video," in Proc. IEEE 16th Packet Video Workshop, Nov. 2007, pp. 68-77.
32. A. Mavlankar and B. Girod, "Pre-fetching based on video analysis for interactive region-of-interest streaming of soccer sequences," in Proc. IEEE ICIP, Nov. 2009, pp. 3061-3064.
33. A. Mavlankar, J. Noh, P. Baccichet, and B. Girod, "Peer-to-peer multicast live video streaming with interactive virtual pan/tilt/zoom functionality," in Proc. IEEE ICIP, Oct. 2008, pp. 2296-2299.
34. A. Mavlankar, J. Noh, P. Baccichet, and B. Girod, "Optimal server bandwidth allocation for streaming multiple streams via P2P multicast," in Proc. IEEE 10th Workshop MMSP, Oct. 2008, pp. 468-473.