Delay-distortion optimization for content-adaptive video streaming

IEEE Transactions on Multimedia

Volumn 9, Issue 4, 2007, Pages 826-835

  Ozcelebi, Tanir ^a,b,c   Tekalp, A Murat ^a,b   Civanlar, M Reha ^a,b,d  

^a IEEE   (Netherlands)

^b KOÇ UNIVERSITY   (Turkey)

^c EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

^d DOCOMO USA LABS   (United States)

Author keywords

Content adaptive video coding; GoP rate allocation; Pre roll delay; Semantic relevance; Video streaming

Indexed keywords

CONTENT ADAPTIVE VIDEO CODING; GOP RATE ALLOCATION; PRE-ROLL DELAY; SEMANTIC RELEVANCE;

IMAGE CODING; IMAGE COMMUNICATION SYSTEMS; OPTIMIZATION; SIGNAL DISTORTION; TIME DELAY; VIDEO ON DEMAND;

VIDEO STREAMING;

EID: 34249289753     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2007.895670     Document Type: Article

References (30)

1. S. F. Chang, D. Zhong, and R. Kumar, "Real-time content-based adaptive streaming of sports video," in IEEE Workshop on Content-Based Access to Video/Image Library, Hawaii, Dec. 2001, pp. 139-146, (also U.S. Patent Application 20040125877).
2. P. van Beek, J. R. Smith, T. Ebrahimi, T. Suzuki, and J. Askelof, "Meta-data-driven multimedia access," IEEE Signal Process. Mag., vol. 20, no. 2, pp. 40-52, Mar. 2003.
3. IEEE Signal Process. Mag., vol. 20, no. 2, Mar. 2003.
4. R. Mohan, J. R. Smith, and S. Chung, "Adapting multimedia Internet content for universal access," IEEE Trans. Multimedia, vol. 1, no. 1, pp. 104-114, Mar. 1999.
5. M. Bertini, A. Del Bimbo, R. Cucchiara, and A. Prati, "Semantic video adaptation based on automatic annotation of sport videos," in Proc. 6th ACM SIGMM Int. Workshop on Multimedia Information Retrieval (MIR), New York, Oct. 15-16, 2004, pp. 291-298.
6. P. Pahalawatta, Z. Li, F. Zhai, and A. K. Katsaggelos, "Rate-distortion optimized video summary generation and transmission over packet lossy networks," in Proc. SPIE Image/Video Comm., San Jose, CA, Jan. 2005.
7. L. Zhao and C.-C. J. Kuo, "Buffer-constrained R-D optimized rate control for video coding," in IEEE Int. Conf. Acoustic, Speech, Signal Processing, Hong Kong, Apr. 6-10, 2003, pp. III_89-III_92.
8. S. Ma, W. Gao, F. Wu, and Y. Lu, "Rate control for JVT video coding scheme with HRD considerations," in Proc. IEEE ICIP 2003, Sep. 2003, vol. 3, pp. III_793-III_796.
9. Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification, ITU-T Rec.H.264|ISO/IEC 14496-10 AVC, May 27, 2003, T. Wiegand, G. Sullivan, and A. Luthra.
10. T. Wiegand, H. Schwarz, A. Joch, F. Kossentini, and G. J. Sullivan, "Rate-constrained coder control and comparison of video coding standards," IEEE Trans. Circuits, Syst., Video Technol., vol. 13, no. 7, pp. 688-703, Jul. 2003.
11. E. Steinbach, N. Farber, and B. Girod, "Adaptive playout for low-latency video streaming," in Proc. IEEE Int. Conf. on Image Processing (ICIP), Thessaloniki, Greece, Oct. 2001, vol. 1, pp. 962-965.
12. M. Kalman, E. Steinbach, and B. Girod, "R-D optimized media streaming enhanced with adaptive media playout," in Proc. IEEE Int. Conf. Multimedia and Expo (ICME), Lausanne, Switzerland, Aug. 2002, vol. 1, pp. 869-872.
13. G. J. Sullivan and T. Wiegand, "Rate-distortion optimization for video compression," IEEE Signal Process. Mag., vol. 15, no. 6, pp. 74-90, Nov. 1998.
14. D. Yow, B.-L. Yeo, M. Yeung, and B. Liu, "Analysis and presentation of soccer highlights from digital video," in Proc. Asian Conf. Computer Vision (ACCV), 1995.
15. A. Ekin, A. M. Tekalp, and R. Mehrotra, "Automatic soccer video analysis and summarization," IEEE Trans. Image Processing, vol. 12, no. 7, pp. 796-807, Jun. 2003.
16. M. G. Brown, J. T. Foote, G. J. F. Jones, K. S. Jones, and S. J. Young, "Automatic content-based retrieval of broadcast news," in Proc. 3rd Int. Conf. on Multimedia (ACM Multimedia 95), New York, 1995, pp. 35-43.
17. V. Tovinkere and R. J. Qian, "Detecting semantic events in soccer games: Toward a complete solution," in Proc. IEEE Int. Conf. Multimedia and Expo (ICME), Aug. 2001.
18. M. Bertini, A. Del Bimbo, A. Prati, and R. Cucchiara, "Semantic annotation and transcoding for sport videos," in Proc. Int. Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2004), Lisboa, Portugal, Apr. 21-23, 2004.
19. J.-W. Lee, A. Vetro, Y. Wang, and Y.-S. Ho, "Bit allocation for MPEG-4 video coding with spatio-temporal tradeoffs," IEEE Trans. Circuits, Syst., Video Technol., vol. 13, no. 6, pp. 488-502, Jun. 2003.
20. S. Liu and C.-C. J. Kuo, "Joint temporal-spatial bit allocation for video coding with dependency," IEEE Trans. Circuits, Syst., Video Technol., vol. 15, no. 1, pp. 15-26, Jan. 2005.
21. S. Winkler, A. Sharma, and D. McNally, "Video quality and blockiness metrics for multimedia streaming applications," in Proc. Int. Symp. Wireless Personal Multimedia Comm., Aalborg, Denmark, Sep. 12, 2001, pp. 547-552.
22. C. J. van den B. Lambrecht and O. Verscheure, "Perceptual quality measure using a spatio-temporal model of the human visual system," Proceedings of the SPIE, vol. 2668, pp. 450-461, 1996.
23. S. A. Karunasekera and N. G. Kingsbury, "A distortion measure for blocking artifacts in images based on human visual sensitivity," IEEE Trans. Image Processing, vol. 4, pp. 713-724, 1995.
24. M. Miyahara, K. Kotani, and V. R. Algazi, "Objective picture quality scale (PQS) for image coding," IEEE Trans. Commun., vol. 46, pp. 1215-1226, Sep. 1998.
25. F. Pan, X. Lin, S. Rahadja, W. Lin, E. Ong, S. Yao, Z. Lu, and X. Yang, "A locally adaptive algorithm for measuring blocking artifacts in images and videos," Signal Process.: Image Commun., vol. 19, no. 6, pp. 499-506, Jul. 2004.
26. Y. Wang, Z. Liu, and J. Huang, "Multimedia content analysis using both audio and visual clues," IEEE Signal Process. Mag., vol. 17, pp. 12-36, Nov. 2000.
27. T. Zhang and J. Kuo, "Audio content analysis for online audiovisual data segmentation and classification," IEEE Trans. Speech Audio Process., vol. 9, no. 4, pp. 441-157, May 2001.
28. N. Karmarkar, "A new polynomial time algorithm for linear programming," Combinatorica, vol. 4, pp. 373-395, 1984.
29. H. Papadimitriou and M. Yannakakis, "Multiobjective query optimization," in Proc. Symp. Principles of Database Systems (PODS), 2001, pp. 52-59.
30. Y.-I. Lim, P. Floquet, and X. Joulia, "Multiobjective optimization considering economics and environmental impact," in Proc. ECCE2, Oct. 5-7, 1999.