Using graphics rendering contexts to enhance the real-time video coding for mobile cloud gaming

MM'11 - Proceedings of the 2011 ACM Multimedia Conference and Co-Located Workshops

Volumn , Issue , 2011, Pages 103-112

  Shi, Shu ^a   Hsu, Cheng Hsin ^b   Nahrstedt, Klara ^a   Campbell, Roy H ^a  

^a University of Illinois at Urbana Champaign   (United States)

^b DEUTSCHE TELEKOM LABORATORIES   (Germany)

Author keywords

3D image warping; Cloud gaming; Mobile devices; Real time video coding

Indexed keywords

3-D IMAGE; 3D GAME ENGINES; CAMERA MOTIONS; GRAPHICS RENDERING; H.264/AVC ENCODER; KEY FRAMES; MOBILE CUSTOMER; QUALITY IMPROVEMENT; REAL TIME VIDEO CODING; RUNTIMES; VIDEO ENCODER; VIDEO ENCODINGS; VIDEO SEQUENCES;

ENCODING (SYMBOLS); IMAGE CODING; MOBILE DEVICES; MOTION PICTURE EXPERTS GROUP STANDARDS; THREE DIMENSIONAL;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84455173157     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2072298.2072313     Document Type: Conference Paper

References (23)

1. Onlive support documents. http://www.onlive.com/.
2. P. Bao and D. Gourlay. Remote walkthrough over mobile networks using 3-D image warping and streaming. IEE Proceedings on Vision, Image and Signal Processing, 151(4):329-336, August 2004.
3. U. Bayazit. Macroblock data classification and nonlinear bit count estimation for low delay H.263 rate control. In Proc. of IEEE International Conference on Image Processing (ICIP'99), pages 263-267, Kobe, Japan, October 1999.
4. T. Beigbeder, R. Coughlan, C. Lusher, J. Plunkett, E. Agu, and M. Claypool. The effects of loss and latency on user performance in unreal tournament 2003. In Proc. of NetGames'04, pages 144-151, Portland, OR, August 2004.
5. J. Garrett-Glaser. x264: The best low-latency video streaming platform in the world, January 2010. http://x264dev.multimedia.cx/archives/249.
6. F. Giesen, R. Schnabel, and R. Klein. Augmented compression for server-side rendering. In Proc. of VMV'08, pages 207-216, Konstanz, Germany, October 2008.
7. Y. Lee and B. Song. An intra-frame rate control algorithm for ultra low delay H.264/AVC coding. In Proc. of ICASSP'08, pages 1041-1044, Las Vegas, NV, March 2008.
8. M. Levoy. Polygon-assisted jpeg and mpeg compression of synthetic images. In Proceedings of SIGGRAPH'95, pages 21-28. ACM, 1995.
9. Y. Liu, Z. Li, and Y. Soh. A novel rate control scheme for low delay video communication of H.264/AVC standard. IEEE Transactions on Circuits and Systems for Video Technology, 1(17):68-78, January 2007.
10. W. Mark. Post-Rendering 3D Image Warping: Visibility, Reconstruction, and Performance for Depth-Image Warping. PhD thesis, University of North Carolina at Chapel Hill, Department of Computer Science, 1999.
11. J. Marquez, J. Domenech, J. Gil, and A. Pont. Exploring the benefits of caching and prefetching in the mobile web. In Proc. of WCITD'08, Pretoria, South Africa, October 2008.
12. L. McMillan. An Image-Based Approach to Three Dimensional Computer Graphics. PhD thesis, 1997.
13. S. Milani and G. Calvagno. A cognitive approach for effective coding and transmission of 3D video. In Proc. of the ACM International Conference on Multimedia (MM'10), pages 581-590, Firenze, Italy, October 2010.
14. M. Nadeem, S. Wong, and G. Kuzmanov. An efficient realization of forward integer transform in H.264/AVC intra-frame encoder. In Proc. of SAMOS'10, pages 71-78, Samos, Greece, July 2010.
15. H. Reddy and R. Chunduri. MPEG-4 low delay design for HDTV with multi-stream approach. Master's thesis, Swiss Federal Institute of Technology, Lausanne (EPFL), 2006.
16. A. Redert, M. de Beeck, C. Fehn, W. Ijsselsteijn, M. Pollefeys, L. Van Gool, E. Ofek, I. Sexton, and P. Surman. Advanced three-dimensional television system technologies. In Proceedings of 3DPVT'02, pages 313 - 319, 2002.
17. O. Riva and J. Kangasharju. Challenges and lessons in developing middleware on smart phones. IEEE Computer, 41(10):77-85, October 2008.
18. R. Schreier, A. Rahman, G. Krishnamurthy, and A. Rothermel. Architecture analysis for low-delay video coding. In Proc. of ICME'06, pages 2053-2056, Toronto, Canada, July 2006.
19. S. Shi, M. Kamali, K. Nahrstedt, J. C. Hart, and R. H. Campbell. A high-quality low-delay remote rendering system for 3D video. In Proc. of the ACM International Conference on Multimedia (MM'10), pages 601-610, Firenze, Italy, October 2010.
20. T. Tran, L. Liu, and P. Westerink. Low-delay MPEG-2 video coding. In Proc. of VCIP'98, pages 510-516, San Jose, CA, January 1998.
21. Y. Wang, J. Ostermann, and Y. Zhang. Video Processing and Communications. Prentice Hall, 1st edition, 2001.
22. T. Wiegand, G. Sullivan, G. Bjntegaard, and A. Luthra. Overview of the H.264/AVC video coding standard. IEEE Transactions on Circuits and Systems for Video Technology, 13(7):560-576, July 2003.
23. W. Yoo, S. Shi, W. Jeon, K. Nahrstedt, and R. Campbell. Real-time parallel remote rendering for mobile devices using graphics processing units. In Proc. of ICME'10, pages 902 -907, july 2010.