Streaming Mobile Cloud Gaming Video over TCP with Adaptive Source-FEC Coding

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 27, Issue 1, 2017, Pages 32-48

  Wu, Jiyan ^a   Yuen, Chau ^a   Cheung, Ngai Man ^a   Chen, Junliang ^b   Chen, Chang Wen ^c  

^a SINGAPORE UNIVERSITY OF TECHNOLOGY AND DESIGN   (Singapore)

^b BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^c the State University of New York   (United States)

Author keywords

Cloud gaming; forward error correction (FEC); mobile video streaming; rate control; stringent delay constraint; transmission control protocol (TCP)

Indexed keywords

CODES (SYMBOLS); COMMUNICATION CHANNELS (INFORMATION THEORY); ERROR CORRECTION; FORWARD ERROR CORRECTION; IMAGE CODING; IMAGE COMMUNICATION SYSTEMS; OPTIMIZATION; PACKET NETWORKS; QUALITY CONTROL; SIGNAL TO NOISE RATIO; VIDEO STREAMING;

CLOUD GAMINGS; CONGESTION CONTROL MECHANISM; DELAY CONSTRAINTS; FORWARD ERROR CORRECTION CODING; MOBILE VIDEO STREAMING; PEAK SIGNAL TO NOISE RATIO; RATE CONTROLS; REAL-TIME VIDEO COMMUNICATION;

TRANSMISSION CONTROL PROTOCOL;

EID: 85009727125     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2016.2527398     Document Type: Article

References (63)

1. C.-Y. Huang, C.-H. Hsu, Y.-C. Chang, and K.-T. Chen, "GamingAnywhere: An open cloud gaming system, " in Proc. 4th ACM MMSys, 2013, pp. 36-47.
2. D. Wu, Z. Xue, and J. He, "iCloudAccess: Cost-effective streaming of video games from the cloud with low latency, " IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 8, pp. 1405-1416, Aug. 2014.
3. Z. Xue, D. Wu, J. He, X. Hei, and Y. Liu, "Playing high-end video games in the cloud: A measurement study, " IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 12, pp. 2013-2025, Dec. 2015.
4. S.-P. Chuah, C. Yuen, and N.-M. Cheung, "Cloud gaming: A green solution to massive multiplayer online games, " IEEE Wireless Commun., vol. 21, no. 4, pp. 78-87, Aug. 2014.
5. OnLive. [Online]. Available: http://www.onlive.com/, accessed 2015.
6. CloudUnion. [Online]. Available: http://www.cloudunion.cn/, accessed 2015.
7. Distribution and Monetization Strategies to Increase Revenues From Cloud Gaming. [Online]. Available: http://www.cgconfusa.com/report/documents/Content-5minCloudGamingReportHighlights.pdf, accessed 2015.
8. K. Lee et al., "Outatime: Using speculation to enable low-latency continuous interaction for mobile cloud gaming, " in Proc. 13th Annu. Int. Conf. MobiSys, 2015, pp. 151-165.
9. J. Wu, C. Yuen, N.-M. Cheung, J. Chen, and C. W. Chen, "Enabling adaptive high-frame-rate video streaming in mobile cloud gaming applications, " IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 12, pp. 1988-2001, Dec. 2015.
10. C. Yu, Y. Xu, B. Liu, and Y. Liu, "Can you SEE me now? A measurement study of mobile video calls, " in Proc. IEEE INFOCOM, Apr./May 2014, pp. 1456-1464.
11. Web Real-Time Communication. [Online]. Available: http://www. webrtc.org/, accessed 2015.
12. HTTP Live Streaming. [Online]. Available: https://developer.apple. com/streaming/, accessed 2015.
13. K.-T. Chen, Y.-C. Chang, H.-J. Hsu, D.-Y. Chen, C.-Y. Huang, and C.-H. Hsu, "On the quality of service of cloud gaming systems, " IEEE Trans. Multimedia, vol. 16, no. 2, pp. 480-495, Feb. 2014.
14. J. Wu, B. Cheng, C. Yuen, Y. Shang, and J. Chen, "Distortion-Aware concurrent multipath transfer for mobile video streaming in heterogeneous wireless networks, " IEEE Trans. Mobile Comput., vol. 14, no. 4, pp. 688-701, Apr. 2015.
15. M. Panda, H. L. Vu, M. Mandjes, and S. R. Pokhrel, "Performance analysis of TCP NewReno over a cellular last-mile: Buffer and channel losses, " IEEE Trans. Mobile Comput., vol. 14, no. 8, pp. 1629-1643, Aug. 2015.
16. D. Moltchanov, "A study of TCP performance in wireless environment using fixed-point approximation, " Comput. Netw., vol. 56, no. 4, pp. 1263-1285, 2012.
17. P. Frossard and O. Verscheure, "Joint source/FEC rate selection for quality-optimal MPEG-2 video delivery, " IEEE Trans. Image Process., vol. 10, no. 12, pp. 1815-1825, Dec. 2001.
18. X. Yu, J. W. Modestino, R. Kurceren, and Y. S. Chan, "A model-based approach to evaluation of the efficacy of FEC coding in combating network packet losses, " IEEE/ACM Trans. Netw., vol. 16, no. 3, pp. 628-641, Jun. 2008.
19. Y. Li, Y. Zhang, L. Qiu, and S. Lam, "SmartTunnel: Achieving reliability in the Internet, " in Proc. IEEE INFOCOM, May 2007, pp. 830-838.
20. M. Claypool, D. Finkel, A. Grant, and M. Solano, "On the performance of OnLive thin client games, " Multimedia Syst., vol. 20, no. 5, pp. 471-484, 2014.
21. J. Wu, C. Yuen, and J. Chen, "Leveraging the delay-friendliness of TCP with FEC coding in real-Time video communication, " IEEE Trans. Commun., vol. 63, no. 10, pp. 3584-3599, Oct. 2015.
22. H.-P. Shiang and M. van der Schaar, "A quality-centric TCPfriendly congestion control for multimedia transmission, " IEEE Trans. Multimedia, vol. 14, no. 3, pp. 896-909, Jun. 2012.
23. O. Habachi, H.-P. Shiang, M. van der Schaar, and Y. Hayel, "Online learning based congestion control for adaptive multimedia transmission, " IEEE Trans. Signal Process., vol. 61, no. 6, pp. 1460-1469, Mar. 2013.
24. E. Brosh, S. A. Baset, V. Misra, D. Rubenstein, and H. Schulzrinne, "The delay-friendliness of TCP for real-Time traffic, " IEEE/ACM Trans. Netw., vol. 18, no. 5, pp. 1478-1491, Oct. 2010.
25. P. U. Tournoux, E. Lochin, J. Lacan, A. Bouabdallah, and V. Roca, "On-The-fly erasure coding for real-Time video applications, " IEEE Trans. Multimedia, vol. 13, no. 4, pp. 797-812, Aug. 2011.
26. S. Ahmad, R. Hamzaoui, and M. Al-Akaidi, "Adaptive unicast video streaming with rateless codes and feedback, " IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 2, pp. 275-285, Feb. 2010.
27. Y. Wu, S. Kumar, F. Hu, Y. Zhu, and J. D. Matyjas, "Cross-layer forward error correction scheme using raptor and RCPC codes for prioritized video transmission over wireless channels, " IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 6, pp. 1047-1060, Jun. 2014.
28. J. Xiao, T. Tillo, C. Lin, and Y. Zhao, "Dynamic sub-GOP forward error correction code for real-Time video applications, " IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1298-1308, Aug. 2012.
29. J. Xiao, T. Tillo, and Y. Zhao, "Real-Time video streaming using randomized expanding Reed-Solomon code, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 11, pp. 1825-1836, Nov. 2013.
30. Y. Liu, Z. G. Li, and Y. C. Soh, "A novel rate control scheme for low delay video communication of H.264/AVC standard, " IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 1, pp. 68-78, Jan. 2007.
31. J. Wu, Y. Shang, J. Huang, X. Zhang, B. Cheng, and J. Chen, "Joint source-channel coding and optimization for mobile video streaming in heterogeneous wireless networks, " EURASIP J. Wireless Commun. Netw., vol. 2013, p. 283, Dec. 2013.
32. P. Nunes and F. Pereira, "Joint rate control algorithm for low-delay MPEG-4 object-based video encoding, " IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 9, pp. 1274-1288, Sep. 2009.
33. K. Stuhlmuller, N. Farber, M. Link, and B. Girod, "Analysis of video transmission over lossy channels, " IEEE J. Sel. Areas Commun., vol. 18, no. 6, pp. 1012-1032, Jun. 2000.
34. P. Frossard, "FEC performances in multimedia streaming, " IEEE Commun. Lett., vol. 5, no. 3, pp. 122-124, Mar. 2001.
35. E. N. Gilbert, "Capacity of a burst-noise channel, " Bell Syst. Tech. J., vol. 39, no. 5, pp. 1253-1265, 1960.
36. J. Wu, B. Cheng, C. Yuen, N.-M. Cheung, and J. Chen, "Trading delay for distortion in one-way video communication over the Internet, " IEEE Trans. Circuits Syst. Video Technol., to be published.
37. R. Koetter and A. Vardy, "Algebraic soft-decision decoding of Reed-Solomon codes, " IEEE Trans. Inf. Theory, vol. 49, no. 11, pp. 2809-2825, Nov. 2003.
38. J. Nagle, Congestion Control in IP/TCP Internetworks, document RFC 896, 1984.
39. V. Sharma, K. Kar, K. K. Ramakrishnan, and S. Kalyanaraman, "A transport protocol to exploit multipath diversity in wireless networks, " IEEE/ACM Trans. Netw., vol. 20, no. 4, pp. 1024-1039, Aug. 2012.
40. G. Van der Auwera and M. Reisslein, "Implications of smoothing on statistical multiplexing of H.264/AVC and SVC video streams, " IEEE Trans. Broadcast., vol. 55, no. 3, pp. 541-558, Sep. 2009.
41. S. Floyd and K. Fall, "Promoting the use of end-To-end congestion control in the Internet, " IEEE/ACM Trans. Netw., vol. 7, no. 4, pp. 458-472, Aug. 1999.
42. S. Floyd, J. Padhye, and J. Widmer, TCP Friendly Rate Control (TFRC): Protocol Specification, document IETF RFC 5438, 2008.
43. Y. Xu, C. Yu, J. Li, and Y. Liu, "Video telephony for end-consumers: Measurement study of Google+, iChat, and Skype, " IEEE/ACM Trans. Netw., vol. 22, no. 3, pp. 826-839, Jun. 2014.
44. S. Cen, P. C. Cosman, and G. M. Voelker, "End-To-end differentiation of congestion and wireless losses, " IEEE/ACM Trans. Netw., vol. 11, no. 5, pp. 703-717, Oct. 2003.
45. EXata. [Online]. Available: http://www.scalable-networks.com/exata, accessed 2015.
46. QualNet. [Online]. Available: http://www.scalable-networks.com/qualnet, accessed 2015.
47. J. Wu, J. Yang, Y. Shang, B. Cheng, and J. Chen, "SPMLD: Sub-packet based multipath load distribution for real-Time multimedia traffic, " J. Commun. Netw., vol. 16, no. 5, pp. 548-558, Oct. 2014.
48. JM Software. [Online]. Available: http://iphome.hhi.de/suehring/tml/, accessed 2015.
49. J. Wu, C. Yuen, B. Cheng, Y. Shang, and J. Chen, "Goodput-Aware load distribution for real-Time traffic over multipath networks, " IEEE Trans. Parallel Distrib. Syst., vol. 26, no. 8, pp. 2286-2299, Aug. 2015.
50. Z. Feng, G. Papageorgiou, S. V. Krishnamurthy, R. Govindan, and T. La Porta, "Trading off distortion for delay for video transmissions in wireless networks, " in Proc. IEEE INFOCOM, Apr. 2013, pp. 1878-1886.
51. S. Wang and S. Dey, "Adaptive mobile cloud computing to enable rich mobile multimedia applications, " IEEE Trans. Multimedia, vol. 15, no. 4, pp. 870-883, Jun. 2013.
52. S. Wang and S. Dey, "Cloud mobile gaming: Modeling and measuring user experience in mobile wireless networks, " ACM Trans. Mobile Comput. Commun. Rev., vol. 16, no. 1, pp. 10-21, Jan. 2012.
53. Y. Liu, S. Wang, and S. Dey, "Content-Aware modeling and enhancing user experience in cloud mobile rendering and streaming, " IEEE J. Emerg. Sel. Topics Circuits Syst., vol. 4, no. 1, pp. 43-56, Mar. 2014.
54. J. Zhang and H. Li, "A novel error concealment algorithm for H.264/AVC, " in MultiMedia Modeling. Springer, 2015, pp. 466-476.
55. Z. Wu and J. M. Boyce, "An error concealment scheme for entire frame losses based on H.264/AVC, " in Proc. IEEE ISCAS, May 2006, pp. 1-5.
56. S. Belfiore, M. Grangetto, E. Magli, and G. Olmo, "Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation, " IEEE Trans. Multimedia, vol. 7, no. 2, pp. 316-329, Apr. 2005.
57. I. Sodagar, "The MPEG-DASH standard for multimedia streaming over the Internet, " IEEE MultiMedia, vol. 18, no. 4, pp. 62-67, Apr. 2011.
58. T. Stockhammer, "Dynamic adaptive streaming over HTTP-Standards and design principles, " in Proc. 2nd Annu. ACM Conf. MMSys, 2011, pp. 133-144.
59. M. Luby, M. Watson, T. Gasiba, T. Stockhammer, and W. Xu, "Raptor codes for reliable download delivery in wireless broadcast systems, " in Proc. 3rd IEEE CCNC, Jan. 2006, pp. 192-197.
60. A. Fiandrotti, V. Bioglio, M. Grangetto, R. Gaeta, and E. Magli, "Band codes for energy-efficient network coding with application to P2P mobile streaming, " IEEE Trans. Multimedia, vol. 16, no. 2, pp. 521-532, Feb. 2014.
61. J. Wu, C. Yuen, B. Cheng, M. Wang, and J. Chen, "Streaming highquality mobile video with multipath TCP in heterogeneous wireless networks, " IEEE Trans. Mobile Comput., to be published.
62. J. Wu, C. Yuen, N.-M. Cheung, and J. Chen, "Delay-constrained high definition video transmission in heterogeneous wireless networks with multi-homed terminals, " IEEE Trans. Mobile Comput., vol. 15, no. 3, pp. 641-655, Mar. 2016.
63. S. Kumar, L. Xu, M. K. Mandal, and S. Panchanathan, "Error resiliency schemes in H.264/AVC standard, " J. Vis. Commun. Image Represent., vol. 17, no. 2, pp. 425-450, 2006.