Modeling and Optimization of High Frame Rate Video Transmission Over Wireless Networks

IEEE Transactions on Wireless Communications

Volumn 15, Issue 4, 2016, Pages 2713-2726

  Wu, Jiyan ^a   Yuen, Chau ^a   Cheung, Ngai Man ^a   Chen, Junliang ^b   Chen, Chang Wen ^c  

^a SINGAPORE UNIVERSITY OF TECHNOLOGY AND DESIGN   (Singapore)

^b BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^c State University of New York   (United States)

Author keywords

forward error correction; High frame rate video; model driven optimization; wireless video communication

Indexed keywords

COMMUNICATION CHANNELS (INFORMATION THEORY); ERROR CORRECTION; FORWARD ERROR CORRECTION; IMAGE COMMUNICATION SYSTEMS; SIGNAL TO NOISE RATIO; VIDEO STREAMING; WIRELESS NETWORKS;

END-TO-END DISTORTION; HIGH FRAME RATE; MODEL-DRIVEN OPTIMIZATION; MODELING AND OPTIMIZATION; MULTIMEDIA APPLICATIONS; PEAK SIGNAL TO NOISE RATIO; TRANSMISSION PERFORMANCE; WIRELESS VIDEO COMMUNICATION;

IMAGE CODING;

EID: 84963819538     PISSN: 15361276     EISSN: None     Source Type: Journal    
DOI: 10.1109/TWC.2015.2509063     Document Type: Article

References (55)

1. K. T. Chen et al., "On the quality of service of cloud gaming systems," IEEE Trans. Multimedia, vol. 16, no. 2, pp. 480-495, Feb. 2014.
2. D. Miao, J. Fu, Y. Lu, and C. W. Chen, "High frame rate screen video coding for screen sharing applications," in Proc. IEEE Int. Symp. Circuits Syst. (ISCAS), 2014, pp. 2157-2160.
3. M. Claypool et al., "On the performance of On Live thin client games," Multimedia Syst., vol. 20, no. 5, pp. 471-484, 2014.
4. J. L. Suo et al., "Joint non-Gaussian denoising and superresolving of raw high frame rate videos," IEEE Trans. Image Process., vol. 23, no. 3, pp. 1154-1168, Mar. 2014.
5. K. T. Claypool and M. Claypool, "On frame rate and player performance in first person shooter games," Multimedia Syst., vol. 13, no. 1, pp. 3-17, 2007.
6. RED.COM Incorporation. High Frame Rate Video Samples [Online]. Available: http://www.red.com/learn/red-101/high-frame-rate-video
7. J. Wu, C. Yuen, N.-M. Cheung, J. Chen, and C. W. Chen, "Enabling adaptive high-frame-rate video streaming in mobile cloud gaming applications," IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 12, pp. 1988-2001, Dec. 2015.
8. Cloud Union Company. Cloud Union [Online]. Available: http://www.cloudunion.cn/
9. J. Yooon, H. Zhang, S. Banerjee, and S. Rangarajan, "MuVi: A multicast video delivery scheme for 4G cellular networks," in Proc. ACM Mobi Com, 2012, pp. 209-220.
10. J. Wu, B. Cheng, C. Yuen, Y. Shang, and J. Chen, "Distortion-aware concurrent multipath transfer for mobile video streaming in heterogeneous wireless networks," IEEE Trans. Mobile Comput., vol. 14, no. 4, pp. 688-701, Apr. 2015.
11. D. Wu, Z. Xue, and J. He, "iCloud Access: Costeffective streaming of video games from the cloud with low latency," IEEE Trans. Circuits Syst. Video Technol., vol. 42, no. 8, pp. 1405-1416, Aug. 2014.
12. K. T. Chen et al., "Measuring the latency of cloud gaming systems," in Proc. ACM Multimedia, 2011, pp. 1269-1272.
13. K. Stuhlmüller, N. Färber, M. Link, and B. Girod, "Analysis of video transmission over lossy channels," IEEE J. Sel. Areas Commun., vol. 18, no. 6, pp. 1012-1032, Jun. 2000.
14. X. Zhu et al., "Distributed rate allocation policies for multihomed video streaming over heterogeneous access networks," IEEE Trans. Multimedia, vol. 11, no. 4, pp. 752-764, Jun. 2009.
15. Y. Huang, S. Mehrotra, and J. Li, "A hybrid FEC-ARQ protocol for low-delay lossless sequential data streaming," in Proc. IEEE Int. Conf. Multimedia Expo (ICME), 2009, pp. 718-725.
16. S. Mehdian and B. Liang, "Jointly optimal selection and scheduling for lossy transmission of dependent frames with delay constraint," in Proc. IEEE 22nd Int. Symp. Qual. Serv. (IWQoS), 2014, pp. 168-177.
17. C. Gong and X. Wang, "Adaptive transmission for delay-constrained wireless video," IEEE Trans. Wireless Commun., vol. 13, no. 1, pp. 49-61, Jan. 2014.
18. S. Soltani, K. Misra, and H. Radha, "Delay constraint error control protocol for real-time video communication," IEEE Trans. Multimedia, vol. 11, no. 4, pp. 742-751, Jun. 2009.
19. S. S. Karande and H. Radha, "Hybrid erasure-error protocols for wireless video," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 307-319, Feb. 2007.
20. E. Baccaglini, T. Tillo, and G. Olmo, "Slice sorting for unequal loss protection of video streams," IEEE Signal Process. Lett., vol. 15, pp. 581-584, Oct. 2008.
21. J. Xiao et al., "Dynamic sub-GOP forward error correction code for real-time video applications," IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1298-1308, Aug. 2012.
22. J. Wu, J. Yang, X. Wu, and J. Chen, "A low latency scheduling approach for high definition video streaming over heterogeneous wireless networks," in Proc. IEEE GLOBECOM, 2013, pp. 1723-1729.
23. K. Chebrolu and R. R. Rao, "Selective frame discard for interactive video," in Proc. IEEE Int. Conf. Commun. (ICC), 2004, pp. 4097-4102.
24. J. Wu, B. Cheng, C. Yuen, N.-M. Cheung, and J. Chen, "Trading delay for distortion in one-way video communication over the Internet," IEEE Trans. Circuits Syst. Video Technol., doi: 10.1109/TCSVT.2015.2412774, submitted for publication.
25. J. Wu, Y. Shang, X. Qiao, B. Cheng, and J. Chen, "Robust bandwidth aggregation for real-time video delivery in integrated heterogeneous wireless networks," Multimedia Tools. Appl., vol. 74, no. 11, pp. 4117-4138, 2015.
26. P. Frossard, "FEC performances in multimedia streaming," IEEE Commun. Lett., vol. 5, no. 3, pp. 122-124, Mar. 2001.
27. J. Wu et al., "Goodput-aware load distribution for real-time traffic over multipath networks," IEEE Trans. Parallel Distrib. Syst., vol. 26, no. 8, pp. 2286-2299, Aug. 2015.
28. E. Gilbert, "Capacity of a burst-noise channel," Bell Syst. Tech. J., vol. 39, no. 9, pp. 1253-1265, 1960.
29. J. Wu, C. Yuen, N.-M. Cheung, and J. Chen, "Delay-constrained high definition video transmission in heterogeneous wireless networks with multi-homed terminals," IEEE Trans. Mobile Comput., doi: 10.1109/TMC.2015.2426710, submitted for publication.
30. L. Zhou et al., "Distributed scheduling scheme for video streaming over multi-channel multi-radio multi-hop wireless networks," IEEE J. Sel. Area Commun., vol. 28, no. 3, pp. 409-419, Apr. 2010.
31. L. Zhou et al., "Availability-aware multimedia scheduling in heterogeneous wireless networks," IEEE Trans. Veh. Technol., vol. 60, no. 3, pp. 1161-1170, Mar. 2011.
32. S. Cen, P. C. Cosman, and G. M. Voelker, "End-to-end differentiation of congestion and wireless losses," IEEE/ACM Trans. Netw., vol. 11, no. 5, pp. 703-717, Oct. 2003.
33. Scalable Networks Technologies Inc. Exata [Online]. Available: http://www.scalable-networks.com/exata
34. Scalable Networks Technologies Inc. Qual Net [Online]. http://www.scalable-networks.com/qualnet
35. J. Wu et al., "Joint source-channel coding and optimization for mobile video streaming in heterogeneous wireless networks," EURASIP J. Wireless Commun. Netw., vol. 2013, pp. 1-16, 2013.
36. P. Borgnat et al., "Seven years and one day: Sketching the evolution of internet traffic," in Proc. IEEE INFOCOM, 2009, pp. 711-719.
37. K. Suhring, JM Homepage [Online]. Available: http://iphome.hhi.de/suehring/tml/
38. Unity Technologies Inc. Unity Engine [Online]. Available: http://unity3d.com/
39. ANSI T1.TR.74-2001, "Objective video quality measurement using a peak-signal-to-noise-ratio (PSNR) full reference technique," 2001 [Online]. Available: http://webstore.ansi.org/RecordDetail.aspx?sku= T1.TR.74-2001
40. G. Hasslinger, A. Schwahn, and F. Hartleb, "2-State (semi-) Markov processes beyond Gilbert-Elliott: Traffic and channel models based on 2 nd order statistics," in Proc. IEEE INFOCOM, 2013, pp. 1438-1446.
41. W. Song and W. Zhuang, "Performance analysis of probabilistic multipath transmission of video streaming traffic over multi-radio wireless devices," IEEE Trans. Wireless Commun., vol. 11, no. 4, pp. 1554-1564, Apr. 2012.
42. M. Ismail, W. Zhuang, and S. Elhedhli, "Energy and content aware multihoming video transmission in heterogeneous networks," IEEE Trans. Wireless Commun., vol. 12, no. 7, pp. 3600-3610, Jul. 2013.
43. B. Girod, "What's wrong with mean-squared error?" in Digital Images and Human Vision. Cambridge, MA, USA: MIT Press 1993.
44. Z. Wang and A. C. Bovik, "Mean squared error: Love it or leave it?" IEEE Signal Process. Mag., vol. 26, no. 1, pp. 98-117, Jan. 2009.
45. W. Lin and C. J. Kuo, "Perceptual visual quality metrics: A survey," J. Vis. Commun. Image Represent., vol. 22, no. 4, pp. 297-312, 2011.
46. A. C. Bovik, "Automatic prediction of perceptual image and video quality," Proc. IEEE, vol. 101, no. 9, pp. 2008-2024, 2013.
47. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
48. H. R. Sheikh and A. C. Bovik, "Image information and visual quality," IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006.
49. Tenomichi Ltd. Stream My Game [Online]. Available: http://streammygame.com/smg/index.php
50. Y. F. Ou et al., "Modeling the impact of frame rate on perceptual quality of video," in Proc. IEEE 15th Int. Conf. Image Process. (ICIP), 2008, pp. 689-692.
51. V. Sharma et al., "A transport protocol to exploit multipath diversity in wireless networks," IEEE/ACM Trans. Netw., vol. 20, no. 4, pp. 1024-1039, Aug. 2012.
52. G. Auwera and M. Reisslein, "Implications of smoothing on statistical multiplexing of H. 264/AVC and SVC video streams," IEEE Trans. Broadcast., vol. 55, no. 3, pp. 541-558, Sep. 2009.
53. J. Wu, C. Yuen, and J. Chen, "Leveraging the delay-friendliness of TCP with FEC coding in real-time video communication," IEEE Trans. Commun., vol. 63, no. 10, pp. 3584-3599, Oct. 2015.
54. A. Zhou, M. Liu, Z. Li, and E. Dutkiewicz, "Cross-layer design for proportional delay differentiation and network utility maximization in multi-hop wireless networks," IEEE Trans. Wireless Commun., vol. 11, no. 4, pp. 1446-1455, Apr. 2012.
55. J. Wu, X. Qiao, Y. Xia, C. Yuen, and J. Chen, "A low latency scheduling approach for high definition video streaming in a heterogeneous wireless network with multihomed clients," Multimedia Syst., vol. 21, no. 4, pp. 411-425, 2015.