Flexible transport of 3-d video over networks

Proceedings of the IEEE

Volumn 99, Issue 4, 2011, Pages 694-707

  Gürler, C Göktuǧ ^a   Gorkemli, Burak ^a   Saygili, Görkem ^a   Tekalp, A Murat ^a  

^a KOÇ UNIVERSITY   (Turkey)

Author keywords

Adaptive multiview video streaming; broadcast over combined digital video broadcasting (DVB) and IP platforms; free view 3 D video; peer to peer (P2P) multiview video streaming; stereoscopic video

Indexed keywords

COMPUTER GRAPHICS; DIGITAL STORAGE; DIGITAL VIDEO BROADCASTING (DVB); FLEXIBLE DISPLAYS; MULTIMEDIA SYSTEMS; NETWORK ARCHITECTURE; PEER TO PEER NETWORKS; STEREO IMAGE PROCESSING; TELEVISION BROADCASTING; VIDEO STREAMING;

3-D VIDEOS; AUTO-STEREOSCOPIC DISPLAY; DIGITAL MEDIA TECHNOLOGIES; IP PLATFORM; MULTIVIEW VIDEO; STEREOSCOPIC VIDEO; STREAMING ARCHITECTURE; THREE-DIMENSIONAL (3D) VIDEO;

INTERNET PROTOCOLS;

EID: 79952986489     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2010.2100010     Document Type: Conference Paper

References (81)

1. T. Schierl and S. Narasimhan, BTransport and storage systems for 3-D video using MPEG-2 systems, RTP, and ISO file format," Proc. IEEE, vol. 99, no. 4, Apr. 2011, DOI: 10.1109/JPROC.2010.2091370.
2. DVB BlueBook A151, Commercial Requirements for DVB 3D-TV, Jul. 2010.
3. Requirements for the Support of IPTV Services, ITU-T Recommendation ITU-T Y.1901, 2009.
4. DIOMEDES. [Online]. Available: http://www.diomedes-project.eu
5. HDMI Specification 1.4a, HDMI Licensing, LLC., Mar. 2010.
6. ATTEST. [Online]. Available: http://www.hitech-projects.com/euprojects/ attest/
7. Text of ISO/IEC FDIS 23002-3 Representation of Auxiliary Video and Supplemental Information, ISO/IEC JTC1/SC29/WG11, Marrakesh, Morocco, Doc. N8768, Jan. 2007.
8. Text of ISO/IEC 13818-1:2003/FDAM2 Carriage of Auxiliary Data, ISO/IEC JTC1/SC29/WG11, Marrakech, Morocco, Doc. N8799, Jan. 2007.
9. P. Merkle, A. Smolic, K. Müller, and T. Wiegand, " Multi-view video plus depth representation and coding," in Proc. IEEE Int. Conf. Image Process., San Antonio, TX, Sep. 2007, pp. I-201-I-204.
10. A. Smolic, K. Muller, N. Stefanoski, J. Osterman, A. Gotchev, G. B. Akar, G. Triantafyllidis, and A. Koz, " Coding algorithms for 3DTVVA survey," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1606-1621, Nov. 2007.
11. P. Merkle, K. Müller, A. Smolic, and T. Wiegand, " Efficient compression of multiview depth data based on MVC," in Proc. 3DTV Conf., Kos, Greece, May 2007, DOI: 10.1109/3DTV.2007.4379460.
12. P. Kauff, N. Atzpadin, C. Fehn, M. Müller, O. Schreer, A. Smolic, and R. Tanger, " Depth map creation and image based rendering for advanced 3DTV services providing interoperability and scalability," Signal Process., Image Commun., vol. 22, Special Issue on 3DTV, no. 2, Feb. 2007, DOI: 10.1016/j.image.2006.11.013.
13. J. Shade, S. Gortler, L. Hey, and R. Szeliski, " Layered depth images," in Proc. ACM SIGGRAPH, Orlando, FL, 1998, pp. 231-242.
14. H. Schwarz, D. Marpe, and T. Wiegand, " Overview of the scalable video coding extension of the H.264/AVC standard," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1103-1120, Sep. 2007. (Pubitemid 47483052)
15. H. Kirchhoffer, D. Marpe, H. Schwarz, and T. Wiegand, " A low-complexity approach for increasing the granularity of packet-based fidelity scalability in scalable video coding," in Proc. Picture Coding Symp., Nov. 2007.
16. B. Gorkemli, Y. Sadi, and A. M. Tekalp, " Effects of MGS fragmentation, slice mode and extraction strategies on the performance of SVC with medium-grained scalability," in Proc. IEEE Int. Conf. Image Process., Hong Kong, Sep. 2010, pp. 4201-4204.
17. A. Vetro, T. Wiegand, and G. Sullivan, " Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard," Proc. IEEE, vol. 99, no. 4, Apr. 2011, DOI: 10.1109/JPROC.2010. 2098830.
18. H. Schwarz, D. Marpe, and T. Wiegand, " Analysis of hierarchical B-Pictures and MCTF," in Proc. IEEE Int. Conf. Multimedia Expo, Toronto, ON, Canada, Jul. 2006, pp. 1929-1932.
19. Y.Chen, Y.-K. Wang,K.Ugur, M.Hannuksela, J. Lainema, and M. Gabbouj, " The emerging MVC standard for 3D video services," EURASIP J. Adv. Signal Process., vol. 2009, 2009, DOI: 10.1155/2009/786015.
20. P. Merkle, A. Smolic, K. Muller, and T. Wiegand, " Efficient prediction structures for multiview video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1461-1473, Nov. 2007. (Pubitemid 350025508)
21. M. Drose, C. Clemens, and T. Sikora, " Extending single-view scalable video coding to multi-view based on H.264/AVC," in Proc. IEEE Int. Conf. Image Process., Atlanta, GA, Oct. 2006, pp. 2977-2980.
22. N. Ozbek and A. M. Tekalp, " Scalable multi-view video coding for interactive 3DTV," in Proc. IEEE Int. Conf. Multimedia Expo, Toronto, ON, Canada, Jul. 2006, pp. 213-216. (Pubitemid 46679692)
23. J. Garbas, U. Fecker, T. Tröger, and A. Kaup, B4D scalable multi-view video coding using disparity compensated view filtering and motion compensated temporal filtering,[ in Int. Workshop Multimedia Signal Process., Oct. 2006, pp. 54-58.
24. S. Tao, Y. Chen, M. M. Hannuksela, Y.-K. Wang, M. Gabbouj, and H. Li, " Joint texture and depth map video coding based on the scalable extension of H.264/AVC," in Proc. IEEE Int. Symp. Circuits Syst., 2009, pp. 2253-2256.
25. L. M. J. Meesters, W. A. IJsselsteijn, and P. J. H. Seuntiens, BA survey of perceptual evaluations and requirements of three-dimensional TV," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 3, pp. 381-391, Mar. 2004.
26. L. B. Stelmach, W. J. Tam, D. V. Meegan, A. Vincent, and P. Corriveau, BHuman perception of mismatched stereoscopic 3D inputs," in Proc. IEEE Int. Conf. Image Process., Vancouver, " C, Canada, Sep. 2000, vol. 1, pp. 5-8. (Pubitemid 32465788)
27. L. B. Stelmach, W. J. Tam, D. V. Meegan, and A. Vincent, BStereo image quality: Effects of mixed spatio-temporal resolution," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 2, pp. 188-193, Mar. 2000.
28. W. J. Tam, "Image and depth quality of asymmetrically coded stereoscopic video for 3D-TV," Joint Video Team Doc. JVT-W094, Apr. 2007.
29. G. Saygili, G. Gurler, and A. M. Tekalp, B3D display-dependent quality evaluation and rate allocation using scalable video coding,[ in Proc. IEEE Int. Conf. Image Process., Cairo, Egypt, Nov. 2009, pp. 717-720.
30. G. Saygili, G. Gurler, and A. M. Tekalp, " Quality assessment of asymmetric stereo video coding," in Proc. IEEE Int. Conf. Image Process., Hong Kong, Sep. 2010, pp. 4009-4012.
31. P. Aflaki, M. M. Hannuksela, J. Hakkinen, P. Lindroos, and M. Gabbouj, " Subjective study on compressed asymmetric stereoscopic video," in Proc. IEEE Int. Conf. Image Process., Hong Kong, Sep. 2010, pp. 4021-4024.
32. B. Wang, J. F. Kurose, P. J. Shenoy, and D. F. Towsley, " Multimedia streaming via TCP: An analytic performance study," in Proc. ACM Multimedia, Oct. 2004, pp. 908-915. (Pubitemid 40211887)
33. E. Kohler, M. Handley, and S. Floyd, "Datagram congestion control protocol (DCCP)," RFC 4340, Mar. 2006.
34. B. Gorkemli and A. M. Tekalp, " Adaptation strategies for streaming SVC video," in Proc. IEEE Int. Conf. Image Process., Hong Kong, Sep. 2010, pp. 2913-2916.
35. Y. B. Zikria, S. A. Malik, H. Ahmed, S. Nosheen, N. Z. Azeemi, and S. A. Khan, " Video transport over heterogeneous networks using SCTP and DCCP," in Proc. Int. Multi Topic Conf., 2008, pp. 180-190.
36. H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson, "RTP: A transport protocol for real-time applications," RFC 3550, Jul. 2003.
37. J. Lazzaro, "Framing RTP and RTCP packets over connection-oriented transport," RFC 4571, Jul. 2006.
38. J. Crowcroft and P. Oechslin, " Differentiated end to end internet services using a weighted proportional fair sharing TCP," ACM Comput. Commun. Rev., vol. 28, no. 3, Jul. 1998, DOI: 10.1145/293927.293930.
39. D. Damjanovic and M. Welzl, " MulTFRC: Providing weighted fairness for multimedia applications (and others too!)," ACM Comput. Commun. Rev., vol. 39, no. 3, Jul. 2009.
40. S. Lee and K. Chung, " Buffer-driven adaptive video streaming with TCP-friendliness," Comput. Commun., vol. 31, no. 10, pp. 2621-2630, 2008.
41. D. T. Nguyen and J. Ostermann, " Congestion control for scalable video streaming using the scalability extension of H.264/AVC," IEEE J. Sel. Topics Signal Process., vol. 1, no. 2, pp. 246-253, Aug. 2007. (Pubitemid 47260273)
42. B. Xie and W. Zeng, " Rate distortion optimized dynamic bitstream switching for scalable video streaming," in Proc. IEEE Int. Conf. Multimedia Expo, Taipei, Taiwan, Jun. 2004, vol. 2, pp. 1327-1330. (Pubitemid 40063285)
43. P. Zhu, W. Zeng, and C. Li, " Joint design of source rate control and QoS-aware congestion control for video streaming over the Internet," IEEE Trans. Multimedia, vol. 9, no. 2, pp. 366-376, Feb. 2007. (Pubitemid 46183106)
44. B. Girod, M. Kalman, Y. J. Liang, and R. Zhang, " Advances in channel-adaptive video streaming," in Proc. IEEE Int. Conf. Image Process., Rochester, NY, Sep. 2002, vol. 1, pp. 9-12.
45. J. Chakareski, J. G. Apostolopoulos, S. Wee, W. Tan, and B. Girod, " Rate-distortion hint tracks for adaptive video streaming," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 10, pp. 1257-1269, Oct. 2005. (Pubitemid 41640563)
46. N. Ozbek, B. Gorkemli, A. M. Tekalp, and T. Tunali, " Adaptive streaming of scalable stereoscopic video over DCCP," in Proc. IEEE Int. Conf. Image Process., San Antonio, TX, Sep. 2007, vol. 6, pp. 489-492.
47. R. Pantos, "HTTP live streaming," Internet-Draft, draft-pantos-http-live-streaming-02, Oct. 2009.
48. J. Vieron and C. Guillemot, " Real-time constrained TCP-compatible rate control for video over the Internet," IEEE Trans. Multimedia, vol. 6, no. 3, pp. 634-646, Aug. 2004.
49. M. Wien, R. Cazoulat, A. Graffunder, A. Hutter, and P. Amon, " Real-time system for adaptive video streaming based on SVC," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1227-1237, Sep. 2007. (Pubitemid 47485776)
50. T. Schierl, Y. Sanchez de la Fuente, R. Globisch, C. Hellge, and T. Wiegand, " Priority-based media delivery using SVC with RTP and HTTP streaming," Springer Multimedia Tools Appl., 2010, DOI: 10.1007/s11042-010-0572-5.
51. J. H. Jeon, S. C. Son, and J. S. Nam, " Overlay multicast tree recovery scheme using a proactive approach," Comput. Commun., vol. 31, pp. 3163-3168, 2008.
52. M. Fesci, E. T. Tunali, and A. M. Tekalp, " Bandwidth-aware multiple multicast tree formation for P2P scalable video streaming using hierarchical clusters," in Proc. IEEE Int. Conf. Image Process., Cairo, Egypt, Nov. 2009, pp. 945-948.
53. M. Castro, P. Druschel, A.-M. Kermarrec, A. Nandi, A. Rowstron, and A. Singh, " Split-stream: High-bandwidth content distribution in cooperative environments," Peer-to-Peer Systems II, vol. 2735. Berlin, Germany: Springer-Verlag, Feb. 2003, pp. 292-303, ser. Lecture Notes in Computer Science, DOI: 10.1007/978-3-540-45172-3-27.
54. P. Baccichet, J. Noh, E. Setton, and B. Girod, BContent-aware P2P video streaming with low latency," in Proc. IEEE Int. Conf. Multimedia Expo, " eijing, China, Jul. 2007, pp. 400-403.
55. J. Noh, P. Baccichet, F. Hartung, A. Mavlankar, and B. Girod, " Stanford peer-to-peer multicast (SPPM)VOverview and recent extensions," in Proc. Picture Coding Symp., May 2009, DOI: 10.1109/PCS.2009. 5167392.
56. P. P. Baccichet, T. Schierl, T. Wiegand, and B. Girod, " Low-delay peer-to-peer streaming using scalable video coding," in Proc. Int. Packet Video Workshop, Nov. 2007, pp. 173-181.
57. V. K. Goyal, " Multiple description coding: Compression meets the network," IEEE Signal Process. Mag., vol. 18, no. 5, pp. 74-93, Sep. 2001. (Pubitemid 32932335)
58. E. Setton, P. Baccichet, and B. Girod, " Peer-to-peer live multicast: A video perspective," Proc. IEEE, vol. 96, no. 1, pp. 25-38, Jan. 2008.
59. V. N. Padmanabhan, H. J. Wang, and P. A. Chou, " Resilient peer-to-peer streaming," in Proc. IEEE Int. Conf. Network Protocols, 2003, pp. 16-27.
60. D. Jurca, J. Chakareski, J. P. Wagner, and P. Frossard, " Enabling adaptive video streaming in P2P systems," IEEE Commun. Mag., vol. 45, no. 6, pp. 108-114, Jun. 2007.
61. J. Wang and K. Ramchandran, " Enhancing peer-to-peer live multicast quality using helpers," in Proc. IEEE Int. Conf. Image Process., San Diego, CA, Oct. 2008, pp. 2300-2303.
62. H. Zhang and K. Ramchandran, " A reliable decentralized peer-to-peer video-on-demand system using helpers," in Proc. Picture Coding Symp., May 2009, DOI: 10.1109/PCS.2009. 5167390.
63. J. Pouwelse, P. Garbacki, D. Epema, and H. Sips, " The BitTorrent P2P file-sharing system: Measurements and analysis," in Proc. 4th Int. Workshop Peer-to-Peer Syst., 2005, pp. 205-216.
64. B. Cohen, " Incentives build robustness in BitTorrent," in Proc. Workshop Econom. P2P Syst., Jun. 2003.
65. A. Vlavianos, M. Iliofotou, and M. Faloutsos, " BiToS: Enhancing BitTorrent for supporting streaming applications," in Proc. Global Internet Workshop/IEEE Int. Conf. Comput. Commun., Apr. 2006, DOI: 10.1109/INFOCOM.2006. 43.
66. C. Dana, D. Li, D. Harrison, and C. Chuah, " Bass: Bittorrent assisted streaming system for video-on-demand," in Proc. Int. Workshop Multimedia Signal Process., 2005, DOI: 10.1109/MMSP.2005.248586.
67. Tribler. [Online]. Available: http://www. tribler.org/
68. J. Pouwelse, P. Garbacki, J. Wang, A. Bakker, J. Yang, A. Iosup, D. Epema, M. Reinders, M. van Steen, and H. Sips, " Tribler: A social-based peer-to-peer system," in Proc. 5th Int. Workshop Peer-to-Peer Syst., 2006.
69. J. Mol, J. Pouwelse, M. Meulpolder, D. Epema, and H. Sips, " Give-to-get: Free-riding-resilient video-on-demand in P2P systems," Proc. SPIEVMultimedia Comput. Network Conf., vol. 6818, Jan. 2008, DOI: 10.1117/12.774909. (Pubitemid 351654151)
70. R. C. Merkle, " A digital signature based on a conventional encryption function," in Proc. Conf. Theory Appl. Cryptographic Techn. Adv. Cryptology, Santa Barbara, CA, Aug. 1987, pp. 369-378.
71. NextShare. [Online]. Available: http://www. livinglab.eu
72. P2P-Next. [Online]. Available: http://www. p2p-next.org
73. C. Fehn, P. Kauff, S. Cho, H. Kwon, N. Hur, and J. Kim, " Asymmetric coding of stereoscopic video for transmission over T-DMB," in Proc. 3DTV Conf., Kos, Greece, May 2007, DOI: 10.1109/3DTV.2007. 4379449.
74. A. Aksay, C. Bilen, E. Kurutepe, T. Ozcelebi, G. B. Akar, M. R. Civanlar, and A. M. Tekalp, " Temporal and spatial scaling for stereoscopic video compression," in Proc. 14th Eur. Signal Process. Conf., Florence, Italy, Sep. 2006.
75. G. Gurler, K. Bagci, and A. M. Tekalp, " Adaptive stereoscopic 3D video streaming," in Proc. IEEE Int. Conf. Image Process., Hong Kong, Sep. 2010, pp. 2409-2412.
76. Z. Yang, B. Yu, K. Nahrstedt, and R. Bajcsy, " A multi-stream adaptation framework for bandwidth management in 3D tele-immersion," in Proc. Int. Workshop Netw. Oper. Syst. Support Digit. Audio Video, May 2006, DOI: 10.1145/1378191.1378209.
77. E. Kurutepe, A. Aksay, C. Bilen, C. G. Gurler, T. Sikora, G. B. Akar, and A. M. Tekalp, " A standards-based, flexible, end-to-end multi-view video streaming architecture," in Proc. Int. Packet Video Workshop, Lausanne, Switzerland, Nov. 2007, pp. 302-307.
78. G. Petrovic, L. Do, S. Zinger, and P. H. N. de With, " Virtual view adaptation for 3D multiview video streaming," Proc. SPIEVElectron. Imag. Stereoscopic Displays Appl., vol. 7524, Jan. 2010, DOI:10.1117/12. 840230.
79. H. Urey, K. V. Chellappan, E. Erden, and P. Surman, " State of the art in stereoscopic and autostereoscopic displays," Proc. IEEE, vol. 99, no. 4, Apr. 2011, DOI: 10.1109/JPROC.2010.2098351.
80. E. Kurutepe, M. R. Civanlar, and A. M. Tekalp, BClient-driven selective streaming of multiview video for interactive 3DTV," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 11, pp. 1558-1565, Nov. 2007. (Pubitemid 350025515)
81. G. Cheung, A. Ortega, and N.-M. Cheung, " Bandwidth-efficient interactive multiview live video streaming using redundant frame structures," in Proc. Annu. Summit Conf. Asia-Pacific Signal Inf. Process. Assoc., Oct. 2009.