Scalable remote rendering with depth and motion-flow augmented streaming

Computer Graphics Forum

Volumn 30, Issue 2, 2011, Pages 415-424

  Paja̧k, Dawid ^a,b   Herzog, Robert ^b   Eisemann, Elmar ^c   Myszkowski, Karol ^b   Seidel, Hans Peter ^b  

^a WEST POMERANIAN UNIVERSITY OF TECHNOLOGY   (Poland)

^b MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^c TELECOM PARISTECH   (France)

Author keywords

[No Author keywords available]

Indexed keywords

BANDWIDTH; COMPUTER GRAPHICS; COMPUTER HARDWARE; COMPUTER HARDWARE DESCRIPTION LANGUAGES; DATA TRANSFER; HARDWARE; IMAGE RECONSTRUCTION; PROGRAM PROCESSORS; STEREO IMAGE PROCESSING; STEREO VISION;

CLIENT-SIDE APPLICATION; HARDWARE RESOURCES; IMPORTANT FEATURES; INTERACTIVE APPLICATIONS; LIMITED BANDWIDTH; REAL TIME INTERACTIONS; TEMPORAL CONSISTENCY; VIDEO INFORMATION;

RENDERING (COMPUTER GRAPHICS);

EID: 84878211319     PISSN: 01677055     EISSN: 14678659     Source Type: Journal    
DOI: 10.1111/j.1467-8659.2011.01871.x     Document Type: Conference Paper

References (34)

1. CHENG L., BHUSHAN A., PAJAROLA R., ZARKI M. E.: Real-time 3D graphics streaming using MPEG-4. In Proc. IEEE/ACM Workshop on Broadb. Wireless Serv. and Appl. (2004).
2. COHENOR D., MANN Y., FLEISHMAN S.: Deep compression for streaming texture intensive animations. In Proceedings of SIGGRAPH (1999), pp. 261-268.
3. DIDYK P., EISEMANN E., RITSCHEL T., MYSZKOWSKI K., SEIDEL H.-P.: Perceptually-motivated real-time temporal upsampling of 3D content for high-refresh-rate displays. Comp. Graph. Forum (Proc. of Eurographics) 29, 2 (2010), 713-722.
4. DIDYK P., RITSCHEL T., EISEMANN E., MYSZKOWSKI K., SEIDEL H.-P.: Adaptive image-space stereo view synthesis. In Proc. of VMV (2010).
5. ELDER J. H.: Are edges incomplete? International Journal of Comp. Vision 34, 2-3 (aug 1999), 97-122.
6. EISERT P., WIEGAND T., GIROD B.: Rate-distortion-efficient video compression using a 3D head model. In Intern. Conf. on Image Proc. (1999), pp. 217-221.
7. FATTAL R.: Edge-avoiding wavelets and their applications. ACM Trans. on Graph. 28, 3 (July 2009), 22:1-22:10.
8. FECHTELER P., EISERT P.: Depth map enhanced macroblock partitioning for H.264 video coding of computer graphics content. In Intern. Conf. on Image Proc. (2009), pp. 3441-3444.
9. FEHN C.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. In Stereoscopic Displays and Virtual Reality Systems XI (2004), vol. 5291, SPIE, pp. 93-104.
10. FARBMAN Z., FATTAL R., LISCHINSKI D., SZELISKI R.: Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Trans. on Graph. 27, 3 (2008), 67:1-67:10.
11. GORTLER S. J., GRZESZCZUK R., SZELISKI R., COHEN M. F.: The lumigraph. In Proc. of SIGGRAPH (1996), ACM, pp. 43-54.
12. GALIC I., WEICKERT J., WELK M., BRUHN A., BELYAEV A. G., SEIDEL H.-P.: Image compression with anisotropic diffusion. Journal of Math. Imaging and Vision 31, 2-3 (2008), 255-269.
13. HERZOG R., EISEMANN E., MYSZKOWSKI K., SEIDEL H.-P.: Spatio-temporal upsampling on the GPU. In Proc. of I3D (2010), ACM, pp. 91-98.
14. HERZOG R., KINUWAKI S., MYSZKOWSKI K., SEIDEL H.-P.: Render2MPEG: A perception-based framework towards integrating rendering and video compression. Comp. Graph. Forum (Proc. of Eurographics) 27, 2 (2008), 183-192.
15. ITU-T: Information technology - coded representation of picture and audio information - lossy/lossless coding of bilevel images, itu-t recommendation t.82 - iso/iec international standard 14492 final committee draft.
16. JIANG Z., WONG T.-T., BAO H.: Depth image sequences compression using programmable graphics hardware. TR-2004-01, 2004.
17. KAUFF P., ATZPADIN N., FEHN C., MÜLLER M., SCHREER O., SMOLIC A., TANGER R.: Depth map creation and image-based rendering for advanced 3dtv services providing interoperability and scalability. Signal Processing: Image Communication 22, 2 (2007), 217 - 234. Special issue on 3D video and television.
18. KRISHNAMURTHY R., BING CHAI B., TAO H., SETHURAMAN S.: Compression and transmission of depth maps for image-based rendering. In Intern. Conf. on Image Proc. (2001), pp. 828-831.
19. LUFT T., COLDITZ C., DEUSSEN O.: Image enhancement by unsharp masking the depth buffer. ACM Trans. on Graph. (Proc. of SIGGRAPH) 25, 3 (2006), 1206-1213.
20. LEVOY M.: Polygon-assisted JPEG and MPEG compression of synthetic images. In Proceedings of ACM SIGGRAPH (1995), pp. 21-28.
21. MAITRE M., DO M.: Joint encoding of the depth image based representation using shape-adaptive wavelets. In Intern. Conf. on Image Proc. (2008), pp. 1768-1771.
22. MURAD A., FUJA T.: Exploiting the residual redundancy in motion estimation vectors to improve the quality of compressed video transmitted over noisy channels. In Intern. Conf. on Image Proc. (1998), pp. 497-501.
23. MERKLE P., MORVAN Y., SMOLIC A., FARIN D., MÜLLER K., DE WITH P. H. N., WIEGAND T.: The effects of multiview depth video compression on multiview rendering. Signal Processing: Image Communcation 24, 1-2 (2009), 73-88.
24. NAVE I., DAVID H., SHANI A., LAIKARI A., EISERT P., FECHTELER P.: Games@Large graphics streaming architecture. In Symp. on Consumer Electronics (ISCE) (2008).
25. ORZAN A., BOUSSEAU A., WINNEMÖLLER H., BARLA P., THOLLOT J., SALESIN D.: Diffusion curves: A vector representation for smooth-shaded images. In ACM Trans. on Graph. (Proc. of SIGGRAPH) (2008), vol. 27, pp. 92:1-92:8.
26. PAETH A. W.: Image file compression made easy. In Graphic GEMS II (1991).
27. PARK Y. K., JUNG K., OH Y., LEE S., KIM J. K., LEE G., LEE H., YUN K., HUR N., KIM J.: Depth-image-based rendering for 3DTV service over T-DMB. Signal Processing: Image Communication 24, 1-2 (2009), 122-136.
28. SITTHI-AMORN P., LAWRENCE J., YANG L., SANDER P. V., NEHAB D.: An improved shading cache for modern GPUs. In Proc. of Graphics Hardware (2008), pp. 95-101.
29. STICH T., LINZ C., WALLRAVEN C., CUNNINGHAM D., MAGNOR M.: Perception-motivated Interpolation of Image Sequences. In Proc. APGV (2008), pp. 97-106.
30. WALLACH D. S., KUNAPALLI S., COHEN M. F.: Accelerated MPEG compression of dynamic polygonal scenes. In Proceedings of SIGGRAPH (1994), pp. 193-197.
31. WITTEN I. H., NEAL R. M., CLEARY J. G.: Arithmetic coding for data compression. Commun. ACM 30, 6 (1987), 520-540.
32. Free software library and application for H.264 video coding. http://www.videolan.org/developers/x264.html.
33. YANG L., SANDER P. V., LAWRENCE J.: Geometry-aware framebuffer level of detail. Comp. Graph. Forum (Proc. of EGSR) 27, 4 (2008), 1183-1188.
34. ZENG W., DALY S., LEI S.: Visual optimization tools in JPEG 2000. In IEEE Intern. Conf. on Image Proc. (2000).