Coding of focused plenoptic contents by displacement intra prediction

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 26, Issue 7, 2016, Pages 1308-1319

  Li, Yun ^a   Sjöström, Mårten ^a   Olsson, Roger ^a   Jennehag, Ulf ^a  

^a MID SWEDEN UNIVERSITY   (Sweden)

Author keywords

Compression; High Efficiency Video Coding (HEVC); light field; plenoptic images; plenoptic videos

Indexed keywords

CAMERAS; CODES (SYMBOLS); COMPACTION; EFFICIENCY; FORECASTING; MICROOPTICS; QUALITY CONTROL; RENDERING (COMPUTER GRAPHICS); VIDEO SIGNAL PROCESSING;

BIT-RATE REDUCTION; EVALUATION RESULTS; HIGH-EFFICIENCY VIDEO CODING; LIGHT FIELDS; MICRO-LENS ARRAYS; PLENOPTIC CAMERAS; PLENOPTIC IMAGES; PLENOPTIC VIDEOS;

IMAGE CODING;

EID: 84978658360     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2015.2450333     Document Type: Article

References (46)

1. C. Conti, L. D. Soares, and P. Nunes, "Influence of self-similarity on 3D holoscopic video coding performance," in Proc. 18th Brazilian Symp. Multimedia Web (WebMedia), 2012, pp. 131-134.
2. B. Bross, W. J. Han, J. R. Ohm, G. J. Sullivan, Y. K. Wang, and T. Wiegand, High Efficiency Video Coding (HEVC) Text Specification Working Draft 10, document JCTVC-L1003, 2013.
3. E. H. Adelson and J. R. Bergen, "The plenoptic function and the elements of early vision," in Computational Models of Visual Processing. Cambridge, MA, USA: MIT Press, 1991, pp. 3-20.
4. M. Levoy and P. Hanrahan, "Light field rendering," in Proc. 23rd Annu. Conf. Comput. Graph. Interact. Techn., 1996, pp. 31-42.
5. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen, "The lumigraph," in Proc. 23rd Annu. Conf. Comput. Graph. Interact. Techn. (SIGGRAPH), New York, NY, USA, 1996, pp. 43-54.
6. B. Wilburn, N. Joshi, V. Vaish, M. Levoy, and M. Horowitz, "High-speed videography using a dense camera array," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 2. Jun./Jul. 2004, pp. II-294-II-301.
7. Y. Taguchi, A. Agrawal, S. Ramalingam, and A. Veeraraghavan, "Axial light field for curved mirrors: Reflect your perspective, widen your view," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 499-506.
8. A. Veeraraghavan, R. Raskar, A. Agrawal, A. Mohan, and J. Tumblin, "Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing," ACM Trans. Graph., vol. 26, no. 3, Jul. 2007, Art. ID 69.
9. G. Lippmann, "Épreuves réversibles donnant la sensation du relief," J. Phys. Theoretical Appl., vol. 7, no. 1, pp. 821-825, 1908.
10. R. Ng, "Digital light field photography," M.S. thesis, Dept. Comput. Sci., Stanford Univ., Stanford, CA, USA, 2006.
11. R. Ng, M. Levoy, M. Brédif, G. Duval, M. Horowitz, and P. Hanrahan, "Light field photography with a hand-held plenoptic camera," Dept. Comput. Sci., Stanford Univ., Stanford, CA, USA, Tech. Rep. CSTR 2005-02, 2005.
12. T. Georgiev and A. Lumsdaine, "Focused plenoptic camera and rendering," J. Electron. Imag., vol. 19, no. 2, p. 021106, Apr. 2010.
13. Todor Georgiev's Website. [Online]. Available: http://tgeorgiev.net/, accessed Aug. 2013.
14. C.-L. Chang, X. Zhu, P. Ramanathan, and B. Girod, "Light field compression using disparity-compensated lifting and shape adaptation," IEEE Trans. Image Process., vol. 15, no. 4, pp. 793-806, Apr. 2006.
15. T. Georgiev, Z. Yu, A. Lumsdaine, and S. Goma, "Lytro camera technology: Theory, algorithms, performance analysis," Proc. SPIE, vol. 8667, pp. 86671J-1-86671J-10, Mar. 2013.
16. Z. Yu, J. Yu, A. Lumsdaine, and T. Georgiev, "Plenoptic depth map in the case of occlusions," Proc. SPIE, Multimedia Content Mobile Devices, vol. 8667, pp. 86671S-1-86671S-9, Mar. 2013.
17. X.-L. Tang, S.-K. Dai, and C.-H. Cai, "An analysis of TZSearch algorithm in JMVC," in Proc. Int. Conf. Green Circuits Syst. (ICGCS), Jun. 2010, pp. 516-520.
18. X. Dong, D. Qionghan, and X. Wenli, "Data compression of light field using wavelet packet," in Proc. IEEE ICME, Jun. 2004, pp. 1071-1074.
19. P. Ramanathan and B. Girod, "Rate-distortion analysis for light field coding and streaming," Signal Process., Image Commun., vol. 21, no. 6, pp. 462-475, 2006.
20. M. Magnor and B. Girod, "Model-based coding of multiviewpoint imagery," Proc. SPIE, Vis. Commun. Image Process., vol. 4067, pp. 14-22, May 2000.
21. M. Magnor and B. Girod, "Data compression for light-field rendering," IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 3, pp. 338-343, Apr. 2000.
22. S. Kundu, "Light field compression using homography and 2D warping," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Mar. 2012, pp. 1349-1352.
23. D. Lelescu and F. Bossen, "Representation and coding of light field data," Graph. Models, vol. 66, no. 4, pp. 203-225, Jul. 2004.
24. K. Nishino, Y. Sato, and K. Ikeuchi, "Eigen-texture method: Appearance compression based on 3D model," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 1. 1999, pp. 618-624.
25. A. Gelman, P. L. Dragotti, and V. Velisavljevic, "Multiview image compression using a layer-based representation," in Proc. 17th IEEE Int. Conf. Image Process. (ICIP), Sep. 2010, pp. 493-496.
26. X. Zhu, A. Aaron, and B. Girod, "Distributed compression of light fields," Inf. Syst. Lab., Stanford Univ., Stanford, CA, USA, Tech. Rep.
27. N. Gehrig and P. L. Dragotti, "Distributed compression of multi-view images using a geometrical coding approach," in Proc. IEEE Int. Conf. Image Process., Sep./Oct. 2007, pp. VI-421-VI-424.
28. K. Marwah, G. Wetzstein, Y. Bando, and R. Raskar, "Compressive light field photography using overcomplete dictionaries and optimized projections," ACM Trans. Graph., vol. 32, no. 4, Jul. 2013, Art. ID 46.
29. C. Conti, P. Nunes, and L. D. Soares, "New HEVC prediction modes for 3D holoscopic video coding," in Proc. 19th IEEE Int. Conf. Image Process., Sep./Oct. 2012, pp. 1325-1328.
30. C. Conti, P. Nunes, and L. D. Soares, "3D holoscopic video coding based on HEVC with improved spatial and temporal prediction," in Proc. Conf. Telecommun.-Conftele, Castelo Branco, Portugal, May 2013, pp. 1-4.
31. B. Girod, "Efficiency analysis of multihypothesis motion-compensated prediction for video coding," IEEE Trans. Image Process., vol. 9, no. 2, pp. 173-183, Feb. 2000.
32. M. Flierl, T.Wiegand, and B. Girod, "A video codec incorporating blockbased multi-hypothesis motion-compensated prediction," in Proc. SPIE Conf. Vis. Commun. Image Process., Perth, Australia, 2000, pp. 1-12.
33. M. Flierl, T. Wiegand, and B. Girod, "Rate-constrained multihypothesis prediction for motion-compensated video compression," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 11, pp. 957-969, Nov. 2002.
34. Y. Li, M. Sjöström, R. Olsson, and U. Jennehag, "Efficient intra prediction scheme for light field image compression," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Florence, Italy, May 2014, pp. 539-543.
35. D. Flynn, J. Sole, and T. Suzuki, High Efficiency Video Coding (HEVC) Range Extensions Text Specification: Draft 4, Joint Collaborative Team on Video Coding (JCT-VC), document JCTVC-N1005, Apr. 2013.
36. A. Agooun, O. A. Fatah, J. C. Fernandez, C. Conti, P. Nunes, and L. D. Soares, "Acquisition, processing and coding of 3D holoscopic content for immersive video systems," in Proc. 3DTV-Conf., True Vis.-Capture, Transmiss., Dispaly 3D Video (3DTV-CON), Aberdeen, U.K., Oct. 2013, pp. 1-4.
37. R. M. Gray and D. L. Neuhoff, "Quantization," IEEE Trans. Inf. Theory, vol. 44, no. 6, pp. 2325-2383, Oct. 2012.
38. G. J. Sullivan, J. Ohm, W.-J. Han, and T. Wiegand, "Overview of the High Efficiency Video Coding (HEVC) standard," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1649-1668, Dec. 2012.
39. I.-K. Kim, J. Min, T. Lee, W.-J. Han, and J. Park, "Block partitioning structure in the HEVC standard," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1697-1706, Dec. 2012.
40. HM Reference Software Version 11. [Online]. Available: https://hevc.hhi. fraunhofer.de/svn/, accessed Aug. 2013.
41. F. Bossen, B. Bross, K. Sühring, and D. Flynn, "HEVC complexity and implementation analysis," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1685-1696, Dec. 2012.
42. Raytrix Website. [Online]. Available: http://raytrix.de/, accessed May 2014.
43. G. Bjøntegaard, Calculation of Average PSNR Differences Between RD-Curves, document ITU-T VCEG-M33, 2001.
44. F. Bossen, Common Test Conditions and Software Reference Configurations, Joint Collaborative Team on Video Coding (JCT-VC), document JCTVC-L1100, 2013.
45. D. S. Taubman and M. W. Marcellin, JPEG2000: Image Compression Fundamentals, Standards and Practice. Norwell, MA, USA: Kluwer, 2001.
46. OpenJPEG Project. [Online]. Available: http://www.openjpeg.org/, accessed Apr. 2015.