An overview of perceptual processing for digital pictures

Proceedings of the 2012 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2012

Volumn , Issue , 2012, Pages 113-120

  Wu, Hong Ren ^a   Lin, Weisi ^b   Karam, Lina J ^c  

^a RMIT UNIVERSITY   (Australia)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c Arizona State University   (United States)

Author keywords

computer graphics; image and video compression; perceptual visual signal processing; visual signal quality evaluation

Indexed keywords

DIGITAL PICTURE; PERCEPTUAL MODEL; PERCEPTUAL PROCESSING; RESEARCH EFFORTS; STATE-OF-THE-ART TECHNOLOGY; VISUAL SIGNAL PROCESSING; VISUAL SIGNALS; VISUAL-PROCESSING;

COMPUTER GRAPHICS; EXHIBITIONS; IMAGE COMPRESSION; SIGNAL PROCESSING;

QUALITY CONTROL;

EID: 84866862770     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICMEW.2012.27     Document Type: Conference Paper

References (95)

1. W.M. Goodall. Television by pulse code modulation. Bell Systems Technical Journal, 28:33-49, January 1951.
2. ITU Telecommunication Standardization Sector, ITU-T Rec. H.261 Line Transmission on Non-Telephonee Signals-Video Codec for Audiovisual Services at px64 kbit/s, Geneva, 1990.
3. ITU, Rec. T.81 (09/92) Terminal Equipment and Protocols for Telematic Services - Information Technology - Digital Compression and Coding of Continuous-Tone Still Images-Requirements and Guidelines, 1993.
4. A.J. Seyler and Z.L. Budrikis, "Measurements of temporal adaptation to spatial detail vision," Nature, Vol. 184, pp. 1215-1217, Oct. 1959.
5. G. Ghinea, G.-M. Muntean, P. Frossard, M. Etoh, F. Speranza, and H.R. Wu, (Guest Editors), Special Issue on "Quality Issues on Mobile Multimedia Broadcasting", The IEEE Transactions on Broadcasting, 54(3), Pt II, 2008.
6. L.J. Karam, T. Ebrahimi, S. Hemami, T. Pappas, R. Safranek, Z. Wang, and A.B. Watson, (Eds), IEEE Journal on Special Topics in Signal Processing, Special Issue on Visual Media Quality Assessment, vol. 3, no. 2, pp. 189-192, April 2009.
7. T. Ebrahimi, L.J. Karam, F. Pereira, K. El-Maleh, and I.S. Burnett, IEEE Signal Processing Magazine, Speicial Issue on Multimedia Quality Assessment - A world of applications, Vol.28, No.6, November 2011.
8. J. Hopfinger, M. Buonocore, G. Mangun, "The neural mechanisms of top-down attentional control," Nature Neuroscience, vol. 3(3), pp.284-291, 2000.
9. L. Itti, "Visual salience," Scholarpedia, 2(9):3327, 2007. [Online] http://www.scholarpedia.org/ article/Visual-salience.
10. D. Lloyd, N. Merat, F. McGlone, C. Spence, "Crossmodal links between audition and touch in covert endogenous spatial attention," Perception Psychophys., 65(6):901-924, 2003.
11. C. Koch, S. Ullman, "Shifts in selective visual attention: towards the underlying neural circuitry," Human Neurobiology 4, pp.219-227, 1985.
12. L. Itti, C. Koch, E. Niebur, "A model of saliency based visual attention for rapid scene analysis," IEEE Trans. Pattern Analy. Mach. Intell., vol. 20(11), pp.1254-1259, 1998.
13. J. Harel, C. Koch and P. Perona, "Graph-based visual saliency," Advances in Neural Information Processing Systems, pp. 545-552, 2006.
14. N. Bruce and J. Tsotsos, "Saliency based on information maximization," Advances in Neural Information Processing Systems, pp. 155-162, 2006.
15. T. Liu, J. Sun, N. Zheng, X. Tang and H. Shum, "Learning to detect a salient object," in Proc. Int. Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
16. X. Hou and L. Zhang, "Saliency Detection: A spectral residual approach," in Proc. Int. Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007
17. Y. Fang, W. Lin, B-S Lee, C. T. Lau, Z. Chen, C-W Lin, "Bottom-up Saliency Detection Model Based on Human Visual Sensitivity and Amplitude Spectrum", IEEE Transactions on Multimedia, Vol. 14(1), pp. 187 - 198, 2012.
18. U. Rajashekar, I. van der Linde, A. Bovik, and L. Cormack, "GAFFE: A gaze-attentive fixation finding engine," IEEE Transactions on Image Processing, vol. 17(4):564-73, 2008.
19. R. Achanta, S. Hemami, F. Estrada, S. Susstrunk, "Frequency-tuned salient region detection," IEEE Conf. Computer Vision and Pattern Recog. (2009), pp. 1597-1604.
20. Z. Lu, W. Lin, X. Yang, E. Ong, S. Yao, "Modeling Visual Attention's Modulatory Aftereffects on Visual Sensitivity and Quality Evaluation", IEEE Trans. Image Processing, Vol.14(11), pp.1928 - 1942, 2005.
21. A. Ahumada and H. Peterson, "Luminance-model-based DCT quantization for color image compression," SPIE Int'l Society for Optical Engineering, 1666:365-374, 1992.
22. A. B.Watson, "DCT quantization matrices visually optimized for individual images, Proceedings of the SPIE International Society for Optical Engineering, vol. 1913:202-216, 1993.
23. C. Chou, C. Chen, "A perceptually optimized 3-D subband image codec for video communication over wireless channels," IEEE Trans. Circuits Syst. Video Technol., 6(2): 143-156, 1996.
24. Y. Chiu, T. Berger, "A software-only videocodec using pixelwise conditional differential replenishment and perceptual enhancement," IEEE Trans. Circuits Syst. Video Technol., vol. 9(3), pp. 438-450, 1999.
25. M. Ramasubramanian, S. Pattanaik, D. Greenberg, "A perceptual based physical error metric for realistic image synthesis," Proceedings of Computer Graphics Conference, vol. 4(33), pp. 73-82, 1999.
26. X. Zhang, W. Lin and P. Xue, "Just-Noticeable Difference Estimation With Pixels in Images," J. of Visual Commun. and Image Representation, 19(1):30-41, 2008.
27. X. Yang, W. Lin, Z. Lu, E. Ong, and S. Yao, "Just noticeable distortion model and its applications in video coding," Signal Process.:Image Commun., vol. 20, pp. 662-680, 2005.
28. A. Liu, W. Lin, M. Paul, C. Deng, F. Zhang, "Just Noticeable Difference for Images with Decomposition Model for Separating Edge and Textured Regions," IEEE Trans. Circuits Syst. Video Technol., vol. 20(11):1648-1652, 2010.
29. C.E. Shannon, "Communication in the Presence of Noise," Proc. The IRE, vol. 37, no.1, pp. 10-21, Jan. 1949.
30. C.E. Shannon, "A Mathematical Theory of Communication," Bell Syst. Tech. J., vol. 27, pp. 379-424, July 1948;
31. pp. 623-657, Oct. 1948.
32. T. Berger and J.D. Gibson, Lossy Source Coding, IEEE Trans. Information Theory, Vol.44(6), pp.2693-2723, 1998.
33. R.G. Baraniuk, E. Candes, R. Nowak and M.Vetterli, "Compressive Sampling," IEEE Signal Processing Magazine, vol.25, no.2, pp.31-40, 2008.
34. N. Jayant, J. Johnston and R. Safranek, "Signal Compression Based on Models of Human Perception", Proceedings of The IEEE, vol. 81, no.10, pp.1385-1422, October, 1993.
35. A. B. Watson, "Receptive Fields and Visual Represtations," in SPIE Proceedings. SPIE, vol. 1077, pp. 190-197, 1989.
36. D. Wu, D. Tan, M. Baird, J. DeCampo, C. White, H. Wu, "Perceptually Lossless Medical Image Coding," IEEE Trans. Medical Imaging, vol. 25(3), pp. 335-344, 2006.
37. H. Wu and K. Rao, Eds, Digital Video Image Quality and Perceptual Coding, CRC Press, 2006.
38. N.B. Nill. A Visual Model Weighted Cosine Transform for Image Compression and Quality Assessment. IEEE Transactions on Communications, vol.33(6):551-557, 1985.
39. K.K. Ngan, K.S. Leong, H.Singh. Adaptive Cosine Transform Coding of Images in Perceptual Domain. IEEE Trans. Acous., Speech, and Sig. Proc., 37: 1743-1750, 1989.
40. A.B. Watson. DCTune: A Technique for Visual Optimization of DCT Quantization Matrices for Individual Images. In Society for Information Display Digest of Technical Papers XXIV, 946-949. 1993.
41. C.-H. Chou, Y.-C. Li, "A Perceptually Tuned Subband Image Coder Based on the Measure of Just-Noticeable-Distortion Profile," IEEE Trans Circuits and Systems for Video Techn., 5(6):467-476, 1995.
42. I. Höntsch and L.J. Karam, "Locally Adaptive Perceptual Image Coding," IEEE Transactions on Image Processing, vol. 9, pages 1472-1483, Sept. 2000.
43. Z. Liu, L.J. Karam, and A.B. Watson, "JPEG2000 Encoding with Perceptual Distortion Control," IEEE Trans. on Image Proc., vol. 15, no. 7, pp. 1763-1778, Jul 2006.
44. X. Yang, W. Lin, Z. Lu, E. Ong and S. Yao, "Motion-compensated Residue Pre-processing in Video Coding Based on Just-noticeable-distortion Profile," IEEE Trans. Circuits Syst. Video Technol., vol. 15(6), pp.742-750, June, 2005.
45. D. S. Taubman, "High performance scalable image compression with EBCOT," IEEE Trans. Image Proc., Vol. 9, pp. 1158-1170, July 2000.
46. D.M. Tan, H.R. Wu and Z. Yu "Perceptual Coding of Digital Monochrome Images", IEEE Signal Processing Letters, 11(2): 239-242, February 2004.
47. D. Tan, C. Tan, H. Wu, "Perceptual Color Image Coding With JPEG2000," IEEE Trans. Image Process., vol. 19(2), pp. 374-383, June, 2010.
48. A. Pica, M. Isnardi, J. Lubin, "HVS Based Perceptual Video Encoders," in H.R. Wu, K.R. Rao, eds., Digital Video Image Quality and Perceptual Coding, CRC Press, 2006.
49. I. Dalgic and F.A. Tobagi, "A Constant Quality MPEG-1 Video Encoding Scheme and its Traffic Characterization," Int'l Picture Coding Symp. 1: 105-110, 1996.
50. T.-S. Ou, Y.-H. Huang and H.H. Chen. SSIM-Based Perceptual Rate Control for Video Coding. IEEE Trans. Circuits and Systems for Video Techn., 21(5): 682-691, 2011.
51. S. Lee, M.S. Pattichis and A.C. Bovik. Foveated Video Compression with Optimal Rate Control. IEEE Transactions on Image Imaging, 10(7): 977-992, July 2001.
52. Z. Wang, L. Lu and A.C. Bovik. Foveation Scalable Video Coding with Automatic Fixation Selection. IEEE Transactions on Image Processing, 12(2): 243-254, 2003.
53. X.Yang, W.Lin, Z.Lu, X.Lin, S.Rahardja, E.Ong, S.Yao, "Rate Control for Videophone Using Local Perceptual Cues," IEEE Trans Circuits and Systems for Video Techn., 15(4): 496-507, 2005.
54. M. Naccari, F. Pereira, "Decoder side just noticeable distortion model estimation for efficient H.264/AVC based perceptual video coding," Int. Conf. Image Processing, 2010.
55. Z. Chen and C. Guillemot, "Perceptually-friendly H.264/AVC video coding based on foveated Just-Noticeable-Distortion model," IEEE Trans. Circuits Syst. Video Technol., vol. 20(6), pp. 806-819, June 2010.
56. A. B. Watson and J. A. Solomon, "A model of visual contrast gain control and pattern masking," J. Opt. Soc. Amer. A, pp. 2379-2391, 1997.
57. Z. Yu, H.R. Wu, S. Winkler and T. Chen, "Objective Assessment of Blocking Artifacts for Digital Video with a Vision Model", Proc. of IEEE, 90(1):154-169, January 2002.
58. V. Lukin, M. Zriakhov, N. Ponomarenko, S. Krivenko, Z. Miao, "Lossy compression of images without visible distortions and its application," Int. Conf. Signal Processing, pp. 698-701, 2010.
59. Z. Wang, E. Simoncelli, and A. Bovik, "Multi-scale structural similarity for image quality assessment," IEEE Asilomar Conf. on Signals, Systems, and Computers, 2003.
60. O. Han, A. Bilgin, W. Michael, "Multi-resolution visually lossless image coding using JPEG2000," Proc. Int. Conf. Image Processing, pp. 2581-2584, 2010.
61. Z. Wei, K. Ngan, "The perceptually transparent coding for image," Int. Symp. Circuits and Systems, pp. 1621-24, 2009.
62. E. Tan, W. Gan, M. Wong, "Perceptually lossless coder based on just noticeable distortion profile with subband DCT," in Proc. Int. Symp. Consumer Electronics, pp. 253-257, 2005.
63. D. Wu, D. Tan, H. Wu, "Perceptual coding at the threshold level for the Digital Cinema System Specification," in Proc. Int. Conf. Multimedia and Expo, pp. 796-801, 2010.
64. H.R. Wu, D.M. Tan and D. Wu, "A Theoretical Framework for Perceptually Lossless Coding of Stereo 3-D Video," Proc. IASTED SIP 2011, Dallas, Texas, USA, Dec. 2011.
65. J. L. Mannos and D. J. Sakrison, "The effects of a visual fidelity criterion on the encoding of images," IEEE Trans. Information Theory, vol. 20, no. 4, pp. 525-536, July 1974.
66. F. Lukas and Z. Budrikis, "Picture quality prediction based on a visual model," IEEE Trans. Communications, vol. 30, no. 7, pp. 679-1692, July 1982.
67. S. Daly, "The visible differences predictor: An algorithm for the assessment of image fidelity," in Digital Images and Human Vision, A.B. Watson, Ed. Cambridge, MA: MIT Press, 1993, pp. 179-206.
68. J. Lubin and D. Fibush, "Sarnoff JND Vision Model," T1A1.5Working Group Document #97-612, ANSI T1 Standards Committee, 1997.
69. C. J. van den Branden Lambrecht and O. Verscheure, "Perceptual quality measure using a spatio-temporal model of the human visual system," SPIE Digital Video Compression: Algorithms and Technologies, 1996, vol. 2668, pp. 450-461.
70. S. Winkler, "A perceptual distortion metric for digital color video," in Proc. SPIE Human Vision and Electronic Imaging, San Jose, CA, January 23-29, 1999, vol. 3644, pp. 175-184.
71. Z. Wang, A. Bovik, H. Sheikh, E. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13(4): 600-612, 2004.
72. H. Sheikh and A. Bovik, "Image information and visual quality," IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, 2006.
73. D. Chandler and S. Hemami, "VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images," IEEE Trans. on Image Processing, vol. 16, no. 9, 2007.
74. A. Eskicioglu, A. Gusev, A. Shnayderman, "An SVD-Based Gray-Scale Image Quality Measure for Local and Global Assessment," IEEE Trans. Image Proces., 15:422-429, 2006.
75. M. Narwaria, and W. Lin, "Objective Image Quality Assessment Based on Support Vector Regression", IEEE Transactions on Neural Networks, 21(3):515-519, 2010.
76. X. Zhu, P. Milanfar, "Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content, " IEEE Trans. on Image Proc., 19:3116-32, 2010.
77. U. Engelke, M. Kusuma. , H.J. Zepernick and M. Caldera, "Reduced-reference metric design for objective perceptual quality assessment in wireless imaging," Signal Processing: Image Communication, Vol. 24, pp.525-547, 2009.
78. Z. Wang and X. Shang, "Spatial Pooling Strategies for Perceptual Image Quality Assessment," Proc. of IEEE International Conferencing on Image Processing, 2006.
79. A. Moorthy and A. Bovik, "Visual Importance Pooling for Image Quality Assessment," IEEE J. of Selected Topics in Signal Processing, Vol. 3, no. 2, 2009.
80. Q. Ma and L. Zhang, "Image Quality Assessment with Visual Attention," Int. Conf. on Pattern Recognition (ICPR), 2008.
81. J. You, A. Perkis, M. Hannuksela and M. Gabbouj, "Perceptual Quality Assessment Based on Visual Attention Analysis," ACM Int'l Conf. Multimedia, 2009.
82. H. Yee, S. Pattanaik, D. P. Greenberg, "Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments," ACM Trans on Graphics, 20(1): 39-65, 2001.
83. J. Haber, K. Myszkowski, H. Yamauchi, and H. P. Seidel, "Perceptually guided corrective splatting," in Computer Graphics Forum, vol. 20, pp. 142-153, 2001.
84. P. Longhurst, K. Debattista, and A. Chalmers, "Snapshot: A rapid technique for driving a selective global illumination renderer," WSCG 2005 SHORT papers proceedings, 2005.
85. K. Cater, A. Chalmers, and G.Ward, "Detail to attention: exploiting visual tasks for selective rendering," 14th Eurographics workshop on Rendering, pp. 270-280, 2003.
86. S. Lee, G. J. Kim, and S. Choi, "Real-time tracking of visually attended objects in virtual environments and its application to LOD," IEEE Trans Visualization and Computer Graphics, pp. 6-19, 2008.
87. V. Sundstedt, K. Debattista, P. Longhurst, A. Chalmers, T. Troscianko, "Visual attention for efficient high-fidelity graphics," Spring Conference on Computer Graphics, 2005.
88. V. Sundstedt, D. Gutierrez, O. Anson, F. Banterle, and A. Chalmers, "Perceptual rendering of participating media," ACM Trans. Appl. Percept., vol. 4, November 2007.
89. th Symp. on Applied Perception in Graphics and Visualization, pp. 135-140, 2010.
90. W. Stokes, J. Ferwerda, B. Walter, and D. Greenberg, "Perceptual illumination components: a new approach to efficient, high quality global illumination rendering," ACM Transactions on Graphics, vol. 23, pp. 742-749, ACM, 2004.
91. G. Ramanarayanan, J. Ferwerda, B. Walter, and K. Bala, "Visual equivalence: towards a new standard for image fidelity," ACM Trans. Graph., vol. 26, July 2007.
92. J. Křivánek, J. Ferwerda, and K. Bala, "Effects of global illumination approximations on material appearance," ACM Transactions on Graphics, vol. 29(4), pp. 112:1-112:10, 2010.
93. J.R. Casas Pla, Image Compression based on Perceptual Coding Techniques, PhD Thesis, Technical Uniersity of Catalonia, Barcelona, 1996.
94. I. Dalgic and F.A. Tobagi, "A Constant Quality MPEG-1 Video Encoding Scheme and its Traffic Characterization," Int'l Picture Coding Symp. 1: 105-110, March 1996.
95. T.-S. Ou, Y.-H. Huang and H.H. Chen. SSIM-Based Perceptual Rate Control for Video Coding. IEEE Trans. Circuits and Systems for Video Techn., 21(5): 682-691, 2011.