Fourier transform-based scalable image quality measure

IEEE Transactions on Image Processing

Volumn 21, Issue 8, 2012, Pages 3364-3377

  Narwaria, Manish ^a   Lin, Weisi ^a   McLoughlin, Ian Vince ^a   Emmanuel, Sabu ^a   Chia, Liang Tien ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Fourier phase and magnitude; image quality assessment (IQA); non uniform frequency bins

Indexed keywords

DIFFERENT FREQUENCY; DISTORTED IMAGES; FOURIER; FREQUENCY BINS; FREQUENCY COMPONENTS; GRACEFUL DEGRADATION; HUMAN VISUAL SYSTEM; IMAGE QUALITY ASSESSMENT; IN-PHASE; PREDICTION PERFORMANCE; QUALITY ASSESSMENT; REDUCED REFERENCE; REDUCED SPACE; REFERENCE IMAGE; SCALABLE IMAGE; VIDEO DATABASE;

DEGRADATION; DISCRETE FOURIER TRANSFORMS; IMAGE QUALITY;

ALGORITHMS;

ALGORITHM; ARTICLE; ARTIFACT; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; FOURIER ANALYSIS; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; PROCEDURES;

ALGORITHMS; ARTIFACTS; FOURIER ANALYSIS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 84864124329     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2197010     Document Type: Article

References (66)

1. Methodology for the Subjective Assessment of the Quality of Television Pictures, ITU-R Standard BT.500-11, Jun. 2002.
2. S. Winkler, "Perceptual video quality metrics-a review," in Digital Video Image Quality and Perceptual Coding, H. R. Wu and K. R. Rao, Eds. Boca Raton, FL: CRC Press, 2005, ch. 5.
3. S. Winkler and P. Mohandas, "The evolution of video quality measurement: From PSNR to hybrid metrics," IEEE Trans. Broadcast., vol. 54, no. 3, pp. 660-668, Sep. 2008.
4. W. Lin and M. Narwaria, "Perceptual image quality assessment: Recent progress and trends," Proc. SPIE, vol. 7744, p. 774403, Jul. 2010.
5. W. Lin and C. Kuo, "Perceptual visual quality metrics: A survey," J. Visual Commun. Imag. Represent., vol. 22, no. 4, pp. 297-312, 2011.
6. Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, "Image quality assessment: From error measurement to structural similarity," IEEE Trans. Imag. Process., vol. 13, no. 4, pp. 1-4, Apr. 2004.
7. Y. Huang, T. Ou, P. Y. Su, and H. H. Chen, "Perceptual rate-distortion optimization using structural similarity index as quality metric," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 11, pp. 1614-1624, Nov. 2010.
8. B. Girod, "What's wrong with mean-squared error?" in Digital Images and Human Vision, A. B. Watson, Ed. Cambridge, MA: MIT Press, 1993, pp. 207-220.
9. J. Mannos and D. Sakrison, "The effects of a visual fidelity criterion on the encoding of images," IEEE Trans. Inf. Theory, vol. 20, no. 4, pp. 525-536, Jul. 1974.
10. F. X. J. Lukas and Z. L. Budrikis, "Picture quality prediction based on a visual model," IEEE Trans. Commun., vol. 30, no. 7, pp. 679-1692, Jul. 1982.
11. S. Daly, "The visible difference predictor: An algorithm for the assessment of image fidelity," in Digital Images and Human Vision, A. B. Watson, Ed. Cambridge, MA: MIT Press, 1993, pp. 179-206.
12. J. Lubin, "The use of psychophysical data and models in the analysis of display system performance," in Digital Images and Human Vision, A. B. Watson, Ed. Cambridge, MA: MIT Press, 1993, pp. 163-178.
13. C. Lambrecht and O. Verscheure, "Perceptual quality measure using a spatio-temporal model of the human visual system," Proc. SPIE Digital Video Compress.: Algorithms Technol., vol. 2668, pp. 450-461, Jan. 1996.
14. S. Winkler, "A perceptual distortion metric for digital color video," Proc. SPIE Human Vis. Electron. Imag., vol. 3644, pp. 175-184, Jan. 1999.
15. H. Sheikh and A. Bovik, "Image information and visual quality," IEEE Trans. Imag. Process., vol. 15, no. 2, pp. 430-444, Feb. 2006. (Pubitemid 43126168)
16. D. Chandler and S. Hemami, "VSNR: A wavelet-based visual signalto-noise ratio for natural images," IEEE Trans. Imag. Process., vol. 16, no. 9, pp. 2284-2298, Sep. 2007. (Pubitemid 47316675)
17. M. Narwaria and W. Lin, "Scalable image quality assessment based on structural vectors," in Proc. IEEE Int. Workshop Multimedia Signal Process., Oct. 2009, pp. 1-6.
18. A. M. Eskicioglu, A. Gusev, and A. Shnayderman, "An SVD-based grayscale image quality measure for local and global assessment," IEEE Trans. Imag. Process., vol. 15, no. 2, pp. 422-429, Feb. 2006. (Pubitemid 43126167)
19. M. Sendashonga and F. Labeau, "Low complexity image quality assessment using frequency domain transforms," in Proc. Int. Conf. Imag. Process., 2006, pp. 385-388.
20. C. Wee, R. Paramesran, R. Munundan, and X. Jiang, "Image quality assessment by discrete orthogonal moments," Pattern Recognit., vol. 43, no. 12, pp. 4055-4068, 2010.
21. M. Liu and X. Yang, "Image quality assessment using contourlet transform," Opt. Eng., vol. 48, no. 10, p. 107201, 2009.
22. A. Oppenheim and J. Lim, "The importance of phase in signals," Proc. IEEE, vol. 69, no. 5, pp. 529-541, May 1981.
23. X. Ni and X. Huo, "Statistical interpretation of the importance of phase information in signal and image reconstruction," Stat. Probab. Lett. vol. 77, no. 4, pp. 447-454, 2007.
24. P. Kovesi, "Phase preserving denoising of images," in Proc. Australian Pattern Recognit. Soc. Conf., 1999, pp. 212-172.
25. M. C. Morrone and D. C. Burr, "Feature detection in human vision: A phase-dependent energy model," Proc. Royal Soc., London Ser. B, vol. 235, no. 1280, pp. 221-245, 1988.
26. K. Gegenfurtner, D. Braun, and F. Wichmann, "The importance of phase information for recognizing natural images," J. Vis., vol. 3, no. 9, p. 519, 2003.
27. B. C. Hansen and R. F. Hess, "Structural sparseness and spatial phase alignment in natural scenes," J. Opt. Soc. Amer., vol. 24, no. 7, pp. 1873-1885, 2007. (Pubitemid 47342612)
28. W. Hsiao and R. Millane, "Effects of spectral amplitude and phase errors on image reconstruction," Proc. SPIE, vol. 5562, no. 27, pp. 175-180, 2004.
29. W. Hsiao and R. Millane, "Effects of Fourier-plane amplitude and phase errors on image reconstruction. I. Small amplitude errors," J. Opt. Soc. Amer. A, vol. 24, no. 10, pp. 3180-3188, 2007. (Pubitemid 350238779)
30. M. Thomson, D. Foster, and R. Summers, "Human sensitivity to phase perturbations in natural images: A statistical framework," Perception, vol. 29, no. 9, pp. 1057-1069, 2000.
31. G. Blanchet, L. Moisan, and B. Rouge, "Measuring the global phase coherence of the image," in Proc. IEEE Int. Conf. Imag. Process., Jan. 2008, pp. 1176-1179.
32. C. Juglin and D. Hines, "The phase correlation image alignment method," in Proc. Int. Conf. Cybern. Soc., 1975, pp. 163-65.
33. T. Alieva and M. Calvo, "Importance of the phase and amplitude in the fractional Fourier domain," J. Opt. Soc. Amer., vol. 20, no. 3, pp. 533-541, 2003.
34. J. Bretel, T. Caelli, R. Hilz, and I. Rentschler, "Modelling perceptual distortion: Amplitude and phase transmission in the human visual system," Human Neurobiol., vol. 1, no. 1, pp. 61-67, 1982. (Pubitemid 12009935)
35. Y. Tadmor and D. Tolhurst, "Both the phase and the amplitude spectrum may determine the appearance of natural images," Vis. Res., vol. 33, no. 1, pp. 141-145, 1993. (Pubitemid 23032231)
36. K. Ito, T. Aoki, E. Kosuge, R. Kawamata, and I. Kashima, "Medical image registration using phase-only correlation for distorted dental radiographs," in Proc. IEEE Int. Conf. Pattern Recognit., Dec. 2008, pp. 1-4.
37. K. Ito, T. Aoki, H. Nakajima, K. Kobayashi, and T. Higuchi, "A palmprint recognition algorithm using phase-based image matching," in Proc. IEEE Int. Conf. Imag. Process., Oct. 2006, pp. 2669-2672.
38. C. Guo, Q. Ma, and L. Zhang, "Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
39. A. Sao and B. Yegnanarayana, "On the use of phase of the Fourier transform for face recognition under variations in illumination," Signal, Imag. Video Process., vol. 4, no. 3, pp. 353-358, 2009.
40. S. Mitra, M. Savvides, and A. Brockwell, "Modeling phase spectra using Gaussian mixture models for human face identification," in Pattern Recognition and Image Analysis (Lecture Notes in Computer Science), vol. 3687. New York: Springer-Verlag, 2005, pp. 174-182. (Pubitemid 41520468)
41. S. Rajagopalan and R. Robb, "Phase based image quality assessment," Proc. SPIE Med. Imag. Percept., Observer Perform., Technol. Assessment, vol. 5749, pp. 373-382, Feb. 2005. (Pubitemid 41275025)
42. P. Skurowski and A. Gruca, "Image quality assessment using phase spectrum correlation," in Computer Vision and Graphics (Lecture Notes in Computer Science), vol. 5337. New York: Springer-Verlag, 2009, pp. 80-89.
43. W. Lin, L. Dong, and P. Xue, "Visual distortion gauge based on discrimination of noticeable contrast changes," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 7, pp. 900-909, Jul. 2005. (Pubitemid 41119225)
44. N. Ponomarenko, F. Silvestri, K. Egiazarian, M. Carli, J. Astola, and V. Lukin, "On between-coefficient contrast masking of DCT basis functions," in Proc. 3rd Int. Workshop Video Process. Qual. Metrics Consumer Electron., Jan. 2007, pp. 1-4.
45. H. R. Sheikh, Z. Wang, A. C. Bovik, and L. K. Cormack. Image and Video Quality Assessment Research at LIVE [Online]. Available: http://live.ece.utexas. edu/research/quality/
46. E. C. Larson and D. M. Chandler. Categorical Image Quality (CSIQ) Database [Online]. Available: http://vision.okstate.edu/csiq
47. A. Ninassi, P. L. Callet, and F. Autrusseau. Subjective Quality Assessment-IVC Database [Online]. Available: http://www2.irccyn.ecnantes. fr/ivcdb
48. Y. Horita, K. Shibata, Y. Kawayoke, and Z. Sazzad. MICT Image Quality Evaluation Database [Online]. Available: http://mict.eng.utoyama. ac.jp/mict/index2.html
49. D. M. Chandler and S. S. Hemami. VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images [Online]. Available: http://foulard.ece.cornell.edu/dmc27/vsnr/vsnr.html
50. N. Ponomarenko, M. Carli, V. Lukin, K. Egiazarian, J. Astola, and F. Battisti, "Color image database for evaluation of image quality metrics," in Proc. Int. Workshop Multimedia Signal Process., Oct. 2008, pp. 403-408.
51. U. Engelke, H.-J. Zepernick, and M. Kusuma. (2010). Wireless Imaging Quality Database [Online]. Available: http://www.bth.se/tek/rcg.nsf/ pages/wiq-db
52. R. Kakarala, "Signal processing approach to Fourier analysis of ranking data: The importance of phase," IEEE Trans. Signal Process., vol. 59, no. 4, pp. 1518-1527, Apr. 2011.
53. F. Simone, M. Naccari, M. Tagliasacchi, F. C. Dufaux, S. Tubaro, and T. Ebrahimi, "Subjective assessment of H.264/AVC video sequences transmitted over a noisy channel," in Proc. 1st Int. Workshop Qual. Multimedia Experience, 2009, pp. 204-209.
54. Y. Wang. (2003, Aug.). Final Report from the Video Quality Experts Group on the Validation of Objective Models of Video Quality Assessment, Phase II [Online]. Available: http://www.vqeg.org
55. G. Chen, C. Yang, and S. Xie, "Gradient-based structural similarity for image quality assessment," in Proc. Int. Conf. Imag. Process., 2006, pp. 2929-2932.
56. G. Cheng, J. Huang, C. Zhu, Z. Liu, and L. Cheng, "Perceptual image quality assessment using a geometric structural distortion model," in Proc. Int. Conf. Imag. Process., 2010, pp. 325-328.
57. Q. Li and Z. Wang, "Reduced-reference image quality assessment using divisive normalization based image representation," IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 202-211, Apr. 2009.
58. A. Rehman and Z. Wang, "Reduced-reference SSIM estimation," in Proc. IEEE Int. Conf. Imag. Process., Sep. 2010, pp. 289-292.
59. Z. Wang, E. Simoncelli, and A. Bovik, "Multi-scale structural similarity for image quality assessment," in Proc. IEEE Asilomar Conf. Signals, Syst., Comput., Nov. 2003, pp. 1398-1402.
60. S. Cakir and A. Cetin, "Mel-cepstral feature extraction methods for image representation," Opt. Eng., vol. 49, no. 9, p. 097004, 2010.
61. V. Ojansivu and J. Heikkila, "Image registration using blur-invariant phase correlation," IEEE Signal Process. Lett., vol. 14, no. 7, pp. 449-452, Jul. 2007. (Pubitemid 47018912)
62. K. Castleman, Digital Image Processing. Englewood Cliffs, NJ: Prentice-Hall, 1996.
63. Y. Fang, W. Lin, C. Lau, and B. Lee, "A visual attention model combining top-down and bottom-up mechanisms for salient object detection," in Proc. Int. Conf. Acoust., Speech Signal Process., 2011, pp. 1293-1296.
64. N. Skarbnik, C. Sagiv, and Y. Zeevi, "Edge detection and skeletonization using quantized localized phase," in Proc. 17th Eur. Signal Process. Conf., 2009, pp. 1542-1546.
65. T. Huang, J. Burnett, and A. Deczky, "The importance of phase in image processing filters," IEEE Trans. Acoust. Speech, Signal Process., vol. 23, no. 6, pp. 529-542, Dec. 1975.
66. M. Narwaria and W. Lin, "Objective image quality assessment based on support vector regression," IEEE Trans. Neural Netw., vol. 21, no. 3, pp. 515-519, Mar. 2010.