Scalable image quality assessment with 2D mel-cepstrum and machine learning approach

Pattern Recognition

Volumn 45, Issue 1, 2012, Pages 299-313

  Narwaria, Manish ^a   Lin, Weisi ^a   Cetin, A Enis ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b BILKENT UNIVERSITY   (Turkey)

Author keywords

2D mel cepstral features; Feature extraction; Image quality assessment; Machine learning

Indexed keywords

2D MEL-CEPSTRAL FEATURES; COMPLEX NATURE; EFFECTIVE TOOL; GROUND TRUTH; HUMAN VISUAL SYSTEMS; IMAGE AND VIDEO PROCESSING; IMAGE DATABASE; IMAGE FEATURES; IMAGE QUALITY ASSESSMENT; MACHINE-LEARNING; OBJECTIVE IMAGE QUALITY ASSESSMENT; PATTERN RECOGNITION PROBLEMS; QUALITY ASSESSMENT; REDUCED REFERENCE; REFERENCE IMAGE; SCALABLE IMAGE; STRUCTURAL INFORMATION; TWO STAGE; TWO-STAGE PROCESS; VIDEO DATABASE; VIDEO SEQUENCES;

FEATURE EXTRACTION; LEARNING SYSTEMS; RATING; VIDEO RECORDING;

IMAGE QUALITY;

EID: 80052739658     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2011.06.023     Document Type: Article

References (92)

1. C. Yang Inverted pattern approach to improve image quality of information hiding by LSB substitution Pattern Recognition 41 2008 2674 2683
2. D. Rouse, S. Hemami, Natural image utility assessment using image contours, in: Proceedings of the International Conference on Image Processing, 2009, pp. 22172220.
3. S. Lee, H. Koo, and N. Cho Image segmentation algorithms based on the machine learning of features Pattern Recognition Letters 31 2010 2325 2336
4. F.X.J. Lukas, and Z.L. Budrikis Picture quality prediction based on a visual model IEEE Transactions on Communications 30 7 1982 679 1692
5. A. Oppenheim, and R. Schafer From frequency to quefrency: a history of the cepstrum IEEE Signal Processing Magazine 21 5 2004 95 106
6. S. Daly The visible differences predictor: an algorithm for the assessment of image fidelity A.B. Watson, Digital Images and Human Vision 1993 MIT Press Cambridge, MA 179 206
7. J. Lubin, D. Fibush, Sarnoff JND Vision Model, T1A1.5Working Group Document #97-612, ANSI T1 Standards Committee, 1997.
8. C.J. van den Branden Lambrecht, O. Verscheure, Perceptual quality measure using a spatio-temporal model of the human visual system, in: Proceedings of the SPIE digital video compression: algorithms and technologies, San Jose, CA, vol. 2668, January 28February 2, 1996, pp. 450461.
9. Y. Kessentini, T. Paquet, and A. Hamadou Off-line handwritten word recognition using multi-stream hidden Markov models Pattern Recognition Letters 31 2010 60 70
10. S. Winkler, A perceptual distortion metric for digital color video, in: Proceedings of the SPIE Human Vision and Electronic Imaging, San Jose, CA, vol. 3644, January 2329, 1999, pp. 175184.
11. Z. Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli Image quality assessment: from error visibility to structural similarity IEEE Transactions on Image Processing 13 4 2004
12. S. Winkler Perceptual video quality metrics - a review H.R. Wu, K.R. Rao, Digital Video Image Quality and Perceptual Coding 2005 CRC Press Boca Raton, FL (Chapter 5)
13. M.C. Morrone, and D.C. Burr Feature detection in human vision: a phase-dependent energy model Proceedings of the Royal Society of London B 235 1280 1988 221 245
14. M. Narwaria, W. Lin, Scalable image quality assessment based on structural vectors, in: Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP09), Rio de Janeiro, Brazil, October 57, 2009.
15. A. Eskicioglu, A. Gusev, and A. Shnayderman An SVD-based gray-scale image quality measure for local and global assessment IEEE Transactions on Image Processing 15 2 2006 422 429 (Pubitemid 43126167)
16. M. Narwaria, and W. Lin Objective image quality assessment based on support vector regression IEEE Transactions on Neural Networks 21 3 2010 515 519
17. S. Choi, Y. Lee, S. Lee, K. Park, and J. Kim Age estimation using a hierarchical classifier based on global and local facial features Pattern Recognition 44 2011 1262 1281
18. A. Watson, and L. Kreslake Measurement of visual impairment scales for digital video Proceedings of the SPIE, Human Vision Visual Processing and Digital Display 4299 2001 79 89 (Pubitemid 32934392)
19. Z. Haddad, A. Beghdadi, A. Serir, A. Mokraoui, Image quality assessment based on wave atoms transform, in: Proceedings of the International Conference on Image Processing, 2010, pp. 305308.
20. C. Wee, R. Paramesran, R. Munundan, and X. Jiang Image quality assessment by discrete orthogonal moments Pattern Recognition 43 2010 4055 4068
21. M. Liu, and X. Yang Image quality assessment using contourlet transform Optical Engineering 48 10 2009 107201
22. L. Zhang, L. Zhang, X. Mou, RFSIM: a feature based image quality assessment metric using Riesz transforms, in: Proceedings of the International Conference on Image Processing, 2010, pp. 321324.
23. J. Shin, J. Lee, and D. Kim Real-time lip reading system for isolated Korean word recognition Pattern Recognition 44 2011 559 571
24. Z. Wang, X. Shang, Spatial pooling strategies for perceptual image quality assessment, in: Proceedings of the IEEE International Conference on Image Processing, (ICIP), 2006, pp. 29452948.
25. A. Ninassi, O. Lemeur, P. Callet, D. Barba, Does where you gaze on an image affect your perception of quality? Applying visual attention to image quality metric, in: Proceedings of the IEEE International Conferencing on Image Processing (ICIP), 2007, pp. 169172
26. J. You, A. Perkis, M. Hannuksela, M. Gabbouj, Perceptual quality assessment based on visual attention analysis, in: Proceedings of the ACM International Conference on Multimedia (MM09), Beijing, China, October 1924, 2009.
27. C. Li, and A. Bovik Content-partitioned structural similarity index for image quality assessment Signal Processing: Image Communication 25 2010 517 526
28. S. Scanzio, S. Cumani, R. Gemello, F. Mana, and P. Laface Parallel implementation of artificial neural network training for speech recognition Pattern Recognition Letters 31 2010 1302 1309
29. G. Chen, C. Yang, S. Xie, Gradient-based structural similarity for image quality assessment, in: Proceedings of the IEEE International Conference on Image Processing, October 2006, pp. 29292932.
30. J.L. Mannos, and D.J. Sakrison The effects of a visual fidelity criterion on the encoding of images IEEE Transactions on Information Theory 20 4 1974 525 536
31. L. Liang, S. Wang, J. Chen b, S. Mac, D. Zhao, and W. Gao No-reference perceptual image quality metric using gradient profiles for JPEG2000 Signal Processing: Image Communication 25 2010 502 516
32. S. Cakir, A. Cetin, Image feature extraction using 2D mel-cepstrum, in: Proceedings of the International Conference on Pattern Recognition (ICPR), 2010, pp. 674677.
33. M. Narwaria, W. Lin, I.V. McLoughlin, S. Emmanuel, C.L. Tien, Non-intrusive speech quality assessment with support vector regression, in: Proceedings of the 16th International Conference on Multimedia Modeling, Lecture Notes in Computer Science, vol. 5916, 2010, pp. 325335.
34. S. Cakir, A. Cetin, Mel-cepstral methods for image feature extraction, in: Proceedings of the International Conference on Image Processing, 2010, pp. 45774580.
35. B. Scholkopf, and A.J. Smola Learning with Kernels 2002 MIT Press
36. C. Wee, R. Paramesran, and R. Mukundan Fast computation of geometric moments using a symmetric kernel Pattern Recognition 41 7 2008 2369 2380
37. T. Sylvain, A. Florent, Z. Parvez, H. Yuukou, Impact of Subjective dataset on the performance of image quality metrics, in: Proceedings of the IEEE International Conference on Image Processing, 2008.
38. H.R. Sheikh, Z. Wang, A.C. Bovik, L.K. Cormack, Image and Video Quality Assessment Research at LIVE [online]. Available from: 〈http://live.ece. utexas.edu/research/quality/〉.
39. P. Le Callet, F. Autrusseau, Subjective Quality Assessment IRCCyN/IVC Database. 〈http://www2.irccyn.ec-nantes.fr/ivcdb/〉.
40. A57 dataset: 〈http://foulard.ece.cornell.edu/dmc27/vsnr/vsnr. html〉.
41. N. Ponomarenko, M. Carli, V. Lukin, K. Egiazarian, J. Astola, F. Battisti, Color image database for evaluation of image quality metrics, in: Proceedings of the International Workshop on Multimedia Signal Processing, 2008, pp. 403408.
42. M. Peterson, D. Ridder, and H. Handels Image processing with neural networks - a review Pattern Recognition 35 2002 2279 2301 (Pubitemid 34812878)
43. F. Simone, M. Naccari, M. Tagliasacchi, F.C. Dufaux, S. Tubaro, T. Ebrahimi, Subjective assessment of H.264/AVC video sequences transmitted over a noisy channel, in: Proceedings of the First International Workshop on Quality of Multimedia Experience (QoMEX 2009), San Diego, California, July 2009.
44. P. Bartlett, S. Boucheron, and G. Lugosi Model selection and error estimation Machine Learning 2002 85 113 (Pubitemid 34247574)
45. VQEG, Final Report from the Video Quality Experts Group on the Validation of Objective Models of Video Quality Assessment, Phase II August 2003 online. Available from: 〈http://www.vqeg.org〉.
46. K. Lu, J. Zhao, and Y. Wu Hessian optimal design for image retrieval Pattern Recognition 44 2011 1155 1161
47. Z. Sazzad, Y. Kawayoke, and Y. Horita No reference image quality assessment for JPEG2000 based on spatial features Signal Processing: Image Communication 23 2008 257 268
48. F. Autrusseau, Subjective quality assessment - Fourier subband database [online]. Available from: 〈http://www.irccyn.ec-nantes.fr/∼autrusse/ Databases/FourierSB/〉, 2009.
49. D. Marr, and E. Hildreth Theory of edge detection Proceedings of the Royal Society of London B 207 1167 1980 187 217 (Pubitemid 10103608)
50. X. Ran, and N. Farvardin A perceptually-motivated three-component image model - Part I: description of the model IEEE Transactions on Image Processing 4 4 1995
51. X. Wang, T. Wang, and J. Bu Color image segmentation using pixel wise support vector machine classification Pattern Recognition 44 2011 777 787
52. U. Engelke, H.-J. Zepernick, and M. Kusuma Wireless Imaging Quality Database 2010 〈http://www.bth.se/tek/rcg.nsf/pages/wiq-db〉
53. H. Tsai, and C. Liu Wavelet-based image watermarking with visibility range estimation based on HVS and neural networks Pattern Recognition 44 2011 751 763
54. D.M. Chandler, and S.S. Hemami VSNR: a wavelet-based visual signal-to-noise ratio for natural images IEEE Transactions on Image Processing 16 9 2007
55. A. James, and S. Dimitrijev Inter-image outliers and their application to image classification Pattern Recognition 43 2010 4101 4112
56. H.R. Sheikh, and A.C. Bovik Image information and visual quality IEEE Transactions on Image Processing 15 2 2006 430 444 (Pubitemid 43126168)
57. M. Gaubatz, Metrix MUX Visual Quality Assessment Package, 〈http://foulard.ece.cornell.edu/gaubatz/metrix-mux/〉.
58. X. Zhao, Y. Satoh, H. Takauji, S. Kaneko, K. Iwata, and R. Ozaki Object detection based on a robust and accurate statistical multi-point-pair model Pattern Recognition 44 2011 1296 1311
59. S. Winkler, and P. Mohandas The evolution of video quality measurement: from PSNR to hybrid metrics IEEE Transactions on Broadcasting 54 3 2008 660 668
60. A. Maeder The image importance approach to human vision based image quality characterization Pattern Recognition Letters 26 2005 347 354 (Pubitemid 40120816)
61. O. Schwartz, and E. Simoncelli Natural signal statistics and sensory gain control Nature Neuroscience 4 2001 819 825 (Pubitemid 32702514)
62. J. Aucouturier, F. Pachet, Music similarity measures: whats the use? in: Proceedings of the International Symposium on Music Info. Retrieval (ISMIR), 2002.
63. D.O. Kim, H.S. Han, and R.H. Park Gradient information-based image quality metric IEEE Transactions on Consumer Electronics 56 2 2010 930 936
64. G. Tzanetakis, and P. Cook Musical genre classification of audio signals IEEE Transactions on Speech and Audio Processing 10 5 2002 293 302 (Pubitemid 34950067)
65. H. Terasawa, M. Slaney, and J. Berger A timbre space for speech Proceedings of the Interspeech 2005
66. L. Rabiner, and B. Juang Fundamentals of Speech Recognition 1993 Prentice-Hall, Inc. Upper Saddle River, NJ
67. S. Cakir, and A. Cetin Mel-cepstral feature extraction methods for image representation Optical Engineering 49 9 2010 097004
68. R. Arandjelović, and T. Sezgin Sketch recognition by fusion of temporal and image-based features Pattern Recognition 44 2011 1225 1234
69. 〈http://www.ponomarenko.info/psnrhvsm.htm〉.
70. D. Marr Vision 1980 W. H. Freeman and Company New York
71. D. Chandler, and S. Hemami Suprathreshold Image Compression based on Contrast Allocation and Global Precedence Proceedings of the Human Vision and Electronic Imaging 2003
72. G. Cheng, J. Huang, C. Zhu, Z. Liu, L. Cheng, Perceptual image quality assessment using a geometric structural distortion model, in: Proceedings of the IEEE International Conference on Image Processing, September 2010, pp. 325328.
73. N. Ponomarenko, F. Silvestri, K. Egiazarian, M. Carli, J. Astola, V. Lukin, On between-coefficient contrast masking of dct basis functions, in: Third International Workshop on Video Processing and Quality Metrics for Consumer Electronics, January 2007.
74. J. Melendez, D. Puig, and M. Garcia Multi-level pixel-based texture classification through efficient prototype selection via normalized cut Pattern Recognition 43 2010 4113 4123
75. S. Hemami, M. Ramos, Wavelet coefficient quantization to produce equivalent visual distortion in complex stimuli, in: Human Vision and Electronic Imaging V, Proceedings of the SPIE, vol. 3959, 2000, pp. 200210.
76. Z. Wang, A.C. Bovik, L. Lu, Why is image quality assessment so difficult? in: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, 2002.
77. C.C. Chang, C.J. Lin, LIBSVM: a library for support vector machines, 2001 [online]. Available from: 〈http://www.csie.ntu.edu.tw/verb∼cjlin/ libsvm〉.
78. H. Noda, and M. Niimi Local MAP estimation for quality improvement of compressed color images Pattern Recognition 44 2011 788 793
79. S. Antani, R. Kasturi, and R. Jain A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video Pattern Recognition 35 2002 945 965 (Pubitemid 34128817)
80. V. OBrien Contour perception, illusion and reality Journal of the Optical Society of America 48 1958 112 119
81. J.H. Elder, and S.W. Zucker Evidence for boundary-specific grouping in human vision Vision Research 38 1 1998 143 152 (Pubitemid 27494081)
82. R.L. De Valois, and K.K. De Valois Spatial Vision 1990 Oxford University Press New York
83. W.K. Pratt Digital Image Processing: PIKS Inside 3rd ed. 2001 Wiley-Interscience New York
84. W. Lin, M. Narwaria, Perceptual image quality assessment: recent progress and trends, in: Proceedings of the SPIE, vol. 7744, July 2010, p. 774403.
85. M. Sendashonga, F. Labeau, Low complexity image quality assessment using frequency domain transforms, in: Proceedings of the International Conference on Image Processing, 2006, pp. 385388.
86. B. Girod. Whats wrong with mean-squared error? in: A.B. Watson (Ed.), Digital Images and Human Vision, The MIT Press, 1993, pp. 207220.
87. W. Lin, C. Kuo, Perceptual visual quality metrics: a survey. Journal of Visual Communication and Image Representation, in press. Available from: 〈http://www.sciencedirect.com〉.
88. D. Ghiglia, and M. Pritt Two-dimensional Phase Unwrapping: Theory, Algorithms and Software 1998 John Wiley & Sons
89. S.S. Channappayya, A.C. Bovik, and R.W. Heath Rate bounds on SSIM index of quantized images IEEE Transactions on Image Processing 17 2008 1624 1639
90. Y.H. Huang, T.S. Ou, P.Y. Su, and H.H. Chen Perceptual ratedistortion optimization using structural similarity index as quality metric IEEE Transactions on Circuits Systems and Video Technology 20 11 2010 1614 1624
91. Recommendation ITU-R BT.500-11, Methodology for the subjective assessment of the quality of television pictures, June 2002.
92. W. Xue, X. Mou, Reduced reference image quality assessment based on Weibull statistics, in: Proceedings of the International Workshop on Quality of Multimedia Experience (QoMEX 2010), vol. 1, 2010, pp. 16.