SRLSP: A Face Image Super-Resolution Algorithm Using Smooth Regression with Local Structure Prior

IEEE Transactions on Multimedia

Volumn 19, Issue 1, 2017, Pages 27-40

  Jiang, Junjun ^a   Chen, Chen ^b   Ma, Jiayi ^c   Wang, Zheng ^c   Wang, Zhongyuan ^c   Hu, Ruimin ^c  

^a CHINA UNIVERSITY OF GEOSCIENCES   (China)

^b University of Central Florida   (United States)

^c WUHAN UNIVERSITY   (China)

Author keywords

Face image super resolution (SR); face recognition; local structure prior (LSP) low resolution (LR); smooth regression

Indexed keywords

HUMAN COMPUTER INTERACTION; INTERPOLATION; OPTICAL RESOLVING POWER; PIXELS; REGRESSION ANALYSIS;

EXTENDED YALE-B FACE DATABASE; FACE IMAGES; FACE RECOGNITION EXPERIMENT; FACE RECOGNITION SYSTEMS; LOW RESOLUTION; OPTICAL IMAGING SYSTEM; PERFORMANCE COMPARISON; SMOOTH REGRESSION;

FACE RECOGNITION;

EID: 85007486852     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2016.2601020     Document Type: Article

References (74)

1. L. Wang, K. Lu, and P. Liu, "Compressed sensing of a remote sensing image based on the priors of the reference image, " IEEE Geosci. Remote Sens. Lett., vol. 12, no. 4, pp. 736-740, Apr. 2015.
2. H. Lu et al., "Reference information based remote sensing image reconstruction with generalized nonconvex low-rank approximation, " Remote Sensing, vol. 8, no. 6, 2016, Art. no. 499.
3. J. Ma, C. Chen, C. Li, and J. Huang, "Infrared and visible image fusion via gradient transfer and total variation minimization, " Inf. Fusion, vol. 31, pp. 100-109, 2016.
4. H. Greenspan, "Super-resolution in medical imaging, " Comput. J., vol. 52, no. 1, pp. 43-63, 2009.
5. N. Wang, D. Tao, X. Gao, X. Li, and J. Li, "A comprehensive survey to face hallucination, " Int. J. Comput. Vis., vol. 106, no. 1, pp. 9-30, 2014.
6. Y. Yao, B. R. Abidi, N. D. Kalka, N. A. Schmid, and M. A. Abidi, "Improving long range and high magnification face recognition: Database acquisition, evaluation, and enhancement, " Comput. Vis. Image Understand., vol. 111, no. 2, pp. 111-125, 2008.
7. Z. Wang et al., "Zero-shot person re-identification via cross-view consistency, " IEEE Trans. Multimedia, vol. 18, no. 2, pp. 260-272, Feb. 2016.
8. L. An and B. Bhanu, "Face image super-resolution using 2d CCA, " Signal Process., vol. 103, pp. 184-194, 2014.
9. M.-C. Yang, C.-P. Wei, Y.-R. Yeh, and Y.-C. F. Wang, "Recognition at a long distance: Very low resolution face recognition and hallucination, " in Proc. IEEE Int. Conf. Biometrics, May 2015, pp. 237-242.
10. C.-Y. Yang, C. Ma, and M.-H. Yang, "Single-image super-resolution: A benchmark, " in Proc. Eur. Conf. Comput. Vis., 2014, pp. 372-386.
11. X. Li and M. T. Orchard, "New edge-directed interpolation, " IEEE Trans. Image Process., vol. 10, no. 10, pp. 1521-1527, Oct. 2001.
12. X. Zhang and X. Wu, "Image interpolation by adaptive 2-d autoregressive modeling and soft-decision estimation, " IEEE Trans. Image Process., vol. 17, no. 6, pp. 887-896, Jun. 2008.
13. L. Zhang and X. Wu, "An edge-guided image interpolation algorithm via directional filtering and data fusion, " IEEE Trans. Image Process., vol. 15, no. 8, pp. 2226-2238, Aug. 2006.
14. Y. Zhu, K. Li, and J. Jiang, "Video super-resolution based on automatic key-frame selection and feature-guided variational optical flow, " Signal Process.: Image Commun., vol. 29, no. 8, pp. 875-886, 2014.
15. K. Li, Y. Zhu, J. Yang, and J. Jiang, "Video super-resolution using an adaptive superpixel-guided auto-regressive model, " Pattern Recog., vol. 51, pp. 59-71, 2016.
16. Z. Lin and H.-Y. Shum, "Fundamental limits of reconstruction-based superresolution algorithms under local translation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 1, pp. 83-97, Jan. 2004.
17. W. Freeman, E. Pasztor, and O. Carmichael, "Learning low-level vision, " Int. J. Comput. Vis., vol. 40, pp. 25-47, 2000.
18. K. I. Kim and Y. Kwon, "Single-image super-resolution using sparse regression and natural image prior, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 6, pp. 1127-1133, Jun. 2010.
19. L. An and B. Bhanu, "Image super-resolution by extreme learning machine, " in Proc. IEEE Int. Conf. Image Process, Sep.-Oct. 2012, pp. 2209-2212.
20. R. Timofte, V. De, and L. Van Gool, "Anchored neighborhood regression for fast example-based super-resolution, " in Proc. Int. Conf. Comput. Vis., 2013, pp. 1920-1927.
21. Z. Zhu, F. Guo, H. Yu, and C. Chen, "Fast single image super-resolution via self-example learning and sparse representation, " IEEE Trans. Multimedia, vol. 16, no. 8, pp. 2178-2190, Dec. 2014.
22. Y. Zhang, J. Liu, W. Yang, and Z. Guo, "Image super-resolution based on structure-modulated sparse representation, " IEEE Trans. Image Process., vol. 24, no. 9, pp. 2797-2810, Sep. 2015.
23. S. Ye, C. Deng, J. Xu, and X. Gao, "Coupled fisher discrimination dictionary learning for single image super-resolution, " in Proc. Int. Conf. Acoust., Speech Signal Process., Apr. 2015, pp. 1196-1200.
24. C. Liu, H.-Y. Shum, and C.-S. Zhang, "A two-step approach to hallucinating faces: global parametric model and local nonparametric model, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Dec. 2001, vol. 1, pp. 192-198.
25. X. Wang and X. Tang, "Hallucinating face by eigentransformation, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 35, no. 3, pp. 425-434, Aug. 2005.
26. A. Chakrabarti, A. Rajagopalan, and R. Chellappa, "Super-resolution of face images using kernel PCA-based prior, " IEEE Trans. Multimedia, vol. 9, no. 4, pp. 888-892, Jun. 2007.
27. S.W. Park and M. Savvides, "Breaking the limitation of manifold analysis for super-resolution of facial images, " in Proc. Int. Conf. Acoust., Speech Signal Process., Apr. 2007, vol. 1, pp. I-573-I-576.
28. X. Zhang, S. Peng, and J. Jiang, "An adaptive learning method for face hallucination using locality preserving projections, " in Proc. 8th IEEE Int. Conf. Autom. Face Gesture Recog., Sep. 2008, pp. 1-8.
29. Y. Zhuang, J. Zhang, and F. Wu, "Hallucinating faces:Lph super-resolution and neighbor reconstruction for residue compensation, " Pattern Recog., vol. 40, no. 11, pp. 3178-3194, 2007.
30. H. Huang, H. He, X. Fan, and J. Zhang, "Super-resolution of human face image using canonical correlation analysis, " Pattern Recog., vol. 43, no. 7, pp. 2532-2543, 2010.
31. H. Huang and N. Wu, "Fast facial image super-resolution via local linear transformations for resource-limited applications, " IEEE Trans. Image Process., vol. 21, no. 10, pp. 1363-1377, Oct. 2011.
32. J.-S. Park and S.-W. Lee, "An example-based face hallucination method for single-frame, low-resolution facial images, " IEEE Trans. Image Process., vol. 17, no. 10, pp. 1806-1816, Oct. 2008.
33. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution via sparse representation, " IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
34. H. Chang, D. Yeung, and Y. Xiong, "Super-resolution through neighbor embedding, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun.-Jul. 2004, vol. 1, pp. 275-282.
35. Y. Hu, K.-M. Lam, G. Qiu, and T. Shen, "From local pixel structure to global image super-resolution: A new face hallucination framework, " IEEE Trans. Image Process., vol. 20, no. 2, pp. 433-445, Feb. 2011.
36. J. Jiang, R. Hu, Z. Wang, and Z. Han, "Noise robust face hallucination via locality-constrained representation, " IEEE Trans. Multimedia, vol. 16, no. 5, pp. 1268-1281, Aug. 2014.
37. J. Jiang, R. Hu, Z. Wang, and Z. Han, "Face super-resolution via multilayer locality-constrained iterative neighbor embedding and intermediate dictionary learning, " IEEE Trans. Image Process., vol. 23, no. 10, pp. 4220-4231, Oct. 2014.
38. X. Ma, J. Zhang, and C. Qi, "Hallucinating face by position-patch, " Pattern Recog., vol. 43, no. 6, pp. 2224-2236, 2010.
39. C. Jung, L. Jiao, B. Liu, and M. Gong, "Position-patch based face hallucination using convex optimization, " IEEE Signal Process. Lett., vol. 18, no. 6, pp. 367-370, Jun. 2011.
40. G. Gao and J. Yang, "A novel sparse representation based framework for face image super-resolution, " Neurocomputing, vol. 134, pp. 92-99, 2014.
41. C.-T. Tu and J.-R. Luo, "Robust face hallucination using ensemble of feature-based regression functions and classifiers, " Image Vis. Comput., vol. 44, pp. 59-72, 2015.
42. J. Jiang, C. Chen, K. Huang, Z. Cai, and R. Hu, "Noise robust positionpatch based face super-resolution via Tikhonov regularized neighbor representation, " Inf. Sci., vols. 367-368, pp. 354-372, 2016.
43. Z. Wang, R. Hu, S. Wang, and J. Jiang, "Face hallucination via weighted adaptive sparse regularization, " IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 5, pp. 802-813, May 2014.
44. X. Ma, H. Song, and X. Qian, "Robust framework of single-frame face superresolution across head pose, facial expression, and illumination variations, " IEEE Trans. Human-Mach. Syst., vol. 45, no. 2, pp. 238-250, Apr. 2015.
45. W. Zhang and W.-K. Cham, "Hallucinating face in the DCT domain, " IEEE Trans. Image Process., vol. 20, no. 10, pp. 2769-2779, Oct. 2011.
46. J. Jiang, R. Hu, Z. Wang, Z. Han, and J. Ma, "Facial image hallucination through coupled-layer neighbor embedding, " IEEE Trans. Circuits Syst. Video Technol., vol. 26, no. 9, pp. 1674-1684, Sep. 2016.
47. K. Su, Q. Tian, Q. Xue, N. Sebe, and J. Ma, "Neighborhood issue in singleframe image super-resolution, " in Proc. IEEE Int. Conf.Multimedia Expo, Jul. 2005, p. 4.
48. Z. Wang, Z. Miao, Q. J. Wu, Y. Wan, and Z. Tang, "Low-resolution face recognition: A review, " Vis. Comput., vol. 30, no. 4, pp. 359-386, 2014.
49. W. Zou and P. Yuen, "Very lowresolution face recognition problem, " IEEE Trans. Image Process., vol. 21, no. 1, pp. 327-340, Jan. 2012.
50. B. Li, H. Chang, S. Shan, and X. Chen, "Low-resolution face recognition via coupled locality preserving mappings, " IEEE Signal Process. Lett., vol. 17, no. 1, pp. 20-23, Jan. 2010.
51. J. Jiang, R. Hu, Z. Wang, and Z. Cai, "CDMMA: Coupled discriminant multi-manifold analysis for matching low-resolution face images, " Signal Process., vol. 124, pp. 162-172, 2016.
52. P. H. Hennings-Yeomans, S. Baker, and B. V. Kumar, "Simultaneous super-resolution and feature extraction for recognition of low-resolution faces, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2008, pp. 1-8.
53. M. Jian and K. Lam, "Simultaneous hallucination and recognition of lowresolution faces based on singular value decomposition, " IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 11, pp. 1761-1772, Nov. 2015.
54. C. Lan, R. Hu, K. Huang, and Z. Han, "Face hallucination with shape parameters projection constraint, " in Proc. 18th ACM Int. Conf. Multimedia, 2010, pp. 883-886.
55. R. Xing, J. Fu, Y. Shao, and J. You, "Rigid regression for facial image interpolation with local structure prior, " in Proc. 6th Int. Conf. Intell. Human-Mach. Syst. Cybern., 2014, vol. 2, pp. 67-70.
56. Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, "Image quality assessment: From error visibility to structural similarity, " IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
57. C. E. Thomaz and G. A. Giraldi, "A new ranking method for principal components analysis and its application to face image analysis, " Image Vision Comput., vol. 28, no. 6, pp. 902-913, 2010.
58. W. Gao et al., "The CAS-PEAL large-scale chinese face database and baseline evaluations, " IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 38, no. 1, pp. 149-161, Jan. 2008.
59. H. He and W. Siu, "Single image super-resolution using gaussian process regression, " in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2011, pp. 449-456.
60. J. Ma, J. Zhao, and A. L. Yuille, "Non-rigid point set registration by preserving global and local structures, " IEEE Trans. Image Process., vol. 25, no. 1, pp. 53-64, Jan. 2016.
61. J. Ma et al. and "Robust feature matching for remote sensing image registration via locally linear transforming, " IEEE Trans. Geosci. Remote Sens., vol. 53, no. 12, pp. 6469-6481, Dec. 2015.
62. L. Zhang and X. Wu, "An edge-guided image interpolation algorithm via directional filtering and data fusion, " IEEE Trans. Image Process., vol. 15, no. 8, pp. 2226-2238, Aug. 2006.
63. H. Rowley, S. Baluja, and T. Kanade, "Neural network-based face detection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 1, pp. 23-38, Jan. 1998.
64. C. L. P. Chen, L. Liu, L. Chen, Y. Y. Tang, and Y. Zhou, "Weighted couple sparse representation with classified regularization for impulse noise removal, " IEEE Trans. Image Process., vol. 24, no. 11, pp. 4014-4026, Nov. 2015.
65. L. Liu, L. Chen, C. L. P. Chen, Y. Y. Tang, and C.M. Pun, "Weighted joint sparse representation for removing mixed noise in image, " IEEE Trans. Cybern., to be published, doi: 10.1109/TCYB.2016.2521428
66. X. Xu, W. Liu, and L. Li, "Face hallucination: How much it can improve face recognition, " in Proc. Australian Control Conf., 2013, pp. 93-98.
67. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
68. C.-P. Wei and Y.-C. F. Wang, "Undersampled face recognition via robust auxiliary dictionary learning, " IEEE Trans. Image Process., vol. 24, no. 6, pp. 1722-1734, Jun. 2015.
69. A. Georghiades, P. Belhumeur, and D. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose, " IEEE Trans. Pattern Anal.Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
70. D. Chen, Y. Hu, C. Cai, K. Zeng, and X. Li, "Brain big data processing with massively parallel computing technology: Challenges and opportunities, " Softw.: Practice Experience, 2016. doi: 10.1002/spe.2418
71. D. Chen et al., "Fast and scalable multi-way analysis of massive neural data, " IEEE Trans. Comput., vol. 64, no. 3, pp. 707-719, Mar. 2015.
72. D. Chen et al., "Parallel simulation of complex evacuation scenarios with adaptive agent models, " IEEE Trans. Parallel Distrib. Syst., vol. 26, no. 3, pp. 847-857, Mar. 2015.
73. J. Ma, J. Zhao, J. Tian, X. Bai, and Z. Tu, "Regularized vector field learning with sparse approximation for mismatch removal, " Pattern Recog., vol. 46, no. 12, pp. 3519-3532, Dec. 2013.
74. J. Jiang, J. Ma, C. Chen, X. Jiang, and Z. Wang, "Noise robust face image super-resolution through smooth sparse representation, " IEEE Trans. Cybern., to be published, doi: 10.1109/TCYB.2016.2594184