Face sketch-photo synthesis and retrieval using sparse representation

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 22, Issue 8, 2012, Pages 1213-1226

  Gao, Xinbo ^a   Wang, Nannan ^a   Tao, Dacheng ^b   Li, Xuelong ^c  

^a XIDIAN UNIVERSITY   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Face sketch photo synthesis; sketch photo based retrieval; sparse neighbor selection; sparse representation

Indexed keywords

INITIAL ESTIMATE; NEIGHBOR SELECTION; PHOTO RETRIEVAL; RETRIEVAL ALGORITHMS; RETRIEVAL MODES; SKETCH RETRIEVAL; SKETCH-PHOTO-BASED RETRIEVAL; SPARSE REPRESENTATION; SYNTHESIS METHOD; SYNTHESIZED IMAGES;

MEDIA STREAMING; NETWORKS (CIRCUITS);

ALGORITHMS;

EID: 84864660231     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2012.2198090     Document Type: Article

References (52)

1. W. Zhao, R. Chellappa, A. Rosenfeld, and P. Phillips, "Face recognition: A literature survey," ACM Comput. Survey, vol. 34, no. 4, pp. 399-458, 2003.
2. P. Phillips, P. Flynn, T. Scruggs, K. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the face recognition grand challenge," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 947-954. (Pubitemid 43897294)
3. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent," IEEE Trans. Image Process., vol. 20, no. 7, pp. 2030-2048, Jul. 2011.
4. N. Guan, D. Tao, Z. Luo, and B. Yuan, "Non-negative patch alignment framework," IEEE Trans. Neural Netw., vol. 22, no. 8, pp. 1218-1230, Aug. 2011.
5. T. Zhou, D. Tao, and X. Wu, "Manifold elastic net: A unified framework for sparse dimension reduction," Data Mining Knowl. Discovery, vol. 22, no. 3, pp. 340-371, 2011.
6. D. Tao, X. Li, X. Wu, and S. Maybank, "Geometric mean for subspace selection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
7. X. Gao, J. Zhong, J. Li, and C. Tian, "Face sketch synthesis algorithm based on E-HMM and selective ensemble," IEEE Trans. Circuits Syst. Video Technol, vol. 18, no. 4, pp. 487-496, Apr. 2008.
8. S. E. Brennan, "Caricature generator," M.S. thesis, MIT Media Lab., Massachusetts Instit. Technol., Cambridge, MA, 1982.
9. M. Tominaga, S. Fukuoka, K. Murakami, and H. Koshimizu, "Facial caricaturing with motion caricaturing in PICASSO system," in Proc. IEEE/ASME Int. Conf. Advanced Intell. Mechatronics, Jun. 1997, pp. 30-37.
10. H. Koshimizu, M. Tominaga, T. Fujiwara, and T. Murakami, "On KANSEI facial processing for computerized facial caricaturing system PICASSO," in Proc. IEEE Int. Conf. Syst. Man Cybern., Oct. 1999, pp. 294-299.
11. Y. Li and H. Kobatake, "Extraction of facial sketch based on morphological processing," in Proc. IEEE Int. Conf. Image Process., Oct. 1997, pp. 316-319.
12. H. Chen, N. Zheng, Y. Xu, and H. Shum, "An example-based facial sketch generation system," J. Softw., vol. 14, no. 2, pp. 202-208, 2003.
13. J. Wang, H. Bao, and W. Zhou, "Automatic image-based pencil sketch rendering," J. Comput. Sci. Technol., vol. 17, no. 5, pp. 347-356, 2002.
14. B. Klar, Z. Li, and A. Jain, "Matching forensic sketches to mug shot photos," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 3, pp. 639-646, Mar. 2011.
15. X. Tang and X. G. Wang, "Face photo recognition using sketch," in Proc. IEEE Int. Conf. Image Process., Sep. 2002, pp. 257-260.
16. X. Tang and X. G. Wang, "Face sketch recognition," IEEE Trans. Circuit Syst. Video Technol., vol. 14, no. 1, pp. 50-57, Jan. 2004.
17. X. Tang and X. Wang, "Face sketch synthesis and recognition," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2003, pp. 687-694.
18. Q. Liu and X. Tang, "A nonlinear approach for face sketch synthesis and recognition," in Proc. IEEE. Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 1005-1010. (Pubitemid 43897302)
19. X. Wang and X. Tang, "Face photo-sketch synthesis and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 11, pp. 1955-1967, Nov. 2009.
20. W. Liu, X. Tang, and J. Liu, "Bayesian tensor inference for sketch-based facial photo hallucination," in Proc. Int. Joint Conf. Artif. Intell., Jan. 2007, pp. 2141-2146.
21. W. Zhang, X. Wang, and X. Tang, "Lighting and pose robust face sketch synthesis," in Proc. Eur. Conf. Comput. Vis., vol. 6. Sep. 2010. pp. 420-433.
22. Y. Li, M. Savvides, and V. Bhagavatula, "Illumination tolerant face recognition using a novel face from sketch synthesis approach and advanced correlation filters," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., May 2006, pp. 357-360.
23. S. Roweis and L. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, pp. 2323-2326, Dec. 2000. (Pubitemid 32041578)
24. X. Gao, J. Zhong, D. Tao, and X. Li, "Local face sketch synthesis learning," Neurocomputing, vol. 71, nos. 10-12, pp. 1921-1930, 2008.
25. B. Xiao, X. Gao, X. Li, and D. Tao, "A new approach for face recognition by sketches in photos," Signal Process., vol. 89, no. 8, pp. 1531-1539, 2009.
26. J. Zhong, X. Gao, and C. Tian, "Face sketch synthesis using E-HMM and selective ensemble," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Apr. 2007, pp. 485-488.
27. B. Xiao, X. Gao, D. Tao, Y. Yuan, and J. Li, "Photo-sketch synthesis and recognition based on subspace learning," Neurocomputing, vol. 73, nos. 4-6, pp. 840-852, 2010.
28. Z. H. Zhou, J. Wu, and W. Tang, "Ensemble neural networks: Many could be better than all," Artif. Intel., vol. 137, nos. 1-2, pp. 239-263, 2002. (Pubitemid 34405220)
29. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
30. M. Yang and L. Zhang, "Gabor feature based sparse representation for face recognition with Gabor occlusion dictionary," in Proc. Eur. Conf. Comput. Vis., vol. 6. Sep. 2010, pp. 448-461.
31. M. Yang, L. Zhang, D. Zhang, and J. Yang, "Metaface learning for sparse representation based face recognition," in Proc. IEEE Int. Conf. Image Process., Sep. 2010, pp. 1601-1604.
32. L. Zhang, M. Yang, Z. Feng, and D. Zhang, "On the dimensionality reduction for sparse representation based face recognition," in Proc. Int. Conf. Pattern Recognit., Aug. 2010, pp. 1237-1240.
33. X. Yuan and S. Yan, "Visual classification with multi-task joint sparse representation," in Proc. IEEE. Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3493-3500.
34. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
35. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution as sparse representation of raw image patches," in Proc. IEEE. Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
36. W. Freeman, E. Pasztor, and O. Carmichael, "Learning low-level vision," Int. J. Comput. Vis., vol. 40, no. 1, pp. 25-47, 2000. (Pubitemid 32083682)
37. J. Sun, N. Zheng, H. Tao, and H. Shum, "Image hallucination with primal sketch priors," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2003, pp. 729-736.
38. H. Lee, A. Battle, R. Raina, and A. Ng, "Efficient sparse coding algorithms," in Proc. Adv. Neural Inform. Process. Syst., 2007, pp. 801-808.
39. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, Dec. 2006. (Pubitemid 44811686)
40. J. Mairal, G. Sapiro, and M. Elad, "Learning multiscale sparse representations for image and video restoration," SIAM Multiscale Model. Simul., vol. 7, no. 1, pp. 214-241, 2008.
41. D. L. Donoho, "For most large underdetermined systems of linear equations, the minimal ť1-norm near-solution approximates the sparsest near-solution," Comm. Pure Appl. Math., vol. 59, no. 7, pp. 907-934, 2006.
42. R. Tibshirani, "Regression shrinkage and selection via the Lasso," J. Roy. Statist. Soc. B, vol. 58, no. 1, pp. 267-288, 1996.
43. A. Martinez and R. Benavente, "The AR face database," Ohio State Univ., Columbus, OH, CVC Tech. Rep. 24, 1998.
44. K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre, "XM2VTSDB: The extended M2VTS database," in Proc. Int. Conf. Audio Video-Based Person Authentication, 1999, pp. 72-77.
45. P. J. Phillips, H. Wechsler, J. Huang, and P. Rauss, "The FERET database and evaluation procedure for face recognition algorithms," Image Vis. Comput. J., vol. 16, no. 5, pp. 295-306, 1998. (Pubitemid 128393579)
46. P. Phillips, H. Moon, S. Rizvi, and P. Rauss, "The FERET evaluation methodology for face recognition algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
47. A. Serrano, I. de Diego, C. Conde, E. Cabello, L. Shen, and L. Bai, "Influence of wavelet frequency and orientation in an SVM-based parallel Gabor PCA face verification system," in Proc. Conf. Intell. Data Eng. Automated Learning, vol. 4881. Dec. 2007, pp. 219-228. (Pubitemid 351145025)
48. M. Stone, "Cross-validatory choice and assessment of statistical predictions," J. Roy. Statist. Soc, vol. 36, no. 2, pp. 111-147, 1974.
49. N. Wang, X. Gao, D. Tao, and X. Li, "Face sketch-photo synthesis via multi-dictionary sparse representation framework," in Proc. Int. Conf. Image Graph., Aug. 2011, pp. 82-87.
50. M. Turk and A. Pentland, "Face recognition using eigenfaces," in Proc. IEEE. Int. Conf. Comput. Vis. Pattern Recognit., Jun. 1991, pp. 586-591.
51. P. Belhumeur, J. Hespanha, and D. Kriegman, "Eigenfaces versus fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997. (Pubitemid 127762263)
52. X. He, "Locality preserving projections," Ph.D. dissertation, Comput. Sci. Dept., Univ. Chicago, Chicago, IL, 2005.