Extracting a good quality frontal face image from a low-resolution video sequence

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 10, 2011, Pages 1353-1362

  Nasrollahi, Kamal ^a   Moeslund, Thomas B ^a  

^a AALBORG UNIVERSITY   (Denmark)

Author keywords

Face quality assessment; face log generation; super resolution; surveillance video

Indexed keywords

ENTIRE SYSTEM; FACE QUALITY ASSESSMENT; FACE-LOG GENERATION; FACIAL ANALYSIS; FRONTAL FACES; HIGH RESOLUTION; IMPROVEMENT FACTORS; LEARNING-BASED SUPER-RESOLUTION; LOW QUALITIES; SIMILAR IMAGE; SUPER RESOLUTION; SUPER RESOLUTION ALGORITHMS; SURVEILLANCE CAMERAS; SURVEILLANCE VIDEO; THREE-STEP APPROACH; VIDEO SEQUENCES;

ALGORITHMS; OPTICAL RESOLVING POWER; SECURITY SYSTEMS; VIDEO RECORDING;

FACE RECOGNITION;

EID: 80053482745     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2162267     Document Type: Article

References (31)

1. V. Bannore, Iterative Interpolation Super Resolution Image Reconstruction. Berlin/Heidelberg, Germany: Springer-Verlag, 2009.
2. S. Chaudhuri, Super Resolution Imaging, 2nd ed. New York: Kluwer Academic Publishers, 2002.
3. T. S. Huang and R. Tsai, "Multi-frame image restoration and registration," Adv. Comput. Vis. Image Process., vol. 1, no. 2, pp. 317-339, 1984.
4. M. Irani and S. Peleg, "Improving resolution by image registration," Graph. Models Image Process., vol. 53, no. 3, pp. 231-239, 1991. (Pubitemid 21651453)
5. R. R. Schultz and R. L. Stevenson, "Extraction of high-resolution frames from video sequences," IEEE Trans. Image Process., vol. 5, no. 6, pp. 996-1010, Jun. 1996.
6. S. Lertrattanapanich and N. K. Bose, "High resolution image formation from low resolution frames using Delaunay triangulation," IEEE Trans. Image Process., vol. 11, no. 12, pp. 1427-1441, Dec. 2002.
7. A. J. Patti and Y. Altunbasak, "Artifact reduction for set theoretic super resolution image reconstruction with edge adaptive constraints and higher-order interpolants," IEEE Trans. Image Process., vol. 10, no. 1, pp. 179-186, Jan. 2001. (Pubitemid 32136894)
8. M. E. Tipping and C. M. Bishop, "Bayesian image super-resolution, " Adv. Neural Inform. Process. Syst., vol. 15, pp. 1303-1310, 2002.
9. A. Rav-Acha and S. Peleg, "Two motion blurred images are better than one," Pattern Recognition Lett., vol. 26, no. 3, pp. 311-317, 2005. (Pubitemid 40120813)
10. X. Li, Y. Hu, X. Gao, D. Tao, and B. Ning, "A multi-frame image super-resolution method," Signal Process., vol. 90, no. 2, pp. 405-414, 2010.
11. L. Zhang, H. Zhang, H. Shen, and P. Li, "A super-resolution reconstruction algorithm for surveillance images," Signal Process., vol. 90, no. 3, pp. 848-859, 2010.
12. S. Baker and T. Kanade, "Hallucinating faces," in Proc. IEEE Int. Conf. AFGR, Mar. 2000, pp. 83-88.
13. H. Chang, D.-Y. Yeung, and Y. Xiong, "Super-resolution through neighbor embedding," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun.-Jul. 2004, pp. 275-282.
14. O. Arandjelovic and R. Cipolla, "A manifold approach to face recognition from low quality video across illumination and pose using implicit super-resolution," in Proc. ICCV, 2007.
15. B. Li, H. Chang, S. Shan, and X. Chen, "Aligning coupled manifolds for face hallucination," IEEE Signal Process. Lett., vol. 16, no. 11, pp. 957-960, Nov. 2009.
16. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution as sparse representation of raw image patches," in Proc. Int. Conf. CVPR, 2008.
17. Y. Huang and Y. Long, "Super-resolution using neural networks based on the optimal recovery theory," J. Comput. Electron., vol. 5, no. 4, pp. 275-281, 2007.
18. C. Miravet and F. B. Rodriguez, "A two-step neural-network based algorithm for fast image super-resolution," Image Vis. Comput., vol. 25, no. 9, pp. 1449-1473, 2007. (Pubitemid 46899289)
19. V. H. Patil, D. S. Bormane, and V. S. Pawar, "Super resolution using neural network," in Proc. IEEE 2nd Asia Int. Conf. Modeling Simul., May 2008, pp. 492-496.
20. D. Glasner, S. Bagon, and M. Irani, "Super-resolution from a single image," in Proc. ICCV, 2009.
21. A. Fourney and R. Laganiere, "Constructing face image logs that are both complete and concise," in Proc. 4th IEEE Can. Conf. Comput. Vis. Robot Vis., May 2007, pp. 488-494. (Pubitemid 47432507)
22. K. Nasrollahi and T. B. Moeslund, "Complete face logs for video sequences using quality face measures," IET Int. J. Signal Process., vol. 3, no. 4, pp. 289-300, Jul. 2009.
23. P. Viola and M. Jones, "Robust real time face detection," Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, 2004.
24. E. Murphy-Chutorian and M. Trivedi, "Head pose estimation in computer vision: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 4, pp. 607-626, Apr. 2009.
25. K. Nasrollahi and T. B. Moeslund, "Face quality assessment system in video sequences," in Proc. 1st Eur. Workshop Biometrics Identity Manage., 2008.
26. N. Gourier, J. Maisonnasse, D. Hall, and J. L. Crowley, "Head pose estimation on low resolution images," in Proc. CLEAR, LNCS 4122. 2007, pp. 270-280.
27. N. Gourier and J. Letessier, "The pointing 04 data sets," in Proc. ICPR Visual Observation Deictic Gestures, 2004.
28. Z. Wang, E. P. Simoncelli, and A. C. Bovik, "Multi-scale structural similarity for image quality assessment," in Proc. IEEE Asilomar Conf. Signals Syst. Comput., Nov. 2003, pp. 1398-1402.
29. California Institute of Technology, Face Database [Online]. Available: http://www.vision.caltech.edu/archive.html
30. D. O. Gorodnichy, "Video-based framework for face recognition in video," in Proc. 2nd Can. Conf. CRV, May 2005, pp. 330-338.
31. Facegen Modeler [Online]. Available: http://www.facegen.com/modeller.htm