On recognizing faces in videos using clustering-based re-ranking and fusion

IEEE Transactions on Information Forensics and Security

Volumn 9, Issue 7, 2014, Pages 1056-1068

  Bhatt, Himanshu S ^a   Singh, Richa ^a   Vatsa, Mayank ^a  

^a INDRAPRASTHA INSTITUTE OF INFORMATION TECHNOLOGY   (India)

Author keywords

Face recognition; surveillance; video

Indexed keywords

ALGORITHMS; BENCHMARKING; DATABASE SYSTEMS; IMAGE MATCHING; SECURITY SYSTEMS; SPACE SURVEILLANCE;

FACE RECOGNITION PERFORMANCE; FACE RECOGNITION SYSTEMS; INTRA-PERSONAL VARIATIONS; LIMITED INFORMATION; PERFORMANCE COMPARISON; SINGLE COMPOSITES; VIDEO; VIDEO-BASED FACE RECOGNITION;

FACE RECOGNITION;

EID: 84902145584     PISSN: 15566013     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIFS.2014.2318433     Document Type: Article

References (47)

1. G. Aggarwal, A. K. R. Chowdhury, and R. Chellappa, "A system identification approach for video-based face recognition," in Proc. 17th ICPR, 2004, pp. 175-178.
2. O. Arandjelovic, G. Shakhnarovich, J. Fisher, R. Cipolla, and T. Darrell, "Face recognition with image sets using manifold density divergence," in Proc. IEEE Int. Conf. CVPR, Jun. 2005, pp. 581-588.
3. E. Bailly-Bailliére et al., "The BANCA database and evaluation protocol," in Audio-and Video-Based Biometric Person Authentication. Berlin, Germany: Springer-Verlag, 2003, pp. 625-638.
4. J. R. Barr, K. W. Bowyer, P. J. Flynn, and S. Biswas, "Face recognition from video: A review," Int. J. Pattern Recognit. Artif. Intell., vol. 26, no. 5, p. 1266002, 2012.
5. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
6. H. S. Bhatt, S. Bharadwaj, R. Singh, and M. Vatsa, "Memetically optimized MCWLD for matching sketches with digital face images," IEEE Trans. Inf. Forensics Security, vol. 7, no. 5, pp. 1522-1535, Oct. 2012.
7. H. S. Bhatt, R. Singh, and M. Vatsa, "On rank aggregation for face recognition from videos," in Proc. 20th IEEE ICIP, Sep. 2013, pp. 1-5.
8. Y. C. Chen, V. M. Patel, P. J. Phillips, and R. Chellappa, "Dictionarybased face recognition from video," in Proc. ECCV, 2012, pp. 766-779.
9. Y. C. Chen, V. M. Patel, S. Shekhar, R. Chellappa, and P. J. Phillips, "Video-based face recognition via joint sparse representation," in Proc. 10th IEEE Int. Conf. Workshops Automatic Face and Gesture Recognition, Apr. 2013, pp. 1-8.
10. Z. Cui, W. Li, D. Xu, S. Shan, and X. Chen, "Fusing robust face region descriptors via multiple metric learning for face recognition in the wild," in Proc. IEEE Int. Conf. CVPR, Jun. 2013, pp. 3554-3561.
11. Z. Cui, S. Shan, H. Zhang, S. Lao, and X. Chen, "Image sets alignment for video-based face recognition," in Proc. IEEE Int. Conf. CVPR, Jun. 2012, pp. 2626-2633.
12. K. Fukui and O. Yamaguchi, "The kernel orthogonal mutual subspace method and its application to 3D object recognition," in Proc. ACCV, 2007, pp. 467-476.
13. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, "Multi-pie," Image Vis. Comput., vol. 28, no. 5, pp. 807-813, 2010.
14. R. Gross and J. Shi, "The CMU motion of body (MoBo) database," Robotics Inst., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. CMU-RI-TR-01-18, 2001.
15. A. Hadid and M. Pietikäinen, "Manifold learning for video-to-video face recognition," in Proc. Int. Conf. Biometric ID Manag. and Multimodal Communication, 2009, pp. 9-16.
16. M. T. Harandi, C. Sanderson, S. Shirazi, and B. C. Lovell, "Graph embedding discriminant analysis on Grassmannian manifolds for improved image set matching," in Proc. IEEE Int. Conf. CVPR, Jun. 2011, pp. 2705-2712.
17. J. A. Hartigan, Clustering Algorithms (Probability and Mathematical Statistics). Hoboken, NJ, USA: Wiley, 1975.
18. Y. Hu, A. S. Mian, and R. Owens, "Sparse approximated nearest points for image set classification," in Proc. IEEE Int. Conf. CVPR, Jun. 2011, pp. 121-128.
19. A. Jain, K. Nandakumar, and A. Ross, "Score normalization in multimodal biometric systems," Pattern Recognit., vol. 38, no. 12, pp. 2270-2285, 2005.
20. K. Järvelin and J. Kekäläinen, "Cumulated gain-based evaluation of IR techniques," ACM Trans. Inform. Syst., vol. 20, no. 4, pp. 422-446, 2002.
21. M. Kim, S. Kumar, V. Pavlovic, and H. Rowley, "Face tracking and recognition with visual constraints in real-world videos," in Proc. IEEE Int. Conf. CVPR, Jun. 2008, pp. 1-8.
22. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas, "On combining classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 3, pp. 226-239, Mar. 1998.
23. B. Klare and A. K. Jain, "On a taxonomy of facial features," in Proc. 4th IEEE Int. Conf. BTAS, Sep. 2010, pp. 1-8.
24. K. Lee, J. Ho, M. Yang, and D. Kriegman, "Video-based face recognition using probabilistic appearance manifolds," in Proc. IEEE Int. Conf. CVPR, Jun. 2003, pp. 313-320.
25. K. C. Lee, J. Ho, M. H. Yang, and D. Kriegman, "Visual tracking and recognition using probabilistic appearance manifolds," Comput. Vis. Image Understand., vol. 99, no. 3, pp. 303-331, 2005.
26. H. Li, G. Hua, Z. Lin, J. Brandt, and J. Yang, "Probabilistic elastic matching for pose variant face verification," in Proc. IEEE Int. Conf. CVPR, Jun. 2013, pp. 3499-3506.
27. S. Z. Li and A. K. Jain, Handbook of Face Recognition, 2nd ed. New York, NY, USA: Springer-Verlag, 2011.
28. X. Liu and T. Chen, "Video-based face recognition using adaptive hidden Markov models," in Proc. IEEE Int. Conf. CVPR, Jun. 2003, pp. 340-345.
29. C. D. Manning, P. Raghavan, and H. Schtze, Introduction to Information Retrieval. Cambridge, U.K.: Cambridge Univ. Press, 2008.
30. H. Mendez-Vazquez, Y. Martinez-Diaz, and Z. Chai, "Volume structured ordinal features with background similarity measure for video face recognition," in Proc. ICB, Jun. 2013, pp. 1-6.
31. M. Nishiyama, M. Yuasa, T. Shibata, T. Wakasugi, T. Kawahara, and O. Yamaguchi, "Recognizing faces of moving people by hierarchical image-set matching," in Proc. IEEE Int. Conf. CVPR, Jun. 2007, pp. 1-8.
32. V. M. Patel, T. Wu, S. Biswas, P. J. Phillips, and R. Chellappa, "Dictionary-based face recognition under variable lighting and pose," IEEE Trans. Inf. Forensics Security, vol. 7, no. 3, pp. 954-965, Jun. 2012.
33. P. J. Phillips et al., "Overview of the multiple biometrics grand challenge," in Proc. Int. Conf. Advances Biometrics, 2009, pp. 705-714.
34. N. Poh et al., "An evaluation of video-to-video face verification," IEEE Trans. Inf. Forensics Security, vol. 5, no. 4, pp. 781-801, Dec. 2010.
35. A. Ross and A. Jain, "Information fusion in biometrics," Pattern Recognit. Lett., vol. 24, no. 13, pp. 2115-2125, 2003.
36. D. A. Ross, J. Lim, R.-S. Lin, and M.-H. Yang, "Incremental learning for robust visual tracking," Int. J. Comput. Vis., vol. 77, nos. 1-3, pp. 125-141, 2008.
37. F. Schroff, T. Treibitz, D. Kriegman, and S. Belongie, "Pose, illumination and expression invariant pairwise face-similarity measure via Doppelgänger list comparison," in Proc. IEEE ICCV, Nov. 2011, pp. 2494-2501.
38. G. Shakhnarovich, J. W. Fisher, and T. Darrell, "Face recognition from long-term observations," in Proc. 7th ECCV, 2002, pp. 851-868.
39. T. Sim, S. Baker, and M. Bsat, "The CMU pose, illumination, and expression database," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 12, pp. 1615-1618, Dec. 2003.
40. J. Stallkamp, H. K. Ekenel, and R. Stiefelhagen, "Video-based face recognition on real-world data," in Proc. 11th ICCV, Oct. 2007, pp. 1-8.
41. R. Wang, S. Shan, X. Chen, and W. Gao, "Manifold-manifold distance with application to face recognition based on image set," in Proc. IEEE Int. Conf. CVPR, Jun. 2008, pp. 1-8.
42. L. Wolf, T. Hassner, and I. Maoz, "Face recognition in unconstrained videos with matched background similarity," in Proc. IEEE Int. Conf. CVPR, Jun. 2011, pp. 529-534.
43. Q. Yin, X. Tang, and J. Sun, "An associate-predict model for face recognition," in Proc. IEEE Int. Conf. CVPR, Jun. 2011, pp. 497-504.
44. J. Zhang, J. Gao, M. Zhou, and J. Wang, "Improving the effectiveness of information retrieval with clustering and fusion," J. Comput. Linguist. Chin. Lang. Process., vol. 6, no. 1, pp. 109-125, 2001.
45. Z. Zhang, C. Wang, and Y. Wang, "Video-based face recognition: State of the art," in Proc. Chinese Conf. Biometric Recognition, 2011, pp. 1-9.
46. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Comput. Surv., vol. 35, no. 4, pp. 399-458, 2003.
47. S. Zhou, V. Krueger, and R. Chellappa, "Probabilistic recognition of human faces from video," Comput. Vis. Image Understand., vol. 91, nos. 1-2, pp. 214-245, 2003.