KinectfaceDB: A kinect database for face recognition

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Volumn 44, Issue 11, 2014, Pages 1534-1548

  Min, Rui ^a   Kose, Neslihan ^b   Dugelay, Jean Luc ^b  

^a UNIVERSITY OF NORTH CAROLINA SCHOOL OF MEDICINE   (United States)

^b EURECOM   (France)

Author keywords

Database; Face recognition; Kinect

Indexed keywords

BENCHMARKING; DATABASE SYSTEMS;

BENCHMARK EVALUATION; FACE BIOMETRICS; FACE RECOGNITION METHODS; FACE RECOGNITION TECHNOLOGIES; IMAGING SENSORS; KINECT; SCORE-LEVEL FUSION; STANDARD TESTING;

FACE RECOGNITION;

EID: 84908121477     PISSN: 21682216     EISSN: 21682232     Source Type: Journal    
DOI: 10.1109/TSMC.2014.2331215     Document Type: Article

References (89)

1. (2013, Mar. 31). Microsoft Kinect [Online]. Available: http://www.xbox.com/en-US/KINECT
2. Z. Zhang, "Microsoft Kinect sensor and its effect," IEEE Multimedia, vol. 19, no. 2, pp. 4-10, Feb. 2012.
3. L. Shao, J. Han, D. Xu, and J. Shotton, Eds., "Special issue on computer vision for RGB-D sensors: Kinect and its applications," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 4, pp. 1295-1296, Aug. 2012.
4. S. Izadi et al., "KinectFusion: Real-time 3D reconstruction and interaction using a moving depth camera," in Proc. 24th Annu. ACM Symp. User Interface Softw. Technol., 2011, pp. 559-568.
5. P. Henry, M. Krainin, E. Herbst, X. Ren, and D. Fox, "RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments," Int. J. Robot. Res., vol. 31, no. 5, pp. 647-663, 2012.
6. R. Johnson, K. O'Hara, A. Sellen, C. Cousins, and A. Criminisi, "Exploring the potential for touchless interaction in image-guided interventional radiology," in Proc. SIGCHI Conf. Human Factors Comput. Syst., CHI'11, Vancouver, BC, Canada, pp. 3323-3332.
7. K. Khoshelham and S. O. Elberink, "Accuracy and resolution of Kinect depth data for indoor mapping applications," Sensors, vol. 12, no. 2, pp. 1437-1454, 2012.
8. M. Fallon, H. Johannsson, and J. Leonard, "Efficient scene simulation for robust Monte Carlo localization using an RGB-D camera," in Proc. 2012 IEEE Int. Conf. Robot. Autom. (ICRA), pp. 1663-1670.
9. J. Shotton et al., "Real-time human pose recognition in parts from single depth images," in Proc. 2011 IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Washington, DC, USA, pp. 1297-1304.
10. M. Gabel, E. Renshaw, A. Schuster, and R. Gilad-Bachrach, "Full body gait analysis with Kinect," in Proc. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. (EMBC), Aug. 2012.
11. E. Stone and M. Skubic, "Evaluation of an inexpensive depth camera for in-home gait assessment," J. Ambient Intell. Smart Environ., vol. 3, no. 4, pp. 349-361, Dec. 2011.
12. J. Preis, M. Kessel, M. Werner, and C. Linnhoff-Popien, "Gait recognition with Kinect," in Proc. 1st Workshop Kinect Pervasive Comput., 2012.
13. I. Barbosa, M. Cristani, A. Bue, L. Bazzani, and V. Murino, "Reidentification with RGB-D sensors," in Computer Vision-ECCV 2012. Workshops and Demonstrations, vol. 7583. Berlin, Germany: Springer, pp. 433-442.
14. B. C. Munsell, A. Temlyakov, C. Qu, and S. Wang, "Person identification using full-body motion and anthropometric biometrics from Kinect videos," in Proc. 12th Int. Conf. Comput. Vis. ECCV'12, vol. 7585. Florence, Italy, pp. 91-100.
15. C. Velardo and J.-L. Dugelay, "Real time extraction of body soft biometric from 3D videos," in Proc. 19th ACM Int. Conf. Multimedia MM'11, New York, NY, USA, pp. 781-782.
16. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Comput. Surv., vol. 35, no. 4, pp. 399-458, Dec. 2003.
17. A. Jain, L. Hong, and R. Bolle, "On-line fingerprint verification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 4, pp. 302-314, Apr. 1997.
18. J. Daugman, "How iris recognition works," IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 1, pp. 21-30, Jan. 2004.
19. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cognit. Neurosci., vol. 3, no. 1, pp. 71-86, Jan. 1991.
20. P. N. Belhumeur, J. A. P. Hespanha, and D. J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997.
21. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
22. P. Phillips, H. Moon, S. Rizvi, and P. Rauss, "The FERET evaluation methodology for face-recognition algorithms," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
23. J. R. Beveridge et al., "FRVT 2006: Quo vadis face quality," Image Vis. Comput., vol. 28, no. 5, pp. 732-743, May 2010.
24. P. Phillips et al., "Overview of the face recognition grand challenge," in Proc. IEEE Comput. Vis. Pattern Recognit. (CVPR), vol. 1. San Diego, CA, USA, Jun. 2005, pp. 947-954.
25. A. F. Abate, M. Nappi, D. Riccio, and G. Sabatino, "2D and 3D face recognition: A survey," Pattern Recogn. Lett., vol. 28, no. 14, pp. 1885-1906, Oct. 2007.
26. K. W. Bowyer, K. Chang, and P. Flynn, "A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition," Comput. Vis. Image Underst., vol. 101, no. 1, pp. 1-15, Jan. 2006.
27. P. J. Besl and N. D. McKay, "A method for registration of 3-D shapes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 2, pp. 239-256, Feb. 1992.
28. Y. Chen and G. Medioni, "Object modelling by registration of multiple range images," Image Vis. Comput., vol. 10, no. 3, pp. 145-155, Apr. 1992.
29. (2013, Mar. 31). KONICA Minolta [Online]. Available: http://www.konicaminolta.com/
30. R. Min, J. Choi, G. Medioni, and J. Dugelay, "Real-time 3D face identification from a depth camera," in Proc. 2012 21st Int. Conf. Pattern Recogn. (ICPR), Tsukuba, Japan, pp. 1739-1742.
31. D. C. Herrera, J. Kannala, and J. Heikkilä, "Joint depth and color camera calibration with distortion correction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 10, pp. 2058-2064, Oct. 2012.
32. D. C. Herrera, J. Kannala, and J. Heikkilä, "Accurate and practical calibration of a depth and color camera pair," in Computer Analysis of Images and Patterns, vol. 6855. Berlin, Germany: Springer, 2011, pp. 437-445.
33. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
34. W. Zhang, S. Shan, W. Gao, X. Chen, and H. Zhang, "Local Gabor binary pattern histogram sequence (LGBPHS): A novel non-statistical model for face representation and recognition," in Proc. 10th IEEE Int. Conf. Comput. Vis. (ICCV), vol. 1. 2005, pp. 786-791.
35. G. Medioni and R. Waupotitsch, "Face modeling and recognition in 3-D," in Proc. IEEE Int. Workshop Anal. Model. Faces Gestures (AMFG), 2003, pp. 232-233.
36. N. Erdogmus and J.-L. Dugelay, "On discriminative properties of TPS warping parameters for 3D face recognition," in Proc. IEEE/IAPR Int. Conf. Inf. Electron. Vis. (ICIEV), Dhaka, Bangladesh, May 2012.
37. (2013, Mar. 31). Face Recognition Homepage [Online]. Available: http://www.face-rec.org/databases/
38. R. Gross, "Face databases," in Handbook of Face Recognition, A. S. Li, Ed. New York, NY, USA: Springer, Feb. 2005.
39. A. Georghiades, P. Belhumeur, and D. Kriegman, "From few to many: Illumination cone models for face recognition under variable lighting and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
40. K. Lee, J. Ho, M. Yang, and D. Kriegman, "Video-based face recognition using probabilistic appearance manifolds," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2003.
41. K.-C. Lee, J. Ho, M.-H. Yang, and D. Kriegman, "Visual tracking and recognition using probabilistic appearance manifolds," Comput. Vis. Image Underst., vol. 99, no. 3, pp. 303-331, Sep. 2005.
42. A. Martinez and R. Benavente, "The AR face database," Dept. Electr. Comput. Eng., Ohio State Univ., CVC, Barcelona, Spain, Tech. Rep. 24, 1998.
43. R. Gross, I. Matthews, J. Cohn, T. Kanade, and S. Baker, "Multi-pie," in Proc. 8th IEEE Int. Conf. Autom. Face Gesture Recognit. (FG), Amsterdam, The Netherlands, Sep. 2008, pp. 1-8.
44. F. Samaria and A. Harter, "Parameterisation of a stochastic model for human face identification," in Proc. 2nd IEEE Workshop Appl. Comput. Vis. (WACV), Dec. 1994, pp. 138-142.
45. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: A database for studying face recognition in unconstrained environments," Comput. Sci. Dept., Univ. Massachusetts Amherst, Amherst, MA, USA, Tech. Rep. 07-49, Oct. 2007.
46. S. Marcel et al., "On the results of the first mobile biometry (MOBIO) face and speaker verification evaluation," in Recognizing Patterns in Signals, Speech, Images and Videos. Lecture Notes in Computer Science, vol. 6388. D. Ünay, Z. Çataltepe, and S. Aksoy, Eds. Berlin, Germany: Springer, 2010, pp. 210-225.
47. T. Faltemier, K. Bowyer, and P. Flynn, "Using a multi-instance enrollment representation to improve 3D face recognition," in Proc. 1st IEEE Int. Conf. Biometrics Theory Appl. Syst. (BTAS), Crystal City, VA, USA, Sep. 2007, pp. 1-6.
48. A. B. Moreno and A. Sánchez, "GavabDB: A 3D Face Database," in Proc. Workshop Biometrics Internet, Vigo, Spain, Mar. 2004, pp. 77-85.
49. "The BJUT-3D large-scale Chinese face database," Multimedia Intell. Softw. Technol. Beijing Municipal Key Lab., Beijing Univ. Technol., Beijing, China, Tech. Rep. MISKL-TR-05-FMFR-001, Aug. 2005.
50. A. Colombo, C. Cusano, and R. Schettini, "UMB-DB: A database of partially occluded 3D faces," in Proc. 2011 IEEE Int. Conf. Comput. Vis. Workshops (ICCV), pp. 2113-2119.
51. K. Messer, J. Matas, J. Kittler, and K. Jonsson, "XM2VTSDB: The extended M2VTS database," in Proc. 2nd Int. Conf. Audio Video-Based Biometric Person Authent., 1999, pp. 72-77.
52. S. Gupta, K. R. Castleman, M. K. Markey, and A. C. Bovik, "Texas 3D face recognition database," in Proc. IEEE Southwest Symp. Image Analysis Interpretation (SSIAI), May 2010, pp. 97-100.
53. (2013, Mar. 31). 3D RMA: 3D Database [Online]. Available: http://www.sic.rma.ac.be/~beumier/DB/3d-rma.html
54. (2013, Mar. 31). University of York 3D Face Database [Online]. Available: http://www-users.cs.york.ac.uk/∼nep/research/3Dface/tomh/3DFaceDatabase.html
55. L. Yin, X. Wei, Y. Sun, J. Wang, and M. J. Rosato, "A 3D facial expression database for facial behavior research," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., Southampton, U.K., 2006, pp. 211-216.
56. (2013, Mar. 31). 3dMD [Online]. Available: http://www.3dmd.com/
57. (2013, Mar. 31). Cyberware [Online]. Available: http://www. cyberware.com/
58. G. P. Otto and T. K. W. Chau, "'Region-growing' algorithm for matching of terrain images," Image Vision Comput., vol. 7, no. 2, pp. 83-94, May 1989.
59. K. W. Bowyer, K. Chang, and P. Flynn, "A survey of approaches and challenges in 3D and multi-modal 3D+2D face recognition," Comput. Vis. Image Underst., vol. 101, no. 1, pp. 1-15, Jan. 2006.
60. I. Kakadiaris et al., "Three-dimensional face recognition in the presence of facial expressions: An annotated deformable model approach," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 4, pp. 640-649, Apr. 2007.
61. H. Drira, B. B. Amor, A. Srivastava, M. Daoudi, and R. Slama, "3D face recognition under expressions, occlusions, and pose variations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 9, pp. 2270-2283, Sep. 2013.
62. A. Savran et al., "Bosphorus database for 3D face analysis," in Biometrics and Identity Management. Berlin, Germany: Springer, 2008, pp. 47-56.
63. A. Colombo, C. Cusano, and R. Schettini, "UMB-DB: A database of partially occluded 3D faces," in Proc. 2011 IEEE Int. Conf. Comput. Vis. Workshops (ICCV), Barcelona, Spain, pp. 2113-2119.
64. J. Duchon, "Splines minimizing rotation-invariant semi-norms in Sobolev spaces," in Constructive Theory of Functions of Several Variables, vol. 571. Berlin, Germany: Springer, 1977, pp. 85-100.
65. K.-C. Lee, J. Ho, M.-H. Yang, and D. Kriegman, "Video-based face recognition using probabilistic appearance manifolds," in Proc. 2003 IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. (CVPR), pp. 313-320.
66. F. Matta and J.-L. Dugelay, "Person recognition using facial video information: A state of the art," J. Vis. Lang. Comput., vol. 20, no. 3, pp. 180-187, 2009.
67. Y.-C. Chen, V. Patel, S. Shekhar, R. Chellappa, and P. Phillips, "Videobased face recognition via joint sparse representation," presented at the 2013 10th IEEE Int. Conf. Workshops Autom. Face Gesture Recognit. (FG), Shanghai, China.
68. U. Park, A. Jain, and A. Ross, "Face recognition in video: Adaptive fusion of multiple matchers," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Minneapolis, MN, USA, Jun. 2007, pp. 1-8.
69. M. Hayat, M. Bennamoun, and A. El-Sallam, "Fully automatic face recognition from 3D videos," in Proc. 2012 21st Int. Conf. Pattern Recognit. (ICPR), Tsukuba, Japan, pp. 1415-1418.
70. M. Hernandez, J. Choi, and G. Medioni, "Laser scan quality 3-D face modeling using a low-cost depth camera," in Proc. 2012 Eur. Signal Process. Conf. (EUSIPCO), pp. 1995-1999.
71. OpenNI. (2010 Nov.). OpenNI User Guide [Online]. Available: http://www.openni.org/documentation
72. F. Barak, S. Alexander, M. Meir, and A. Yoel, "Depth mapping using projected patterns," U.S. Patent 20100118123, May 2010 [Online]. Available: http://www.faqs.org/patents/app/20100201811
73. R. Tsai, "An efficient and accurate camera calibration technique for 3D machine vision," in Proc. Comput. Vision Pattern Recognit., 1986.
74. A. Jain, S. Dass, and K. Nandakumar, "Soft biometric traits for personal recognition systems," in Biometric Authentication, vol. 3072. Berlin, Germany: Springer, 2004, pp. 731-738.
75. A. Dantcheva, C. Velardo, A. D'Angelo, and J.-L. Dugelay, "Bag of soft biometrics for person identification," Multimedia Tools Appl., vol. 51, no. 2, pp. 739-777, Jan. 2011.
76. G. Farinella and J.-L. Dugelay, "Demographic classification: Do gender and ethnicity affect each other?" in Proc. IEEE/IAPR Int. Conf. Inf. Electron. Vis. (ICIEV), Dhaka, Bangladesh, May 2012.
77. X. Lu, H. Chen, and A. K. Jain, "Multimodal facial gender and ethnicity identification," in Proc. 2006 Int. Conf. Adv. Biometrics (ICB), pp. 554-561.
78. E. Rosten and T. Drummond, "Machine learning for high-speed corner detection," in Computer Vision-ECCV 2006, vol. 3951. Berlin, Germany: Springer, pp. 430-443.
79. M. Zollhöfer, M. Martinek, G. Greiner, M. Stamminger, and J. Sübmuth, "Automatic reconstruction of personalized avatars from 3D face scans," Comput. Animat. Virtual Worlds, vol. 22, nos. 2-3, pp. 195-202, Apr. 2011.
80. C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color images," in Proc. 6th Int. Conf. Comput. Vis., Bombay, India, 1998, pp. 839-846.
81. C. Geng and X. Jiang, "Face recognition using sift features," in Proc. 2009 16th IEEE Int. Conf. Image Process. (ICIP), Cairo, Egypt, pp. 3313-3316.
82. (2013, Mar. 31). TABULA RASA [Online]. Available: http://www.tabularasa-euproject.org/
83. Y. Huang, Y. Wang, and T. Tan, "Combining statistics of geometrical and correlative features for 3D face recognition," in Proc. BMVC, 2006, pp. 90.1-90.10.
84. T. Huynh, R. Min, and J.-L. Dugelay, "An efficient LBP-based descriptor for facial depth images applied to gender recognition using RGB-D face data," in Computer Vision-ACCV 2012 Workshops, vol. 7728. Berlin, Germany: Springer, 2013, pp. 133-145.
85. T. Cootes, G. Edwards, and C. Taylor, "Active appearance models," in Computer Vision-ECCV'98, vol. 1407. Berlin, Germany: Springer, 1998, pp. 484-498.
86. I. Matthews, J. Xiao, and S. Baker, "2D vs. 3D deformable face models: Representational power, construction, and real-time fitting," Int. J. Comput. Vis., vol. 75, no. 1, pp. 93-113, 2007.
87. J. Harguess and J. Aggarwal, "A case for the average-half-face in 2D and 3D for face recognition," in Proc. IEEE Comput. Soc. Conf. CVPR Workshops, Miami, FL, USA, Jun. 2009, pp. 7-12.
88. Y. Liu, R. Weaver, K. Schmidt, N. Serban, and J. Cohn, "Facial asymmetry: A new biometric," Robot. Inst., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. CMU-RI-TR-01-23, Aug. 2001.
89. R. Min, A. Hadid, and J. Dugelay, "Improving the recognition of faces occluded by facial accessories," in Proc. 2011 IEEE Int. Conf. Autom. Face Gesture Recognit. Workshops (FG), Santa Barbara, CA, USA, pp. 442-447.