The THU multi-view face database for videoconferences and baseline evaluations

Neurocomputing

Volumn 207, Issue , 2016, Pages 48-59

  Tao, Xiaoming ^a   Dong, Linhao ^a   Li, Yang ^a   Lu, Jianhua ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Evaluation protocol; Face video database; Gaze correction; Multi view; Videoconferences

Indexed keywords

FACE RECOGNITION; SIGNAL TO NOISE RATIO; VIDEO CAMERAS; VIDEO RECORDING; VIDEO SIGNAL PROCESSING;

EVALUATION PROTOCOL; ILLUMINATION CONDITIONS; MULTI-VIEWS; PEAK SIGNAL TO NOISE RATIO; TEMPORAL SYNCHRONIZATION; VIDEO COMMUNICATIONS; VIDEO DATABASE; VIDEOCONFERENCES;

DATABASE SYSTEMS;

ANATOMICAL VARIATION; COMMUNICATION PROTOCOL; CONFERENCE PAPER; DATA BASE; FACE; FACE VIDEO DATABASE; FACIAL RECOGNITION; GAZE; ILLUMINATION; INFORMATION PROCESSING; MATHEMATICAL MODEL; PRIORITY JOURNAL; SIGNAL NOISE RATIO; STANDARDIZATION; TELECOMMUNICATION; TELEVISION CAMERA; VIDEOCONFERENCING;

EID: 85008315580     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2016.03.055     Document Type: Conference Paper

References (36)

1. N. Atzpadin, P. Kauff, O. Schreer, Stereo analysis by hybrid recursive matching for real-time immersive video conferencing, IEEE Trans. Circuits Syst. Video Technol. 14 (2004) 321–334. http://dx.doi.org/10.1109/TCSVT.2004.823391.
2. Hung, K., Zhang, Y.-T., Implementation of a WAP-based telemedicine system for patient monitoring. IEEE Trans. Inf. Technol. Biomed. 7 (2003), 101–107, 10.1109/TITB.2003.811870.
3. Luo, C., Wang, W., Tang, J., Sun, J., Li, J., Multiparty, A., Videoconferencing system over an application-level multicast protocol. IEEE Trans. Multimed. 9 (2007), 1621–1632, 10.1109/TMM.2007.907467.
4. M. Ponec, S. Sengupta, M. Chen, J. Li, P.A. Chou, Optimizing multi-rate peer-to-peer video conferencing applications, IEEE Trans. Multimed. 13 (2011) 856–868. http://dx.doi.org/10.1109/TMM.2011.2161759.
5. J. Jansen, P. Cesar, D.C.A. Bulterman, T. Stevens, I. Kegel, J. Issing, Enabling composition-based video-conferencing for the home, IEEE Trans. Multimed. 13 (2011) 869–881. http://dx.doi.org/10.1109/TMM.2011.2159369.
6. A. Criminisi, J. Shotton, A. Blake, P.H.S. Torr, Gaze manipulation for one-to-one teleconferencing, in: Proceedings of IEEE ICCV׳03 1 (2003) 191–198. http://dx.doi.org/10.1109/ICCV.2003.1238340.
7. S.-B. Lee, I.-Y. Shin, Y.-S. Ho, Gaze-corrected view generation using stereo camera system for immersive videoconferencing, IEEE Trans. Consum. Electron. 57 (2011) 1033–1040. http://dx.doi.org/10.1109/TCE.2011.6018852.
8. R. Yang, Z. Zhang, Eye gaze correction with stereovision for video-teleconferencing, IEEE Trans. Pattern Anal. Mach. Intell. 26 (2004) 956–960. http://dx.doi.org/10.1109/TPAMI.2004.27.
9. C. Kuster, T. Popa, J.C. Bazin, C. Gotsman, M. Gross, Gaze correction for home video conferencing, ACM Trans. Graph. 31 (2012) 174:1–174:6 (Proceedings of ACM SIGGRAPH ASIA). http://dx.doi.org/10.1145/2366145.2366193.
10. D. Giger, J.-C. Bazin, C. Kuster, T. Popa, M. Gross, Gaze correction with a single webcam, in: Proceedings of IEEE ICME׳14, 2014, pp. 1–6. http://dx.doi.org/10.1109/ICME.2014.6890306.
11. S. Pigeon, L. Vandendorpe, The M2VTS multimodal face database (Release 1.00), in: Proceedings of AVBPA׳97, vol. 1206, 1997, pp. 403–409. http://dx.doi.org/10.1007/BFb0016021.
12. Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J., Eigenfaces vs. Fisherfaces: recognition using class specific linear projections. IEEE Trans. Pattern Anal. Mach. Intell. 19 (1997), 711–720, 10.1109/34.598228.
13. A.M. Martínez, R. Benavente, The AR Face Database, Technical Report #24, Computer Vision Center (CVC).
14. D.B. Graham, N.M. Allinson, Characterizing virtual eigensignatures for general purpose face recognition, in: Face Recognition: From Theory to Applications. NATO ASI Series F, Computer and Systems Sciences, vol. 163, 1998, pp. 446–456.
15. K. Messer, J. Matas, J. Kittler, J. Luettin, XM2VTSDB: the extended M2VTS database, in: Proceedings of AVBPA׳99, 1999, pp. 72–77.
16. T. Kanade, J.F. Cohn, Y. Tian, Comprehensive database for facial expression analysis, in: Proceedings of IEEE FG׳00, 2000, pp. 484–490. http://dx.doi.org/10.1109/AFGR.2000.840611.
17. Phillips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J., The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22 (2000), 1090–1104, 10.1109/34.879790.
18. Marszalec, E., Martinkauppi, B., Soriano, M., Pietik, M., A physics-based face database for color research. J. Electron. Imaging 9 (2000), 32–38, 10.1117/1.482722.
19. Georghiades, A.S., Belhumeur, P.N., Kriegman, D., From few to many: generative models for recognition under variable pose and illumination. IEEE Trans. Pattern Anal. Mach. Intell. 23 (2001), 643–660, 10.1109/34.927464.
20. Sim, T., Baker, S., Bsat, M., The CMU pose, illumination, and expression database. IEEE Trans. Pattern Anal. Mach. Intell. 25 (2003), 1615–1618, 10.1109/TPAMI.2003.1251154.
21. B. Weyrauch, J. Huang, B. Heisele, V. Blanz, Component-based face recognition with 3D morphable models, in: Proceedings of IEEE CVPRW׳04, 2004, pp. 85–90. http://dx.doi.org/10.1109/CVPR.2004.41.
22. N.A. Fox, B.A. O׳Mullane, R.B. Reilly, VALID: a new practical audio-visual database, and comparative results, in: Proceedings of AVBPA׳05, vol. 3546, 2005, pp. 777–786. http://dx.doi.org/10.1007/11527923_81.
23. Gao, W., Cao, B., Shan, S., Zhou, D., Zhang, X., Zhao, D., The CAS-PEAL large-scale Chinese face database and baseline evaluations. IEEE Trans. Syst. Man Cybern. A 38 (2008), 149–161, 10.1109/TSMCA.2007.909557.
24. Huang, Z., Shan, S., Wang, R., Zhang, H., Lao, S., Kuerban, A., Chen, X., A benchmark and comparative study of video-based face recognition on COX face database. IEEE Trans. Signal Process. 24 (2015), 5967–5981, 10.1109/TIP.2015.2493448.
25. Gross, R., Matthews, I., Cohn, J., Kanade, T., Baker, S., Multi-PIE. Image Vis. Comput. 28 (2010), 807–813, 10.1016/j.imavis.2009.08.002.
26. S. Milborrow, J. Morkel, F. Nicolls, The MUCT landmarked face database, in: Proceedings of the Twenty-First Annual Symposium of the Pattern Recognition Association of South Africa (PRASA׳10), 2010.
27. Wang, S., Liu, Z., Lv, S., Lv, Y., Wu, G., Peng, P., Chen, F., Wang, X., A natural visible and infrared facial expression database for expression recognition and emotion inference. IEEE Trans. Multimed. 12 (2010), 682–691, 10.1109/TMM.2010.2060716.
28. Yeasin, M., Bullot, B., Sharma, R., Recognition of facial expressions and measurement of levels of interest from video. IEEE Trans. Multimed. 8 (2006), 500–508, 10.1109/TMM.2006.870737.
29. Nair, P., Cavallaro, A., 3-D face detection, landmark localization, and registration using a point distribution model. IEEE Trans. Multimed. 11 (2009), 611–623, 10.1109/TMM.2009.2017629.
30. Barnard, M., Koniusz, P., Wang, W., Kittler, J., Naqvi, S.M., Chambers, J., Robust multi-speaker tracking via dictionary learning and identity modeling. IEEE Trans. Multimed. 16 (2014), 864–880, 10.1109/TMM.2014.2301977.
31. Y. Moses, Y. Adini, S. Ullman, Face recognition: the problem of compensating for changes in illumination direction, in: Proceedings of ECCV׳94, vol. 800, 1994, pp. 286–296. http://dx.doi.org/10.1007/3-540-57956-7_33.
32. J. Jung, Y. Ho, Color correction method using gray gradient bar for multi-view camera system, in: Proceedings of IWAIT׳09, 2009, MP.C4(1–6).
33. J.-Y. Bouguet, Camera Calibration Toolbox for Matlab. URL 〈 http://www.vision.caltech.edu/bouguetj/calib_doc/〉.
34. J. Garofolo, L. Lamel, W. Fisher, J. Fiscus, D. Pallett, N. Dahlgren, V. Zue, TIMIT Acoustic-Phonetic Continuous Speech Corpus LDC93S1, Linguistic Data Consortium, Philadelphia.
35. Y.-S. Kang, Y.-S. Ho, Geometrical Compensation for Multi-view Video in Multiple Camera Array, in: Proceedings of IEEE ELMAR׳08, 2008, pp. 83–86.
36. Hirschmuller, H., Stereo processing by semiglobal matching and mutual information. IEEE Trans. Pattern Anal. Mach. Intell. 30 (2008), 328–341, 10.1109/TPAMI.2007.1166.