Real-time face detection and lip feature extraction using field-programmable gate arrays

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 36, Issue 4, 2006, Pages 902-912

  Nguyen, Duy ^a   Halupka, David ^a   Aarabi, Parham ^a   Sheikholeslami, Ali ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

Edge information; Face detection; Field programmable gate array (FPGA); Lip feature extraction; Lip tracking; Naive Bayes classifier; Sobel

Indexed keywords

EDGE DETECTION; ERROR DETECTION; FACE RECOGNITION; FEATURE EXTRACTION; STATISTICAL METHODS;

LIP FEATURE EXTRACTION; NAIVE BAYES CLASSIFIER;

FIELD PROGRAMMABLE GATE ARRAYS;

ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; AUTOMATIC SPEECH RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SYSTEM; EQUIPMENT; EQUIPMENT DESIGN; FACE; HISTOLOGY; HUMAN; INSTRUMENTATION; LIP; METHODOLOGY; SIGNAL PROCESSING;

ARTIFICIAL INTELLIGENCE; COMPUTER SYSTEMS; EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; FACE; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; LIP; PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED; SPEECH RECOGNITION SOFTWARE;

EID: 33746824139     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2005.862728     Document Type: Article

References (31)

1. L. Deng, A. Acero, M. Plumpe, and X. Huang, "Large-vocabulary speech recognition under adverse acoustic environments," in Proc. Int. Conf. Spoken Language Processing (ICSLP), Beijing, China, 2000, Vol. 3, pp. 806-809.
2. P. Aarabi and B. V. Dasarathy, "Robust speech processing using multisensor multi-source information fusion - An overview of the state of the art," Inf. Fusion, Vol. 5, no. 2, pp. 77-80, Jun. 2004.
3. P. Aarabi and B. Mungamuru, "The fusion of visual lip movements and mixed speech signals for robust speech separation," Inf. Fusion, Vol. 5, no. 2, pp. 103-117, Jun. 2004.
4. G. Potamianos, G. Gravier, A. Garg, and A. W. Senior, "Recent advances in the automatic recognition of audiovisual speech," Proc. IEEE, Vol. 91, no. 9, pp. 1306-1326, Sep. 2003.
5. X. Zhang, C. C. Broun, R. M. Mersereau, and M. A. Clements, "Automatic speechreading with applications to human-computer interfaces," EURASIP J. Appl. Signal Process., Special Issue on Audio-Visual Speech Processing, Vol. 1, pp. 1228-1247, 2002.
6. K. Nakamura, N. Murakami, K. Takagi, and N. Takagi, "A real time lipreading LSI for word recognition," in Proc. IEEE Asia-Pacific Conf. ASIC, Taipei, Taiwan, 2002, pp. 303-306.
7. I. Mathews, G. Potasmianos, C. Neti, and J. Luettin, "A comparison of model and transform-based visual features for audio-visual LVCSR," in Proc. IEEE Int. Conf. Multimedia and Expo., Tokyo, Japan, 2001, pp. 1032-1035.
8. G. Potamianos and C. Neti, "Improved ROI and within frame discriminant features for lipreading," in Proc. Int. Conf. Image Processing, Thessaloniki, Greece, 2001, pp. 250-253.
9. G. Potantianos, H. P. Graf, and E. Cosatto, "An image transform approach for HMM based automatic lipreading," in Proc. Int. Conf. Image Processing, Chicago, IL, 1998, pp. 173-177.
10. J. Yang and A. Waibel, "A real-time face tracker," in Proc. 3rd IEEE Workshop Applications Computer Vision, Sarasota, FL, 1996, pp. 142-147.
11. M. Hunke and A. Waibel, "Face locating and tracking for human-computer interaction," in Proc. 28th Asilomar Conf. Signals, Systems and Computers, Pacific Grove, CA, 1994, pp. 1277-1281.
12. R. Hsu, M. Abdel-Mottaleb, and A. K. Jain, "Face detection in color images," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 24, no. 5, pp. 696-706, May 2002.
13. D. Mario and D. Maltoni, "Real-time face location on gray-scale static images," Pattern Recognit., Vol. 33, no. 9, pp. 1525-1539, Sep. 2000.
14. S. Paschalakis and M. Bober, "A low cost FPGA system for high speed face detection and tracking," in Proc. IEEE Int. Conf. Field-Programmable Technology, Tokyo, Japan, Dec. 2003, pp. 214-221.
15. C. Papageorgiou, M. Oren, and T. Poggio, "A general frame work object detection," in Proc. Int. Conf. Computer Vision, Bombay, India, 1998, pp. 555-562.
16. H. Sahbi, D. Geman, and N. Boujemaa, "Face detection using coarse-to-fine support vector classifiers," in Proc. IEEE Int. Conf. Image Processing (ICIP), Rochester, NY, 2002, pp. 925-928.
17. H. Rowley, S. Baluja, and T. Kanade, "Neural network-based face detection," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 20, no. 1, pp. 23-28, Jan. 1998.
18. H. Rowley, S. Baluja, and T. Kanade, "Rotation invariant neural network-based face detection," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Santa Barbara, CA, Jun. 1998, pp. 38-44.
19. R. Feraud, O. J. Bernier, J. Viallet, and M. Collobert, "A fast and accurate face detector based on neural networks," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 23, no. 1, pp. 42-53, Jan. 2001.
20. H. Schneiderman and T. Kanade, "Probabilistic modeling of local appearance and spatial relationships for object recognition," in Proc. Conf. Computer Vision and Pattern Recognition, Santa Barbara, CA, 1998, pp. 45-51.
21. H. Schneiderman and T. Kanade, "A statistical model for 3D object detection applied to faces and cars," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Hilton Head Island, SC, 2000, pp. 746-751.
22. H. Schneiderman, "Learning statistical structure for object detection," in Proc. 10th Int. Conf. Computer Analysis Images and Patterns, Groningen, The Netherlands, 2003, pp. 434-441.
23. M. Kass, A. Witkin, and D. Terzopoulos, "SNAKES: Active contour models," in Proc. 1st Int. Conf. Computer Vision, London, U.K., 1987, pp. 259-268.
24. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham, "Active shape models - Their training and application," Comput. Vis. Image Underst., Vol. 12, no. 1, pp. 321-332, Jan. 1995.
25. I. Mathews, T. F. Cootes, J. A. Bangham, S. Cox, and R. Harvey, "Extraction of visual features for lipreading," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 24, no. 2, pp. 198-213, Feb. 2002.
26. T. Theocharides et al., "Embedded hardware face detection," in Proc. Int. Conf. VLSI Design, Mumbai, India, 2004, pp. 133-138.
27. R. Gonzalez and R. Woods, Digital Image Processing. Reading, MA: Addison-Wesley, 1992.
28. K. Sung and T. Poggio, "Example-based learning for view-based human face detection," IEEE Trans. Pattern Anal. Mach. Intell., Vol. 20, no. 1, pp. 39-51, Jan. 1998.
29. R. McCready, "Real-time face detection on a configurable hardware platform," M.S. thesis, Dept. Elect. Comput. Eng., Univ. Toronto, Toronto, ON, Canada, 2000.
30. M. P. Fitzgerald. (2002). CBCL Face Database #1, Center for Biological and Computational Learning at MIT. [Online]. Available: http://cbcl.mit. edu/software-datasets/FaceData2.html
31. A. Georghiades. (1997). Yale Face Database, Center for Computational Vision and Control at Yale University. [Online]. Available: http://cvc. yale.edu/projects/yalefaces/yalefaces.html