Processing of face images and its applications

IEICE Transactions on Information and Systems

Volumn E82-D, Issue 3, 1999, Pages 589-600

  Kaneko, Masahide ^a   Hasegawa, Osamu ^a  

^a ELECTROTECHNICAL LABORATORY   (Japan)

Author keywords

Applications; Face; Facial information; Recognition of face images; Synthesis of face images; Tools and databases

Indexed keywords

DIGITAL PROCESSING METHODS; FACE RECOGNITION; INTELLIGENT IMAGE CODING; MEDIA HANDLING;

COMPUTER AIDED SOFTWARE ENGINEERING; DATABASE SYSTEMS; FEATURE EXTRACTION; HUMAN COMPUTER INTERACTION; IMAGE CODING; OBJECT RECOGNITION;

IMAGE ANALYSIS;

EID: 0033321204     PISSN: 09168532     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (76)

1. T. Kanade, "Computer Recognition of Human Faces," Basel and Stuttgart, Birkhauser Verlag, 1977.
2. H. Harashima, "Intelligent image coding and communication," Journal of the Institute of Television Engineers of Japan, vol.42, no.6, pp.519-525, June 1988. (in Japanese)
3. A. Samal and P.A. lyengar, "Automatic recognition and analysis of human faces and facial expressions: A survey," Pattern Recognition, vol.25, no.l, pp.65-77, Jan. 1992.
4. D. Valentin, H. Abdi, A.J. O'Toole, and G.W. Cottrell, "Connectionist models of face processing, A survey," Pattern Recognition, vol.27, no.9, pp.1209-1230, Sept. 1994.
5. R. Chellappa, C.L. Wilson, and S. Sirohey, "Human and machine recognition of faces, A survey," Proc. of the IEEE, vol.83, no.5, May 1995.
6. S. Akamatsu, "Computer recognition of human face-A survey," IEICE Trans., vol.JSO-D-II, no.8, pp.2031-2046, Aug. 1997. (in Japanese)
7. O. Hasegawa, S. Morishima, and M. Kaneko, "Processing of facial information by computer," Electronics and Communications in Japan, Scripta Technica, Part 3, vol.81, no.10, pp.36-57, Oct. 1998. (translated from IEICE Trans., vol.JSO-D-II, no.8, pp.2047-2065, Aug. 1997. (in Japanese))
8. S. Yoshikawa, M. Masuya, and M. Nakamura, "Face and Mind-Introduction to Psychology of Face," Saiensu Publishers Inc., 1993. (in Japanese)
9. T. Kurokawa, "Non-verbal Interface," Ohmsha Ltd., 1994. (in Japanese)
10. Y. Kohara, "Anthropology of Face and Its Expression," Heibonsha Limited, Publishers, Tokyo, 1995. (in Japanese)
11. M. Turk and A. Pentland, "Eigenfaces for recognition," Journal of Cognitive Neuroscience, vol.3, no.l, pp.71-86, 1991.
12. E. Osuna, R. Freund, and F. Girosi, "Training support vector machines: an application to face detection," Proc. of CVPR'97, 17-19, June 1997.
13. O. Hasegawa, K. Yokosawa, and M. Ishizuka, "Real-time parallel and cooperative recognition of facial images for an interactive visual human interface," Proc. of the 12th IAPR Int'l Conf. on Pattern Recognition (ICPR'94), pp.384-387, Oct. 1994.
14. R. Brunelli and T. Poggio, "Face recognition: Features versus templates," IEEE Trans, on Pattern Analysis and Machine Intelligence (PAMI), vol.15, no.10, pp.1042-1052, Oct. 1993.
15. P. Phillips, II. Wechsler, J. Huang, and P. Rauss, "The FERET database and evaluation procedure for facerecognition algorithm," Image and Vision Computing, vol.lG, pp.295-306, 1998.
16. S.A. Rizvi, P. Phillips, and H. Moon, "The FERET verification testing protocol for face recognition algorithms," Proc. of IEEE Conference on Automatic Face and Gesture Recognition, pp.48-53, April 1998.
17. A. Pentland, B. Moghaddam, and T. Starner, "View-based and modular eigenspaccs for recognition," Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, pp.8491, July 1994.
18. D. Swets and J. Weng, "Using discriminant eigenfeatures for image retrieval," IEEE Trans, on PAMI, vol.18, no.8, pp.831-836, Aug. 1996.
19. B. Moghaddam and A. Pentland, "Probabilistic visual learning for object representation," IEEE Trans, on PAMI, vol.19, no.7, pp.696-710, July 1997.
20. T. Kurita, N. Otsu, and T. Sato, "A face recognition method using higher order local autocorrelation and multivariate analysis," Proc. of the llth IAPR Int'l Conf. on Pattern Recognition (ICPR'92), vol.11, pp.213-216, Aug. 1992.
21. F. Goudali, E. Lange, T. Iwamoto, K. Kyuma, and N. Otsu, "Face recognition system using local autocorrelations and multiscale integration," IEEE Trans, on PAMI, vol.18, no.10, pp.1024-1028, Oct. 1996.
22. L. Woskott and C.v.d. Malsburg, "Recognizing faces by dynamic link matching," Proc. of the International Conference on Artificial Neural Networks (ICANN 95), pp.347352, Oct. 1995.
23. K. Matsuno, C.W. Lee, S. Kimura, and S. Tsuji, "Automatic recognition of human facial expressions," Proc. of the Int'l Conf. on Computer Vision (ICCV'95), pp.352-359, June 1995.
24. H. Kobayashi, A. Tange, and F. Hara, "Real-time recognition of 6 basic facial expressions," Proc. of IEEE International Workshop on Robot and Human Communication (RO-MAN'95), pp.179-186, July 1995.
25. M. Kenji, "Recognition of facial expressions by optical flow," IEICE Trans., Special Issue on Computer Vision and Its Applications, vol.74E, no.10, pp.3474-3483, Oct. 1991.
26. I.A. Essa and A. Pentland, "Coding, analysis, interpretation, and recognition of facial expressions," IEEE Trans, on PAMI, vol.19, no.7, pp.757-763, July 1993.
27. M.J. Black and Y. Yacoob, "Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion," Proc. of the Int'l Conf. on Computer Vision (ICCV'95), pp.374-381, June 1995.
28. A. Lanitis, C.J. Taylor, and T.F. Coûtes, "A unified approach to coding and interpreting face images," Proc. of the Int'l Conf. on Computer Vision (ICCV'95), pp.368-373, June 1995.
29. T.F. Cootes, G.J. Edwards, and C.J. Taylor, "Active appearance models," Proc. of European Conference on Computer Vision (ECCV'98), vol.2, pp.484-498, June 1998.
30. D. Terzopoulos and K. Waters, "Analysis and synthesis of facial image sequences using physical and anatomical models," IEEE Trans, on PAMI, vol.15, no.6, pp.569-579, June 1993.
31. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, and D.H. Salesin, "Synthesizing realistic facial expressions from photographs," SIGGRAPH98 Conference Proc., pp.75-84, July 1998.
32. B. Guentcr, C. Grimm, D. Wood, H. Malvar, and F. Pighin, "Making faces," SIGGRAPH98 Conference Proc., pp.55-66, July 1998.
33. H. Harasliima, K. Aizawa, and T. Saito, "Model-based analysis and synthesis coding of videotelephone imagesconception and basic study of intelligent image coding," IEICE Trans., vol.E72, no.5, pp.452-459, May 1989.
34. M. Kaneko, Y. Hatori, and A. Koike, "Coding of facial images based on 3-D model of head and analysis of shape changes in input image sequence," IEICE Trans., vol.J71B, no.12, pp.1554-1563, Dec. 1988. (in Japanese)
35. M.C. Park, T. Naemura, M. Kaneko, and H. Harasliima, "Recognition of facial gestures using the GRIP method for head motion estimation and hidden Markov models," IEEE Int. Conf. on Image Processing, vol.4, no.861, Oct. 1997. (in CD-ROM)
36. T. Yokoyama, Y. Yagi, M. Yachida, and H. Wu, "Face contour extraction by using active contour model based on axis symmetry," IEICE Trans., vol.J80-D-II, no.8, pp.21782185, Aug. 1997. (in Japanese)
37. P. Ekman and W.V. Friesen, "Facial Action Coding System," Consulting Psychologist Press, 1977.
38. S. Sato and T. Kanade, "Name-It: Naming and detecting faces in video by the integration of image and natural language processing," Proc. of Int'l Conference on Artificial Intelligence (IJCAI97), pp.1488-1493, Aug. 1997.
39. K. Nagao, "Design of Interactive Environment," Kyoritsu Shuppan Co., Ltd., 1996. (in Japanese)
40. D. Stork and M. Hennecke, "Speechreading: An overview of image processing, feature extraction, sensory integration and pattern recognition techniques," Proc. of the Int'l Conf. on Automatic Face and Gesture Recognition, pp.xvi-xxvi, Oct. 1996.
41. E. Andr ed., Proc. of the Workshop on "Animated Interface Agents: Making them Intelligent," in conjunction with IJCAI-97, Nagoya, Japan, Aug. 1997.
42. O. Hasegawa, K. Sakaue, K. Itou, T. Kurita, S. Hayamizu, K. Tanaka, and N. Otsu, "Agent oriented multimodal image learning system," Proc. of the Workshop on Intelligent Multimodal Systems, in conjunction with IJCAI-97, pp.2934, Aug. 1997.
43. Y. Takebayashi, "Spontaneous speech dialogue system TOSBERG II-towards the user-centered multimodal interface," IEICE Trans., vol.J77-D-II, no.8, pp.1417-1428, Aug. 1994. (in Japanese)
44. T. Rist and J. Muler, "WebPersona: A life-like presentation agent for the World-Wide Web," Proc. of the Workshop on Animated Interface Agents: Making them Intelligent, in conjunction with IJCAI-97, pp.53-60, Aug. 1997.
45. J.C. Lester, J.L. Voerman, S.G. Towns, and C.B. Callaway, "Cosmo: A life-like animated pedagogical agent with deictic believability," Proc. of the Workshop on Animated Interface Agents: Making them Intelligent, in conjunction with IJCAI-97, pp.61-69, Aug. 1997.
46. J. Rickel and W.L. Johnson, "Steve: An animated pedagogical agent for procedural training in virtual environments (extended abstract)," Proc. of the Workshop on Animated Interface Agents: Making them Intelligent, in conjunction with IJCAI-97, pp.71-76, Aug. 1997.
47. K. Nitta, O. Hasegawa, T. Akiba, T. Kamishima, T. Kurita, S. Hayamizu, K. Itoh, M. Ishizuka, H. Dohi, and M. Okamura, "An experimental multimodal disputation system" Proc. of the Workshop on Intelligent Multimodal Systems, in conjunction with IJCAI-97, pp.23-28, Aug. 1997.
48. K. Nagao and A. Takeuchi, "Social interaction: Multimodal conversation with social agents," Proc. of the 12th National Conference on Artificial Intelligence (AAAI-94), vol.1, pp.22-28, 1994.
49. Y. Nakayama, "Multimodal interface agent," Proc. of 1997 ITE (Institute of Image Information and Television Engineers) Annual Convention, S5-4, pp.477-480, Sept. 1997. (in Japanese)
50. Persona Project at Microsoft Research: http: //www.research.microsoft.com/research/ ui/persona/home.htm
51. ALIVE: Artificial Life Interactive Video Environment: http://Ics.www.media.mit.edu/projects/alive/
52. CMU, OZ Project: http://www.cs.cmu.edu/afs/ cs.cmu.edu/project/oz/web/oz.html
53. H. Kobayashi, F. Hara, G. Uchida, and M. Ohno, "Study on face robot for active human interface: Mechanisms of face robot and facial expressions of 6 basic emotions," J. of Robotics Society of Japan, vol.12, no.l, pp.155-163, Jan. 1993.
54. H. Koshimizu and K. Murakami, "Facial caricaturing based on visual illusion-A mechanism to evaluate caricature in PICASSO system," IEICE Trans., vol.E76-D, no.4, pp.470478, 1993.
55. G. Hanaoka, M. Kaneko, and H. Harashima, "Facial caricature by computer based on the style of individual human caricaturist," IEICE Trans., vol.J80-D-II, no.8. pp.21102118, Aug. 1997. (in Japanese)
56. A. Nagata, M. Kaneko, and H. Harashima, "Analysis of face impression using average faces," IEICE Trans., vol.J80-A, no.8. pp. 1266-1272, Aug. 1997. (in Japanese)
57. S. Nishio and K. Koyama, "A criterion for facial expression of laugh based on temporal difference of eye and mouth movement," IEICE Trans., vol.J80-A, no.8. pp.1316-1318, Aug. 1997. (in Japanese)
58. T. Sakaguchi, II. Yamada, and S. Morishima, "Construction and evaluation of 3-D emotion space based on facial image analysis," IEICE Trans., vol.J80-A, no.8. pp.12791284, Aug. 1997. (in Japanese)
59. M. Nakagawa, T. Munetugu, Y. Kado, F. Maehara, and K. Chihara, "The facial aging simulation based on the skeletal model," IEICE Trans., vol.J80-A, no.8. pp.1312-1315, Aug. 1997. (in Japanese)
60. A. Sugiura and M. Ueda, "An assessment of prosopagnosia by using face image synthesis," IEICE Trans., vol.J80-A, no.l. pp.294-297, Jan. 1997. (in Japanese)
61. H. Harashima, et al., "Facial image processing system for human-like 'Kansei' agent," Proc. of the 15th IPA Technical Conference, vol.15, pp.237-249, Oct. 1996. (in Japanese)
62. H. Harashima, et al., "Facial image processing system for human-like 'Kansei' agent," 1996 Annual General Report of Individual Theme, IPA (The Information-technology Promotion Agency, Japan), pp.99-10G, March 1997. (in Japanese)
63. RWC Multimodal Database Home Page: http://rwc-tyo.noc.rwcp.or.jp/ people/toyoura/rwcdb/home.html
64. O. Hasegawa and K. Sakaue, "CG tool for constructing anthropomorphic interface agents," Proc. of the Workshop on Animated Interface Agents, pp.23-26, Aug. 1997.
65. ETL CG Tool Home Page: http://www.etl.go.jp/etl/gazo/CGtool
66. M. Nakagawa, T. Ohba, O. Delloye, M. Kaneko, and H. Harashima, "Interactive synthesis of facial images based on 3-dimensional model," Proc. of the 1996 Engineering Sciences Society Conference of IEICE, SA-10-5, pp.342-343, Sept. 1996. (in Japanese)
67. T. Ohba, M. Kaneko, and H. Harashima, "Interactive retrieval of facial images using 'Fukuwarai' Module," IEICE Trans., vol.J80-D-II, no.8, pp.2254-2258, Aug. 1997. (in Japanese)
68. The Face Recognition Home Page: http://www.cs.rug.nl/ peterkr/FACE/face.html
69. Facial Animation: http://mambo.ucsc.edu/psl/fan.html
70. Japan Academy of Facial Studies Home Page: http://www.hc.t- u-tokyo.ac.jp/jface/
71. Human Communication Engineering Group, The Institute of Electronics, Information and Communication Engineers Home Page : http://www.ieice.or.jp/hcg/
72. H. Harashima et al. eds., IEICE Trans. Special issue on "Computer and Cognitive Scientific Researches of Faces," vol.JSO-D-II, no.8, pp.2029-2258, Aug. 1997. (in Japanese)
73. H. Harashima et al. eds., IEICE Trans. Special issue on "Computer and Cognitive Scientific Researches of Faces," \-ol.J80-A, no.8, pp.1213-1336, Aug. 1997. (in Japanese)
74. Journal of the Institute of Image Information and Television Engineers, Special Edition on "Image Engineering of Human Face and Body," vol.51, no.8, pp.1169-1174, Aug. 1997. (in Japanese)
75. IEEE Trans, on Pattern Analysis and Machine Intelligence (PAMI), Theme Section, "Face and Gesture Recognition," vol.19, no.7, pp.675-785, July 1997.
76. Proc. of the IEEE International Conference on Automatic Face and Gesture Recognition, June 1995, Oct. 1996 and April 1998.