Processing of facial information by computer

Electronics and Communications in Japan, Part III: Fundamental Electronic Science (English translation of Denshi Tsushin Gakkai Ronbunshi)

Volumn 81, Issue 10, 1998, Pages 36-57

  Hasegawa, Osamu ^{a,d,e,f,g,h,i}   Morishima, Shigeo ^b,e,g,j,k,l   Kaneko, Masahide ^c  

^a ELECTROTECHNICAL LABORATORY   (Japan)

^b SEIKEI UNIVERSITY   (Japan)

^c KDDI R AND D LABORATORIES INC   (Japan)

^d TOKYO UNIVERSITY OF SCIENCE   (Japan)

^e UNIVERSITY OF TOKYO   (Japan)

^f AAAI   (Japan)

^g Institute of Electronics   (Japan)

^h IPSJ   (Japan)

ⁱ Japan Academy of Facial Studies   (Japan)

^j IEEE

^k ACM

^l UNIVERSITY OF TORONTO   (Canada)

more..

Author keywords

Face; Facial image synthesis; Facial information processing; Practical applications; Recognition of facial expressions

Indexed keywords

APPLICATIONS; CHARACTER RECOGNITION; COMMUNICATION; HUMAN FORM MODELS; IMAGE RECONSTRUCTION; MAN MACHINE SYSTEMS;

FACIAL INFORMATION PROCESSING;

DATA PROCESSING;

EID: 0032188136     PISSN: 10420967     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1520-6440(199810)81:10<36::AID-ECJC5>3.0.CO;2-P     Document Type: Article

References (76)

1. H. Harashima. Intelligent image coding and communication. Journal of the Institute of Television Engineers of Japan, 42, No. 6, pp. 519-525 (June 1988). (in Japanese)
2. H. Kitano. Artificial intelligence. Artificial Life & Entertainment, AAAI'94 Workshop Proc. Seattle (Aug.).
3. D. Terzopoulos and K. Waters. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Trans. on PAMI, 15, No. 6, pp. 569-579 (June 1993).
4. S. Hashimoto, Y. Sato, and H. Oda. Modification of facial expression using spring frame model. Proc. IASTED Int'l Symp. Applied Control, Filtering and Signal Processing. pp. 37-41 (June 1987).
5. C.S. Choi, H. Harashima. and T. Takebe. 3-Dimensional facial model-based description and synthesis of facial expressions. Trans. I.E.I.C.E. (A), J73, No. 7. pp. 1270-1280 (July 1990). (in Japanese)
6. M. Kaneko, Y. Hatori, and A. Koike. Coding of facial images based on 3-D model of head and analysis of shape changes in input image sequence. Trans. I.E.I.C.E. (B), J71, No. 12, pp. 1554-1563 (Dec. 1988). (in Japanese)
7. M. Kaneko, A. Koike, and Y. Hatori. Synthesis of moving facial images with expression and its application to human interface. IEICE 2nd Symposium on Functional Image Information System, S5.3, pp. 83-88 (April 1991). (in Japanese)
8. P. Ekman and W.V. Friesen. Facial Action Coding System. Consulting Psychologist Press (1977).
9. K. Ebihara, J. Kurumizawa, J. Ohya, and F. Kishino. A study of real-time facial expression reproduction based on artistic anatomy. ITE Technical Report, 20, No. 41, pp. 55-59 (July 1996). (in Japanese)
10. S. Morishima, S. Okada, and H. Harashima. A facial motion synthesis for intelligent man-machine interface. Trans. I.E.I.C.E. (D-II), No. 3, pp. 351-359 (March 1990). (in Japanese)
11. M. Kaneko, A. Koike, and Y. Hatori. Automatic synthesis of moving facial images with expression and mouth shape controlled by text. Tech. Rep. I.E.I.C.E., IE90-96 (Feb. 1991). (in Japanese)
12. T. Sakaguchi, H. Hiraga, S. Morishima, and H. Harashima. A scenario-making tool for face expression animation and real-time motion image playback system. Tech. Rep. I.E.I.C.E., 91, No. 508, HC91-57, pp. 23-30 (March 1992). (in Japanese)
13. S. Iwasa and S. Morishima. Facial feature points extraction from frontal view for model fitting. ITE Technical Report, 20, No. 41, pp. 43-48 (July 1996). (in Japanese)
14. S. Iwasawa, M. Ueno, S. Morishima, and H. Harashima. Polygonal face model from range map data and realistic facial expression synthesis. Proceedings of Tenth NICOGRAPH, pp. 11-21 (Nov. 1994). (in Japanese)
15. M. Ueno, S. Morishima, and H. Harashima. High-definition wire frame model of head and its hierarchical control for natural expression synthesis. Tech. Rep. I.E.I.C.E., 92, No. 386, PRU92-79 (Dec. 1992). (in Japanese)
16. H. Sera et al. Physics-based muscle model for mouth shape control. IEEE Proceedings of ROMAN'96, pp. 207-212 (Nov.).
17. T. Ishikawa, H. Sera, and S. Morishima. Facial muscle parameter decision from marker movement by neural network. Tech. Rep. I.E.I.C.E., 96, No. 604, HCS96-48, pp. 29-36 (March 1997). (in Japanese)
18. S. Morishima and H. Harashima. A media conversion from speech to facial image for intelligent man-machine interface. IEEEJSAC, 9, No. 4, pp. 594-600 (1991).
19. S. Morishima. Better face communication. ACM SIGGRAPH'95, Visual Proceedings, p. 117 (Aug.).
20. J. Sato and S. Morishima. Emotion modeling in speech production using emotion space. IEEE Proceedings of ROMAN'96, pp. 472-477 (Nov. 1996).
21. N. Miyashita, T. Sakaguchi, and S. Morishima. Real-time media conversion from voice to image for human computer interaction. Proceedings of Interaction'97, pp. 53-55 (Feb.). (in Japanese)
22. K. Mase. Detection of facial muscle motion by optical-flow. Tech. Rep. I.E.I.C.E., PRU89-128, pp. 17-24 (March 1990). (in Japanese)
23. K. Mase and K. Suenaga. Recognition of emotion from image sequence of facial expression. Tech. Rep. I.E.I.C.E., PRU91-24, pp. 95-101 (May 1991). (in Japanese)
24. I.A. Essa and A. Pentland. A vision system for observing and extracting facial action parameters. IEEE Computer Vision and Pattern Recognition'94, pp. 76-83 (June).
25. C.S. Choi, H. Harashima, and T. Takebe. Analysis of facial expressions using three-dimensional facial model. Trans. I.E.I.C.E. (D-II), J74, No. 6, pp. 766-777 (June 1991). (in Japanese)
26. M. Suwa. A preliminary note on pattern recognition of facial emotional expression. The 4th International Joint Conference on Pattern Recognition, pp. 408-410 (1978).
27. T. Ishii and H. Iwata. Automatic recognition of human facial expression. Trans. of Japan Society of Mechanical Engineering, 52, No. 483, pp. 2989-2992 (1986). (in Japanese)
28. X. Song, C.-W. Lee, G. Xu, and S. Tsuji. Extraction of facial organ features using partial feature template and global constraints. Trans. I.E.I.C.E. (D-II), J77, No. 8, pp. 1601-1609 (Aug. 1994). (in Japanese)
29. T. Sakaguchi, J. Ohya, and F. Kishino. Image feature extraction using wavelet transformation and its application for facial expression recognition. Tech. Rep. I.E.I.C.E., 96, No. 604, IE94-147, PRU94-147, pp. 15-22 (March 1995). (in Japanese)
30. K. Matsuno, C.-W. Lee, and S. Tsuji. Recognition of facial expressions using potential net and KL expansion. Trans. I.E.I.C.E. (D-II), J77, No. 8, pp. 1591-1600 (Aug. 1994). (in Japanese)
31. T. Sakaguchi, J. Ohya, and F. Kishino. Facial expression recognition from image sequence using hidden Markov model. J. of ITE, 49, No. 8, pp. 1060-1067 (Aug. 1995). (in Japanese)
32. H. Kobayashi and F. Hara. Dynamic recognition of basic facial expressions by discrete-time recurrent neural network. Proc. of IJCNN'93, Nagoya, pp. 155-158 (Oct.).
33. T. Sakaguchi and S. Morishima. Real-time basic facial expression recognition based on spatial frequency information. Proc. of the 2nd Symp. on Intelligent Information Media, pp. 75-82 (Dec. 1996). (in Japanese)
34. H. Kobayashi, A. Tange, and F. Hara. Real-time recognition of six basic facial expressions. Proc. of ROMAN'95, Tokyo, pp. 179-186 (July).
35. S. Yshikawa, M. Masuya, and M. Nakamura. Face and Mind: Introduction to the Psychology of the Face. Saiensu Publishers Inc. (1993). (in Japanese)
36. T. Kurokawa. Non-Verbal Interface. Ohmsha Ltd. (1994). (in Japanese)
37. Y. Kohara. Anthropology of Face and Its Expression. Heibonsha Limited, Publishers, Tokyo (1995). (in Japanese)
38. K. Okadaand Y. Matsushita. Multiparty videoconferencing with a sense of presence: MAJIC. Trans. of Information Processing Society of Japan, 36, No. 3, pp. 775-783 (March 1995). (in Japanese)
39. H. Ishii. CSCW and Groupware. Ohmsha Ltd. (1994). (in Japanese)
40. M. Kobayashi and H.Ishii. Clear board: a novel shared drawing medium that supports gaze awareness in remote collaboration. Trans. I.E.I.C.E. (B), E76, No. 6, pp. 609-617 (June 1993).
41. H. Kuzuoka. Media space. Visual Interface. Kyoritsu Shuppan Co., Ltd., pp. 98-116 (1996). (in Japanese)
42. H. Harashima. The Art of Facial Information. Ohmsha Ltd. (1994). (in Japanese)
43. H. Harashima, K. Aizawa, and T. Saito. Model-based analysis synthesis coding of videotelephone images: Conception and basic study of intelligent image coding. Trans. I.E.I.C.E., E72, No. 5, pp. 452-459 (May 1989).
44. F. Kishino. Communication with Realistic Sensation. Ohmsha Ltd. (1994). (in Japanese)
45. M. Okutomi and T. Kanade. A multi-baseline stereo. IEEE Trans. PAMI, 15, No. 4, pp. 353-363 (April 1993).
46. T. Kanade, P.J. Narayanan, and P. Rander. Virtualized reality: concepts and early results. Proc. of IEEE Workshop on the Representation of Visual Scenes, Boston (1995).
47. K. Nitta et al. An experimental multimodal disputation system: Mr. Bengo. Trans. I.E.I.C.E. (D-II), J80, No. 8, pp. 2081-2087 (Aug. 1997). (in Japanese)
48. K. Nagao. Design of Interactive Environment. Kyoritsa Shuppan Co., Ltd. (1996). (in Japanese)
49. S. Akamatsu. Computer recognition of human face. Trans. I.E.I.C.E. (D-II), J80, No. 8, pp. 2031-2046 (Aug. 1997).
50. D. Stork and M. Hennecke. Speechreading: an over-view of image processing, feature extraction, sensory integration and pattern recognition techniques. Proc. Int'l Conf. on Automatic Face and Gesture Recognition, pp. xvi-xxvi (Oct. 1996).
51. O. Hasegawa et al. An analysis of human behavior during conversations with a speech dialogue system. Proc. 10th Sympos. on Human Interface, pp. 631-636 (Oct. 1994). (in Japanese)
52. A. Kay. Computer software. Sci. America, 251, No. 3, pp. 191-207 (1984).
53. B. Laurel (Ed.). The Art of Human-Computer Interface Design. Addison Wesley Publishers (1990).
54. D. Riecken (Ed.). Intelligent agents. Commun, of ACM, 37, No. 7 (July 1994).
55. Y. Suenaga, K. Mase, F. Masaaki, and Y. Watanabe. Human reader: an advanced human machine interface based on human images and speech. Trans. I.E.I.C.E. (D-II), J75, No. 2, pp. 190-202 (Feb. 1992). (in Japanese)
56. Y. Takebayashi. Spontaneous speech dialogue system TOSBERG II: Towards a user-centered multimodal interface. Trans. I.E.I.C.E. (D-II), J77, No. 8, pp. 1417-1428 (Aug. 1994). (in Japanese)
57. K. Nagao and A. Takeuchi. Social interaction: multimodal conversation with social agents. Proc. 12th AAAI-94. The MIT Press, pp. 22-28 (Aug. 1994).
58. O. Hasegawa et al. Active agent oriented multimodal interface system. Proc. International Joint Conference on Artificial Intelligence 95 (IJCAI-95), pp. 82-87 (Aug.).
59. T. Kamiya, S. Lu, M. Hara, and H. Miyai. Development of electronic library interface with 3D walkthrough and CG librarian. Technical Report of IPSJ, IM19-5, pp. 27-34 (1995). (in Japanese)
60. O. Hasegawa et al. A multimodal anthropomorphic agent which learns visual information through interactions. Technical Report of IPSJ, CVIM-100-4, pp. 33-38 (May 1996). (in Japanese)
61. H. Dohi and M. Ishizuka. A visual software agent connected to WWW/Mosaic. Trans. I.E.I.C.E. (D-II), J79, No. 4, pp. 585-591 (April 1996). (in Japanese)
62. Proceedings of the 1997 Real World Computing Symposium RWC'97, Real World Computing Partnership (Jan.).
63. G. Ball et al. Lifelike computer characters: the persona project at Microsoft Research, J.Bradshaw, Ed., Software Agents. MIT Press (1997).
64. H. Kobayashi, F. Hara, G. Uchida, and M. Ohno. Study on face robot for active human interface: Mechanisms of face robot and facial expressions of 6 basic emotions. Journal of the Robotics Society of Japan, 12, No. 1, pp. 155-163 (Jan. 1993).
65. J. Bates, B. Loyall, and S. Reilly. Artificial social systems. Fourth European Workshop on Modeling Autonomous Agents in a Multi-Agent World, Springer-Verlag, Berlin (1994).
66. Japan Academy of Facial Studies (Home Page): http://www.hc.t.u-tokyo.ac.jp/jface/
67. Int'l Conf. on Automatic Face and Gesture Recog. Home Page: http://vismod.www.media. mit.edu/events/fg96/
68. H. Harashima et al. Facial image processing system for human-like 'Kansei' agent. Proceedings of the 15th IPA Technical Conference, 15, pp. 237-249 (Oct. 1996). (in Japanese)
69. H. Harashima et al. Facial image processing system for human-like 'Kansei' agent. 1996 Annual General Report of Individual Theme, IPA (The Information-technology Promotion Agency, Japan), pp. 99-106 (March 1997). (in Japanese)
70. RWC Multi-modal Database: http://rwc-tyo.noc.rwcp.or.jp/people/toyoura/rwcdb/ home.html
71. M. Nakagawa et al. Interactive synthesis of facial images based on 3-dimensional model. Proceedings of the 1996 Engineering Sciences Society Conference of IEICE, SA-10-5, pp. 342-343 (Sept.). (in Japanese)
72. T. Ohba, M. Kaneko, and H. Harashima. Interactive retrieval of facial images using 'Fukuwarai' module. Trans. I.E.I.C.E. (D-II), J80, No. 8, pp. 2254-2258 (Aug. 1997). (in Japanese)
73. The Face Recognition Home Page: http://www.cs.rug.nl/~peterkr/FACE/face.html
74. Facial Animation: http://mambo.ucsc.edu/psl/ fan.html
75. H. Harashima and H. Baba. What Has Changed the Human Face? Kawade Shobou Shin-sha Co. (1996). (in Japanese)
76. A. Shimizu, N. Sumitsuji, and M. Nakamura. Why Do People Laugh? Kodansha Blue Books, Kodansha Co, Ltd. (1994). (in Japanese)