Mapping and Manipulating Facial Expression

Language and Speech

Volumn 52, Issue 2-3, 2009, Pages 369-386

  Theobald, Barry John ^a   Matthews, Iain ^b   Mangini, Michael ^c   Spies, Jeffrey R ^d   Brick, Timothy R ^d   Cohn, Jeffrey F ^e   Boker, Steven M ^d  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b WETA DIGITAL   (New Zealand)

^c UNIVERSITY OF NOTRE DAME   (United States)

^d UNIVERSITY OF VIRGINIA   (United States)

^e UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Active appearance models; Expression cloning; Expression mapping

Indexed keywords

EID: 67949116914     PISSN: 00238309     EISSN: None     Source Type: Journal    
DOI: 10.1177/0023830909103181     Document Type: Article

References (42)

1. Blanz, V., Basso, C., Poggio, T., & Vetter, T. (2003). Reanimating faces in images and video. Computer Graphics Forum, 22 (3). 641-650.
2. Blanz, V., & Vetter, T. (1999). A morphable model for the synthesis of 3D faces. In W. Waggenspack (Ed.), Proceedings of SIGGRAPH (pp. 187-194). Los Angeles, CA: ACM Press.
3. Blanz, V., & Vetter, T. (2003). Face recognition based on fitting a 3D morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25 (9). 1063-1074.
4. Bregler, C., & Omohundro, S. (1995). Nonlinear manifold learning for visual speech recognition. In E. Grimson (Ed.), Proceedings of the International Conference on Computer Vision (pp. 494-499). Cambridge, MA: IEEE Computer Society Press.
5. Chang, Y., & Ezzat, T. (2005). Transferable videorealistic speech animation. In ACM SIGGRAPH/Eurographics Symposium on Computer Animation (pp.29-31).
6. Choe, B., Lee, H., & Ko, H. (2001). Performance-driven muscle-based facial Animation. Journal of Visualization and Computer Animation, 11 (2). 67-79. (Pubitemid 33692528)
7. Chuang, E., & Bregler, C. (2002). Performance driven facial animation using blendshape interpolation. Technical Report CS-TR-2002-02, Stanford University, U.S.A.
8. Cootes, T., Edwards, G., & Taylor C. (2001). Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23 (6). 681-685. (Pubitemid 32585279)
9. Cosker, D., Marshall, D., Rosin, S., Paddock, P., & Rushton, S. (2004). Towards perceptually realistic talking heads: Models, metrics, and McGurk. In V. Interrante & A. McNamara (Eds.), Proceedings of Symposium on Applied Perception in Graphics and Visualization (pp. 2474-2477). Los Angeles, CA: ACM Press.
10. Edwards, G., Cootes, T., & Taylor, C. (1998). Face recognition using active appearance models. In H. Burkhardt & B. Neumann (Eds.), Proceedings of the European Conference on Computer Vision (pp. 581-595). Freiburg: Springer. (Pubitemid 128093052)
11. Fagel, S., Bailly, G., & Elisei, F. (2007). Intelligibility of natural and 3D-cloned German speech. In Proceedings of Auditory Visual Speech Processing (pp.126-131).
12. Gehricke, J., & Shapiro, D. (2000). Reduced facial expression and social context in major depression: Discrepancies between facial muscle activity and self-reported emotion. Psychiatry Research, 95 (2). 157-167. (Pubitemid 30645889)
13. Govokhina, O., Bailly, G., Bretin, G., & Bagshaw, P. (2006). TDA: A new train-able trajectory formation system for facial animation. In R. Stern, A. Black, & T. Schultz (Eds.), Proceedings of Interspeech (pp. 2474-2477). Pittsburgh, PA: International Speech Communication Association.
14. Grahe, J., & Bernieri, F. (1999). The importance of nonverbal cues in judging rapport. Journal of Nonverbal Behavior, 23 (4). 253-269.
15. Gross, R., Matthews, I., & Baker, S. (2006). Active appearance models with occlusion. Image and Vision Computing, 24 (6). 593-604. (Pubitemid 43867828)
16. Guenter, B., Grimm, C., Wood, D., Malvar, H., & Pighin F. (1998). Making faces. In Proceedings of SIGGRAPH (pp. 55-66 ).
17. Hong, P., Wen, Z., Huang, T., & Shum, H. (2002). Real-time speech-driven 3D animation. In Proceedings of 3D Data Processing, Visualization and Transmission (pp.713-716).
18. Kirby, M., & Sirovich, L. (1990). Application of the Karhunen-Loeve procedure for the characterization of human faces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12 (1). 103-108. (Pubitemid 20653605)
19. Koufakis, I., & Buxton, B. (1999). Very low bit-rate face video compression using linear combination of 2D face views and principal components analysis. Image and Vision Computing, 17, 1031-1051. (Pubitemid 30503528)
20. Liu, Z., Shan, Y., & Zhang, Z. (2001). Expression mapping with expressive ratio images. In L. Pockock (Ed.), SIGGRAPH (pp. 271-276). Los Angeles, CA: ACM Press. (Pubitemid 33047312)
21. Luettin, J., Thacker, N., & Beet, S. (1996). Speechreading using shape and intensity information. In Proceedings of the International Conference on Spoken Language Processing (pp. 58-61 ).
22. Macedo, I., Brazil, E., & Velho, L. (2006). Expression transfer between photographs through multilinear AAMs. Brazilian Symposium on Computer Graphics and Image Processing (pp.239-246).
23. Massaro, D. (1998). Perceiving talking faces. Cambridge, MA: MIT Press.
24. Matthews, I., & Baker, S. (2004). Active Appearance Models revisited. International Journal of Computer Vision, 60 (20). 135-164.
25. Matthews, I., Cootes, T., Bangham, A., Harvey, R., & Cox, S. (2002). Extraction of visual features for lipreading. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24 (2). 198-213. (Pubitemid 34198209)
26. Mori, M. (1970). The uncanny valley. Energy, 7 (4). 33-35.
27. Mogghaddam, B., & Pentland, A. (1995). An automatic system for model-based coding of faces. In J. Storer & M. Cohn (Eds.), Proceedings of the Data Compression Conferences (pp. 362-370). Snowbird, UT: IEEE Computer Society Press.
28. Noh, J., & Neumann, U. (2001). Expression cloning. In L. Pocock (Ed.), SIGGRAPH (pp. 277-288). Los Angeles, CA: ACM Press. (Pubitemid 33047313)
29. Schwartz, G., Fair, P., Salt, P., Mandel, M., & Klerman, G. (1976). Facial expression and imagery in depression: An electromyographic study. Psychosomoatic Medicine, 28 (5). 337-347.
30. Shackleton, M., & Welsh, W. (1991). Classification of facial features for recognition. In S. Negahdaripour (Ed.), Proceedings of Computer Vision and Pattern Recognition (pp. 573-579). Lhanina, Maui: IEEE Computer Society Press.
31. Sirovich, L., & Kirby, M. (1987). Low-dimensional procedure for the characterization of human faces. Journal of the Optical Society of America (A), 4, 519-524.
32. Terzopoulos, D., & Waters, K. (1993). Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Transactions of Pattern Analysis and Machine Intelligence, 15 (6). 569-579. (Pubitemid 23675487)
33. Theobald, B., Bangham, A., Matthews, I., & Cawley, G. (2004). Near-videorealistic synthetic talking faces: Implementation and evaluation. Speech Communication, 44, 127-140.
34. Theobald, B., Kruse, S., Bangham, A., & Cawley G. (2003). Towards a low-bandwidth talking face using appearance models. Image and Vision Computing, 21 (13-14). 1117-1124.
35. Theobald, B., & Wilkinson, N. (2007). A real-time speech-driven talking head using appearance models. In Proceedings of Auditory Visual Speech Processing (pp. 264-269 ).
36. Turk, M., & Pentland, A. (1991). Eigenfaces for recognition. Journal of Cognitive Neuro-Science, 3 (1). 71-86.
37. Vlasic, D., Brand, M., Pfister, H., & Popovic, J. (2005). Face transfer with multilinear models. ACM Transactions on Graphics, 24 (3). 426-433.
38. Wang, Y., Lucey, S., & Cohn, J. (2008). Enforcing convexity for improved alignment with constrained local model. In N. Ahuja & L. Shapiro (Eds.), Proceedings of Computer Vision and Pattern Recognition (pp. 1-8). Anchorage, AK: IEEE Computer Society Press.
39. Williams, L. (1990). Performance driven facial animation. Computer Graphics, 24 (2). 235-242.
40. Xiao, J., Baker, S., Matthews, I., & Kanade, T. (2004). Real-time combined 2D+3D active appearance models. In Proceedings of Computer Vision and Pattern Recognition (pp.535-542).
41. Yang, J., Zhang, D., Frangi, A., & Yang, J. (2004). Two-dimensional PCA: A new approach to appearance-based face representation and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26 (1). 131-131.
42. Zhang, Q., Liu, Z., Quo, G., Terzopoulos, D., & Shum, H. (2006). Geometry-driven photorealistic facial expression synthesis. IEEE Transactions on Visualization and Computer Graphics, 12 (1). 48-60. (Pubitemid 43170171)