Evolution of the 3-dimensional video system for facial motion analysis: Ten years' experiences and recent developments

Annals of Plastic Surgery

Volumn 69, Issue 2, 2012, Pages 173-185

  Tzou, Chieh Han John ^a   Pona, Igor ^a   Placheta, Eva ^a   Hold, Alina ^a   Michaelidou, Maria ^a   Artner, Nicole ^b   Kropatsch, Walter ^b   Gerber, Hans ^c   Frey, Manfred ^a  

^a MEDICAL UNIVERSITY OF VIENNA   (Austria)

^b VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

^c ETH ZURICH   (Switzerland)

Author keywords

3 dimensional; documentation; face; facial grading system; facial palsy; objective measurements tool; three dimensional video analysis

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; CHILD; COMPUTER ASSISTED DIAGNOSIS; COMPUTER PROGRAM; EVALUATION; FACIAL NERVE PARALYSIS; FEASIBILITY STUDY; FEMALE; HUMAN; INFANT; MALE; METHODOLOGY; NEWBORN; PRESCHOOL CHILD; THREE DIMENSIONAL IMAGING; VIDEORECORDING;

ADOLESCENT; ADULT; CHILD; CHILD, PRESCHOOL; FACIAL PARALYSIS; FEASIBILITY STUDIES; FEMALE; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; INFANT; INFANT, NEWBORN; MALE; SOFTWARE DESIGN; VIDEO RECORDING; YOUNG ADULT;

EID: 84863986597     PISSN: 01487043     EISSN: None     Source Type: Journal    
DOI: 10.1097/SAP.0b013e3182223d96     Document Type: Article

References (77)

1. Finsterer J. Management of peripheral facial nerve palsy. Eur Arch Otorhinolaryngol. 2008;265:743-752.
2. Guntinas-Lichius O, Streppel M, Stennert E. Postoperative functional evaluation of different reanimation techniques for facial nerve repair 1. Am J Surg. 2006;191:61-67.
3. Tomat LR, Manktelow RT. Evaluation of a new measurement tool for facial paralysis reconstruction. Plast Reconstr Surg. 2005;115:696-704.
4. House JW, Brackmann DE. Facial nerve grading system. Otolaryngol Head Neck Surg. 1985;93:146-147.
5. Lewis BI, Adour KK. An analysis of the Adour-Swanson and House-Brackmann grading systems for facial nerve recovery 1. Eur Arch Otorhinolaryngol. 1995;252:265-269.
6. Johnson P, Bajaj-Luthra A, Llull R, et al. Quantitative facial motion analysis after functional free muscle reanimation procedures. Plast Reconstr Surg. 1997;100:1710-1719; discussion 1720-1712.
7. Manktelow RT, Zuker RM, Tomat LR. Facial paralysis measurement with a handheld ruler. Plast Reconstr Surg. 2008;121:435-442.
8. Hontanilla B, Aubá C. Automatic three-dimensional quantitative analysis for evaluation of facial movement. J Plast Reconstr Aesthet Surg. 2008;61: 18-30.
9. Frey M, Jenny A, Giovanoli P, et al. Development of a new documentation system for facial movements as a basis for the international registry for neuromuscular reconstruction in the face. Plast Reconstr Surg. 1994;93: 1334-1349.
10. Frey M, Giovanoli P, Gerber H, et al. Three-dimensional video-analysis of facial movements: A new method to assess the quantity and quality of the smile. Plast Reconstr Surg. 1999;104:2032-2039.
11. Frey M, Freilinger G. Second Vienna Muscle Symposium. In: Frey M, Freilinger G, eds. Second Vienna Muscle Symposium. Vienna, Austria: Facultas Verlag; 1986.
12. Frey M. Free muscle transplantation for treatment of facial paralysis: First experiences with the International Muscle Transplant Registry. Plast Reconstr Surg. 1991;87:200-202.
13. Tzou C, Giovanoli P, Ploner M, et al. Are there ethnic differences of facial movements between Europeans and Asians? Br J Plast Surg. 2005;58: 183-195.
14. Michaelidou M, Tzou C, Gerber H, et al. The combination of muscle transpositions and static procedures for reconstruction in the paralyzed face of the patient with limited life expectancy or who is not a candidate for free muscle transfer. Plast Reconstr Surg. 2009;123:121-129.
15. Frey M, Giovanoli P, Tzou C, et al. Dynamic reconstruction of eye closure by muscle transposition or functional muscle transplantation in facial palsy. Plast Reconstr Surg. 2004;114:865-875.
16. Frey M, Giovanoli P, Michaelidou M. Functional upgrading of partially recovered facial palsy by cross-face nerve grafting with distal end-to-side neurorrhaphy. Plast Reconstr Surg. 2006;117:597-608.
17. Frey M, Michaelidou M, Tzou C, et al. Three-dimensional video-analysis of the paralyzed face reanimated by cross-face nerve grafting and free gracilis muscle transplantation: Quantification of the functional outcome. Plast Reconstr Surg. 2008;122:1709-1722.
18. Giovanoli P, Tzou CH, Ploner M, et al. Three-dimensional video-analysis of facial movements in healthy volunteers. Br J Plast Surg. 2003;56:644-652.
19. Frey M, Giovanoli P. The three-stage concept to optimize the results of microsurgical reanimation of the paralyzed face. Clin Plast Surg. 2002;29: 461-482.
20. Neely JG, Wang KX, Shapland CA, et al. Computerized Objective Measurement of Facial Motion: Normal variation and test-retest reliability. Otol Neurotol. 2010;31:1488-1492.
21. Dornaika F, Ahlberg J. Fast and reliable active appearance model search for 3-D face tracking. IEEE Trans Syst Man Cybern B Cybern. 2004;34: 1838-1853.
22. Edwards GJ, Taylor CJ, Cootes TF. Interpreting face images using Active Appearance Models. Automatic Face and Gesture Recognition. In: Third IEEE International Conference Proceedings. Nara, Japan: IEEE Computer Society Press; 1998:300-305.
23. DeCarlo D, Metaxas D. Optical flow constraints on deformable models with applications to face tracking. Int J Comput Vision. 2000;38:99-127.
24. Hsieh CK, Lai SH, Chen YC. Expressional Face Image Analysis with Constrained Optical Flow. In: 2008 IEEE International Conference on Multimedia and Expo. Hannover, Germany: IEEE Xplore; 2008;1-4: 1553-1556.
25. Wikipedia. Optical Flow. 2010. Available at: Http://en.wikipedia.org/ wiki/OpticalElowemflow. Accessed August 20, 2010.
26. Wikipedia. Video Tracking. 2010. Available at: Http://en.wikipedia.org/ wiki/VideoElowemtracking. Accessed August 20, 2010.
27. Cordea MD, Petriu EM. A 3-D anthropometric-muscle-based active appearance model. IEEE Trans Instrum Meas. 2006;55:91-98.
28. Blanz V. Face recognition based on a 3D Morphable Model. In: Proceedings of the Seventh International Conference on Automatic Face and Gesture Recognition - Proceedings of the Seventh International Conference. Washington, DC: Institute of Electric and Electronics Engineers (IEEE);2006:617-622.
29. Popat H, Henley E, Richmond S, et al. A comparison of the reproducibility of verbal and nonverbal facial gestures using three-dimensional motion analysis. Otolaryngol Head Neck Surg. 2010;142:867-872.
30. Manohar VSM, Goldgof D, Sarkar S. Modeling Facial Skin Motion Properties in Video and Its Application to Matching Faces Across Expressions. In: 20th International Conference Pattern Recognition (ICPR). Washington, DC: IEEE Computer Society; 2010:2122-2125.
31. Comaniciu D. RV, Meer P. Real-time tracking of non-rigid objects using mean shift. In: IEEE Conference on Computer Vision and Pattern Recognition. Hilton Head Island, SC: IEEE Computer Society Press; 2000:142-149.
32. Linstrom CJ. Objective facial motion analysis in patients with facial nerve dysfunction. Laryngoscope. 2002;112:1129-1147.
33. Coulson SE, Croxson GR. Assessing physiotherapy rehabilitation outcomes following facial nerve paralysis. Aust J Otolaryngol. 1995;2:4.
34. Ross BG, Fradet G, Nedzelski JM. Development of a sensitive clinical facial grading system. Otolaryngol Head Neck Surg. 1996;114:380-386.
35. Kahn J, Gliklich R, Boyev K, et al. Validation of a patient-graded instrument for facial nerve paralysis: The FaCE scale. Laryngoscope. 2001;111:387-398.
36. Coulson S, Croxson G, Adams R, et al. Reliability of the "Sydney," "Sunnybrook," and "House Brackmann" facial grading systems to assess voluntary movement and synkinesis after facial nerve paralysis. Otolaryngol Head Neck Surg. 2005;132:543-549.
37. Yen T, Driscoll C, Lalwani A. Significance of House-Brackmann facial nerve grading global score in the setting of differential facial nerve function. Otol Neurotol. 2003;24:118-122.
38. Mehta R, WernickRobinson M, Hadlock T. Validation of the Synkinesis Assessment Questionnaire. Laryngoscope. 2007;117:923-926.
39. Burres SA. Facial biomechanics: The standards of normal. Laryngoscope. 1985;95:708-714.
40. Neely JG, Cheung JY, Wood M, et al. Computerized quantitative dynamic analysis of facial motion in the paralyzed and synkinetic face. Am J Otol. 1992;13:97-107.
41. Johnson PC, Brown H, KuzonWMJr, et al. Simultaneous quantitation of facial movements: The maximal static response assay of facial nerve function. Ann Plast Surg. 1994;32:171-179.
42. Yuen K, Kawakami S, Ogawara T, et al. Evaluation of facial palsy by Moire topography. Eur Arch Otorhinolaryngol. 1994;S541YS544.
43. Isono M, Murata K, Tanaka H, et al. An objective evaluation method for facial mimic motion. Otolaryngol Head Neck Surg. 1996;114:27-31.
44. Meier-GallatiV, Scriba H,FischU.Objective scaling of facial nerve function based on area analysis (OSCAR). Otolaryngol Head Neck Surg. 1998;118:545-550.
45. Sargent EW, Fadhli OA, Cohen RS. Measurement of facial movement with computer software. Arch Otolaryngol Head Neck Surg. 1998;124:313-318.
46. Coulson SE, Croxson GR, Gilleard WL. Three-dimensional quantification of "still" points during normal facial movement. Ann Otol Rhinol Laryngol. 1999;108:265-268.
47. Somia N, Rash G, Epstein E, et al. A computer analysis of reflex eyelid motion in normal subjects and in facial neuropathy. Clin Biomech (Bristol, Avon). 2000;15:766-771.
48. Heckmann M, Schön-Hupka G. Quantification of the efficacy of botulinum toxin type A by digital image analysis. J Am Acad Dermatol. 2001;45: 508-514.
49. Wachtman G, Cohn J, VanSwearingen J, et al. Automated tracking of facial features in patients with facial neuromuscular dysfunction. Plast Reconstr Surg. 2001;107:1124-1133.
50. Nakamura K, Toda N, Sakamaki K, et al. Biofeedback rehabilitation for prevention of synkinesis after facial palsy. Otolaryngol Head Neck Surg. 2003;128:539-543.
51. Mishima K, Yamada T, Ohura A, et al. Production of a range image for facial motion analysis: A method for analyzing lip motion. Comput Med Imaging Graph. 2006;30:53-59.
52. Sawyer AR, See M, Nduka C. Quantitative analysis of normal smile with 3D stereophotogrammetryYan aid to facial reanimation. J Plast Reconstr Aesthet Surg. 2010;63:65-72.
53. Sawyer A, See M, Nduka C. 3D Stereophotogrammetry quantitative lip analysis. Aesthetic Plast Surg. 2009;33:497-504.
54. Wu Z, Silverman C, Linstrom C, et al. Objective computerized versus subjective analysis of facial synkinesis. Laryngoscope. 2005;115:2118-2122.
55. Gross M, Trotman C, Moffatt K. A comparison of three-dimensional and twodimensional analyses of facial motion. Angle Orthod. 1996;66:189-194.
56. Frey M. Smile reconstruction using the gracilis muscle. Oper Tech Plast Reconstr Surg. 1999;6:180-189.
57. Stussi E, Handschin S, Frey M. Quantifying facial asymmetry. A method for objective assessment of impairments of facial motoricity; a pilot study. Biomed Tech (Berl). 1992;37:14-19.
58. Mehta R, Zhang S, Hadlock T. Novel 3-D video for quantification of facial movement. Otolaryngol Head Neck Surg. 2008;138:468-472.
59. Nakata S, Sato Y, Gunaratne P, et al. Quantification of facial motion for objective evaluation using a high-speed three-dimensional face measurement systemYa pilot study. Otol Neurotol. 2006;27:1023-1029.
60. Rogers C, Schmidt K, VanSwearingen J, et al. Automated facial image analysis: Detecting improvement in abnormal facial movement after treatment with botulinum toxin A. Ann Plast Surg. 2007;58:39-47.
61. Giovanoli P, Tzou C-HJ, Ploner M, et al. Three-dimensional video-analysis of facial movements within healthy volunteers. Br J Plast Surg. 2003;56: 644-652.
62. Enee V, Guerin J, Bebear JP, et al. Acoustic neuroma surgery. Results and complications in 348 cases. Rev Laryngol Otol Rhinol (Bord). 2003;124:45-52.
63. Gormley WB, Sekhar LN, Wright DC, et al. Acoustic neuromas: Results of current surgical management. Neurosurgery 1997;41:50-58; discussion 58-60.
64. Waddell A, Maw AR. Cholesteatoma causing facial nerve transection. J Laryngol Otol. 2001;115:214-215.
65. Axon PR, Fergie N, Saeed SR, et al. Petrosal cholesteatoma: Management considerations for minimizing morbidity. Am J Otol. 1999;20:505-510.
66. Ikeda M, Nakazato H, Onoda K, et al. Facial nerve paralysis caused by middle ear cholesteatoma and effects of surgical intervention. Acta Otolaryngol. 2006;126:95-100.
67. Bartels LJ. Facial nerve and medially invasive petrous bone cholesteatomas. Ann Otol Rhinol Laryngol. 1991;100:308-316.
68. Mohammed F, Asaria J, Payne RJ, et al. Retrospective reviewof 242 consecutive patients treated surgically for parotid gland tumours. J Otolaryngol Head Neck Surg. 2008;37:340-346.
69. Beurskens CH, Heymans PG. Physiotherapy in patients with facial nerve paresis: Description of outcomes. Am J Otolaryngol. 2004;25:394-400.
70. Brach J, VanSwearingen J, Lenert J, et al. Facial neuromuscular retraining for oral synkinesis. Plast Reconstr Surg. 1997;99:1922-1931; discussion 1932-1923.
71. VanSwearingen J, Brach J. Changes in facial movement and synkinesis with facial neuromuscular reeducation. Plast Reconstr Surg. 2003;111: 2370-2375.
72. Beurskens C, Heymans P. Mime therapy improves facial symmetry in people with long-term facial nerve paresis: A randomised controlled trial. Aust J Physiother. 2006;52:177-183.
73. Laskawi R. The use of botulinum toxin in head and face medicine: An interdisciplinary field. Head Face Med. 2008;4:5.
74. Jankovic J, Schwartz K, Donovan D. Botulinum toxin treatment of cranialcervical dystonia, spasmodic dysphonia, other focal dystonias and hemifacial spasm. J Neurol Neurosurg Psychiatry. 1990;53:633-639.
75. Kraft S, Lang A. Cranial dystonia, blepharospasm and hemifacial spasm: Clinical features and treatment, including the use of botulinum toxin. CMAJ. 1988;139:837-844.
76. Garcia-Rodriguez B, Fusari A, Rodriguez B, et al. Differential patterns of implicit emotional processing in Alzheimer's disease and healthy aging. J Alzheimers Dis. 2009;18:541-551.
77. Standerwick RG, Roberts WE. The aponeurotic tension model of craniofacial growth in man. Open Dent J. 2009;3:100-113.