3-D head pose estimation in monocular video sequences using deformable surfaces and radial basis functions

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 19, Issue 2, 2009, Pages 261-272

  Krinidis, Michail ^a   Nikolaidis, Nikos ^a   Pitas, Ioannis ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

3 D deformable models; Head pose estimation; Radial basis function interpolation

Indexed keywords

ATTITUDE CONTROL; DEFORMATION; ESTIMATION; FACE RECOGNITION; FEEDFORWARD NEURAL NETWORKS; FUNCTIONS; GESTURE RECOGNITION; IMAGE SEGMENTATION; INTERPOLATION; MEDICAL IMAGING; PROBABILITY DENSITY FUNCTION; RADIAL BASIS FUNCTION NETWORKS; VIDEO RECORDING; VIDEO SIGNAL PROCESSING;

3-D DEFORMABLE MODELS; DEFORMABLE SURFACE MODELS; DEFORMABLE SURFACES; DIRECTION VECTORS; FACE DETECTORS; FACIAL IMAGES; FEATURE VECTORS; HEAD POSE; HEAD POSE ESTIMATION; MONOCULAR VIDEO SEQUENCES; RADIAL BASIS FUNCTION INTERPOLATION; RADIAL BASIS FUNCTIONS; SURFACE MODELS; TRACKING TECHNIQUES; VIDEO SEQUENCES;

THREE DIMENSIONAL;

EID: 59649118692     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2008.2009261     Document Type: Article

References (40)

1. M. Doi and Y. Aoki, "Real-time video surveillance system using omnidirectional image sensor and controllable camera," Proc. SPIE, Real-Time Imaging VII, vol. 5012, pp. 1-9,. Apr. 2003.
2. U. Weidenbacher, G. Layher. P. Bayerl, and H. Neumann, "Detection of head pose and gaze direction for human-computer interaction," in Perception and Inteiactive Technologies, Springer, Berlin, Heidelberg. Jun. 2006, vol. 4021/2006, pp. 9-19.
3. P. Lu, X. Zeng, X. Huang, and Y. Wang, "Navigation in 3d game by markov model based head pose estimating," in Proc. 3rd ICIG, Dec. 2004, pp. 493-496.
4. B. Yip and J. Jin, "Pose determination and viewpoint determination of human head in video conferencing based on head movement," in Proc. 10th Int. Multimedia Model. Conf., Brisbane. Australia, Jan. 2004, pp. 130-135.
5. B. Yip and J. Jin, "3d reconstruction of a human face with monocular camera based on head movement," in Proc. Pan-Sydney Area Workshop VIP, Darlinghurst, Australia. 2003, pp. 99-103.
6. J. Ng and S. Gong, "Multi-view face detection and pose estimation using a composite support vector machine across the view sphere," in Proc. IEEE Int. Workshop Recognit., Anal., Tracking of Faces Gestures Real-Time Syst., Corfu, Greece, Sep. 1999, pp. 14-21.
7. H. Song, U. Yang, J. Kim, and K. Sohn, "A 3D head pose estimation for face recognition," in Proc. IASTED SIP, HI, USA, Aug. 13-15, 2003, pp. 255-260.
8. C. Chien, Y. Chang, and Y. Chen, "Facial expression analysis under various head poses," in Proc. 3rd Third IEEE Pacific Rim Conf. Multimedia, Taiwan, Dec. 16-18, 2002, vol. 2532/2002, pp. 199-212.
9. E. Seemann, K. Nickel, and R. Stiefelhagen, "Head pose estimation using stereo vision for human-robot interaction," in Proc. 6th Int. Conf. AFGR, Seoul, Korea, May 17-19, 2004, pp. 626-631.
10. R. Yang and Z. Zhang, "Model-based head pose tracking with stereo vision," in Proc. 6th Int. Conf. AFGR, May 2002, pp. 255-260.
11. L. M. Brown and Y.-L. Tian, "Comparative study of coarse head pose estimation," in Proc. IEEE Workshop Motion Video Comput., Dec. 2002, pp. 125-130.
12. S. Ba and J.-M. Odobez, "Evaluation of multiple cue head pose estimation algorithms in natural environments," in Proc. IEEE ICME, Amsterdam. Jul. 2005, pp. 1330-1333.
13. E. Murphy-Chutorian and M. Trivedi, "Head pose estimation in computer vision: A survey," IEEE Transactions on Pattern Analysis and Machine Intelligence, unpublished.
14. Q. Chen, T. Shimada, H. Wu, and T. Shioyama, "Head pose estimation using both color and feature information," in Proc. 15th ICPR, Barcelona, Spain, Sep. 2000, vol. II, pp. 842-845.
15. T. Huang, A. Bruckstein, R. Holt, and A. Netravali, "Uniqueness of 3d pose under weak perspective: A geometrical proof," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 12, pp. 1220-1221, Dec. 1995.
16. Z. Liu and Z. Zhang, "Robust head motion computation by taking advantage of physical properties," in IEEE Workshop Human Motion, Los Alamitos. CA, Dec. 2000, vol. 17, pp. 73-77.
17. Y. Hu, L. Chen, Y. Zhou, and H. Zhang, "Estimating face pose by facial asymmetry and geometry," in Proc. IEEE 6th Int. Conf. AFGR, Seoul, Korea, May 2004, pp. 651-656.
18. M. L. Cascia and V. Athitsos, "Fast, reliable head tracking under varying illumination: An approach based on registration of texture-mapped 3-D models," IEEE Trans. Pattern Anal. Mach. Intelle. vol. 22, no. 4, pp. 322-336, Apr. 2000.
19. C. Zhang and F. S. Cohen, "3-d face structure extraction and recognition from images using 3-d morphing and distance mapping," IEEE Trans. Image Process., vol. 11, pp. 1249-1259, Nov. 2002.
20. B. Kwolek, "Model based facial pose tracking using a particle filter," Proc. IEEE GMAI, pp. 203-208. Jul. 2006.
21. S. O. Ba and J. Odobez, "A probabilistic framework for joint head tracking and pose estimation," in Proc. 17th ICPR, 2004, vol. 4, pp. 264-267.
22. S. Z. Li, X. Lu, X. Hou, X. Peng, and Q. Cheng, "Learning multiview face subspaces and facial pose estimation using independent component analysis," IEEE Tians. Image Process., vol. 14, pp. 705-712, Jun. 2005.
23. R. Stiefelhagen, Y. Jie, and A. Waibel, "Simultaneous tracking of head poses in a panoramic view," in Proc. 15th Int. Conf. Pattern Recognit., Barcelona, Spain, Sep. 2000, vol. 3, pp. 722-725.
24. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
25. Y. Li, S. Gong, J. Sherrah, and H. Liddell, "Support vector machine based multiview face detection and recognition," Image Vis. Comput., vol. 1, no. 5. pp. 413-27, May 2004.
26. Y. Li, S. Gong, and H. Liddell, "Support vector regression and classification based multiview face detection and recognition," in Proc. IEEE Int. Conf. Automatic Face Gesture Recognit., Grenoble. France, Mar. 2004, pp. 300-305.
27. A. Rajwade and M. Levine, "Facial pose from 3D data," Image and Vis. Comput., vol. 24, no. 8, pp. 849-856, Aug. 2006.
28. B. M. C. Nastar and A. Pentland, "Generalized image matching: Statistical learning of physically-based deformations," in Proc. 4th ECCV, Cambridge, U.K., Apr. 1996. vol. 1, pp. 589-598.
29. B. Moghaddam, C. Nastar, and A. Pentland, "A bayesian similarity measure for direct image matching," in Proc. ICPR, Vienna, Austria, Aug. 1996, pp. 350-358.
30. A. Pentland and S. Sclaroff, "Closed-form solutions for physically based shape modeling and recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 7, pp. 715-729, Jul. 1991.
31. C. Nastar and N. Ayache, "Frequency-based nonrigid motion analysis: Application to four dimensional medical images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 11, pp. 1069-1079, Nov. 1996.
32. S. Krinidis, C. Nikou, and I. Pitas, "Reconstruction of serially acquired slices using physics-based modelling," IEEE Tians. Inf. Technol. Biomed., vol. 7, pp. 394-403, Dec. 2003.
33. C. Nikou, G. Bueno, F. Heitz, and J. Armspach, "A joint physics-based statistical deformable model for multimodal brain image analysis," IEEE Trans. Med. Imag., vol. 20, no. 10, pp. 1026-1037, Oct. 2001.
34. C. Nastar and N. Ayache, "Fast segmentation, tracking, and analysis of deformable objects," in Proc. 4th ICCV. Berlin, Germany, May 1993, pp. 11-14.
35. M. Krinidis, N. Nikolaidis, and I. Pitas, "The discrete modal transform and its application to lossy image compression," Signal Process.: Image Commun., vol. 22, no. 5, pp. 480-504, Jun. 2007.
36. M. Krinidis, N. Nikolaidis, and I. Pitas, "2-D feature point selection and tracking using 3-D physics-based deformable surfaces," IEEE Tians. Circuits Syst. Video Technol. vol. 17, no. 7, pp. 876-888, Jul. 2007.
37. R. Lienhart and J. Maydt, "An extended set of Haar-like features for rapid object detection," in Proc. IEEE ICIP, Rochester, NY, Sep. 2002. pp. 900-903.
38. P. Viola and M. J. Jones, "Robust real-time object detection," Cambridge Research Lab., Cambridge, U.K., 2001, Tech. Rep. 01.
39. S. Haykin, Neural Networks: A compiehensive Foundation, 2nd ed. New York: Macmillan, 1998.
40. D. Broomhead and D. Lowe, "Multivariable functional interpolation and adaptive networks," Complex Syst., vol. 2, pp. 321-355, 1998.