Optimization and filtering for human motion capture : AAA multi-layer framework

International Journal of Computer Vision

Volumn 87, Issue 1-2, 2010, Pages 75-92

  Gall, Juergen ^a   Rosenhahn, Bodo ^a   Brox, Thomas ^b   Seidel, Hans Peter ^a  

^a MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

^b DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Filtering; Human motion capture; Stochastic optimization; Tracking

Indexed keywords

3D POSE TRACKING; DATA SETS; EXPERIMENTAL EVALUATION; HUMAN MOTION CAPTURE; LOCAL OPTIMIZATIONS; MODEL-BASED; PARTICLE FILTERING; PHYSICAL CONSTRAINTS; PRIOR INFORMATION; SECOND LAYER; STOCHASTIC OPTIMIZATIONS;

NONLINEAR FILTERING; STOCHASTIC SYSTEMS; THREE DIMENSIONAL;

SIMULATED ANNEALING;

EID: 75149167102     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-008-0173-1     Document Type: Article

References (55)

1. A. Agarwal B. Triggs 2006 Recovering 3D human pose from monocular images IEEE Transactions on Pattern Analysis and Machine Intelligence 28 1 44 58 10.1109/TPAMI.2006.21 (Pubitemid 46395303)
2. D. Anguelov P. Srinivasan D. Koller S. Thrun J. Rodgers J. Davis 2005 Scape: shape completion and animation of people ACM Transactions on Graphics 24 3 408 416 10.1145/1073204.1073207
3. Balan, A., Sigal, L., & Black, M. (2005). A quantitative evaluation of video-based 3D person tracking. In IEEE workshop on VS-PETS (pp. 349-356).
4. Balan, A., Sigal, L., Black, M., Davis, J., & Haussecker, H. (2007). Detailed human shape and pose from images. In IEEE conference on computer vision and pattern recognition.
5. Borgefors, G. (1986). Distance transformations in digital images. Computer Vision, Graphics, and Image Processing, 34(3).
6. Bray, M., Kohli, P., & Torr, P. (2006). Posecut: simultaneous segmentation and 3D pose estimation of humans using dynamic graph-cuts. In European conference on computer vision (pp. 642-655).
7. M. Bray E. Koller-Meier L. V. Gool 2007 Smart particle filtering for high-dimensional tracking Computer Vision and Image Understanding 106 1 116 129 10.1016/j.cviu.2005.09.013 (Pubitemid 46528766)
8. Bregler, C. (1997). Learning and recognizing human dynamics in video sequences. In IEEE conference on computer vision and pattern recognition.
9. Bregler, C., & Malik, J. (1998). Tracking people with twists and exponential maps. In IEEE conference on computer vision and pattern recognition (pp. 8-15).
10. C. Bregler J. Malik K. Pullen 2004 Twist based acquisition and tracking of animal and human kinematics International Journal of Computer Vision 56 3 179 194 10.1023/B:VISI.0000011203.00237.9b
11. Brox, T., Rousson, M., Deriche, R., & Weickert, J. (2003). Unsupervised segmentation incorporating colour, texture, and motion. In Lecture notes in computer science : Vol. 2756. Computer analysis of images and patterns (pp. 353-360). Berlin: Springer.
12. Brox, T., Rosenhahn, B., & Weickert, J. (2005). Three-dimensional shape knowledge for joint image segmentation and pose estimation. In Lecture notes in computer science : Vol. 3663. Pattern recognition (DAGM) (pp. 109-116). Berlin: Springer.
13. Brox, T., Rosenhahn, B., Kersting, U., & Cremers, D. (2006). Nonparametric density estimation for human pose tracking. In Lecture notes in computer science : Vol. 4174. Pattern recognition (DAGM) (pp. 546-555). Berlin: Springer.
14. K. Cheung S. Baker T. Kanade 2005 Shape-from-silhouette across time, part Ii: applications to human modeling and markerless motion tracking International Journal of Computer Vision 63 3 225 245 10.1007/s11263-005-6879-4 (Pubitemid 41217748)
15. Choo, K., & Fleet, D. (2001). People tracking using hybrid Monte Carlo filtering. In International conference on Computer vision (pp. 321-328).
16. CMU (2007). Graphics lab motion capture database. http://mocap.cs.cmu. edu.
17. J. Deutscher I. Reid 2005 Articulated body motion capture by stochastic search International Journal of Computer Vision 61 2 185 205 10.1023/B:VISI.0000043757.18370.9c
18. Deutscher, J., Blake, A., & Reid, I. (2000). Articulated body motion capture by annealed particle filtering. In IEEE conference on computer vision and pattern recognition (Vol. 2, pp. 1144-1149).
19. Douc, R., Cappe, O., & Moulines, E. (2005). Comparison of resampling schemes for particle filtering. In International symposium on image and signal processing and analysis (pp. 64-69).
20. Doucet, A., de Freitas, N., & Gordon, N. (Eds.) (2001). Sequential Monte Carlo methods in practice. New York: Springer.
21. Fossati, A., Dimitrijevic, M., Lepetit, V., & Fua, P. (2007). Bridging the gap between detection and tracking for 3D monocular video-based motion capture. In IEEE conference on computer vision and pattern recognition (pp. 1-8).
22. Gall, J., Brox, T., Rosenhahn, B., & Seidel, H. P. (2007a). Global stochastic optimization for robust and accurate human motion capture. (Tech. Rep. MPI-I-2007-4-008). Max-Planck-Institut für Informatik, Germany.
23. J. Gall J. Potthoff C. Schnoerr B. Rosenhahn H. P. Seidel 2007 Interacting and annealing particle filters: mathematics and a recipe for applications Journal of Mathematical Imaging and Vision 28 1 1 18 10.1007/s10851-007-0007-8 2344877 (Pubitemid 47324838)
24. Gall, J., Rosenhahn, B., & Seidel, H. P. (2007c). Clustered stochastic optimization for object recognition and pose estimation. In Lecture notes in computer science : Vol. 4713. Pattern recognition (pp. 32-41). Berlin: Springer.
25. Gall, J., Rosenhahn, B., & Seidel, H. P. (2008). Drift-free tracking of rigid and articulated objects. In IEEE conference on computer vision and pattern recognition.
26. Gavrila, D., & Davis, L. (1996). 3D model-based tracking of humans in action: a multi-view approach. In IEEE conference on computer vision and pattern recognition (pp. 73-80).
27. D. Hogg 1983 Model-based vision: a program to see a walking person Image and Vision Computing 1 1 5 20 10.1016/0262-8856(83)90003-3 (Pubitemid 13572232)
28. Isard, M., & Blake, A. (1996). Contour tracking by stochastic propagation of conditional density. In European conference on computer vision (pp. 343-356).
29. Isard, M., & Blake, A. (1998). A smoothing filter for condensation. In European conference on computer vision (pp. 767-781).
30. Kakadiaris, I., & Metaxas, D. (1996). Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection. In IEEE conference on computer vision and pattern recognition (pp. 81-87).
31. Kalman, R. (1960). A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering, 82(Series D), 35-45.
32. Kehl, R., Bray, M., & Gool, L. V. (2005). Full body tracking from multiple views using stochastic sampling. In IEEE conference on computer vision and pattern recognition (pp. 129-136).
33. Lee, M., & Nevatia, R. (2006). Human pose tracking using multi-level structured models. In European conference on computer vision (pp. 368-381).
34. T. Moeslund A. Hilton V. Krüger 2006 A survey of advances in vision-based human motion capture and analysis Computer Vision and Image Understanding 104 2 90 126 10.1016/j.cviu.2006.08.002 (Pubitemid 44573873)
35. Moon, K., & Pavlovic, V. (2006). Impact of dynamics on subspace embedding and tracking of sequences. In IEEE conference on computer vision and pattern recognition (pp. 198-205).
36. Moral, P. D. (2004). Feynman-Kac formulae. Genealogical and interacting particle systems with applications. New York: Springer.
37. Mundermann, L., Corazza, S., & Andriacchi, T. (2007). Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models. In Computer vision and pattern recognition (pp. 1-6).
38. X. Pennec N. Ayache 1998 Uniform distribution, distance and expectation problems for geometric features processing Journal of Mathematical Imaging and Vision 9 1 49 67 0906.68198 10.1023/A:1008270110193 1631603
39. Puzicha, J., Buhmann, J. M., Rubner, Y., & Tomasi, C. (1999). Empirical evaluation of dissimilarity measures for color and texture. In International conference on computer vision (pp. 1165-1172).
40. D. Ramanan D. Forsyth A. Zisserman 2007 Tracking people by learning their appearance IEEE Transactions on Pattern Analysis and Machine Intelligence 29 1 65 81 10.1109/TPAMI.2007.250600 (Pubitemid 46415946)
41. B. Rosenhahn T. Brox D. Smith J. Gurney R. Klette 2006 A system for marker-less human motion estimation Künstliche Intelligenz 1 45 51
42. Rosenhahn, B., Brox, T., & Seidel, H. P. (2007a). Scaled motion dynamics for markerless motion capture. In IEEE conference on computer vision and pattern recognition (pp. 1-8).
43. B. Rosenhahn T. Brox J. Weickert 2007 Three-dimensional shape knowledge for joint image segmentation and pose tracking International Journal of Computer Vision 73 3 243 262 10.1007/s11263-006-9965-3 (Pubitemid 46227274)
44. Rosenhahn, B., Klette, R., & Metaxas, D. (Eds.) (2008). Computational imaging and vision : Vol. 36. Human motion-understanding, modelling, capture and animation. Netherlands: Springer.
45. Schraudolph, N. (1999). Local gain adaptation in stochastic gradient descent. In International conference on artificial neural networks (pp. 569-574).
46. Sidenbladh, H., Black, M., & Fleet, D. (2000). Stochastic tracking of 3D human figures using 2D image motion. In European conference on computer vision (pp. 702-718).
47. Sigal, L., & Black, M. (2006). Humaneva: synchronized video and motion capture dataset for evaluation of articulated human motion (Tech. Rep. CS-06-08). Brown University.
48. Sigal, L., Bhatia, S., Roth, S., Black, M., & Isard, M. (2004). Tracking loose-limbed people. In IEEE conference on computer vision and pattern recognition (pp. 421-428).
49. C. Sminchisescu B. Triggs 2003 Estimating articulated human motion with covariance scaled sampling The International Journal of Robotics Research 22 6 371 391 10.1177/0278364903022006003
50. Stolfi, J. (1991). Oriented projective geometry: a framework for geometric computation. Boston: Academic Press.
51. Urtasun, R., & Fua, P. (2004). 3D human body tracking using deterministic temporal motion models. In European conference on computer vision (pp. 92-106).
52. Urtasun, R., Fleet, D. J., & Fua, P. (2006). 3D people tracking with Gaussian process dynamical models. In IEEE conference on computer vision and pattern recognition (pp. 238-245).
53. J. Weickert B. ter Haar Romeny M. Viergever 1998 Efficient and reliable schemes for nonlinear diffusion filtering IEEE Transactions on Image Processing 7 398 410 10.1109/83.661190
54. Williams, C., & Rasmussen, C. (1996). Gaussian processes for regression. In Advances in neural information processing systems.
55. Z. Zhang 1994 Iterative point matching for registration of free-form curves and surfaces International Journal of Computer Vision 13 2 119 152 10.1007/BF01427149