Exploiting projective geometry for view-invariant monocular human motion analysis in man-made environments

Computer Vision and Image Understanding

Volumn 120, Issue , 2014, Pages 126-140

  Rogez, Grégory ^a   Orrite, Carlos ^a   Guerrero, J J ^a   Torr, Philip H S ^b  

^a UNIVERSITY OF ZARAGOZA   (Spain)

^b UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Human motion analysis; Projective geometry; Video surveillance; View invariance

Indexed keywords

EID: 84894058487     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2013.12.012     Document Type: Article

References (69)

1. G. Shakhnarovich, P. Viola, R. Darrell, Fast pose estimation with parameter-sensitive hashing, in: ICCV, 2003.
2. G. Mori, and J. Malik Recovering 3d human body configurations using shape contexts IEEE Trans. Pattern Anal. Mach. Intell. 28 7 2006 1052 1062
3. E. Ong, A.S. Micilotta, R. Bowden, and A. Hilton Viewpoint invariant exemplar-based 3d human tracking Comput. Vis. Image Understand. 104 2006 178 189 (Pubitemid 44573875)
4. A. Agarwal, and B. Triggs Recovering 3d human pose from monocular images IEEE Trans. Pattern Anal. Mach. Intell. 28 1 2006 44 58 (Pubitemid 46395303)
5. A.M. Elgammal, and C.-S. Lee Tracking people on a torus IEEE Trans. Pattern Anal. Mach. Intell. 31 3 2009 520 538
6. C.-S. Lee, and A.M. Elgammal Coupled visual and kinematic manifold models for tracking Int. J. Comput. Vis. 87 1-2 2010 118 139
7. T. Jaeggli, E. Koller-Meier, and L.J.V. Gool Learning generative models for multi-activity body pose estimation Int. J. Comput. Vis. 83 2 2009 121 134
8. 3E: discriminative density propagation for visual tracking IEEE Trans. Pattern Anal. Mach. Intell. 29 11 2007 2030 2044 (Pubitemid 47423794)
9. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: CVPR, vol. 2, 2005, pp. 886-893. (Pubitemid 43897286)
10. M. Enzweiler, and D.M. Gavrila Monocular pedestrian detection: survey and experiments IEEE Trans. Pattern Anal. Mach. Intell. 31 12 2009 2179 2195
11. M.D. Breitenstein, F. Reichlin, B. Leibe, E. Koller-Meier, and L.J.V. Gool Online multiperson tracking-by-detection from a single, uncalibrated camera IEEE Trans. Pattern Anal. Mach. Intell. 33 9 2011 1820 1833
12. J. Gall, A. Yao, N. Razavi, L.J.V. Gool, and V.S. Lempitsky Hough forests for object detection, tracking, and action recognition IEEE Trans. Pattern Anal. Mach. Intell. 33 11 2011 2188 2202
13. G. Rogez, J. Rihan, C. Orrite, and P.H. Torr Fast human pose detection using randomized hierarchical cascades of rejectors Int. J. Comput. Vis. 99 1 2012 25 52
14. R. Okada, S. Soatto, Relevant feature selection for human pose estimation and localization in cluttered images, in: ECCV, 2008, pp. 434-445.
15. M. Andriluka, S. Roth, B. Schiele, Monocular 3d pose estimation and tracking by detection, in: CVPR, 2010, pp. 623-630.
16. D. Ramanan, D.A. Forsyth, and A. Zisserman Tracking people by learning their appearance IEEE Trans. Pattern Anal. Mach. Intell. 29 1 2007 65 81 (Pubitemid 46415946)
17. B. Wu, and R. Nevatia Detection and segmentation of multiple, partially occluded objects by grouping, merging, assigning part detection responses Int. J. Comput. Vis. 82 2 2009 185 204
18. L. D. Bourdev, S. Maji, T. Brox, J. Malik, Detecting people using mutually consistent poselet activations, in: ECCV (6), 2010, pp. 168-181.
19. P.F. Felzenszwalb, R.B. Girshick, D.A. McAllester, and D. Ramanan Object detection with discriminatively trained part-based models IEEE Trans. Pattern Anal. Mach. Intell. 32 9 2010 1627 1645
20. Z. Lin, and L.S. Davis Shape-based human detection and segmentation via hierarchical part-template matching IEEE Trans. Pattern Anal. Mach. Intell. 32 4 2010 604 618
21. EC funded CAVIAR project IST 2001 37540, 2004. < http://homepages.inf. ed.ac.uk/rbf/CAVIAR/ >.
22. R. Gross, J. Shi, The CMU motion of body (MoBo) database 49, 2001.
23. X. Ji, and H. Liu Advances in view-invariant human motion analysis: a review IEEE Trans. Syst. Man Cybernet. Part C 40 1 2010 13 24
24. I. Haritaoglu, D. Harwood, and L. Davis W4: Real-time surveillance of people and their activities IEEE Trans. Pattern Anal. Mach. Intell. 22 8 2000 809 830
25. M. Isard, J. MacCormick, BraMBLe: a bayesian multiple-blob tracker, in: ICCV, 2001, pp. 34-41. (Pubitemid 32795038)
26. N. T. Siebel, S. J. Maybank, Fusion of multiple tracking algorithms for robust people tracking, in: ECCV, 2002, pp. 373-387.
27. R. Rosales, M. Siddiqui, J. Alon, and S. Sclaroff Estimating 3d body pose using uncalibrated cameras CVPR 1 2001 821 827
28. R. Cucchiara, C. Grana, A. Prati, and R. Vezzani Probabilistic posture classification for human-behavior analysis IEEE Trans. Syst. Man Cybernet. - Part A 35 1 2005 42 54 (Pubitemid 40085385)
29. A. Farhadi, M. K. Tabrizi, Learning to recognize activities from the wrong view point, in: ECCV (1), 2008, pp. 154-166.
30. V. Parameswaran, R. Chellappa, View independent human body pose estimation from a single perspective image, in: CVPR (2), 2004, pp. 16-22.
31. V. Parameswaran, and R. Chellappa View invariance for human action recognition Int. J. Comput. Vis. 66 1 2006 83 101 (Pubitemid 43004673)
32. A. Datta, Y. Sheikh, and T. Kanade Linearized motion estimation for articulated planes IEEE Trans. Pattern Anal. Mach. Intell. 33 4 2011 780 793
33. I. Bouchrika, M. Goffredo, J.N. Carter, M.S. Nixon, Covariate analysis for view-point independent gait recognition, in: ICB, 2009, pp. 990-999.
34. M. Goffredo, R.D. Seely, J.N. Carter, M.S. Nixon, Markerless view independent gait analysis with self-camera calibration, in: FG, 2008, pp. 1-6.
35. D. Gong, G.G. Medioni, Dynamic manifold warping for view invariant action recognition, in: ICCV, 2011.
36. K. Grauman, G. Shakhnarovich, T. Darrell, Example-based 3d shape inference from a single silhouettes., in: Proc. ECCV Workshop SMVP, 2004.
37. A. Kale, A.K.R. Chowdhury, R. Chellappa, Towards a view invariant gait recognition algorithm, in: IEEE Int. Conf on Advanced Video and Signal based Surveillance, 2003, pp. 143-150.
38. G. Rogez, J. Guerrero, J. Martínez, C. Orrite, Viewpoint independent human motion analysis in man-made environments, in: Proc. of the 17th British Machine Vision Conference (BMVC), vol. 2, Edinburgh, UK, 2006, pp. 659-668.
39. Y. Li, B. Wu, R. Nevatia, Human detection by searching in 3d space using camera and scene knowledge, in: ICPR, 2008, pp. 1-5.
40. J. Gall, B. Rosenhahn, T. Brox, and H.-P. Seidel Optimization and filtering for human motion capture Int. J. Comput. Vis. 87 1-2 2010 75 92
41. A. Balan, L. Sigal, M. Black, J. Davis, H. Haussecker, Detailed human shape and pose from images, in: CVPR, 2007, pp. 1-8.
42. R. Rosales, and S. Sclaroff Combining generative and discriminative models in a framework for articulated pose estimation Int. J. Comput. Vis. 67 3 2006 251 276 (Pubitemid 43741483)
43. G. Rogez, J. Rihan, S. Ramalingam, C. Orrite, P.H. Torr, Randomized trees for human pose detection, in: Proc. of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2008.
44. J. Zhang, R.T. Collins, Y. Liu, Bayesian body localization using mixture of nonlinear shape models, in: ICCV, 2005, pp. 725-732. (Pubitemid 44055027)
45. X. Lan, D.P. Huttenlocher, A unified spatio-temporal articulated model for tracking, in: CVPR (1), 2004, pp. 722-729.
46. G. Rogez, C. Orrite, and J. Martínez A spatio-temporal 2d-models framework for human pose recovery in monocular sequences Pattern Recogn. 41 9 2008 2926 2944
47. L. Sigal, A.O. Balan, and M.J. Black Humaneva: synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion Int. J. Comput. Vis. 87 1-2 2010 4 27
48. K. Toyama, and A. Blake Probabilistic tracking with exemplars in a metric space Int. J. Comput. Vis. 48 1 2002 9 19 (Pubitemid 34491072)
49. G. Rogez, J. Rihan, J.J. Guerrero, C. Orrite, Monocular 3-d gait tracking in surveillance scenes, IEEE Trans. Cybernet. PP (99) (in press), http://dx.doi.org/10.1109/TCYB.2013.2275731.
50. T. Zhao, R. Nevatia, and B. Wu Segmentation and tracking of multiple humans in crowded environments IEEE Trans. Pattern Anal. Mach. Intell. 30 7 2008 1198 1211
51. D.M. Gavrila, and A. bayesian exemplar-based approach to hierarchical shape matching IEEE Trans. Pattern Anal. Mach. Intell. 29 8 2007 1408 1421 (Pubitemid 47040439)
52. A. Baumberg, D. Hogg, Learning flexible models from image sequences, in: ECCV, 1994, pp. 299-308.
53. N.T. Siebel, S.J. Maybank, Fusion of multiple tracking algorithms for robust people tracking, in: ECCV (4), 2002, pp. 373-387.
54. J. Giebel, D. Gavrila, C. Schnörr, A bayesian framework for multi-cue 3d object tracking, in: ECCV (4), 2004, pp. 241-252.
55. D. Cremers Dynamical statistical shape priors for level set-based tracking IEEE Trans. Pattern Anal. Mach. Intell. 28 8 2006 1262 1273 (Pubitemid 46405024)
56. R. Li, T.-P. Tian, S. Sclaroff, and M.-H. Yang 3d human motion tracking with a coordinated mixture of factor analyzers Int. J. Comput. Vis. 87 1-2 2010 170 190
57. D. Weinland, E. Boyer, R. Ronfard, Action recognition from arbitrary views using 3d exemplars, in: ICCV, 2007, pp. 1-7.
58. M.F. Abdelkader, W. Abd-Almageed, A. Srivastava, and R. Chellappa Silhouette-based gesture and action recognition via modeling trajectories on riemannian shape manifolds Comput. Vis. Image Understand. 115 3 2011 439 455
59. T. Riklin-Raviv, N. Kiryati, and N.A. Sochen Prior-based segmentation and shape registration in the presence of perspective distortion Int. J. Comput. Vis. 72 3 2007 309 328 (Pubitemid 46094754)
60. G. Rogez, Advances in monocular exemplar-based human body pose analysis: modeling, detection and tracking, Ph.D. thesis, Dept. Electron. Comm. Eng., Univ. Zaragoza, Zaragoza, Spain, 2012.
61. G. Rogez, J. J. Guerrero, C. Orrite, View-invariant human feature extraction for video-surveillance applications, in: Proc. of the IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 2007, pp. 324-329.
62. J. Sola, T. Vidal-Calleja, J. Civera, and J. Montiel Impact of landmark parametrization on monocular ekf-slam with points and lines Int. J. Comput. Vis. 97 2012 339 368
63. R.I. Hartley, and A. Zisserman Multiple View Geometry in Computer Vision second ed. 2004 Cambridge University Press ISBN: 0521540518
64. T. Zhao, and R. Nevatia Tracking multiple humans in complex situations IEEE Trans. Pattern Anal. Mach. Intell. 26 9 2004 1208 1221
65. A. Criminisi, I.D. Reid, and A. Zisserman Single view metrology Int. J. Comput. Vis. 40 2 2000 123 148 (Pubitemid 32136369)
66. E. Lutton, H. Maitre, and J. Lopez-K. Contribution to the determination of vanishing points using hough transform IEEE Trans. Pattern Anal. Mach. Intell. 16 4 1994 430 438
67. J. Guerrero, C. Sagüés, Robust line matching and estimate of homographies simultaneously, in: Proc. Ib. Conf. on Pattern Recognition and Image Analysis (IbPria), 2003, pp. 297-307.
68. T. Zhao, R. Nevatia, Stochastic human segmentation from static camera, in: IEEE Workshop on Motion and Video Computing, 2002.
69. O. Lanz Approximate bayesian multibody tracking IEEE Trans. Pattern Anal. Mach. Intell. 28 9 2006 1436 1449 (Pubitemid 44132650)