Exploiting long-term connectivity and visual motion in CRF-based multi-person tracking

IEEE Transactions on Image Processing

Volumn 23, Issue 7, 2014, Pages 3040-3056

  Heili, Alexandre ^a,b   López Méndez, Adolfo ^b   Odobez, Jean Marc ^a,b  

^a EPFL   (Switzerland)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

CRF; Multi person tracking; tracking by detection; visual motion

Indexed keywords

IMAGE PROCESSING; MATHEMATICAL MODELS;

CONDITIONAL RANDOM FIELD; CRF; HIGHER ORDER POTENTIALS; LONG-TERM CONNECTIVITY; MULTI-PERSON TRACKING; STATE-OF-THE-ART ALGORITHMS; TRACKING-BY-DETECTION; VISUAL MOTION;

VISION;

ALGORITHM; HUMAN; IMAGE PROCESSING; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; PROCEDURES; SPATIOTEMPORAL ANALYSIS; VIDEORECORDING;

ALGORITHMS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MOVEMENT; SPATIO-TEMPORAL ANALYSIS; VIDEO RECORDING;

EID: 84903120909     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2324292     Document Type: Article

References (42)

1. (2012, Oct.). PETS 2009 Benchmark Data [Online]. Available: http://www.cvg.rdg.ac.uk/PETS2009/a.html
2. (2011, Jun.). CAVIAR Test Case Scenarios [Online]. Available: http://groups.inf.ed.ac.uk/vision/CAVIAR/CAVIARDATA1/
3. A. Andriyenko and K. Schindler, "Multi-target tracking by continuous energy minimization," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 1265-1272.
4. A. Andriyenko, K. Schindler, and S. Roth, "Discrete-continuous optimization for multi-target tracking," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 1926-1933.
5. S. Bak, D. P. Chau, J. Badie, E. Corvee, F. Bremond, and M. Thonnat, "Multi-target tracking by discriminative analysis on Riemannian manifold," in Proc. IEEE ICIP, Sep./Oct. 2012, pp. 1605-1608.
6. B. Benfold and I. Reid, "Stable multi-target tracking in real-time surveillance video," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 3457-3464.
7. J. Berclaz, F. Fleuret, and P. Fua, "Multi-camera tracking and atypical motion detection with behavioral maps," in Proc. ECCV, 2008, pp. 112-125.
8. J. Berclaz, F. Fleuret, and P. Fua, "Multiple object tracking using flow linear programming," in Proc. 12th IEEE Int. Workshop Winter-PETS, Dec. 2009, pp. 1-8.
9. K. Bernardin and R. Stiefelhagen, "Evaluating multiple object tracking performance: The CLEAR MOT metrics," J. Image Video Process., vol. 2008, pp. 1:1-1:10, Feb. 2008.
10. M. D. Breitenstein, F. Reichlin, B. Leibe, E. Koller-Meier, and L. Van Gool, "Online multiperson tracking-by-detection from a single, uncalibrated camera," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 9, pp. 1820-1833, Sep. 2011.
11. R. T. Collins, "Multitarget data association with higher-order motion models," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 1744-1751.
12. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Int. CVPR, Jun. 2005, pp. 886-893. (Pubitemid 43897286)
13. P. Dollar, S. Belongie, and P. Perona, "The fastest pedestrian detector in the west," in Proc. BMVC, 2010, pp. 68.1-68.11.
14. C. Dubout and F. Fleuret, "Exact acceleration of linear object detectors," in Proc. ECCV, 2012, pp. 301-311.
15. P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1627-1645, Sep. 2010.
16. F. Fleuret, J. Berclaz, R. Lengagne, and P. Fua, "Multicamera people tracking with a probabilistic occupancy map," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 267-282, Feb. 2008.
17. A. Heili, C. Chen, and J.-M. Odobez, "Detection-based multi-human tracking using a CRF model," in Proc. IEEE ICCV Workshop, Nov. 2011, pp. 1673-1680.
18. A. Heili and J.-M. Odobez, "Parameter estimation and contextual adaptation for a multi-object tracking CRF model," in Proc. IEEE Int. Workshop PETS, Jan. 2013, pp. 14-21.
19. C. Huang, B. Wu, and R. Nevatia, "Robust object tracking by hierarchical association of detection responses," in Proc. 10th ECCV, 2008, pp. 788-801.
20. (2011, Jun.). INRIA Person Dataset [Online]. Available: http://pascal.inrialpes.fr/data/human/
21. V. Kolmogorov and R. Zabin, "What energy functions can be minimized via graph cuts?" IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 2, pp. 147-159, Feb. 2004.
22. C.-H. Kuo and R. Nevatia, "How does person identity recognition help multi-person tracking?" in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 1217-1224.
23. Y. Li, C. Huang, and R. Nevatia, "Learning to associate: HybridBoosted multi-target tracker for crowded scene," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 2953-2960.
24. E. Maggio and A. Cavallaro, "Learning scene context for multiple object tracking," IEEE Trans. Image Process., vol. 18, no. 8, pp. 1873-1884, Aug. 2009.
25. A. Milan, K. Schindler, and S. Roth, "Challenges of ground truth evaluation of multi-target tracking," in Proc. IEEE Conf. CVPRW, Jun. 2013, pp. 735-742.
26. J.-M. Odobez and P. Bouthemy, "MRF-based motion segmentation exploiting a 2D motion model robust estimation," in Proc. IEEE Int. Conf. Image Process., Oct. 1995, pp. 628-631.
27. J.-M. Odobez and P. Bouthemy, "Robust multiresolution estimation of parametric motion models," J. Vis. Commun. Image Represent., vol. 6, no. 4, pp. 348-365, 1995.
28. H. Pirsiavash, D. Ramanan, and C. C. Fowlkes, "Globally-optimal greedy algorithms for tracking a variable number of objects," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 1201-1208.
29. M. Rodriguez, I. Laptev, J. Sivic, and J.-Y. Audibert, "Density-aware person detection and tracking in crowds," in Proc. IEEE ICCV, Nov. 2011, pp. 2423-2430.
30. H. Ben Shitrit, J. Berclaz, F. Fleuret, and P. Fua, "Tracking multiple people under global appearance constraints," in Proc. IEEE ICCV, Nov. 2011, pp. 137-144.
31. B. Song, T.-Y. Jeng, E. Staudt, and A. K. R. Chowdhury, "A stochastic graph evolution framework for robust multi-target tracking," in Proc. ECCV, 2010, pp. 605-619.
32. X. Song, X. Shao, H. Zhao, J. Cui, R. Shibasaki, and H. Zha, "An online approach: Learning-semantic-scene-by-tracking and trackingby- learning-semantic-scene," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 739-746.
33. S. Walk, N. Majer, K. Schindler, and B. Schiele, "New features and insights for pedestrian detection," in Proc. IEEE Conf. CVPR, San Francisco, CA, USA, Jun. 2010, pp. 1030-1037.
34. Z. Wu, T. H. Kunz, and M. Betke, "Efficient track linking methods for track graphs using network-flow and set-cover techniques," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 1185-1192.
35. B. Yang, C. Huang, and R. Nevatia, "Learning affinities and dependencies for multi-target tracking using a CRF model," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 1233-1240.
36. B. Yang and R. Nevatia, "Multi-target tracking by online learning of non-linear motion patterns and robust appearance models," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 1918-1925.
37. B. Yang and R. Nevatia, "An online learned CRF model for multi-target tracking," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 2034-2041.
38. M. Yang, Y. Wu, and G. Hua, "Context-aware visual tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 7, pp. 1195-1209, Jul. 2009.
39. J. Yao and J.-M. Odobez, "Multi-camera multi-person 3D space tracking with MCMC in surveillance scenarios," in Proc. ECCV-M2SFA2, Marseille, France, Oct. 2008.
40. A. Yilmaz, O. Javed, and M. Shah, "Object tracking: A survey," ACM Comput. Surv., vol. 38, no. 4, p. 13, 2006.
41. A. R. Zamir, A. Dehghan, and M. Shah, "GMCP-tracker: Global multiobject tracking using generalized minimum clique graphs," in Proc. ECCV, 2012, pp. 343-356.
42. L. Zhang, Y. Li, and R. Nevatia, "Global data association for multi-object tracking using network flows," in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.