Challenges of ground truth evaluation of multi-target tracking

IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

Volumn , Issue , 2013, Pages 735-742

  Milan, Anton ^a   Schindler, Konrad ^b   Roth, Stefan ^a  

^a DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

^b ETH ZURICH   (Switzerland)

Author keywords

Evaluation; Ground Truth; Multi object tracking

Indexed keywords

EVALUATION; EVALUATION SOFTWARE; GROUND TRUTH; MULTI-OBJECT TRACKING; MULTI-TARGET TRACKING; QUANTITATIVE COMPARISON; TRACKING APPROACHES; TRAINING PROCEDURES;

IMAGE PROCESSING; PATTERN RECOGNITION;

TRACKING (POSITION);

EID: 84884913454     PISSN: 21607508     EISSN: 21607516     Source Type: Conference Proceeding    
DOI: 10.1109/CVPRW.2013.111     Document Type: Conference Paper

References (31)

1. M. Andriluka, S. Roth, and B. Schiele. Monocular 3D pose estimation and tracking by detection. CVPR 2010.
2. M. Andriluka, S. Roth, and B. Schiele. People-tracking-bydetection and people-detection-by-tracking. CVPR 2008.
3. A. Andriyenko and K. Schindler. Multi-target tracking by continuous energy minimization. CVPR 2011.
4. A. Andriyenko, K. Schindler, and S. Roth. Discrete-continuous optimization for multi-target tracking. CVPR 2012.
5. A. Bagdanov, A. Del Bimbo, F. Dini, G. Lisanti, and I. Masi. Compact and efficient posterity logging of face imagery for video surveillance. IEEE Multimedia, 19(4):48-59, 2012.
6. S. Baker, D. Scharstein, J. P. Lewis, S. Roth, M. J. Black, and R. Szeliski. A database and evaluation methodology for optical flow. Int. J. Comput. Vision, 92(1):1-31, 2011.
7. H. Ben Shitrit, J. Berclaz, F. Fleuret, and P. Fua. Tracking multiple people under global appearance constraints. ICCV 2011.
8. J. Bergstra and Y. Bengio. Random search for hyperparameter optimization. JMLR, 13:281-305, 2012.
9. K. Bernardin and R. Stiefelhagen. Evaluating multiple object tracking performance: The CLEAR MOT metrics. Image and Video Processing, 2008(1):1-10, 2008.
10. W. Choi and S. Savarese. Multiple target tracking in world coordinate with single, minimally calibrated camera. ECCV 2010.
11. A. Ellis and J. Ferryman. PETS2010 and PETS2009 evaluation of results using individual ground truthed single views. AVSS, 2010.
12. A. Ess, B. Leibe, K. Schindler, and L. Van Gool. A mobile vision system for robust multi-person tracking. CVPR 2008.
13. M. Everingham, L. Van Gool, C. Williams, J. Winn, and A. Zisserman. The PASCAL VOC 2012 Results. 2012.
14. F. Fleuret, J. Berclaz, R. Lengagne, and P. Fua. Multicamera people tracking with a probabilistic occupancy map. IEEE T. Pattern Anal. Mach. Intell., 30(2):1806-1819, 2008.
15. A. Geiger, P. Lenz, and R. Urtasun. Are we ready for autonomous driving? The KITTI Vision Benchmark Suite. CVPR 2012.
16. J. Henriques, R. Caseiro, and J. Batista. Globally optimal solution to multi-object tracking with merged measurements. ICCV 2011.
17. E. Horbert, K. Rematas, and B. Leibe. Level-set person segmentation and tracking with multi-region appearance models and top-down shape information. ICCV 2011.
18. Y. Li, C. Huang, and R. Nevatia. Learning to associate: Hybridboosted multi-target tracker for crowded scene. CVPR 2009.
19. D. Mitzel, E. Horbert, A. Ess, and B. Leibe. Multi-person tracking with sparse detection and continuous segmentation. ECCV 2010.
20. H. Pirsiavash, D. Ramanan, and C. C. Fowlkes. Globallyoptimal greedy algorithms for tracking a variable number of objects. CVPR 2011.
21. B. Russell, A. Torralba, K. Murphy, and W. Freeman. Labelme: A database and web-based tool for image annotation. Int. J. Comput. Vision, 77(1-3):157-173, 2008.
22. S. M. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski. A comparison and evaluation of multi-view stereo reconstruction algorithms. CVPR 2006.
23. G. Shu, A. Dehghan, O. Oreifej, E. Hand, and M. Shah. Partbased multiple-person tracking with partial occlusion handling. CVPR 2012.
24. K. Smith, D. Gatica-Perez, J.-M. Odobez, and S. Ba. Evaluating multi-object tracking. Workshop on Empirical Evaluation Methods in Computer Vision (EEMCV), 2005.
25. R. Stiefelhagen, K. Bernardin, R. Bowers, J. S. Garofolo, D. Mostefa, and P. Soundararajan. The CLEAR 2006 evaluation. CLEAR, 2006.
26. A. Utasi and C. Benedek. A multi-view annotation tool for people detection evaluation. Workshop on Visual Interfaces for Ground Truth Collection in Computer Vision Applications, Capri, Italy, 2012.
27. C. Vondrick, D. Patterson, and D. Ramanan. Efficiently scaling up crowdsourced video annotation. Int. J. Comput. Vision, 101(1):184-204, 2013.
28. S. Walk, N. Majer, K. Schindler, and B. Schiele. New features and insights for pedestrian detection. CVPR 2010.
29. B. Wu and R. Nevatia. Tracking of multiple, partially occluded humans based on static body part detection. CVPR 2006.
30. B. Yang and R. Nevatia. An online learned CRF model for multi-target tracking. CVPR 2012.
31. D. Zoran and Y. Weiss. Scale invariance and noise in natural images. ICCV 2009.