Integrating graph partitioning and matching for trajectory analysis in video surveillance

IEEE Transactions on Image Processing

Volumn 21, Issue 12, 2012, Pages 4844-4857

  Lin, Liang ^a   Lu, Yongyi ^a   Pan, Yan ^a   Chen, Xiaowu ^b  

^a SUN YAT SEN UNIVERSITY   (China)

^b BEIHANG UNIVERSITY   (China)

Author keywords

Graph partitioning and matching; multiple object tracking; trajectory analysis; video surveillance

Indexed keywords

APPEARANCE MODELS; ATTRIBUTE GRAPHS; BACKGROUND CLUTTER; BACKGROUND MODEL; BAYESIAN FRAMEWORKS; COMPOSITE FEATURES; DATA SETS; ERGODICS; GRAPH PARTITIONING; GRAPH REPRESENTATION; GRAPH VERTEX; IMAGE PRIMITIVES; JOINT SPACE; LONG RANGE; MARKOV CHAIN MONTE CARLO ALGORITHMS; MOVING OBJECTS; MULTIPLE OBJECT TRACKING; POSTERIORI; PROBABILISTIC INFERENCE; SHORT SEQUENCES; SPATIAL GRAPHS; SPATIO-TEMPORAL; STATE-OF-THE-ART METHODS; TARGET TRAJECTORY; TEMPORAL GRAPHS; TRAJECTORY ANALYSIS; UNIFIED APPROACH; VIDEO FRAME; VIDEO SURVEILLANCE; VISUAL SURVEILLANCE;

ALGORITHMS; GRAPH THEORY; IMAGE MATCHING; INFERENCE ENGINES; MARKOV PROCESSES; MONITORING; PATTERN MATCHING; TRAJECTORIES;

SECURITY SYSTEMS;

ALGORITHM; ARTICLE; CAR; CLUSTER ANALYSIS; HUMAN; IMAGE PROCESSING; METHODOLOGY; MONTE CARLO METHOD; PROBABILITY; VIDEORECORDING;

ALGORITHMS; AUTOMOBILES; CLUSTER ANALYSIS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MARKOV CHAINS; MONTE CARLO METHOD; VIDEO RECORDING;

EID: 84869462967     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2211373     Document Type: Article

References (44)

1. N. Bellotto and H. Hu, "Multisensor-based human detection and tracking for mobile service robots," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 39, no. 1, pp. 167-181, Feb. 2009.
2. X. Liu, L. Lin, H. Jin, S. Yan, and W. Tao, "Integrating spatio-temporal context with multiview representation for object recognition in visual surveillance," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 4, pp. 393-407, Apr. 2011.
3. O. Barnich and M. Van Droogenbroeck, "ViBe: A universal background subtraction algorithm for video sequences," IEEE Trans. Image Process., vol. 20, no. 6, pp. 1709-1724, Jun. 2011.
4. P. Pan and D. Schonfeld, "Video tracking based on sequential particle filtering on graphs," IEEE Trans. Image Process., vol. 20, no. 6, pp. 1641-1651, Jun. 2011.
5. L. Lin, H. Gong, L. Li, and L. Wang, "Semantic event representation and recognition using syntactic attribute graph grammar," Pattern Recogn. Lett., vol. 30, no. 2, pp. 180-186, 2009.
6. B. Yao, X. Yang, L. Lin, M. Lee, and S. C. Zhu, "I2T: Image parsing to text description," Proc. IEEE, vol. 98, no. 8, pp. 1485-1508, Aug. 2010.
7. A. Kiruluta, M. Eizenman, and S. Pasupathy, "Predictive head movement tracking using a kalman filter," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 27, no. 2, pp. 326-331, Apr. 1997.
8. Y. Li, C. Huang, and R. Nevatia, "Learning to associate: HybridBoosted multi-target tracker for crowded scene," in Proc. IEEE Comput. Vision Pattern Recogn. Conf., Jun. 2009, pp. 2953-2960.
9. L. Lin, Y. Wang, Y. Liu, C. Xiong, and K. Zeng, "Marker-less registration based on template tracking for augmented reality," Multimedia Tools Appl., vol. 41, no. 2, pp. 235-252, 2009.
10. A. Yilmaz and O. Javed, "Object tracking: A survey," ACM Comput. Survey, vol. 38, no. 4, pp. 1-13, 2006.
11. B. Babenko, M. H. Yang, and S. Belongie, "Visual tracking with online multiple instance learning," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., Jun. 2009, pp. 983-990.
12. Y. Xie, L. Lin, and Y. Jia, "Tracking objects with adaptive feature patches for PTZ camera visual surveillance," in Proc. IEEE Int. Conf. Pattern Recogn., Aug. 2010, pp. 1739-1742.
13. N. Jiang, W. Liu, and Y. Wu, "Learning adaptive metric for robust visual tracking," IEEE Trans. Image Process., vol. 20, no. 8, pp. 2288-2300, Aug. 2011.
14. X. Liu, L. Lin, S. Yan, H. Jin, and W. Jiang, "Adaptive object tracking by learning hybrid template on-line," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 11, pp. 1588-1599, Nov. 2011.
15. T. K. Moon, S. E. Budge, W. C. Stirling, and J. B. Thompson, "Epistemic decision theory applied to multiple-target tracking," IEEE Trans. Syst. Man Cybern., vol. 24, no. 2, pp. 234-245, Feb. 1994.
16. X. Liu, L. Lin, S. C. Zhu, and H. Jin, "Trajectory parsing by cluster sampling in spatio-temporal graph," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., Jun. 2009, pp. 739-746.
17. H. T. Nguyen, Q. Ji, and A. W. M. Smeulders, "Robust multi-target tracking using spatio-temporal context," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., May 2006, pp. 578-585.
18. Z. Khan, T. Balch, and F. Dellaert, "An MCMC-based particle filter for tracking multiple interacting targets," in Proc. Eur. Conf. Comput. Vis., 2004, pp. 279-290.
19. S. P. Denman, V. Chandran, and S. Sridharan, "An adaptive optical flow technique for person tracking systems," Pattern Recogn. Lett., vol. 28, no. 10, pp. 1232-1239, 2007.
20. S. Avidan, "Ensemble tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 2, pp. 261-271, Feb. 2007.
21. D. Reid, "An algorithm for tracking multiple targets," IEEE Trans. Autom. Control, vol. 24, no. 6, pp. 84-90, Dec. 1979.
22. Y. Bar-Shalom, T. Fortmann, and M. Scheffe, "Joint probabilistic data association for multiple targets in clutter," in Proc. Inform. Sci. Syst., 1980, pp. 1-10.
23. J. Berclaz, F. Fleuret, and P. Fua, "Robust people tracking with global trajectory optimization," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., Jun. 2006, pp. 744-750.
24. L. Yang, J. Si, K. S. Tsakalis, and A. A. Rodriguez, "Direct heuristic dynamic programming for nonlinear tracking control with filtered tracking error," IEEE Trans. Syst. Man Cybern. B, Cybern., vol. 39, no. 6, pp. 1617-1622, Dec. 2009.
25. B. Leibe, K. Schindler, and L. V. Gool, "Coupled detection and trajectory estimation for multi-object tracking," in Proc. Int. Conf. Comput. Vision, 2007, pp. 1-8.
26. C. Huang, B. Wu, and R. Nevatia, "Robust object tracking by hierarchical association of detection responses," in Proc. Eur. Conf. Comput. Vision, 2008, pp. 788-801.
27. J. Seong-Wook and R. Chellappa, "A multiple-hypothesis approach for multiobject visual tracking," IEEE Trans. Image Process., vol. 16, no. 11, pp. 2849-2854, Nov. 2007.
28. T. Tuytelaars and K. Mikolajczyk, "Local invariant feature detectors: A survey," Found. Trends Comput. Graph. Vision, vol. 3, no. 2, pp. 177- 280, 2007.
29. H. Bay, A. Ess, T. Tuytelaars, and L. V. Gool, "SURF: Speeded up robust features," Comput. Vision Image Understand., vol. 110, no. 3, pp. 346-359, 2008.
30. J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust wide baseline stereo from maximally stable extremal regions," in Proc. British Mach. Vision Conf., 2002, pp. 384-393.
31. Z. Wu, Q. Ke, M. Isard, and J. Sun, "Bundling features for large scale partial-duplicate web image search," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., Jun. 2009, pp. 25-32.
32. N. Metropolis, A. W. Rosenbluth, M. N. Rosenbluth, A. H. Teller, and E. Teller, "Equation of state calculations by fast computing machines," J. Chem. Phys., vol. 21, no. 6, pp. 85-111, 1953.
33. Q. Yu, G. Medioni, and I. Cohen, "Multiple target tracking using spatiotemporal Markov chain monte carlo data association," in Proc. IEEE Conf. Comput. Vision Pattern Recogn., Jun. 2007, pp. 1-8.
34. A. Barbu and S. C. Zhu, "Generalizing Swendsen-Wang for image analysis, J. Comput. Graph. Stat., vol. 16, no. 4, pp. 877-900, 2007.
35. Y. Zhao, H. Gong, L. Lin, and Y. Jia, "Spatio-temporal patches for night background modeling by subspace learning," in Proc. IEEE Int. Conf. Pattern Recogn., Dec. 2008, pp. 1-4.
36. X. Wang, K. Tieu, and W. E. L. Grimson, "Learning semantic scene models by trajectory analysis," in Proc. Eur. Conf. Comput. Vision, 2006, pp. 110-123.
37. L. Lin, X. Liu, and S. C. Zhu, "Layered graph matching with composite cluster sampling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 8, pp. 1426-1442, Aug. 2010.
38. I. Dryden and K. Mardia, Statistical Shape Analysis. New York: Wiley, 1998.
39. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," in Proc. IEEE Int. Conf. Comput. Vision, Jan. 1999, pp. 1-8.
40. A. Smeaton, P. Over, and W. Kraaij, "Evaluation compaings and trecvid," in Proc. ACM Int. Workshop Multimedia Inform. Retrieval, 2006, pp. 321-330.
41. R. B. Fisher, "The PETS04 surveillance ground-truth data sets," in Proc. IEEE Int. Workshop Perform. Eval. Tracking Surveillance, 2004, pp. 1- 5.
42. T. Zhao, R. Nevatia, and B. Wu, "Segmentation and tracking of multiple humans in crowded environments," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 7, pp. 1198-1211, Jul. 2008.
43. S. Geman and D. Geman, "Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 6, no. 6, pp. 721-741, Nov. 1984.
44. L. Lin, P. Luo, X. Chen, and K. Zeng, "Representing and recognizing objects with massive local image patches," Pattern Recogn., vol. 45, no. 1, pp. 231-240, 2012.