A new hybrid synthetic aperture imaging model for tracking and seeing people through occlusion

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 23, Issue 9, 2013, Pages 1461-1475

  Yang, Tao ^a   Zhang, Yanning ^a   Tong, Xiaomin ^a   Zhang, Xiaoqiang ^a   Yu, Rui ^a  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

Author keywords

Camera array; hybrid synthetic aperture imaging; multiple people tracking; occlusion handling

Indexed keywords

CAMERA ARRAYS; COMPUTER VISION APPLICATIONS; MULTIPLE PEOPLE TRACKING; MULTIPLE-MODELING; OCCLUSION HANDLING; QUALITATIVE AND QUANTITATIVE ANALYSIS; SYNTHETIC APERTURE IMAGING; SYNTHETIC APERTURE IMAGING SYSTEMS;

CAMERAS; IMAGE PROCESSING; SYNTHETIC APERTURES;

TARGET TRACKING;

EID: 84883756250     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2013.2242553     Document Type: Article

References (48)

1. A. Yilmaz, X. Li, and M. Shah, "Object tracking: A survey," ACM J. Computing Surveys, vol.38, no.4, Article 13, pp. 1-45, 2006.
2. X. G. Wang, K. Tieu, and W. E. L. Grimson, "Correspondence-free activity analysis and scene modeling in multiple camera views," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 56-71, Jan. 2010.
3. T. Zhao, R. Nevatia, and B. Wu, "Segmentation and tracking of multiple humans in crowded environments," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 7, pp. 1198-1211, Jul. 2008.
4. B. Leibe, K. Schindler, N. Cornelis, and L. V. Gool, "Coupled detection and tracking from static cameras and moving vehicles," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 10, pp. 1683-1698, Oct. 2008.
5. A. Senior, A. Hampapur, Y. L. Tian, L. Brown, S. Pankanti, and R. Bolle, "Appearance models for occlusion handling," Image Vision Computing, vol. 24, no. 11, pp. 1233-1243, 2006. (Pubitemid 44485267)
6. R. Cucchiara, C. Grana, and G. Tardini, "Track-based and object-based occlusion for people tracking refinement in indoor surveillance," in Proc. VSSN, 2004, pp. 81-87. (Pubitemid 40372016)
7. A. Perera, C. Srinivas, A. Hoogs, G. Brooksby, and W. Hu, "Multi-object tracking through simultaneous long occlusions and split and merge conditions," in Proc. CVPR, Jun. 2006, pp. 666-673. (Pubitemid 44931389)
8. F. Fleuret, R. Lengagne, and P. Fua, "Fixed point probability field for complex occlusion handling," in Proc. ICCV, Oct. 2005, pp. 694-700. (Pubitemid 44055023)
9. T. Zhao and R. Nevatia, "Tracking multiple humans in complex situations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1208-1221, Sep. 2004.
10. D. Ross, J. Lim, R. S. Lin, and M. H. Yang, "Incremental learning for robust visual tracking," Int. J. Comput. Vision, vol. 77, no. 1-3, pp. 125-141, May 2007.
11. M. Li, W. Chen, K. Q. Huang, and T. N. Tan, "Visual tracking via incremental self-tuning particle filtering on the affine group," in Proc. CVPR, Jun. 2010, pp. 1315-1322.
12. A. Ess, B. Leibe, K. Schindler, and L. Van Gool, "Robust multi-person tracking from a mobile platform," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1831-1846, Oct. 2009.
13. M. D. Breitenstein, F. Reichlin, B. Leibe, E. Koller-Meier, and L. V. Gool, "Online multi-person tracking-by-detection from a single, uncalibrated camera," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 9, pp. 1820-1833, Sep. 2011.
14. M. D. Breitenstein, F. Reichlin, B. Leibe, E. Koller-Meier, and L. V. Gool, "Robust tracking-by-detection using a detector confidence particle filter," in Proc. ICCV, Sep.-Oct. 2009, pp. 1515-1522.
15. M. Bray, E. Koller-Meier, and L. V. Gool, "Smart particle filtering for high-dimensional tracking," J. Comput. Vision Image Understanding, vol. 106, no. 1, pp. 116-129, 2007. (Pubitemid 46528766)
16. R. Kehl and L. V. Gool, "Tracking the invisible: Learning where the object might be," in Proc. CVPR, Jun. 2010, pp. 1285-1292.
17. S. Stalder, H. Grabner, and L. V. Gool, "Cascaded confidence filtering for improved tracking-by-detection," in Proc. ECCV, 2010, pp. 369-382.
18. S. Pellegrini, A. Ess, K. Schindler, and L. V. Gool, "You'll never walk alone: Modeling social behavior for multi-target tracking," in Proc. ICCV, Sep-Oct. 2009, pp. 261-268.
19. J. J. Xiao, H. Cheng, H. Sawhney, and F. Han, "Vehicle detection and tracking in wide field-of-view aerial video," in Proc. CVPR, 2010, pp. 679-684.
20. N. Buch, S. A. Velastin, and J. Orwell, "A review of computer vision techniques for the analysis of urban traffic," IEEE Trans. Intell. Transport. Syst., vol. 10, no. 3, pp. 920-939, Sep. 2011.
21. Z. H. Khan, I. Y. Gu, and A. G. Backhouse, "Robust visual object tracking using multi-mode anisotropic mean shift and particle filters," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 1, pp. 74-87, Jan. 2011.
22. S. M. Khan and M. Shah, "Tracking multiple occluding people by localizing on multiple scene planes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 3, pp. 505-519, Mar. 2009.
23. R. Eshel and Y. Moses, "Tracking in a dense crowd using multiple cameras," Int. J. Comput. Vision, vol. 88, no. 1, pp. 129-143, 2010.
24. D. Delannay, N. Danhier, and C. D. Vleeschouwer, "Detection and recognition of sports (wo)men from multiple views," in Proc. ICDSC, Aug.-Sep. 2009, pp. 1-7.
25. F. Fleuret, J. Berclaz, R. Lengagne, and P. Fua, "Multi-camera people tracking with a probabilistic occupancy map," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 267-282, Feb. 2008.
26. M. Taj and A. Cavallaro, "Multi-camera track-before-detect," in Proc. Third ACM/IEEE Int. Conf. Distributed Smart Cameras, Aug.-Sep. 2009, pp. 1-6.
27. R. Eshel and Y. Moses, "Homography based multiple camera detection and tracking of people in a dense crowd," in Proc. CVPR, Jun. 2008, pp. 1-8.
28. J. C. Ren, J. Orwell, G. A. Jones, and M. Xu, "Tracking the soccer ball using multiple fixed cameras," J. Comput. Vision Image Understanding, vol. 113, no. 5, pp. 633-642, 2009.
29. C. M. Huang and L. C. Fu, "Multitarget visual tracking based effective surveillance with cooperation of multiple active cameras," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 41, no. 1, pp. 234-247, Feb. 2011.
30. L. Snidaro, I. Visentini, and G. L. Foresti, "Multi-sensor multi-cue fusion for object detection in video surveillance," in Proc. AVSS, pp. 364-369, Sep. 2009.
31. J. Fiscus, J. Garofolo, T. Rose, and M. Michel, "AVSS multiple camera person tracking challenge evaluation overview," in Proc. AVSS, Sep. 2009, p. 219.
32. Y. L. Hou, and G. K. H. Pang, "People counting and human detection in a challenging situation," IEEE Trans. Syst., Man Cybern., Part A: Syst. Humans, vol. 41, no. 1, pp. 24-33, Jan. 2011.
33. K. Chen, C. Lai, P. Lee, C. Chen, and Y. Hung, "Adaptive learning for target tracking and true linking discovering across multiple nonoverlapping cameras," IEEE Trans. Multimedia, vol. 13, no. 4, pp. 625-638, Aug. 2011.
34. M. Linderoth, A. Robertsson, K. Astrom, and R. Johansson, "Object tracking with measurements from single or multiple cameras," in Proc. ICRA, May 2010, pp. 4525-4530.
35. C. Soto, B. Song, and A. K. Roy-Chowdhury, "Distributed multi-target tracking in a self-configuring camera network," in Proc. CVPR, Jun. 2009, pp. 1486-1493.
36. K. Heath and L. Guibas, "Multi-person tracking from sparse 3D trajectories in a camera sensor network," in Proc. ICDSC, Sep. 2008, pp. 1-9.
37. V. Vaish, B. Wilburn, N. Joshi, and M. Levoy, "Using plane + parallax for calibrating dense camera arrays," in Proc. CVPR, Jun.-Jul. 2004, pp. I-2-I-9.
38. V. Vaish, R. Szeliski, C. L. Zitnick, S. B. Kang, and M. Levoy, "Reconstructing occluded surfaces using synthetic apertures: Stereo, focus and robust methods," in Proc. CVPR, 2006, pp. 2331-2338. (Pubitemid 44931602)
39. B. Wilburn, N. Joshi, V. Vaish, E. V. Talvala, E. Antunez, A. Barth, A. Adams, M. Horowitz, and M. Levoy, "High performance imaging using large camera arrays," ACM Trans. Graphics, vol. 24, no. 3, pp. 765-776, 2005.
40. N. Joshi, S. Avidan,W. Matusik, and D. J. Kriegman, "Synthetic aperture tracking: Tracking through occlusions," in Proc. ICCV, Oct. 2007, pp. 1-8.
41. Z. Zivkovic and F. van der Heijden, "Efficient adaptive density estimation per image pixel for the task of background subtraction," Pattern Recong. Lett., vol. 27, no. 7, pp. 773-780, 2006. (Pubitemid 43374860)
42. A. Prati, I. Mikic, M. Trivedi, and R. Cucchiara, "Detecting moving shadows: Formulation, algorithms and evaluation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 7, pp. 918-923, Jul. 2003.
43. R. Cucchiara, C. Grana, M. Piccardi, and A. Prati, "Improving shadow suppression in moving object detection with HSV color information," in Proc. IEEE Trans. Intell. Transp. Syst., Aug. 2001, pp. 334-339. (Pubitemid 32936362)
44. H. Pirsiavash, D. Ramanan, and C. C. Fowlkes, "Globally-optimal greedy algorithms for tracking a variable number of objects," in Proc. CVPR, 2011, pp. 1201-1208.
45. Z. Pei, Y. N. Zhang, T. Yang, X. W. Zhang, and Y. H. Yang, "A novel multi-object detection method in complex scene using synthetic aperture imaging," J. Pattern Recog., vol. 45, no. 4, pp. 1637-1658, 2011.
46. Z. Pei, Y. N. Zhang, X. Chen, and Y. H. Yang, "Synthetic aperture imaging using pixel labeling via energy minimization," J. Pattern Recog., vol. 46, no. 1, pp. 174-187, 2013.
47. Y. Y. Ding, F. Li, Y. Ji, and J. Y. Yu, "Dynamic 3D fluid surface acquisition using a camera array," in Proc. ICCV, Nov. 2011, pp. 2478-2485.
48. T. Basha, S. Avidan, A. Hornung, andW. Matusik, "Structure and motion from scene registration," in Proc. CVPR, Jun. 2012, pp. 1426-1433.