Tracking people in RGBD videos using deep learning and motion clues

Neurocomputing

Volumn 204, Issue , 2016, Pages 70-76

  Xue, Hongyang ^a   Liu, Yao ^a   Cai, Deng ^a   He, Xiaofei ^a  

^a ZHEJIANG UNIVERSITY   (China)

Author keywords

Convolutional neural network; Deep learning; Human tracking; Pedestrian trajectory; RGB D

Indexed keywords

BIG DATA; CONVOLUTION; MOTION ANALYSIS; NEURAL NETWORKS; SECURITY SYSTEMS;

CONVOLUTIONAL NEURAL NETWORK; DEEP LEARNING; HUMAN TRACKING; MOTION MODELING; MS-KINECT; PEDESTRIAN TRAJECTORIES; TRACKING PERFORMANCE;

TARGET TRACKING;

ARTICLE; ARTIFICIAL NEURAL NETWORK; ASSOCIATION; BIOLOGICAL MONITORING; BIOSENSOR; CLASSIFICATION; CLASSIFIER; DATA PROCESSING; INTERMETHOD COMPARISON; KINETICS; MACHINE LEARNING; MOTION; PRIORITY JOURNAL; RGBD VIDEO; STATISTICAL MODEL; SUPPORT VECTOR MACHINE; VIDEORECORDING;

EID: 84964658345     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.06.112     Document Type: Article

References (26)

1. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: IEEE Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005, vol. 1, IEEE, San Diego, 2005, pp. 886-893.
2. X. Cui, Y. Liu, S. Shan, X. Chen, W. Gao, 3d Haar-like features for pedestrian detection, in: 2007 IEEE International Conference on Multimedia and Expo, IEEE, Beijing, 2007, pp. 1263-1266.
3. Khanloo B.Y.S., Stefanus F., Ranjbar M., Li Z.-N., Saunier N., Sayed T., Mori G. A large margin framework for single camera offline tracking with hybrid cues. Comput. Vis. Image Underst. 2012, 116(6):676-689.
4. B.Y.S. Khanloo, F. Stefanus, M. Ranjbar, Z.-N. Li, N. Saunier, T. Sayed, G. Mori, Max-margin offline pedestrian tracking with multiple cues, in: 2010 Canadian Conference on Computer and Robot Vision (CRV), IEEE, Ottawa, 2010, pp. 347-353.
5. Mittal A., Davis L.S. M2tracker. a multi-view approach to segmenting and tracking people in a cluttered scene. Int. J. Comput. Vis. 2003, 51(3):189-203.
6. J. Kang, I. Cohen, G. Medioni et al., Tracking people in crowded scenes across multiple cameras, in: Asian Conference on Computer Vision, vol. 7, Citeseer, 2004, p. 15.
7. J. Black, T. Ellis, P. Rosin, Multi view image surveillance and tracking, in: Workshop on Motion and Video Computing, 2002. Proceedings, IEEE, Orlando, 2002, pp. 169-174.
8. Mazzon R., Cavallaro A. Multi-camera tracking using a multi-goal social force model. Neurocomputing 2013, 100:41-50.
9. M. Han, W. Xu, H. Tao, Y. Gong, An algorithm for multiple object trajectory tracking, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004, vol. 1, IEEE, Washington, D.C., 2004, pp. I-864.
10. M. Isard, J. MacCormick, Bramble: a Bayesian multiple-blob tracker, in: The Eighth IEEE International Conference on Computer Vision, 2001. ICCV 2001. Proceedings, vol. 2, IEEE, Vancouver, 2001, pp. 34-41.
11. D. Comaniciu, V. Ramesh, P. Meer, Real-time tracking of non-rigid objects using mean shift, in: IEEE Conference on Computer Vision and Pattern Recognition, 2000. Proceedings. Vol. 2, IEEE, Hilton Head, 2000, pp. 142-149.
12. Wang Q., Chen F., Xu W. Adaptive multi-cue tracking by online appearance learning. Neurocomputing 2011, 74(6):1035-1045.
13. Qi Z., Xu Y., Wang L., Song Y. Online multiple instance boosting for object detection. Neurocomputing 2011, 74(10):1769-1775.
14. Zhang S., Yao H., Zhou H., Sun X., Liu S. Robust visual tracking based on online learning sparse representation. Neurocomputing 2013, 100:31-40.
15. Y. Wei, J. Sun, X. Tang, H.-Y. Shum, Interactive offline tracking for color objects, in: IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007. IEEE, Rio de Janeiro, 2007, pp. 1-8.
16. Fleuret F., Berclaz J., Lengagne R., Fua P. Multicamera people tracking with a probabilistic occupancy map. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30(2):267-282.
17. Berclaz J., Fleuret F., Turetken E., Fua P. Multiple object tracking using k-shortest paths optimization. IEEE Trans. Pattern Anal. Mach. Intell. 2011, 33(9):1806-1819.
18. R. Benenson, M. Mathias, R. Timofte, L. Van Gool, Pedestrian detection at 100 frames per second, in: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Providence, 2012, pp. 2903-2910.
19. L. Spinello, K.O. Arras, People detection in rgb-d data, in: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, San Francisco, 2011, pp. 3838-3843.
20. Munaro M., Menegatti E. Fast rgb-d people tracking for service robots. Auton. Rob. 2014, 37(3):227-242.
21. J. Liu, Y. Liu, Y. Cui, Y.Q. Chen, Real-time human detection and tracking in complex environments using single rgbd camera, in: ICIP, 2013, pp. 3088-3092.
22. O.H. Jafari, D. Mitzel, B. Leibe, Real-time rgb-d based people detection and tracking for mobile robots and head-worn cameras, in: 2014 IEEE International Conference on Robotics and Automation (ICRA), IEEE, Hong Kong, 2014, pp. 5636-5643.
23. A. Vedaldi, S. Soatto, Quick shift and kernel methods for mode seeking, in: Computer Vision-ECCV 2008, Springer, Marseille, 2008, pp. 705-718.
24. R. Girshick, J. Donahue, T. Darrell, J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, in: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Columbus, 2014, pp. 580-587.
25. Y. Sun, Y. Chen, X. Wang, X. Tang, Deep learning face representation by joint identification-verification, in: Advances in Neural Information Processing Systems, 2014, pp. 1988-1996.
26. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, T. Darrell, Caffe: convolutional architecture for fast feature embedding, arXiv preprint . http://arXiv:1408.5093.