An iterative integrated framework for thermal-visible image registration, sensor fusion, and people tracking for video surveillance applications

Computer Vision and Image Understanding

Volumn 116, Issue 2, 2012, Pages 210-221

  Torabi, Atousa ^a   Massé, Guillaume ^a   Bilodeau, Guillaume Alexandre ^a  

^a ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

Author keywords

Multiple people tracking; Sensor fusion; Thermal camera; Thermal visible image registration; Visible camera

Indexed keywords

AFFINE TRANSFORMATIONS; ALIGNED IMAGES; INTEGRATED FRAMEWORKS; MULTIPLE OBJECT TRACKING; MULTIPLE PEOPLE TRACKING; OBJECT MODEL; PEOPLE TRACKING; SENSOR FUSION; THERMAL CAMERA; TRACKING METHOD; VIDEO REGISTRATION; VIDEO-SURVEILLANCE APPLICATIONS;

CAMERAS; IMAGE REGISTRATION; LINEAR TRANSFORMATIONS; SECURITY SYSTEMS; SENSORS; TRAJECTORIES;

TARGET TRACKING;

EID: 82155168689     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2011.10.006     Document Type: Article

References (23)

1. Z. Zhu, T. Huang, Multimodal surveillance: an introduction, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007, pp. 1-6.
2. D. Socolinsky, Design and deployment of visible-thermal biometric surveillance systems, in: Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on, 2007, pp. 1-2.
3. Y. Caspi, D. Simakov, and M. Irani Feature-based sequence-to-sequence matching Int. J. Comput. Vis. 68 2006 53 64 (Pubitemid 43724017)
4. F. Morin, A. Torabi, G.-A. Bilodeau, Automatic registration of color and infrared videos using trajectories obtained from a multiple object tracking algorithm, in: Computer and Robot Vision, Canadian Conference, 2008, pp. 311-318.
5. G.A. Bilodeau, A. Torabi, and F. Morin Visible and infrared image registration using trajectories and composite foreground images Image Vis. Comput. 29 2011 41 50
6. A. Torabi, G. Masse, G.-A. Bilodeau, Feedback scheme for thermal-visible video registration, sensor fusion, and people tracking, in: Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on, 2010, pp. 15-22.
7. C. Conaire, N. O'Connor, E. Cooke, A. Smeaton, Comparison of fusion methods for thermo-visual surveillance tracking, in: 9th International Conference on Information Fusion, 2006, pp. 1-7.
8. F. Sadjadi, Comparative image fusion analysis, in: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops, vol. 03, 2005, p. 8.
9. C.O. Conaire, N.E. O'Connor, and A. Smeaton Thermo-visual feature fusion for object tracking using multiple spatiogram trackers Mach. Vis. Appl. 19 5-6 2008 483 494
10. P. Kumar, A. Mittal, and P. Kumar Addressing uncertainty in multi-modal fusion for improved object detection in dynamic environment Inform. Fusion 11 4 2010 311 324
11. J.W. Davis, V. Sharma, Fusion-based background-subtraction using contour saliency, in: CVPR '05: IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, 2005, pp. 11-19.
12. J.W. Davis, and V. Sharma Background-subtraction using contour-based fusion of thermal and visible imagery Comput. Vis. Image Understand. 106 2-3 2007 162 182 (special issue on Advances in Vision Algorithms and Systems beyond the Visible Spectrum) (Pubitemid 46670736)
13. A. Leykin, R. Hammoud, Robust multi-pedestrian tracking in thermal-visible surveillance videos, in: CVPRW '06: Conference on Computer Vision and Pattern Recognition Workshop, 2006, pp. 136-144.
14. A. Leykin, Y. Ran, Thermal-visible video fusion for moving target tracking and pedestrian classification, in: In Object Tracking and Classification in and Beyond the Visible Spectrum Workshop at the International Conference on Computer Vision and Pattern Recognition, 2007, pp. 1-8.
15. R. Hammoud Augmented Vision Perception in Infrared: Algorithms and Applied Systems 2009 Springer Publishing Company, Incorporated
16. S.J. Krotosky, and M.M. Trivedi Mutual information based registration of multimodal stereo videos for person tracking Comput. Vis. Image Understand. 106 2-3 2007 270 287 (Pubitemid 46670743)
17. M. Irani, P. Anandan, Robust multi-sensor image alignment, in: ICCV '98: Proceedings of the Sixth International Conference on Computer Vision, 1998, pp. 959-966.
18. E. Coiras, J. Santamaria, and C. Miravet Segment-based registration technique for visual-infrared images Opt. Eng. 39 2000 282 289 (Pubitemid 30553296)
19. J. Han, B. Bhanu, Detecting moving humans using color and infrared video, in: International Conference on Multisensor Fusion, 2003, pp. 228-233.
20. B. Shoushtarian, and H.E. Bez A practical adaptive approach for dynamic background subtraction using an invariant colour model and object tracking Pattern Recogn. Lett. 26 1 2005 5 26
21. R. Hartley, and A. Zisserman Multiple view geometry in computer vision 2nd ed. 2003 Cambridge University Press Cambridge, UK
22. J. Han, and B. Bhanu Fusion of color and infrared video for moving human detection Pattern Recogn. 40 2007 1771 1784 (Pubitemid 46399786)
23. A. Torabi, G.-A. Bilodeau, A multiple hypothesis tracking method with fragmentation handling, in: Computer and Robot Vision, 2009. CRV '09, 2009, pp. 8-15.