Local self-similarity-based registration of human ROIs in pairs of stereo thermal-visible videos

Pattern Recognition

Volumn 46, Issue 2, 2013, Pages 578-589

  Torabi, Atousa ^a   Bilodeau, Guillaume Alexandre ^a  

^a ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

Author keywords

Dense stereo correspondence; Local self similarity; Multimodal video registration; Mutual information; Thermal camera; Visible camera; Visual surveillance

Indexed keywords

LOCAL SELFSIMILARITY; MUTUAL INFORMATIONS; STEREO CORRESPONDENCES; THERMAL CAMERA; VIDEO REGISTRATION; VISIBLE CAMERAS; VISUAL SURVEILLANCE;

IMAGE MATCHING; IMAGE SEGMENTATION;

SECURITY SYSTEMS;

EID: 84867398178     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.07.026     Document Type: Article

References (23)

1. Z. Zhu, T. Huang, Multimodal surveillance: an introduction, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007. CVPR07, 2007, pp. 1-6.
2. R. Collins, A. Lipton, H. Fujiyoshi, and T. Kanade Algorithms for cooperative multisensor surveillance Proceedings of the IEEE 89 10 2001 1456 1477
3. D. Socolinsky, Design and deployment of visible-thermal biometric surveillance systems, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007. CVPR 07, 2007, pp. 1-2.
4. J.W. Davis, V. Sharma, Background-subtraction using contour-based fusion of thermal and visible imagery, Computer Vision and Image Understanding 106. (2005).
5. A. Leykin, Thermal-visible video fusion for moving target tracking and pedestrian classification, in: In Object Tracking and Classification in and Beyond the Visible Spectrum Workshop at the International Conference on Computer Vision and Pattern Recognition, 2007, pp. 1-8.
6. J. Han, and B. Bhanu Fusion of color and infrared video for moving human detection Pattern Recognition 40 6 2007 1771 1784
7. S.J. Krotosky, and M.M. Trivedi Mutual information based registration of multimodal stereo videos for person tracking Computer Vision and Image Understanding 106 2-3 2007 270 287
8. H.-M. Chen, P. Varshney, M.-A. Slamani, On registration of regions of interest (roi) in video sequences, in: IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS 2003), 2003, pp. 313-318.
9. C. Fookes, A. Maeder, S. Sridharan, J. Cook, Multi-spectral stereo image matching using mutual information, in: 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004. Proceedings, 2004, pp. 961-968.
10. G. Egnal, Mutual Information as a Stereo Correspondence Measure, Technical Report MS-CIS-00-20, University of Pennsylvania, 2000.
11. E. Shechtman, M. Irani, Matching local self-similarities across images and videos, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2007), 2007, pp. 1-8.
12. S. Walk, N. Majer, K. Schindler, B. Schiele, New features and insights for pedestrian detection, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2007), 2010, pp. 1030-1037.
13. J. Yang, Y. Li, Y. Tian, L. Duan, W. Gao, Group-sensitive multiple kernel learning for object categorization, in: IEEE 12th International Conference on Computer Vision (ICCV 2009), 2009, pp. 436-443.
14. A. Vedaldi, V. Gulshan, M. Varma, A. Zisserman, Multiple kernels for object detection, in: IEEE 12th International Conference on Computer Vision (ICCV 2009), 2009, pp. 606-613.
15. A. Torabi, G.-A. Bilodeau, Local self-similarity as a dense stereo correspondence measure for thermal-visible video registration, in: 2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2011, pp. 61-67.
16. P.O. Hoyer, and P. Dayan Non-negative matrix factorization with sparseness constraints Journal of Machine Learning Research 5 2004 1457 1469
17. A. Torabi, M. Najafianrazavi, G. Bilodeau, A comparative evaluation of multimodal dense stereo correspondence measures, in: 2011 IEEE International Symposium on Robotic and Sensors Environments (ROSE), 2011, pp. 143-148.
18. J. Heikkila, O. Silven, A four-step camera calibration procedure with implicit image correction, in: 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1997. Proceedings, 1997, pp. 1106-1112.
19. A. Gil, O.M. Mozos, M. Ballesta, and O. Reinoso A comparative evaluation of interest point detectors and local descriptors for visual slam Machine Vision and Applications 21 2010 905 920
20. R. Mayoral, M. Aurnhammer, Evaluation of correspondence errors for stereo, in: International Conference on Pattern Recognition, vol. 4, 2004, pp. 104-107.
21. B. Shoushtarian, and H.E. Bez A practical adaptive approach for dynamic background subtraction using an invariant colour model and object tracking Pattern Recognition Letters 26 1 2005 5 26
22. A. Ogale, and Y. Aloimonos A roadmap to the integration of early visual modules International Journal of Computer Vision 72 2007 9 25
23. D. Comaniciu, P. Meer, Mean shift analysis and applications, in: The Proceedings of the Seventh IEEE International Conference on Computer Vision (ICCV 1999), vol. 2, 1999, pp. 1197 -1203.