A LSS-based registration of stereo thermal-visible videos of multiple people using belief propagation

Computer Vision and Image Understanding

Volumn 117, Issue 12, 2013, Pages 1736-1747

  Torabi, Atousa ^a   Bilodeau, Guillaume Alexandre ^a  

^a ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

Author keywords

Belief propagation; Dense stereo matching; IR camera; Local self similarity; Multimodal video registration; Visible camera

Indexed keywords

BELIEF PROPAGATION; DENSE STEREO MATCHING; IR CAMERA; LOCAL SELFSIMILARITY; MULTIMODAL VIDEO REGISTRATIONS; VISIBLE CAMERAS;

ALGORITHMS; CAMERAS; FACE RECOGNITION; GLOBAL OPTIMIZATION; IMAGE MATCHING;

SECURITY SYSTEMS;

EID: 84886587904     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2013.01.016     Document Type: Article

References (28)

1. Z. Zhu, T. Huang, Multimodal surveillance: an introduction, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007 (CVPR '07), 2007, pp. 1-6.
2. R. Collins, A. Lipton, H. Fujiyoshi, and T. Kanade Algorithms for cooperative multisensor surveillance Proc. IEEE 89 10 2001 1456 1477 (Pubitemid 33766632)
3. D. Socolinsky, Design and deployment of visible-thermal biometric surveillance systems, in: IEEE Conference on Computer Vision and Pattern Recognition, 2007 (CVPR '07), 2007, pp. 1-2.
4. A. Torabi, and G.-A. Bilodeau Local self-similarity-based registration of human rois in pairs of stereo thermal-visible videos Pattern Recogn. 2012
5. D. Scharstein, and R. Szeliski A taxonomy and evaluation of dense two-frame stereo correspondence algorithms Int. J. Comput. Vision 47 2002 7 42 (Pubitemid 34428419)
6. S.J. Krotosky, and M.M. Trivedi Mutual information based registration of multimodal stereo videos for person tracking Comput. Vision Image Underst. 106 2-3 2007 270 287 (Pubitemid 46670743)
7. E. Coiras, J. Santamaria, and C. Miravet Segment-based registration technique for visual-infrared images Opt. Eng. 39 2000 282 289 (Pubitemid 30553296)
8. A. Torabi, and G.-A. Bilodeau An iterative integrated framework for thermalvisible image registration, sensor fusion, and people tracking for video surveillance applications Comput. Vision Image Underst. 116 2 2012 210 221
9. A. Torabi, G. Masse, G.-A. Bilodeau, Feedback scheme for thermal-visible video registration, sensor fusion, and people tracking, in: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2010, pp. 15-22.
10. A. Torabi, G.-A. Bilodeau, Local self-similarity as a dense stereo correspondence measure for themal-visible video registration, in: 2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2011, pp. 61-67.
11. A. Torabi, M. Najafianrazavi, G. Bilodeau, A comparative evaluation of multimodal dense stereo correspondence measures, in: 2011 IEEE International Symposium on Robotic and Sensors Environments (ROSE), 2011, pp. 143-148.
12. H.-M. Chen, P. Varshney, M.-A. Slamani, On registration of regions of interest (ROI) in video sequences, in: IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS 2003), 2003, pp. 313-318.
13. G. Egnal, Mutual Information as a Stereo Correspondence Measure, Tech. Rep. MS-CIS-00-20, University of Pennsylvania.
14. J. Sun, N.-N. Zheng, and H.-Y. Shum Stereo matching using belief propagation IEEE Trans. Pattern Anal. Mach. Intell. 25 7 2003 787 800
15. P.F. Felzenszwalb, and D.P. Huttenlocher Efficient belief propagation for early vision Int. J. Comput. Vision 70 2006 41 54 (Pubitemid 43855866)
16. Q. Yang, L. Wang, R. Yang, H. Stewenius, and D. Nister Stereo matching with color-weighted correlation hierarchical belief propagation, and occlusion handling IEEE Trans. Pattern Anal. Mach. Intell. 31 3 2009 492 504
17. Y. Boykov, O. Veksler, and R. Zabih Fast approximate energy minimization via graph cuts IEEE Trans. Pattern Anal. Mach. Intell. 23 11 2001 1222 1239 (Pubitemid 33137959)
18. M. Bleyer, and M. Gelautz Graph-cut-based stereo matching using image segmentation with symmetrical treatment of occlusions Image Commun. 22 2007 127 143 (Pubitemid 46412733)
19. M. Tappen, W. Freeman, Comparison of graph cuts with belief propagation for stereo, using identical mrf parameters, in: Proceedings of the Ninth IEEE International Conference on Computer Vision, 2003, pp. 900-906.
20. Q. Yang, L. Wang, N. Ahuja, A constant-space belief propagation algorithm for stereo matching, in: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, pp. 1458-1465.
21. A. Klaus, M. Sormann, K. Karner, Segment-based stereo matching using belief propagation and a self-adapting dissimilarity measure, in: 18th International Conference on Pattern Recognition, 2006 (ICPR 2006), vol. 3, 2006, pp. 15-18. (Pubitemid 46553055)
22. E. Shechtman, M. Irani, Matching local self-similarities across images and videos, in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2007), 2007, pp. 1-8.
23. P.O. Hoyer, and P. Dayan Non-negative matrix factorization with sparseness constraints J. Mach. Learn. Res. 5 2004 1457 1469
24. B. Shoushtarian, and H.E. Bez A practical adaptive approach for dynamic background subtraction using an invariant colour model and object tracking Pattern Recogn. Lett. 26 1 2005 5 26
25. A. Ogale, and Y. Aloimonos A roadmap to the integration of early visual modules Int. J. Comput. Vision 72 2007 9 25 (Pubitemid 44876074)
26. D. Comaniciu, P. Meer, Mean shift analysis and applications, in: The Proceedings of the Seventh IEEE International Conference on Computer Vision (ICCV 1999), vol. 2, 1999, pp. 1197-1203. (Pubitemid 32080003)
27. J. Heikkila, O. Silven, A four-step camera calibration procedure with implicit image correction, in: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1997, pp. 1106-1112.
28. J.-Y. Bouguet, Camera Calibration Toolbox for Matlab. < http://www.vision.caltech.edu/bouguetj/calib-doc/ >.