Joint radiometric calibration and feature tracking system with an application to stereo

Computer Vision and Image Understanding

Volumn 114, Issue 5, 2010, Pages 574-582

  Kim, Seon Joo ^a   Gallup, David ^a   Frahm, Jan Michael ^a   Pollefeys, Marc ^a,b  

^a University of North Carolina   (United States)

^b ETH ZURICH   (Switzerland)

Author keywords

Auto exposure video; KLT tracker; Radiometric calibration; Stereo

Indexed keywords

3D SURFACE; FEATURE-TRACKING; FULL BRIGHTNESS; HIGH DYNAMIC RANGE; IMAGE BRIGHTNESS; KLT TRACKER; NATURAL SCENES; NONLINEAR PROCESS; RADIOMETRIC CALIBRATIONS; RADIOMETRIC RESPONSE; STRUCTURE FROM MOTION; TRACKING FEATURE; VIDEO SEQUENCES;

CALIBRATION; CAMERAS; FACE RECOGNITION; VIDEO RECORDING;

RADIOMETRY;

EID: 77950939099     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2009.07.009     Document Type: Article

References (24)

1. S. Baker, R. Gross, I. Matthews, T. Ishikawa, Lucas-kanade 20 Years on: A Unifying Framework: Part 2, Tech. Rep. CMU-RI-TR-03-01, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, February 2003.
2. S. Birchfield, Klt: An Implementation of the Kanade-Lucas-Tomasi Feature Tracker .
3. Candocia F. Jointly registering images in domain and range by piecewise linear comparametric analysis. IEEE Transactions on Image Processing (2003) 409-419
4. P. Debevec, J. Malik, Recovering high dynamic range radiance maps from photographs, in: Proceedings of SIGGRAPH'97, 1997, pp. 369-378.
5. Grossberg M., and Nayar S. Determining the camera response from images: what is knowable?. IEEE Transaction on Pattern Analysis and Machine Intelligence 25 11 (2003) 1455-1467
6. Grossberg M., and Nayar S. Modeling the space of camera response functions. IEEE Transaction on Pattern Analysis and Machine Intelligence 26 10 (2004) 1272-1282
7. H. Hirschmuller, D. Scharstein, Evaluation of cost functions for stereo matching, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2007, pp. 1-8.
8. H. Jin, P. Favaro, S. Soatto, Real-time feature tracking and outlier rejection with changes in illumination, in: Proceedings of IEEE International Conference on Computer Vision, 2001, pp. 684-689.
9. Kang S.B., Uyttendaele M., Winder S., and Szeliski R. High dynamic range video. ACM Transactions on Graphics 22 3 (2003) 319-325
10. S. J. Kim, J.-M. Frahm, M. Pollefeys, Joint feature tracking and radiometric calibration, in: Proceedings of IEEE International Conference on Computer Vision, 2007, pp. 1-8.
11. S. J. Kim, D. Gallup, J.-M. Frahm, A. Akbarzadeh, Q. Yang, R. Yang, D. NistTr, M. Pollefeys, Gain adaptive real-time stereo streaming, in: Proceeedings of International Conference on Computer Vision Systems, 2007, pp. 1-10.
12. Kim S.J., and Pollefeys M. Robust radiometric calibration and vignetting correction. IEEE Transactions on Pattern Analysis and Machine Intelligence 4 (2008) 562-576
13. S. Lin, J. Gu, S. Yamazaki, H. Shum, Radiometric calibration from a single image, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2004, pp. 938-945.
14. S. Lin, L. Zhang, Determining the radiometric response function from a single grayscale image, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2005, pp. 66-73.
15. B. D. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, Conference on Artificial Intelligence (1981) 674-659.
16. S. Mann, 'pencigraphy' with agc: Joint parameter estimation in both domain and range of functions in same orbit of the projective-wyckoff group, in: Proceedings of IEEE International Conference on Image Processing, 1996, pp. 193-196.
17. S. Mann, C. Manders, J. Fung, The lightspace change constraint equation (lcce) with practical application to estimation of the projectivity + gain transformation between multiple pictures of the same subject matter, in: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing.
18. S. Mann, R. Picard, On being 'undigital' with digital cameras: extending dynamic range by combining differently exposed pictures, in: Proceedings of IS&T 46th Annual Conference, 1995, pp. 422-428.
19. T. Mitsunaga, S. Nayar, Radiometric self-calibration, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1999, pp. 374-380.
20. Pollefeys M., Gool L.V., Vergauwen M., Verbiest F., Cornelis K., Tops J., and Koch R. Visual modeling with a hand-held camera. International Journal of Computer Vision 59 3 (2004) 207-232
21. J. Shi, C. Tomasi, Good features to track, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1994, pp. 593-600.
22. Triggs B., McLauchlan P., Hartley R., and Fitzgibbon A. Bundle adjustment - a modern synthesis. In: Triggs B., Zisserman A., and Szeliski R. (Eds). Vision Algorithms: Theory and Practice. Lecture Notes in Computer Science vol. 1883 (2000), Springer, Verlag
23. G. Welch, G. Bishop, An introduction to the Kalman filter, Tech. Rep. TR-95-031, Department of Computer Science, University of North Carolina at Chapel Hill, December 1995.
24. H. Yalcin, R. Collins, M. Hebert, Background estimation under rapid gain change in thermal imagery, in: Proceedings of IEEE Workshop on Object Tracking and Classification in and Beyond the Visible Spectrum (OTCBVS'05), 2005, pp. 1142-1149.