Aligning windows of live video from an imprecise Pan-tilt-zoom robotic camera into a remote panoramic display

Proceedings - IEEE International Conference on Robotics and Automation

Volumn 2006, Issue , 2006, Pages 3429-3436

  Qin, Ni ^a   Song, Dezhen ^a   Goldberg, Ken ^b  

^a TEXAS A AND M UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

IMAGE ALIGNMENT ALGORITHM; NONLINEAR PROJECTIONS; PAN TILT PARAMETERS; VIDEO STREAMING;

ALGORITHMS; ANGLE MEASUREMENT; CAMERAS; DISPLAY DEVICES; IMAGE ANALYSIS; PARAMETER ESTIMATION; REMOTE CONTROL; VIDEO SIGNAL PROCESSING;

PROGRAMMABLE ROBOTS;

EID: 33845668711     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ROBOT.2006.1642226     Document Type: Conference Paper

References (41)

1. D. Song, N. Qin, and K. Goldberg, "A minimum variance calibration algorithm for pan-tilt robotic cameras in natural environments," in IEEE International Conference on Robotics and Automation (ICRA), Orlando, Florida, May 2006.
2. B. Zitova and J. Flusser, "Image registration methods: a survey," Image and Vision Computing, vol. 21, no. 2003, pp. 977-1000, June 2003.
3. R. Benosman and S. B. Kang, Panoramic Vision. Springer, New York, 2001.
4. J. Foote and D. Kimber, "Flycam: Practical panoramic video and automatic camera control," in IEEE International Conference on Multimedia and Expo. ICME 2000, New York, NY, vol. 3, July 2000, pp. 1419-1422.
5. _, "Enhancing distance learning with panoramic video," in Proceedings of the 34th Hawaii International Conference on System Sciences, 2001.
6. D. Song and K. Goldberg, "Sharecam part I: Interface, system architecture, and implementation of a collaboratively controlled robotic webcam," in IEEE/RSJ International Conference on Intelligent Robots (IROS), Nov. 2003.
7. D. Song, A. Pashkevich, and K. Goldberg, "Sharecam part II: Approximate and distributed algorithms for a collaboratively controlled robotic webcam," in IEEE/RSJ International Conference on Intelligent Robots (IROS), Nov. 2003.
8. D. Song and K. Goldberg, "Networked robotic cameras for collaborative observation of natural environments," in The 12th International Symposium of Robotics Research, (ISRR), San Francisco, CA, October 2005.
9. R. Swaminathan and S. K. Nayar, "Nonmetric calibration of wide-angle lenses and polycameras," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1172-1178, October 2000.
10. K.-H. Tan, H. Hua, and A. N., "Multiview panoramic cameras using mirror pyramids," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 7, pp. 1941-946, July 2004.
11. S. Baker and S. K. Nayar, "A theory of single-viewpoint catadioptric image formation," International Journal of Computer Vision, vol. 35, no. 2, pp. 175-196, November 1999.
12. S. K. Nayar, "Catadioptric omnidirectional camera," in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, June 1997, pp. 482-488.
13. Y. Xiong and K. Turkowski, "Creating image-based vr using a self-calibrating fisheye lens," in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, June 1997, pp. 237-243.
14. R. Szeliski, "Image alignment and stitching, microsoft research, technical report msr-tr-2004-92," 2004.
15. S. E. Chen, "QuickTime VR - an image-based approach to virtual environment navigation," Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1995, Los angeles, California, vol. 29, pp. 29-38, Aug 1995.
16. B. Y. Kim, K. H. Jang, and S. K. Jung, "Adaptive strip compression for panorama video streaming," in Computer Graphics International (CGI'04), Crete, Greece, June 2004.
17. R. Hartley, "Self-calibration of stationary cameras," in IJCV, vol. 22, 1997, pp. 5-23.
18. H. Shum and R. Szeliski, "Panoramic image mosaics," 1997, microsoft Research:MSR-TR-97-23.
19. S. Coorg and S. Teller, "Spherical mosaics with quaternions and dense correlation," International Journal of Computer Vision, vol. 37, no. 3, pp. 259-273, 2000.
20. S. B. Kang and R. Weiss, "Characterization of errors in compositing panoramic images," in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, June 1997, pp. 103-109.
21. R. Szeliski, "Image mosaicing for tele-reality applications," in Proceedings of the Second IEEE Workshop on Applications of Computer Vision, Sarasota, USA, Dec 1994, pp. 44-53.
22. _, "Video mosaics for virtual environments," in Proceedings of IEEE Computer Graphics and Applications, vol. 16, no. 2, Mar 1996, pp. 22-30.
23. R. Szeliski and H. Shum, "Creating full view panoramic image mosaics and environment maps," Proceedings of the 24th annual conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1997, Los Angeles, California, vol. 31, pp. 251-258, Aug 1997.
24. E. D. Castro and C. Morandi, "Registration of translated and rotated images using finite fourier transform," in Proceedings of IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 9, no. 5, 1987, pp. 700-703.
25. B. S. Reddy and B. N. Chatterji, "An fft-based technique for translation, rotation, and scale-invariant image registration," in Proceedings of IEEE Transactions on Image Processing, vol. 5, no. 8, Aug 1996, pp. 1266-1271.
26. C. J. Harris and M. Stephens, "A combined corner and edge detector," in Proceedings 4th Alvey Vision Conference, Manchester, 1988, pp. 147-151.
27. P. H. S. Torr and A. Zisserman, "Feature based methods for structure and motion estimation," in Proceedings of the International Workshop on Vision Algorithm: Theory and Practice, Corfu, 1999, pp. 278-294.
28. Z. Zhang, R. Deriche, O. Faugeras, and Q. T. Luong, "A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry," Artificial Intelligence, vol. 78, pp. 87-119, 1995.
29. I. Zoghlami, O. Faugeras, and R. Deriche, "Using geometric corners to build a 2d mosaic from a set of images," in Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, June 1997, pp. 420-425.
30. B. Hu, C. Brown, and A. Choi, "Acquiring an environment map through image mosaicking," in University of Rochester:TR-786, Nov 2001.
31. G. Borgefors, "Hierarchical chamfer matching: a parametric edge matching algorithm," in Proceedings of IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 10, no. 6, Nov 1988, pp. 849-865.
32. H. Li, B. S. Manjunath, and S. K. Mitra, "A contour-based approach to multisensor image registration," in Proceedings of IEEE Transactions on Image Processing, vol. 4, no. 3, Mar 1995, pp. 320-334.
33. S.-H. Cho, Y.-K. Chung, and J. Y. Lee, "Automatic image mosaic system using image feature detection and taylor series," in Proceedings of VIIth Digital Image Computing: Techniques and Applications. Sydney, Dec. 2003, pp. 549-556.
34. Y. Kanazawa and K. Kanatani, "Image mosaicing by stratified matching," in Proceedings of Statistical Methods in Video Processing Workshop, Denmark, Jan. 2002, pp. 31-36.
35. W. Zhang, J. Kosecka, and F. Li, "Mosaics construction from a sparse set of views," in Proceedings of First International Symposium on 3D Data Processing Visualization and Transmission, June 2002, pp. 177-180.
36. M. Brown and D. Lowe, "Recognising panoramas," in Proceedings of IEEE International Conference on Computer Vision, Nice, France, vol. 2, Oct 2003, pp. 1218-1225.
37. M. Irani, P. Anandan, J. Bergen, R. Kumar, and S. Hsu, "Mosaic representations of video sequences and their applications," in Signal Processing: Image Communication, vol. 8, May 1996, pp. 327-351.
38. E. Trucco, A. Doull, F. Odone, A. Fusiello, and D. Lane, "Dynamic video mosaicing and augmented reality for subsea inspection and monitoring," Mar 2000.
39. Z. Zhu, G. Xu, E. M. Riseman, and A. R. Hanson, "Fast generation of dynamic and multi-resolution 360-degree panorama from video sequences," in Proceedings of the IEEE International Conference on Multimedia Computing and Systems, Florence, Italy, vol. 1, June 1999, pp. 9400-9406.
40. A. Agarwala, C. Zheng, C. Pal, M. Agrawala, M. Cohen, B. Curless, D. Salesin, and R. Szeliski, "Panoramic video textures," in ACM Transactions on Graphics (Proceedings of SIGGRAPH 2005), Los Angeles, CA, July 2005.
41. D. G. Lowe, "Object recognition from local scale-invariant features," in Proceedings of 7th IEEE International Conference on Computer Vision, Corfu, Greece, vol. 2, Sept 1999, pp. 1150-1157.