Robust and accurate visual echo cancelation in a full-duplex projector-camera system

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 30, Issue 10, 2008, Pages 1831-1840

  Liao, Miao ^a   Yang, Ruigang ^a   Zhang, Zhengyou ^b  

^a UNIVERSITY OF KENTUCKY   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

Collaboration; Geometric calibration; Photometric calibration; Projector camera system; Teleconferencing; Visual echo cancellation; Whiteboard camera system

Indexed keywords

CALIBRATION; ECHO SUPPRESSION; IMAGE ENHANCEMENT; PHOTOCOPYING; PHOTOMETRY; TABLE LOOKUP;

APPLICATIONS.; CALIBRATION INFORMATION; CALIBRATION PROCEDURES; COLLABORATION; FULL-COLOR IMAGES; GEOMETRIC CALIBRATION; GEOMETRIC REGISTRATION; HIGH FREQUENCIES; LOOK-UP TABLE; PHOTOMETRIC CALIBRATION; PROJECTOR-CAMERA SYSTEM; PROJECTOR-CAMERA SYSTEMS; QUANTIZATION EFFECTS; REAL IMAGES; RUN-TIME; TELECONFERENCING; TELEPHONE CONVERSATION; VISUAL ECHO; VISUAL ECHO CANCELLATION; WHITEBOARD-CAMERA SYSTEM;

CAMERAS;

CAMERAS; INFORMATION RETRIEVAL; PHOTOMETRY; PROJECTORS; TELEPHONES;

ALGORITHM; ARTICLE; ARTIFACT; COMPUTER ASSISTED DIAGNOSIS; COMPUTER INTERFACE; FEEDBACK SYSTEM; IMAGE ENHANCEMENT; INFORMATION PROCESSING; METHODOLOGY; PHOTOGRAPHY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFACTS; DATA DISPLAY; FEEDBACK; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; USER-COMPUTER INTERFACE;

EID: 50249179600     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2007.70828     Document Type: Article

References (28)

1. M. Brown, A. Majumder, and R. Yang, "Camera-Based Calibration Techniques for Seamless Multiprojector Displays," IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 2, pp. 193-206, Mar./Apr. 2005.
2. T.J. Cham, J. Rehg, R. Sukthankar, and G. Sukthankar, "Shadow Elimination and Occluder Light Suppression for Multi-Projector Displays," Proc. IEEE Computer Vision and Pattern Recognition (CVPR '03), 2003.
3. H. Chen, R. Sukthankar, and G. Wallace, "Scalable Alignment of Large-Format Multi-Projector Displays Using Camera Homography Trees," Proc. 13th IEEE Visualization Conf. (VIS '02), pp. 339-346, 2002.
4. P.E. Debevec and J. Malik, "Recovering High Dynamic Range Radiance Maps from Photographs," Proc. ACM SIGGRAPH '97, pp. 369-378, 1997.
5. M. Flagg, J. Summet, and J. Rehg, "Improving the Speed of Virtual Rear Projection: A GPU-Centric Architecture," Proc. IEEE Int'l Workshop Projector-Camera Systems (Procams '05), 2005.
6. K. Fujii, M.D. Grossberg, and S.K. Nayar, "A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '05 , vol. 1, pp. 814-821, 2005.
7. D. Hall, C. Le Gal, J. Martin, O. Chomat, T. Kapuscinski, and J. Crowley, "Magicboard: A Contribution to an Intelligent Office Environment," Proc. Seventh Int'l Symp. Intelligent Robotic Systems (SIRS '99), 1999.
8. R. Hartley and A. Zisserman, Multiple-View Geometry. Cambridge Univ. Press, 2000.
9. C. Jaynes, B. Seales, K. Calvert, Z. Fei, and J. Griffioen, "The Metaverse: A Collection of Inexpensive, Self-Configuring, Immersive Environments," Proc. Seventh Int'l Workshop Immersive Projection Technology/Ninth Eurographics Workshop Virtual Environments, 2003.
10. C. Jaynes, S. Webb, and R. Steele, "Camera-Based Detection and Removal of Shadows from Interactive Multiprojector Displays," IEEE Trans. Visualization and Computer Graphics, vol. 10, no. 3. pp. 290-301, May/June 2004.
11. A. Majumder, D. Jones, M. McCrory, M.E. Papka, and R. Stevens, "Using a Camera to Capture and Correct Spatial Photometric Variation in Multi-Projector Displays," Proc. IEEE Int'l Workshop Projector-Camera Systems (Procams '03). 2003.
12. A. Majumder and R. Stevens, "Color Nonuniformity in Projection-Based Displays: Analysis and Solutions," IEEE Trans. Visualization and Computer Graphics, vol. 10, no. 2, Apr.-June 2003.
13. E. Mynatt, T. Igarashi, W. Edwards, and A. LaMarca, "Flatland: New Dimensions in the Whiteboard," Proc. ACM Conf. Human Factors in Computing Systems (CHI '99), pp. 346-353, 1999.
14. C.S. Pinhanez, "The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces," Proc. Third Int'l Conf. Ubiquitous Computing (Ubicomp '01), 2001.
15. R. Raskar, M. Brown, R. Yang, W. Chen, G. Welch, H. Towles, B. Seales, and H. Fuchs, "Multi-Projector Displays Using Camera-Base Registration," Proc. 10th IEEE Visualization Conf. (VIS '99 , pp. 161-168, 1999.
16. R. Raskar, J. van Baar, P. Beardsley, T. Willwacher, S. Rao, and C. Forlines, "ilamps: Geometrically Aware and Self-Configuring Projectors," Proc. ACM Siggraph '03, 2003.
17. R. Raskar, G. Welch, M. Cutts, A. Lake, L. Stesin, and H. Fuchs, "The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays," Computer Graphics, vol. 32, Annual Conference Series, pp. 179-188, 1998.
18. R. Surati, "Scalable Self-Calibrating Display Technology for Seamless Large-Scale Display," PhD dissertation, Dept. of Computer Science, Massachusetts Inst. of Technology, 1998.
19. Y. Sato, Y. Kobayashi, and H. Koike, "Fast Tracking of Hands and Fingertips in Infrared Images for Augmented Desk Interface," Proc. Fourth IEEE Int'l Conf. Automatic Face and Gesture Recognition (AFGR '00), 2000.
20. M.C. Stone, "Color and Brightness Appearance Issues in Tiled Displays," IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 58-66, 2001.
21. N. Takao, J. Shi, and S. Baker, "Telegraffiti: A Camera-Projector Based Remote Sketching System with Hand-Based User Interface and Automatic Session Summarization," Int'l J. Computer Vision, vol. 53, no. 2, pp. 115-133, 2003.
22. N. Takao, J. Shi, and S. Baker, "Tele-Grafitti," Technical Report CMU-RI-TR-02-10, Robotics Inst., Carnegie Mellon Univ., 2002.
23. N. Takao, S. Baker, and J. Shi, "Steady-State Feedback Analysis of Tele-Craffiti," Proc. IEEE Int'l Workshop Projector-Camera Systems (Procams '03), Oct. 2003.
24. P. Wellner, "Interacting with Paper on the Digital Desk," Comm. ACM vol. 36, no 7, pp 86-97, 1993.
25. R. Yang, D. Getz, J. Hensley, H. Towles, and M. Brown, "PixelFlex: A Reconfigurable Multi-Projector Display System," Proc. 12th IEEE Visualization Conf. (VIS '01), pp. 167-174, 2001.
26. K.-J. Yoon and I.-S. Kweon, "Locally Adaptive Support-Weight Approach for Visual Correspondence Search," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR '05), pp. 924-931, 2005.
27. Z. Zhang, "Computer Vision Techniques for Remote Collaboration Using Physical Whiteboards, Projectors and Cameras," Computer Vision for Interactive and Intelligent Environments, C. Jaynes and R. Collins, eds., pp. 109-122, IEEE Computer Society, 2006.
28. H. Zhou, Z. Zhang, and T. Huang, "Visual Echo Cancellation in a Projector-Camera-Whiteboard System," Proc. Int'l Conf. Image Processing (ICIP '04), pp. 2885-2888, 2004.