Practical display-camera calibration from eye reflections using coded illumination

1st Asian Conference on Pattern Recognition, ACPR 2011

Volumn , Issue , 2011, Pages 550-553

  Nitschke, Christian ^a   Nakazawa, Atsushi ^a,b   Takemura, Haruo ^a  

^a OSAKA UNIVERSITY   (Japan)

^b JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

CORNEAL REFLECTION; EXPERIMENTAL EVALUATION; FACE IMAGES; GEOMETRY CONSTRAINTS; ILLUMINATION PATTERNS; OFF-LINE PROCESSING; OPTIMIZATION STRATEGY; PARAMETER VARIATION; ROBUST DETECTION; VISION APPLICATIONS;

PATTERN RECOGNITION;

CAMERAS;

EID: 84862880293     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACPR.2011.6166661     Document Type: Conference Paper

References (27)

1. N. Funk and Y.-H. Yang, "Using a raster display for photometric stereo," in Proc. Canadian Conference on Computer and Robot Vision (CRV), 2007, pp. 201-207.
2. M. Tarini, H. P. A. Lensch, M. Goesele, and H.-P. Seidel, "3D acquisition of mirroring objects using striped patterns," Graph. Models, vol. 67, no. 4, pp. 233-259, 2005.
3. K. N. Kutulakos and E. Steger, "A theory of refractive and specular 3D shape by light-path triangulation," Int. J. Comput. Vision, vol. 76, no. 1, pp. 13-29, 2008.
4. P. Sturm and T. Bonfort, "How to compute the pose of an object without a direct view?" in Proc. Asian Conference on Computer Vision (ACCV), 2006, pp. 21-31.
5. Y. Francken, C. Hermans, and P. Bekaert, "Screen-camera calibration using Gray codes," in Proc. Canadian Conference on Computer and Robot Vision (CRV), 2009, pp. 155-161.
6. -, "Screen-camera calibration using a spherical mirror," in Proc. Canadian Conference on Computer and Robot Vision (CRV), 2007, pp. 11-20.
7. C. Nitschke, A. Nakazawa, and H. Takemura, "Display-camera calibration using eye reflections and geometry constraints," Comput. Vis. Image Underst., vol. 115, no. 6, pp. 835-853, 2011.
8. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. New York, NY: Cambridge University Press, 2003.
9. S. Baker and S. K. Nayar, "A theory of single-viewpoint catadioptric image formation," Int. J. Comput. Vision, vol. 35, no. 2, pp. 175-196, 1999.
10. R. Swaminathan, M. D. Grossberg, and S. K. Nayar, "Non-single viewpoint catadioptric cameras: Geometry and analysis," Int. J. Comput. Vision, vol. 66, no. 3, pp. 211-229, 2006.
11. K. Nishino and S. K. Nayar, "Corneal imaging system: Environment from eyes," Int. J. Comput. Vision, vol. 70, no. 1, pp. 23-40, 2006.
12. M. Backes, T. Chen, M. Dürmuth, H. P. A. Lensch, and M. Welk, "Tempest in a teapot: Compromising reflections revisited," in Proc. IEEE Symposium on Security and Privacy (SP), 2009, pp. 315-327.
13. N. Tsumura, M. N. Dang, T. Makino, and Y. Miyake, "Estimating the directions to light sources using images of eye for reconstructing 3D human face," in Proc. IS&T/SID Color Imaging Conference (CIC), 2003, pp. 77-81.
14. M. K. Johnson and H. Farid, "Exposing digital forgeries through specular highlights on the eyes," in Proc. International Workshop on Information Hiding (IH), 2007, pp. 311-325.
15. D. W. Hansen and Q. Ji, "In the eye of the beholder: A survey of models for eyes and gaze," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 3, pp. 478-500, 2010.
16. D. Schnieders, X. Fu, and K.-Y. K. Wong, "Reconstruction of display and eyes from a single image," in Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, pp. 1442-1449.
17. E. D. Guestrin and M. Eizenman, "General theory of remote gaze estimation using the pupil center and corneal reflections," IEEE Trans. Biomed. Eng., vol. 53, no. 6, pp. 1124-1133, 2006.
18. N. Iqbal and S.-Y. Lee, "A study on human gaze estimation using screen reflection," in Proc. International Conference on Intelligent Data Engineering and Automated Learning (IDEAL), 2008, pp. 104-111.
19. J. Salvi, S. Fernandez, T. Pribanic, and X. Llado, "A state of the art in structured light patterns for surface profilometry," Pattern Recogn., vol. 43, no. 8, pp. 2666-2680, 2010.
20. L. Zhang, N. Subramaniam, R. Lin, R. Raskar, and S. Nayar, "Capturing images with sparse informational pixels using projected 3D tags," in Proc. IEEE Virtual Reality Conference (VR), 2008, pp. 11-18.
21. J. D. Smith, R. Vertegaal, and C. Sohn, "Viewpointer: Lightweight calibration-free eye tracking for ubiquitous handsfree deixis," in Proc. ACM Symposium on User Interface Software and Technology (UIST), 2005, pp. 53-61.
22. D. Fofi, T. Sliwa, and Y. Voisin, "A comparative survey on invisible structured light," in Proc. SPIE 5303 Machine Vision Applications in Industrial Inspection XII, 2004, pp. 90-98.
23. O. Bimber, D. Iwai, G. Wetzstein, and A. Grundhöfer, "The visual computing of projector-camera systems," Comput. Graph. Forum, vol. 27, no. 8, pp. 2219-2245, 2008.
24. H. Hua, P. Krishnaswamy, and J. P. Rolland, "Video-based eyetracking methods and algorithms in head-mounted displays," Opt. Express, vol. 14, no. 10, pp. 4328-4350, 2006.
25. F. Li, S. Kolakowski, and J. Pelz, "Using structured illumination to enhance video-based eye tracking," in Proc. IEEE International Conference on Image Processing (ICIP), 2007, pp. 373-376.
26. P. L. Kaufman and A. Alm, Adler's Physiology of the Eye: Clinical Application, 10th ed. St. Louis, MO: Mosby Inc., 2003.
27. C. Nitschke, "Image-based eye pose and reflection analysis for advanced interaction techniques and scene understanding," Ph.D. dissertation, Graduate School of Information Science and Technology, Osaka University, Japan, 2011.