Kinectrack: 3D pose estimation using a projected dense dot pattern

IEEE Transactions on Visualization and Computer Graphics

Volumn 20, Issue 6, 2014, Pages 839-851

  Mcilroy, Paul ^a   Izadi, Shahram ^b   Fitzgibbon, Andrew ^b  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b MICROSOFT RESEARCH   (United Kingdom)

Author keywords

3D reconstruction; kinect; Six DoF tracking

Indexed keywords

CAMERAS; THREE DIMENSIONAL;

3D POSE ESTIMATION; 3D RECONSTRUCTION; AUTO CALIBRATION; COMMODITY HARDWARE; INTRINSIC PARAMETERS; KINECT; MATCHING TECHNIQUES; SIX-DOF;

GESTURE RECOGNITION;

EID: 84900019619     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2013.262     Document Type: Article

References (38)

1. A. Davison, I. Reid, N. Molton, and O. Stasse, "Mono SLAM: Real-Time Single Camera Slam," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 6, pp. 1052-1067, June 2007.
2. G. Klein and D. Murray, "Parallel Tracking and Mapping for Small AR Workspaces," Proc. IEEE and ACM Sixth Int'l Symp. Mixed and Augmented Reality, Nov. 2007.
3. T. Shiratori, H. Park, L. Sigal, Y. Sheikh, and J. Hodgins, "Motion Capture from Body-Mounted Cameras," Proc. ACM SIGGRAPH, Aug. 2011.
4. P. McIlroy, S. Izadi, and A. Fitzgibbon, "Kinectrack: Agile 6-Dof Tracking Using a Projected Dot Pattern," Proc. IEEE and ACM Int'l Symp. Mixed and Augmented Reality, Nov. 2012.
5. D. Wormell, E. Foxlin, and P. Katzman, "Advanced Inertial-Optical Tracking System for Wide Area Mixed and Augmented Reality Systems," Proc. 13th Eurographics Workshop Virtual Environments, May 2007.
6. Vicon.com, "Vicon," http://www.vicon.com/, 2014.
7. Natural Point, "Optitrack Tracking," http://naturalpoint.com/ optitrack, 2014.
8. O. Williams and A. Fitzgibbon, "Optical Pointing Device," US patent Application US2009/0237356 A1, Sept. 2009.
9. H. Kato and M. Billinghurst, "Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System," Proc. IEEE and ACM Second Int'l Workshop Augmented Reality, Oct. 1999.
10. M. Fiala, "ARTag, A Fiducial Marker System Using Digital Techniques," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, June 2005.
11. H. Uchiyama and H. Saito, "Random Dot Markers," Proc. IEEE Virtual Reality Conf., Mar. 2011.
12. H. Uchiyama and E. Marchand, "Deformable Random Dot Markers," Proc. IEEE and ACM Int'l Symp. Mixed and Augmented Reality, Oct. 2011.
13. L. Chan, H. Wu, H. Kao, J. Ko, H. Lin, M. Y. Chen, J. Hsu, and Y. Hung, "Enabling Beyond-Surface Interactions for Interactive Surface with an Invisible Projection," Proc. 23rd ACM Symp. User Interface Software and Technology, Oct. 2010.
14. K. Willis, I. Poupyrev, S. Hudson, and M. Mahler, "SideBySide: Ad-Hoc Multi-User Interaction with Handheld Projectors," Proc. 24th ACM Symp. User Interface Software and Technology, Oct. 2011.
15. D. Cavens, F. Vogt, S. Fels, and M. Meitner, "Interacting with the Big Screen: Pointers to Ponder," Proc. Conf. Extended Abstracts on Human Factors in Computing Systems, Apr. 2002.
16. J. Davis and X. Chen, "Lumipoint: Multi-User Laser-Based Interaction on Large Tiled Displays," Displays, vol. 23, no. 5, pp. 205-211, 2002.
17. B. Ahlborn, D. Thompson, O. Kreylos, B. Hamann, and O. G. Staadt, "A Practical System for Laser Pointer Interaction on Large Displays," Proc. ACM Symp. Virtual Reality Software and Technology, Nov. 2005.
18. Y. Qin, Y. Shi, and H. Jiang, "Structured Laser Pointer: Enabling Wrist-Rolling Movements as a New Interactive Dimension," Proc. Int'l Conf. Advanced Visual Interfaces, May 2010.
19. S. V. Matveyev and M. Göbel, "The Optical Tweezers: Multiple-Point Interaction Technique," Proc. ACM Symp. Virtual Reality Software and Technology, Oct. 2003.
20. C. Wienss, I. Nikitin, G. Goebbels, and K. Troche, "Sceptre: An Infrared Laser Tracking System for Virtual Environments," Proc. ACM Symp. Virtual Reality Software and Technology, Nov. 2006.
21. M. E. Latoschik and E. Bomberg, "Augmenting a Laser Pointer with a Diffraction Grating for Monoscopic 6-Dof Detection," J. Virtual Reality and Broadcasting, vol. 4, no. 14, pp. 1860-2037, 2007.
22. I. Albitar, P. Graebling, and C. Doignon, "Robust Structured Light Coding for 3D Reconstruction," Proc. IEEE Int'l Conf. Computer Vision, Oct. 2007.
23. Procams.org, "Projector-Camera Systems Workshops," http://www.procams.org/, 2014.
24. M. Ashdown and Y. Sato, "Steerable Projector Calibration," Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshops, June 2005.
25. M. Kimura, M. Mochimaru, and T. Kanade, "Projector Calibration Using Arbitrary Planes and Calibrated Camera," Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2007.
26. S. Park and G. Park, "Active Calibration of Camera-Projector Systems Based on Planar Homography," Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2010.
27. T. Johnson and H. Fuchs, "Real-Time Projector Tracking on Complex Geometry Using Ordinary Imagery," Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2007.
28. R. Raskar, M. Brown, R. Yang, W. Chen, G. Welch, H. Towles, B. Scales, and H. Fuchs, "Multi-Projector Displays Using Camera-Based Registration," Proc. IEEE Conf. Visualization, July 1999.
29. M. Kolomenkin, S. Pollak, I. Shimshoni, and M. Lindenbaum, "Geometric Voting Algorithm for Star Trackers," IEEE Trans. Aerospace and Electronic Systems, vol. 44, no. 2, pp. 441-456, Apr. 2008.
30. D. Lang, D. Hogg, K. Mierle, M. Blanton, and S. Roweis, "Astrometry.net: Blind Astrometric Calibration of Arbitrary Astronomical Images," The Astronomical J., vol. 139, no. 5, pp. 1782-1800, 2010.
31. T. Nakai, K. Kise, and M. Iwamura, "Hashing with Local Combinations of Feature Points and Its Application to Camera-Based Document Image Retrieval," Proc. Int'l Workshop Camera-Based Document Analysis and Recognition, Aug. 2005.
32. T. Nakai, K. Kise, and M. Iwamura, "Use of Affine Invariants in Locally Likely Arrangement Hashing for Camera-Based Document Image Retrieval," Proc. Seventh Int'l Conf. Document Analysis Systems, Feb. 2006.
33. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, second ed., Cambridge Univ. Press, 2004.
34. OpenCV.org, "Opencv v2.4 Documentation," 2012.
35. N. Maitland and C. Harris, "A Video Based Tracker for Use in Computer Aided Surgery," Proc. British Machine Vision Conf., pp. 609-681, Sept. 1994.
36. D. Nistér, "An Efficient Solution to the Five-Point Relative Pose Problem," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, June 2004.
37. G. Simon, A. Fitzgibbon, and A. Zisserman, "Markerless Tracking Using Planar Structures in the Scene," Proc. IEEE and ACM Int'l Symp. Augmented Reality, Oct. 2000.
38. B. Triggs, "Autocalibration from Planar Scenes," Proc. European Conf. Computer Vision, June 1998.