Coded time of flight cameras: Sparse deconvolution to address multipath interference and recover time profiles

ACM Transactions on Graphics

Volumn 32, Issue 6, 2013, Pages

  Kadambi, Achuta ^a   Whyte, Refael ^a,b   Bhandari, Ayush ^a   Streeter, Lee ^b   Barsi, Christopher ^a   Dorrington, Adrian ^b   Raskar, Ramesh ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF WAIKATO   (New Zealand)

Author keywords

Femtophotography; Multipath interference; Sparse deconvolution; Time of flight (ToF) cameras; Time coded illumination

Indexed keywords

AMPLITUDE MODULATED; ELECTRONIC TIME DELAYS; FEMTOPHOTOGRAPHY; MULTI-PATH INTERFERENCE; NEW APPLICATIONS; SUB-SURFACE IMAGING; TIME OF FLIGHT (TOF) CAMERAS; TIME-OF-FLIGHT CAMERAS;

AMPLITUDE MODULATION; CAMERAS; INVERSE PROBLEMS; MULTIPATH PROPAGATION; RECOVERY;

SIGNAL INTERFERENCE;

EID: 84887834876     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2508363.2508428     Document Type: Article

References (31)

1. ABRAMSON, N. 1980. Light-in-flight recording by holography. In 1980 Los Angeles Technical Symposium, International Society for Optics and Photonics, 140-143.
2. BAMJI, C., ET AL., 2008. Method and system to avoid inter-system interference for phase-based time-of-flight systems, July 29. US Patent 7,405,812.
3. BHANDARI, A., KADAMBI, A., WHYTE, R., STREETER, L., BARSI, C., DORRINGTON, A., AND RASKAR, R. 2013. Multifrequency time of flight in the context of transient renderings. In ACM SIGGRAPH 2013 Posters, ACM, 46.
4. BRUCKSTEIN, A. M., ELAD, M., AND ZIBULEVSKY, M. 2008. On the uniqueness of nonnegative sparse solutions to underdetermined systems of equations. Information Theory, IEEE Transactions on 54, 11, 4813-4820.
5. BUTTGEN, B., AND SEITZ, P. 2008. Robust optical time-of-flight range imaging based on smart pixel structures. Circuits and Systems I: Regular Papers, IEEE Transactions on 55, 6, 1512-1525.
6. CARNEGIE, D. A., MCCLYMONT, J., JONGENELEN, A. P., DRAYTON, B., DORRINGTON, A. A., AND PAYNE, A. D. 2011. Design and construction of a configurable full-field range imaging system for mobile robotic applications. In New Developments and Applications in Sensing Technology. Springer, 133-155.
7. CLAERBOUT, J. F., AND F, M. 1973. Robust modelling with erratic data. Geophysics 38, 1, 826-844.
8. 2008. Special issue on compressed sensing. IEEE Signal Processing Magazine 25, 2.
9. DARCHE, G. 1989. Iterative 1 deconvolution. SEP Annual Report 61, 281-301.
10. DAUBECHIES, I., DEFRISE, M., AND DE MOL, C. 2004. An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Communications on pure and applied mathematics 57, 11, 1413-1457.
11. DORRINGTON, A. A., GODBAZ, J. P., CREE, M. J., PAYNE, A. D., AND STREETER, L. V. 2011. Separating true range measurements from multi-path and scattering interference in commercial range cameras. In IS&T/SPIE Electronic Imaging, International Society for Optics and Photonics, 786404-786404.
12. GODBAZ, J. P., CREE, M. J., AND DORRINGTON, A. A. 2012. Closed-form inverses for the mixed pixel/multipath interference problem in amcw lidar. In IS&T/SPIE Electronic Imaging, International Society for Optics and Photonics, 829618-829618.
13. GODBAZ, J. P., DORRINGTON, A. A., AND CREE, M. J. 2013. Understanding and ameliorating mixed pixels and multipath interference in amcw lidar. In TOF Range-Imaging Cameras. Springer, 91-116.
14. GUPTA, M., AGRAWAL, A., VEERARAGHAVAN, A., AND NARASIMHAN, S. G. 2013. A practical approach to 3d scanning in the presence of interreflections, subsurface scattering and defocus. International Journal of Computer Vision, 1-23.
15. HEIDE, F., HULLIN, M. B., GREGSON, J., AND HEIDRICH, W. 2013. Low-budget transient imaging using photonic mixer devices. ACM Transactions on Graphics 32, 4 (July).
16. HODRICK, R., AND PRESCOTT, E. 1997. Postwar u. s. business cycles: An empirical investigation. Journal of Money, Credit, and Banking 29, 1-16.
17. JENSEN, H. W., MARSCHNER, S. R., LEVOY, M., AND HANRAHAN, P. 2001. A practical model for subsurface light transport. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques, ACM, 511-518.
18. KADAMBI, A., IKOMA, H., LIN, X., WETZSTEIN, G., AND RASKAR, R. 2013. Subsurface enhancement through sparse representations of multispectral direct/global decomposition. In Computational Optical Sensing and Imaging, Optical Society of America.
19. NAIK, N., ZHAO, S., VELTEN, A., RASKAR, R., AND BALA, K. 2011. Single view reflectance capture using multiplexed scattering and time-of-flight imaging. In ACM Transactions on Graphics (TOG), vol. 30, ACM, 171.
20. NAIK, N., BARSI, C., VELTEN, A., AND RASKAR, R. 2013. Time-resolved reconstruction of scene reflectance hidden by a diffuser. In CLEO: Science and Innovations, Optical Society of America.
21. NARASIMHAN, S. G., NAYAR, S. K., SUN, B., AND KOPPAL, S. J. 2005. Structured light in scattering media. In Computer Vision, 2005. ICCV 2005. Tenth IEEE International Conference on, vol. 1, IEEE, 420-427.
22. O'BRIEN, M. S., SINCLAIR, A. N., AND KRAMER, S. M. 1994. Recovery of a sparse spike time series by l1 norm deconvolution. IEEE Trans. Signal Proc. 42, 12, 3353-3365.
23. RASKAR, R., AND DAVIS, J. 2008. 5d time-light transport matrix: What can we reason about scene properties. Int. Memo07 2.
24. RASKAR, R., AGRAWAL, A., AND TUMBLIN, J. 2006. Coded exposure photography: motion deblurring using fluttered shutter. In ACM Transactions on Graphics (TOG), vol. 25, ACM, 795- 804.
25. SANTOSA, F., AND SYMES, W. W. 1986. Linear inversion of band-limited reflection seismograms. SIAM Journal on Scientific and Statistical Computing 7, 4, 1307-1330.
26. TAYLOR, H. L., BANKS, S. C., AND MCCOY, J. F. 1979. Deconvolution with the ell1 norm. Geophysics 44, 1, 39-52.
27. TSIN, Y., KANG, S. B., AND SZELISKI, R. 2006. Stereo matching with linear superposition of layers. Pattern Analysis and Machine Intelligence, IEEE Transactions on 28, 2, 290-301.
28. VELTEN, A., WILLWACHER, T., GUPTA, O., VEERARAGHAVAN, A., BAWENDI, M. G., AND RASKAR, R. 2012. Recovering three-dimensional shape around a corner using ultrafast time-offlight imaging. Nature Communications 3, 745.
29. VELTEN, A., WU, D., JARABO, A., MASIA, B., BARSI, C., JOSHI, C., LAWSON, E., BAWENDI, M., GUTIERREZ, D., AND RASKAR, R. 2013. Femto-photography: Capturing and visualizing the propagation of light. ACM Transactions on Graphics 32, 4 (July).
30. WHYTE, R. Z., PAYNE, A. D., DORRINGTON, A. A., AND CREE, M. J. 2010. Multiple range imaging camera operation with minimal performance impact. In IS&T/SPIE Electronic Imaging, International Society for Optics and Photonics, 75380I-75380I.
31. WU, D., WETZSTEIN, G., BARSI, C., WILLWACHER, T., OTOOLE, M., NAIK, N., DAI, Q., KUTULAKOS, K., AND RASKAR, R. 2012. Frequency analysis of transient light transport with applications in bare sensor imaging. In Computer Vision-ECCV 2012. Springer, 542-555.