Plenoptic cameras in real-time robotics

International Journal of Robotics Research

Volumn 32, Issue 2, 2013, Pages 206-217

  Dong, Fengchun ^a   Ieng, Sio Hoi ^b   Savatier, Xavier ^a   Etienne Cummings, Ralph ^c   Benosman, Ryad ^b  

^a Rouen   (France)

^b SORBONNE UNIVERSITÉ   (France)

^c JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

egomotion; non central vision; plenoptic function; scalespace; vision based navigation

Indexed keywords

CENTRAL VISION; EGO-MOTION; PLENOPTIC FUNCTIONS; SCALE-SPACE; VISION BASED NAVIGATION;

CAMERAS; MOTION ESTIMATION; NAVIGATION; OPTICAL PROPERTIES; OPTIMIZATION; PIXELS; ROBOTS; SENSORS;

ROBOTICS;

EID: 84874071240     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364912469420     Document Type: Article

References (47)

1. Adelson EH, Bergen JR Computational Models of Visual Processing. Cambridge, MA: MIT Press ; 1991: 3-20.
2. Adelson EH, Wang JYA. Single lens stereo with a plenoptic camera. IEEE Transactions on Pattern Analysis and machine Intelligence. 1992 ; 14: 99-106
3. Borst, Egelhaaf Detecting Visual Motion: Theory and Models. Amsterdam: Elsevier ; 1993: 3-27.
4. Brady D, Morrison RL Diffractive Optics and Micro-Optics. Li T., ed. 2000 :
5. BurrusN (2011) Kinect calibration. http://nicolas.burrus.name/index.php/ Research/KinectCalibration.
6. Camahort E, Fussell D A Geometric Study of Light Field Representations. Department of Computer Sciences, The University of Texas at Austin ; 1999 :
7. Civera J, Grasa OG, Davison AJ, Montiel JMM. 1-Point RANSAC for extended Kalman filtering: Application to real-time structure from motion and visual odometry. Journal of Field Robotics. 2010 ; 27: 609-631
8. Culurciello E, Etienne-Cummings R, Boahen K. An address event digital imager. IEEE Journal of Solid-State Circuits. 2003 ; 38: 281-294
9. Dansereau I, Mahon DG, Pizarro O, Williams S. Plenoptic flow: Closed- form visual odometry for light field cameras. Proceedings of Intelligent Robots and Systems (IROS). 2011 ;:
10. Dawkins R Climbing Mount Improbable. New York: Norton ; 1996 :
11. Duparré J, Dannberg P, Schreiber P. Ultra-thin camera based on artificial apposition compound eyes. Proceedings of the 10th Microoptics Conference (MOC'04) ; 2004 Friedrich-Schiller-University, Germany ; 2004..
12. Forster LM. Visual mechanisms of hunting behaviour. Trite planiceps New Zealand Journal of Zoology. 1979 ; 6: 79-93
13. Franceschini N. Towards automatic visual guidance of aerospace vehicles: from insects to robots. Acta Futura. 2008 ; 3: 12-28
14. Georgiev T, Lumsdaine A. Focused plenoptic camera and rendering. Journal of Electronic Imaging. 2010 ; 19 (2). 21106
15. Gortler S, Grzeszczuk R. The lumigraph. Computer Graphics (Proceedings SIGGRAPH). 1996 ;: 43-54
16. Hassenstein B, Reichardt W. Systemtheoretische analyse der zeit, reihenfolgen, und vorzeichenauswertung bei der bewegungsperzepion des russelkafers chlorophanus. Zeitschrift für Naturforschung. 1956 ; 11b: 513-524
17. Hildreth E The Measurement Of Visual Motion. MIT Press ; 1984 :
18. Iida F, Lambrinos D. Navigation in an autonomous flying robot using a biologically inspired visual odometer. Sensor Fusion and Decentralized Control in Robotic System III Photonics East. 2000 ; vol. 4196: 86-97
19. Jackson DPH. Influence of cues from the anterior medial eyes of virtual prey on Portia fimbriata, an araneophagic jumping spider. The Journal of Experimental Biology. 2002 ; 205: 1861-1868
20. Khoshelham K. Accuracy analysis of kinect depth data. ISPRS Workshop Laser Scanning ; 2011 ; 2011..
21. Land MF, Collett TS. Chasing behaviour of houseflies. Journal of Comparative Physiology A. 1974 ; 89: 525-538
22. Land MF, Nilsson DE Animal Eyes. Oxford: Oxford University Press ; 2002 :
23. Levoy M, Hanrahan P. Light field rendering. SIGGRAPH '96: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques ; 1996 ; 1996. 31.
24. Lichtsteiner P, Posch C, Delbruck T. A 128 × 128 120 dB 30 MW asynchronous vision sensor that responds to relative intensity change. Proceedings IEEE International Solid-State Circuits Conference ISSCC 2006 ; 2006 ; 2006. 2060.
25. Lindeberg T Scale-Space Theory in Computer Vision. Norwell, MA: Kluwer Academic Publishers ; 1994 :
26. Liu LC, Usseglio-Viretta A. Fly-like visuomotor responses of a robot using a vlsi motion-sensitive chips. Biological Cybernetics. 2001 ; 85: 449-457
27. NeumannJ (2004) Computer Vision in the Space of Light Rays: Plenoptic Videogeometry and Polydioptric Camera Design. PhD Thesis, University of Maryland.
28. Neumann J, Fermuller C, Aloimonos Y. Eyes from eyes: new cameras for structure from motion. Proceedings of the Workshop on Omnidirectional Vision ; 2002 ; 2002..
29. Neumann J, Fermuller C, Aloimonos Y, Brajovic V. Compound eye sensor for 3D ego motion estimation. Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS) ; 2004 IEEE ; 2004..
30. Ng R, Levoy M, Bredif M, Duval G, Horowitz M, Hanrahan P Light Field Photography with a Hand-held Plenoptic Camera. Standford University ; 2005 :
31. Okoshi T Three-dimensional Imaging Techniques. New York: Academic Press ; 1976 :
32. Olberg RM, Worthington AH, Venator KR. Prey pursuit and interception in dragonflies. Journal of Comparative Physiology A. 2000 ; 186: 155-162
33. Panaite J, Usciati T, Clady X, Haliyo S. An experimental study of the Kinect depth sensor. Robotic and Sensors Environments. 2011 ;:
34. RaboudD (2009) The Panoptic Camera: Plenoptic Interpolation in an Omnidirectional Polydioptric Camera. Master's thesis, EPA.
35. Raskar R, Agrawal A, Wilson CA, Veeraraghavan A. Glare aware photography: 4D ray sampling for reducing glare effects of camera lenses. ACM Transactions on Graphics. 2008 ; 27: 56:1-56:10
36. Rivas Lopez OS M, Tyrsa V. Computer Vision. 2008 ;:
37. Ruffier F, Franceschini N. Octave: a bioinspired visuo-motor control system for the guidance of micro-air-vehicles. Proceedings of Bioengineered and Bioinspired Systems Conference ; 2003 ; 2003. 1.
38. Srinivasan MV, Zhang SW, Altwein M, Tautz J. Honeybee navigation: Nature and calibration of the "odometer". Science. 2000 ; 287: 851-853
39. Strasdat H, Montiel JMM, Davison AJ Robotics: Science and Systems VI. Zaragoza, Spain: Universidad de Zaragoza ; 2010 2010 :
40. Svoboda T, Martinec D, Pajdla T. A convenient multi-camera self-calibration for virtual environments. PRESENCE: Teleoperators and Virtual Environments. 2005 ; 14: 407-422
41. Tanida J, Yamada K. TOMBO: thin observation module by bound optics. The 15th Annual Meeting of the IEEE Lasers and Electro-Optics Society, 2002 (LEOS 2002) ; 2002 ; 2002. 233.
42. ThorpeL (2011) New 35mm CMOS Image Sensor for Digital CINE Motion Imaging. Canon Withepaper, Canon. http://learn.usa.canon.com/app/pdfs/white- papers/EOS-C300-New-35mm-CMOS-Sensor-WP.pdf.
43. Tinbergen N Animal Behavior. 1980 ) Animal Behavior, 2nd edition. Time Life. 1980 :
44. VanSanten JP, Sperling G. A temporal covariance model of human motion perception. Journal of the Optical Society of America. 1984 ; 1: 451-473
45. Völkel R, Duparré J. Technology trends of microlens imprint lithography and wafer level cameras (WLC). Proceedings of the 14th Microoptics Conference (MOC'08) ; 2008 Brussels, Belgium ; 2008..
46. Wei Chung W, Schenato L, Wood RJ, Fearing RS. Biomimetic sensor suite for flight control of a micro mechanical flying insect: design and experimental results. IEEE International Conference on Robotics and Automation (ICRA'03) ; 2003 ; 2003. 1146.
47. WilburnB (2004) High Performance Imaging Using Arrays of Inexpensive Cameras. PhD thesis, Stanford University.