Asynchronous event-based Hebbian epipolar geometry

IEEE Transactions on Neural Networks

Volumn 22, Issue 11, 2011, Pages 1723-1734

  Benosman, Ryad ^a   Ieng, Sio Hoï ^a   Rogister, Paul ^b   Posch, Christoph ^c  

^a INSTITUT DE LA VISION   (France)

^b Institute of Neuroinformatics Zurich   (Switzerland)

^c AIT AUSTRIAN INSTITUTE OF TECHNOLOGY   (Austria)

Author keywords

Asynchronous acquisition; asynchronous sensing; event based vision; frame free; frameless vision; neuromorphic electronics; stereovision; time impulse codification; time based imaging

Indexed keywords

ASYNCHRONOUS ACQUISITION; ASYNCHRONOUS SENSING; EVENT-BASED; FRAME-FREE; FRAMELESS VISION; NEUROMORPHIC; TIME IMPULSE CODIFICATION; TIME-BASED IMAGING;

COMPUTER VISION; GEOMETRY; SENSORS;

STEREO VISION;

BIOMIMETIC MATERIAL;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BINOCULAR VISION; COMPUTER ASSISTED DIAGNOSIS; DEPTH PERCEPTION; LIGHT; RETINA; SENSATION;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMIMETIC MATERIALS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; LIGHT; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; RETINA; SENSATION; SPACE PERCEPTION; VISION, BINOCULAR;

EID: 80455160269     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2167239     Document Type: Article

References (44)

1. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge, U.K.: Cambridge Univ. Press, 2003.
2. O. D. Faugeras, "What can be seen in three dimensions with an uncalibrated stereo rig?" in Proc. Eur. Conf. Comput. Vis., 1992, pp. 563-578.
3. R. Hartley, R. Gupta, and T. Chang, "Stereo from uncalibrated cameras," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Champaign, IL, Jun. 1992, pp. 761-764.
4. R. Benosman and S. Kang, Panoramic Vision: Sensors Theory and Applications. New York: Springer-Verlag, 2002.
5. T. Svoboda and T. Pajdla, "Epipolar geometry for central catadioptric cameras," Int. J. Comput. Vis., vol. 49, no. 1, pp. 23-37, Aug. 2002.
6. S. Baker and S. Nayar, "A theory of single-viewpoint catadioptric image formation," Int. J. Comput. Vis., vol. 35, no. 2, pp. 1-22, 1999.
7. L. Smadja, R. Benosman, and J. Devars, "Hybrid stereo configurations through a cylindrical sensor calibration," J. Mach. Vis. Appl., vol. 17, no. 4, pp. 251-264, 2006.
8. A. Torii, A. Imiya, and N. Ohnishi, "Two and three view geometry for spherical cameras," in Proc. Workshop Omnidirect. Vis., 2005, pp. 1-8.
9. S. Li, "Full-view spherical image camera," in Proc. 18th Int. Conf. Pattern Recognit., Hong Kong, 2006, pp. 386-390.
10. R. Swaminathan, S. Nayar, and M. Grossberg, "Designing mirrors for catadioptric systems that minimize image errors," in Proc. Workshop Omnidirect. Vis., 2004, pp. 1-12.
11. R. Hicks, "Designing a mirror to realize a given projection," J. Opt. Soc. Amer. A, vol. 22, no. 2, pp. 323-330, 2005.
12. P. Rademacher and G. Bishop, "Multiple-center-of-projection images," in Proc. SIGGRAPH, 1998, pp. 1-8.
13. R. Gupta and R. I. Hartley, "Linear pushbroom cameras," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 9, pp. 963-975, Sep. 1997.
14. H. Shum, A. Kalai, and S. Seitz, "Omnivergent stereo," in Proc. Int. Conf. Comput. Vis., 1999, pp. 1-8.
15. S. Seitz, "The space of all stereo images," in Proc. 8th IEEE Int. Conf. Comput. Vis., vol. 1. Vancouver, BC, Canada, Jul. 2001, pp. 26-33.
16. S. Nayar and A. Karmarkar, "360 Ã-360 mosaics," in Proc. Comput. Vis. Pattern Recognit., 2002, pp. 388-395.
17. R. Swaminathan, M. D. Grossberg, and S. K. Nayar, "Caustics of catadioptric cameras," in Proc. 8th IEEE Int. Conf. Comput. Vis., vol. 2. Vancouver, BC, Canada, Jul. 2001, pp. 2-9.
18. S. Ieng and R. Benosman, Geometric Construction of the Caustic Surface of Catadioptric Non-Central Sensors. New York: Springer-Verlag, 2006, ch. 1, pp. 39-54.
19. T. Pajdla, "Epipolar geometry of some non-classical cameras," in Proc. Comput. Vis. Winter Workshop, 2001, pp. 159-180.
20. T. Pajdla, "Stereo with oblique cameras," Int. J. Comput. Vis., vol. 47, no. 1, pp. 161-170, 2002.
21. M. D. Grossberg and S. K. Nayar, "A general imaging model and a method for finding its parameters," in Proc. Int. Conf. Comput. Vis., 2001, pp. 108-115.
22. S. Ramalingam, P. Sturm, and S. Lodha. (2005, Jun.). Toward Complete Generic Camera Calibration. pp. 1093-1098 [Online]. Available: http://perception.inrialpes.fr/Publications/2005/RSL05a
23. P. Sturm. (2005, Jun.). Multi-View Geometry for General Camera Models. pp. 206-212 [Online]. Available: http://perception.inrialpes.fr/ Publications/2005/Stu05
24. T. Debaecker, R. Benosman, and S. Ieng, "Cone of view camera model using conformal geometric algebra for classic and panoramic image sensors," in Proc. 8th Workshop Omnidirect. Vis., Marseilles, France, 2008, pp. 1-11.
25. S. Kuthirummal and S. K. Nayar, "Flexible mirror imaging," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
26. K. Boahen, Communicating Neural Ensembel Between Neuromorphic Chips. Norwell, MA: Kluwer, 1998, pp. 229-259.
27. O. Braddick, Neural Basis of Visual Perception. Amsterdam, The Netherlands: Elsevier, 2001, pp. 16269-16274.
28. R. Serrano-Gotarredona, M. Oster, P. Lichtsteiner, A. Linares-Barranco, R. Paz-Vicente, F. Gomez-Rodriguez, L. Camunas-Mesa, R. Berner, M. Rivas, T. Delbruck, S. Liu, R. Douglas, P. Hafliger, G. Moreno, and A. Civit, "CAVIAR: A 45 k neuron, 5 M synapse, 12 G connects/s AER hardware sensory-processing-learning-actuating system for highspeed visual object recognition and tracking," IEEE Trans. Neural Netw., vol. 20, no. 9, pp. 1417-1438, Sep. 2009.
29. R. Serrano-Gotarredona, T. Serrano-Gotarredona, A. Acosta-Jimenez, and B. Linares-Barranco, "A neuromorphic cortical-layer microchip for spike-based event processing vision systems," IEEE Trans. Circuits Syst., vol. 53, no. 12, pp. 2548-2566, Dec. 2006.
30. E. Chicca, P. Lichtsteiner, T. Delbruck, G. Indiveri, and R. J. Douglas, "Modeling orientation selectivity using a neuromorphic multi-chip system," in Proc. IEEE Int. Symp. Circuits Syst., Island of Kos, Greece, Sep. 2006, pp. 1235-1238.
31. T. Y. W. Choi, P. Merolla, J. Arthur, K. Boahen, and B. E. Shi, "Neuromorphic implementation of orientation hypercolumns," IEEE Trans. Circuits Syst., vol. 52, no. 6, pp. 1049-1060, Jun. 2005.
32. C. Mead, "Adaptive retina," in Analog VLSI Implementation of Neural Systems, C. Mead and M. Ismail, Eds. Boston, MA: Kluwer, 1989, pp. 239-246.
33. M. A. Mahowald and C. Mead, "The silicon retina," Sci. Amer., vol. 264, no. 5, pp. 76-82, May 1991.
34. K. Boahen, "Neuromorphic microchips," Sci. Amer., vol. 292, no. 5, pp. 55-63, May 2005.
35. P. Lichtsteiner, C. Posch, and T. Delbruck, "A 128 × 128 120 dB 15 μs latency asynchronous temporal contrast vision sensor," IEEE J. Solid-State Circuits, vol. 43, no. 2, pp. 566-576, Feb. 2008.
36. Q.-T. Luong, R. Deriche, O. Faugeras, and T. Papadopoulo, "On determining the fundamental matrix: Analysis of different methods and experimental results," INRIA, Le Chesnay, France, Tech. Rep. RR-1894, 1993.
37. Z. Zhang, "Determining the epipolar geometry and its uncertainty: A review," Int. J. Comput. Vis., vol. 27, no. 2, pp. 161-195, Mar. 1998.
38. R. Hartley, "In defense of the eight-point algorithm," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 6, pp. 580-593, Jun. 1997.
39. H. Longuet-Higgins, "A computer algorithm for reconstructing a scene from two projections," Nature, vol. 293, pp. 133-135, Sep. 1981.
40. P. A. Beardsley, A. Zisserman, and D. W. Murray, "Navigation using affine structure from motion," in Proc. Eur. Conf. Comput. Vis., 1994, pp. 85-96.
41. R. Hartley, "Euclidean reconstruction from uncalibrated views," in Proc. 2nd Eur. -U.S. Workshop Invar., 1993, pp. 1-18.
42. D. Hebb, The Organization of Behavior. New York: Wiley, 1949.
43. MATLAB Functions for Multiple View Geometry [Online]. Available: http://www.robots.ox.ac.uk/~vgg/hzbook/code/
44. S. B. Kang, "Catadioptric self-calibration," in Proc. Conf. Comput. Vis. Pattern Recognit., vol. 1. Hilton Head Island, SC, Jun. 2000, pp. 201-207.