Vector disparity sensor with vergence control for active vision systems

Sensors

Volumn 12, Issue 2, 2012, Pages 1771-1799

  Barranco, Francisco ^a   Diaz, Javier ^a   Gibaldi, Agostino ^b   Sabatini, Silvio P ^b   Ros, Eduardo ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b UNIVERSITY OF GENOA   (Italy)

Author keywords

Active vision; Field programmable gate arrays; Real time systems

Indexed keywords

ARTICLE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; EQUIPMENT; EQUIPMENT DESIGN; FEEDBACK SYSTEM; IMAGE ENHANCEMENT; INSTRUMENTATION; METHODOLOGY; ROBOTICS; TRANSDUCER; VIDEORECORDING;

EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; FEEDBACK; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; ROBOTICS; TRANSDUCERS; VIDEO RECORDING;

EID: 84857551056     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s120201771     Document Type: Article

References (62)

1. Bertozzi, M.; Broggi, A. GOLD: A parallel real-time stereo vision system for generic obstacle and lane detection. IEEE Trans. Image Process. 1998, 7, 62-81.
2. El Ansari, M.; Mousset, S.; Bensrhair, A. A new stereo matching approach for real-time road obstacle detection for situations with deteriorated visibility. In Proceedings of the 2008 IEEE Intelligent Vehicles Symposium, Eindhoven, The Netherlands, 4-6 June 2008; pp. 355-360.
3. Oisel, L.; Memin, E.; Morin, L.; Galpin, F. One-dimensional dense disparity estimation for three-dimensional reconstruction. IEEE Trans. Image Process. 2003, 12, 1107-1119.
4. Lu, Z.; Shi, B. Subpixel resolution binocular visual tracking using analog VLSI vision sensors. IEEE Trans. Circuits Syst. II Analog Digit. Signal Process. 2000, 47, 1468-1475.
5. Musleh, B.; Garca, F.; Otamendi, J.; Armingol, J.M.; de la Escalera, A. Identifying and tracking pedestrians based on sensor fusion and motion stability predictions. Sensors 2010, 10, 8028-8053.
6. Coelho, J.; Piater, J.; Grupen, R. Developing haptic and visual perceptual categories for reaching and grasping with a humanoid robot. Robot. Auton. Syst. 2001, 37, 195-218.
7. Song, W.; Minami, M.; Yu, F.; Zhang, Y.; Yanou, A. 3-D hand amp; Eye-vergence approaching visual servoing with lyapunouv-stable pose tracking. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 9-13 May 2011; pp. 5210-5217.
8. Diaz, J.; Ros, E.; Carrillo, R.; Prieto, A. Real-time system for high-image resolution disparity estimation. IEEE Trans. Image Process. 2007, 16, 280-285.
9. Murphy, C.; Lindquist, D.; Rynning, A.; Cecil, T.; Leavitt, S.; Chang, M. Low-cost stereo vision on an FPGA. In Proceedings of the 15th Annual IEEE Symposium on Field-Programmable Custom Computing Machines (FCCM '07), Napa, CA, USA, 23-25 April 2007; pp. 333-334.
10. Trucco, E.; Verri, A. Introductory Techniques for 3-D Computer Vision; Prentice Hall PTR: Upper Saddle River, NJ, USA, 1998.
11. Faugeras, O.; Luong, Q.T.; Papadopoulou, T. The Geometry of Multiple Images: The Laws that Govern the Formation of Images of A Scene and Some of Their Applications; MIT Press: Cambridge, MA, USA, 2001.
12. Samarawickrama, J.G.; Sabatini, S.P. Version and vergence control of a stereo camera head by fitting the movement into the hering's law. In Proceedings of the 4th Canadian Conference on Computer and Robot Vision, Montreal, QC, Canada, 28-30 May 2007; pp. 363-370.
13. Theimer, W.M.; Mallot, H.A. Vergence Guided Depth Reconstruction Using a Phase Method; Neuro-Nimes '93; EC2 Publishing: Nanterre, France, 1993; pp. 299-308.
14. Gibaldi, A.; Canessa, A.; Chessa, A.; Sabatini, S.P.; Solari, F. A neuromorphic control module for real-time vergence eye movements on the iCub robot head. In Proceedings of the 10th IEEE-RAS International Conference on Humanoid Robots (Humanoids), Nashville, TN, USA, 6-8 December 2011; pp. 543-550.
15. Semmlow, J.L.; Yuan, W.; Alvarez, T.L. Evidence for separate control of slow version and vergence eye movements: Support for Hering's law. Vis. Res. 1998, 38, 1145-1152.
16. Enrights, J. Changes in vergence mediated by saccades. J. Physiol. 1983, 350, 9-31.
17. Chessa, M.; Sabatini, S.P.; Solari, F. A fast joint bioinspired algorithm for optic flow and two-dimensional disparity estimation. In Proceedings of the 7th International Conference on Computer Vision Systems: Computer Vision Systems (ICVS '09), Liege, Belgium, October 2009; pp. 184-193.
18. Xu, Y.; Zhou, J.; Zhai, G. 2D phase-based matching in uncalibrated images. In Proceedings of the IEEE Workshop on Signal Processing Systems Design and Implementation, Athens, Greece, 2-4 November 2005; pp. 325-330.
19. Nalpantidis, L.; Amanatiadis, A.; Sirakoulis, G.; Gasteratos, A. Efficient hierarchical matching algorithm for processing uncalibrated stereo vision images and its hardware architecture. IET Image Process. 2011, 5, 481-492.
20. Beauchemin, S.S.; Barron, J.L. The computation of optical flow. ACM Comput. Surv. 1995, 27, 433-466.
21. Lucas, B.D.; Kanade, T. An iterative image registration technique with an application to stereo vision. In Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI '81), Vancouver, BC, Canada, August 1981; pp. 674-679.
22. Fleet, D.J.; Jepson, A.D.; Jenkin, M.R. Phase-based disparity measurement. CVGIP Image Underst. 1991, 53, 198-210.
23. Sabatini, S.P.; Gastaldi, G.; Solari, F.; Pauwels, K.; Hulle, M.M.V.; Diaz, J.; Ros, E.; Pugeault, N.; Krger, N. A compact harmonic code for early vision based on anisotropic frequency channels. Comput. Vis. Image Underst. 2010, 114, 681-699.
24. Solari, F.; Sabatini, S.P.; Bisio, G.M. Fast technique for phase-based disparity estimation with no explicit calculation of phase. Electron. Lett. 2001, 37, 1382-1383.
25. iCub Project. The EU iCub Project: An Open Source Cognitive Humanoid Robotic Platform. Available online: http://www.icub.org/ (accessed on 28 December 2011).
26. Beira, R.; Lopes, M.; Praga, M.; Santos-Victor, J.; Bernardino, A.; Metta, G.; Becchi, F.; Saltaren, R. Design of the robot-cub (iCub) head. In Proceedings of the 2006 IEEE International Conference on Robotics and Automation (ICRA '06), Orlando, CA, USA, May 2006; pp. 94-100.
27. Ivaldi, S. From Humans to Humanoids: A Study on Optimal Motor Control for the iCub. Ph.D. Thesis, University of Genoa, Genoa, Italy, 2011.
28. Georgoulas, C.; Andreadis, I. A real-time occlusion aware hardware structure for disparity map computation. In Proceedings of the Image Analysis and Processing (ICIAP '09), Vietri sul mare, Italy, September 2009; Volume 5716, pp. 721-730.
29. Hansard, M.; Horaud, R. Cyclopean geometry of binocular vision. J. Opt. Soc. Am. 2008, 25, 2357-2369.
30. Tomasi, M.; Vanegas, M.; Barranco, F.; Diaz, J.; Ros, E. A novel architecture for a massively parallel low level vision processing engine on chip. In Proceedings of the 2010 IEEE International Symposium on Industrial Electronics (ISIE '10), Bari, Italy, 5-7 July 2010; pp. 3033-3039.
31. Hadjitheophanous, S.; Ttofis, C.; Georghiades, A.; Theocharides, T. Towards hardware stereoscopic 3D reconstruction a real-time FPGA computation of the disparity map. In Proceedings of the 2010 IEEE International Symposium on Design, Automation & Test in Europe Conference & Exhibition (DATE '10), Dresden, Germany, 8-12 March 2010; pp. 1743-1748.
32. Jin, S.; Cho, J.; Pham, X.D.; Lee, K.M.; Park, S.K.; Kim, M.; Jeon, J.W. FPGA design and implementation of a real-time stereo vision system. IEEE Trans. Circuits Syst. Video Technol. 2010, 20, 15-26.
33. Calderon, H.; Ortiz, J.; Fontaine, J. High parallel disparity map computing on FPGA. In Proceedings of the 2010 IEEE/ASME International Conference on Mechatronics and Embedded Systems and Applications (MESA '10), Suzhou, China, 8-10 July 2010; pp. 307-312.
34. Diaz, J.; Ros, E.; Pelayo, F.; Ortigosa, E.M.; Mota, S. FPGA-based real-time optical-flow system. IEEE Trans. Circuits Syst. Video Technol. 2006, 16, 274-279.
35. Barranco, F.; Tomasi, M.; Diaz, J.; Vanegas, M.; Ros, E. Parallel architecture for hierarchical optical flow estimation based on FPGA. IEEE Trans. Very Large Scale Integr. (VLSI) Syst. 2012, doi: 10.1109/TVLSI.2011.2145423.
36. Diaz, J.; Ros, E.; Agis, R.; Bernier, J. Superpipelined high-performance optical-flow computation architecture. Comput. Vis. Image Underst. 2008, 112, 262-273.
37. Brandt, J.W. Improved accuracy in Gradient-based optical flow estimation. Int. J. Comput. Vis. 1997, 25, 5-22.
38. Barron, J.L.; Fleet, D.J.; Beauchemin, S.S. Performance of optical flow techniques. Int. J. Comput. Vis. 1994, 12, 43-77.
39. Liu, H.; Hong, T.H.; Herman, M.; Chellappa, R. Accuracy vs. efficiency trade-offs in optical flow algorithms. In Computer Vision ECCV 96; Springer: Berlin, Germany, 1996; Volume 1065, pp. 174-183.
40. Pauwels, K.; Tomasi, M.; Diaz, J.; Ros, E.; Hulle, M.M.V. A comparison of FPGA and GPU for real-time phase-based optical flow, stereo, and local image features. IEEE Trans. Comput. 2011, doi: 10.1109/TC.2011.120.
41. Gautama, T.; van Hulle, M. A phase-based approach to the estimation of the optical flow field using spatial filtering. IEEE Trans. Neural Netw. 2002, 13, 1127-1136.
42. Bergen, J.; Anandan, P.; Hanna, K.; Hingorani, R. Hierarchical model-based motion estimation. In Computer Vision ECCV'92; Sandini, G., Ed.; Springer: Berlin, Germany, 1992; Volume 588, pp. 237-252.
43. Burt, P.J.; Adelson, E.H. The laplacian pyramid as a compact image code. IEEE Trans. Commun. 1983, 31, 532-540.
44. Sevensols. Seven Solutions. Available online: http://www.sevensols.com/ (accessed on 28 December 2011).
45. Tomasi, M.; Vanegas, M.; Barranco, F.; Diaz, J.; Ros, E. High-performance optical-flow architecture based on a multiscale, multi-orientation phase-based model. IEEE Trans. Circuits Syst. Video Technol. 2010, 20, 1797-1807.
46. Vanegas, M.; Tomasi, M.; Diaz, J.; Ros, E. Multi-port abstraction layer for FPGA intensive memory exploitation applications. J. Syst. Archit. 2010, 56, 442-451.
47. Ortigosa, E.; Canas, A.; Ros, E.; Ortigosa, P.; Mota, S.; Diaz, J. Hardware description of multi-layer perceptrons with different abstraction levels. Microprocess. Microsyst. 2006, 30, 435-444.
48. Tomasi, M.; Barranco, F.; Vanegas, M.; Diaz, J.; Ros, E. Fine grain pipeline architecture for high performance phase-based optical flow computation. J. Syst. Archit. 2010, 56, 577-587.
49. Vision, M.C. Middlebury Computer Vision. Available online: http://vision.middlebury.edu/ (accessed on 28 December 2011).
50. Chessa, M.; Solari, F.; Sabatini, S.P. Virtual reality to simulate visual tasks for robotic systems. In Virtual Reality; Kim, J.J., Ed.; InTech: New York, NY, USA, 2010; pp. 71-92.
51. Chang, N.C.; Tsai, T.H.; Hsu, B.H.; Chen, Y.C.; Chang, T.S. Algorithm and architecture of disparity estimation with mini-census adaptive support weight. IEEE Trans. Circuits Syst. Video Technol. 2010, 20, 792-805.
52. Ernst, I.; Hirschmüller, H. Mutual information based semi-global stereo matching on the GPU. In Proceedings of the 4th International Symposium on Advances in Visual Computing, Las Vegas, NV, USA, December 2008; pp. 228-239.
53. Han, S.K.; Woo, S.; Jeong, M.H.; You, B.J. Improved-quality real-time stereo vision processor. In Proceedings of the 22nd International Conference on VLSI Design, New Delhi, India, 5-9 January 2009; pp. 287-292.
54. Gibson, J.; Marques, O. Stereo depth with a unified architecture GPU. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW '08), Anchorage, AK, USA, 23-28 June 2008; pp. 1-6.
55. Gong, M.; Yang, Y.H. Fast unambiguous stereo matching using reliability-based dynamic programming. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27, 998-1003.
56. Virtual Reality Tool for Active Vision. Available online: http://www.pspc.dibe.unige.it/Research/vr.html (accessed on 28 December 2011).
57. Carneiro, G.; Jepson, A. Multi-scale phase-based local features. In Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA, 18-20 June 2003; pp. 736-743.
58. Oppenheim, A.; Lim, J. The importance of phase in signals. Proc. IEEE 1981, 69, 529-541.
59. Tomasi, M.; Vanegas, M.; Barranco, F.; Diaz, J.; Ros, E. Real-time architecture for a robust multi-scale stereo engine on FPGA. IEEE Trans. Very Large Scale Integr. (VLSI) Syst. 2011, doi: 10.1109/TVLSI.2011.2172007.
60. Fleet, D.; Jepson, A. Stability of phase information. IEEE Trans. Pattern Anal. Mach. Intell. 1993, 15, 1253-1268.
61. Bernardino, A.; Santos-Victor, J. Binocular tracking: Integrating perception and control. IEEE Trans. Robot. Autom. 1999, 15, 1080-1094.
62. Sapienza, M.; Hansard, M.; Horaud, R. Real-Time 3D Reconstruction and Fixation with an Active Binocular Head; Technical Report; INRIA: Le Chesnay Cedex, France, 2011.