FPGA-based multimodal embedded sensor system integrating low- and mid-level vision

Sensors

Volumn 11, Issue 8, 2011, Pages 8164-8179

  Botella, Guillermo ^a   Jose Antonio Martin H ^a   Santos, Matilde ^a   Meyer Baese, Uwe ^b  

^a UNIVERSIDAD COMPLUTENSE DE MADRID   (Spain)

^b FAMU FSU COLLEGE OF ENGINEERING   (United States)

Author keywords

Bio inspired systems; Machine vision; Optical flow; Orthogonal variant moments; VLSI

Indexed keywords

ALGORITHM; ANIMAL; ARTICLE; AUTOMATED PATTERN RECOGNITION; BRAIN CORTEX; COMPUTER; EQUIPMENT DESIGN; GENETIC PROCEDURES; HUMAN; METHODOLOGY; MOTION; OPTICS; PHYSIOLOGY; REPRODUCIBILITY; STATISTICAL MODEL; THREE DIMENSIONAL IMAGING; VISION;

ALGORITHMS; ANIMALS; BIOSENSING TECHNIQUES; CEREBRAL CORTEX; COMPUTERS; EQUIPMENT DESIGN; HUMANS; IMAGING, THREE-DIMENSIONAL; MODELS, STATISTICAL; MOTION; OPTICS AND PHOTONICS; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; VISION, OCULAR;

EID: 80052182203     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s110808164     Document Type: Article

References (48)

1. Bruce, V.; Green, P.R.; Georgeson, M.A. Visual Perception: Physiology, Psychology & Ecology, 3rd ed.; Laurence Erlbaum Associates: Hove, UK, 1998.
2. Szelinsky, R. Computer Vision Algorithms and Applications; Springer: Berlin, Germany, 2011.
3. Guzel, M.S.; Bicker, R. Optical Flow Based System Design for Mobile Robots. In Proceedings of the 2010 IEEE Conference on Robotics Automation and Mechatronics, Robotics Automation and Mechatronics (RAM), Singapore, 28-30 June 2010; pp. 545-550.
4. Sim, K.F.; Sundaraj, K. Human Motion Tracking of Athlete Using Optical Flow and Artificial Markers. In Proceedings of the 2010 International Conference on Intelligent and Advanced Systems (ICIAS), Kuala Lumpur, Malaysia, 15-17 June 2010; pp. 1-4.
5. Papadopoulos, G.T.; Briassouli, A.; Mezaris, V.; Kompatsiaris, I.; Strintzis, M.G. Statistical motion information extraction and representation for semantic video analysis. IEEE Trans. Circuits Syst. Video Technol. 2009, 19, 1513-1528.
6. Huang, C.; Chen, Y. Motion estimation method using 3D steerable filter. Image Vis. Comput. 1995, 13, 21-32.
7. Lucas, B.D.; Kanade, T. An Iterative Image Registration Technique with an Application to Stereo Vision. In Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI'81), Vancouver, BC, Canada, 24-28 August 1981; pp. 674-679.
8. Baker, S.; Matthews, I. Lucas-kanade 20 years on: A unifying framework. Int. J. Comput. Vis. 2004, 56, 221-255.
9. Prokop, R.J.; Reeves, A.P. A survey of moment-based techniques for unoccluded object representation and recognition. CVGIP: Graph. Models Image Process 1992, 54, 438-460.
10. Papakostas, G.A.; Koulouriotis, D.E.; Karakasis, E.G. A unified methodology for the efficient computation of discrete orthogonal image moments. Inf. Sci. 2009, 176, 3619-3633.
11. Flusser, J. Moment Invariants in Image Analysis. In Proceedings of the World Academy of Science, Engineering and Technology, Czech Republic, February 2006; Volume 11, pp. 196-201.
12. Hu, M.K. Pattern recognition by moment invariants. IEEE Trans. Inf. Theory 1961, 49, 14-28
13. Hu, M.-K. Visual pattern recognition by moment invariants. IRE Trans. Inf. Theory 1962, 8, 179-187.
14. Botella, G.; Meyer-Baese, U.; García A. Bioinspired robust optical flow processor system for VLSI implementation. IEEE Electron. Lett. 2009, 45, 1304-1306.
15. Botella, G.; García, A.; Rodríguez, M.; Ros, E.; Meyer-Baese, U.; Molina M.C. Robust bioinspired architecture for optical flow computation. IEEE Trans. VLSI Syst. 2010, 18, 616-629.
16. Johnston, A.; Clifford, C.W. A unified account of three apparent motion illusions. Vis. Res. 1994, 35, 1109-1123.
17. Johnston, A.; Clifford, C.W. Perceived motion of contrast modulated gratings: PredICTION of the McGM and the role of full-wave rectification. Vis. Res. 1995, 35, 1771-1783.
18. Johnston, A.; McOwan, P.W.; Benton, C.P. Robust velocity computation from a biologically motivated model of motion perception. Proc. Biol. Sci. 1999, 266, 509-518.
19. McOwan, P.W.; Benton, C.; Dale, J.; Johnston, A. A multi-differential neuromorphic approach to motion detection. Int. J. Neural Syst. 1999, 9, 429-434.
20. Johnston, A.; McOwan, P.W.; Benton, C.P. Biological computation of image motion from flows over boundaries. J. Physiol. (Paris) 2003, 97, 325-334.
21. Lindeberg, T.; Romeny, B. Linear scale-space: I. Basic Theory, II. Early Visual Operations. In Geometry-Driven Diffusion; Kluwer Academic Publishers: Boston, MA, USA, 1994; pp. 1-77.
22. Johnston, A.; McOwan, P.W.; Buxton, H.A. Computational model of the analysis of some first-order and second-order motion patterns by simple and complex cells. Proc. R. Soc. London 1992, 250, 297-306.
23. Nalwa, V.S. A Guided Tour of Computer Vision; Addison-Wesley: Reading, MA, USA, 1993
24. Barron, J.L.; Fleet, D.J.; Beauchemin, S.S. Performance of optical flow techniques. Int. J. Comput. Vis. 1994, 12, 43-77.
25. Hess, R.F.; Snowden, R.J. Temporal frequency filters in the human peripheral visual field. Vis. Res. 1992, 32, 61-72.
26. Lagae, L.; Raiguel, S.; Orban, G.A. Speed and direction selectivity of macaque middle temporal neurons. J. Neurophysiol. 1993, 69, 19-39.
27. Mikami, A.; Newsome, W.T.; Wurtz, R.H. Motion selectivity in macaque visual cortex. I. Mechanisms of direction and speed selectivity in extrastriate area MT. J. Neurophysiol. 1986, 55, 1308-1327.
28. McLeod, P.; Dittrich, W.; Driver, J.; Perrett, D.; Zihl, J. Preserved and impaired detection of structure from motion by a motion-blind patient. Visual Cognit. 1996, 3, 363-391.
29. Horn, K.P.; Schunck, B.G. Determining optical flow. Artif. Intell. 1981, 17, 185-203.
30. Teh, C.-H.; Chin, R.T. On image analysis by the methods of moments. IEEE Trans. Pattern Anal. Mach. Intell. 1988, 10, 496-513.
31. Zhang, Y.N.; Zhang, Y.; Wen, C.Y. A new focus measure method using moments. Image Vis. Comput. 2000, 18, 959-965.
32. Papakostas, G.A.; Boutalis, Y.S.; Karras, D.A.; Mertzios, B.G. A new class of zernike moments for computer vision applications. Inf. Sci. 2007, 177, 2802-2819.
33. Papakostas, G.A.; Karakasis, E.G.; Koulouriotis, D.E. Exact and Speedy Computation of Legendre Moments on Binary Images. In Proceedings of the Eight International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS'07, Santorini, Greece, 6-8 June 2007.
34. Papakostas, G.A.; Koulouriotis, D.E.; Karakasis, E.G. A unified methodology for the efficient computation of discrete orthogonal image moments. Inf. Sci. 2009, 176, 3619-3633.
35. Wee, C.-Y.; Paramesran, R.; Takeda, F. New computational methods for full and subset zernike moments. Inf. Sci. 2004, 159, 203-220.
36. Sookhanaphibarn, K.; Lursinsap, C. A new feature extractor invariant to intensity, rotation, and scaling of color images. Inf. Sci. 2006, 176, 2097-2119.
37. Martin H., J.A.; Santos, M.; de Lope, J. Orthogonal variant moments features in image analysis. Inf. Sci. 2010, 180, 846-860.
38. Handel-C Languaje Reference Manual; Agility Design Solutions Inc. 2008. Available online: http://www.mentor.com/products/fpga/handel-c/upload/handelc-reference.pdf (accessed on 16 August 2011).
39. AlphaData RC1000 product. Available online: http://www.alpha-data.com (accessed on 16 August 2011).
40. Frigo, J. Evaluation of the StreamsC, CtoFPGA compiler: An applications perspective. In Proceedings of the ACM/SIGDA International Symposium on Field Programmable Gate Arrays, Monterey, CA, USA, 11-13 February 2001; pp. 134-140.
41. Software and Design Tools. Available online: http://www.xilinx.com/tools/designtools.htm (accessed on 16 August 2011).
42. Wei, Z.; Lee, D.-J.; Nelson, B.E.; Archibald, J.K.; Edwards, B.B. FPGA-based embedded motion estimation sensor. Int. J. Reconfig. Comput. 2008, 8, doi:10.1155/2008/636145.
43. Díaz, J.; Ros, E.; Agís, R.; Bernier, J.L. Superpipelined high-performance optical flow computation architecture. Comput. Vis. Image Underst. 2008, 112, 262-273.
44. Tomasi, M.; Barranco, F.; Vanegas, M.; Díaz, J.; Ros. E. Fine grain pipeline architecture for high performance phase-based optical flow computation. J. Syst. Archit. 2010, 56, 577-587.
45. Sosa, J.C.; Gomez-Fabela, R.; Boluda, J.A.; Pardo, F. Change-Driven Image Architecture on FPGA with Adaptive Threshold for Optical-Flow Computation. In Proceedings of the IEEE International Conference on Reconfigurable Computing and FPGA's, ReConFig 2006, San Luis Potosí, México, 20-22 September 2006; pp. 1-8.
46. Mahalingam, V.; Bhattacharya, K.; Ranganathan, N.; Chakravarthula, H.; Murphy, R.R.; Pratt, K.S. A VLSI architecture and algorithm for lucas-kanade-based optical flow computation. IEEE Trans. VLSI Syst. 2010, 18, 29-38.
47. Chubb, C.; Sperling, G. Drift-balanced random stimuli: A general basis for studying non-Fourier motion perception. J. Opt. Soc. Am. A 1988, 5, 1986-2007.
48. First-Order and Second-Order Motion Demos. Available online: http://www.snl.salk.edu/~maarten/demos/2nd.html (accessed on 16 August 2011).