Real-time nonlinear parameter estimation using the levenberg-marquardt algorithm on field programmable gate arrays

IEEE Transactions on Industrial Electronics

Volumn 60, Issue 1, 2013, Pages 170-176

  Shawash, Janti ^a   Selviah, David R ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Artificial intelligence; camera calibration; embedded; estimation; FPGA; hardware in the loop; Levenberg Marquardt; machine learning; mapping; neural networks; nonlinear; on chip learning; online learning; optical inspection; projective geometry; supervised learning; systems; XOR

Indexed keywords

ARTIFICIAL INTELLIGENCE; CALIBRATION; CAMERAS; COMPUTER SYSTEMS; E-LEARNING; EMBEDDED SYSTEMS; ESTIMATION; FIELD PROGRAMMABLE GATE ARRAYS (FPGA); HARDWARE; LEARNING ALGORITHMS; LEARNING SYSTEMS; MAPPING; MOTION COMPENSATION; NEURAL NETWORKS; OPTICAL TESTING; PARAMETER ESTIMATION; REAL TIME CONTROL; SUPERVISED LEARNING; SYNTHETIC APERTURES;

CAMERA CALIBRATION; EMBEDDED; HARD-WARE-IN-THE-LOOP; LEVENBERG-MARQUARDT; NONLINEAR; ON-CHIP LEARNING; ONLINE LEARNING; OPTICAL INSPECTION; PROJECTIVE GEOMETRY; XOR;

ONLINE SYSTEMS;

EID: 84866296556     PISSN: 02780046     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIE.2012.2183833     Document Type: Article

References (27)

1. D. Marquardt, "An algorithm for least-squares estimation of nonlinear parameters," J. Soc. Ind. Appl. Math., vol. 11, no. 2, pp. 431-441, Jun. 1963.
2. B. Wilamowski, N. Cotton, O. Kaynak, and G. Dundar (2008, Oct.). Computing gradient vector and Jacobian matrix in arbitrarily connected neural networks. IEEE Trans. Ind. Electron. [Online]. 55(10), pp. 3784-3790. Available: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm? arnumber=4602720
3. M. Hamouda, H. F. Blanchette, K. Al-Haddad, and F. Fnaiech (2011, Nov.). An efficient DSP-FPGA-based real-time implementation method of SVM algorithms for an indirect matrix converter. IEEE Trans. Ind. Electron. [Online]. 58(11), pp. 5024-5031. Available: http://ieeexplore. ieee.org/lpdocs/epic03/wrapper.htm? arnumber=5892884
4. J. Reed and S. Hutchinson (1996, Jun.). Image fusion and subpixel parameter estimation for automated optical inspection of electronic components. IEEE Trans. Ind. Electron. [Online]. 43(3), pp. 346-354. Available: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=499806 (Pubitemid 126772878)
5. S.-Y. Cho and T. W. Chow, "Shape and surface measurement technology by an improved shape-from-shading neural algorithm," IEEE Trans. Ind. Electron., vol. 47, no. 1, pp. 225-230, Feb. 2000. (Pubitemid 32132952)
6. S. Segvic and S. Ribaric (2001, Jun.). Determining the absolute orientation in a corridor using projective geometry and active vision. IEEE Trans. Ind. Electron. [Online]. 48(3), pp. 696-710. Available: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=925597 (Pubitemid 32609965)
7. M. S. Alam and A. Bal (2007, Feb.). Improved multiple target tracking via global motion compensation and optoelectronic correlation. IEEE Trans. Ind. Electron. [Online]. 54(1), pp. 522-529. Available: http://ieeexplore. ieee.org/lpdocs/epic03/wrapper.htm?arnumber=4084638 (Pubitemid 46444049)
8. F.-J. Lin, S. Member, Y.-C. Hung, and S.-Y. Chen (2009, Apr.). FPGAbased computed force control system using Elman neural network for linear ultrasonic motor. IEEE Trans. Ind. Electron. [Online]. 56(4), pp. 1238-1253. Available: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=4663727
9. Y. Motai and A. Kosaka (2008, Oct.). HandEye calibration applied to viewpoint selection for robotic vision. IEEE Trans. Ind. Electron. [Online]. 55(10), pp. 3731-3741. Available: http://ieeexplore.ieee.org/lpdocs/epic03/ wrapper.htm?arnumber=4475519
10. G. Ogawa, K. Kise, T. Torii, and T. Nagao (2007, Apr.). Onboard evolutionary risk recognition system for AutomobilesToward the risk map system. IEEE Trans. Ind. Electron. [Online]. 54(2), pp. 878-886. Available: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=4126820 (Pubitemid 46591010)
11. W.-F. Xie, Z. Li, X.-W. Tu, and C. Perron (2009, Feb.). Switching control of image-based visual servoing with laser pointer in robotic manufacturing systems. IEEE Trans. Ind. Electron. [Online]. 56(2), pp. 520-529. Available: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm? arnumber=4602717
12. H. Ashrafiuon, K. Muske, L. McNinch, and R. Soltan, "Sliding-mode tracking control of surface vessels," IEEE Trans. Ind. Electron., vol. 55, no. 11, pp. 4004-4012, Nov. 2008.
13. J. U. Cho, Q. N. Le, and J. W. Jeon (2009, Mar.). An FPGA-based multiple-axis motion control chip. IEEE Trans. Ind. Electron. [Online]. 56(3), pp. 856-870. Available: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm? arnumber=4624557
14. J. H. Zhu and P. Sutton, FPGA Implementations of Neural Networks-A Survey of a Decade of Progress, Berlin, Germany: Springer-Verlag, Sep. 2003, vol. 2778, pp. 1062-1066. [Online]. Available: WOS:000186329700120
15. J. Shawash and D. R. Selviah (2010). "Artificial higher order neural network training on limited precision processors," in Artificial Higher Order Neural Networks for Computer Science and Engineering: Trends for Emerging Applications. Hershey, PA: Inf. Sci. Publ., ch. 14, p. 378. [Online]. Available: http://www.amazon.com/Artificial-Networks-Computer-Science-Engineering/dp/ 1615207112/ref=sr11?ie=UTF8&s= books&qid=1267789032&sr=8-1
16. S. Sahin, Y. Becerikli, and S. Yazici, "Neural network implementation in hardware using FPGAs," in NIP, Neural Information Processing, Berlin, Germany: Springer-Verlag, 2006, vol. 4234, no. 3, pp. 1105-1112. ISI:000241759000122. (Pubitemid 44699955)
17. J. E. Gentle, Matrix Algebra: Theory, Computations, and Applications in Statistics, 1st ed., New York: Springer New York, 2009. [Online]. Available: http://www.amazon.com/Matrix-Algebra-Computations-Applications-Statistics/dp/ 1441924248
18. Xilinx, AccelDSP Synthesis Tool, Jun. 2008. [Online]. Available: http://www.xilinx.com/tools/dsp.htm
19. T. M. Bhatt and D. McCain, "Matlab as a development environment for FPGA design," in Proc. 42nd Des. Autom. Conf., 2005, pp. 607-610. (Pubitemid 41675508)
20. J. Z. Ou and V. K. Prasanna, "MATLAB/simulink based hardware/software co-simulation for designing using FPGA configured soft processors," in Proc. Parallel Distrib. Process. Symp., Apr. 2005, p. 148b.
21. A. Rosado-Munoz, M. Bataller-Mompean, E. Soria-Olivas, C. Scarante, and J. Guerrero-Martinez (2011, Mar.). FPGA implementation of an adaptive filter robust to impulsive noise: Two approaches. IEEE Trans. Ind. Electron. [Online]. 58(3), pp. 860-870. Available: http://ieeexplore.ieee. org/lpdocs/epic03/ wrapper.htm?arnumber=5067312
22. J.-Y. Bouguet, Camera Calibration Toolbox for Matlab, Pasadena, CA, 2008. [Online]. Available: http://www.vision.caltech.edu/bouguetj/calibdoc/index. html#system
23. H. Zarrinkoub, Fixed-Point Signal ProcessingWith Matlab and Simulink, Apr. 2006. [Online]. Available: http://www.mathworks.com/webex/recordings/ fixedpt 042006/fixedpt 042006.html
24. J. C. Lopez-Garcia, M. A. Moreno-Armendariz, J. Riera-Babures, M. Balsi, and X. Vilasis-Cardona, "Real time vision by FPGA implemented CNNs," in Proc. Eur. Conf. Circuit Theory Des., 2005, vol. 1, pp. I-281-I-284.
25. L. Qiang and N. Allinson, "FPGA-based optical distortion correction for imaging systems," in Proc. 8th Int. Conf. Signal Process., 2006, pp. 16-20, no. 1. [Online]. Available: http://ieeexplore.ieee.org/lpdocs/epic03/ wrapper.htm?arnumber=4129027
26. Z. Zhang (2000, Nov.). A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. [Online]. 22(11), pp. 1330-1334. Available: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm? arnumber=888718
27. L. Shoushan, C. Yan, X. Wenshang, and Z. Tongjun, "A single layer architecture to FPGA implementation of BP artificial neural network," in Proc. IEEE 2nd Int. Asia Conf. Informat. CAR, Mar. 2010, pp. 258-264.