Kernel CMAC with improved capability

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 37, Issue 1, 2007, Pages 124-138

  Horváth, Gábor ^a   Szabó, Tamás ^a,b  

^a BUDAPEST UNIVERSITY OF TECHNOLOGY AND ECONOMICS   (Hungary)

^b Hungarian Branch Office   (United States)

Author keywords

Cerebellar model articulation controller (CMAC); Generalization error; Kernel machines; Modeling; Neural networks; Regularization

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; COMPUTER SIMULATION; ERROR ANALYSIS; MATHEMATICAL MODELS; NEURAL NETWORKS;

CEREBELLAR MODEL ARTICULATION CONTROLLER (CMAC); GENERALIZATION ERROR; KERNEL MACHINES;

LEARNING SYSTEMS;

ARTICLE; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; BIOMIMETICS; CEREBELLUM; COMPARATIVE STUDY; COMPUTER SIMULATION; EVALUATION; FEEDBACK SYSTEM; LOCOMOTION; METHODOLOGY; MOTION; NERVE CELL NETWORK; PHYSIOLOGY; ROBOTICS;

ARTIFICIAL INTELLIGENCE; BIOMIMETICS; CEREBELLUM; COMPUTER SIMULATION; FEEDBACK; LOCOMOTION; MODELS, BIOLOGICAL; MOTION; NERVE NET; ROBOTICS;

EID: 33847681450     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2006.881295     Document Type: Article

References (50)

1. J. S. Albus, "A new approach to manipulator control: The cerebellar model articulation controller (CMAC)," Trans. ASME, vol. 97, no. 3, pp. 220-227, Sep. 1975.
2. J. S. Ker, Y. H. Kuo, and B. D. Liu, "Hardware realization of higher-order CMAC model for color calibration," in Proc. IEEE Int. Conf. Neural Netw., Perth, Australia, 1995, vol. 4, pp. 1656-1661.
3. J. S. Ker, Y. H. Kuo, R. C. Wen, and B. D. Liu, "Hardware implementation of CMAC neural network with reduced storage requirement," IEEE Trans. Neural Netw., vol. 8, no. 6, pp. 1545-1556, Nov. 1997.
4. T. W. Miller, III, F. H. Glanz, and L. G. Kraft, "CMAC: An associative neural network alternative to backpropagation," Proc. IEEE, vol. 78, no. 10, pp. 1561-1567, Oct. 1990.
5. P. C. Parks and J. Militzer, "Convergence properties of associative memory storage for learning control system," Autom. Remote Control, vol. 50, no. 2, pp. 254-286, 1989.
6. D. Ellison, "On the convergence of the multidimensional Albus perceptron," Int. J. Robot. Res., vol. 10, no. 4, pp. 338-357, Aug. 1991.
7. D. E. Thompson and S. Kwon, "Neighborhood sequential and random training techniques for CMAC," IEEE Trans. Neural Netw., vol. 6, no. 1, pp. 196-202, Jan. 1995.
8. M. Brown, C. J. Harris, and P. C. Parks, "The interpolation capabilities of the binary CMAC," Neural Netw., vol. 6, no. 3, pp. 429-440, 1993.
9. M. Brown and C. J. Harris, Neurofuzzy Adaptive Modeling and Control. New York: Prentice Hall, 1994.
10. S. H. Lane, D. A. Handelman, and J. J. Gelfand, "Theory and development of higher-order CMAC neural networks," IEEE Control Syst. Mag., vol. 12, no. 2, pp. 23-30, Apr. 1992.
11. C. T. Chiang and C. S. Lin, "Learning convergence of CMAC technique," IEEE Trans. Neural Netw., vol. 8, no. 6, pp. 1281-1292, Nov. 1996.
12. C. T. Chiang and C. S. Lin, "CMAC with general basis function," Neural Netw., vol. 9, no. 7, pp. 1199-1211, 1998.
13. F. J. Gonzalez-Serrano, A. R. Figueiras, and A. Artes-Rodriguez, "Generalizing CMAC architecture and training," IEEE Trans. Neural Netw., vol. 9, no. 6, pp. 1509-1514, Nov. 1998.
14. T. Szabó and G. Horváth, "CMAC and its extensions for efficient system modelling," Int. J. Appl. Math. Comput. Sci., vol. 9, no. 3, pp. 571-598, 1999.
15. T. Szabó and G. Horváth, "Improving the generalization capability of the binary CMAC," in Proc. Int. Joint Conf. Neural Networks, Como, Italy, 2000, vol. 3, pp. 85-90.
16. R. E. Crochiere and L. R. Rabiner, Multirate Digital Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1983.
17. L. Zhong, Z. Zhongming, and Z. Chongguang, "The unfavorable effects of hash coding on CMAC convergence and compensatory measure," in Proc. IEEE Int. Conf. Intell. Process. Syst., Beijing, China, 1997, pp. 419-422.
18. Z. Q. Wang, J. L. Schiano, and M. Ginsberg, "Hash coding in CMAC neural networks," in Proc. IEEE Int. Conf. Neural Netw., Washington, DC, 1996, vol. 3, pp. 1698-1703.
19. C. S. Lin and C. K. Li, "A new neural network structure composed of small CMACs," in Proc. IEEE Int. Conf. Neural Netw., Washington, DC, 1996, vol. 3, pp. 1777-1783.
20. C. S. Lin and C. K. Li, "A low-dimensional-CMAC-based neural network," in Proc. IEEE Int. Conf. Syst., Man and Cybern., 1996, vol. 2, pp. 1297-1302.
21. C. K. Li and C. S. Lin, "Neural networks with self-organized basis functions," in Proc. IEEE Int. Conf. Neural Netw., Anchorage, AK, 1998, vol. 2, pp. 1119-1224.
22. C. K. Li and C. T. Chiang, "Neural networks composed of single-variable CMACs," in Proc. IEEE Int. Conf. Syst., Man and Cybern., The Hague, The Netherlands, 2004, pp. 3482-3487.
23. H. M. Lee, C. M. Chen, and Y. F. Lu, "A self-organizing HCMAC neural-network classifier," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 15-27, Jan. 2003.
24. S. L. Hung and J. C. Jan, "MS_CMAC neural network learning model in structural engineering," J. Comput. Civ. Eng., vol. 13, no. 1, pp. 1-11, Jan. 1999.
25. J. C. Jan and S. L. Hung, "High-order MS_CMAC neural network," IEEE Trans. Neural Netw., vol. 12, no. 3, pp. 598-603, May 2001.
26. C.-M. Hong and D.-W. Wu, "An association memory mapped approach of CMAC neural networks using rational interpolation method for memory requirement reduction," in Proc. IASTED Int. Conf., Honolulu, HI, 2000, pp. 153-158.
27. J. S. Albus, "Data storage in the cerebellar model articulation controller," J. Dyn. Syst. Meas. Control, vol. 97, no. 3, pp. 228-233, Sep. 1975.
28. K. Zhang and F. Qian, "Fuzzy CMAC and its application," in Proc. 3rd World Congr. Intell. Control and Autom., Hefei, China, 2000, pp. 944-947.
29. H. R. Lai and C. C. Wong, "A fuzzy CMAC structure and learning method for function approximation," in Proc. 10th Int. Conf. Fuzzy Syst., Melbourne, Australia, 2001, vol. 1, pp. 436-439.
30. W. Shitong and L. Hongjun, "Fuzzy system and CMAC network with B-spline membership/basis functions can approximate a smooth function and its derivatives," Int. J. Comput. Intell. Appl., vol. 3, no. 3, pp. 265-279, 2003.
31. C. J. Lin, H. J. Chen, and C. Y. Lee, "A self-organizing recurrent fuzzy CMAC model for dynamic system identification," in Proc. IEEE Int. Conf. Fuzzy Syst., Budapest, Hungary, 2004, vol. 3, pp. 697-702.
32. J. Moody, "Fast learning in multi-resolution hierarchies," in Advances in Neural Information Processing Systems, vol. 1. San Mateo, CA: Morgan Kaufmann, 1989, pp. 29-39.
33. H. Kim and C. S. Lin, "Use of adaptive resolution for better CMAC learning," in Proc. Int. Joint Conf. Neural Netw., Baltimore, MD, 1992, vol. 1, pp. 517-522.
34. S. F. Su, T. Tao, and T. H. Hung, "Credit assigned CMAC and its application to online learning robot controllers," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 33, no. 2, pp. 202-213, Apr. 2003.
35. T. Qin and Z. Chen, "A learning algorithm of CMAC based on RLS," Neural Process. Lett., vol. 19, no. 1, pp. 49-61, Feb. 2004.
36. T. Qin, Z. Chen, H. Zhang, and W. Xiang, "Continuous CMAC-QRLS and its systolic array," Neural Process. Lett., vol. 22, no. 1, pp. 1-16, Aug. 2005.
37. S. Simons, "Analytical inversion of a particular type of banded matrix," J. Phys. A, Math. Gen., vol. 30, no. 2, pp. 755-763, Jan. 1997.
38. D. A. Lavis, B. W. Southern, and I. F. Wilde, "The inverse of a semi-infinite symmetric banded matrix," J. Phys. A, Math. Gen., vol. 30, no. 21, pp. 7229-7241, Oct. 1997.
39. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1995.
40. R. L. Smith, "Intelligent motion control with an artificial cerebellum," Ph.D. thesis, Univ. Auckland, Auckland, New Zealand, 1998.
41. J. Palotta and L. G. Kraft, "Two-dimensional function learning using CMAC neural network with optimized weight smoothing," in Proc. Amer. Control Conf., San Diego, CA, 1999, pp. 373-377.
42. C. de Boor, A Practical Guide to Splines, Revised Ed. New York: Springer-Verlag, 2001.
43. J. A. K. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, and J. Vandewalle, Least Squares Support Vector Machines. Singapore: World Scientific, 2002.
44. C. Saunders, A. Gammerman, and V. Vovk, "Ridge regression learning algorithm in dual variables. Machine learning," in Proc. 15th Int. Conf. Mach. Learn., 1998, pp. 515-521.
45. J. Valyon and G. Horváth, "A sparse least squares support vector machine classifier," in Proc. Int. Joint Conf. Neural Networks, 2004, pp. 543-548.
46. J. Valyon and G. Horváth, "A generalized LS-SVM," in Proc. SYSID, Rotterdam, The Netherlands, 2003, pp. 827-832.
47. G. Horváth and Z. Csipak, "FPGA implementation of the kernel CMAC," in Proc. Int. Joint Conf. Neural Networks, Budapest, Hungary, 2004, pp. 3143-3148.
48. G. Golub and C. V. Loan, Matrix Computations, 3rd ed. Baltimore, MD: John Hopkins Univ. Press, 1996.
49. P. Rózsa, private communication, Budapest Univ. of Technol. Econ., May 2000.
50. P. Rózsa, Linear Algebra and Its Applications. Budapest, Hungary: Tankönyvkiadó, (in Hungarian), 1997.