Generalized regression neural networks with multiple-bandwidth sharing and hybrid optimization

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 37, Issue 6, 2007, Pages 1434-1445

  Goulermas, John Y ^a   Zeng, Xiao Jun ^b   Liatsis, Panos ^c   Ralph, Jason F ^a  

^a UNIVERSITY OF LIVERPOOL   (United Kingdom)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

^c CITY UNIVERSITY   (United Kingdom)

Author keywords

Bandwidth reduction; Clustering; Function approximation; Generalized regression neural network (GRNN); Local and global optimization; Neural nets; Pattern clustering

Indexed keywords

BANDWIDTH; CLUSTERING ALGORITHMS; FUZZY CLUSTERING; GLOBAL OPTIMIZATION; NEWTON-RAPHSON METHOD; PRINCIPAL COMPONENT ANALYSIS; REGRESSION ANALYSIS;

GENERALIZED REGRESSION NEURAL NETWORK; HYBRID OPTIMIZATION; PATTERN CLUSTERING; QUASI-NEWTON METHOD;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; METHODOLOGY; REGRESSION ANALYSIS; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; REGRESSION ANALYSIS;

EID: 36749064922     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2007.904541     Document Type: Article

References (41)

1. T. Hastie, R. Tibshirani, and J. H. Friedman, The Elements of Statistical Learning. New York: Springer-Verlag, 2001.
2. S. Haykin, Neural Networks; A Comprehensive Foundation. Englewood Cliffs, NJ: Prentice-Hall, 1999.
3. H. R. Madala and A. G. Ivakhnenko, Inductive Learning Algorithms for Complex Systems Modelling. Boca Raton, FL: CRC, 1994.
4. S. Theodoridis and K. Koutroumbas, Pattern Recognition, 2nd ed. New York: Academic, 2003.
5. H. Schiøler and U. Hartmann, "Mapping neural network derived from the Parzen window estimator," Neural Netw., vol. 5, no. 6, pp. 903-909, Nov./Dec. 1993.
6. D. F. Specht, "A general regression neural network," IEEE Trans. Neural Netw., vol. 2, no. 6, pp. 568-576, Nov. 1991.
7. J. C. Fu, S. K. Lee, S. T. C. Wong, J. Y. Yeh, A. H. Wang, and H. K. Wu, "Image segmentation, feature selection, and pattern classification for mammographic micro classifications," Comput. Med. Imaging Graph., vol. 29, no. 6, pp. 419-429, Sep. 2005.
8. J. Y Goulermas, D. Howard, C. Nester, R. Jones, and L. Ren, "Regression techniques for the prediction of lower limb kinematics," J. Biomech. Eng., vol. 127, no. 6, pp. 1020-1024, Nov. 2005.
9. Z. Gu, M. X. Tang, and H. Frazer, "Capturing aesthetic intention during interactive evolution," Comput. -Aided Des., vol. 38, no. 3, pp. 224-237, Mar. 2006.
10. E. W. M. Lee, Y. Y. Lee, C. P. Limb, and C. Y. Tang, "Application of a noisy data classification technique to determine the occurrence of flashover in compartment fires," Adv. Eng. Inf., vol. 20, no. 2, pp. 213-222, Apr. 2006.
11. B. Kim, D. W. Lee, and K. H. Kwon, "Prediction of etch microtrenching using a neural network," J. Appl. Phys., vol. 96, no. 7, pp. 3612-3616, Oct. 2004.
12. I. Anagnostopoulos, C. Anagnostopoulos, G. Kouzas, and D. D. Vergados, "A generalised regression algorithm for web page categorisation," Neural Comput. Appl., vol. 13, no. 3, pp. 229-236, Sep. 2004.
13. S. G. Kulkarni, A. K. Chaudhary, S. Nandi, S. S. Tambe, and B. D. Kulkarni, "Modelling and monitoring of batch processes using principal component analysis assisted generalised regression neural networks," Biochem. Eng. J., vol. 18, no. 3, pp. 193-210, 2004.
14. T. Hoya, "Notions of intuition and attention modelled by a hierarchically arranged generalized regression neural network," IEEE Trans. Syst., Man, Cybern. B, Cybem., vol. 34, no. 1, pp. 200-209, Feb. 2004.
15. D. Tomandl and A. Schober, "A modified general regression neural network (MGRNN) with new, efficient training algorithms as a robust blackbox tool for data analysis," Neural Netw., vol. 14, no. 8, pp. 1023-1034, Oct. 2001.
16. T. L. Seng, M. Khalid, and R. Yusof, "Adaptive general regression neural network for modelling of dynamic plants," Proc. Inst. Mech. Eng. Part I- J. Syst. Control Eng., vol. 213, no. 14, pp. 275-287, 1999.
17. E. W. M. Lee, C. P. Lim, and S. M. Lo, "A hybrid neural network model for noisy data regression," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 2, pp. 951-960, Apr. 2004.
18. G. A. Babich and O. I. Camps, "Weighted Parzen windows for pattern classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 5, pp. 567-570, May 1996.
19. B. Tian, M. R. Azimi-Sadjaji, T. H. Vonder Haar, and D. Reinke, "Temporal updating scheme for probabilistic neural network with application to satellite cloud classification," IEEE Trans. Neural Netw., vol. 11, no. 4, pp. 903-919, Jul. 2000.
20. E. Parzen, "On estimation of a probability density function and mode," Ann. Math. Stat., vol. 33, no. 3, pp. 1065-1076, Sep. 1962.
21. T. Cacoullos, "Estimation of a multivariate density," Ann. Inst. Stat. Math., vol. 18, no. 2, pp. 179-189, 1966.
22. K. Fukunaga, Statistical Pattern Recognition, 2nd ed. New York: Academic, 1990.
23. L. Xu, A. Krzyzak, and A. Yuille, "On radial basis function nets and kernel regression: Statistical consistency, convergence rates, and receptive field size," Neural Netw., vol. 7, no. 4, pp. 609-628, 1994.
24. H. M. Kim and J. M. Mendel, "Fuzzy basis functions: Comparisons with other basis functions," IEEE Trans. Fuzzy Syst., vol. 3, no. 2, pp. 158-168, May 1995.
25. J. O. Ramsay and B. W. Silverman, Functional Data Analysis. New York: Springer-Verlag, 1997.
26. J. V. Hansen and R. D. Meservy, "Learning experiments with genetic optimization of a generalized regression neural network," Decis. Support Syst., vol. 18, no. 3/4, pp. 317-325, Nov. 1996.
27. S. Chen, X. Hong, C. J. Harris, and P. M. Sharkey, "Sparse modelling using orthogonal forward regression with PRESS statistic and regularization, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 2, pp. 898-911, Apr. 2004.
28. T. Masters and W. Land, "A new training algorithm for the general regression neural network," in Proc. IEEE Int. Conf. SMC - Computational Cybernetics Simulation, 1997, vol. 3, pp. 1990-1994.
29. S. S. Rao, Engineering Optimisation: Theory and Practice, 3rd ed. Hoboken, NJ: Wiley, 1996.
30. J. Nocedal and S. J. Wright, Numerical Optimisation. New York: Springer-Verlag, 1999.
31. J. Kennedy and R. C. Eberhart, "Particle swarm optimisation," in Proc. IEEE Int. Conf. Neural Netw., 1995, pp. 1942-1948.
32. R. C. Eberhart, P. Simpson, and R. Dobbins, Computational Intelligence PC Tools. New York: Academic, 1996.
33. Y. Shi and R. C. Eberhart, "A modified particle swarm optimiser," in Proc. IEEE Int. Conf. Evol. Comput., 1998, pp. 69-73.
34. S. He, Q. H. Wu, J. Y Wen, J. R. Saunders, and R. C. Paton, "Hybrid particle swarm optimiser with passive congregation," BioSystems, vol. 78, no.1-3, pp. 135-147, 2004.
35. F. van den Bergh and A. P. Engelbrecht, "A cooperative approach to particle swarm optimization," IEEE Trans. Evol. Comput., vol. 8, no. 3, pp. 225-239, Jun. 2004.
36. A. Ratnaweera, S. K. Halgamuge, and H. C. Watson, "Self-organising hierarchical particle swarm optimizer with time-varying acceleration coefficients," IEEE Trans. Evol. Comput., vol. 8, no. 3, pp. 240-255, Jun. 2004.
37. J. Y Goulermas, A. H. Findlow, C. J. Nester, D. Howard, and P. Bowker, "Automated design of robust discrimmant analysis classifier for foot pressure lesions using kinematic data," IEEE Trans. Biomed. Eng., vol. 52, no.9, pp. 1549-1562, Sep. 2005.
38. J. Carney and P. Cunningham, "Tuning diversity in bagged ensembles," Int. J. Neural Syst., vol. 10, no. 4, pp. 267-279, Aug. 2000.
39. I. T. Nabney, Netlab: Algorithms for Pattern Recognition. New York: Springer-Verlag, 2002. [Online].HAvailable: http://www.ncrg.aston. ac.uk/netlab
40. J. S. R. Jang, "ANFIS: Adaptive network-based fuzzy inference systems," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, May/Jun. 1993.
41. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.