Particle swarm optimization aided orthogonal forward regression for unified data modeling

IEEE Transactions on Evolutionary Computation

Volumn 14, Issue 4, 2010, Pages 477-499

  Chen, Sheng ^a   Hong, Xia ^b   Harris, Chris J ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b UNIVERSITY OF READING   (United Kingdom)

Author keywords

Classification; density estimation; evolutionary computation; leave one out cross validation; orthogonal forward regression; particle swarm optimization; radial basis function network; regression

Indexed keywords

CROSS VALIDATION; DENSITY ESTIMATION; EVOLUTIONARY COMPUTATIONS; FORWARD REGRESSION; LEAVE-ONE-OUT; ORTHOGONAL FORWARD REGRESSION;

ALGORITHMS; ATTITUDE CONTROL; COVARIANCE MATRIX; ESTIMATION; ORTHOGONAL FUNCTIONS; PARTICLE SWARM OPTIMIZATION (PSO); PROBABILITY DENSITY FUNCTION; REGRESSION ANALYSIS;

RADIAL BASIS FUNCTION NETWORKS;

EID: 77955419648     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2009.2035921     Document Type: Article

References (134)

1. G. E. P. Box and G. M. Jenkins, Time Series Analysis, Forecasting and Control. San Francisco, CA: Holden Day, 1976.
2. R. H. Myers, Classical and Modern Regression with Applications, 2nd ed. Boston, MA: PWS-Kent, 1990.
3. S. A. Billings and S. Chen, "The determination of multivariable nonlinear models for dynamic systems," in Neural Network Systems Techniques and Applications (Control and Dynamic Systems), vol.8, C. T. Leondes, Ed. San Diego, CA: Academic, 1998, pp. 231-278.
4. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
5. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1995.
6. B. D. Ripley, Pattern Recognition and Neural Networks. Cambridge, U.K.: Cambridge Univ. Press, 1996.
7. E. Parzen, "On estimation of a probability density function and mode," Ann. Mathematical Statistics, vol.33, no.3, pp. 1066-1076, 1962.
8. B. W. Silverman, Density Estimation for Statistics and Data Analysis. London, U.K.: Chapman & Hall, 1986.
9. A. W. Bowman and A. Azzalini, Applied Smoothing Techniques for Data Analysis. Oxford, U.K.: Oxford Univ. Press, 1997.
10. S. Chen, S. A. Billings, C. F. N. Cowan, and P. M. Grant, "Non-linear systems identification using radial basis functions," Int. J. Syst. Sci., vol.21, no.12, pp. 2513-2539, 1990.
11. J. A. Leonard and M. A. Kramer, "Radial basis function networks for classifying process faults," IEEE Control Syst. Mag., vol.11, no.3, pp. 31-38, Apr. 1991.
12. S. Chen, B. Mulgrew, and P. M. Grant, "A clustering technique for digital communications channel equalization using radial basis function networks," IEEE Trans. Neural Netw., vol.4, no.4, pp. 570-579, Jul. 1993.
13. A. Caiti and T. Parisini, "Mapping ocean sediments by RBF networks," IEEE J. Oceanic Eng., vol.19, no.4, pp. 577-582, Oct. 1994.
14. D. Gorinevsky, A. Kapitanovsky, and A. Goldenberg, "Radial basis function network architecture for nonholonomic motion planning and control of free-flying manipulators," IEEE Trans. Robot. Autom., vol.12, no.3, pp. 491-496, Jun. 1996.
15. I. Cha and S. A. Kassam, "RBFN restoration of nonlinearly degraded images," IEEE Trans. Image Process., vol.5, no.6, pp. 964-975, Jun. 1996.
16. M. Rosenblum and L. S. Davis, "An improved radial basis function network for visual autonomous road following," IEEE Trans. Neural Netw., vol.7, no.5, pp. 1111-1120, Sept. 1996.
17. J. A. Refaee, M. Mohandes, and H. Maghrabi, "Radial basis function networks for contingency analysis of bulk power systems," IEEE Trans. Power Syst., vol.14, no.2, pp. 772-778, May 1999.
18. S. Muraki, T. Nakai, Y. Kita, and K. Tsuda, "An attempt for coloring multichannel MR imaging data," IEEE Trans. Vis Comput. Graphics, vol.7, no.3, pp. 265-274, Jul.-Sep. 2001.
19. R. Mukai, V. A. Vilnrotter, P. Arabshahi, and V. Jamnejad, "Adaptive acquisition and tracking for deep space array feed antennas," IEEE Trans. Neural Netw., vol.13, no.5, pp. 1149-1162, Sep. 2002.
20. C.-T. Su, T. Yang, and C.-M. Ke, "A neural-network approach for semiconductor wafer post-sawing inspection," IEEE Trans. Semicond. Manuf., vol.15, no.2, pp. 260-266, May 2002.
21. ∞ controller design for aircraft auto-landing," IEEE Trans. Aerosp. Electron. Syst., vol.40, no.1, pp. 158-167, Jan. 2004.
22. M.-J. Lee and Y.-K. Choi, "An adaptive neurocontroller using RBFN for robot manipulators," IEEE Trans. Ind. Electron., vol.51, no.3, pp. 711-717, Jun. 2004.
23. S. X. Ng, M.-S. Yee, and L. Hanzo, "Coded modulation assisted radial basis function aided turbo equalization for dispersive Rayleigh-fading channels," IEEE Trans. Wireless Commun., vol.3, no.6, pp. 2198-2206, Nov. 2004.
24. Y.-J. Oyang, S.-C. Hwang, Y.-Y. Ou, C.-Y. Chen, and Z. W. Chen, "Data classification with radial basis function networks based on a novel kernel density estimation algorithm," IEEE Trans. Neural Netw., vol.16, no.1, pp. 225-236, Jan. 2005.
25. N. Acir, I. Oztura, M. Kuntalp, B. Baklan, and C. Guzelis, "Automatic detection of epileptiform events in EEG by a three-stage procedure based on artificial neural networks," IEEE Trans. Biomed. Eng., vol.52, no.1, pp. 30-40, Jan. 2005.
26. K. K. Tan, S. Zhao, and S. Huang, "Iterative reference adjustment for high-precision and repetitive motion control applications," IEEE Trans. Control Syst. Technol., vol.13, no.1, pp. 85-97, Jan. 2005.
27. S. Chen, C. F. N. Cowan, S. A. Billings, and P. M. Grant, "Parallel recursive prediction error algorithm for training layered neural networks," Int. J. Control, vol.51, no.6, pp. 1215-1228, 1990.
28. P. E. An, M. Brown, S. Chen, and C. J. Harris, "Comparative aspects of neural network algorithms for on-line modeling of dynamic processes," Proc. Inst. Mech. Eng., part I.\J. Syst. Control Eng., vol.207, pp. 223-241, 1993.
29. S. McLoone, M. D. Brown, G. Irwin, and A. Lightbody, "A hybrid linear/nonlinear training algorithm for feedforward neural networks," IEEE Trans. Neural Netw., vol.9, no.4, pp. 669-684, Jul. 1998.
30. N. B. Karayiannis and M. M. Randolph-Gips, "On the construction and training of reformulated radial basis function neural networks," IEEE Trans. Neural Netw., vol.14, no.4, pp. 835-846, Jul. 2003.
31. H. Peng, T. Ozaki, V. Haggan-Ozaki, and Y. Toyoda, "A parameter optimization method for radial basis function type models," IEEE Trans. Neural Netw., vol.14, no.4, pp. 432-438, Mar. 2003.
32. Z. R. Yang and S. Chen, "Robust maximum likelihood training of heteroscedastic probabilistic neural networks," Neural Netw., vol.11, pp. 739-747, Jun. 1998.
33. M.-W. Mak and S.-Y. Kung, "Estimation of elliptical basis function parameters by the EM algorithm with application to speaker verification," IEEE Trans. Neural Netw., vol.11, no.4, pp. 961-969, Jul. 2000.
34. B. A. Whitehead and T. D. Choate, "Evolving space-filling curves to distribute radial basis functions over an input space," IEEE Trans. Neural Netw., vol.5, no.1, pp. 15-23, Jan. 1994.
35. B. A. Whitehead, "Genetic evolution of radial basis function coverage using orthogonal niches," IEEE Trans. Neural Netw., vol.7, no.6, pp. 1525-1528, Nov. 1996.
36. J. Gonzalez, I. Rojas, J. Ortega, H. Pomares, F. J. Fernandez, and A. F. Diaz, "Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation," IEEE Trans. Neural Netw., vol.14, no.6, pp. 1478-1495, Nov. 2003.
37. H.-M. Feng, "Self-generation RBFNs using evolutional PSO learning," Neurocomputing, vol.70, pp. 241-251, Dec. 2006.
38. F. A. Guerra and L. S. Coelho, "Multi-step ahead nonlinear identification of Lorenz's chaotic system using radial basis function neural network with learning by clustering and particle swarm optimization," Chaos, Solitons Fractals, vol.35, pp. 967-979, Mar. 2008.
39. J. Moody and C. J. Darken, "Fast learning in networks of locally-tuned processing units," Neural Comput., vol.1, no.2, pp. 281-294, 1989.
40. S. Chen, S. A. Billings, and P. M. Grant, "Recursive hybrid algorithm for non-linear system identification using radial basis function networks," Int. J. Control, vol.55, no.5, pp. 1051-1070, 1992.
41. S. Chen, "Nonlinear time series modeling and prediction using Gaussian RBF networks with enhanced clustering and RLS learning," Electron. Lett., vol.31, no.2, pp. 117-118, 1995.
42. Z. Uykan, "Clustering-based algorithms for single-hidden-layer sig-moid perceptron," IEEE Trans. Neural Netw., vol.14, no.3, pp. 708-715, May 2003.
43. D. Shi, D. S. Yeung, and J. Gao, "Sensitivity analysis applied to the construction of radial basis function networks," Neural Netw., vol.18, pp. 951-957, Sep. 2005.
44. S. Chen, S. A. Billings, and W. Luo, "Orthogonal least squares methods and their application to non-linear system identification," Int. J. Control, vol.50, no.5, pp. 1873-1896, 1989.
45. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks," IEEE Trans. Neural Netw., vol.2, no.2, pp. 302-309, Mar. 1991.
46. S. Chen, Y. Wu, and B. L. Luk, "Combined genetic algorithm optimization and regularised orthogonal least squares learning for radial basis function networks," IEEE Trans. Neural Netw., vol.10, no.5, pp. 1239-1243, Sep. 1999.
47. S. Chen, X. Hong, and C. J. Harris, "Sparse kernel regression modeling using combined locally regularized orthogonal least squares and D-optimality experimental design," IEEE Trans. Automat. Control, vol.48, no.6, pp. 1029-1036, Jun. 2003.
48. S. Chen, X. Hong, C. J. Harris, and P. M. Sharkey, "Sparse modeling using orthogonal forward regression with PRESS statistic and regular-ization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.34, no.2, pp. 898-911, Apr. 2004.
49. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
50. S. Gunn, "Support vector machines for classification and regression," School Electron. Comput. Sci., Univ. Southampton, Southampton, U.K., Tech. Rep., May 1998.
51. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," Soc. Ind. Appl. Math. Rev., vol.43, no.1, pp. 129-159, 2001.
52. M. E. Tipping, "Sparse Bayesian learning and the relevance vector machine," J. Mach. Learning Res., vol.1, pp. 211-244, Jun. 2001.
53. B. Schölkopf and A. J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA: MIT Press, 2002.
54. P. Vincent and Y. Bengio, "Kernel matching pursuit," Mach. Learning, vol.48, nos. 1-3, pp. 165-187, 2002.
55. G. R. G. Lanckriet, N. Cristianini, P. Bartlett, L. E. Ghaoui, and M. I. Jordan, "Learning the kernel matrix with semidefinite programming," J. Mach. Learning Res., vol.5, pp. 27-72, Dec. 2004.
56. F. Schwenker, H. A. Kestler, and G. Palm, "Three learning phases for radial-basis-function networks," Neural Netw., vol.14, pp. 439-458, May 2001.
57. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," Data Mining Knowl. Discovery, vol.2, no.2, pp. 121-167, 1998.
58. A. J. Smola and B. Schölkopf, "A tutorial on support vector regression," Royal-Holloway College, Univ. London, London, U.K., Tech. Rep. TR-98-1030, 1998.
59. J. Weston, A. Gammerman, M. O. Stitson, V. Vapnik, V. Vovk, and C. Watkins, "Support vector density estimation," in Advances in Kernel Methods\Support Vector Learning, B. Schölkopf, C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 293-306.
60. S. Mukherjee and V. Vapnik, "Support vector method for multivariate density estimation," MIT AI Lab., Cambridge, MA, Tech. Rep. A.I. Memo 1653, 1999.
61. V. Vapnik and S. Mukherjee, "Support vector method for multivariate density estimation," in Advances in Neural Information Processing Systems, S. Solla, T. Leen, and K. R. Müller, Eds. Cambridge, MA: MIT Press, 2000, pp. 659-665.
62. M. Girolami and C. He, "Probability density estimation from optimally condensed data samples," IEEE Trans. Pattern Anal. Mach. Intell., vol.25, no.10, pp. 1253-1264, Oct. 2003.
63. X. Hong, S. Chen, and C. J. Harris, "A fast linear-in-the-parameters classifier construction algorithm using orthogonal forward selection to minimize leave-one-out misclassification rate," Int. J. Syst. Sci., vol.39, no.2, pp. 119-125, 2008.
64. S. Chen, X. Hong, and C. J. Harris, "An orthogonal forward regression technique for sparse kernel density estimation," Neurocomputing, vol.71, pp. 931-943, Jan. 2008.
65. F. Sha, L. K. Saul, and D. D. Lee, "Multiplicative updates for nonnegative quadratic programming in support vector machines," Univ. Pennsylvania, Philadelphia, Tech. Rep. MS-CIS-02-19, 2002.
66. S. Chen, X. Hong, C. J. Harris, and X. X. Wang, "Identification of nonlinear systems using generalized kernel models," IEEE Trans. Control Syst. Technol., vol.13, no.3, pp. 401-411, May 2005.
67. S. Chen, X. X. Wang, and C. J. Harris, "Experiments with repeating weighted boosting search for optimization in signal processing applications," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.35, no.4, pp. 682-693, Aug. 2005.
68. S. Chen, X. Hong, and C. J. Harris, "Orthogonal forward selection for constructing the radial basis function network with tunable nodes," in Proc. Int. Conf. Intell. Comput., Hefei, China, Aug. 23-26, 2005, pp. 777-786.
69. S. Chen, X. Hong, and C. J. Harris, "Construction of RBF classifiers with tunable units using orthogonal forward selection based on leave-one-out misclassification rate," in Proc. Int. Joint Conf. Neural Netw., Vancouver, B.C., Canada, Jul. 16-21, 2006, pp. 6390-6394.
70. J. Kennedy and R. Eberhart, "Particle swarm optimization," in Proc. IEEE Int. Conf. Neural Netw., vol.4. Perth, Australia, Nov. 27-Dec. 1, 1995, pp. 6390-6394.
71. J. Kennedy, and R. C. Eberhart, Swarm Intelligence. San Mateo, CA: Morgan Kaufmann, 2001.
72. D. W. van der Merwe and A. P. Engelbrecht, "Data clustering using particle swarm optimization," in Proc. Congr. Evol. Comput., Canberra, Australia, Dec. 8-12, 2003, pp. 215-220.
73. A. Ratnaweera, S. K. Halgamuge, and H. C. Watson, "Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients," IEEE Trans. Evol. Comput., vol.8, no.3, pp. 240-255, Jun. 2004.
74. M. G. H. Omran, "Particle swarm optimization methods for pattern recognition and image processing," Ph.D. dissertation, Dept. Comput. Sci., Univ. Pretoria, Pretoria, South Africa, 2005.
75. S. M. Guru, S. K. Halgamuge, and S. Fernando, "Particle swarm optimisers for cluster formation in wireless sensor networks," in Proc. Int. Conf. Intell. Sensors, Sensor Netw. Inform. Process., Melbourne, Australia, Dec. 5-8, 2005, pp. 319-324.
76. K. W. Chau, "Particle swarm optimization training algorithm for ANNs in stage prediction of Shing Mun River," J. Hydrol., vol.329, pp. 363-367, Oct. 2006.
77. K. K. Soo, Y. M. Siu, W. S. Chan, L. Yang, and R. S. Chen, "Particle-swarm-optimization-based multiuser detector for CDMA communications," IEEE Trans. Veh. Technol., vol.56, no.5, pp. 3006-3013, Sep. 2007.
78. J.-R. Zhang, J. Zhang, T.-M. Lok, and M. R. Lyu, "A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training," Appl. Math. Comput., vol.185, pp. 1026-1037, Feb. 2007.
79. T.-Y. Sun, C.-C. Liu, T.-Y. Tsai, and S.-T. Hsieh, "Adequate determination of a band of wavelet threshold for noise cancellation using particle swarm optimization," in Proc. Congr. Evol. Comput., Hong Kong, Jun. 2008, pp. 1168-1175.
80. J. Y. Chen, Z. Qin, and J. Jia, "A PSO-based subtractive clustering technique for designing RBF neural networks," in Proc. Congr. Evol. Comput., Hong Kong, Jun. 2008, pp. 2047-2052.
81. A. A. Cardi, H. A. Firpi, M. T. Bement, and S. Y. Liang, "Workpiece dynamic analysis and prediction during chatter of turning process," Mech. Syst. Signal Process., vol.22, pp. 1481-1494, Aug. 2008.
82. H.-W. Ge, F. Qian, Y.-C. Liang, W.-L. Du, and L. Wang, "Identification and control of nonlinear systems by a dissimilation particle swarm optimization-based Elman neural network," Nonlinear Anal.: Real World Applicat., vol.9, pp. 1345-1360, Sep. 2008.
83. H. Liu and J. Li, "A particle swarm optimization-based multiuser detection for receive-diversity-aided STBC systems," IEEE Signal Process. Lett., vol.15, pp. 29-32, 2008.
84. W.-F. Leong and G. G. Yen, "PSO-based multiobjective optimization with dynamic population size and adaptive local archives," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.38, no.5, pp. 1270-1293, Oct. 2008.
85. C.-J. Lin, C.-H. Chen, and C.-T. Lin, "A hybrid of cooperative particle swarm optimization and cultural algorithm for neural fuzzy networks and its prediction applications," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol.39, no.1, pp. 55-68, Jan. 2009.
86. Z.-H. Zhan, J. Zhang, Y. Li, and H. S.-H. Chung, "Adaptive particle swarm optimization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.39, no.6, pp. 1362-1381, Dec. 2009.
87. V. S. Pappala, I. Erlich, K. Rohrig, and J. Dobschinski, "A stochastic model for the optimal operation of a wind-thermal power system," IEEE Trans. Power Syst., vol.24, no.2, pp. 940-950, May 2009.
88. K. V. Deligkaris, Z. D. Zaharis, D. G. Kampitaki, S. K. Goudos, I. T. Rekanos, and M. N. Spasos, "Thinned planar array design using Boolean PSO with velocity mutation," IEEE Trans. Magnet., vol.45, no.3, pp. 1490-1493, Mar. 2009.
89. B. Biswal, P. K. Dash, and B. K. Panigrahi, "Power quality disturbance classification using fuzzy C-means algorithm and adaptive particle swarm optimization," IEEE Trans. Ind. Electron., vol.56, no.1, pp. 212-220, Jan. 2009.
90. H. Wu, J. Geng, R. Lin, J. Qiu, W. Liu, J. Chen, and S. Liu, "An improved comprehensive learning particle swarm optimization and its application to the semiautomatic design of antennas," IEEE Trans. Antennas and Propagation, vol.57, pp. 3018-3028, Oct. 2009.
91. M. T. Hagh, H. Taghizadeh, and K. Razi, "Harmonic minimization in multilevel inverters using modified species-based particle swarm optimization," IEEE Trans. Power Electron., vol.24, no.10, pp. 2259-2267, Oct. 2009.
92. M. R. AlRashidi and M. E. El-Hawary, "A survey of particle swarm optimization applications in electric power systems," IEEE Trans. Evolutionary Computat., vol.13, pp. 913-918, Aug. 2009.
93. F.-J. Lin, S.-Y. Chen, L.-T. Teng, and H. Chu, "Recurrent functional-link-based fuzzy neural network controller with improved particle swarm optimization for a linear synchronous motor drive," IEEE Trans. Magnetics, vol.45, no.8, pp. 3151-3165, Aug. 2009.
94. M. Pedrasa, T. D. Spooner, and I. F. MacGill, "Scheduling of demand side resources using binary particle swarm optimization," IEEE Trans. Power Syst., vol.24, pp. 1173-1181, Aug. 2009.
95. N. He, D.-G. Xu, and L. Huang, "The application of particle swarm optimization to passive and hybrid active power filter design," IEEE Trans. Ind. Electron., vol.56, no.8, pp. 2841-2851, Aug. 2009.
96. Y.-X. Liao, J.-H. She, and M. Wu, "Integrated hybrid-PSO and fuzzy-NN decoupling control for temperature of reheating furnace," IEEE Trans. Ind. Electron., vol.56, no.7, pp. 2704-2714, Jul. 2009.
97. P. Demarcke, H. Rogier, R. Goossens, and P. De Jaeger, "Beamforming in the presence of mutual coupling based on constrained particle swarm optimization," IEEE Trans. Antennas Propag., vol.57, no.6, pp. 1655-1666, Jun. 2009.
98. N. C. Chauhan, M. V. Kartikeyan, and A. Mittal, "CAD of RF windows using multiobjective particle swarm optimization," IEEE Trans. Plasma Sci., vol.37, no.6, pp. 1104-1109, Jun. 2009.
99. G. G. Yen and W. F. Leong, "Dynamic multiple swarms in multiob-jective particle swarm optimization," IEEE Trans. Syst., Man, Cybern. A, Syst. Humans, vol.39, pp. 890-911, Jul. 2009.
100. F.-J. Lin, L.-T. Teng, J.-W. Lin, and S.-Y. Chen, "Recurrent functional-link-based fuzzy-neural-network-controlled induction-generator system using improved particle swarm optimization," IEEE Trans. Ind. Electron., vol.56, no.5, pp. 1557-1577, May 2009.
101. M. Ramezani, M.-R. Haghifam, C. Singh, H. Seifi, and M. P. Moghaddam, "Determination of capacity benefit margin in multiarea power systems using particle swarm optimization," IEEE Trans Power Systems, vol.24, no.2, pp. 631-641, May 2009.
102. H. R. Marateb and K. C. McGill, "Resolving superimposed MUAPs using particle swarm optimization," IEEE Trans. Biomed. Eng., vol.56, no.3, pp. 916-919, Mar. 2009.
103. H.-L. Wei, S. A. Billings, Y.-F. Zhao, and L.-Z. Guo, "Lattice dynamical wavelet neural networks implemented using particle swarm optimization for spatio-temporal system identification," IEEE Trans. Neural Netw., vol.20, no.1, pp. 181-185, Jan. 2009.
104. K. D. Sharma, A. Chatterjee, and A. Rakshit, "A hybrid approach for design of stable adaptive fuzzy controllers employing Lyapunov theory and particle swarm optimization," IEEE Trans. Fuzzy Syst., vol.17, no.2, pp. 329-342, Apr. 2009.
105. S. K. Goudos, Z. D. Zaharis, D. G. Kampitaki, I. T. Rekanos, and C. S. Hilas, "Pareto optimal design of dual-band base station antenna arrays using multiobjective particle swarm optimization with fitness sharing," IEEE Trans. Magnetics, vol.45, no.3, pp. 1522-1525, Mar. 2009.
106. L.-F. Wang and C. Singh, "Multicriteria design of hybrid power generation systems based on a modified particle swarm optimization algorithm," IEEE Trans. Energy Conversion, vol.24, no.1, pp. 163-172, Mar. 2009.
107. K. Zielinski, P. Weitkemper, R. Laur, and K.-D. Kammeyer, "Optimization of power allocation for interference cancellation with particle swarm optimization," IEEE Trans. Evol. Comput., vol.13, no.1, pp. 128-150, Feb. 2009.
108. R. Saeidi, H. R. S. Mohammadi, T. Ganchev, and R. D. Rodman, "Particle swarm optimization for sorted adapted Gaussian mixture models," IEEE Trans. Audio Speech Language Process., vol.17, no.2, pp. 344-353, Feb. 2009.
109. N. M. Kwok, Q. P. Ha, D.-K. Liu, and G. Fang, "Contrast enhancement and intensity preservation for gray-level images using multiobjective particle swarm optimization," IEEE Trans. Autom. Sci. Eng., vol.6, no.1, pp. 145-155, Jan. 2009.
110. S. Maheswararajah, S. K. Halgamuge, and M. Premaratne, "Sensor scheduling for target tracking by suboptimal algorithms," IEEE Trans. Vehicular Technol., vol.58, no.3, pp. 1467-1479, Mar. 2009.
111. M. A. Montes de Oca, T. Stützle, M. Birattari, and M. Dorigo, "Frankenstein's PSO: A composite particle swarm optimization algorithm," IEEE Trans. Evol. Comput., vol.13, no.5, pp. 1120-1132, Oct. 2009.
112. W. Qiao, G. K. Venayagamoorthy, and R. G. Harley, "Missing-sensor- fault-tolerant control for SSSC FACTS device with real-time implementation, " IEEE Trans. Power Delivery, vol.24, no.2, pp. 740-750, Apr. 2009.
113. T. Ince, S. Kiranyaz, and M. Gabbouj, "A generic and robust system for automated patient-specific classification of ECG signals," IEEE Trans. Biomed. Eng., vol.56, no.5, pp. 1415-1426, May 2009.
114. S. Kwak, S. Lee, S. Lee, W.-S. Kim, J.-K. Lee, C. Park, J. Bae, J.-B. Song, H. Lee, K. Choi, K. Seong, H. Jung, and S.-Y. Hahn, "Design of HTS magnets for a 2.5 MJ SMES," IEEE Trans. Appl. Superconductivity, vol.19, no.3, pp. 1985-1988, Jun. 2009.
115. S. Y. Kim, N. H. Myung, and M. J. Kang, "Antenna mask design for SAR performance optimization," IEEE Geosci. Remote Sensing Lett., vol.6, pp. 443-447, Jul. 2009.
116. S. Das, A. Abraham, U. K. Chakraborty, and A. Konar, "Differential evolution using a neighborhood-based mutation operator," IEEE Trans. Evol. Comput., vol.13, no.3, pp. 526-553, Jun. 2009.
117. M. Donelli, D. Franceschini, P. Rocca, and A. Massa, "Three- dimensional microwave imaging problems solved through an efficient multiscaling particle swarm optimization," IEEE Trans. Geosci. Remote Sensing, vol.47, no.5, pp. 1467-1481, May 2009.
118. M. Stone, "Cross validation choice and assessment of statistical predictions," J. Roy. Statist. Soc. Ser. B, vol.36, no.2, pp. 111-147, 1974.
119. X. Hong, P. M. Sharkey, and K. Warwick, "Automatic nonlinear predictive model construction algorithm using forward regression and the PRESS statistic," IEE Proc. Control Theory Applicat., vol.150, no.3, pp. 245-254, May 2003.
120. S. Chen and J. Wigger, "Fast orthogonal least squares algorithm for efficient subset model selection," IEEE Trans. Signal Process., vol.43, pp. 1713-1715, Jul. 1995.
121. D. E. Goldberg, Genetic Algorithms in Search, Optimization and Mach. Learning. Reading, MA: Addison-Wesley, 1989.
122. K. F. Man, K. S. Tang, and S. Kwong, Genetic Algorithms: Concepts and Design. London, U.K.: Springer-Verlag, 1998.
123. L. Ingber, "Simulated annealing: Practice versus theory," Math. Com-put. Modeling, vol.18, no.11, pp. 29-57, 1993.
124. S. Chen and B. L. Luk, "Adaptive simulated annealing for optimization in signal processing applications," Signal Process., vol.79, no.1, pp. 117-128, Nov. 1999.
125. S. A. Billings, S. Chen, and R. J. Backhouse, "The identification of linear and non-linear models of a turbocharged automotive diesel engine," Mech. Syst. Signal Process., vol.3, no.2, pp. 123-142, 1989.
126. S. A. Billings and W. S. F. Voon, "A prediction-error and stepwise-regression estimation algorithm for non-linear systems," Int. J. Control, vol.44, no.3, pp. 803-822, 1986.
127. A. Asuncion and D. J. Newman, UCI Mach. Learning Repository [Online]. Available: http://www.ics.uci.edu/∼mlearn/MLRepository.html
128. G. Rätsch, T. Onoda, and K. R. Müller, Data Sets in [Online]. Available: http://ida.first.fhg.de/projects/bench/benchmarks.htm
129. G. Rätsch, T. Onoda, and K. R. Müller, "Soft margins for AdaBoost," Mach. Learning, vol.42, no.3, pp. 287-320, Mar. 2001.
130. A. Choudhury, "Fast machine learning algorithms for large data," Ph.D. dissertation, School Eng. Sci., Univ. Southampton, Southampton, U.K., 2002.
131. S. Chen, X. Hong, and C. J. Harris, "Sparse kernel density construction using orthogonal forward regression with leave-one-out test score and local regularization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.34, no.4, pp. 1708-1717, Aug. 2004.
132. G. McLachlan and D. Peel, Finite Mixture Models. New York: Wiley, 2000.
133. J. A. Bilmes, "A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models," Univ. Berkeley, Berkeley, CA, Tech. Rep. ICSI-TR-97-1021, 1997.
134. B. Efron and R. J. Tibshirani, An Introduction to Bootstrap. London: Chapman and Hall, 1993.