Towards crafting a smooth and accurate functional link artificial neural networks based on differential evolution and feature selection for noisy database

International Journal of Computational Intelligence Systems

Volumn 8, Issue 3, 2015, Pages 539-552

  Dash, Ch Sanjeev Kumar ^a   Dehuri, Satchidananda ^b   Cho, Sung Bae ^c   Wang, Gi Nam ^b  

^a SILICON INSTITUTE OF TECHNOLOGY   (India)

^b Ajou University   (South Korea)

^c Yonsei University   (South Korea)

Author keywords

Classification; Differential evolution; Feature selection; Functional link artificial neural network

Indexed keywords

DATABASE SYSTEMS; EVOLUTIONARY ALGORITHMS; FEATURE EXTRACTION; INFORMATION FILTERING; NEURAL NETWORKS; OPTIMIZATION;

CLASSIFICATION ACCURACY; DIFFERENTIAL EVOLUTION; FUNCTIONAL EXPANSION; FUNCTIONAL LINK ARTIFICIAL NEURAL NETWORKS; HIGHER DIMENSIONAL FEATURES; INFORMATION GAIN; TRIGONOMETRIC FUNCTIONS; UNIVERSITY OF CALIFORNIA;

CLASSIFICATION (OF INFORMATION);

EID: 84983751492     PISSN: 18756891     EISSN: 18756883     Source Type: Journal    
DOI: 10.1080/18756891.2015.1036221     Document Type: Article

References (70)

1. H. Xiong, G. Pandey, M. Steinbach and V. Kumar, Enhancing Data Analysis with Noise Removal, IEEE Transactions on Knowledge and Data Engineering,(2006),18(3),304-319.
2. S. Verbaeten and A. Van Assche, Ensemble Methods for Noise Elimination in Classification Problems, Multiple Classifier Systems,(2003), 317-325.
3. D. Gamberger, N. Lavrac, and S. Dzeroski, Noise Detection and Elimination in Data Preprocessing: Experiments in Medical Domains, Applied Artificial Intelligence,(2000), 14(2), 205-223.
4. L. Daza, and E. Acuna, An Algorithm for Detecting Noise on Supervised Classification, in Proceedings of WCECS-07, the 1st World Conference on Engineering and Computer Science,(2007), pp. 701-706.
5. X. Zhu, X. Wu and Q. Chen, Eliminating Class Noise in Large Datasets, in ICML, (2003), vol. 3, pp. 920-927.
6. X. Zhu, X. Wu, and Q. Chen, Bridging Local and Global Data Cleansing: Identifying Class Noise in Large, Distributed Data Datasets, Data mining and Knowledge Discovery,(2006), 12(2-3), 275-308.
7. H. Xiong, G. Pandey, M. Steinbach and V. Kumar, Enhancing Data Analysis with Noise Removal“. IEEE Transactions on Knowledge and Data Engineering, (2006), 18(3), 304-319.
8. I-A. Abu-Mahfouz, A Comparative Study of Three Artificial Neural Networks for the Detection and Classification of Gear Faults, International Journal of General Systems,(2005), 34(3), 261-277.
9. S. Aruna, L. V. Nandakishore and S.P. Rajagopalan,. (2012), Hybrid Feature Selection Method based on IGSBFS and Naive Bayes for the Diagnosis of Erythemato-Squamous A Diseases, International Journal of Computer Applications, (2012), 41(7).
10. R. Battiti, Using Mutual Information for Selecting Features in Supervised Neural Network Learning, IEEE Transactions Neural Networks, (1994), 5(4), 537-549.
11. D.R. Carvalho and A. A. Freitas, A Hybrid Decision Tree/Genetic Algorithm Method for Data Mining, Information Sciences,(2004), 163(1-3),13-35.
12. CLP. Chen et al., An Incremental Adaptive Implementation of Functional Link Processing for Function Approximation, Time Series Prediction, and System Identification, Neurocomputing, (1998), 18(1), 11-31.
13. M. Das, R. Roy, S. Dehuri, and S.-B. Cho., A New Approach to Associative Classification Based on Binary Multi-objective Particle Swarm Optimization, International Journal of Applied Meta-heuristic Computing, (2011), 2(2), 51-73.
14. S. Das and P. N. Suganthan, Differential Evolution: A Survey of the State-of-the-Art, IEEE Transactions on Evolutionary Computation,(2011), 15(1), 4-31.
15. P. K. Dash, A. C. Liew and H. P. Satpathy, A Functional Link Neural Network for Short Term Electric Load Forecasting, Journal of Intelligent and Fuzzy Systems, (1999),7(3),209-221.
16. P.K Dash, H. P. Satpathy, A.C. Liew, and S. Rahman, A Real-Time Short-Term Load Forecasting System using Functional Link Network, IEEE Transactions on Power Systems, (1997),12(2), 675-680.
17. C. S. K. Dash, A. Behera, S. Dehuri, and S.-B. Cho Differential Evolution Based Optimization of Kernel Parameters in Radial Basis Function Networks for Classification, International Journal of Applied Evolutionary Computation, (2013), 4(1), 56-80.
18. S. Dehuri, B.B. Mishra, and S.-B. Cho, Genetic Feature Selection for Optimal Functional Link Neural Network in Classification, in: Fyfe C et al (eds) IDEAL, LNCS 5326, (2008), pp.156-163.
19. S. Dehuri, and S.-B. Cho, A Comprehensive Survey on Functional Link Neural Networks and an adaptive PSO--BP learning for CFLNN, Neural Computing and Applications, (2009), 19(2),187-205.
20. S. Dehuri, and S.-B. Cho, Evolutionary Optimized Features in Functional Link Neural Networks for Classification, Expert Systems with Applications, (2010), 37(6), 4379-4391.
21. S. Dehuri, R. Roy, S.-B. Cho and A. Ghosh, An Improved Swarm Optimized Functional Link Artificial Neural Network (ISO-FLANN) for Classification, The Journal of Systems and Software, (2012), 85(6), 1333-1345.
22. J. Derrac, S. Garcia, and F. Herrera, A Survey on Evolutionary Instance Selection and Generation, International Journal of Applied Meta-heuristic Computing, (2010). 1(1), 60-92.
23. S. Forerest, Genetic Algorithms: Principles of Natural Selection Applied to Computation, Science, (1993), 261, 872-888.
24. A. Frank, and A. Asuncion, UCI Machine Learning Repository (http://archive.ics.uci.edu/ml), Irvine, CA: University of California, School of Information and Computer Science, (2010).
25. D. E. Goldberg, Genetic Algorithm in Search Optimization and Machine Learning, Addison-Wesley: Reading: MA, (1989).
26. B. Haring, JN. Kok, Finding Functional Links for Neural Networks by Evolutionary Computation, in: Van de Merckt T et al (eds) BENELEARN1995, proceedings of the fifth Belgian-Dutch conference on machine learning, Brussels, Belgium, (1995), pp.71-78
27. S. Haring, N. K. Joost, and C. V. W. Michiel, Feature Selection for Neural Networks Through Functional Links Found by evolutionary Computation, Advances in Intelligent Data Analysis Reasoning about Data. LNCS 1280,(1997), pp.199-210.
28. S. Haykin, Neural Networks: A Comprehensive Foundation, Upper Saddle River, NJ: Prentice tfall,(1994).
29. X. He, Q. Zhang, N. Sun, and Y. Dong, Feature Selection with Discrete Binary Differential Evolution. International Conference on Artificial Intelligence and Computational Intelligence, AICI'09, (2009), vol.4, pp.327-330.
30. Y-C. Hu, Functional Link Nets with Genetic Algorithm Based Learning for Robust Non-Linear Interval Regression Analysis, Neurocomputing. (2008),doi:10.1016/J.neucom.2008.07.002.
31. Y-C. Hu and F-M. Tseng, Functional-Link Net with Fuzzy Integral for Bankruptcy Prediction, Neurocomputing, (2007), 70(16),2959-2968.
32. A. Hussain, J. J. Soraghan, and T. S. Durrani, A New Adaptive Functional Link Neural Network Based DFE for Overcoming Co-Channel Interference, IEEE Tranactions on Communication, (1997), 45(11), 1358-1362.
33. A. G. Karegowda, A. S. Manjunath, and M. A. Jayaram, Comparative Study of Attribute Selection Using Gain Ratio and Correlation Based Feature Selection International Journal of Information Technology and Knowledge Management, (2010), 2(2),271-277.
34. R. N. Khusba, A. Ahmed, A. Adel, and et al., Feature Subset Selection Using Differential Evolution, in Proceedings of 15th International conference on Advances in Neuro-Information Processing, Springer-Verlag, Berlin, Heidelberg, part-I, (2008), pp.103-110,.
35. R. Khushaba, A. Al-Ani, A. AlSukker, and A. Al-Jumaily, A Combined Ant Colony and Differential Evolution Feature Selection Algorithm, Ant Colony Optimization and Swarm Intelligence, (2008), pp.1-12.
36. R. Khushaba, A. Al-Ani, and A. Al-Jumaily, Feature Subset Selection using Differential Evolution and a Statistical Repair Mechanism, Expert Systems with Applications, (2011), 38(9), 11511-11526.
37. MS. Klasser, YH. Pao. Characteristics of the Functional Link Net: A Higher Order Delta Rule Net, IEEE Proceedings of 2nd Annual International Conference on Neural Networks, San Diago, CA, (1988), pp.507-513
38. D. Krishnaiah, D. R. Prasad, A. Bono, P. M. Pandiyan, and R. Sarbatly, Application of Ultrasonic Waves Coupled with Functional Link Neural Network for Estimation of carrageenan Concentration, International Journal of Physical Sciences, (2008), 3(4),90-96.
39. H. Liu, and H. Motoda, On Issues of Instance Selection, Data Mining and Knowledge Discovery, (2002),vol.6, pp.115-130.
40. B. Majhi, and S. Hasan, An Improved Scheme for Digital Watermarking using Functional Link Artificial Neural Network, Journal of Computer Science, (2005), 1(2), 169-174.
41. T. Marcu, B. Koppen-Seliger, Dynamic Functional Link Neural Networks Genetically Evolved Applied to System Identification, in: Proceedings of ESANN’2004, Bruges (Belgium), (2004), pp. 115-120.
42. Z. Michalewicz, Genetic Algorithm + Data structure = Evolution Programs, Springer Verlag, New York, (1998).
43. B. B. Misra, S. Dehuri, Functional Link Neural Network for Classification Task in Data mining, J Comput Sci, (2007), 3(12), 948-955.
44. S. C. Nayak, B. B. Misra, and H. S. Behera, Index prediction with Neuro-Genetic Hybrid network: A Comparative Analysis of Performance Computing, International Conference on Communication and Applications (ICCCA), (2012), pp.1-6.
45. S. C. Nayak, B. B. Misra, and H. S. Behera, Evaluation of Normalization Methods on Neuro-Genetic Models for Stock index Forecasting, Information and Communication Technologies (WICT), 2012 World Congress, (2012), pp.602-607.
46. D. A. Panagiotopoulos, R. W. Newcomb, S. K. Singh, Planning with a Functional Neural Network Architecture”. IEEE Trans Neural Network, (1999), 10(1),115-127.
47. Y-H. Pao, SM. Philips The Functional Link Net Learning Optimal Control, Neurocomputing, (1995), 9(2), 149-164.
48. Y-H. Pao, Y. Takefuji, Functional Link Net Computing:Theory, system, Architecture and Functionalities, IEEE Comput, (1992), pp.76-79.
49. Y.-H. Pao, et al., Neural-net Computing and Intelligent Control Systems, International Journal of Control, (1992), 56(2), pp.263-289.
50. GH. Park and YH. Pao Unconstrained Word-Based Approach for Off-Line Script Recognition using Density Based Random Vector Functional Link net, Neurocomputing, (2000), 31(1), 45-65.
51. JC. Patra et al., Identification of Non-Linear Dynamic Systems using Functional Link Artificial Neural Networks, IEEE Trans Syst Man Cyber Part B Cybern, (1999),29(2),254-262.
52. JC. Patra et al., Non-Linear Channel Equalization for QAM Signal Constellation using Artificial Neural Networks, IEEE Transactions on Systems, Man, Cybernetics-Part B: Cybernetics, (1999),29(2), 262-271.
53. J. C. Patra, A. Van den Bos, Modeling of an Intelligent Pressure Sensor using Functional Link Artificial Neural Networks, ISA Trans, (2000),39(1), 15-27.
54. J. C. Patra, and A. C Kot, Non-Linear Dynamic System Identification using Chebyshev Functional Link Artificial Neural Networks, IEEE Trans on Systems, Man, and Cybernetics, Part B: Cybernetics, (2002), 32(4),505-511.
55. JC. Patra et al., Functional Link Neural Networks-Based Intelligent Sensors for Harsh Environments, Functional Link Neural Networks-Based Intelligent Sensors for Harsh Environments, (2008),vol.90, pp.209-220.
56. J. C. Patra, N. R. Pal, A Functional Link Neural Network for Adaptive Channel Equalization, Signal Process, (1995), 43(2),181-195.
57. J. C. Patra, R. N. Pal, B. N. Chatteiji, and G. Panda, Identification of Nonlinear Dynamic Systems using Functional Link Artificial Neural Networks, IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics,(1999),29(2), 254-262.
58. J.C. Patra, and A.C. Kot, Nonlinear Dynamic System Identification using Chebyshev Functional Link Artificial Neural Networks, IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, (2002), 32(4), 505-511.
59. J. C. Patra and R. N. Pal, A Functional Link Artificial Neural Network for Adaptive Channel Equalization, Signal Processing, (1995), 43(2), 181-195.
60. K. Price, R. Storn and J. Lampinen, Differential Evolution: A Practical Approach to Global Optimization, Springer-Verlag, (2005).
61. S. Purwar et al., On-line System Identification of Complex Systems using Chebyshev Neural Networks, Applied Soft Computing, (2007),7(1),364-372.
62. R. Roy, S. Dehuri, and S.-B. Cho, A Novel Particle Swarm Optimization Algorithm for Multi-objective Combinatorial Optimization Problem, International Journal of Applied Meta-heuristic Computing, (2011), 2 (4), 41-57.
63. A. Sierra, J. A. Macias, F. Corbacho, Evolution of Functional Link Networks, IEEE Transactions on Evolutionary Computation, (2001), 5(1),54-65.
64. S. N. Sing, K. N. Srivastava, Degree of Insecurity Estimation in a Power System using Functional Link Neural Network, European Transactions on Electrical Power, (2002), 12(5), 353-359.
65. R. Stron, and K. Price, Differential Evolution-A Simple and Efficient Adaptive Scheme for Global Optimization over Continuous Spaces, Technical Report TR-05-012: International Computer Science Institute, Berkely, (1995).
66. R. Stron, and K. Price, Differential Evolution-Simple and Efficient Heuristic for Global Optimization over Continuous Spaces, Journal of Global Optimization, (1997), 11(4),341-359.
67. W-D. Weng et al., A Channel Equalizer using Reduced Decision Feedback Chebyshev Function Link Artificial Neural Networks. Information Sciences, (2007),177(13),2642-2654.
68. W-D. Weng, CT. Yen. Reduced Decision Feed-back FLANN Non-Linear Channel Equaliser for Digital Communication Systems, IEE Proceedings-Communications, (2004),151(4),305-311.
69. Z. Yan, Z. Wang, and H. Xie, The Application of Mutual Information Based Feature Selection and Fuzzy LS-SVM based Classifier in Motion Classification, Computer Methods and Programs in Biomedicine, (2008), vol.90(3), 275-284.
70. G. P. Zhang, Neural Networks for Classification: A Survey”. IEEE Transactions on Systems, Man, Cybernetics-Part C: Application and Reviews, (2000), 30(4), 451-461.