Smoothing decision boundaries to avoid overfitting in neural network training

Neural Network World

Volumn 21, Issue 4, 2011, Pages 311-325

  El Hindi, Khalil ^a   Al Akhras, Mousa ^a  

^a UNIVERSITY OF JORDAN   (Jordan)

Author keywords

Artificial neural network; Instance reduction; Instance selection; Instance based learning; Machine learning; Noise filtering; Over learning; Overfitting; Prototype selection

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; NEURAL NETWORKS; SPURIOUS SIGNAL NOISE;

INSTANCE BASED LEARNING; INSTANCE SELECTION; NOISE FILTERING; OVER LEARNING; OVERFITTING; PROTOTYPE SELECTION;

DEEP NEURAL NETWORKS;

EID: 80053632198     PISSN: 12100552     EISSN: None     Source Type: Journal    
DOI: 10.14311/NNW.2011.21.019     Document Type: Article

References (20)

1. Aha D. W., Kibler D., Albert M. K.: Instance-Based Learning Algorithms. Machine Learnings, 1991, pp. 37-66. (Pubitemid 21727227)
2. Aha, D. W. Tolerating noisy, irrelevant and novel attributes in instance-based learning algorithms, International Journal of Man-Machine Studies, 36, 1992, pp. 267-287.
3. AL-Akhras M., Zedan H., John R., AL Momani I.: Non-intrusive speech quality prediction in VoIP networks using a neural network approach, Neurocomputing, 72, 10-12, 2009, pp. 2595-2608.
4. AL-Akhras M., AL Momani I., Sleit A.: An Improved E-MODEL Using Artificial Neural Network VoIP Quality Predictor, NEURAL NETWORK WORLD, 21, 1, 2011, pp. 3-26.
5. Askarunisa A., Ramaraj N.: An Algorithm for Test Data Set Reduction for Web Application Testing, NEURAL NETWORK WORLD, 21, 1, 2011, pp. 27-43.
6. Blake C., Merz C.: UCI Repository of Machine Learning Databases [Online]. Irvine, CA: University of California, Department of Information and Computer Science, 1998. Available from: http://www.ics.uci.edu/mlearn/MLRepository.html.
7. Cameron-Jones R. M.: Instance Selection by Encoding Length Heuristic with Random Mutation Hill Climbing. In: Proceedings of the Eighth Australian Joint Conference on Artificial Intelligence, 1995, pp. 99-106.
8. El Hindi K., AL-Akhras M.: Eliminating Border Instance to Avoid Overfitting. IADIS International Conference Intelligent Systems and Agents 2009(ISA 2009), 21-23 June, 2009, Algarve, Portugal.
9. Garcia S., Cano J. R., Herrera F.: A Mimetic Algorithm for Evolutionary Prototype Selection: a scaling up approach. The Journal of The Pattern Recognition Society, 41, 8, 2008, Elsevier Ltd. 2008.
10. Gates G. W.: The Reduced Nearest Neighbor Rule. IEEE Transactions on Information Theory, 18, 3, 1972, pp. 431-433.
11. Hart P. E.: The Condensed Nearest Neighbor Rule. IEEE Transactions on Information Theory, 14, 1968, pp. 515-516.
12. Levenberg K.: A Method for the Solution of Certain Non-Linear Problems in Least Squares, The Quarterly of Applied Mathematics, 2, 2, 1944, pp. 164-168.
13. Marquardt D. W.: An Algorithm for the Least-Squares Estimation of Nonlinear Parameters, SIAM Journal of Applied Mathematics, 11, 2, June 1963, pp. 431-441.
14. Mitchell T. M.: Machine Learning, 1997, New York, NY, USA McGraw-Hill.
15. Quinlan J. R.: C4.5: Programs for machine learning, 1993, Morgan Kaufmann, San Mateo, CA.
16. Ritter G. L., Woodruff H. B., Lowry S. R., Isenhour T. L.: An Algorithm for a Selective Nearest Neighbor Decision Rule. IEEE Transactions on Information Theory, 21, 6, November 1975, pp. 665-669.
17. Tomek I.: An Experiment with the Edited Nearest-Neighbor Rule. IEEE Transactions on Systems, Man, and Cybernetics, 6, 6, June 1976, pp. 448-452.
18. Wilson D. L.: Asymptotic Properties of Nearest Neighbor Rules Using Edited Data. IEEE Transactions on Systems, Man, and Cybernetics, 2, 3, 1972, pp. 408-421.
19. Wilson D. R., Martinez T. R.: Improved Center Point Selection for Radial Basis Function Networks. In: Proceedings of the International Conference on Artificial Neural Networks and Genetic Algorithms (ICANNGA'97), 1997.
20. Wilson D. R., Martinez T. R.: Reduction Techniques for Exemplar-Based Learning Algorithms. Machine Learning, 38, 3, 2000, pp. 257-286. (Pubitemid 30572450)