Neural-network feature selector

IEEE Transactions on Neural Networks

Volumn 8, Issue 3, 1997, Pages 654-662

  Setiono, Rudy ^b   Liu, Huan ^a,b  

^a IEEE

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Backpropagation; Cross entropy; Feature selection; Feedforward neural network; Network pruning; Penalty term

Indexed keywords

BACKPROPAGATION; FEEDFORWARD NEURAL NETWORKS; LEARNING ALGORITHMS; LEARNING SYSTEMS;

NETWORK PRUNING ALGORITHM;

FEATURE EXTRACTION;

EID: 0031140388     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.572104     Document Type: Review

References (20)

1. T. Y. Young and T. W. Calvert, Classification, Estimation, and Pattern Recognition. New York: Elsevier, 1974.
2. J. R. Quinlan, C4.5: Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann, 1993.
3. L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone, Classification and Regression Trees. Belmont, CA: Wadsworth and Brooks, 1984.
4. K. J. Lang and M. J. Witbrock, "Learning to tell two spirals apart," in Proc. 1988 Connectionist Model Summer School, D. S. Touretzky, G. Hinton, and T. Sejnowski, Eds.. San Mateo, CA: Morgan Kaufmann, 1988, pp. 52-59.
5. A. van Ooyen and B. Nienhuis, "Improving the convergence of the backpropagation algorithm," Neural Networks, vol. 5, pp. 465-471, 1992.
6. R. Setiono, "A penalty-function approach for pruning feedforward neural networks," Neural Computa., vol. 9. no. 1, pp. 185-204, 1997.
7. D. E. Rumelhartm, J. L. McClelland, and the PDP Research Group, Parallel Distributed Processing. Cambridge, MA: MIT Press, vol. 1, 1986.
8. R. L. Watrous, "Learning algorithms for connectionist networks: Applied gradient methods for nonlinear optimization," in Proc. IEEE 1st Int. Conf. Neural Networks, San Diego, CA, 1987, pp. 619-627.
9. R. Setiono, "A neural network construction algorithm which maximizes the likelihood function," Connection Sci., vol. 7, no. 2, pp. 147-166, 1995.
10. J. E. Dennis Jr. and R. B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations. Englewood Cliffs, NJ: Prentice-Hall, 1983.
11. L. M. Belue and K. W. Bauer, Jr., "Determining input features for multilayer perceptron," Neurocomputing, vol. 7, no. 2, pp. 111-122, 1995.
12. S. B. Thrun et al., "The MONK's problems - A performance comparison of different learning algorithms," Dept. Computer Sci., Carnegie Mellon University, Pittsburgh, PA, Tech. Rep. CMU-CS-91-197, 1991.
13. R. Agrawal, T. Imielinski, and A. Swami, "Database mining: A performance perspective," IEEE Trans. Knowledge Data Eng., vol. 5, pp. 914-925, Dec. 1993.
14. P. M. Murphy and D. W. Aha, "UCI repository of machine learning databases," Machine-Readable Data Repository, Univ. California, Dept. Inform. Computer Sci., Irvine, CA, 1992.
15. W. H. Wolberg and O. L. Mangasarian, "Multisurface method of pattern separation for medical diagnosis applied to breast cytology," in Proc. Nat Academy Sci., vol. 87, 1990, pp. 9193-9196.
16. O. L. Mangasarian, "Multisurface method of pattern separation," IEEE Trans. Inform. Theory, vol. 14, no. 6, pp. 801-807, 1968.
17. O. L. Mangasarian, R. Setiono, and W. H. Wolberg, "Pattern recognition via linear programming: Theory and application to medical diagnosis," in Large-Scale Numerical Optimization, T. F. Coleman and Y. Li, Eds. Philadelphia, PA: SIAM, 1990, pp. 22-30.
18. J. C. Schlimmer, "Concept acquisition through representational adjustment," Ph.D. dissertation, Dept. Inform. Computer Sci., Univ. California, Irvine, CA, 1987.
19. J. W. Smith, J. E. Everhart, W. C. Dickson, W. C. Knowler, and R. S. Johannes, "Using the ADAP learning algorithm to forecast the onset of diabetes mellitus," in Proc. Symp. Computer Applicat. Medical Care. Los Alamitos, CA: EEE Computer Soc. Press, 1988, pp. 261-265.
20. R. P. Gorman and T. J. Sejnowski, "Analysis of hidden units in a layered network trained to classify sonar target," Neural Networks, vol. 1, pp. 75-89, 1988.