Orthogonal Forward Selection and Backward Elimination Algorithms for Feature Subset Selection

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 34, Issue 1, 2004, Pages 629-634

  Mao, K Z ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Feature subset selection; Orthogonal backward elimination (OBE); Orthogonal forward selection (OFS)

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); ERROR ANALYSIS; LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS; MAPPING; MATHEMATICAL TRANSFORMATIONS; PATTERN MATCHING; PRINCIPAL COMPONENT ANALYSIS; PROBLEM SOLVING; REDUNDANCY; SET THEORY; VECTORS;

FEATURE SUBSET SELECTION; ORTHOGONAL BACKWARD ELIMINATION (OBE); ORTHOGONAL FORWARD SELECTION (OFS);

FEATURE EXTRACTION;

EID: 0742307292     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2002.804363     Document Type: Article

References (16)

1. R. Kohavi and G. H. John, "Wrappers for feature subset selection," Artif. Intell., vol. 97, no. 1-2, pp. 273-324, 1997.
2. P. M. Narendra and K. Fukunaga, "A branch and bound algorithm for feature subset selection," IEEE Trans. Comput., vol. C-26, pp. 917-922, Sept. 1977.
3. W. Siedlecki and J. Skansky, "A note on genetic algorithms for large-scale feature selection," Pattern Recognit. Lett., vol. 10, no. 5, pp. 335-347, 1989.
4. J. Yang and V. Honavar, "Feature subset selection using a genetic algorithm," IEEE Intell. Syst., vol. 13, pp. 44-49, Feb. 1998.
5. P. A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach. London, U.K.: Prentice-Hall, 1982.
6. E. Backer and J. A. D. Schipper, "On the max-min approach for feature ordering and selection," in The Seminar on Pattern Recognition. Liege, Belgium: Liege Univ., 1977.
7. P. Pudil, J. Novovicova, and J. Kittler, "Floating search methods in feature selection," Pattern Recognit. Lett., vol. 15, no. 11, pp. 1119-1125, 1994.
8. A. Jain and D. Zongker, "Feature selection: Evaluation, application and small sample performance," IEEE Trans. Pattern Anal. Machine Intell., vol. 19, pp. 153-158, Feb. 1997.
9. S. Chen, S. A. Billings, and W. Luo, "Orthogonal least squares methods and their applications to nonlinear system identification," Int. J. Control, vol. 50, pp. 1873-1896, 1989.
10. G. A. F. Saber, Linear Regression Analysis. New York: Wiley, 1977.
11. G. Vane, R. O. Green, T. G. Chrien, H. T. Enmark, E. G. Hansen, and W. M. Porter, "The airborne visible infrared/imaging spectrometer (AVIRIS)," Remote Sensing Environ., vol. 44, no. 1, pp. 12-143, 1993.
12. E. Wilburn, J. O. G. Reddick, E. N. Cook, T. D. Elkin, and R. J. Deaton, "Automated segmentation and classification of multispectral magnetic resonance images of brain using artificial neural networks," IEEE Trans. Med. Imag., vol. 16, pp. 911-918, Dec. 1997.
13. L. O. Jimenez and D. A. Landgrebe, "Hyperspectral data analysis and supervised feature reduction via projection pursuit," IEEE Trans. Geosci. Remote Sensing, vol. 37, pp. 2653-2667, June 1999.
14. C.-C. Hung, A. Fahsi, W. Tadesse, and T. L. Coleman, "A comparative study of remotely sensed data classification using principal component analysis and divergence," in Proc. IEEE Int. Conf. Syst. Man Cybern., vol. 3, 1997, pp. 2444-2449.
15. USGS Spectral Lab [Online]. Available: ftp://speclab.cr.usgs.gov
16. C. L. Blake and C. J. Merz. (1998) UCI repository of machine learning databases. Tech. Rep., Dept. Inform. Comput. Sci., Univ. of California, Irvine, CA. [Online]. Available: http://www.ics.uci.edu/mlearn/Machine-Learning.html