Feature selection inspired classifier ensemble reduction

IEEE Transactions on Cybernetics

Volumn 44, Issue 8, 2014, Pages 1259-1268

  Diao, Ren ^a   Chao, Fei ^b   Peng, Taoxin ^c   Snooke, Neal ^a   Shen, Qiang ^a  

^a ABERYSTWYTH UNIVERSITY   (United Kingdom)

^b XIAMEN UNIVERSITY   (China)

^c EDINBURGH NAPIER UNIVERSITY   (United Kingdom)

Author keywords

Classifier ensemble reduction; feature selection; harmony search

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION;

CLASSIFICATION PERFORMANCE; CLASSIFIER ENSEMBLES; ENSEMBLE PREDICTION; FEATURE SELECTION PROBLEM; HARMONY SEARCH; MULTIPLE CLASSIFIERS; PREDICTIVE PERFORMANCE; STORAGE REQUIREMENTS;

BENCHMARKING;

EID: 84904655780     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2013.2281820     Document Type: Article

References (59)

1. D. Aha, D. Kibler, and M. Albert, "Instance-based learning algorithms," Mach. Learn., vol. 6, no. 1, pp. 37-66, 1991. (Pubitemid 21727227)
2. R. Bellman, Dynamic Programming. Princeton, NJ, USA: Princeton Univ. Press, 1957.
3. Y. Bengio and Y. Grandvalet, "No unbiased estimator of the variance of k-fold cross-validation," J. Mach. Learn. Res., vol. 5, pp. 1089-1105, Sep. 2004.
4. R. B. Bhatt and M. Gopal, "On fuzzy-rough sets approach to feature selection," Pattern Recognit. Lett., vol. 26, no. 7, pp. 965-975, 2005. (Pubitemid 40538756)
5. L. Breiman, "Bagging predictors," Mach. Learn., vol. 24, no. 2, pp. 123-140, 1996. (Pubitemid 126724382)
6. C. M. Christoudias, R. Urtasun, and T. Darrell, "Multi-view learning in the presence of view disagreement," in Proc. 24th Conf. Uncertainty Artif. Intell., 2008, p. 9.
7. M. Dash and H. Liu, "Consistency-based search in feature selection," Artif. Intell., vol. 151, nos. 1-2, pp. 155-176, Dec. 2003.
8. M. Dash and H. Liu, "Feature selection for classification," Intell. Data Anal., vol. 1, nos. 1-4, pp. 131-156, 1997.
9. J. Debuse and V. Rayward-Smith, "Feature subset selection within a simulated annealing data mining algorithm," J. Intell. Inf. Syst., vol. 9, no. 1, pp. 57-81, 1997. (Pubitemid 127507078)
10. R. Diao and Q. Shen, "Fuzzy-rough classifier ensemble selection," in Proc. IEEE Int. Conf. Fuzzy Syst., Jun. 2011, pp. 1516-1522.
11. R. Diao and Q. Shen, "Feature selection with harmony search," IEEE Trans. Syst., Man, Cybern. B, vol. 42, no. 6, pp. 1509-1523, Dec. 2012.
12. S. Džeroski and B. Ženko, "Is combining classifiers better than selecting the best one," Mach. Learn., vol. 54, no. 3, pp. 255-273, Mar. 2004.
13. M. Fesanghary, M. Mahdavi, M. Minary-Jolandan, and Y. Alizadeh, "Hybridizing harmony search algorithm with sequential quadratic programming for engineering optimization problems," Comput. Meth. Appl. Mech. Eng., vol. 197, nos. 33-40, pp. 3080-3091, 2008.
14. K. Bache and M. Lichman. (2013). UCI Machine Learning Repository, School Information Comput. Sci., Univ. California, Irvine, CA, USA [Online]. Available: http://archive.ics.uci.edu/ml
15. Z. W. Geem, Recent Advances in Harmony Search Algorithm (Studies in Computational Intelligence), vol. 270. Berlin, Germany: Springer, 2010.
16. G. Giacinto and F. Roli, "An approach to the automatic design of multiple classifier systems," Pattern Recognit. Lett., vol. 22, no. 1, pp. 25-33, 2001.
17. M. A. Hall, "Correlation-based feature selection for discrete and numeric class machine learning," in Proc. 17th Int. Conf. Mach. Learn., 2000, pp. 359-366.
18. S. Haykin, Neural Networks: A Comprehensive Foundation. Englewood Cliffs, NJ, USA: Prentice Hall, 1999.
19. T. Ho, "The random subspace method for constructing decision forests," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 8, pp. 832-844, Aug. 1998. (Pubitemid 128741345)
20. C.-N. Hsu, H.-J. Huang, and D. Schuschel, "The annigma-wrapper approach to fast feature selection for neural nets," IEEE Trans. Syst., Man, Cybern. B, vol. 32, no. 2, pp. 207-212, Apr. 2002. (Pubitemid 34249379)
21. R. A. Jacobs, "Methods for combining experts' probability assessments," Neural Comput., vol. 7, no. 5, pp. 867-888, Sep. 1995.
22. R. Jensen and C. Cornelis, "Fuzzy-rough nearest neighbour classification," in Proc. Trans. Rough Sets XIII, LNCS 6499. 2011, pp. 56-72.
23. R. Jensen and Q. Shen, Computational Intelligence and Feature Selection: Rough and Fuzzy Approaches, New York, NY, USA: Wiley-IEEE Press, 2008.
24. R. Jensen and Q. Shen, "New approaches to fuzzy-rough feature selection," IEEE Trans. Fuzzy Syst., vol. 17, no. 4, pp. 824-838, Aug. 2009.
25. G. John and P. Langley, "Estimating continuous distributions in bayesian classifiers," in Proc. 11th Conf. Uncertainty Artif. Intell., 1995, pp. 338-345.
26. J. Keller, M. Gray, and J. Givens, "A fuzzy k-nearest neighbor algorithm," IEEE Trans. Syst., Man, Cybern., vol. SMC-15, no. 4, pp. 580-585, Jul.-Aug. 1985.
27. R. Kohavi and G. H. John, "Wrappers for feature subset selection," Artif. Intell., vol. 97, no. 1, pp. 273-324, 1997. (Pubitemid 127401107)
28. B. Kröse, N. Vlassis, R. Bunschoten, and Y. Motomura, "A probabilistic model for appearance-based robot localization," in Proc. 1st Eur. Symp. Ambience Intell., 2000, pp. 264-274.
29. L. Kuncheva, "Switching between selection and fusion in combining classifiers: An experiment," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 2, pp. 146-156, Apr. 2002. (Pubitemid 34249373)
30. R. Leardi, R. Boggia, and M. Terrile, "Genetic algorithms as a strategy for feature selection," J. Chemometr., vol. 6, no. 5, pp. 267-281, 1992.
31. K. S. Lee and Z. W. Geem, "A new meta-heuristic algorithm for continuous engineering optimization: Harmony search theory and practice," Comput. Meth. Appl. Mech. Eng., vol. 194, nos. 36-38, pp. 3902-3933, Sep. 2005. (Pubitemid 40815237)
32. X. Li and L. Parker, "Design and performance improvements for fault detection in tightly-coupled multi-robot team tasks," in Proc. IEEE Int. Conf. Robot. Autom., Apr. 2008, pp. 198-203.
33. H. Liu and H. Motoda, Computational Methods of Feature Selection. London, U.K.: Chapman Hall/CRC, 2007.
34. N. Mac Parthaláin and R. Jensen, "Measures for unsupervised fuzzyrough feature selection," Int. J. Hybrid Intell. Syst., vol. 7, no. 4, pp. 249-259, Dec. 2010.
35. N. Mac Parthaláin, Q. Shen, and R. Jensen, "A distance measure approach to exploring the rough set boundary region for attribute reduction," IEEE Trans. Knowl. Data Eng., vol. 22, no. 3, pp. 305-317, Mar. 2010.
36. M. Mahdavi, M. H. Chehreghani, H. Abolhassani, and R. Forsati, "Novel meta-heuristic algorithms for clustering web documents," Appl. Math. Comput., vol. 201, nos. 1-2, pp. 441-451, 2008.
37. A. Marán-Hernández, R. Méndez-Rodríguez, and F. Montes-González, "Significant feature selection in range scan data for geometrical mobile robot mapping," in Proc. 5th Int. Symp. Robot. Autom., 2006, p. 6.
38. F. Markatopoulou, G. Tsoumakas, and L. Vlahavas, "Instance-based ensemble pruning via multi-label classification," in Proc. 22nd IEEE Int. Conf. Tools With Artif. Intell., vol. 1. Oct. 2010, pp. 401-408.
39. M. H. Mashinchi, M. A. Orgun, M. Mashinchi, and W. Pedrycz, "A tabu-harmony search-based approach to fuzzy linear regression," IEEE Trans. Fuzzy Syst., vol. 19, no. 3, pp. 432-448, Jun. 2011.
40. L. Nanni and A. Lumini, "Ensemblator: An ensemble of classifiers for reliable classification of biological data," Pattern Recognit. Lett., vol. 28, no. 5, pp. 622-630, 2007. (Pubitemid 46073220)
41. I. Partalas, G. Tsoumakas, and I. Vlahavas, "Pruning an ensemble of classifiers via reinforcement learning," Neurocomputing, vol. 72, nos. 7-9, pp. 1900-1909, 2009.
42. C. C. Ramos, A. N. Souza, G. Chiachia, A. X. Falcão, and J. P. Papa, "A novel algorithm for feature selection using harmony search and its application for non-technical losses detection," Comput. Electr. Eng., vol. 37, no. 6, pp. 886-894, 2011.
43. S. Royston, J. Lawry, and K. Horsburgh, "A linguistic decision tree approach to predicting storm surge," Fuzzy Sets Syst., vol. 215, no. 0, pp. 90-111, 2013.
44. M. Shah, M. Marchand, and J. Corbeil, "Feature selection with conjunctions of decision stumps and learning from microarray data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 174-186, Jan. 2012.
45. C. Shang and D. Barnes, "Fuzzy-rough feature selection aided support vector machines for mars image classification," Comput. Vision Image Understand., vol. 117, no. 3, pp. 202-213, 2013.
46. R. Srinivasa Rao, S. V. L. Narasimham, M. Ramalinga Raju, and A. Srinivasa Rao, "Optimal network reconfiguration of large-scale distribution system using harmony search algorithm," IEEE Trans. Power Syst., vol. 26, no. 3, pp. 1080-1088, Aug. 2011.
47. R. W. Swiniarski and A. Skowron, "Rough set methods in feature selection and recognition," Pattern Recognit. Lett., vol. 24, no. 6, pp. 833-849, 2003. (Pubitemid 35391801)
48. M. A. Tahir, J. Kittler, and A. Bouridane, "Multilabel classification using heterogeneous ensemble of multi-label classifiers," Pattern Recognit. Lett., vol. 33, no. 5, pp. 513-523, 2012.
49. G. Tsoumakas, I. Partalas, and I. Vlahavas, "A taxonomy and short review of ensemble selection," in Proc. Workshop Supervised Unsupervised Ensemble Meth. Their Applicat., 2008, pp. 41-46.
50. A. Tsymbal, M. Pechenizkiy, and P. Cunningham, "Diversity in search strategies for ensemble feature selection," Inf. Fusion, vol. 6, no. 1, pp. 83-98, 2005.
51. D. L. Vail and M. M. Veloso, "Feature selection for activity recognition in multi-robot domains," in Proc. 23rd AAAI Conf. Artif. Intell., 2008, pp. 1415-1420.
52. X. Wang, J. Yang, X. Teng, W. Xia, and R. Jensen, "Feature selection based on rough sets and particle swarm optimization," Pattern Recognit. Lett., vol. 28, no. 4, pp. 459-471, 2007. (Pubitemid 44920436)
53. G. Wells and C. Torras, "Assessing image features for vision-based robot positioning," J. Intell. Robot. Syst., vol. 30, no. 1, pp. 95-118, 2001. (Pubitemid 32189002)
54. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques (Morgan Kaufmann Series in Data Management Systems), 2nd ed. San Mateo, CA, USA: Morgan Kaufmann, 2005.
55. J. Wróblewski, "Ensembles of classifiers based on approximate reducts," Fundamenta Inform., vol. 47, nos. 3-4, pp. 351-360, Oct. 2001. (Pubitemid 33105745)
56. E. P. Xing, M. I. Jordan, and R. M. Karp, "Feature selection for highdimensional genomic microarray data," in Proc. 18th Int. Conf. Mach. Learn., 2001, pp. 601-608.
57. S.-M. Zhou and J. Q. Gan, "Constructing accurate and parsimonious fuzzy models with distinguishable fuzzy sets based on an entropy measure," Fuzzy Sets Syst., vol. 157, no. 8, pp. 1057-1074, 2006.
58. S.-M. Zhou and J. Gan, "Constructing L2-SVM-based fuzzy classifiers in high-dimensional space with automatic model selection and fuzzy rule ranking," IEEE Trans. Fuzzy Syst., vol. 15, no. 3, pp. 398-409, Jun. 2007. (Pubitemid 46971552)
59. Z. Zhu, Y.-S. Ong, and M. Dash, "Wrapper-filter feature selection algorithm using a memetic framework," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 1, pp. 70-76, Feb. 2007. (Pubitemid 46358481)