One-class classifier ensemble pruning and weighting with firefly algorithm

Neurocomputing

Volumn 150, Issue PB, 2015, Pages 490-500

  Krawczyk, Bartosz ^a  

^a WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Classifier ensembles; Diversity; Ensemble pruning; Firefly algorithm; One class classification; Weighted fusion

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; FIRE PROTECTION; MULTIOBJECTIVE OPTIMIZATION; QUALITY CONTROL;

CLASSIFIER ENSEMBLES; DIVERSITY; ENSEMBLE PRUNING; FIREFLY ALGORITHMS; ONE-CLASS CLASSIFICATION; WEIGHTED FUSION;

BIOLUMINESCENCE;

ARTICLE; CALCULATION; CONTROLLED STUDY; ENSEMBLE PRUNING ALGORITHM; FIREFLY ALGORITHM; LEARNING ALGORITHM; MACHINE LEARNING; MATHEMATICAL PHENOMENA; ONE CLASS CLASSIFICATION; STATISTICS; WEIGHTED FUSION ALGORITHM;

EID: 84922692060     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.07.068     Document Type: Article

References (55)

1. Alpaydin Ethem Combined 5×2 cv f test for comparing supervised classification learning algorithms. Neural Comput. 1999, 11(8):1885-1892.
2. Bartkowiak A., Zimroz R. Outliers analysis and one class classification approach for planetary gearbox diagnosis. J. Phys. Conf. Ser. 2011, 305(1).
3. Casale P., Pujol O., Radeva P. Approximate polytope ensemble for one-class classification. Pattern Recognit. 2014, 47(2):854-864.
4. Chen B., Feng A., Chen S., Li B. One-cluster clustering based data description. Jisuanji Xuebao/Chin. J. Comput. 2007, 30(8):1325-1332.
5. Y. Chen, X.S. Zhou, T.S. Huang, One-class svm for learning in image retrieval, in: IEEE International Conference on Image Processing, vol. 1, 2001, pp. 34-37.
6. V. Cheplygina, D.M.J. Tax, Pruned random subspace method for one-class classifiers, in: Multiple Classifier Systems, LNCS of Lecture Notes in Computer Science, vol. 6713, 2011, pp. 96-105.
7. Cheung K.F. Fuzzy one-mean algorithm. formulation, convergence analysis, and applications. J. Intell. Fuzzy Syst. 1997, 5(4):323-332.
8. G. Cohen, H. Sax, A. Geissbuhler, Novelty detection using one-class parzen density estimator an application to surveillance of nosocomial infections, in: Studies in Health Technology and Informatics, vol. 136, 2008, pp. 21-26.
9. B. Cyganek, Image segmentation with a hybrid ensemble of one-class support vector machines, LNAI of Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6076, 2010, pp. 254-261.
10. Cyganek B. One-class support vector ensembles for image segmentation and classification. J. Math. Imaging Vis. 2012, 42(2-3):103-117.
11. Demsar J. Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 2006, 7:1-30.
12. R.P.W. Duin, The combining classifier: to train or not to train? in: Proceedings of Sixteenth International Conference on Pattern Recognition, 2002, vol. 2, 2002, pp. 765-770.
13. Galar Mikel, Fernández Alberto, Tartas Edurne Barrenechea, Sola Humberto Bustince, Herrera Francisco Dynamic classifier selection for one-vs-one strategy. avoiding non-competent classifiers. Pattern Recognit. 2013, 46(12):3412-3424.
14. García Salvador, Fernández Alberto, Luengo Julián, Herrera Francisco Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining. experimental analysis of power. Inf. Sci. 2010, 180(10):2044-2064.
15. Garcia-Pedrajas N., Maudes-Raedo J., García-Osorio C., Rodriguez-Diez J.J. Supervised subspace projections for constructing ensembles of classifiers. Inf. Sci. 2012, 193:1-21.
16. Gardner A.B., Krieger A.M., Vachtsevanos G., Litt B. One-class novelty detection for seizure analysis from intracranial eeg. J. Mach. Learn. Res. 2006, 7:1025-1044.
17. G. Giacinto, F. Roli, G. Fumera, Design of effective multiple classifier systems by clustering of classifiers, in: Proceedings of Fifteenth International Conference on Pattern Recognition, 2000, vol. 2, 2000, pp. 160-163.
18. Giacinto Giorgio, Perdisci Roberto, Rio Mauro Del, Roli Fabio Intrusion detection in computer networks by a modular ensemble of one-class classifiers. Inf. Fusion 2008, 9(January):69-82.
19. Harris J.W., Stocker H. Handbook of Mathematics and Computational Science 1998, Springer-Verlag, New York.
20. Ho Tin Kam The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Mach. Intell. 1998, 20(August):832-844.
21. Jain A.K., Duin R.P.W., Mao Jianchang Statistical pattern recognition. a review. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22(January (1)):4-37.
22. Jiang H., Liu G., Xiao X., Mei C., Ding Y., Yu S. Monitoring of solid-state fermentation of wheat straw in a pilot scale using ft-nir spectroscopy and support vector data description. Microchem. J. 2012, 102.
23. P. Juszczak, Learning to recognise. A study on one-class classification and active learning (Ph.D. thesis), Delft University of Technology, 2006.
24. Juszczak P., Tax D.M.J., Pekalska E., Duin R.P.W. Minimum spanning tree based one-class classifier. Neurocomputing 2009, 72(7-9):1859-1869.
25. Koch M.W., Moya M.M., Hostetler L.D., Fogler R.J. Cueing, feature discovery, and one-class learning for synthetic aperture radar automatic target recognition. Neural Netw. 1995, 8(7-8):1081-1102.
26. Krawczyk B. Diversity in ensembles for one-class classification. New Trends in Databases and Information Systems, Advances in Intelligent Systems and Computing 2012, vol. 185:119-129. Springer, Berlin, Heidelberg.
27. Krawczyk B., Filipczuk P. Cytological image analysis with firefly nuclei detection and hybrid one-class classification decomposition. Eng. Appl. Artif. Intell. 2014, 31:126-135.
28. B. Krawczyk, M. Wozniak, Accuracy and diversity in classifier selection for one-class classification ensembles, in: Proceedings of the 2013 IEEE Symposium on Computational Intelligence and Ensemble Learning, CIEL 2013 - 2013 IEEE Symposium Series on Computational Intelligence, SSCI 2013, 2013, pp. 46-51.
29. Krawczyk B., Woźniak M. Combining diverse one-class classifiers. Hybrid Artificial Intelligent Systems, Lecture Notes in Computer Science 2012, vol. 7209:590-601. Springer, Berlin/Heidelberg.
30. Krawczyk B., Woźniak M. Diversity measures for one-class classifier ensembles. Neurocomputing 2014, 126:36-44.
31. Krawczyk B., Woźniak M., Cyganek B. Clustering-based ensembles for one-class classification. Inf. Sci. 2014, 264:182-195.
32. Kuncheva L.I., Jain L.C. Designing classifier fusion systems by genetic algorithms. IEEE Trans. Evol. Comput. 2000, 4(November (4)):327-336.
33. Manevitz L., Yousef M. One-class document classification via neural networks. Neurocomputing 2007, 70(7-9):1466-1481.
34. Parpinelli R.S., Lopes H.S. New inspirations in swarm intelligence. a survey. Int. J. Bio-Inspir. Comput. 2011, 3(1):1-16.
35. Ratsch G., Mika S., Scholkopf B., Muller K. Constructing boosting algorithms from svms. an application to one-class classification. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24(9):1184-1199.
36. Ruta Dymitr, Gabrys Bogdan Classifier selection for majority voting. Inf. Fusion 2005, 6(1):63-81.
37. A.D. Shieh, D.F. Kamm, Ensembles of one class support vector machines, in: Multiple Classifier Systems, 8th International Workshop, MCS 2009, Lecture Notes in Computer Science, vol. 5519, Springer, 2009, pp. 181-190.
38. SIAM. Proceedings of the Eleventh SIAM International Conference on Data Mining, SDM 2011, April 28-30, 2011, Mesa, Arizona, USA. SIAM Omnipress, 2011. 〈〉. http://tunedit.org/challenge/QSAR.
39. Sonnenburg S., Rtsch G., Schfer C., Schlkopf andB. Large scale multiple kernel learning. J. Mach. Learn. Res. 2006, 7:1531-1565.
40. Tax D.M.J., Duin R.P.W. Support vector domain description. Pattern Recognit. Lett. 1999, 20(11-13):1191-1199.
41. Tax D.M.J., Duin R.P.W. Support vector data description. Mach. Learn. 2004, 54(1):45-66.
42. D.M.J. Tax, K. Müller, A consistency-based model selection for one-class classification, in: Proceedings - International Conference on Pattern Recognition, vol. 3, 2004, Cited By (since 1996):12, pp. 363-366.
43. David M.J. Tax, Piotr Juszczak, Elzbieta Pekalska, Robert P.W. Duin, Outlier detection using ball descriptions with adjustable metric, in: Proceedings of the 2006 joint IAPR international conference on Structural, Syntactic, and Statistical Pattern Recognition SSPR 06/SPR 06, Springer-Verlag, Berlin, Heidelberg, 2006, pp. 587-595.
44. D.M.J. Tax, Robert P.W. Duin, Characterizing one-class datasets, in: Proceedings of the Sixteenth Annual Symposium of the Pattern Recognition Association of South Africa, 2005, pp. 21-26.
45. O. Taylor, J. MacIntyre, Adaptive local fusion systems for novelty detection and diagnostics in condition monitoring, in: Proceedings of SPIE - The International Society for Optical Engineering, vol. 3376, 1998, pp. 210-218.
46. G. Tsoumakas, I. Partalas, I.P. Vlahavas, An ensemble pruning primer, in: Applications of Supervised and Unsupervised Ensemble Methods, 2009, pp. 1-13.
47. Wilk T., Woźniak M. Soft computing methods applied to combination of one-class classifiers. Neurocomputing 2012, 75(January):185-193.
48. Woźniak M., Grana M., Corchado E. A survey of multiple classifier systems as hybrid systems. Inf. Fusion 2014, 16(1):3-17.
49. Woźniak M., Krawczyk B. Combined classifier based on feature space partitioning. J. Appl. Math. Comput. Sci. 2012, 22(4):855-866.
50. Wozniak Michal Experiments with trained and untrained fusers. Innov. Hybrid Intell. Syst. Adv. Soft Comput. 2007, vol. 44:144-150. Springer, Berlin/Heidelberg.
51. Wozniak Michal, Zmyslony Marcin Combining classifiers using trained fuser-analytical and experimental results. Neural Netw. World 2010, 13(7):925-934.
52. X. Yang, Engineering optimization: an introduction with metaheuristic applications, 2010.
53. Yang X. Firefly algorithm, stochastic test functions and design optimization. Int. J. Bio-Inspir. Comput. 2010, 2(2):78-84.
54. Zhang H., Cao L. A spectral clustering based ensemble pruning approach. Neurocomputing 2014, 139:289-297.
55. H. Zuo, O. Wu, W. Hu, B. Xu, Recognition of blue movies by fusion of audio and video, in: 2008 IEEE International Conference on Multimedia and Expo, ICME 2008 - Proceedings, 2008, pp. 37-40.