Diversity measures for one-class classifier ensembles

Neurocomputing

Volumn 126, Issue , 2014, Pages 36-44

  Krawczyk, Bartosz ^a   Woźniak, Michał ^a  

^a WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Combined classifier; Diversity measure; Machine learning; Multiple classifier system; One class classification

Indexed keywords

CLASSIFICATION MODELS; COMBINED CLASSIFIERS; COMPUTER EXPERIMENT; DIVERSITY MEASURE; MULTI-CLASS CLASSIFICATION; MULTIPLE CLASSIFIER SYSTEMS; ONE-CLASS CLASSIFICATION; ONE-CLASS CLASSIFIER;

COMPUTER APPLICATIONS; NEURAL NETWORKS;

LEARNING SYSTEMS;

ARTICLE; CLASSIFICATION; CLASSIFIER; COMPUTER MODEL; CONTROLLED STUDY; DIVERSITY MEASURE; FACTUAL DATABASE; MULTI CLASS CLASSIFICATION; ONE CLASS CLASSIFIER; ONE CLASS DISAGREEMENT MEASURE; ONE CLASS ENERGY MEASURE; ONE CLASS ENTROPY MEASURE; ONE CLASS SHANON MEASURE; ONE CLASS SUPPORT VECTOR MACHINE; PRIORITY JOURNAL; QUALITY CONTROL; SINGLE CLASS CLASSIFICATION; SPHERE INTERSECTION MEASURE; STATISTICAL ANALYSIS; STATISTICAL MODEL; SUPPORT VECTOR DATA DESCRIPTION; SUPPORT VECTOR MACHINE;

EID: 84887613816     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.01.053     Document Type: Article

References (53)

1. Alpaydin E. Combined 5×2 cv f test for comparing supervised classification learning algorithms. Neural Computation 1999, 11(8):1885-1892.
2. Bi Y. The impact of diversity on the accuracy of evidential classifier ensembles. International Journal of Approximate Reasoning 2012, 53(4):584-607.
3. Bolton R.J., Hand D.J. Statistical fraud detection. a review. Statistical Science 2002, 17(3):235-255.
4. G. Brown, L.I. Kuncheva, "Good" and "bad" diversity in majority vote ensembles, in: MCS, 2010, pp. 124-133.
5. Burges C.J.C. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 1998, 2(2):121-167.
6. Chen B., Feng A., Chen S., Li B. One-cluster clustering based data description. Jisuanji Xuebao/Chinese Journal of Computers 2007, 30(8):1325-1332.
7. Y. Chen, X.S. Zhou, T.S. Huang, One-class SVM for learning in image retrieval, in: IEEE International Conference on Image Processing, vol. 1, 2001, pp. 34-37.
8. G. Cohen, H. Sax, A. Geissbuhler, Novelty detection using one-class parzen density estimator. An application to surveillance of nosocomial infections, in: Studies in Health Technology and Informatics, vol. 136, 2008, pp. 21-26.
9. Corchado E., Grana M., Woźniak M. New trends and applications on hybrid artificial intelligence systems. Neurocomputing 2012, 75:61-63.
10. Cormack G.V., Lynam T.R. Online supervised spam filter evaluation. ACM Transactions on Information Systems 2007, 25(3).
11. Czogala E., Leski J. Application of entropy and energy measures of fuzziness to processing of ECG signal. Fuzzy Sets and Systems 1998, 97(1):9-18.
12. Dietterich T.G., Bakiri G. Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research 1995, 2:263-286.
13. Duda R.O., Hart P.E., Stork D.G. Pattern Classification 2001, Wiley, New York. 2nd ed.
14. Galar M., Fernández A., Barrenechea E., Bustince H., Herrera F. An overview of ensemble methods for binary classifiers in multi-class problems. experimental study on one-vs-one and one-vs-all schemes. Pattern Recognition 2011, 44(8):1761-1776.
15. Gardner A.B., Krieger A.M., Vachtsevanos G., Litt B. One-class novelty detection for seizure analysis from intracranial EEG. Journal of Machine Learning Research 2006, 7:1025-1044.
16. Garg A.X., Adhikari N.K.J., McDonald H., Rosas-Arellano M.P., Devereaux P.J., Beyene J., Sam J., Haynes R.B. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes. a systematic review. Journal of the American Medical Association 2005, 293(10):1223-1238.
17. Giacinto G., Perdisci R., Del Rio M., Roli F. Intrusion detection in computer networks by a modular ensemble of one-class classifiers. Information Fusion 2008, 9:69-82.
18. A. Golestani, J. Azimi, M. Analoui, M. Kangavari, A new efficient fuzzy diversity measure in classifier fusion, in: Proceedings of the IADIS Conference, 2007, pp. 722-726.
19. Gong Y., Hu G., Pan Z., Zhou Y. Radio transmitter verification based on elastic sparsity preserving projections and SVDD. International Journal of Digital Content Technology and its Applications 2011, 5(10):247-254.
20. Harris J.W., Stocker H. Handbook of Mathematics and Computational Science 1998, Springer-Verlag, New York.
21. Ho T.K. The random subspace method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence 1998, 20:832-844.
22. Jiang H., Liu G., Xiao X., Mei C., Ding Y., Yu S. Monitoring of solid-state fermentation of wheat straw in a pilot scale using FT-NIR spectroscopy and support vector data description. Microchemical Journal 2012, 102:68-74.
23. P. Juszczak, Learning to Recognise. A Study on One-Class Classification and Active Learning, Ph.D. Thesis, Delft University of Technology, 2006.
24. Juszczak P., Tax D.M.J., Pekalska E., Duin R.P.W. Minimum spanning tree based one-class classifier. Neurocomputing 2009, 72(7-9):1859-1869.
25. B. Krawczyk, Classifier committee based on feature selection method for obstructive nephropathy diagnosis, in: Studies in Computational Intelligence, vol. 381, 2011, pp. 115-125.
26. B. Krawczyk, Diversity in ensembles for one-class classification, in: Current Developments in Databases and Information Systems, Advances in Intelligent and Soft Computing, Springer Berlin/Heidelberg, 2012, pp. 119-129.
27. B. Krawczyk, M. Woźniak, Combining diverse one-class classifiers, in: Emilio Corchado, Vaclav Snasel, Ajith Abraham, Michal Wozniak, Manuel Grana, Sung-Bae Cho (Eds.), Hybrid Artificial Intelligent Systems, in: Lecture Notes in Computer Science, vol. 7209, Springer Berlin/Heidelberg, 2012, pp. 590-601.
28. B. Krawczyk, M. Woźniak, Experiments on distance measures for combining one-class classifiers, in: Proceedings of the FEDCISIS 2012 Conference, 2012, pp. 88-92.
29. Kuncheva L.I. Combining Pattern Classifiers. Methods and Algorithms 2004, Wiley-Interscience.
30. Kuncheva L.I., Bezdek J.C., Duin R.P.W. Decision templates for multiple classifier fusion. an experimental comparison. Pattern Recognition 2001, 34(2):299-314.
31. L.I. Kuncheva, C.J. Whitaker, Ten measures of diversity in classifier ensembles: limits for two classifiers, in: A DERA/IEE Workshop on Intelligent Sensor Processing (Ref. No. 2001/050), February 2001, pp. 10/1-1010.
32. Kuncheva L.I., Whitaker C.J., Shipp C.A., Duin R.P.W. Limits on the majority vote accuracy in classifier fusion. Pattern Analysis and Applications 2003, 6:22-31.
33. Lai C., Reinders M.J.T., Wessels L. Random subspace method for multivariate feature selection. Pattern Recognition Letters 2006, 27(10):1067-1076.
34. Manevitz L., Yousef M. One-class document classification via neural networks. Neurocomputing 2007, 70(7-9):1466-1481.
35. Mukherjee B., Heberlein L.T., Levitt K.N. Network intrusion detection. IEEE Network 1994, 8(3):26-41.
36. Noto K., Brodley C., Slonim D. Frac. a feature-modeling approach for semi-supervised and unsupervised anomaly detection. Data Mining and Knowledge Discovery 2012, 25(1):109-133.
37. Partridge D., Krzanowski W. Software diversity. practical statistics for its measurement and exploitation. Information and Software Technology 1997, 39(10):707-717.
38. Polikar R. Ensemble based systems in decision making. IEEE Circuits and Systems Magazine 2006, 6(3):21-45.
39. Quinlan J.R. C4.5. Programs for Machine Learning. Morgan Kaufmann Series in Machine Learning 1993, Morgan Kaufmann Publishers.
40. R.E. Schapire, The boosting approach to machine Learning: an Overview, in: MSRI Workshop on Nonlinear Estimation and Classification, Berkeley, CA, USA, 2001.
41. B. Schölkopf, A.J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Adaptive Computation and Machine Learning. MIT Press, 2002.
42. SIAM, Proceedings of the Eleventh SIAM International Conference on Data Mining, SDM 2011, April 28-30, 2011, Mesa, Arizona, USA, SIAM Omnipress, 2011.
43. Sonnenburg S., Rtsch G., Schfer C., Schlkopf B. Large scale multiple kernel learning. Journal of Machine Learning Research 2006, 7:1531-1565.
44. Tax D.M.J., Duin R.P.W. Support vector data description. Machine Learning 2004, 54(1):45-66.
45. D.M.J. Tax, P. Juszczak, E. Pekalska, R.P.W. Duin, Outlier detection using ball descriptions with adjustable metric, in: Proceedings of the 2006 Joint IAPR International Conference on Structural, Syntactic, and Statistical Pattern Recognition, SSPR'06/SPR'06, Berlin, Heidelberg, Springer-Verlag, 2006, pp. 587-595.
46. Tax D.M.J., Van Breukelen M., Duin R.P.W., Kittler Josef Combining multiple classifiers by averaging or by multiplying?. Pattern Recognition 2000, 33(9):1475-1485.
47. R Development Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria, 2008.
48. S. Watanabe, Theorem of the ugly duckling, in: Knowing and Guessing: A Quantitative Study of Inference and Information, Wiley, 1969.
49. Wilk T., Woźniak M. Soft computing methods applied to combination of one-class classifiers. Neurocomputing 2012, 75:185-193.
50. Windeatt T., Ghaderi R. Coding and decoding strategies for multi-class learning problems. Information Fusion 2003, 4(1):11-21.
51. D.H. Wolpert, The supervised learning no-free-lunch theorems, in: Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications, 2001, pp. 25-42.
52. Yu H., Man J., Chang K.C. Pebl. web page classification without negative examples. IEEE Transactions on Knowledge and Data Engineering 2004, 16(1):70-81.
53. H. Zuo, O. Wu, W. Hu, B. Xu, Recognition of blue movies by fusion of audio and video, in: 2008 IEEE International Conference on Multimedia and Expo, ICME 2008-Proceedings, 2008, pp. 37-40.