Quantification-oriented learning based on reliable classifiers

Pattern Recognition

Volumn 48, Issue 2, 2015, Pages 591-604

  Barranquero, Jose ^a   Díez, Jorge ^a   José Del Coz, Juan ^a  

^a UNIVERSITY OF OVIEDO   (Spain)

Author keywords

Class distribution estimation; Multivariate predictions; Performance metrics; Quantification; Reliability

Indexed keywords

PATTERN RECOGNITION; RELIABILITY;

CLASS DISTRIBUTION ESTIMATION; CLASSIFICATION ABILITY; CLASSIFICATION PERFORMANCE; INDIVIDUAL PREDICTION; NATURAL DISTRIBUTION; PERFORMANCE METRICS; QUANTIFICATION; QUANTIFICATION MODEL;

FORECASTING;

EID: 85027928230     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.07.032     Document Type: Article

References (40)

1. A. Esuli, and F. Sebastiani Sentiment quantification IEEE Intell. Syst. 25 2010 72 75
2. L. Tang, H. Gao, H. Liu, Network quantification despite biased labels, in: Proceedings of the Eighth Workshop on Mining and Learning with Graphs, ACM, pp. 147-154.
3. A. Guerrero-Curieses, R. Alaiz-Rodriguez, and J. Cid-Sueiro Cost-sensitive and modular land-cover classification based on posterior probability estimates Int. J. Remote Sens. 30 2009 5877 5899
4. L. Sánchez, V. González-Castro, E. Alegre-Gutiérrez, R. Alaiz-Rodríguez, Classification and quantification based on image analysis for sperm samples with uncertain damaged/intact cell proportions, in: Image Analysis and Recognition, Lecture Notes in Computer Science 5112, Springer, 2008, pp. 827-836.
5. Y. Chan, H. Ng, Estimating class priors in domain adaptation for word sense disambiguation, in: Proceedings of the Twenty-first International Conference on Computational Linguistics, ACL, pp. 89-96.
6. G. Forman, E. Kirshenbaum, J. Suermondt, Pragmatic text mining: minimizing human effort to quantify many issues in call logs, in: Proceedings of ACM SIGKDD06, ACM, pp. 852-861.
7. D. Hand Classifier technology and the illusion of progress Stat. Sci. 21 2006 1 14
8. F. Provost, and T. Fawcett Robust classification for imprecise environments Mach. Learn. 42 2001 203 231
9. T. Rakthanmanon, E. Keogh, S. Lonardi, and S. Evans MDL-based time series clustering Knowl. Inf. Syst. 33 2012 371 399
10. G. Forman Quantifying counts and costs via classification Data Min. Knowl. Discov. 17 2008 164 206
11. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification 2001 John Wiley & Sons New York, NY
12. M. Kelly, D. Hand, N. Adams, The impact of changing populations on classifier performance, in: Proceedings of ACM SIGKDD99, pp. 367-371.
13. R. Alaiz-Rodríguez, N. Japkowicz, Assessing the impact of changing environments on classifier performance, in: Advances in AI, Lecture Notes in Computer Science 5032, Springer-Verlag, 2008, pp. 13-24.
14. T. Fawcett, and P. Flach A response to Webb and Tings on the application of ROC analysis to predict classification performance under varying class distributions Mach. Learn. 58 2005 33 38
15. J. Fleiss, B. Levin, and M. Paik Statistical Methods for Rates and Proportions, Wiley Series in Probability and Statistics 2003 John Wiley & Sons, New York, NY
16. G. Weiss, and F. Provost Learning when training data are costly the effect of class distribution on tree induction J. Artif. Intell. Res. 19 2003 315 354
17. G. Webb, and K. Ting On the application of ROC analysis to predict classification performance under varying class distributions Mach. Learn. 58 2005 25 32
18. R. Holte Elaboration on two points raised in "classifier technology and the illusion of progress" Stat. Sci. 21 2006 24 26
19. J. Quionero-Candela, M. Sugiyama, A. Schwaighofer, and N. Lawrence Dataset Shift in Machine Learning 2009 The MIT Press, Cambridge, MA
20. J. Moreno-Torres, T. Raeder, R. Alaiz-Rodríguez, N. Chawla, and F. Herrera A unifying view on dataset shift in classification Pattern Recognit. 45 2012 521 530
21. A. Bradley The use of the area under the ROC curve in the evaluation of machine learning algorithms Pattern Recognit. 30 1997 1145 1159
22. T. Fawcett ROC graphs notes and practical considerations for researchers Mach. Learn. 31 2004 1 38
23. C. Drummond, and R. Holte Cost curves an improved method for visualizing classifier performance Mach. Learn. 65 2006 95 130
24. P. Latinne, M. Saerens, C. Decaestecker, Adjusting the outputs of a classifier to new a priori probabilities may significantly improve classification accuracy: evidence from a multi-class problem in remote sensing, in: Proceedings of ICML01, M. Kaufmann, 2001, pp. 298-305.
25. S. Vucetic, Z. Obradovic, Classification on data with biased class distribution, in: Proceedings of ECML01, Springer-Verlag, pp. 527-538.
26. M. Saerens, P. Latinne, and C. Decaestecker Adjusting the outputs of a classifier to new a priori probabilities a simple procedure Neural Comput. 14 2002 21 41
27. J. Xue, G. Weiss, Quantification and semi-supervised classification methods for handling changes in class distribution, in: Proceedings of ACM SIGKDD09, ACM, pp. 897-906.
28. R. Alaiz-Rodríguez, A. Guerrero-Curieses, and J. Cid-Sueiro Class and subclass probability re-estimation to adapt a classifier in the presence of concept drift Neurocomputing 74 2011 2614 2623
29. R. Alaiz-Rodríguez, A. Guerrero-Curieses, and J. Cid-Sueiro Minimax regret classifier for imprecise class distributions J. Mach. Learn. Res. 8 2007 103 130
30. E. Ramentol, Y. Caballero, R. Bello, and F. Herrera SMOTE-RSB a hybrid preprocessing approach based on oversampling and undersampling for high imbalanced data-sets using SMOTE and rough sets theory Knowl. Inf. Syst. 33 2012 245 265
31. A. Bella, C. Ferri, J. Hernández-Orallo, M. Ramírez-Quintana, Quantification via probability estimators, in: Proceedings of the Tenth IEEE International Conference on Data Mining, pp. 737-742.
32. T. Joachims, A support vector method for multivariate performance measures, in: Proceedings of ICML05, ACM, pp. 377-384.
33. K. Bache, M. Lichman, UCI machine learning repository, 2013.
34. G. Forman, Counting positives accurately despite inaccurate classification, in: Proceedings of ECML05, Springer-Verlag, 2005, pp. 564-575.
35. G. Forman, Quantifying trends accurately despite classifier error and class imbalance, in: Proceedings of ACM SIGKDD06, ACM, pp. 157-166.
36. C. van Rijsbergen Foundations of evaluation J. Doc. 30 1974 365 373
37. R. Barandela, J. Sánchez, V. García, and E. Rangel Strategies for learning in class imbalance problems Pattern Recognit. 36 2003 849 851
38. J. Barranquero, P. González, J. Díez, and J.J. del Coz On the study of nearest neighbour algorithms for prevalence estimation in binary problems Pattern Recognit. 46 2013 472 482
39. C.-C. Chang, and C.-J. Lin LIBSVM a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 2011 1 27
40. J. Demšar Statistical comparisons of classifiers over multiple data sets J. Mach. Learn. Res. 7 2006 1 30