Using Asymmetric Distributions to Improve Text Classifier Probability Estimates

SIGIR Forum (ACM Special Interest Group on Information Retrieval)

Volumn , Issue SPEC. ISS., 2003, Pages 111-118

  Bennett, Paul N ^a  

^a Carnegie Mellon University   (United States)

Author keywords

Active learning; Classifier combination; Cost sensitive learning; Text classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL METHODS; COSTS; DATA REDUCTION; DECISION MAKING; INFORMATION RETRIEVAL; LEARNING SYSTEMS; MATHEMATICAL MODELS; PARAMETER ESTIMATION; PROBABILITY DISTRIBUTIONS; VECTOR QUANTIZATION;

ACTIVE LEARNING; ASYMMETRIC DISTRIBUTION; CLASSIFIER COMBINATION; COST-SENSITIVE LEARNING; TEXT CLASSIFICATION;

TEXT PROCESSING;

EID: 1542347788     PISSN: 01635840     EISSN: None     Source Type: Journal    
DOI: 10.1145/860454.860457     Document Type: Conference Paper

References (27)

1. P. N. Bennett. Assessing the calibration of naive bayes' posterior estimates. Technical Report CMU-CS-00-155, Carnegie Mellon, School of Computer Science, 2000.
2. P. N. Bennett. Using asymmetric distributions to improve classifier probabilities: A comparison of new and standard parametric methods. Technical Report CMU-CS-02-126, Carnegie Mellon, School of Computer Science, 2002.
3. H. Bourlard and N. Morgan. A continuous speech recognition system embedding mlp into hmm. In NIPS '89, 1989.
4. G. Brier. Verification of forecasts expressed in terms of probability. Monthly Weather Review, 78:1-3, 1950.
5. M. H. DeGroot and S. E. Fienberg. The comparison and evaluation of forecasters. Statistician, 32:12-22, 1983.
6. M. H. DeGroot and S. E. Fienberg. Comparing probability forecasters: Basic binary concepts and multivariate extensions. In P. Goel and A. Zellner, editors, Bayesian Inference and Decision Techniques. Elsevier Science Publishers B.V., 1986.
7. P. Domingos and M. Pazzani. Beyond independence: Conditions for the optimality of the simple bayesian classifier. In ICML '96, 1996.
8. R. Duda, P. Hart, and D. Stork. Pattern Classification, John Wiley & Sons, Inc., 2001.
9. S. T. Dumais and H. Chen. Hierarchical classification of web content. In SIGIR '00, 2000.
10. S. T. Dumais, J. Platt, D. Heckerman, and M. Sahami. Inductive learning algorithms and representations for text categorization. In CIKM '98, 1998.
11. Y. Freund and R. Schapire. Large margin classification using the perceptron algorithm. Machine Learning, 37(3):277-296, 1999.
12. I. Good. Rational decisions. Journal of the Royal Statistical Society, Series B, 1952.
13. T. Joachims. Text categorization with support vector machines: Learning with many relevant features. In ECML '98, 1998.
14. S. Kotz, T. J. Kozubowski, and K. Podgorski. The Laplace Distribution and Generalizations: A Revisit with Applications to Communications, Economics, Engineering, and Finance. Birkähuser, 2001.
15. D. D. Lewis. A sequential algorithm for training text classifiers: Corrigendum and additional data. SIGIR Forum, 29(2):13-19, Fall 1995.
16. D. D. Lewis. Reuters-21578, distribution 1.0. http://www.daviddlewis.com/resources/testcollections/reuters21578, January 1997.
17. D. D. Lewis and W. A. Gale. A sequential algorithm for training text classifiers. In SIGIR '94, 1994.
18. D. D. Lewis, R. E. Schapire, J. P. Callan, and R. Papka. Training algorithms for linear text classifiers. In SIGIR '96, 1996.
19. D. Lindley, A. Tversky, and R. Brown. On the reconciliation of probability assessments. Journal of the Royal Statistical Society, 1979.
20. R. Manmatha, T. Rath, and F. Feng. Modeling score distributions for combining the outputs of search engines. In SIGIR '10, 2001.
21. A. McCallum and K. Nigam. A comparison of event models for naive bayes text classification. In AAAI '98, Workshop on Learning for Text Categorization, 1998.
22. J. C. Platt. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In A. J. Smola, P. Bartlett, B. Scholkopf, and D. Schuurmans, editors, Advances in Large Margin Classifiers. MIT Press, 1999.
23. M. Saar-Tsechansky and F. Provost. Active learning for class probability estimation and ranking. In IJCAI '01, 2001.
24. R. L. Winkler. Scoring rules and the evaluation of probability assessors. Journal of the American Statistical Association, 1969.
25. Y. Yang and X. Liu. A re-examination of text categorization methods. In SIGIR '99, 1999.
26. B. Zadrozny and C. Elkan. Obtaining calibrated probability estimates from decision trees and naive bayesian classifiers. In ICML '01, 2001.
27. B. Zadrozny and C. Elkan. Reducing multiclass to binary by coupling probability estimates. In KDD '02, 2002.