On the generative-discriminative tradeoff approach: Interpretation, asymptotic efficiency and classification performance

Computational Statistics and Data Analysis

Volumn 54, Issue 2, 2010, Pages 438-451

  Xue, Jing Hao ^a,b   Titterington, D Michael ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ASYMPTOTIC EFFICIENCY; CLASSIFICATION PERFORMANCE; DISCRIMINATIVE APPROACH; DISCRIMINATIVE COMPONENTS; GENERATIVE MODEL; HYBRID APPROACH; LINEAR DISCRIMINANT ANALYSIS; LINEAR NORMALS; LOGISTIC REGRESSIONS; MISSPECIFICATION; OPTIMISATIONS; SIMULATED DATASETS;

ASYMPTOTIC ANALYSIS; COMMUNICATION CHANNELS (INFORMATION THEORY); DISCRIMINANT ANALYSIS;

LUNAR SURFACE ANALYSIS;

EID: 70350569278     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2009.09.011     Document Type: Article

References (20)

1. Asuncion, A., Newman, D.J., 2007. UCI machine learning repository. University of California, School of Information and Computer Science, Irvine, CA, http://www.ics.uci.edu/~mlearn/MLRepository.html
2. Bishop C.M., and Lasserre J. Generative or Discriminative? Getting the Best of Both Worlds (with discussion). Bayesian Statistics vol. 8 (2007), Oxford University Press 3-24
3. Bouchard, G., 2005. Generative models in supervised statistical learning with applications to digital image categorization and structural reliability. Ph.D. thesis, INRIA
4. Bouchard G. Bias-variance tradeoff in hybrid generative-discriminative models. ICMLA (2007), IEEE Computer Society 124-129
5. Bouchard G., and Triggs B. The tradeoff between generative and discriminative classifiers. COMPSTAT (2004), Physica-Verlag 721-728
6. Dawid A.P. Properties of diagnostic data distributions. Biometrics 32 3 (1976) 647-658
7. Druck G., Pal C., Zhu X., and McCallum A. Semi-supervised classification with hybrid generative/discriminative methods. KDD (2007), ACM 280-289
8. Efron B. The efficiency of logistic regression compared to normal discriminant analysis. Journal of the American Statistical Association 70 352 (1975) 892-898
9. Fujino A., Ueda N., and Saito K. A hybrid generative/discriminative approach to text classification with additional information. Information Processing and Management 43 2 (2007) 379-392
10. Kim J.-H. Estimating classification error rate: Repeated cross-validation, repeated hold-out and bootstrap. Computational Statistics & Data Analysis 53 11 (2009) 3735-3745
11. McCallum A., Pal C., Druck G., and Wang X. Multi-conditional learning: Generative/discriminative training for clustering and classification. AAAI (2006), AAAI Press 433-439
12. Ng A.Y., and Jordan M.I. On discriminative vs. generative classifiers: A comparison of logistic regression and naive Bayes. NIPS (2001), MIT Press 841-848
13. O'Neill T.J. The general distribution of the error rate of a classification procedure with application to logistic regression discrimination. Journal of the American Statistical Association 75 369 (1980) 154-160
14. Raina R., Shen Y., Ng A.Y., and McCallum A. Classification with hybrid generative/discriminative models. NIPS (2003), MIT Press
15. Rubinstein, Y.D., 1998. Discriminative vs informative learning. Ph.D. thesis, Stanford University
16. Rubinstein Y.D., and Hastie T. Discriminative vs. informative learning. KDD (1997), AAAI Press 49-53
17. Suzuki J., Fujino A., and Isozaki H. Semi-supervised structured output learning based on a hybrid generative and discriminative approach. EMNLP-CoNLL (2007), Association for Computational Linguistics 791-800
18. Titterington D.M., Murray G.D., Murray L.S., Spiegelhalter D.J., Skene A.M., Habbema J.D.F., and Gelpke G.J. Comparison of discrimination techniques applied to a complex data set of head injured patients (with discussion). Journal of the Royal Statistical Society. Series A (General) 144 2 (1981) 145-175
19. Xue J.-H., and Titterington D.M. Comment on discriminative vs. generative classifiers: A comparison of logistic regression and naive Bayes. Neural Processing Letters 28 3 (2008) 169-187
20. Xue J.-H., and Titterington D.M. Interpretation of hybrid generative/discriminative algorithms. Neurocomputing 72 7-9 (2009) 1648-1655