Interpretation of hybrid generative/discriminative algorithms

Neurocomputing

Volumn 72, Issue 7-9, 2009, Pages 1648-1655

  Xue, Jing Hao ^a,b   Titterington, D Michael ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Hybrid generative discriminative models; Probabilistic generative and discriminative approaches; Statistical modelling and learning

Indexed keywords

BAYES CLASSIFIERS; CONDITIONAL PROBABILITIES; COVARIANCE MATRICES; DIAGONAL MATRIXES; GENERATION PROCESS; GENERATIVE MODELS; HYBRID ALGORITHMS; HYBRID GENERATIVE/DISCRIMINATIVE MODELS; HYBRID MODELLING; LEARNING TECHNIQUES; LOGISTIC REGRESSIONS; LOSS FUNCTIONS; MULTI CLASS; POSTERIOR PROBABILITIES; PROBABILISTIC GENERATIVE AND DISCRIMINATIVE APPROACHES; REAL-WORLD DATUM; SIMULATION STUDIES; STATISTICAL MODELLING AND LEARNING; TEXT CLASSIFICATIONS;

CIRCUIT THEORY; CLASSIFIERS; COVARIANCE MATRIX; DISCRIMINANT ANALYSIS; EDUCATION; LEARNING SYSTEMS; LOGISTICS; NEURAL NETWORKS; REGRESSION ANALYSIS; TEXT PROCESSING;

LEARNING ALGORITHMS;

ALGORITHM; ANALYTICAL PARAMETERS; ARTICLE; BAYES THEOREM; CLASSIFIER; DATA ANALYSIS; DISCRIMINANT ANALYSIS; HYBRID; LINEAR SYSTEM; LOGISTIC REGRESSION ANALYSIS; PRIORITY JOURNAL; PROBABILITY; SIMULATION; STATISTICAL MODEL;

EID: 61849157763     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2008.08.009     Document Type: Article

References (13)

1. A. Asuncion, D.J. Newman, UCI machine learning repository, University of California, School of Information and Computer Science, Irvine, CA 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉.
2. G. Bouchard, B. Triggs, The tradeoff between generative and discriminative classifiers, in: IASC International Symposium on Computational Statistics (COMPSTAT), Prague, 2004, pp. 721-728.
3. Dawid A.P. Properties of diagnostic data distributions. Biometrics 32 3 (1976) 647-658
4. Efron B. The efficiency of logistic regression compared to normal discriminant analysis. J. Am. Stat. Assoc. 70 352 (1975) 892-898
5. Fujino A., Ueda N., and Saito K. A hybrid generative/discriminative approach to text classification with additional information. Inf. Process. Manage. 43 2 (2007) 379-392
6. Hand D.J. Classifier technology and illusion of progress (with discussion). Statistical Science 21 1 (2006) 1-34
7. Hand D.J., and Yu K. Idiot's Bayes-not so stupid after all?. International Statistical Review 69 3 (2001) 385-398
8. A. McCallum, C. Pal, G. Druck, X. Wang, Multi-conditional learning: generative/discriminative training for clustering and classification, in: AAAI, 2006, pp. 433-439.
9. A.Y. Ng, M.I. Jordan, On discriminative vs. generative classifiers: a comparison of logistic regression and naive Bayes, in: NIPS, 2001.
10. R. Raina, Y. Shen, A.Y. Ng, A. McCallum, Classification with hybrid generative/discriminative models, in: NIPS, 2003.
11. Y.D. Rubinstein, T. Hastie, Discriminative vs. informative learning, in: KDD, 1997, pp. 49-53.
12. Titterington D.M., Murray G.D., Murray L.S., Spiegelhalter D.J., Skene A.M., Habbema J.D.F., and Gelpke G.J. Comparison of discrimination techniques applied to a complex data set of head injured patients (with discussion). J. R. Stat. Soc. Ser. A (General) 144 2 (1981) 145-175
13. J.-H. Xue, D.M. Titterington, On the generative-discriminative tradeoff approach: interpretation, asymptotic efficiency and classification performance, Technical Report, Department of Statistics, University of Glasgow, 2008.