An asymptotic analysis of generative, discriminative, and pseudolikelihood estimators

Proceedings of the 25th International Conference on Machine Learning

Volumn , Issue , 2008, Pages 584-591

  Liang, Percy ^a   Jordan, Michael I ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MACHINE LEARNING; LEARNING SYSTEMS; PARAMETER ESTIMATION; ROBOT LEARNING;

MODEL MISSPECIFICATION; PARAMETER ESTIMATORS; PSEUDO-LIKELIHOOD; UNIFIED FRAMEWORK;

ASYMPTOTIC ANALYSIS;

MISSPECIFICATION; PARAMETER ESTIMATORS; PSEUDO LIKELIHOODS; UNIFIED FRAMEWORKS;

EID: 56449098139     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1390156.1390230     Document Type: Conference Paper

References (14)

1. Besag, J. (1975). The analysis of non-lattice data. The Statistician, 24, 179-195.
2. Bouchard, G., & Triggs, B. (2004). The trade-off between generative and discriminative classifiers. International Conference on Computational Statistics (pp. 721-728).
3. Lafferty, J., McCallum, A., & Pereira, F. (2001). Conditional random fields: Probabilistic models for segmenting and labeling data. International Conference on Machine Learning (ICML).
4. Lasserre, J. A., Bishop, C. M., & Minka, T. P. (2006). Principled hybrids of generative and discriminative models. Computer Vision and Pattern Recognition (CVPR) (pp. 87-94).
5. Liang, P., Klein, D., & Jordan, M. I. (2008). Agreement-based learning. Advances in Neural Information Processing Systems (NIPS).
6. Lindsay, B. (1988). Composite likelihood methods. Contemporary Mathematics, 80, 221-239.
7. McCallum, A., Pal, C., Druck, G., & Wang, X. (2006). Multi-conditional learning: Generative/discriminative training for clustering and classification. Association for the Advancement of Artificial Intelligence (AAAI).
8. Ng, A. Y., & Jordan, M. I. (2002). On discriminative vs. generative classifiers: A comparison of logistic regression and naive Bayes. Advances in Neural Information Processing Systems (NIPS).
9. Sutton, C., & McCallum, A. (2005). Piecewise training of undirected models. Uncertainty in Artificial Intelligence (UAI).
10. van der Vaart, A. W. (1998). Asymptotic Statistics. Cambridge University Press.
11. Varin, C. (2008). On composite marginal likelihoods. Advances in Statistical Analysis, 92, 1-28.
12. Wainwright, M. (2006). Estimating the "wrong" graphical model: Benefits in the computation-limited setting. Journal of Machine Learning Research, 7, 1829-1859.
13. Wainwright, M., Jaakkola, T., & Willsky, A. (2003). Tree-reweighted belief propagation algorithms and approximate ML estimation by pseudo-moment matching. Artificial Intelligence and Statistics (AISTATS).
14. Wainwright, M., " Jordan, M. I. (2003). Graphical models, exponential families, and variational inference (Technical Report). Department of Statistics, University of California at Berkeley.