Multi-conditional learning: Generative/discriminative training for clustering and classification

Proceedings of the National Conference on Artificial Intelligence

Volumn 1, Issue , 2006, Pages 433-439

  McCallum, Andrew ^a   Pal, Chris ^a   Druck, Greg ^a   Wang, Xuerui ^a  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION ERROR; DIRICHLET ALLOCATION; GENERATIVE PROBABILITY; MULTI CONDITIONAL LEARNING (MCL); TEXT DATA SETS;

DATA STRUCTURES; ERROR CORRECTION; MATHEMATICAL MODELS; PROBABILITY; REGRESSION ANALYSIS; ROBUSTNESS (CONTROL SYSTEMS);

LEARNING SYSTEMS;

EID: 33750699291     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Ando, R. K., & Zhang, T. (2005). A framework for learning predictive structures from multiple tasks and unlabeled data. Journal of Machine Learning Research, 6, 1817-1853.
2. Andrieu, C., de Freitas, N., Doucet, A., & Jordan, M. (2003). An introduction to MCMC for machine learning. Machine Learning, 50, 5-43.
3. Berger, A. L., Pietra, S. A. D., & Pietra, V. J. D. (1996). A maximum entropy approach to natural language processing. Computational Linguistics, 22, 39-72.
4. Besag, J. (1975). Statistical analysis of non-lattice data. The Statistician, 24, 179-195.
5. Blei, D., Ng, A., & Jordan, M. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3, 993-1022.
6. Corduneanu, A., & Jaakkola, T. (2003). On information regularization. Proceedings of Uncertainty in Artificial Intelligence.
7. Hinton, G. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14, 1771-1800.
8. Jebara, T., & Pentland, A. (1998). Maximum conditional likelihood via bound maximization and the CEM algorithm. In Neural Information Processing Systems (NIPS), II.
9. Jebara, T., & Pentland, A. (2000). On reversing Jensen's inequality. NIPS 13.
10. Jordan, M. I., & Jacobs, R. A. (1994). Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6, 181-214.
11. Kschischang, F. R., Frey, B., & Loeliger, H.-A. (2001). Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory, 47, 498-519.
12. Lafferty, J., McCallum, A., & Pereira, F. (2001). Conditional random fields: Probabilistic models for segmenting and labeling sequence data. Proc. ICML, 282-289.
13. McCallum, A., Bellare, K., & Pereira, F. (2005). A conditional random field for discriminatively-trained finite-state string edit distance. Conference on Uncertainty in AI (UAI).
14. Minka, T. (2005). Discriminative models, not discriminative training. MSR-TR-2005-144.
15. Ng, A. Y., & Jordan, M. (2002). On discriminative vs. generative classifiers: A comparison of logistic regression and naive Bayes. NIPS 14.
16. Nigam, K., McCallum, A. K., Thrun, S., & Mitchell, T. M. (2000). Text classification from labeled and unlabeled documents using EM. Machine Learning, 39, 103-134.
17. Pavlov, D., Popescul, A., Pennock, D., & Ungar, L. (2002). Mixtures of conditional maximum entropy models. NEC Research Institute Technical Report NECI.
18. Quattoni, A., Collins, M., & Darrell, T. (2004). Conditional random fields for object recognition. NIPS 17, 1097-1104.
19. Raina, R., Shen, Y., Ng, A. Y, & McCallum, A. (2003). Classification with hybrid generative/conditional models. NIPS.
20. Salakhutdinov, R., Roweis, S., & Ghahramani, Z. (2003). Optimization with EM and expectation-conjugate-gradient. Proc. ICML.
21. Smolensky, P. (1986). Information processing in dynamical systems: foundations of harmony theory. In D. Rumehart and J. McClelland (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition, volume 1: Foundations, 194-281. MIT Press.
22. Sutton, C, & McCallum, A. (2006). An introduction to conditional random fields for relational learning. In L. Getoor and B. Taskar (Eds.), Introduction to statistical relational learning. MIT Press. To appear.
23. Welling, M., Rosen-Zvi, M., & Hinton, G. (2005). Exponential family harmoniums with an application to information retrieval. NIPS, 1481-1488.
24. Xing, E., Yan, R., & Hauptmann, A. G. (2005). Mining associated text and images with dual-wing harmoniums. Proc. Uncertainty in Artificial Intelligence.