SampleRank: Training factor graphs with atomic gradients

Proceedings of the 28th International Conference on Machine Learning, ICML 2011

Volumn , Issue , 2011, Pages 777-784

  Wick, Michael ^a   Rohanimanesh, Khashayar ^b   Bellare, Kedar ^a   Culotta, Aron ^c   McCallum, Andrew ^a  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

^b EBAY INC   (United States)

^c SOUTHEASTERN LOUISIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONTRASTIVE DIVERGENCE; COREFERENCE; ERROR REDUCTION; ESTIMATING PARAMETERS; GRAPHICAL MODEL; LOSS FUNCTIONS; STOCHASTIC GRADIENT; TRAINING FACTOR;

LEARNING SYSTEMS;

EID: 80053457712     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Bagga, Amit and Baldwin, Breck. Algorithms for scoring coreference chains. In In The First International Conference on Language Resources and Evaluation Workshop on Linguistics Coreference, pp. 563-566, 1998.
2. Bertsekas, D.P. and Tsitsiklis, John N. Gradient convergence in gradient methods. Technical Report P2404, LIDS, 1997.
3. Calafiore, G. and Campi, M. C. Uncertain convex programs: Randomized solutions and confidence levels. Mathematical Programming, 102:25-46, 2005. (Pubitemid 40134690)
4. Crammer, Koby, Dekel, Ofer, Keshet, Joseph, Shalev-Shwartz, Shai, and Singer, Yoram. Online passive-aggressive algorithms. Journal of Machine Learning Research, 7:551-585, 2006. ISSN 1533-7928.
5. Culotta, Aron, Wick, Michael, Hall, Robert, and McCallum, Andrew. First-order probabilistic models for coreference resolution. In Proc. Human Language Technologies, 2007.
6. Farias, D. P. De and Roy, B. Van. On constraint sampling in the linear programming approach to approximate dynamic programming. Math. of Op. Research, 29(3):462-478, 2004.
7. Finley, T. and Joachims, T. Training structural SVMs when exact inference is intractable. In Proc International Conference on Machine Learning (ICML), pp. 304-311, 2008.
8. Hinton, Geoffrey E. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8): 1771-1800, 2002. ISSN 0899-7667.
9. Joachims, Thorsten, Finley, Thomas, and Yu, Chun-Nam John. Cutting-plane training of structural svms. Machine Learning, 77(1):27-59, 2009.
10. Kulesza, Alex and Pereira, Fernando. Structured learning with approximate inference. In Adv. Neural Inf. Proc. Sys., 2007.
11. McAllester, David, Hazan, Tamir, and Keshet, Koseph. Direct loss minimization for structured prediction. In Proc International Conference on Machine Learning, 2010.
12. Meshi, O., Sontag, D., Jaakkola, T., and Globerson, A. Learning Efficiently with Approximate Inference via Dual Losses. In Proc. International Conference on Machine Learning, 2010.
13. Milch, Brian, Marthi, Bhaskara, and Russell, Stuart. BLOG: Relational Modeling with Unknown Objects. PhD thesis, University of California, Berkeley, 2006.
14. Nemirovski, Arkadi and Rubinstein, Reuven Y. An efficient stochastic approximation algorithm for stochastic saddle point problems. Technical report, Technion, 1996.
15. Rohanimanesh, Khashayar, Wick, Michael, and McCallum, Andrew. Inference and learning in large factor graphs with adaptive proposal distributions. Technical Report #UM-CS-2009-028, University of Massachusetts, Amherst, 2009.
16. Salakhutdinov, Ruslan. Learning in markov random fields using tempered transitions. In Adv. Neur. Inf. Proc. Sys., 2009.
17. Sarawagi, Sunita and Gupta, Rahul. Accurate max-margin training for structured output spaces. In Proc. International Conference on Machine Learning, 2008.
18. Shalev-Shwartz, Shai, Singer, Yoram, and Srebro, Nathan. Pegasos: Primal Estimated sub-GrAdient SOlver for SVM. In Proc. International Conference on Machine Learning, 2007.
19. Sutton, Richard S. and Barto, Andrew G. Reinforcement Learning: An Introduction. MIT Press, 1998. ISBN 0262193981.
20. Taskar, Ben, Guestrin, Carlos, and Koller, Daphne. Max-margin markov network. In Adv. Neur. Inf. Proc. Sys., 2003.
21. Tieleman, Tijmen. Training restricted boltzmann machines using approximations to the likelihood gradient. In Proc. International Conference on Machine Learning, pp. 1064-1071, 2008.
22. Tsochantaridis, I., Hofmann, T., Joachims, T., and Altun, Y. Support vector machine learning for interdependent and structured output spaces. In Proc. Int. Conf. Mach. Learn., 2004.