Structured prediction via output space search

Journal of Machine Learning Research

Volumn 15, Issue , 2014, Pages 1317-1350

  Doppa, Janardhan Rao ^a   Fern, Alan ^a   Tadepalli, Prasad ^a  

^a Oregon State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; COST FUNCTIONS;

BENCHMARK DOMAINS; CLASSIFICATION LEARNING; FUNCTION LEARNING; LOSS FUNCTIONS; SEARCH PROCEDURES; SPEED IMPROVEMENT; STRUCTURED PREDICTION; TECHNICAL CONTRIBUTION;

FORECASTING;

EID: 84901623144     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (50)

1. Dhruv Batra, Payman Yadollahpour, Abner Guzmfian-Rivera, and Gregory Shakhnarovich. Diverse m-best solutions in Markov random fields. In Proceedings of European Conference on Computer Vision (ECCV), pages 1-16, 2012.
2. Justin A. Boyan and Andrew W. Moore. Learning evaluation functions to improve optimization by local search. Journal of Machine Learning Research (JMLR), 1:77-112, 2000.
3. Ming-Wei Chang, Lev-Arie Ratinov, and Dan Roth. Structured learning with constrained conditional models. Machine Learning Journal (MLJ), 88(3):399-431, 2012.
4. Chao Chen, Vladimir Kolmogorov, Yan Zhu, Dimitris Metaxas, and Christoph H. Lampert. Computing the M most probable modes of a graphical model. In Proceedings of International Conference on Artificial Intelligence and Statistics (AISTATS), 2013.
5. Michael Collins. Ranking algorithms for named entity extraction: Boosting and the voted perceptron. In Proceedings of Association of Computational Linguistics (ACL) Confer-ence, 2002.
6. Koby Crammer, Ofer Dekel, Joseph Keshet, Shai Shalev-Shwartz, and Yoram Singer. Online passive-aggressive algorithms. Journal of Machine Learning Research (JMLR), 7:551-585, 2006. (Pubitemid 43668115)
7. Hal Daumfie III. Practical Structured Learning Techniques for Natural Language Processing. PhD thesis, University of Southern California, Los Angeles, CA, 2006.
8. Thomas G. Dietterich, Hermann Hild, and Ghulum Bakiri. A comparison of ID3 and backpropagation for English text-to-speech mapping. Machine Learning Journal (MLJ), 18(1):51-80, 1995.
9. Justin Domke. Structured learning via logistic regression. In Advances in Neural Informa-tion Processing Systems (NIPS), pages 647-655, 2013.
10. Janardhan Rao Doppa, Alan Fern, and Prasad Tadepalli. Output space search for structured prediction. In Proceedings of International Conference on Machine Learning (ICML), 2012.
11. Janardhan Rao Doppa, Alan Fern, and Prasad Tadepalli. HC-Search: Learning heuristics and cost functions for structured prediction. In Proceedings of AAAI Conference on Artificial Intelligence (AAAI), 2013.
12. Janardhan Rao Doppa, Alan Fern, and Prasad Tadepalli. HC-Search: A learning framework for search-based structured prediction. To appear in Journal of Artificial Intelligence Research (JAIR), 2014.
13. Pedro F. Felzenszwalb and David A. McAllester. The generalized Aarchitecture. Journal of Artificial Intelligence Research (JAIR), 29:153-190, 2007.
14. Alan Fern, Sung Wook Yoon, and Robert Givan. Approximate policy iteration with a policy language bias: Solving relational Markov decision processes. Journal of Artificial Intelligence Research (JAIR), 25:75-118, 2006. (Pubitemid 43800043)
15. Alexander Grubb and Drew Bagnell. Speedboost: Anytime prediction with uniform nearoptimality. Journal of Machine Learning Research - Proceedings Track, 22:458-466, 2012.
16. Hal Daumfie III and Daniel Marcu. Learning as search optimization: Approximate large margin methods for structured prediction. In Proceedings of International Conference on Machine Learning (ICML), 2005.
17. Hal Daumfie III, John Langford, and Daniel Marcu. Search-based structured prediction. Machine Learning Journal (MLJ), 75(3):297-325, 2009.
18. William D. Harvey and Matthew L. Ginsberg. Limited discrepancy search. In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), pages 607-615, 1995.
19. Tamir Hazan and Raquel Urtasun. Efficient learning of structured predictors in general graphical models. CoRR, abs/1210.2346, 2012.
20. Liang Huang, Suphan Fayong, and Yang Guo. Structured perceptron with inexact search. In Proceedings of Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics (HLT-NAACL), pages 142-151, 2012.
21. Matti K-a-ari-ainen. Lower bounds for reductions. In Atomic Learning Workshop, 2006.
22. Joseph Keshet, Shai Shalev-Shwartz, Yoram Singer, and Dan Chazan. Phoneme alignment based on discriminative learning. In Proceedings of Annual Conference of the Interna- tional Speech Communication Association (Interspeech), pages 2961-2964, 2005.
23. Alex Kulesza and Ben Taskar. Determinantal point processes for machine learning. Foun-dations and Trends in Machine Learning, 5(2-3):123-286, 2012.
24. John Lafierty, Andrew McCallum, and Fernando Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of International Conference on Machine Learning (ICML), pages 282-289, 2001.
25. Michael Lam, Janardhan Rao Doppa, Xu Hu, Sinisa Todorovic, Thomas Dietterich, Abigail Reft, and Marymegan Daly. Learning to detect basal tubules of nematocysts in SEM images. In Proceedings of ICCV Workshop on Computer Vision for Accelerated Biosciences (CVAB). IEEE, 2013.
26. David A. McAllester, Tamir Hazan, and Joseph Keshet. Direct loss minimization for structured prediction. In Advances in Neural Information Processing Systems (NIPS), pages 1594-1602, 2010.
27. Ofer Meshi, David Sontag, Tommi Jaakkola, and Amir Globerson. Learning efficiently with approximate inference via dual losses. In Proceedings of International Conference on Machine Learning (ICML), pages 783-790, 2010.
28. Dennis Park and Deva Ramanan. N-best maximal decoders for part models. In Proccedings of IEEE International Conference on Computer Vision (ICCV), pages 2627-2634, 2011.
29. Xian Qian, Xiaoqian Jiang, Qi Zhang, Xuanjing Huang, and Lide Wu. Sparse higher order conditional random fields for improved sequence labeling. In Proceedings of International Conference on Machine Learning (ICML), 2009.
30. Stfiephane Ross and Drew Bagnell. Efficient reductions for imitation learning. Journal of Machine Learning Research - Proceedings Track, 9:661-668, 2010.
31. Stffiephane Ross, Geoffirey J. Gordon, and Drew Bagnell. A reduction of imitation learning and structured prediction to no-regret online learning. Journal of Machine Learning Research - Proceedings Track, 15:627-635, 2011.
32. Dan Roth and Wen tau Yih. Integer linear programming inference for conditional random fields. In Proceedings of International Conference on Machine Learning (ICML), pages 736-743, 2005.
33. Rajhans Samdani and Dan Roth. Efficient decomposed learning for structured prediction. In Proceedings of International Conference on Machine Learning (ICML), 2012.
34. Terrence J. Sejnowski and Charles R. Rosenberg. Parallel networks that learn to pronounce English text. Complex Systems, 1:145-168, 1987.
35. David Sontag, Ofer Meshi, Tommi Jaakkola, and Amir Globerson. More data means less inference: A pseudo-max approach to structured learning. In Advances in Neural Infor-mation Processing Systems (NIPS), pages 2181-2189, 2010.
36. Veselin Stoyanov, Alexander Ropson, and Jason Eisner. Empirical risk minimization of graphical model parameters given approximate inference, decoding, and model structure. In Proceedings of International Conference on Artificial Intelligence and Statistics (AISTATS), pages 725-733, 2011.
37. Charles A. Sutton and Andrew McCallum. Piecewise training for structured prediction. Machine Learning Journal (MLJ), 77(2-3):165-194, 2009.
38. Umar Syed and Rob Schapire. A reduction from apprenticeship learning to classification. In Advances in Neural Information Processing Systems (NIPS), pages 2253-2261, 2010.
39. Benjamin Taskar, Carlos Guestrin, and Daphne Koller. Max-margin Markov networks. In Advances in Neural Information Processing Systems (NIPS), 2003.
40. Ioannis Tsochantaridis, Thomas Hofmann, Thorsten Joachims, and Yasemin Altun. Support vector machine learning for interdependent and structured output spaces. In Proceedings of International Conference on Machine Learning (ICML), 2004.
41. Ioannis Tsochantaridis, Thorsten Joachims, Thomas Hofmann, and Yasemin Altun. Large margin methods for structured and interdependent output variables. Journal of Machine Learning Research (JMLR), 6:1453-1484, 2005.
42. Julia Vogel and Bernt Schiele. Semantic modeling of natural scenes for content-based image retrieval. International Journal of Computer Vision (IJCV), 72(2):133-157, 2007. (Pubitemid 46094757)
43. David Weiss and Benjamin Taskar. Structured prediction cascades. Journal of Machine Learning Research - Proceedings Track, 9:916-923, 2010.
44. David Weiss, Ben Sapp, and Ben Taskar. Sidestepping intractable inference with structured ensemble cascades. In Advances in Neural Information Processing Systems (NIPS), pages 2415-2423, 2010.
45. Michael L. Wick, Khashayar Rohanimanesh, Kedar Bellare, Aron Culotta, and Andrew McCallum. Samplerank: Training factor graphs with atomic gradients. In Proceedings of International Conference on Machine Learning (ICML), 2011.
46. Yuehua Xu, Alan Fern, and Sung Wook Yoon. Learning linear ranking functions for beam search with application to planning. Journal of Machine Learning Research (JMLR), 10: 1571-1610, 2009.
47. Zhixiang Xu, Kilian Weinberger, and Olivier Chapelle. The greedy miser: Learning under test-time budgets. In Proceedings of International Conference on Machine Learning (ICML), 2012.
48. Nan Ye, Wee Sun Lee, Hai Leong Chieu, and Dan Wu. Conditional random fields with high-order features for sequence labeling. In Advances in Neural Information Processing Systems (NIPS), pages 2196-2204, 2009.
49. Heng Yu, Liang Huang, Haitao Mi, and Kai Zhao. Max-violation perceptron and forced decoding for scalable MT training. In Proceedings of Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1112-1123, 2013.
50. Wei Zhang and Thomas G. Dietterich. A reinforcement learning approach to job-shop scheduling. In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), pages 1114-1120, 1995.