HC-Search: A learning framework for search-based structured prediction

Journal of Artificial Intelligence Research

Volumn 50, Issue , 2014, Pages 369-707

  Doppa, Janardhan Rao ^a   Fern, Alan ^a   Tadepalli, Prasad ^a  

^a Oregon State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COST FUNCTIONS; IMAGE SEGMENTATION; SEMANTICS;

BENCHMARK DOMAINS; IMITATION LEARNING; LEARNING FRAMEWORKS; PART OF SPEECH TAGGING; SEMANTIC SEGMENTATION; STATE-OF-THE-ART METHODS; STRUCTURED PREDICTION; TRAINING PROCEDURES;

FORECASTING;

EID: 84902808499     PISSN: None     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.4212     Document Type: Article

References (73)

1. Agarwal, S., & Roth, D. (2005). Learnability of Bipartite Ranking Functions. In Proceedings of International Conference on Learning Theory (COLT), pp. 16-31.
2. Batra, D., Yadollahpour, P., Guzmán-Rivera, A., & Shakhnarovich, G. (2012). Diverse M-Best Solutions in Markov Random Fields. In Proceedings of European Conference on Computer Vision (ECCV), pp. 1-16.
3. Boyan, J. A., & Moore, A. W. (2000). Learning Evaluation Functions to Improve Optimization by Local Search. Journal of Machine Learning Research (JMLR), 1, 77-112.
4. Brill, E. (1995). Transformation-Based Error-Driven Learning and Natural Language Processing: A Case Study in Part-of-Speech Tagging. Computational Linguistics, 21 (4), 543-565.
5. Chang, K.-W., Samdani, R., & Roth, D. (2013). A Constrained Latent Variable Model for Coreference Resolution. In Proceedings of Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 601-612.
6. Chang, M.-W., Ratinov, L.-A., & Roth, D. (2012). Structured Learning with Constrained Conditional Models. Machine Learning Journal (MLJ), 88 (3), 399-431.
7. Chen, C., Kolmogorov, V., Zhu, Y., Metaxas, D., & Lampert, C. H. (2013). Computing the M Most Probable Modes of a Graphical Model. In Proceedings of International Conference on Artificial Intelligence and Statistics (AISTATS).
8. Chen, S., Fern, A., & Todorovic, S. (2014). Multi-Object Tracking via Constrained Sequential Labeling. In To appear in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
9. Collins, M. (2000). Discriminative Reranking for Natural Language Parsing. In Proceedings of International Conference on Machine Learning (ICML), pp. 175-182.
10. Collins, M. (2002). Ranking Algorithms for Named Entity Extraction: Boosting and the Voted Perceptron. In ACL.
11. Crammer, K., Dekel, O., Keshet, J., Shalev-Shwartz, S., & Singer, Y. (2006). Online Passive-Aggressive Algorithms. Journal of Machine Learning Research (JMLR), 7, 551-585. (Pubitemid 43668115)
12. Daumé III, H. (2006). Practical Structured Learning Techniques for Natural Language Processing. Ph.D. thesis, University of Southern California, Los Angeles, CA.
13. Daumé III, H., & Marcu, D. (2005). Learning as Search Optimization: Approximate Large margin methods for Structured Prediction. In ICML.
14. Dietterich, T. G., Hild, H., & Bakiri, G. (1995). A Comparison of ID3 and Backpropagation for English Text-to-Speech Mapping. Machine Learning Journal (MLJ), 18 (1), 51-80.
15. Domke, J. (2013). Structured Learning via Logistic Regression. In Proceedings of Advances in Neural Information Processing Systems (NIPS), pp. 647-655.
16. Doppa, J. R., Fern, A., & Tadepalli, P. (2012). Output Space Search for Structured Prediction. In Proceedings of International Conference on Machine Learning (ICML).
17. Doppa, J. R., Fern, A., & Tadepalli, P. (2013). HC-Search: Learning Heuristics and Cost Functions for Structured Prediction. In Proceedings of AAAI Conference on Artificial Intelligence (AAAI).
18. Doppa, J. R., Fern, A., & Tadepalli, P. (2014a). Structured Prediction via Output Space Search. Journal of Machine Learning Research (JMLR), 15, 1317-1350.
19. Doppa, J. R., Yu, J., Ma, C., Fern, A., & Tadepalli, P. (2014b). HC-Search for Multi-Label Prediction: An Empirical Study. In To appear in Proceedings of AAAI Conference on Artificial Intelligence (AAAI).
20. Doppa, J. R., Yu, J., Tadepalli, P., & Getoor, L. (2009). Chance-Constrained Programs for Link Prediction. In Proceedings of NIPS Workshop on Analyzing Networks and Learning with Graphs.
21. Doppa, J. R., Yu, J., Tadepalli, P., & Getoor, L. (2010). Learning Algorithms for Link Prediction based on Chance Constraints. In Proceedings of European Conference on Machine Learning (ECML), pp. 344-360.
22. Felzenszwalb, P. F., & McAllester, D. A. (2007). The Generalized A* Architecture. Journal of Artificial Intelligence Research (JAIR), 29, 153-190.
23. Fern, A. (2010). Speedup Learning. In Encyclopedia of Machine Learning, pp. 907-911.
24. Fern, A., Yoon, S. W., & Givan, R. (2006). Approximate Policy Iteration with a Policy Language Bias: Solving Relational Markov Decision Processes. Journal of Artificial Intelligence Research (JAIR), 25, 75-118. (Pubitemid 43800043)
25. Goldberg, Y., & Elhadad, M. (2010). An Efficient Algorithm for Easy-First Non-Directional Dependency Parsing. In Proceedings of Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistic (HLT-NAACL), pp. 742-750.
26. Grubb, A., & Bagnell, D. (2012). SpeedBoost: Anytime Prediction with Uniform Near-Optimality. Journal of Machine Learning Research - Proceedings Track, 22, 458-466.
27. Hal Daumé III, Langford, J., & Marcu, D. (2009). Search-based Structured Prediction. Machine Learning Journal (MLJ), 75 (3), 297-325.
28. Harvey, W. D., & Ginsberg, M. L. (1995). Limited Discrepancy Search. In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), pp. 607-615.
29. Hazan, T., & Urtasun, R. (2012). Efficient Learning of Structured Predictors in General Graphical Models. CoRR, abs/1210.2346.
30. Hogen, K.-U., Simon, H.-U., & Horn, K. S. V. (1995). Robust Trainability of Single Neurons. Journal of Computer and System Sciences, 50 (1), 114-125.
31. Huang, L., Fayong, S., & Guo, Y. (2012). Structured Perceptron with Inexact Search. In Proceedings of Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics (HLT-NAACL), pp. 142-151.
32. Jiang, J., Teichert, A., Daumé III, H., & Eisner, J. (2012). Learned Prioritization for Trading Off Accuracy and Speed. In Proceedings of Advances in Neural Information Processing (NIPS).
33. Kääriäinen, M. (2006). Lower Bounds for Reductions. In Atomic Learning Workshop.
34. Keshet, J., Shalev-Shwartz, S., Singer, Y., & Chazan, D. (2005). Phoneme Alignment based on Discriminative Learning. In Proceedings of Annual Conference of the International Speech Communication Association (Interspeech), pp. 2961-2964.
35. Khardon, R. (1999). Learning to Take Actions. Machine Learning Journal (MLJ), 35 (1), 57-90.
36. Kulesza, A., & Taskar, B. (2012). Determinantal Point Processes for Machine Learning. Foundations and Trends in Machine Learning, 5 (2-3), 123-286.
37. Lafferty, J., McCallum, A., & Pereira, F. (2001). Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of International Conference on Machine Learning (ICML), pp. 282-289.
38. Lam, M., Doppa, J. R., Hu, X., Todorovic, S., Dietterich, T., Reft, A., & Daly, M. (2013). Learning to Detect Basal Tubules of Nematocysts in SEM Images. In ICCV Workshop on Computer Vision for Accelerated Biosciences (CVAB). IEEE.
39. Li, Q., Ji, H., & Huang, L. (2013). Joint Event Extraction via Structured Prediction with Global Features. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL), pp. 73-82.
40. McAllester, D. A., Hazan, T., & Keshet, J. (2010). Direct Loss Minimization for Structured Prediction. In Proceedings of Advances in Neural Information Processing Systems (NIPS), pp. 1594-1602.
41. Meshi, O., Sontag, D., Jaakkola, T., & Globerson, A. (2010). Learning Efficiently with Approximate Inference via Dual Losses. In Proceedings of International Conference on Machine Learning (ICML), pp. 783-790.
42. Mohan, A., Chen, Z., & Weinberger, K. Q. (2011). Web-Search Ranking with Initialized Gradient Boosted Regression trees. Journal of Machine Learning Research - Proceed-ings Track, 14, 77-89.
43. Nivre, J. (2008). Algorithms for Deterministic Incremental Dependency Parsing. Computational Linguistics, 34 (4), 513-553.
44. Park, D., & Ramanan, D. (2011). N-Best Maximal Decoders for Part Models. In Proccedings of IEEE International Conference on Computer Vision (ICCV), pp. 2627-2634.
45. Payet, N., & Todorovic, S. (2013). SLEDGE: Sequential Labeling of Image Edges for Boundary Detection. International Journal of Computer Vision (IJCV), 104 (1), 15-37.
46. Qian, X., Jiang, X., Zhang, Q., Huang, X., & Wu, L. (2009). Sparse Higher Order Conditional Random Fields for Improved Sequence Labeling. In Proceedings of International Conference on Machine Learning (ICML).
47. Read, J., Pfahringer, B., Holmes, G., & Frank, E. (2011). Classifier Chains for Multi-Label Classification. Machine Learning, 85 (3), 333-359.
48. Ross, S., & Bagnell, D. (2010). Efficient Reductions for Imitation Learning. Journal of Machine Learning Research - Proceedings Track, 9, 661-668.
49. Ross, S., Gordon, G. J., & Bagnell, D. (2011). A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning. Journal of Machine Learning Research - Proceedings Track, 15, 627-635.
50. Roth, D., & tau Yih, W. (2005). Integer Linear Programming Inference for Conditional Random Fields. In Proceedings of International Conference on Machine Learning (ICML), pp. 736-743.
51. Samdani, R., & Roth, D. (2012). Efficient Decomposed Learning for Structured Prediction. In Proceedings of International Conference on Machine Learning (ICML).
52. Sen, P., Namata, G., Bilgic, M., Getoor, L., Gallagher, B., & Eliassi-Rad, T. (2008). Collective Classification in Network Data. AI Magazine, 29 (3), 93-106.
53. Sontag, D., Meshi, O., Jaakkola, T., & Globerson, A. (2010). More data means less inference: A pseudo-max approach to structured learning. In Proceedings of Advances in Neural Information Processing Systems (NIPS), pp. 2181-2189.
54. Stoyanov, V., & Eisner, J. (2012). Easy-first Coreference Resolution. In Proceedings of International Conference on Computational Linguistics (COLING), pp. 2519-2534.
55. Stoyanov, V., Ropson, A., & Eisner, J. (2011). Empirical Risk Minimization of Graphical Model Parameters Given Approximate Inference, Decoding, and Model Structure. In Proceedings of International Conference on Artificial Intelligence and Statistics (AISTATS), pp. 725-733.
56. Sutton, C. A., & McCallum, A. (2009). Piecewise Training for Structured Prediction. Machine Learning Journal (MLJ), 77 (2-3), 165-194.
57. Syed, U., & Schapire, R. (2010). A Reduction from Apprenticeship Learning to Classification. In Proceedings of Advances in Neural Information Processing Systems (NIPS), pp. 2253-2261.
58. Taskar, B., Guestrin, C., & Koller, D. (2003). Max-Margin Markov Networks. In Proceedings of Advances in Neural Information Processing Systems (NIPS).
59. Tsochantaridis, I., Hofmann, T., Joachims, T., & Altun, Y. (2004). Support Vector Machine Learning for Interdependent and Structured Output Spaces. In Proceedings of International Conference on Machine Learning (ICML).
60. Tsochantaridis, I., Joachims, T., Hofmann, T., & Altun, Y. (2005). Large Margin Methods for Structured and Interdependent Output Variables. Journal of Machine Learning Research (JMLR), 6, 1453-1484.
61. Vogel, J., & Schiele, B. (2007). Semantic Modeling of Natural Scenes for Content-Based Image Retrieval. International Journal of Computer Vision (IJCV), 72 (2), 133-157. (Pubitemid 46094757)
62. Weiss, D. (2014). Structured Prediction Cascades code. http://code.google.com/p/structured-cascades/.
63. Weiss, D., Sapp, B., & Taskar, B. (2010). Sidestepping Intractable Inference with Structured Ensemble Cascades. In Proceedings of Advances in Neural Information Processing Systems (NIPS), pp. 2415-2423.
64. Weiss, D., & Taskar, B. (2010). Structured Prediction Cascades. Journal of Machine Learning Research - Proceedings Track, 9, 916-923.
65. Wick, M. L., Rohanimanesh, K., Bellare, K., Culotta, A., & McCallum, A. (2011). SampleRank: Training Factor Graphs with Atomic Gradients. In Proceedings of International Conference on Machine Learning (ICML).
66. Wick, M. L., Rohanimanesh, K., Singh, S., & McCallum, A. (2009). Training Factor Graphs with Reinforcement Learning for Efficient MAP Inference. In Proceedings of Advances in Neural Information Processing Systems (NIPS), pp. 2044-2052.
67. Xu, Y., Fern, A., & Yoon, S. (2009a). Learning Linear Ranking Functions for Beam Search with Application to planning. The Journal of Machine Learning Research, 10, 1571-1610.
68. Xu, Y., Fern, A., & Yoon, S. W. (2009b). Learning Linear Ranking Functions for Beam Search with Application to Planning. Journal of Machine Learning Research (JMLR), 10, 1571-1610.
69. Xu, Y., Fern, A., & Yoon, S. W. (2010). Iterative Learning of Weighted Rule Sets for Greedy Search. In Proceedings of International Conference on Automated Planning and Systems (ICAPS), pp. 201-208.
70. Xu, Z.,Weinberger, K., & Chapelle, O. (2012). The Greedy Miser: Learning under Test-time Budgets. In Proceedings of International Conference on Machine Learning (ICML).
71. Ye, N., Lee, W. S., Chieu, H. L., & Wu, D. (2009). Conditional Random Fields with High-Order Features for Sequence Labeling. In Proceedings of Advances in Neural Information Processing Systems (NIPS), pp. 2196-2204.
72. Yu, H., Huang, L., Mi, H., & Zhao, K. (2013). Max-Violation Perceptron and Forced Decoding for Scalable MT Training. In Proceedings of Empirical Methods in Natural Language Processing (EMNLP), pp. 1112-1123.
73. Zhang, W., & Dietterich, T. G. (1995). A Reinforcement Learning Approach to job-shop Scheduling. In Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), pp. 1114-1120.