Learning policies for contextual submodular prediction

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 3, 2013, Pages 2401-2409

  Ross, Stephane ^a   Zhou, Jiaji ^a   Yue, Yisong ^a   Dey, Debadeepta ^a   Bagnell, J Andrew ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FORECASTING; LEARNING SYSTEMS;

DOCUMENT SUMMARIZATION; NEWS RECOMMENDATION; NO-REGRET LEARNING; PERFORMANCE GUARANTEES; PREDICTION PROBLEM; SUBMODULAR OPTIMIZATIONS; TRAJECTORY OPTIMIZATION; TRAJECTORY PREDICTION;

OPTIMIZATION;

EID: 84897551647     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Auer, Peter, Cesa-Bianchi, Nicolo, Freund, Yoav, and Schapire, Robert. The nonstochastic multiarmed bandit problem. SIAM Journal on Computing, 32 (1):48-77, 2003.
2. Beygelzimer, Alina, Dani, Varsha, Hayes, Thomas, Langford, John, and Zadrozny, Bianca. Error limiting reductions between classification tasks. In ICML. ACM, 2005.
3. Dang, Hoa Trang. Overview of due 2005. In DUC, 2005.
4. Dey, Debadeepta, Liu, Tian Yu, Hebert, Martial, and Bagnell, J. Andrew (Drew). Contextual sequence optimization with application to control library optimization. In RSS, 2012.
5. Feige, U., Mirrokni, V. S., and Vondrak, J. Maximizing non-monotone submodular functions. SIAM Journal on Computing, 40(4):1133-1153, 2011.
6. Guestrin, Carlos and Krause, Andreas. Beyond convexity: Submodularity in machine learning. URL www.submodularity.org.
7. Guzman-Rivera, Abner, Batra, Dhruv, and Kohli, Pushmeet. Multiple choice learning: Learning to produce multiple structured outputs. In NIPS, 2012.
8. Joachims, Thorsten. A support vector method for multivariate performance measures. In ICML. ACM, 2005.
9. Kalai, Adam and Vempala, Santosh. Efficient algorithms for online decision problems. JCSS, 71(3): 291-307, 2005.
10. Kulesza, Alex and Taskar, Ben. Learning determinantal point processes. In UAI, 2011.
11. Lin, Chin-Yew. Rouge: A package for automatic evaluation of summaries. In Text Summarization Branches Out: ACL-O4 Workshop, 2004.
12. Lin, Hui and Bilmes, Jeff. Multi-document summarization via budgeted maximization of submodular functions. In Annual Conference of the North American Chapter of the Association for Computational Linguistics, 2010.
13. Lin, Hui and Bilmes, Jeff. A class of submodular functions for document summarization. In ACL-HLT, 2011.
14. Lin, Hui and Bilmes, Jeff. Learning mixtures of sub-modular shells with application to document summarization. In UAI, 2012.
15. Littlestone, Nick and Warmuth, Manfred. The Weighted Majority Algorithm. INFORMATION AND COMPUTATION, 1994.
16. Radlinski, Filip, Kleinberg, Robert, and Joachims, Thorsten. Learning diverse rankings with multi-armed bandits. In ICML, 2008.
17. Raman, Karthik, Shivaswamy, Pannaga, and Joachims, Thorsten. Online learning to diversify from implicit feedback. In KDD, 2012.
18. Ratliff, Nathan, Zucker, Matt, Bagnell, J. Andrew, and Srinivasa, Siddhartha. Chomp: Gradient optimization techniques for efficient motion planning. In ICRA, May 2009.
19. Ross, Stephane and Bagnell, J. Andrew. Agnostic system identification for model-based reinforcement learning. In ICML, 2012.
20. Ross, Stephane, Gordon, Geoff, and Bagnell, J. Andrew. A reduction of imitation learning and structured prediction to no-regret online learning. In AISTATS, 2011a.
21. Ross, Stephane, Munoz, Daniel, Bagnell, J. Andrew, and Hebert, Martial. Learning message-passing inference machines for structured prediction. In CVPR, 2011b.
22. Streeter, M. and Golovin, D. An online algorithm for maximizing submodular functions. In NIPS, 2008.
23. Streeter, Matthew, Golovin, Daniel, and Krause, Andreas. Online learning of assignments. In NIPS, 2009.
24. Yue, Yisong and Guestrin, Carlos. Linear submodular bandits and their application to diversified retrieval. In NIPS, 2011.
25. Yue, Yisong and Joachims, Thorsten. Predicting diverse subsets using structural svms. In ICML, 2008.