Selecting actions for resource-bounded information extraction using reinforcement learning

WSDM 2012 - Proceedings of the 5th ACM International Conference on Web Search and Data Mining

Volumn , Issue , 2012, Pages 253-262

  Kanani, Pallika ^a   McCallum, Andrew ^a  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

Active information acquisition; Reinforcement learning; Resource bounded information extraction; Web mining

Indexed keywords

INFORMATION ACQUISITIONS; INFORMATION EXTRACTION; INFORMATION GATHERING; LEARNING-BASED APPROACH; Q-LEARNING METHOD; RESOURCE LIMITATIONS; RESOURCE-BOUNDED; SPECIFIC INFORMATION; TEMPORAL DIFFERENCES; TIME STEP; WEB MINING;

DATA MINING; EMPLOYMENT; INFORMATION RETRIEVAL; LEARNING ALGORITHMS; WEBSITES;

REINFORCEMENT LEARNING;

EID: 84858054268     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2124295.2124328     Document Type: Conference Paper

References (18)

1. A. Culotta. Learning and inference in weighted logic with application to natural language processing. PhD thesis, University of Massachusetts, 2008.
2. T. Eliassi-Rad. Building Intelligent Agents that Learn to Retrieve and Extract Information. PhD thesis, University of Wisconsin, Madison, 2001.
3. O. Etzioni, M. Cafarella, D. Downey, S. Kok, A. Popescu, T. Shaked, S. Soderland, D. Weld, and A. Yates. Web-scale information extraction in knowitall. In WWW, 2004.
4. P. Kanani and A. McCallum. Learning to select actions for resource-bounded information extraction. UMass CS Tech. Report UM-CS-2011-042, 2011.
5. P. Kanani, A. McCallum, and S. Hu. Resource-bounded information extraction: Acquiring missing feature values on demand. In PAKDD, 2010.
6. P. Kanani and P. Melville. Prediction-time active feature-value acquisition for customer targeting. In Workshop on Cost Sensitive Learning, NIPS, 2008.
7. C. A. Knoblock. Planning executing, sensing and replanning for information gathering. In IJCAI, 1995.
8. D. J. Lizotte, O. Madani, and R. Greiner. Budgeted learning of naive-bayes classifiers. In UAI, 2003.
9. A. K. McCallum. Mallet: A machine learning for language toolkit. http://mallet.cs.umass.edu, 2002.
10. P. Melville, M. Saar-Tsechansky, F. Provost, and R. Mooney. An expected utility approach to active feature-value acquisition. In ICDM, 2005.
11. M. H. Nodine, J. Fowler, T. Ksiezyk, B. Perry, M. Taylor, and A. Unruh. Active information gathering in infosleuth. IJCIS, 9(1-2):3{28, 2000.
12. S. Russell and P. Norvig. Artificial Intelligence: A Modern Approach (2nd Edition). Prentice Hall, 2003.
13. V. Sheng and C. Ling. Feature value acquisition in testing: a sequential batch test algorithm. In ICML'06.
14. R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, 1998.
15. C. J. C. H. Watkins and P. Dayan. Q-learning. Machine Learning, 8(3-4):279-292, 1992.
16. M. Wick, K. Rohanimanesh, K. Bellare, A. Culotta, and A. McCallum. Samplerank: Training factor graphs with atomic gradients. In ICML, 2011.
17. F. Wu, R. Hoffmann, and D. S. Weld. Information extraction from wikipedia: moving down the long tail. In SIGKDD, 2008.
18. S. Zilberstein. Resource-bounded reasoning in intelligent systems. ACM Comput. Surv, 28, 1996.