Concise comparative summaries (CCS) of large text corpora with a human experiment

Annals of Applied Statistics

Volumn 8, Issue 1, 2014, Pages 499-529

  Miratrix, Luke ^b   Jia, Jinzhu ^a   Yu, Bin ^c   Gawalt, Brian ^c   Ghaoui, Laurent El ^c   Barnesmoore, Luke ^c   Clavier, Sophie ^d  

^a PEKING UNIVERSITY   (China)

^b HARVARD UNIVERSITY   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d SAN FRANCISCO STATE UNIVERSITY   (United States)

Author keywords

Co occurrence; High dimensional analysis; L1 regularized logistic regression; L2 normalization; Lasso; Sparse modeling; Text summarization; Tf idf

Indexed keywords

EID: 84898020235     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/13-AOAS698     Document Type: Article

References (44)

1. BISCHOF, J.M. and AIROLDI, E. M. (2012). Summarizing topical content with word frequency and exclusivity. In Proceedings of the 29th International Conference on Machine Learning (ICML-12) 201-208. Edinburgh, Scotland.
2. BLEI, D. and MCAULIFFE, J. (2008). Supervised topic models. In Advances in Neural Information Processing Systems 20 (J. C. Platt, D. Koller, Y. Singer and S. Roweis, eds.) 121-128. MIT Press, Cambridge, MA.
3. BLEI, D. M., NG, A. Y. and JORDAN, M. I. (2003). Latent Dirichlet allocation. J. Mach. Learn. Res. 3 993-1022.
4. CHANG, J., Boyd-Graber, J., GERRISH, S., WANG, C. and BLEI, D. (2009). Reading tea leaves: How humans interpret topic models. In Advances in Neural Information Processing Systems 22 (Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I.Williams and A. Culotta, eds.) 288-296. Vancouver, BC, Canada.
5. CLAVIER, S., EL GHAOUI, L., BARNESMOORE, L. and LI, G.-C. (2010). All the news that's fit to compare: Comparing Chinese representations in the American Press and US representations in the Chinese press.
6. DAI, X., JIA, J., EL GHAOUI, L. and YU, B. (2011). SBA-term: Sparse bilingual association for terms. In Fifth IEEE International Conference on Semantic Computing (ICSC) 189-192. Stanford Univ., Palo Alto, CA.
7. EISENSTEIN, J., SMITH, N. A. and XING, E. P. (2011). Discovering sociolinguistic associations with structured sparsity. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies 1 1365-1374. Association for Computational Linguistics, Portland, OR.
8. EL GHAOUI, L., VIALLON, V. and RABBANI, T. (2010). Safe feature elimination in sparse supervised learning. Technical Report No. UC/EECS-2010-126. EECS Dept., Univ. California, Berkeley.
9. EL GHAOUI, L., LI, G.-C., DUONG, V.-A., PHAM, V., SRIVASTAVA, A. and BHADURI, K. (2011). Sparse machine learning methods for understanding large text corpora: Application to flight reports. In Conference on Intelligent Data Understanding 159-173. Mountain View, CA.
10. ENTMAN, R. M. (1993). Framing: Toward clarification of a fractured paradigm. Journal of Communication 43 52-57.
11. ENTMAN, R. M. (2004). Projections of power framing news, public opinion, and U.S. foreign policy. Univ. Chicago, Chicago, IL.
12. FORMAN, G. (2003). An extensive empirical study of feature selection metrics for text classification. J. Mach. Learn. Res. 3 1289-1305.
13. FRANK, E., PAYNTER, G.W., WITTEN, I. H., GUTWIN, C. and Nevill-Manning, C. G. (1999). Domain-specific keyphrase extraction. In Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence (IJCAI-99) 668-673. Morgan Kaufmann, San Francisco, CA.
14. GAWALT, B., JIA, J., MIRATRIX, L.W., GHAOUI, L., YU, B. and CLAVIER, S. (2010). Discovering word associations in news media via feature selection and sparse classification. In Proceedings of the International Conference on Multimedia Information Retrieval (MIR'10) 211-220. Philadelphia, PA.
15. GENKIN, A., LEWIS, D. D. and MADIGAN, D. (2007). Large-scale Bayesian logistic regression for text categorization. Technometrics 49 291-304. MR2408634
16. GOFFMAN, E. (1974). Frame Analysis: An Essay on the Organization of Experience. Harvard Univ. Press, Cambridge, MA.
17. GOLDSTEIN, J., MITTAL, V., CARBONELL, J. and KANTROWITZ, M. (2000). Multi-document summarization by sentence extraction. In NAACL-ANLP 2000 Workshop on Automatic Summarization 40-48. Seattle, WA.
18. GRIMMER, J., SHOREY, R., WALLACH, H. and ZLOTNICK, F. (2011). A class of Bayesian semiparametric cluster-topic models for political texts.
19. HASTIE, T., TIBSHIRANI, R. and FRIEDMAN, J. H. (2011). The Elements of Statistical Learning, Vol. 1. Springer, New York.
20. HENNIG, L. (2009). Topic-based multi-document summarization with probabilistic latent semantic analysis. In Recent Advances in Natural Language Processing (RANLP) 144-149. Association for Computational Linguistics, Borovets, Bulgaria.
21. HOPKINS, D. and KING, G. (2010). A method of automated nonparametric content analysis for social science. American Journal of Political Science 54 229-247.
22. IFRIM, G., BAKIR, G. and WEIKUM, G. (2008). Fast logistic regression for text categorization with variable-length N-grams. In 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 354-362. ACM, New York.
23. JIA, J., MIRATRIX, L. W., GAWALT, B., YU, B. and EL GHAOUI, L. (2011). What is in the news on a subject: Automatic and sparse summarization of large document corpora. Technical Report #801, Dept. Statistics, Univ. California, Berkeley.
24. KIOUSIS, S. and WU, X. (2008). International agenda-building and agenda-setting: Exploring the influence of public relations counsel on US news media and public perceptions of foreign nations. The International Communications Gazette 70 58-75.
25. KUNCZIK, M. (2000). Globalisation: News media, images of nations and the flow of international capital with special reference to the role of rating agencies. J. International Communication 8 39-79.
26. LAZER, D., PENTLAND, A., ADAMIC, L., ARAL, S., BARABASI, A.-L., BREWER, D., CHRISTAKIS, N., CONTRACTOR, N., FOWLER, J., GUTMANN, M., JEBARA, T., KING, G., MACY, M., ROY, D. and VAN ALSTYNE, M. (2009). Computational social science. Science 323 721-723.
27. LEE, L. and CHEN, S. (2006). New methods for text categorization based on a new feature selection method and a new similarity measure between documents. Lecture Notes in Comput. Sci. 4031 1280.
28. MCLEOD, M., KOSICKI, G. M. and PAN, Z. (1991). On Understanding and Misunderstanding Media Effects. Edward Arnold, London.
29. MONROE, B. L., COLARESI, M. P. and QUINN, K. M. (2008). Fightin' words: Lexical feature selection and evaluation for identifying the content of political conflict. Political Analysis 16 372-403.
30. MOSTELLER, F. and WALLACE, D. L. (1984). Applied Bayesian and Classical Inference: The Case of The Federalist Papers, 2nd ed. Springer, New York. MR0766742
31. NETO, J. L., FREITAS, A.A. and KAESTNER, C. A. A. (2002). Automatic text summarization using a machine learning approach. In Advances in Artificial Intelligence. Lecture Notes in Computer Science 2507 205-215. Springer, Berlin. MR2048852
32. PAUL, M. J., ZHAI, C. and GIRJU, R. (2010). Summarizing contrastive viewpoints in opinionated text. In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing 66-76. Association for Computational Linguistics, Stroudsburg, PA.
33. POTTKER, H. (2003). News and its communicative quality: The inverted pyramid when and why did it appear? Journalism Studies 4 501-511.
34. ROSE, S., ENGEL, D., CRAMER, N. and COWLEY, W. (2010). Automatic keyword extraction from individual documents. In Text Mining: Applications and Theory (M.W. Berry and J. Kogan, eds.). Wiley, Chichester.
35. SALTON, G. (1991). Developments in automatic text retrieval. Science 253 974-980.
36. SALTON, G. and BUCKLEY, C. (1988). Term-weighting approaches in automatic text retrieval. Information Processing and Management 24 513-523.
37. SENELLART, P. and BLONDEL, V. D. (2008). Automatic discovery of similar words. In Survey of Text Mining II. Springer, Berlin.
38. SHAHAF, D., GUESTRIN, C. and HORVITZ, E. (2012). Trains of thought: Generating information maps. In Proceedings of the 21st International Conference on World Wide Web 899-908. ACM, Lyon, France.
39. TIBSHIRANI, R. (1996). Regression shrinkage and selection via the lasso. J. R. Stat. Soc. Ser. B Stat. Methodol. 58 267-288. MR1379242
40. WAGSTAFF, K. L. (2012). Machine learning that matters. In 29th International Conference on Machine Learning 1-6. Edinburgh, Scotland.
41. YANG, Y. and PENDERSEN, I. O. (1997). A comparative study on feature selection in text categorization. In ICML-97, 14th International Conference on Machine Learning 412-420. Nashville, TN.
42. ZHANG, T. and OLES, F. J. (2001). Text categorization based on regularized linear classification methods. Information Retrieval 4 5-31.
43. ZHAO, P. and YU, B. (2007). Stagewise lasso. J. Mach. Learn. Res. 8 2701-2726. MR2383572
44. ZUBIAGA, A., SPINA, D., FRESNO, V. and MARTÍNEZ, R. (2011). Classifying trending topics: A typology of conversation triggers on Twitter. In Proceedings of the 20th ACM International Conference on Information and Knowledge Management (CIKM'11) 2461-2464. ACM, New York.