Multinomial inverse regression for text analysis

Journal of the American Statistical Association

Volumn 108, Issue 503, 2013, Pages 755-770

  Taddy, Matt ^a  

^a UNIVERSITY OF CHICAGO   (United States)

Author keywords

Multinomial logistic regression; Nonconcave penalization; Regularized regression; Text mining

Indexed keywords

EID: 84888128053     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.2012.734168     Document Type: Article

References (56)

1. Agresti, A. (2002), Categorical Data Analysis (2nd ed.), New York: Wiley. [759].
2. Bishop, Y., Fienberg, S., and Holland, P. (1975), Discrete Multivariate Analysis, New York: MIT Press. [759].
3. Blei, D. M., and McAuliffe, J. D. (2007), "Supervised Topic Models, " in Proceedings of the Neural Information Processing Systems, Volume 21, 1-8. [757].
4. Blei, D. M., Ng, A. Y., and Jordan, M. I. (2003), "Latent Dirichlet Allocation, " Journal of Machine Learning Research, 3, 993-1022. [757].
5. Bollen, J., Mao, H., and Zeng, X.-J. (2011), "Twitter Mood Predicts the Stock Market, " Journal of Computational Science, 2, 1-8. [757].
6. Bura, E., and Cook, D. (2001), "Estimating the Structural Dimension of Regressions via Parametric Inverse Regression, " Journal of the Royal Statistical Society, Series B, 63, 393-410. [758].
7. Carlin, B. P., Polson, N. G., and Stoffer, D. S. (1992), "A Monte-Carlo Approach to Nonnormal and Nonlinear State-Space Modeling, " Journal of the American Statistical Association, 87, 493-500. [760].
8. Carvalho, C. M., Polson, N. G., and Scott, J. G. (2010), "The Horseshoe Estimator for Sparse Signals, " Biometrika, 97, 465-480. [760,761].
9. Chang, J. (2011), lda: Collapsed Gibbs Sampling Methods for Topic Models, R package version 1.3.1, Vienna: The R Foundation for Statistical Computing. [768].
10. Cook, R. D. (2007), "Fisher Lecture: Dimension Reduction in Regression, " Statistical Science, 22, 1-26. [758].
11. Cook, R. D., and Li, L. (2009), "Dimension Reduction in Regressions With Exponential Family Predictors, " Journal of Computational and Graphical Statistics, 18, 774-791. [758].
12. Fan, J., and Li, R. (2001), "Variable Selection via Nonconcave Penalized Likelihood and Its Oracle Properties, " Journal of the American Statistical Association, 96, 1348-1360. [760,761].
13. Fan, J., and Peng, H. (2004), "Nonconcave Penalized LikelihoodWith a Diverging Number of Parameters, " The Annals of Statistics, 32, 928-961. [761].
14. Frank, I. E., and Friedman, J. H. (1993), "A Statistical View of Some Chemometrics Regression Tools, " Technometrics, 35, 109-135. [767].
15. Friedman, J. H. (2008), "Fast Sparse Regression and Classification, " Technical Report, Department of Statistics, Stanford University. [761].
16. Friedman, J. H., Hastie, T., and Tibshirani, R. (2010), "Regularization Paths for Generalized Linear Models via Coordinate Descent, " Journal of Statistical Software, 33(1), 1-22. [760,768].
17. Gail, M. H., Wieand, S., and Piantadosi, S. (1984), "Biased Estimates of Treatment Effect in Randomized Experiments With Nonlinear Regressions and Omitted Covariates, " Biometrika, 71, 341-444. [759].
18. Gelman, A., Su, Y.-S., Yajima, M., Hill, J., Pittau, M. G., Kerman, J., and Zheng, T. (2012), Arm: Data Analysis Using Regression and Multilevel/Hierarchical Models, R package version 1.5-03, Vienna: The R Foundation for Statistical Computing. [768].
19. Genkin, A., Lewis, D. D., and Madigan, D. (2007), "Large-Scale Bayesian Logistic Regression for Text Categorization, " Technometrics, 49, 291-304. [768].
20. Gentzkow, M., and Shapiro, J. (2010), "What Drives Media Slant? Evidence From U.S. Daily Newspapers, " Econometrica, 78, 35-72. [756,757].
21. Gramacy, R. B. (2012), Monomvn: Estimation for Multivariate Normal and Student-t Data With Monotone Missingness, R package version 1.8-10, Vienna: The R Foundation for Statistical Computing. [768].
22. Gramacy, R. B., and Polson, N. G. (2012), "Simulation-Based Regularized Logistic Regression, " Bayesian Analysis, 7, 1-24. [760,763].
23. Grimmer, J. (2010), "A Bayesian Hierarchical Topic Model for Political Texts: Measuring ExpressedAgendas in Senate Press Releases, " Political Analysis, 18, 1-35. [757].
24. Hastie, T., Tibshirani, R., and Friedman, J. H. (2009), The Elements of Statistical Learning, New York: Springer. [768,768].
25. Holmes, C. C., and Held, L. (2006), "Bayesian Auxiliary Variable Models for Binary and Multinomial Regression, " Bayesian Analysis, 1, 145-168. [760].
26. Jurafsky, D., and Martin, J. H. (2009), Speech and Language Processing (2nd ed.), Upper Saddle River, NJ: Prentice Hall. [756].
27. Karatzoglou, A., Smola, A., Hornik, K., and Zeileis, A. (2004), "Kernlab-An S4 Package for Kernel Methods in R, " Journal of Statistical Software, 11(9), 1-20. [768].
28. Krishnapuram, B., Carin, L., Figueiredo, M. A. T., and Hartemink, A. J. (2005), "Sparse Multinomial Logistic Regression: Fast Algorithms and Generalization Bounds, " IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 957-969. [762].
29. Lange, K., Hunter, D. R., and Yang, I. (2000), "Optimization Transfer Using Surrogate Objective Functions, " Journal of Computational and Graphical Statistics, 9, 1-20. [762].
30. Laver, M., Benoit, K., and Garry, J. (2003), "Extracting Policy Positions From Political Texts Using Words as Data, " American Political Science Review, 97, 311-332. [757].
31. Lehmann, E. L., and Scheffé, H. (1950), "Completeness, Similar Regions, and Unbiased Estimation-Part 1, " Sankhyā: The Indian Journal of Statistics, 10, 305-340. [758].
32. Li, K. (1991), "Sliced Inverse Regression for Dimension Reduction, " Journal of the American Statistical Association, 86, 316-327. [758].
33. Li, L., Cook, R. D., and Tsai, C.-L. (2007), "Partial Inverse Regression, " Biometrika, 94, 615-625. [758].
34. Loughran, T., and McDonald, B. (2011), "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10-Ks, " Journal of Finance, 66, 35-65. [757].
35. Luenberger, D. G., and Ye, Y. (2008), Linear and Nonlinear Programming (3rd ed.), New York: Springer. [762].
36. Madigan, D., Genkin, A., Lewis, D. D., and Fradkin, D. (2005), "Bayesian Multinomial Logistic Regression for Author Identification, " in AIP Conference Proceedings, Volume 803, 509-516. [762].
37. Mauá, D. D., and Cozman, F. G. (2009), "Representing and Classifying User Reviews, " in ENIA '09: VIII Enconro Nacional de Inteligência Artificial, Brazil, 1-10. [757].
38. Mazunder, R., Friedman, J. H., and Hastie, T. (2011), "Sparsenet: Coordinate Descent With Nonconvex Penalties, " Journal of the American Statistical Association, 106, 1125-1138. [761,763].
39. Pang, B., and Lee, L. (2008), "Opinion Mining and Sentiment Analysis, " Foundations and Trends in Information Retrieval, 1-2, 1-135. [757].
40. Park, T., and Casella, G. (2008), "The Bayesian Lasso, " Journal of the American Statistical Association, 103, 681-686. [760].
41. Poon, H., and Domingos, P. (2009), "Unsupervised Semantic Parsing, " in Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 1-10. [756].
42. Porter, M. F. (1980), "An Algorithm for Suffix Stripping, " Program, 14, 130-137. [756].
43. Quinn, K., Monroe, B., Colaresi, M., Crespin, M., and Radev, D. (2010), "How to Analyze Political AttentionWith MinimalAssumptions andCosts, " American Journal of Political Science, 54, 209-228. [757].
44. Rossi, P. E., Allenby, G. M., and McCulloch, R. (2005), Bayesian Statistics and Marketing, New York: Wiley. [760].
45. Schervish, M. J. (1995), Theory of Statistics, New York: Springer. [758].
46. Srivastava, A. N., and Sahami, M. (eds.) (2009), Text Mining: Classification, Clustering, and Applications, Boca Raton, FL: CRC Press. [756,757].
47. Taddy, M. (2012a), "Design and Analysis of a Text Mining Experiment, " arXiv:1206.3776v1. [767].
48. Taddy, M. (2012b), "On Estimation and Selection for Topic Models, " in Proceedings of the 15th International Conference on Artificial Intelligence and Statistics (AISTATS 2012), 1184-1193. [765].
49. Talley, E. L., and O'Kane, D. (2011), "The Measure of a MAC: A Machine-Learning Protocol for Analyzing Force Majeure Clauses in M&A Agreements, " Journal of Institutional and Theoretical Economics, 168, 181-201. [756].
50. Tetlock, P. (2007), "Giving Content to Investor Sentiment: The Role of Media in the Stock Market, " Journal of Finance, 62, 1139-1168. [757].
51. Thomas, M., Pang, B., and Lee, L. (2006), "Get Out the Vote: Determining Support or Opposition From Congressional Floor-Debate Transcripts, " in Proceedings of Emperical Methods in Natural Language Processing, pp. 327-335. [757].
52. Tibshirani, R. (1996), "Regression Shrinkage and Selection via the Lasso, " Journal of the Royal Statistical Society, Series B, 58, 267-288. [760].
53. West, M. (2003), "Bayesian Factor Regression Models in the 'Large p, Small n' Paradigm, " in Bayesian Statistics (Vol. 7); J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith, and M. West (eds.), Oxford: Oxford University Press, 733-742. [758].
54. Wold, H. (1975), "Soft Modeling by Latent Variables: The Nonlinear Iterative Partial Least Squares Approach, " in Perspectives in Probability and Statistics: Papers in Honour of M.S. Bartlett, J. Gani (ed.), London: Academic Press, 117-144. [757].
55. Yu, B., Kaufmann, S., and Diermeirer, D. (2008), "Classifying Party Affiliation From Political Speech, " Journal of Information Technology and Politics, 5, 33-49. [757].
56. Zeger, S. L., Liang, K.-Y., and Self, S. G. (1985), "The Analysis of Binary Longitudinal DataWith Time-Independent Covariates, " Biometrika, 72, 31-38. [759].