Scalable training of L1-regularized log-linear models

ACM International Conference Proceeding Series

Volumn 227, Issue , 2007, Pages 33-40

  Andrew, Galen ^a   Gao, Jianfeng ^a  

^a MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MATHEMATICAL MODELS; NEWTON-RAPHSON METHOD; OPTIMIZATION; PARAMETER ESTIMATION; PROBLEM SOLVING;

LINEAR MODELS; QUASI NEWTON METHODS;

LEARNING SYSTEMS;

EID: 34547984768     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1273496.1273501     Document Type: Conference Paper

References (18)

1. Benson, J. S., & More, J. J. (2001). A limited memory variable metric method for bound constraint minimization.
2. Bertsekas, D. P. (1999). Nonlinear programming. Athena Scientific.
3. Byrd, R. H., Lu, P., Nocedal, J., & Zhu, C. Y. (1995). A limited memory algorithm for bound constrained optimization. SIAM Journal on Scientific Computing, 16, 1190-1208.
4. Charniak, E., & Johnson, M. (2005). Coarse-to-fine n-best parsing and maxent discriminative reranking. ACL.
5. Collins, M. (2000). Discriminative reranking for natural language parsing. ICML (pp. 175-182).
6. Darroch, J., & Ratcliff, D. (1972). Generalised iterative scaling for log-linear models. Annals of Mathematical Statistics.
7. Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004). Least angle regression. Annals of Statistics.
8. Gao, J., Andrew, G., Johnson, M., & Toutanova, K. (2007). A comparative study of parameter estimation methods for statistical NLP. ACL.
9. Goodman, J. (2004). Exponential priors for maximum entropy models. ACL.
10. Kazama, J., & Tsujii, J. (2003). Evaluation and extension of maximum entropy models with inequality constraints. EMNLP.
11. Lee, S.-I., Lee, H., Abbeel, P., & Ng, A. (2006). Efficient L1 regularized logistic regression. AAAI-06.
12. Malouf, R. (2002). A comparison of algorithms for maximum entropy parameter estimation. CONLL.
13. Minka, T. P. (2003). A comparison of numerical optimizers for logistic regression (Technical Report). Microsoft Research.
14. Ng, A. Y. (2004). Feature selection, L1 vs. L2 regularization, and rotational invariance. ICML.
15. Nocedal, J., & Wright, S. J. (1999). Numerical optimization. Springer.
16. Perkins, S., & Theiler, J. (2003). Online feature selection using grafting. ICML.
17. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society Series B.
18. Zhu, C., Byrd, R. H., Lu, P., & Nocedal, J. (1997). Algorithm 778: L-bfgs-b: Fortran subroutines for large-scale bound-constrained optimization. ACM Trans. Math. Softw., 23, 550-560.