Sparse Gaussian conditional random fields: Algorithms, theory, and application to energy forecasting

30th International Conference on Machine Learning, ICML 2013

Volumn , Issue PART 3, 2013, Pages 2302-2310

  Wytock, Matt ^a   Kolter, J Zico ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

IMAGE SEGMENTATION; LEARNING SYSTEMS; RANDOM PROCESSES;

ACTIVE-SET METHODS; CONDITIONAL DISTRIBUTION; CONDITIONAL RANDOM FIELD; INVERSE COVARIANCE; LARGE-SCALE PROBLEM; OPTIMIZATION APPROACH; ORDERS OF MAGNITUDE; STATE-OF-THE-ART PERFORMANCE;

OPTIMIZATION;

EID: 84897479364     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Andrew, Galen and Gao, Jianfeng. Scalable training of 11-regularized log-linear models. In Proceedings of the 24th international conference on Machine learning, pp. 33-40. ACM, 2007.
2. Banerjee, O., Ghaoui, L. El, and d'Aspremont, A. Model selection through sparse maximum likelihood estimation for multivariate gaussian or binary data, 2008.
3. 1-regularized linear regression: Persistence and oracle inequalities. Probability theory and related fields, pp. 1-32, 2012.
4. Beck, Amir and Teboulle, Marc. A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM Journal on Imaging Sciences, 2 (1):183-202, 2009.
5. Duchi, J. C., Gould, S., and Roller, D. Projected subgradient methods for learning sparse Gaussians. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, 2008.
6. Friedman, J., Hastie, T., and Tibshirani, R. Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9(3):432-441, 2008. (Pubitemid 351882084)
7. Hong, T. Global energy forecasting competition, 2012. URL http://www.gefcom.org.
8. Hsieh, C.-J., Sustik, M. A., Dhillon, I. S., and Ravikumar, P. Sparse inverse covariace matrix estimation using quadratic approximation. In Neural Information Processing Systems, 2011.
9. Lu, Z. Smooth optimization approaches for sparse inverse covariance selection. SIAM Journal on Optimization, 19(4):1807-1827, 2009.
10. Ng, A. Y. and Jordan, M. I. On discriminative vs. generative classifiers: a comparison of logistic regression and naive Bayes. 2002.
11. Olsen, Peder A, Oztoprak, Figen, Nocedal, Jorge, and Rennie, Stephen J. Newton-like methods for sparse inverse covariance estimation. Optimization Online, 2012.
12. Ravikumar, Pradeep, Wainwright, Martin J, Raskutti, Garvesh, and Yu, Bin. High-dimensional covariance estimation by minimizing 1-penalized log-determinant divergence. Electronic Journal of Statistics, 5:935-980, 2011.
13. Scheinberg, K., Ma, S., and Goldfarb, D. Sparse inverse covariance selection via alternating linearization methods. In Neural Information Processing Systems, 2010.
14. Sohn, Kyung-Ah and Kim, Seyoung. Joint estimation of structured sparsity and output structure in multiple-output regression via inverse-covariance regularization. In Proceedings of the Conference on Artificial Intelligence and Statistics, 2012.
15. Soliman, S. A. and Al-Kandari, A. M. Electrical Load Forecasting: Modeling and Model Construction. Elsevier, 2010.
16. Sutton, C. and McCallum, A. An introduction to conditional random fields. Foundations and Trends in Machine Learning, 4(4):267-373, 2012.
17. Tseng, Paul and Yun, Sangwoon. A coordinate gradient descent method for nonsmooth separable minimization. Mathematical Programming, 117(1):387-423, 2009.
18. Various. PJM Manual 19: Load Forecasting and Analysis. PJM, 2012. Available at: http://www.pjm.com/planning/resource-adequacy-planning/-/media/ documents/manuals/m19.ashx.
19. 1-constrained quadratic programming (Lasso). IEEE Transactions on Information Theory, 55(5):2183-2202, 2009.
20. Wytock, Matt and Kolter, J. Zico. Sparse conditional gaussian random fields. In NIPS Workshop on Log Linear Models, 2012.
21. Yuan, Xiao-Tong and Zhang, Tong. Partial gaussian graphical model estimation. CoRR, abs/1209.6419, 2012.