Sparse estimation using general likelihoods and non-factorial priors

Advances in Neural Information Processing Systems 22 - Proceedings of the 2009 Conference

Volumn , Issue , 2009, Pages 2071-2079

  Wipf, David ^a   Nagarajan, Srikantan ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COST-FUNCTION; DATA FITS; ESTIMATION PROBLEM; OVER-COMPLETE; PENALTY FUNCTION; PRIOR FUNCTIONS; PROPERTY; SPARSE BAYESIAN; SPARSE ESTIMATION; SPARSE REPRESENTATION;

COST FUNCTIONS;

EID: 77955685516     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004.
2. A. Bruckstein, M. Elad, and M. Zibulevsky, "A non-negative and sparse enough solution of an underdetermined linear system of equations is unique," IEEE Trans. Information Theory, vol. 54, no. 11, pp. 4813-4820, Nov. 2008.
3. 1 minimization," J. Fourier Anal. Appl, vol. 14, no. 5, pp. 877-905, 2008.
4. G. Cawley and N. Talbot, "Gene selection in cancer classification using sparse logistic regression with Bayesian regularization," Bioinformatics, vol. 22, no. 19, pp. 2348-2355, 2006.
5. 1 minimization," Proc. Nat. Acad. Sci., vol. 100, no. 5, pp. 2197-2202, 2003.
6. M. Fazel, H. Hindi, and S. Boyd, "Log-Det heuristic for matrix rank minimization with applications to hankel and Euclidean distance matrices," Proc. American Control Conf, vol. 3, pp. 2156-2162, June 2003.
7. B. Krishnapuram, L. Carin, M. Figueiredo, and A. Hartemink, "Sparse multinomial logistic regression: Fast algorithms and generalization bounds," IEEE Trans. Pattn Anal. Mach. Intell., vol. 27, pp. 957-968, 2005.
8. D. Luenberger, linear and Nonlinear Programming, Addison-Wesley, Reading, Massachusetts, second edition, 1984.
9. D. Malioutov, M. Cetin, and A.S. Willsky, "Optimal sparse representations in general overcom-plete bases," IEEE Int. Conf. Acoust, Speech, and Sig. Proc, vol. 2, pp. 11-793-796, 2004.
10. R. Neal, Bayesian learning for Neural Networks, Springer-Verlag, New York, 1996.
11. Y. Qi, T. Minka, R. Picard, and Z. Ghahramani, "Predictive automatic relevance determination by expectation propagation," Int. Conf. Machine learning (ICMI), pp. 85-92, 2004.
12. R. Showalter, "Monotone operators in Banach space and nonlinear partial differential equations," Mathematical Surveys and Monographs 49. AMS, Providence, RI, 1997.
13. J. Silva, J. Marques, and J. Lemos, "Selecting landmark points for sparse manifold learning," Advances in Neural Information Processing Systems 18, pp. 1241-1248, 2006.
14. R. Tibshirani, "Regression shrinkage and selection via the Lasso," Journal of the Royal Statistical Society, vol. 58, no. 1, pp. 267-288, 1996.
15. M. Tipping, "Sparse bayesian learning and the relevance vector machine," J. Machine learning Research, vol. 1, pp. 211-244, 2001.
16. M. Tipping and A. Faul, "Fast marginal likelihood maximisation for sparse Bayesian models," Ninth Int. Workshop. Artificial Intelligence and Statistics, Jan. 2003.
17. J. Tropp, "Algorithms for simultaneous sparse approximation. Part II: Convex relaxation," Signal Processing, vol. 86, pp. 589-602, April 2006.
18. M. Wakin, M. Duarte, S. Sarvotham, D. Baron, and R. Baraniuk, "Recovery of jointly sparse signals from a few random projections," Advances in Neural Information Processing Systems 18, pp. 1433-1440, 2006.
19. D. Wipf and S. Nagarajan, "A new view of automatic relevance determination," Advances in Neural Information Processing Systems 20, pp. 1625-1632, 2008.
20. 2 methods for finding sparse solutions," Submitted, 2009.
21. D. Wipf and S. Nagarajan, "Latent variable Bayesian models for promoting sparsity," Submitted, 2009.
22. D. Wipf, J. Owen, H. Attias, K. Sekihara, and S. Nagarajan, "Robust Bayesian Estimation of the Location, Orientation, and Time Course of Multiple Correlated Neural Sources using MEG," Neuro Image, vol. 49, no. 1, pp. 641-655, Jan. 2010.
23. M. Yuan and Y Lin, "Model selection and estimation in regression with grouped variables," J. R. Statist. Soc. B, vol. 68, pp. 49-67, 2006.
24. W Zangwill, Nonlinear Programming: A Unified Approach, Prentice Hall, New Jersey, 1969.