Sparse regression using mixed norms

Applied and Computational Harmonic Analysis

Volumn 27, Issue 3, 2009, Pages 303-324

  Kowalski, Matthieu ^a  

^a AIX MARSEILLE UNIVERSITY   (France)

Author keywords

FOCUSS; Mixed norms; Sparse regression; Structured regression; Thresholded Landweber iterations

Indexed keywords

FOCUSS; MIXED NORMS; SPARSE REGRESSION; STRUCTURED REGRESSION; THRESHOLDED LANDWEBER ITERATIONS;

INVERSE PROBLEMS;

REGRESSION ANALYSIS;

EID: 70049113231     PISSN: 10635203     EISSN: 1096603X     Source Type: Journal    
DOI: 10.1016/j.acha.2009.05.006     Document Type: Article

References (35)

1. Bazaraa M., and Shetty C. Nonlinear Programming: Theory and Algorithms (1979), Wiley, New York
2. p with mixed norm. Duke Math. J. 28 (1961) 301-324
3. Berger J., Coifman R., and Goldberg M. Removing noise from music using local trigonometric bases and wavelet packets. J. Audio Eng. Soc. 42 10 (1994) 808-818
4. Chambolle A., Lee D.R.A.N.-Y., and Lucier B.J. Nonlinear wavelet image processing: Variational problems, compression, and noise removal through wavelet shrinkage. IEEE Trans. Image Process. 7 (1998) 320-353
5. Chen S.S., Donoho D.L., and Saunders M. Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 20 1 (1998) 33-61
6. Cohen A., Daubechies I., Guleryuz O.G., and Orchard M.T. On the importance of combining wavelet-based nonlinear approximation with coding strategies. IEEE Trans. Inform. Theory 48 7 (2002) 1895-1921
7. Combettes P.L., and Wajs V.R. Signal recovery by proximal forward-backward splitting. Multiscale Model. Simul. 4 4 (2005) 1168-1200
8. Cotter S., Rao B., Engan K., and Kreutz-Delgado K. Sparse solutions to linear inverse problems with multiple measurement vectors. IEEE Trans. Signal Process. 53 7 (2005) 2477-2488
9. Daubechies I., Defrise M., and De Mol C. An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Comm. Pure Appl. Math. 57 11 (2004) 1413-1457
10. Daudet L., Molla S., and Torrésani B. Towards a hybrid audio coder. In: Li J.P. (Ed). International Conference Wavelet Analysis and Applications (2004), Chongqing, China 13-24
11. Daudet L., and Torrésani B. Hybrid representations for audiophonic signal encoding. Signal Process. 82 11 (2002) 1595-1617 special issue on Image and Video Coding Beyond Standards
12. Feichtinger H.G. Modulation spaces: Looking back and ahead. Sampl. Theory Signal Image Process. 5 3 (2006) 109-140
13. C. Févotte, L. Daudet, S.J. Godsill, B. Torrésani, Sparse regression with structured priors: Application to audio denoising, in: IEEE International Conference on Acoustics, Speech, and Audio Signal, Toulouse, France, 2006
14. Fornasier M., and Rauhut H. Iterative thresholding algorithms. Appl. Comput. Harmon. Anal. 25 2 (2008) 187-208
15. Fornasier M., and Rauhut H. Recovery algorithm for vector-valued data with joint sparsity constraints. SIAM J. Numer. Anal. 46 2 (2008) 577-613
16. Gröchenig K., and Samarah S. Nonlinear approximation with local Fourier bases. Constr. Approx. 16 3 (2000) 317-331
17. Kowalski M., and Torrésani B. Random models for sparse signals expansion on unions of basis with application to audio signals. IEEE Trans. Signal Process. 56 8 (2008) 3468-3481
18. Kowalski M., and Torrésani B. Sparsity and persistence: Mixed norms provide simple signals models with dependent coefficients. Signal Image Video Process. doi:10.1007/s11760-008-0076-1
19. M. Kowalski, E. Vicent, R. Gribonval, Under-determined source separation via mixed-norm regularized minimization, in: Proceedings of the European Signal Processing Conference
20. Kurcyusz S. On the existence and nonexistence of Lagrange multipliers in Banach spaces. J. Optim. Theory Appl. 20 1 (1976) 81-110
21. Mallat S. A Wavelet Tour of Signal Processing (1998), Academic Press
22. Moreau J.-J. Proximit et dualit dans un espace hilbertien. Bull. Soc. Math. France 93 (1965) 273-299
23. Rao B., Engan K., Cotter S., Palmerand J., and Kreutz-Delgado K. Subset selection in noise based on diversity measure minimization. IEEE Trans. Signal Process. 51 3 (2003) 760-770
24. Rao B., and Kreutz-Delgado K. An affine scaling methodology for best basis selection. IEEE Trans. Signal Process. 47 1 (1999) 187-200
25. Rychkov V.S. On restrictions and extensions of the Besov and Triebel-Lizorkin spaces with respect to Lipschitz domains. J. Lond. Math. Soc. 60 1 (1999) 237-257
26. Samarah S., Obeidat S., and Salman R. A Shur test for weighted mixed-norm spaces. Anal. Math. 31 (2005) 277-289
27. Samarah S., and Salman R. Local Fourier bases and modulation spaces. Turkish J. Math. 30 4 (2006) 447-462
28. Starck J.-L., Elad M., and Donoho D.L. Image decomposition via the combination of sparse representation and a variational approach. IEEE Trans. Image Process. 14 10 (2005) 1570-1582
29. Szafranski M., Grandvalet Y., and Morizet-Mahoudeaux P. Hierarchical penalization. In: Platt J., Koller D., Singer Y., and Roweis S. (Eds). Adv. Neural Inf. Process. Syst. vol. 20 (2008), MIT Press, Cambridge, MA
30. Teschke G. Multi-frames representations in linear inverse problems with mixed multi-constraints. Appl. Comput. Harmon. Anal. 22 1 (2006) 43-60
31. Teschke G., and Ramlau R. An iterative algorithm for nonlinear inverse problems with joint sparsity constraints in vector valued regimes and an application to color image inpainting. Inverse Problems 23 (2007) 1851-1870
32. Tibshirani R. Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58 1 (1996) 267-288
33. Yuan M., and Lin Y. Model selection and estimation in regression with grouped variables. J. Roy. Statist. Soc. Ser. B 68 1 (2006) 49-67
34. P. Zhao, G. Rocha, B. Yu, The composite absolute penalties family for grouped and hierarchical variable selection, Ann. Statist., in press
35. Zou H., and Hastie T. Regularization and variable selection via the elastic net. J. Roy. Statist. Soc. Ser. B 67 2 (2005) 301-320