Comparing measures of sparsity

IEEE Transactions on Information Theory

Volumn 55, Issue 10, 2009, Pages 4723-4741

  Hurley, Niall ^a   Rickard, Scott ^a  

^a UNIVERSITY COLLEGE DUBLIN   (Ireland)

Author keywords

Measures of sparsity; Measuring sparsity; Sparse distribution; Sparse representation; Sparsity

Indexed keywords

MEASURES OF SPARSITY; MEASURING SPARSITY; SPARSE DISTRIBUTION; SPARSE REPRESENTATION; SPARSITY;

CLONING; SIGNAL ANALYSIS;

BLIND SOURCE SEPARATION;

EID: 70349622761     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2009.2027527     Document Type: Article

References (51)

1. W. Li and J. Preisig, "Estimation of rapidly time-varying sparse channels," IEEE J. Ocean. Eng., vol. 32, no. 4, pp. 927-939, Oct. 2007.
2. R. Adams, Y. Xu, and F. Canning, "Sparse pseudo inverse of the discrete plane wave transform," IEEE Trans. Antennas Propag., vol. 56, no. 2, pp. 475-484, Feb. 2008.
3. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Machine Intell., 2008, to be published.
4. J. Mairal, M. Elad, and G. Sapiro, "Sparse representation for color image restoration," IEEE Trans. Image Processing, vol. 17, no. 1, pp. 53-69, Jan. 2008.
5. M. Aharon and M. Elad, "Sparse and redundant modeling of image content using an image-signature-dictionary," SIAM J. Imag. Sci., vol. 1, no. 3, pp. 228-247, 2008.
6. K. Leung, M. van Stralen, A. Nemes, M. Voormolen, G. van Burken, M. Geleijnse, F. ten Cate, J. Reiber, N. de Jong, A. van der Steen, and J. Bosch, "Sparse registration for three-dimensional stress echocardiography," IEEE Trans. Med. Imaging, vol. 27, no. 11, pp. 1568-1579, Nov. 2008.
7. A. Gupta, G. Karypis, and V. Kumar, "Highly scalable parallel algorithms for sparse matrix factorization," IEEE Trans. Parallel Distrib. Syst., vol. 8, no. 5, pp. 502-520, May 1997.
8. J. Tropp, "Just relax: Convex programming methods for identifying sparse signals in noise," IEEE Trans. Inf. Theory, vol. 52, no. 3, pp. 1030-1051, Mar. 2006.
9. 1 minimization," J. Fourier Anal. Applicat., 2007.
10. C. Zhu, "Stable recovery of sparse signals via regularized minimization," IEEE Trans. Inf. Theory, vol. 54, no. 7, pp. 3364-3367, Jul. 2008.
11. M. Mishali and Y. Eldar, "Reduce and boost: Recovering arbitrary sets of jointly sparse vectors," IEEE Trans. Signal Processing, vol. 56, no. 10, pp. 4692-4702, Oct. 2008.
12. M. Aharon, M. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Processing, vol. 54, no. 11, pp. 4311-4322, Nov. 2006.
13. M. Akcakaya and V. Tarokh, "A frame construction and a universal distortion bound for sparse representations," IEEE Trans. Signal Processing, vol. 56, no. 6, pp. 2443-2450, Jun. 2008.
14. R. Gribonval and M. Nielsen, "Sparse representations in unions of bases," IEEE Trans. Inf. Theory, vol. 49, no. 12, pp. 3320-3325, Dec. 2003.
15. G. Teschke, "Multi-frame representations in linear inverse problems with mixed multi-constraints," Appl. Computat. Harmon. Anal., vol. 22, no. 1, pp. 43-60, 2007.
16. L. Jiao, L. Bo, and L. Wang, "Fast sparse approximation for least squares support vector machine," IEEE Trans. Neural Netw., vol. 18, no. 3, pp. 685-697, May 2007.
17. T. Blu, P.-L. Dragotti, M. Vetterli, P. Marziliano, and L. Coulot, "Sparse sampling of signal innovations," IEEE Signal Processing Mag., vol. 25, no. 2, pp. 31-40, Mar. 2008.
18. V. Goyal, A. Fletcher, and S. Rangan, "Compressive sampling and lossy compression," IEEE Signal Processing Mag., vol. 25, no. 2, pp. 48-56, Mar. 2008.
19. M. Fornasier, R. Ramlau, and G. Teschke, "The application of joint sparsity and total variation minimization algorithms to a real-life art restoration problem," Adv. Computat. Math., 2008.
20. P. O'Grady, B. Pearlmutter, and S. Rickard, "Survey of sparse and non-sparse methods in source separation," Int. J. Imag. Syst. Technol., vol. 15, Special Issue on Blind Source Separation and Deconvolution in Imaging and Image Processing, no. 1, pp. 18-33, Jul. 2005.
21. Z. He, S. Xie, S. Ding, and A. Cichocki, "Convolutive blind source separation in the frequency domain based on sparse representation," IEEE Trans. Audio, Speech, Language Processing, vol. 15, no. 5, pp. 1551-1563, Jul. 2007.
22. S. Rickard, "The DUET blind source separation algorithm," in Blind Speech Separation. New York: Springer-Verlag, 2007, pp. 217-241.
23. O. Yilmaz and S. Rickard, "Blind separation of speech mixtures via time-frequency masking," IEEE Trans. Signal Processing, vol. 52, no. 7, pp. 1830-1847, Jul. 2004.
24. M. Elad, "Sparse representations are most likely to be the sparsest possible," in EURASIP J. Appl. Signal Processing, 2006.
25. A. Bruckstein, M. Elad, and M. Zibulevsky, "On the uniqueness of non-negative sparse solutions to underdetermined systems of equations," IEEE Trans. Inf. Theory, vol. 54, no. 11, pp. 4813-4820, Nov. 2008.
26. N. Hurley and S. Rickard, "Comparing measures of sparsity," in Proc. IEEE 2008 Workshop on Machine Learning for Signal Processing, Oct. 2008, pp. 55-60.
27. H. Dalton, "The measurement of the inequity of incomes," Econom. J. vol. 30, pp. 348-361, 1920.
28. S. Rickard and M. Fallon, "The Gini index of speech," in Proc. Conf. Inf. Sci. Syst., Princeton, NJ, Mar. 2004.
29. B. C. Arnold, Majorization and the Lorenz Order: A Brief Introduction : Springer-Verlag, 1986.
30. J. Karvanen and A. Cichocki, "Measuring sparseness of noisy signals," in Proc. ICA03, 2003.
31. J. Fuchs, "Recovery of exact sparse representations in the presence of bounded noise," IEEE Trans. Inf. Theory, vol. 51, no. 10, pp. 3601-3608, Oct. 2005.
32. D. Donoho, M. Elad, and V. Temlyakov, "Stable recovery of sparse overcomplete representations in the presence of noise," IEEE Trans. Inf. Theory, vol. 52, no. 1, pp. 6-18, Jan. 2006.
33. G. Rath, C. Guillemot, and J. Fuchs, "Sparse approximations for joint source-channel coding," in 2008 IEEE 10th Workshop on Multimedia Signal Processing, Oct. 2008, pp. 481-485.
34. 1 norm iterative sparse solution for EEG source localization," IEEE Trans. Biomed. Eng., vol. 54, no. 3, pp. 400-409, Mar. 2007.
35. R. Balan, J. Rosca, and S. Rickard, "Equivalence principle for optimization of sparse versus low-spread representations for signal estimation in noise," Int. J. Imaging Syst. Technol., vol. 15, no. 1, pp. 10-17, 2005.
36. E. Candes and T. Tao, "Decoding by linear programming," IEEE Trans. Inf. Theory, vol. 51, no. 12, pp. 4203-4215, Dec. 2005.
37. 1 -norm minimization problems when the solution may be sparse," IEEE Trans. Inf. Theory vol. 54, no. 11, pp. 4789-4812, Nov. 2008.
38. B. A. Olshausen and D. J. Field, "Sparse coding of sensory inputs," Current Opin. Neurobiol., vol. 14, no. 4, pp. 481-487, Aug. 2004.
39. B. Rao and K. Kreutz-Delgado, "An affine scaling methodology for best basis selection," IEEE Trans. Signal Processing, vol. 47, pp. 187-200, Jan. 1999.
40. K. Kreutz-Delgado and B. Rao, "Measures and algorithms for best basis selection," in ICASSP1998, Seattle, WA, 1998.
41. P. O. Hoyer, "Non-negative matrix factorization with sparseness constraints," J. Mach. Learn. Res., vol. 5, pp. 1457-1469, 2004.
42. A. Bronstein, M. Bronstein, M. Zibulevsky, and Y. Y. Zeevi, "Sparse ICA for blind separation of transmitted and reflected images," Int. J. Imag. Syst. Technol., vol. 15, no. 1, pp. 84-91, 2005.
43. M. O. Lorenz, "Methods of measuring concentrations of wealth," J. Amer. Stat. Assoc., 1905.
44. C. Gini, "Measurement of inequality of incomes," Econom. J., vol. 31, pp. 124-126, 1921.
45. H. Shalit and S. Yitzhaki, "The mean-Gini efficient portfolio frontier," J. Finan. Res., vol. 28, no. 1, pp. 59-75, 2005.
46. R. Aaberge, "Axiomatic characterization of the Gini coefficient and Lorenz curve orderings," J. Econom. Theory, vol. 101, pp. 115-132, 2001.
47. R. Aaberge, "Erratum to axiomatic characterization of the Gini coefficient and Lorenz curve orderings," J. Econom. Theory, vol. 140, no. 1, 2008.
48. B. Milanovic, "A simpleway to calculate the Gini coefficient, and some implications," Econom. Lett., vol. 56, no. 1, pp. 45-49, 1997.
49. S. Rickard, "Sparse sources are separated sources," in Proc. 16th Annu. European Signal Processing Conf., Florence, Italy, 2006.
50. N. Hurley, S. Rickard, and P. Curran, "Parameterized lifting for sparse signal representations using the Gini index," in Proc. Signal Processing With Adapt. Sparse Structured Representations (SPARS05 , Rennes, France, Nov. 2005.
51. N. Hurley, S. Rickard, P. Curran, and K. Drakakis, "Maximizing sparsity of wavelet representations via parameterized lifting," in Proc. 15th Int. Conf. Digital Signal Processing, Jul. 2007, pp. 631-634.