Parametric Dictionary Design for Sparse Coding

IEEE Transactions on Signal Processing

Volumn 57, Issue 12, 2009, Pages 4800-4810

  Yaghoobi, Mehrdad ^a   Daudet, Laurent ^b   Davies, Mike E ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b UNIVERSITÉ PARIS DESCARTES   (France)

Author keywords

Dictionary design; Exact sparse recovery; Gammatone filter banks; Incoherent dictionary; Parametric dictionary; Sparse approximation

Indexed keywords

DESIGN METHOD; DESIGN PROBLEMS; EXACT SPARSE RECOVERY; INCOHERENT DICTIONARY; OVER-COMPLETE; PARAMETRIC FUNCTIONS; PRACTICAL METHOD; SPARSE APPROXIMATIONS; SPARSE CODING; SPARSE RECOVERY; TIGHT FRAME;

APPROXIMATION THEORY; FILTER BANKS;

DESIGN;

EID: 70450233548     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2009.2026610     Document Type: Article

References (52)

1. R. Patterson, M. Allerhand, and C. Giguere, "Time-domain modeling of peripheral auditory processing: A modular architecture and a software platform," J. Acoust. Soc. Amer., vol.98, no.4, pp. 1890-1894, 1995.
2. J. Daugman, "Two-dimensional spectral analysis of cortical receptive field profile," Vis. Res., vol.20, pp. 847-856, 1980.
3. J. Tropp, "Topics in sparse approximation," Ph.D. dissertation, Faculty of Graduate School, Univ. of Texas at Austin, Austin, TX, 2004.
4. G. Davis, "Adaptive nonlinear approximations," Ph.D. dissertation, New York Univ., New York, 1994.
5. S. Mallat and Z. Zhang, "Matching pursuits with time frequency dictionaries," IEEE Trans. Signal Process., vol.41, no.12, pp. 3397-3415, 1993.
6. T. Blumensath and M. Davies, "Gradient pursuits," IEEE Trans. Signal Process., vol.56, no.6, pp. 2370-2382, Jun. 2008.
7. S. Chen, D. Donoho, and M. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Scientif. Comput., vol.20, no.1, pp. 33-61, 1998.
8. I. Gorodnitsky and B. Rao, "Sparse signal reconstruction from limited data using focuss:A re-weighted minimum norm algorithm," IEEE Trans. Signal Process., vol.45, no.3, pp. 600-616, Mar. 1997.
9. B. Rao and K. Kreutz-Delgado, "An affine scaling methodology for best basis selection," IEEE Trans. Signal Process., vol.47, no.1, pp. 187-200, Jan. 1999.
10. R. Gribonval and M. Nielsen, "Sparse representations in unions of bases," IEEE Trans. Inf. Theory, vol.49, no.12, pp. 3320-3325, 2003.
11. S. Sardy,A. Bruce, and P. Tseng, "Block coordinate relaxation methods for nonparametric wavelet denoising," J. Comput. Graphic. Statist., vol.9, no.2, pp. 361-379, 2000.
12. E. Candes and L. Demanet, "The curvelet representation of wave propagators is optimally sparse," Commun. Pure Appl. Math., vol.58, no.11, pp. 1472-1528, 2005.
13. B. Olshausen and D. Field, "Sparse coding with an overcomplete basis set: A strategy employed by V1?," Vis. Res., vol.37, no.23, pp. 3311-3325, 1997.
14. M. Lewicki and T. Sejnowski, "Learning overcomplete representations," Neural Comput., vol.12, no.2, pp. 337-365, 2000.
15. K. Kreutz-Delgado, J. Murray, B. Rao, K. Engan, T. Lee, and T. Sejnowski, "Dictionary learning algorithms for sparse representation," Neural Comput., vol.15, pp. 349-396, 2003.
16. M. Aharon, E. Elad, and A. Bruckstein, "K-SVD: An algorithm for designing of overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol.54, no.11, pp. 4311-4322, Nov. 2006.
17. M. Elad, P. Milanfar, and R. Rubinstein, "Analysis versus synthesis in signal priors," Inverse Problems, vol.23, no.3, pp. 947-968, 2007.
18. T. Lee, "Image representation using 2-D Gabor wavelets," IEEE Trans. Pattern Anal. Mach. Intell., vol.18, no.10, pp. 959-971, 1996.
19. A. Katsiamis, E. Drakakis, and R. Lyon, "Practical Gammatone-like filters for auditory processing," EURASIP J. Audio, Speech, Music Process., vol.2007, pp. 1-15, 2007.
20. T. Irino and R. Patterson, "A time domain, level dependent auditory filter: The Gammachirp," J. Acoust. Soc. Amer., vol.101, pp. 412-419, 1997.
21. R. Patterson, I. Nimmo-Smith, J. Holdsworth, and P. Rice, "An efficient auditory filterbank based on the Gammatone function," Applied Psych. Unit (APU), Univ. of Cambridge, Cambridge, U.K., APU Rep., 1988.
22. M. Turner, G. Gerstein, and R. Bajcsy, "Underestimation of visual texture slant by human observers: A model," Biologic. Cybern., vol.65, no.4, pp. 215-226, 2004.
23. S. Strahl and A. Mertins, "Sparse Gammatone signal model optimized for English speech does not match the human auditory filters," Brain Res., vol.1220, pp. 224-233, 2008.
24. D. Donoho and X. Huo, "Uncertainty principles and ideal atomic decomposition," IEEE Trans. Inf. Theory, vol.47, no.7, pp. 2845-2862, 2001.
25. J. Tropp, "Greed is good: Algorithmic results for sparse approximation," IEEE Trans. Inf. Theory, vol.50, no.10, pp. 2231-2242, 2004.
26. J. Tropp, "Just relax: Convex programming methods for identifying sparse signals," IEEE Trans. Inf. Theory, vol.52, no.3, pp. 1030-1051, 2006.
27. R. Gribonval and P. Vandergheynst, "On the exponential convergence of matching pursuits in quasi-incoherent dictionaries," IEEE Trans. Inf. Theory, vol.52, no.1, pp. 255-261, 2006.
28. J. Tropp, I. Dhillon, R. Heath , Jr, and T. Strohmer, "Designing structural tight frames via an alternating projection method," IEEE Trans. Inf. Theory, vol.51, no.1, pp. 188-209, 2005.
29. M. Sustik, J. Tropp, I. Dhillon, and R. Heath, "On the existence of equiangular tight frames," Linear Algebra Its Appl., vol.426, no.2-3, pp. 619-635, 2007.
30. R. Gribonval, "Fast matching pursuit with a multiscale dictionary of Gaussian chirps," IEEE Trans. Signal Process., vol.49, no.5, pp. 994-1001, May 2001.
31. L. Jacques and C. De Vleeschouwer, "A geometrical study of matching pursuit parametrization," IEEE Trans. Signal Process., vol.56, no.7, pt. 1, pp. 2835-2848, Jul. 2008.
32. T. Strohmer and R. Heath, "Grassmannian frames with applications to coding and communication," Appl. Comput. Harmon. Anal., vol.14, no.3, pp. 257-275, 2003.
33. A. Lyapunov, Stability of Motion. New York: Academic, 1966.
34. H. Stark and Y. Yang, Vector Space Projections: A Numerical Approach to Signal and Image Processing, Neural Nets and Optics. New York: Wiley, 1998.
35. H. Hein and S. Hundal, "An alternating projection that does not converge in norm," Nonlinear Anal., vol.57, no.1, pp. 35-61, 2004.
36. I. Csiszar and G. Tusnady, "Information geometry and alternating minimization procedures," Statist. Dec., Supple. No.1, pp. 205-237, 1984.
37. A. Gunawardana and W. Byrne, "Convergence theorems for generalized alternating minimization procedures," J. Mach. Learn. Res., vol.6, pp. 2049-2073, 2005.
38. J. Dattorro, Convex Optimization and Euclidean Distance Geometry (v2007.09.17). Palo Alto, CA: Meboo Publishing, 2005.
39. R. Fletcher, Practical Methods of Optimization. New York: Wiley, 1987.
40. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
41. T. Apostol, Mathematical Analysis: A Modern Approach to Advanced Calculus. Reading, MA: Addison-Wesley, 1974.
42. M. Davies and L. Daudet, "Sparse audio representations using the MCLT," Signal Process., vol.86, no.3, pp. 457-470, 2006.
43. E. Ravelli, G. Richard, and L. Daudet, "Union of MDCT bases for audio coding," IEEE Trans. Audio, Speech Lang. Process., vol.16, no.8, pp. 1361-1372, 2008.
44. E. Smith and M. S. Lewicki, "Efficient coding of time-relative structure using spikes," Neural Comput., vol.17, no.1, pp. 19-45, 2005.
45. M. Lewicki, "Efficient coding of natural sounds," Nature Neurosci., vol.5, no.4, pp. 356-363, 2002.
46. M. Yaghoobi, T. Blumensath, and M. Davies, "Dictionary learning for sparse approximations with the majorization method," IEEE Trans. Signal Process., vol.57, no.6, pp. 2178-2191, Jun. 2009.
47. R. Pichevar, H. Najaf-Zadeh, and L. Thibault, "A biologically-inspired low-bit-rate universal audio coder," presented at the Audio Eng. Soc. Convention, Vienna, Austria, 2007.
48. B. R. Glasberg and B. C. J. Moore, "Derivative of auditory filter shapes from notched-noise data," Hear. Res., vol.47, pp. 103-108, 1990.
49. M. Slaney, "Lyon's cochlear model," Apple Computer, TR-13, 1988 [Online]. Available: http://cobweb.ecn.purdue.edu/∼malcolm/ apple/tr13/LyonsCochlea.pdf
50. M. Slaney, "An efficient implementation of the Patterson-Holdsworth auditory filter bank," Apple Computer, 1993.
51. S. Abellah and M. Plumbley, "If the independent components of natural images are edges, what are the independent components of natural sounds?," in Proc. Int. Conf. Independent Component Analysis Blind Source Separation (ICA), San Diego, CA, Dec. 9-13, 2001, pp. 534-539.
52. R. Gribonval and K. Schnass, "Some recovery conditions for basis learning by L1-minimization," in Proc. Int. Symp. Communications, Control, Signal Processing (ISCCSP), Malta, Mar. 12-14, 2008, pp. 768-773.