Stochastic models for sparse and piecewise-smooth signals

IEEE Transactions on Signal Processing

Volumn 59, Issue 3, 2011, Pages 989-1006

  Unser, Michael ^a   Tafti, Pouya Dehghani ^a  

^a EPFL   (Switzerland)

Author keywords

Fractals; innovation models; non Gaussian statistics; Poisson processes; sparsity; splines; stochastic differential equations; stochastic processes; Wavelet transform

Indexed keywords

NON-GAUSSIAN STATISTICS; POISSON PROCESS; SPARSITY; STOCHASTIC DIFFERENTIAL EQUATIONS; STOCHASTIC PROCESS;

BOUNDARY CONDITIONS; BROWNIAN MOVEMENT; FRACTALS; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); IMAGE MATCHING; MATHEMATICAL OPERATORS; MEASUREMENT THEORY; NOISE POLLUTION CONTROL; POISSON DISTRIBUTION; SIGNAL GENERATORS; SPLINES; STOCHASTIC SYSTEMS; WAVELET TRANSFORMS; WHITE NOISE;

STOCHASTIC MODELS;

EID: 79951629005     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2010.2091638     Document Type: Article

References (50)

1. A. Papoulis, Probability, Random Variables, and Stochastic Processes. New York: McGraw-Hill, 1991.
2. R. Gray and L. Davisson, An Introduction to Statistical Signal Processing. Cambridge, U.K.: Cambridge Univ. Press, 2004.
3. I. Daubechies, "Orthogonal bases of compactly supported wavelets," Comm. Pure Appl. Math., vol. 41, pp. 909-996, 1988.
4. S. G. Mallat, "A theory of multiresolution signal decomposition: The wavelet representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 7, pp. 674-693, 1989.
5. C. Christopoulos, A. Skodras, and T. Ebrahimi, "The JPEG2000 still image coding system: An overview," IEEE Trans. Consum. Electron., vol. 16, no. 4, pp. 1103-1127, 2000.
6. J. B. Weaver, X. Yansun, J. Healy, D. M. , and L. D. Cromwell, "Filtering noise from images with wavelet transforms," Magn. Reson. Med., vol. 21, no. 2, pp. 288-295, 1991.
7. D. Donoho, "De-noising by soft-thresholding," IEEE Trans. Inf. Theory, vol. 41, no. 3, pp. 613-627, 1995.
8. D. L. Donoho and I. M. Johnstone, "Ideal spatial adaptation viawavelet shrinkage," Biometrika, vol. 81, pp. 425-455, 1994.
9. S. Mallat, AWavelet Tour of Signal Processing. San Diego, CA: Academic, 1998.
10. E. J. Candès and M. B. Wakin, "An introduction to compressive sampling," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 21-30, 2008.
11. A. M. Bruckstein, D. L. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol. 51, no. 1, pp. 34-81, 2009.
12. 1-norm solution is also the sparsest solution," Commun. Pure and Appl. Math., vol. 59, no. 6, pp. 797-829, 2006. (Pubitemid 43667226)
13. E. Candès and J. Romberg, "Sparsity and incoherence in compressive sampling," Inverse Problems, vol. 23, no. 3, pp. 969-985, 2007. (Pubitemid 46838836)
14. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, 2006.
15. M. Vetterli, P. Marziliano, and T. Blu, "Sampling signals with finite rate of innovation," IEEE Trans. Signal Process., vol. 50, no. 6, pp. 1417-1428, Jun. 2002. (Pubitemid 34822552)
16. T. Blu, P. Dragotti, M. Vetterli, P. Marziliano, and L. Coulot, "Sparse sampling of signal innovations," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 31-40, 2008.
17. P. Dragotti, M. Vetterli, and T. Blu, "Sampling moments and reconstructing signals of finite rate of innovation: Shannon meets Strang- Fix," IEEE Trans. Signal Process., vol. 55, no. 5, pt. 1, pp. 1741-1757, May 2007. (Pubitemid 46691625)
18. I. Gelfand and N. Y. Vilenkin, Generalized Functions, Vol. 4. Applications of Harmonic Analysis. New York: Academic , 1964.
19. R. A. Devore, "Nonlinear approximation," Acta Numerica, vol. 7, pp. 51-150, 1998.
20. M. Unser and T. Blu, "Generalized smoothing splines and the optimal discretization of the Wiener filter," IEEE Trans. Signal Process., vol. 53, no. 6, pp. 2146-2159, Jun. 2005. (Pubitemid 40843770)
21. Y. Meyer, Ondelettes et opérateurs I: Ondelettes. Paris, France: Hermann, 1990.
22. A. Chambolle, R. DeVore, N.-Y. Lee, and B. Lucier, "Nonlinear wavelet image processing: Variational problems, compression, and noise removal through wavelet shrinkage," IEEE Trans. Image Process., vol. 7, no. 33, pp. 319-335, 1998. (Pubitemid 128745350)
23. L. I. Rudin, S. Osher, and E. Fatemi, "Nonlinear total variation based noise removal algorithms," Physica D, vol. 60, no. 1-4, pp. 259-268, 1992.
24. E. Mammen and S. van de Geer, "Locally adaptive regression splines," Ann. Statist., vol. 25, no. 1, pp. 387-413, 1997.
25. M. Raphan and E. P. Simoncelli, "Optimal denoising in redundant representations," IEEE Trans. Image Process., vol. 17, no. 8, pp. 1342-1352, 2008.
26. A. Kolmogoroff, "La transformation de Laplace dans les espaces linéaires," C. R. Acad. Sci. Paris, vol. 200, pp. 1717-1718, 1935, note of M. A. Kolmogoroff, presented by M. Jacques Hadamard.
27. L. Schumaker, Spline Functions: Basic Theory. New York: Wiley, 1981.
28. J. Rice, "Generalized shot noise," Adv. Appl. Probabil., vol. 9, no. 3, pp. 553-565, 1977.
29. P. Brémaud and L. Massoulié, "Power spectra of general shot noises and Hawkes point processes with a random excitation," Adv. Appl. Probabil., vol. 34, no. 1, pp. 205-222, 2002. (Pubitemid 34726721)
30. M. Unser and T. Blu, "Self-similarity: Part I-Splines and operators," IEEE Trans. Signal Process., vol. 55, no. 4, pp. 1352-1363, Apr. 2007.
31. J. Duchon, "Splines minimizing rotation-invariant semi-norms in sobolev spaces," in Constructive Theory of Functions of Several Variables, W. Schempp and K. Zeller, Eds. Berlin: Springer-Verlag, 1977, pp. 85-100.
32. P. Tafti, D. Van De Ville, and M. Unser, "Invariances, Laplacian-like wavelet bases, and the whitening of fractal processes," IEEE Trans. Image Process., vol. 18, no. 4, pp. 689-702, Apr. 2009.
33. T. Blu and M. Unser, "Self-similarity: Part II-Optimal estimation of fractal processes," IEEE Trans. Signal Process., vol. 55, no. 4, pp. 1364-1378, Apr. 2007. (Pubitemid 46566204)
34. M. Taqqu, "Fractional Brownian motion and long-range dependence," in Theory and Applications of Long-Range Dependence, P. Doukhan, G. Oppenheim, and M. Taqqu, Eds. Boston, MA: Birkhauser, 2003, pp. 5-38.
35. Q. Sun and M. Unser, "Left inverses of fractional Laplacian and sparse stochastic processes," Adv. Computat. Math., to be published.
36. B. B. Mandelbrot and J. W. Van Ness, "Fractional Brownian motions fractional noises and applications," SIAM Rev., vol. 10, no. 4, pp. 422-437, 1968.
37. E. Perrin, R. Harba, C. Berzin-Joseph, I. Iribarren, and A. Bonami, " nth-order fractional Brownian motion and fractional Gaussian noises," IEEE Trans. Signal Process., vol. 49, no. 5, pp. 1049-1059, 2001. (Pubitemid 32444203)
38. B. B. Mandelbrot, Gaussian Self-Affinity and Fractals. Berlin: Springer, 2001.
39. B. B. Mandelbrot, The Fractal Geometry of Nature. San Francisco, CA: Freeman, 1982.
40. D. M. Roy and Y. W. Teh, "The Mondrian process," in Adv. Neural Inf. Process. Syst. 21, Proc. 22 Annu. Conf. Neural Inf. Process. Syst., D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, Eds., Vancouver, BC, Canada, Dec. 2009, pp. 1377-1384.
41. C. Chui and J.Wang, "A cardinal spline approach to wavelets," in Proc. Amer. Math. Soc., 1991, vol. 113, no. 3, pp. 785-793.
42. M. Unser and T. Blu, "Fractional splines and wavelets," SIAM Rev., vol. 42, no. 1, pp. 43-67, Mar. 2000.
43. T. Blu and M. Unser, "A complete family of scaling functions: The (α t)-fractional splines," in Proc. 28th IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP'03), Hong Kong SAR, People's Rep. China, Apr. 6-10, 2003, vol. VI, pp. 421-424.
44. D. Van De Ville, B. Forster-Heinlein, M. Unser, and T. Blu, "Analytical footprints: Compact representation of elementary singularities in wavelet bases," IEEE Trans. Image Process., vol. 58, no. 12, pp. 6105-6118, 2010.
45. D. Van De Ville, T. Blu, and M. Unser, "Isotropic polyharmonic B-splines: Scaling functions and wavelets," IEEE Trans. Image Process., vol. 14, no. 11, pp. 1798-1813, Nov. 2005. (Pubitemid 41655694)
46. I. Khalidov, D. Van De Ville, T. Blu, and M. Unser, "Construction of wavelet bases that mimic the behaviour of some given operator," in Proc. SPIE Conf. Math. Imaging: Wavelet XII, San Diego, CA, Aug. 26-29, 2007, vol. 6701, pp. 67010S-1-67010S-7.
47. I. Khalidov and M. Unser, "From differential equations to the construction of new wavelet-like bases," IEEE Trans. Signal Process., vol. 54, no. 4, pp. 1256-1267, Apr. 2006.
48. C. Vonesch, T. Blu, and M. Unser, "Generalized Daubechies wavelet families," IEEE Trans. Signal Process., vol. 55, no. 9, pp. 4415-4429, Sep. 2007. (Pubitemid 47323620)
49. J. Verhaeghe, D. Van De Ville, I. Khalidov, Y. D'Asseler, I. Lemahieu, and M. Unser, "Dynamic PET reconstruction using wavelet regularization with adapted basis functions," IEEE Trans. Med. Imag., vol. 27, no. 7, pp. 943-959, 2008.
50. I. Khalidov, D. Van De Ville, J. Fadili, and M. Unser, "Activelets and sparsity:A newway to detect brain activation from fMRI data," in Proc. SPIE Conf. Math. Imag.: Wavelet XII, San Diego, CA, Aug. 26-29, 2007, vol. 6701, pp. 67010Y-1-67010Y-8.