A deep learning approach to structured signal recovery

2015 53rd Annual Allerton Conference on Communication, Control, and Computing, Allerton 2015

Volumn , Issue , 2016, Pages 1336-1343

  Mousavi, Ali ^a   Patel, Ankit B ^a   Baraniuk, Richard G ^a  

^a Rice University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPRESSED SENSING; RECOVERY;

AUTO ENCODERS; COMPRESSIVE SENSING; LINEAR MEASUREMENTS; NONLINEAR MEASUREMENT; SIGNAL RECOVERY; SPARSE REPRESENTATION; STATISTICAL DEPENDENCIES; TRAINING DATA;

SIGNAL RECONSTRUCTION;

EID: 84969776710     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ALLERTON.2015.7447163     Document Type: Conference Paper

References (36)

1. D. L. Donoho, "Compressed sensing," Information Theory, IEEE Transactions on, vol. 52, no. 4, pp. 1289-1306, 2006.
2. R. G. Baraniuk, "Compressive sensing," IEEE Signal Processing Magazine, vol. 24, no. 4, 2007.
3. E. J. Candès, "Compressive sampling," in Proceedings of the International Congress of Mathematicians, vol. 3. Madrid, Spain, 2006, pp. 1433-1452.
4. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006.
5. D. Baron, M. B. Wakin, M. F. Duarte, S. Sarvotham, and R. G. Baraniuk, "Distributed compressed sensing. "
6. E. J. Candès and T. Tao, "Near-optimal signal recovery from random projections: Universal encoding strategies" Information Theory, IEEE Transactions on, vol. 52, no. 12, pp. 5406-5425, 2006.
7. D. L. Donoho, A. Maleki, and A. Montanari, "Message-passing algorithms for compressed sensing," Proceedings of the National Academy of Sciences, vol. 106, no. 45, pp. 18 914-18 919, 2009.
8. D. Needell and J. A. Tropp, "Cosamp: Iterative signal recovery from incomplete and inaccurate samples," Applied and Computational Harmonic Analysis, vol. 26, no. 3, pp. 301-321, 2009.
9. T. Blumensath and M. E. Davies, "Iterative hard thresholding for compressed sensing," Applied and Computational Harmonic Analysis, vol. 27, no. 3, pp. 265-274, 2009.
10. A. Beck and M. Teboulle, "A fast iterative shrinkage-thresholding algorithm for linear inverse problems," SIAM Journal on Imaging Sciences, vol. 2, no. 1, pp. 183-202, 2009.
11. E. J. Candès, "The restricted isometry property and its implications for compressed sensing," Comptes Rendus Mathematique, vol. 346, no. 9, pp. 589-592, 2008.
12. M. L. Malloy and R. D. Nowak, "Near-optimal adaptive compressed sensing," Information Theory, IEEE Transactions on, vol. 60, no. 7, pp. 4001-4012, 2014.
13. J. Haupt, R. Nowak, and R. Castro, "Adaptive sensing for sparse signal recovery," in Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop, 2009. DSP/SPE 2009. IEEE 13th, 2009, pp. 702-707.
14. J. Haupt, R. Baraniuk, R. Castro, and R. Nowak, "Sequentially designed compressed sensing," in Proc. IEEE Work. Stat. Signal Processing, 2012, pp. 401-404.
15. J. D. Haupt, R. G. Baraniuk, R. M. Castro, and R. D. Nowak, "Compressive distilled sensing: Sparse recovery using adaptivity in compressive measurements," in Proc. Asilomar Conf. Signals, Systems, and Computers, 2009, pp. 1551-1555.
16. S. Mallat, A wavelet tour of signal processing. Academic Press, 1999.
17. M. S. Crouse, R. D. Nowak, and R. G. Baraniuk, "Wavelet-based statistical signal processing using hidden markov models," Signal Processing, IEEE Transactions on, vol. 46, no. 4, pp. 886-902, 1998.
18. J. S. De Bonet and P. A. Viola, "A non-parametric multi-scale statistical model for natural images," in Proc. Adv. in Neural Processing Systems (NIPS), 1997.
19. M. Aharon, M. Elad, and A. Bruckstein, "K-svd: An algorithm for designing overcomplete dictionaries for sparse representation," Signal Processing, IEEE Transactions on, vol. 54, no. 11, pp. 4311-4322, 2006.
20. H. C. Burger, C. J. Schuler, and S. Harmeling, "Image denoising: Can plain neural networks compete with BM3D" in Proc. IEEE Int. Conf. Comp. Vision, and Pattern Recognition (CVPR), 2012, pp. 2392-2399.
21. D. Eigen, D. Krishnan, and R. Fergus, "Restoring an image taken through a window covered with dirt or rain," in Proc. IEEE Int. Conf. Comp. Vision (ICCV), 2013, pp. 633-640.
22. C. Dong, C. C. Loy, K. He, and X. Tang, "Learning a deep convolutional network for image super-resolution," in Proc. European Conf. Comp. Vision (ECCV). Springer, 2014, pp. 184-199.
23. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning representations by back-propagating errors," Cognitive Modeling, vol. 5, p. 3, 1988.
24. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, "Greedy layerwise training of deep networks," Proc. Adv. in Neural Processing Systems (NIPS), vol. 19, pp. 153-160, 2007.
25. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Computation, vol. 14, no. 8, pp. 1771-1800, 2002.
26. Y. LeCun, S. Chopra, R. Hadsell, M. Ranzato, and F. Huang, "A tutorial on energy-based learning," Predicting Structured Data, vol. 1, p. 0, 2006.
27. A. Krizhevsky and G. Hinton, "Learning multiple layers of features from tiny images," 2009.
28. H. Kamyshanska and R. Memisevic, "The potential energy of an autoencoder," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 37, no. 6, pp. 1261-1273.
29. H. S. Seung, "Learning continuous attractors in recurrent networks. " in Proc. Adv. in Neural Processing Systems (NIPS), vol. 97, 1997, pp. 654-660.
30. P. Vincent, "A connection between score matching and denoising autoencoders," Neural Computation, vol. 23, no. 7, pp. 1661-1674, 2011.
31. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, and M. Bernstein, "Imagenet large scale visual recognition challenge," International Journal of Computer Vision, pp. 1-42, 2014.
32. X. Glorot and Y. Bengio, "Understanding the difficulty of training deep feedforward neural networks," in International Conference on Artificial Intelligence and Statistics, 2010, pp. 249-256.
33. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio, "Theano: a cpu and gpu math expression compiler," in Proceedings of the Python for Scientific Computing Conference (SciPy), vol. 4. Austin, TX, 2010, p. 3.
34. C. A. Metzler, A. Maleki, and R. G. Baraniuk, "From denoising to compressed sensing," arXiv preprint arXiv:1406. 4175, 2014.
35. E. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inform. Theory, vol. 52, no. 2, pp. 489-509, February 2006.
36. A. Mousavi, A. Maleki, and R. G. Baraniuk, "Parameterless optimal approximate message passing," arXiv preprint arXiv:1311. 0035, 2013.