Randomization of data acquisition and ℓ1-optimization (recognition with compression)

Automation and Remote Control

Volumn 71, Issue 11, 2010, Pages 2259-2282

  Granichin, O N ^a   Pavlenko, D V ^a  

^a ST PETERSBURG STATE UNIVERSITY   (Russian Federation)

Author keywords

[No Author keywords available]

Indexed keywords

RANDOM PROCESSES;

ACQUISITION AND REPRESENTATIONS; COMPRESSED DATUM; COMPRESSIVE SENSING; PROCESSING SIGNAL; SPARSE REPRESENTATION;

DATA ACQUISITION;

EID: 78650026046     PISSN: 00051179     EISSN: None     Source Type: Journal    
DOI: 10.1134/S0005117910110019     Document Type: Review

References (90)

1. Granichin, O.N. and Kiyaev, V.I., Informatsionnye tekhnologii v upravlenii (Information Technologies in Control), Moscow: Binom, 2008.
2. Ermakov, S.M. and Zhiglyavskii, A.A., Matematicheskaya teoriya optimal'nogo eksperimenta (Mathematical Theory of Optimal Experiments), Moscow: Nauka, 1987.
3. Granichin, O.N. and Polyak, B.T., Randomizirovannye algoritmy otsenivaniya i optimizatsii pri pochti proizvol'nykh pomekhakh (Randomized Algorithms of Estimation and Optimization under Almost Arbitrary Noise), Moscow: Nauka, 2003.
4. O.N. Granichin 2004 Linear Regression and Filtering under Nonstandard Assumptions (Arbitrary Noise) IEEE Trans. Automat. Control 49 10 1830 1835 10.1109/TAC.2004.835585 2091340
5. Fisher, R.A., The Design of Experiments, Edinburgh: Oliver and Boyd, 1935.
6. Ljung, L., System Identification: Theory for the User, Upper Saddle River: PTR Prentice Hall, 2nd ed., 1999.
7. Tsypkin, Ya.Z., Informatsionnaya teoriya identifikatsii (Informational Identification Theory), Moscow: Nauka, 1995.
8. L. Györfi 1980 Stochastic Approximation from Ergodic Sample for Linear Regression Z. Wahrscti. Verw. Geb. 54 47 55 0423.62067 10.1007/BF00535352
9. A. Krieger E. Masry 1988 Convergence Analysis of Adaptive Linear Estimation for Dependent Stationary Processes IEEE Trans. Inform. Theory 34 177 182 10.1109/18.9765 966737
10. Young, R.S., Recursive Estimation and Time-Series Analysis. An Introduction, Berlin: Springer, 1984.
11. Albert, A., Regression and the Moore-Penrose Pseudoinverse, New York: Academic, 1972.
12. Polyak, B.T. and Tsypkin, Ya.Z., Adaptive Estimation Algorithms (Converhence, Optimality, Stability), Autom. Remote Control, 1979, no. 3, pp. 378-389.
13. Polyak, B.T., New Method of Stochastic Approximation Type, Autom. Remote Control, 1990, no. 7, pp. 937-946.
14. E. Candes J. Romberg T. Tao 2006 Robust Uncertainty Principles: Exact Signal Reconstruction from Highly Incomplete Frequency Information IEEE Trans. Inform. Theory 52 2 489 509 10.1109/TIT.2005.862083 2236170 (Pubitemid 43174093)
15. D. Donoho 2006 Compressed Sensing IEEE Trans. Inform. Theory 52 4 1289 1306 10.1109/TIT.2006.871582 2241189
16. B.S. Kashin V.N. Temlyakov 2007 Remark on the Problem of Compressed Measurement Mat. Zametki 82 6 829 837 2399963
17. J.F. Claerbout F. Muir 1973 Robust Modeling with Erratic Data Geophysics 38 5 826 844 10.1190/1.1440378
18. F. Santosa W.W. Symes 1986 Linear Inversion of Band-limited Reflection Seismograms SIAM J. Sci. Statist. Comput. 7 4 1307 1330 0602.73113 10.1137/0907087 857796
19. Granichin, O.N., Optimal Control of Linear Plant with Nonregular Bounded Noise, in Abstracts of All-Union Conf. "Theory of Adaptive Systems and Its Applications," Moscow: VINITI, 1983, p. 26.
20. Barabanov, A.E. and Granichin, O.N., Optimal Controller for a Linear Plant with Bounded Noise, Autom. Remote Control, 1984, no. 5, pp. 578-584.
21. M. Dahlem J.B. Pearson 1987 ℓ-1 optimal Feedback Controllers for MIMO Discrete Systems IEEE Trans. Automat. Control 32 4 314 322 10.1109/TAC.1987. 1104603
22. R.G. Baraniuk 2007 Compressive Sensing IEEE Signal Process. Magaz. 52 2 118 120 10.1109/MSP.2007.4286571 2044455 (Pubitemid 47316173)
23. Wiener, N., Cybernetics or Control and Communication in the Animals and the Machines, New York: MIT Press, 1961. Translated under the title Kibernetika ili upravlenie i svyaz' v zhibotnom i mashine, Moscow: Nauka, 1983.
24. Kotel'nikov, V.A., On the Throughput of Ether and Wire in Electrical Communication, in All-Union Energy Committee. Materials for the First All-Union Conference on Technical Reconstruction of Communication and Development of Low-current Industry, 1933. Paper reprinted in Usp. Phys. Nauk, vol. 176, no. 7, pp. 762-770.
25. K. Kupfmuller 1928 Uber die Dynamik der Selbsttatigen Verstarkungsregler Elektr. Nachrichtentechnik 5 11 459 467
26. H. Nyquist 1928 Certain Topics in Telegraph Transmission Theory Trans. AIEE 47 617 644
27. C.E. Shannon 1949 Communication in the Presence of Noise Proc. IRE 37 1 10 21 10.1109/JRPROC.1949.232969 28549
28. Wakin, M., Manifold-based Signal Recovery and Parameter Estimation from Compressive Measurements, Preprint of Colorado School of Mines, 2008.
29. H. Rauhut K. Schnass P. Vandergheynst 2008 Compressed Sensing and Redundant Dictionaries IEEE Trans. Inf. Theory 54 5 2210 2219 10.1109/TIT.2008.920190 2450858 (Pubitemid 351689557)
30. Cevher, V., Duarte, M., Hegde, C., and Baraniuk, R., Sparse Signal Recovery Using Markov Random Fields, in Proc. Workshop Neural Information Process. Systems (NIPS), 2008.
31. M. Mishali Y.C. Eldar 2008 Reduce and Boost: Recovering Arbitrary Sets of Jointly Sparse Vectors IEEE Trans. Signal Process. 56 10 4692 4702 10.1109/TSP.2008.927802 2517125
32. Taubman, D.S. and Marcellin, M.V., JPEG 2000: Image Compression Fundamentals, Standards and Practice, Norwell: Kluwer, 2001.
33. Boufounos, P.T. and Baraniuk, R.G., 1-Bit Compressive Sensing, in 42nd Conf. Inf. Sc. Systems (CISS), Princeton, 2008, pp. 19-21.
34. Takhar, D., Bansal, V., Wakin, M., et al., A Compressed Sensing Camera: New Theory and an Implementation Using Digital Micromirrors, in Proc. Comput. Imaging IV SPIE Electronic Imaging, San Jose, 2006.
35. M.F. Duarte M.A. Davenport D. Takhar, et al. 2008 Single-Pixel Imaging via Compressive Sampling IEEE Signal Process. Magaz. 25 2 83 91 10.1109/MSP.2007.914730 (Pubitemid 351513069)
36. E.J. Candes 2008 The Restricted Isometry Property and Its Implications for Compressed Sensing Comptes Rendus de l'Acad. des Sci., Serie I 346 589 592 1153.94002 2412803
37. E. Candes J. Romberg 2007 Sparsity and Incoherence in Compressive Sampling Inverse Problems 23 3 969 985 1120.94005 10.1088/0266-5611/23/3/008 2329927 (Pubitemid 46838836)
38. E. Candes M. Wakin 2008 People Hearing without Listening: An Introduction to Compressive Sampling IEEE Signal Process. Magaz. 25 2 21 30 10.1109/MSP.2007.914731 (Pubitemid 351513062)
39. B.S. Kashin 1977 Diameters of Some Finite-dimensional Sets and Classes of Smooth Functions Izv. Akad. Nauk SSSR, Mat. 42 2 334 351
40. A.Yu. Garnaev E.D. Gluskin 1984 On Diameters of the Euclidean Sphere Dokl. Akad. Nauk SSSR 277 5 200 204 759962
41. R. Baraniuk M. Davenport R. DeVore M. Wakin 2007 A Simple Proof of the Restricted Isometry Property for Random Matrices (aka "The Johnson-Lindenstrauss Lemma Meets Compressed Sensing") Constr. Approx. 28 3 253 263 10.1007/s00365-007-9003-x 2453366
42. Johnson, W. and Lindenstrauss, J., Extensions of Lipschitz Mapping into a Hilbert Space, in Conf. Modern Anal. Probabil., 1984, pp. 189-206.
43. Achlioptas, D., Database-friendly Random Projections, in Proc. ACM SIGACT-SIGMOD-SIGART Symp. Principles Database Systems, 2001, pp. 274-281.
44. 1 Minimization, Rreprint, 2010, Available at http://arxiv.org/abs/0809.2650.
45. Baron, D., Wakin, M.B., Duarte, M., Sarvotham, S., and Baraniuk, R.G., Distributed Compressed Sensing, 2005, Available at: http://dsp.rice.edu/cs/ DCS112005.pdf.
46. S.S. Chen D.L. Donoho M.A. Saunders 2001 Atomic Decomposition by Basis Pursuit SIAM J. Sci. Comput. 43 1 129 159 0979.94010 1854649
47. R. Tibshirani 1996 Regression Shrinkage and Selection via the Lasso J. Royal. Statist. Soc. B 58 1 267 288 0850.62538 1379242
48. 1 Approach to the Compressed Sensing Problem IEEE Signal Process. Lett. 17 2 181 184 10.1109/LSP.2009. 2034554
49. 0 Norm IEEE Trans. Signal Process. 57 1 289 301 10.1109/TSP.2008.2007606
50. Polyak, B.T., Vvedenie v optimizatsiyu, Moscow: Nauka, 1983. Translated into English under the title Introduction to Optimization, New York: Optimization Software, 1987.
51. R. Chartrand 2007 Exact Reconstructions from Surprisingly Little Data IEEE Signal Process. Lett. 14 707 710 10.1109/LSP.2007.898300 (Pubitemid 47434090)
52. Chartrand, R., Fast Algorithms for Nonconvex Compressive Sensing: MRI Reconstruction from Very Few Data, IEEE Int. Sympos. Biomedical Imaging (ISBI), 2009, pp. 1349-1360.
53. Saab, R., Chartrand, R., and Yilmaz, O., Stable Sparse Approximations via Nonconvex Optimization, in Proc. 33rd Int. Conf. Acoustics, Speech, Signal Process. (ICASSP), 2008, pp. 3885-3888.
54. Chartrand, R. and Yin, W., Iteratively Reweighted Algorithms for Compressive Sensing, in IEEE Int. Conf. Acoustics, Speech, Signal Process. (ICASSP), Las Vegas, 2008.
55. Daubechies, I., DeVore, R., Fornasier, M., and Gunturk, S., Iteratively Re-weighted Least Squares Minimization: Proof of Faster than Linear Rate for Sparse Recovery, in 42nd Ann. Conf. Inf. Sci. Systems, 19-21 March 2008, pp. 26-29.
56. Wipf, D. and Nagarajan, S., Iterative Reweighted 1 and 2 Methods for Finding Sparse Solutions, UC San Francisco, Technical Report, 2008.
57. K. Bredies D.A. Lorenz 2008 Iterated Hard Shrinkage for Minimization Problems with Sparsity Constraints SIAM J. Sci. Comput. 30 2 657 683 1170.46067 10.1137/060663556 2385880
58. Herrity, K.K., Gilbert, A.C., and Tropp, J.A., Sparse Approximation via Iterative Thresholding, in ICASSP 2006 Proc., 14-16 May 2006, vol. 3, pp. 624-627.
59. Ma, J., Improved Iterative Curvelet Thresholding for Compressed Sensing, Preprint, 2009, Available at: http://dsp.rice.edu/sites/dsp.rice.edu/files/cs/ ISTcs2.pdf.
60. A. Beck M. Teboulle 2009 A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems SIAM J. Imaging Sci. 2 1 183 202 1175.94009 10.1137/080716542 2486527
61. J. Bioucas-Dias M. Figueiredo 2007 A New TwIST: Two-step Iterative Shrinkage/Thresholding Algorithms for Image Restoration IEEE Trans. Image Process. 16 12 2992 3004 10.1109/TIP.2007.909319 2472806 (Pubitemid 350201232)
62. P.L. Combettes V.R. Wajs 2005 Signal Recovery by Proximal Forward-Backward Splitting SIAM J. Multiscale Modeling Simulation 4 4 1168 1200 1179.94031 10.1137/050626090 2203849 (Pubitemid 44932287)
63. Combettes, P.L. and Pesquet, J.-Ch., Proximal Splitting Methods in Signal Processing, Preprint, 2010, Available at: http://arxiv4.library.cornell.edu/ abs/0912.3522.
64. Egiazarian, K., Foi, A., and Katkovnik, V., Compressed Sensing Image Reconstruction via Recursive Spatially Adaptive Filtering, in Proc. IEEE Int. Conf. Image Process., ICIP 2007, San Antonio, 16-19 September 2007, pp. 549-552.
65. S. Mallat Z. Zhang 1993 Matching Pursuit with Time-Frequency Dictionaries IEEE Trans. Signal Process. 41 12 3397 3415 0842.94004 10.1109/78.258082
66. Tropp, J. and Gilbert, A.C., Signal Recovery from Partial Information via OrthogonalMatching Pursuit, 2005, Available at: www-personal.umich.edu/~jtropp/ papers/TG06-Signal-Recovery.pdf.
67. Davenport, M.A. and Wakin, M.B., Analysis of Orthogonal Matching Pursuit Using the Restricted Isometry Property, Preprint, 2010, Available at: http://arxiv.org/abs/0909.0083.
68. D. Needell R. Vershynin 2009 Uniform Uncertainty Principle and Signal Recovery via Regularized Orthogonal Matching Pursuit Foundat. Comput. Math. 9 317 334 1183.68739 10.1007/s10208-008-9031-3 2496554
69. D. Needell J.A. Tropp 2008 CoSaMP: Iterative Signal Recovery from Incomplete and Inaccurate Samples Appl. Comp. Harmonic Anal. 26 301 321 10.1016/j.acha.2008.07.002 2502366
70. W. Dai O. Milenkovic 2009 Subspace Pursuit for Compressive Sensing Signal Reconstruction IEEE Trans. Inf. Theory 55 5 2230 2249 10.1109/TIT.2009.2016006
71. Donoho, D.L., Tsaig, Y., Drori, I., and Starck, J.-L., Sparse Solution of Underdetermined Linear Equations by Stagewise Orthogonal Matching Pursuit, Stanford Univ. Tech. Rep., 2006, Available at: http://stat.stanford.edu/idrori/ StOMP.pdf.
72. Cohen, A., Dahmen, W., and DeVore, R., Instance Optimal Decoding by Thresholding in Compressed Sensing, Preprint, 2008, Available: http://www.igpm.rwth-aachen.de/Download/reports/pdf/IGPM289.pdf.
73. La, C. and Minh, N.D., Tree-based Orthogonal Matching Pursuit Algorithm for Signal Reconstruction, in IEEE Int. Conf. Image Process., 8-11 Oct., 2006, pp. 1277-1280.
74. T. Blumensath M.E. Davies 2008 Gradient Pursuits IEEE Trans. Signal Process. 56 6 2370 2382 10.1109/TSP.2007.916124 2516640 (Pubitemid 351795890)
75. R. Berinde P. Indyk 2009 Sequential Sparse Matching Pursuit MIT Allerton Berinde, R. and Indyk, P., Sequential Sparse Matching Pursuit, Allerton: MIT, 2009, Available at: http://people.csail.mit.edu/indyk/ssmp.pdf.
76. Baron, D., Sarvotham, S., and Baraniuk, R.G., Bayesian Compressive Sensing via Belief Propagation, 2008, Available at: http://arxiv.org/abs/0812. 4627.
77. Cormode, G. and Muthukrishnan, S., Combinatorial Algorithms for Compressed Sensing, Berlin: Springer, 2006.
78. S. Jafarpour W. Xu B. Hassibi R. Calderbank 2009 Efficient and Robust Compressed Sensing Using Optimized Expander Graphs IEEE Trans. Info. Theory 55 9 4299 4308 10.1109/TIT.2009.2025528 2582882
79. Berinde, R., Indyk, P., and Ruzic, M., Practical Near-optimal Sparse Recovery in the L1 Norm, in 46th Annual Allerton Conf. Communication, Control, Computing, Allerton, 2008, pp. 198-205.
80. M. Lustig D.L. Donoho J.M. Santos J.M. Pauly 2008 Compressed Sensing MRI IEEE Signal Process. Magaz. 25 2 72 82 10.1109/MSP.2007.914728 (Pubitemid 351513068)
81. E.J. Candes J. Romberg 2005 Practical Signal Recovery from Random Projections Proc. SPIE Computational Imaging 5674 76 86
82. Wakin, M., Laska, J., Duarte, M., Baron, D., Sarvotham, S., Takhar, D., Kelly, K., and Baraniuk, R., Compressive Imaging for Video Representation and Coding, in Proc. Picture Coding Sympos.-PCS 2006, Beijing, 2006, Available at: http://www.mines.edu/mwakin/papers/pcs-camera.pdf.
83. J. Ma F.X. Le Dimet 2009 Deblurring from Highly Incomplete Measurements for Remote Sensing IEEE Trans. Geoscience Remote Sensing 47 3 792 802 10.1109/TGRS.2008.2004709
84. Katkovnik, V. and Egiazarian, K., Nonlocal Image Deblurring: Variational Formulation with Nonlocal Collaborative L0 Norm Prior, in Int. Workshop Local Non-Local Approximation in Image Process., 19-21 Aug., 2009, pp. 46-53.
85. Calderbank, R., Jafarpour, S., and Robert Schapire, R., Compressed Learning: Universal Sparse Dimensionality Reduction and Learning in the Measurement Domain, Preprint, 2009, Available at: http://dsp.rice.edu/files/cs/ cl.pdf.
86. Hsu, D., Langford, J., Kakade, S., and Zhang, T., Multi-label Prediction via Compressed Sensing, Preprint, 2009, Available at: http://arxiv.org/abs/0902. 1284.
87. Jiyoung, C., Minwoo, K., Won, S., and Jong, C.Y., Compressed Sensing Metal Artifact Removal in Dental CT, in IEEE Int. Sympos. Biological Imaging, 2009, pp. 334-337.
88. Kirolos, S., Laska, J., Wakin, M., et al., Analog-to-Information Conversion via Random Demodulation, in Proc. IEEE Dallas Circuits Systems Workshop, 2006, pp. 71-74.
89. Baraniuk, R. and Steeghs, P., Compressive Radar Imaging, in IEEE Radar Conf., 2007, pp. 128-133.
90. M. Vetterli P. Marziliano T. Blu 2002 Sampling Signals with Finite Rate of Innovation IEEE Trans. Signal Process. 50 6 1417 1428 10.1109/TSP.2002. 1003065 1930786 (Pubitemid 34822552)