Compressive system identification: Sequential methods and entropy bounds

Digital Signal Processing: A Review Journal

Volumn 23, Issue 3, 2013, Pages 751-770

  Carmi, Avishy Y ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Autoregressive processes; Complex systems; Compressive sensing; Differential entropy; Kalman filtering; Non RIP; Sensing complexity; System identification; Time series; Variable selection

Indexed keywords

COMPRESSED SENSING; ENTROPY; IDENTIFICATION (CONTROL SYSTEMS); INFORMATION THEORY; LARGE SCALE SYSTEMS; RANDOM PROCESSES; RELIGIOUS BUILDINGS; TIME SERIES;

AUTO REGRESSIVE PROCESS; COMPRESSIVE SENSING; DIFFERENTIAL ENTROPY; KALMAN-FILTERING; NON-RIP; SENSING COMPLEXITY; VARIABLE SELECTION;

KALMAN FILTERS;

EID: 84875231089     PISSN: 10512004     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dsp.2012.12.006     Document Type: Article

References (52)

1. P. Alan Forecasting with Univariate Box-Jenkins Models: Concepts and Cases 1983 John Wiley & Sons
2. l 1-norm IEEE Trans. Signal Process. 58 July 2010 3436 3447
3. D. Angelosante, G.B. Giannakis, E. Grossi, Compressed sensing of time-varying signals, in: Proceedings of the 16th International Conference on Digital Signal Processing, 2009.
4. M.S. Asif, A. Charles, J. Romberg, C. Rozell, Estimation and dynamic updating of time-varying signals with sparse variations, in: International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2011, pp. 3908-3911.
5. M.S. Asif, J. Romberg, Dynamic updating for sparse time varying signals, in: Proceedings of the Conference on Information Sciences and Systems, 2009, pp. 3-8.
6. R.G. Baraniuk, M.A. Davenport, D. Ronald, and M.B. Wakin A simple proof of the restricted isometry property for random matrices Constr. Approx. 28 December 2008 253 263
7. A. Benveniste, M. Basseville, and G.V. Moustakides The asymptotic local approach to change detection and model validation IEEE Trans. Autom. Control 32 1987 583 592
8. T. Blumensath, and M. Davies Iterative hard thresholding for compressed sensing Appl. Comput. Harmon. Anal. 27 2009 265 274
9. J. Bosch-Bayard Estimating brain functional connectivity with sparse multivariate autoregression Philos. Trans. R. Soc. 360 2005 969 981
10. P.J. Brockwell, and R.A. Davis Time Series: Theory and Methods 2009 Springer
11. E.J. Candes The restricted isometry property and its implications for compressed sensing C. R. Math. 346 2008 589 592
12. E.J. Candes, Y.C. Eldar, D. Needell, and P. Randall Compressed sensing with coherent and redundant dictionaries Appl. Comput. Harmon. Anal. 31 2011 59 73
13. E.J. Candes, J. Romberg, and T. Tao Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information IEEE Trans. Inf. Theory 52 2006 489 509
14. E.J. Candes, and T. Tao Decoding by linear programming IEEE Trans. Inf. Theory 51 2005 4203 4215
15. E.J. Candes, and T. Tao Near-optimal signal recovery from random projections: Universal encoding strategies? IEEE Trans. Inf. Theory 52 2006 5406 5425
16. E. Candes, and T. Tao The Dantzig selector: Statistical estimation when p is much larger than n Ann. Stat. 35 2007 2313 2351
17. E.J. Candes, and M.B. Wakin An introduction to compressive sampling IEEE Signal Process. Mag. 25 2008 21 31
18. A. Carmi, P. Gurfil, D. Kanevsky, A simple method for sparse signal recovery from noisy observations using Kalman filtering, Technical Report RC24709, Human Language Technologies, IBM, 2008.
19. A. Carmi, P. Gurfil, and D. Kanevsky Methods for sparse signal recovery using Kalman filtering with embedded pseudo-measurement norms and quasi-norms IEEE Trans. Signal Process. 58 2010 2405 2409
20. A. Carmi, L. Mihaylova, D. Kanevsky, Unscented compressed sensing, in: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2012.
21. A. Charles, M.S. Asif, J. Romberg, C. Rozell, Sparsity penalties in dynamical system estimation, in: Proceedings of the Conference on Information Sciences and Systems, 2011, pp. 1-6.
22. S. Chen, S.A. Billings, and W. Luo Orthogonal least squares methods and their application to non-linear system identification Int. J. Control 50 1989 1873 1896
23. S.S. Chen, D.L. Donoho, and M.A. Saunders Atomic decomposition by basis pursuit SIAM J. Sci. Comput. 20 1998 33 61
24. G. Davis, S. Mallat, and M. Avellaneda Greedy adaptive approximation Constr. Approx. 13 1997 57 98
25. J. Deurschmann, I. Bar-Itzhack, G. Ken, Quaternion normalization in spacecraft attitude determination, in: Proceedings of the AIAA/AAS Astrodynamics Conference, 1992, pp. 27-37.
26. D.L. Donoho Compressed sensing IEEE Trans. Inf. Theory 52 2006 1289 1306
27. M.F. Durate, M.A. Davenport, D. Takhar, J.N. Laska, T. Sun, K.F. Kelly, and R.G. Baraniuk Single pixel imaging via compressive sampling IEEE Signal Process. Mag. 25 2 2008 83 91
28. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani Least angle regression Ann. Stat. 32 2004 407 499
29. N. Friedman, I. Nachman, D. Peer, Learning Bayesian network structure from massive datasets: The "sparse candidate" algorithm, in: Proceedings of the Fifteenth Annual Conference on Uncertainty in Artificial Intelligence (UAI-99), 1999, pp. 206-215.
30. C.W.J. Granger Investigating causal relations by econometric models and cross-spectral methods Econometrica 37 1969 424 438
31. S. Haufe, K. Muller, G. Nolte, N. Kramer, Sparse causal discovery in multivariate time series, in: NIPS Workshop on Causality, 2008.
32. A. Hirotugu A new look at the statistical model identification IEEE Trans. Autom. Control 19 1974 716 723
33. G.M. James, P. Radchenko, and J. Lv DASSO: Connections between the Dantzig Selector and LASSO J. R. Stat. Soc. 71 2009 127 142
34. S. Ji, Y. Xue, and L. Carin Bayesian compressive sensing IEEE Trans. Signal Process. 56 June 2008 2346 2356
35. S.J. Julier, and J.J. LaViola On Kalman filtering with nonlinear equality constraints IEEE Trans. Signal Process. 55 2007 2774 2784
36. S.J. Julier, J.K. Uhlmann, A new extension of the Kalman filter to nonlinear systems, in: Proceedings of the International Symposium on Aerospace/Defense Sensing, Simulation and Controls, 1997, pp. 182-193.
37. T. Kailath Linear Systems 1980 Prentice Hall Englewood Cliffs, New Jersey
38. N. Kalouptsidis, G. Mileounis, B. Babadi, and V. Tarokh Adaptive algorithms for sparse system identification Signal Process. 91 August 2011 1910 1919
39. J.N. Laska, P.T. Boufounos, M.A. Davenport, and R.G. Baraniuk Democracy in action: Quantization, saturation, and compressive sensing Appl. Comput. Harmon. Anal. 31 2011 429 443
40. S. Mallat, and Z. Zhang Matching pursuits with time-frequency dictionaries IEEE Trans. Signal Process. 4 1993 3397 3415
41. J.M. Mendel Lessons in Estimation Theory for Signal Processing, Communications, and Control 1995 Prentice Hall
42. Y.C. Pati, R. Rezifar, P.S. Krishnaprasad, Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition, in: Proceedings of the 27th Asilomar Conference on Signals, Systems and Computers, 1993, pp. 40-44.
43. M. Rudelson Random vectors in the isotropic position J. Funct. Anal. 164 May 1999 60 72
44. M. Rudelson, and R. Vershynin Geometric approach to error correcting codes and reconstruction of signals Int. Math. Res. Not. 64 2005 4019 4041
45. B.M. Sanadaji, T.L. Vincent, M.B. Wakin, R. Toth, K. Poola, Compressive system identification of LTI and LTV ARX models, in: Proceedings of the IEEE Conference on Decision and Control and European Control Conference (CDC-ECC), 2011, pp. 791-798.
46. G.E. Schwarz Estimating the dimension of a model Ann. Stat. 6 1978 461 464
47. A.D. Sokal, Monte Carlo methods in statistical mechanics: Foundations and new algorithms, Cours de Troisieme Cycle de la Physique en Suisse Romande, Laussane, 1989.
48. R. Tibshirani Regression shrinkage and selection via the LASSO J. R. Stat. Soc., Ser. B 58 1996 267 288
49. M.E. Tipping Sparse Bayesian learning and the relevance vector machine J. Mach. Learn. Res. 1 2001 211 244
50. J.A. Tropp Greed is good: Algorithmic results for sparse approximation IEEE Trans. Inf. Theory 50 2004 2231 2242
51. J.A. Tropp, and A.C. Gilbert Signal recovery from random measurements via orthogonal matching pursuit IEEE Trans. Inf. Theory 53 2007 4655 4666
52. N. Vaswani, Kalman filtered compressed sensing, in: Proceedings of the IEEE International Conference on Image Processing (ICIP), October 2008, pp. 893-896.