Dimensionality reduction for distributed estimation in the infinite dimensional regime

IEEE Transactions on Information Theory

Volumn 54, Issue 4, 2008, Pages 1655-1669

  Roy, Olivier ^a   Vetterli, Martin ^a,b  

^a EPFL   (Switzerland)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Asymptotic eigenvalue distribution; Distributed approximation and estimation; Karhunen Lo ve transform (KLT); Large Toeplitz matrices; Principal component analysis; Toeplitz distribution theorem

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; ASYMPTOTIC ANALYSIS; CORRELATION METHODS; EIGENVALUES AND EIGENFUNCTIONS; ITERATIVE METHODS; MATHEMATICAL MODELS; MATRIX ALGEBRA; MEAN SQUARE ERROR; PRINCIPAL COMPONENT ANALYSIS;

ASYMPTOTIC EIGENVALUE DISTRIBUTION; DIMENSIONALITY REDUCTION; DISTRIBUTED ESTIMATION; ITERATIVE ALGORITHM; LARGE TOEPLITZ MATRICES;

INFORMATION THEORY;

EID: 41949131626     PISSN: 00189448     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIT.2008.917635     Document Type: Article

References (34)

1. M. Schwab, M. Karrenbach, and J. Claerbout, "Making scientific computations reproducible," Comput. Sci. Eng., vol. 2, no. 6, pp. 61-67, 2000.
2. T.-H. Lin, W. J. Kaiser, and G. J. Pottie, "Integrated low-power communication system design for wireless sensor networks," IEEE Commun. Mag., vol. 42, no. 12, pp. 142-150, Dec. 2004.
3. N. Gehrig and P. L. Dragotti, "Distributed compression in camera sensor networks," in Proc. IEEE Workshop Multimedia Signal Process., Sep.-Oct. 2004, pp. 311-314.
4. J. C. Chen, K. Yao, and R. E. Hudson, "Source localization and beam-forming," IEEE Signal Process. Mag., vol. 19, no. 2, pp. 30-39, Mar. 2002.
5. T. Schmid, H. Dubois-Ferrière, and M. Vetterli, "SensorScope: Experiences with a wireless building monitoring sensor network," presented at the Workshop Real-World Wireless Sens. Netw., Stockholm, Sweden, Jun. 20-21, 2005.
6. M. Gastpar, M. Vetterli, and P. Dragotti, "Sensing reality and communicating bits: A dangerous liaison," IEEE Signal Process. Mag. vol. 23, no. 4, pp. 70-83, Jul. 2006.
7. R. M. Gray, "On the asymptotic eigenvalue distribution of Toeplitz matrices," IEEE Trans. Inf. Theory, vol. IT-18, no. 6, pp. 725-730, Nov. 1972.
8. R. M. Gray, "Toeplitz and circulant matrices: A review," Found. Trends Commun. Inf. Theory, vol. 2, no. 3, pp. 155-239, 2006.
9. U. Grenander and G. Szegö, Toeplitz Forms and their Applications 2nd ed. New York: Chelsea, 1984.
10. J.-J. Xiao, A. Ribeiro, Z.-Q. Luo, and G. Giannakis, "Distributed compression-estimation using wireless sensor networks," IEEE Signal Process. Mag., vol. 23, no. 4, pp. 27-41, Jul. 2006.
11. P. Ishwar, R. Puri, K. Ramchandran, and S. S. Pradhan, "On rate-constrained distributed estimation in unreliable sensor networks," IEEE J. Sel. Areas Commun., vol. 23, no. 4, pp. 765-775, Apr. 2005.
12. A. Ribeiro and G. Giannakis, "Bandwidth-constrained distributed estimation for wireless sensor networks - Part I: Gaussian PDF," IEEE Trans. Signal Process., vol. 54, no. 3, pp. 1131-1143, Mar. 2006.
13. M. Gastpar, P. L. Dragotti, and M. Vetterli, "The distributed Karhunen-Loève transform," IEEE Trans. Inf. Theory, vol. 52, no. 12, pp. 5177-5196, Dec. 2006.
14. H. Nurdin, R. R. Mazumdar, and A. Bagchi, "On estimation and compression of distributed correlated signals with incomplete observations," Math. Theory Netw. Syst., Jul. 2004.
15. K. Zhang, "Best linear unbiased estimation fusion with constraints," Ph.D. dissertation, Dept. Electr. Eng., Univ. New Orleans, New Orleans, LA, 2003.
16. K. S. Zhang, X. R. Li, P. Zhang, and H. F. Li, "Optimal linear estimation fusion - Part VI: Sensor data compression," in Proc. Int. Conf. Inf. Fusion, Jul. 2003, vol., pp. 221-228.
17. I. D. Schizas, G. B. Giannakis, and Z.-Q. Luo, "Distributed estimation using reduced-dimensionality sensor observations," IEEE Trans. Signal Process., vol. 55, no. 8, pp. 4282-4299, Aug. 2007.
18. H. Hotelling, "Analysis of a complex of statistical variables into principal components," J. Educat. Psychol., vol. 41, pp. 417-441, 1933.
19. K. Karhunen, "Über lineare Methoden in der Wahrscheinlichkeitsrechnung," Annales Academiae Scientiarum Fennicae, Series A1: Mathematica-Physica, vol. 37, pp. 3-79, 1947.
20. T. Berger, "Multiterminal source coding," presented at the CISM Summer School on the Information Theory Approach to Communications, Udine, Italy, Jul. 1977.
21. V. Goyal, "Theoretical foundations of transform coding," IEEE Signal Process. Mag., vol. 18, no. 5, pp. 9-21, Sep. 2001.
22. D. Rebollo-Monedero, S. Rane, and B. Girod, "Wyner-Ziv quantization and transform coding of noisy sources at high rates," in Proc. Asilomar Conf. Signals Syst. Comput., Nov. 2004, vol. 2, pp. 2084-2088.
23. D. Rebollo-Monedero, S. Rane, A. Aaron, and B. Girod, "High-rate quantization and transform coding with side information at the decoder," EURASIP J. Signal Process., vol. 86, Special Issue on Distributed Source Coding, no. 11, pp. 3160-3179, 2006.
24. A. Majumdar, K. Ramchandran, and I. Kozintsev, "Distributed coding for wireless audio sensors," in Proc. IEEE Workshop Appl. Signal Process. Audio Acoust., Oct. 2003, pp. 209-212.
25. R. Puri and K. Ramchandran, "PRISM: A new robust video coding architecture based on distributed compression principles," presented at the 40th Annu. Allerton Conf. Commun. Control Comput., Monticello, IL, Oct. 2-4, 2002.
26. B. Girod, A. Aaron, S. Rane, and D. Rebollo-Monedero, "Distributed video coding," Proc. IEEE, vol. 93, Special Issue on Advances in Video Coding and Delivery, no. 1, pp. 71-83, Jan. 2005.
27. H. V. Poor, An Introduction to Signal Detection and Estimation, 2nd ed. New York: Springer-Verlag, 2001.
28. S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi, "Optimization by simulated annealing," Science, vol. 220, no. 4598, pp. 671-680, 1983.
29. F. Baumgarte and C. Faller, "Binaural cue coding - Part II: Schemes and applications," IEEE Trans. Speech Audio Process., vol. 11, no. 6, pp. 520-531, Nov. 2003.
30. T. Berger, Rate Distortion Theory: A Mathematical Basis for Data Compression. Englewood Cliffs, NJ: Prentice-Hall, 1971.
31. O. Roy and M. Vetterli, "Rate-constrained beamforming for collaborating hearing aids," in Proc. IEEE Int. Symp. Inf. Theory, Jul. 2006, pp. 2809-2813.
32. P. Brémaud, Mathematical Principles of Signal Processing: Fourier and Wavelet Analysis. New York: Springer-Verlag, 2002.
33. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1985.
34. I. S. Gradshteyn and I. M. Ryzhik, Table of Integrals, Series, and Products, 5th ed. London, U.K.: Academic, 1994.