Diffusion information theoretic learning for distributed estimation over network

IEEE Transactions on Signal Processing

Volumn 61, Issue 16, 2013, Pages 4011-4024

  Li, Chunguang ^a   Shen, Pengcheng ^a   Liu, Ying ^a   Zhang, Zhaoyang ^a  

^a ZHEJIANG UNIVERSITY   (China)

Author keywords

diffusion LMS; Distributed estimation; EBM; information theoretic learning; MEE

Indexed keywords

DIFFUSION LMS; DISTRIBUTED ESTIMATION; EBM; INFORMATION THEORETIC LEARNING; MEE;

COST FUNCTIONS; ESTIMATION; GAUSSIAN NOISE (ELECTRONIC); INFORMATION THEORY; MEAN SQUARE ERROR;

DIFFUSION;

EID: 84880872307     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2013.2265221     Document Type: Article

References (33)

1. A. G. Dimakis, S. Kar, J.M. F.Moura,M. G.Rabbat, andA. Scaglione, "Gossip algorithms for distributed signal processing," Proc. IEEE, vol. 98, no. 11, pp. 1847-1864, 2011.
2. I. D. Schizas, G. Mateos, and G. B. Giannakis, "Distributed LMS for consensus-based in-network adaptive processing," IEEE Trans. Signal Process., vol. 57, no. 6, pp. 2365-2382, Jun. 2009.
3. F. S. Cattivelli and A. H. Sayed, "Analysis of spatial and incermental LMS processing for distribued estimation," IEEE Trans. Signal Process., vol. 59, no. 4, pp. 1465-1480, 2011.
4. C. G. Lopes and A. H. Sayed, "Distributed processing over adaptive networks," presented at the Adapt. Sens. Array Process. Workshop, Lexington, MA, USA, Jun. 2006.
5. Y. Liu, C. Li, W. K. S. Tang, and Z. Zhang, "Distributed estimation over complex networks," Inf. Sci., vol. 197, no. 8, pp. 91-104, 2012.
6. C. G. Lopes and A. H. Sayed, "Incremental adaptive strategies over distributed networks," IEEE Trans. Signal Process., vol. 55, no. 8, pp. 4064-4077, Aug. 2007. (Pubitemid 47261528)
7. F. S. Cattivelli, C. G. Lopes, and A. H. Sayed, "Diffusion LMS strategies for distributed estimation," IEEE Trans. Signal Process., vol. 58, no. 3, pp. 1035-1048, Mar. 2010.
8. P. Di Lorenzo, S. Barbarossa, and A. H. Sayed, "Bio-inspired swarming for dynamic radio access based on diffusion adaptation," in Proc. Eur. Signal Process. Conf. (EUSIPCO), Barcelona, Spain, Aug. 2011, pp. 402-406.
9. X. Cao, J. Chen, Y. Xiao, and Y. Sun, "Building-environment control with wireless sensor and actuator networks: Centralized versus distributed," IEEE Trans. Ind. Electron., vol. 57, no. 11, pp. 3596-3605, 2010.
10. J. Chen,X. Cao, P. Cheng,Y. Xiao, and Y. Sun, "Distributed collaborative control for industrial automation with wireless sensor and actuator networks," IEEE Trans. Ind. Electron., vol. 57, no. 12, pp. 4219-4230, 2010.
11. F. S. Cattivelli, C. G. Lopes, and A. H. Sayed, "A diffusion RLS scheme for distributed estimation over adaptive networks," in Proc. IEEE Workshop Signal Process. Adv. Wireless Commun. (SPAWC), Helsinki, Finland, Jun. 2007, pp. 1-5.
12. F. S. Cattivelli, C. G. Lopes, and A. H. Sayed, "Diffusion recursive least-squares for distributed estimation over adaptive networks," IEEE Trans. Signal Process., vol. 56, no. 5, pp. 1865-1877, May 2008.
13. C.G. Lopes and A. H. Sayed, "Diffusion least-mean squares over adaptive networks," in Proc. Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Honolulu, HI, Apr. 2007, vol. 3, pp. 917-920.
14. C.G. Lopes and A. H. Sayed, "Diffusion least-mean squares over adaptive networks: Formulation and performance analysis," IEEE Trans. Signal Process., vol. 56, no. 7, pp. 3122-3136, Jul. 2008.
15. Y. Liu, C. Li, and Z. Zhang, "Diffusion sparse least-mean squares over networks," IEEE Trans. Signal Process., vol. 60, no. 8, pp. 4480-4485, 2012.
16. K. N. Plataniotis, D. Androutsos, and A. N. Venetsanopoulos, "Nonlinear filtering of non-Gaussian noise," J. Intell. Robot. Syst., vol. 19, pp. 207-231, 1997. (Pubitemid 127505959)
17. B. Weng and K. E. Barner, "Nonlinear system identification in impulsive environments," IEEE Trans. Signal Process., vol. 53, pp. 2588-2594, 2005. (Pubitemid 41166939)
18. J. C. Principe, D. Xu, and J. W. Fisher, "Information theoretic learning," in Unsupervised Adaptive Filtering, S. Haykin, Ed. New York, NY, USA: Wiley, 2000, pp. 265-319.
19. J. C. Principe, Information Theoretic Learning: Renyi's Entropy and Kernel Perspectives. New York, NY, USA: Springer, 2010.
20. D. Erdogmus and J. C. Principe, "Generalized information potential criterion for adaptive system training," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1035-1044, 2002.
21. X.-L. Li and T. Adali, "Flexible adaptive filtering by minimization of error entropy bound and its application to system identification," presented at the Proc. ICASSP, Dallas, TX, USA, 2010.
22. H.-L. Li, X.-L. Li, M. Anderson, and T. Adali, "A class of adaptive algorithms based on entropy estimation achieving CRLB for linear non-Gaussian filtering," IEEE Trans. Signal Process., vol. 60, no. 4, pp. 2049-2055, 2012.
23. D. Erdogmus and J. C. Principe, "Comparison of entropy and meansquare error criteria in adaptive system training using higher order statistics," presented at the Independ. Compon. Anal. (ICA), Helsinki, Finland, 2000.
24. X.-L. Li and T. Adali, "A novel entropy estimator and its application to ICA," in Proc. IEEE Workshop Mach. Learn. Signal Process., Grenoble, France, Sep. 2009, pp. 1-6.
25. L. Xiao and S. Boyd, "Fast linear iterations for distributed averaging," Syst. Control Lett., vol. 53, no. 1, pp. 65-78, Sep. 2004.
26. D. S. Scherber and H. C. Papadopoulos, "Locally constructed algorithms for distributed computations in ad hoc networks," in Proc. Inf. Process. Sens. Netw. (IPSN), Apr. 2004, pp. 11-19.
27. N. Takahashi, I. Yamada, and A. H. Sayed, "Diffusion least-mean squares with adaptive combiners," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Taipei, Taiwan, Apr. 2009, pp. 2845-2848.
28. N. Takahashi, I. Yamada, and A. H. Sayed, "Diffusion least-mean squares with adaptive combiners: Formulation and performance analysis," IEEE Trans. Signal Process., vol. 58, no. 9, pp. 4795-4810, Sep. 2010.
29. D. Erdogmus, K. E. Hild, II, and J. C. Principe, "Blind source separation using Renyi's marginal entropies," Neurocomput., vol. 49, no. 1, pp. 25-38, 2002. (Pubitemid 36097408)
30. A. Renyi, Probability Theory. New York, NY, USA: Elsevier, 1970.
31. E. Parzen, "On estimation of a probability density function and mode," in Time Series Analysis Papers, San Francisco, CA, USA, 1967, Holden-Day.
32. X.-L. Li and T. Adali, "Independent component analysis by entropy bound minimization," IEEE Trans. Signal Process., vol. 58, pp. 5151-5164, 2010.
33. A. H. Sayed and F. Cattivelli, "Distributed adaptive learning mechanisms," in Handbook on Array Processing and Sensor Networks, S. Haykin and K. J. R. Liu, Eds. New York, NY, USA: Wiley, 2009.