Distributed EM algorithm for Gaussian mixtures in sensor networks

IEEE Transactions on Neural Networks

Volumn 19, Issue 7, 2008, Pages 1154-1166

  Gu, Dongbing ^a  

^a UNIVERSITY OF ESSEX   (United Kingdom)

Author keywords

Consensus filter; Distributed estimation; Distributed expectation maximization (EM) algorithm; Sensor networks

Indexed keywords

ALGORITHMS; APPROXIMATION ALGORITHMS; ARRAY PROCESSING; BOOLEAN FUNCTIONS; DETECTORS; ESTIMATION; PARAMETER ESTIMATION; SENSORS; STANDARDS; STATISTICAL METHODS; STATISTICS; TELECOMMUNICATION EQUIPMENT; TRELLIS CODES; WAVE FILTERS;

E M ALGORITHMS; EXPECTATION MAXIMIZATION (EM) ALGORITHMS; GAUSSIAN MIXTURE (GM); LOCAL INFORMATION; LOCAL MAXIMUM; LOG LIKELIHOOD; MODEL PARAMETERS; SENSOR NODE (SN); STOCHASTIC APPROXIMATION (SA); SUFFICIENT STATISTICS;

SENSOR NETWORKS;

EID: 48949116234     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2008.915110     Document Type: Article

References (30)

1. I. Akyildiz, W. Su, and Y. Sankarasubramniam, "A surevy on sensor network," IEEE Commun. Mag., vol. 40, no. 8, pp. 102-114, Aug. 2002.
2. D. Estrin, R. Govindan, J. Heidemann, and S. Kumar, "Next century challenges: Scalable coordination in sensor network," in Proc. ACM/IEEE Int. Conf. Mobile Comput. Netw., Seattle, WA, 1999, pp. 263-270.
3. R. D. Nowak, "Distributed EM algorithms for density estimation and clustering in sensor networks," IEEE Trans. Signal PIrocess., vol. 51, no. 8, pp. 2245-2253, Aug. 2003.
4. Y. Sheng, X. Hu, and P. Ramanathan, "Distributed particle filter with GMM approximation for multiple targets localization and tracking in wireless sensor networks," in Proc. 4th Int. Symp. Inf. Process. Sensor Netw., Los Angeles, CA, Apr. 2005, pp. 181-188.
5. R. Kamimura, "Cooperative information maximization with Gaussian activation functions for self-organizing maps," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 909-918, Jul. 2006.
6. C. Constantinopoulos and A. Likas, "Unsupervised learning of Gaussian mixtures based on variational component splitting," IEEE Trans. Neural Netw., vol. 18, no. 3, pp. 745-755, May 2007.
7. X. Nguyen, M. I. Jordan, and B. Sinopoli, "A kernel-based learning approach to ad hoc sensor network localization," ACM Trans. Sensor Netw., vol. 1, no. 1, pp. 134-152, 2005.
8. S. Simic, "A learning theory approach to sensor networks," IEEE Pervasive Comput., vol. 2, no. 4, pp. 44-49, Oct./Dec. 2003.
9. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, "Adaptive mixtures of local experts," Neural Comput., vol. 3, pp. 79-87, 1991.
10. M. I. Jordan and R. A. Jacobs, "Hierarchical mixtures of experts and the EM algorithm," Neural Comput., vol. 6. pp. 181-214. 1994.
11. J. Zhang, "The mean field theory in EM procedures for Markov random fields," IEEE Trans. Signal Process., vol. 40, no. 3, pp. 2570-2583, Mar. 1992.
12. G. Celeux, F. Forbes, and N. Peyrard, "EM procedures using mean field-like approximations for Markov model-based image segmentation," Pattern Recognit., vol. 36, pp. 131-144, 2003.
13. A. Diplaros, N. Vlassis, and T. Gevers, "A spatially constrained generative model and an EM algorithm for image segmentation," IEEE Trans. Neural Netw., vol. 18, no. 3, pp. 798-808, May 2007.
14. F. Zhao, J. Shin, and J. Reich, "Information-driven dynamic sensor collaboration for tracking applications," IEEE Signal Process. Mag. vol. 19, no. 2, pp. 61-72, Mar. 2002.
15. R. Olfati-Saber, "Distributed Kalman filter with embedded consensus filters," in Proc. 44th IEEE Conf. Decision Control, Dec. 12-15, 2005, pp. 8179-8184.
16. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood estimation from incomplete data via the EM algorithm," J. Roy. Statist. Soc. vol. 39, pp. 1-38, 1977.
17. P. Gupta and P. R. Kumar, "The capacity of wireless networks," IEEE Trans. Inf. Theory, vol. 46, no. 3, pp. 388-404, May 2000.
18. R. M. Neal and G. E. Hinton, "A view of the EM algorithm that justifies incremental, sparse, and other variants," in Learning in Graphical Models, M. I. Jordan, Ed. Boston, MA: Kluwer, 1998, pp. 355-368.
19. R. Olfati-Saber and J. S. Shamma, "Consensus filters for sensor networks works and distributed sensor fusion," in Proc. 44th IEEE Conf. Decision Control, Dec. 12-15, 2005, pp. 6698-6703.
20. W. Ren and R. W. Beard, "Consensus seeking in multiagent systems under dynamically changing interaction topologies," IEEE Trans. Autom. Control, vol. 50, no. 5, pp. 655-661, May 2005.
21. L. Xu and M. I. Jordan, "On convergence properties of the EM algorithm for Gaussian mixtures," Neural Comput., vol. 8, pp. 129-151, 1996.
22. M. Sato and S. Ishii, "On-line EM algorithm for the normalized Guassian network," Neural Comput., vol. 12, pp. 407-432, 2000.
23. H. J. Kushner and G. G. Yin, Stochastic Approximation Algorithms and Applications. New York: Springer-Verlag, 1997.
24. M. A. T. Figueiredo and A. K. Jain, "Unsupervised learning of finite mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 3, pp. 381-396, Mar. 2002.
25. N. A. Lynch, Distributed, Algorithms. San Francisco, CA: Morgan Kaufmann, 1996.
26. R. Olfati-Saber and R. M. Murray, "Consensus problems in networks of agents with switching topology and time-delay," IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 101-115, Sep. 2004.
27. C. Godsil and G. Royle, Algebraic Graph Theory. New York: Springer-Verlag, 2001.
28. S. Boyd. P. Diaconis, and L. Xiao, "Fastest mixing Markov chain on a graph," SIAM Rev., vol. 46, no. 4, pp. 667-689, Dec. 2004.
29. M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp. "A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking," IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174-188, Feb. 2002.
30. A. Doucet, N. de Freitas, and N. Gordon, Sequential Monte Carlo Methods. New York: Springer-Verlag, 2001.