Distributed variational Bayesian algorithms for Gaussian mixtures in sensor networks

Signal Processing

Volumn 90, Issue 4, 2010, Pages 1197-1208

  Safarinejadian, B ^a   Menhaj, M B ^a   Karrari, M ^a  

^a AMIRKABIR UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

Clustering; Density estimation; Mixture of Gaussians; Sensor networks; Variational approximations

Indexed keywords

COMPONENT PARAMETERS; DENSITY ESTIMATION; DISTRIBUTED PROCESSING; DISTRIBUTED TARGET; ENVIRONMENTAL FEATURES; ENVIRONMENTAL MONITORING; GAUSSIAN MIXTURE MODEL; GAUSSIAN MIXTURES; MIXTURE OF GAUSSIANS; MODEL COMPLEXITY; SENSOR DATA; SIMULATION RESULT; VARIATIONAL APPROACHES; VARIATIONAL APPROXIMATION; VARIATIONAL BAYESIAN;

BAYESIAN NETWORKS; CLUSTERING ALGORITHMS; ESTIMATION; IMAGE SEGMENTATION; INDUCTIVELY COUPLED PLASMA; MIXTURES; SIMULATORS;

SENSOR NETWORKS;

EID: 72949107801     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2009.10.004     Document Type: Article

References (26)

1. Akyildiz I., Su W., and Sankarasubramniam Y. A survey on sensor networks. IEEE Communications Magazine 40 8 (2002) 102-114
2. D. Estrin, R. Govindan, J. Heidmann, S. Kumar, Next century challenges: scalable coordination in sensor networks, in: Proceedings of the ACM/IEEE International Conference on Mobile Computing and Networking, Seattle, WA, 1999, pp. 263-270.
3. Kamimura R. Cooperative information maximization with Gaussian activation functions for self-organizing maps. IEEE Transactions on Neural Networks 17 4 (2006) 909-918
4. Y. Sheng, X. Hu, P. Ramanathan, Distributed particle filter with GMM approximation for multiple targets localization and tracking in wireless sensor networks, in: Proceedings of the Fourth International Symposium on Information Processing in Sensor Networks, Los Angeles, CA, 2005, pp. 181-188.
5. Datta S., Bhaduri K., Giannella C., Wolff R., and Kargupta H. Distributed data mining in peer-to-peer networks. IEEE Internet Computing 10 (2006) 18-26
6. Wolff R., and Schuster A. Association rule mining in peer-to-peer systems. IEEE Transactions on Systems, Man and Cybernetics, Part B 34 (2004) 2426-2438
7. C. Giannella, H. Dutta, S. Mukherjee, H. Kargupta, Efficient kernel density estimation over distributed data, in: Ninth International Workshop on High Performance and Distributed Mining, SIAM International Conference on Data Mining, 2006.
8. Nguyen X., Jordan M.I., and Sinopoli B. A kernel-based learning approach to ad hoc sensor network localization. ACM Transactions on Sensor Networks 1 1 (2005) 134-152
9. Simic S. A learning theory approach to sensor networks. IEEE Pervasive Computing 2 4 (2003) 44-49
10. M. Paskin, C. Guestrin, J. McFadden, A robust architecture for inference in distributed sensor networks, in: International Conference on Information Processing in Sensor Networks (IPSN), 2005.
11. Paskin M.A., and Guestrin C.E. Robust probabilistic inference in distributed systems. Uncertainty in Artificial Intelligence 20 (2004)
12. Dempster A., and Rubin D. Maximum likelihood estimation from incomplete data via the EM algorithm. Journal of Royal Statistical Society 39 (1977) 1-38
13. Neal R., and Hinton G. A view of the EM algorithm that justifies incremental, sparse, and other variants. In: Jordan M. (Ed). Learning in Graphical Models (1999), MIT Press, Cambridge, MA 355-368
14. Nowak R.D. Distributed EM algorithms for density estimation and clustering in sensor networks. IEEE Transactions on Signal Processing 51 (2003) 2245-2253
15. W. Kowalczyk, N. Vlassis, Newscast EM, in: Advances in Neural Information Processing Systems, vol. 17, MIT Press, Cambridge, MA, 2005.
16. Gu D. Distributed EM algorithm for Gaussian mixtures in sensor networks. IEEE Transactions on Neural Networks 19 7 (2008) 1154-1166
17. H. Attias, Inferring parameters and structure of latent variable models by variational Bayes, in: Proceedings of the Fifth Conference on Uncertainty in Artificial Intelligence, 1999.
18. Attias H. A variational Bayesian framework for graphical models. In: Leen T., et al. (Ed). Advances in Neural Information Processing Systems vol. 12 (2000), MIT Press, Cambridge, MA
19. Constantinopoulos C., and Likas A. Unsupervised learning of Gaussian mixtures based on variational component splitting. IEEE Transactions on Neural Networks 18 3 (2007) 745-755
20. Corduneanu A., and Bishop C.M. Variational Bayesian model selection for mixture distributions. In: Jaakkola T., and Richardson T. (Eds). Artificial Intelligence and Statistics (2001), Morgan Kaufman, Los Altos, CA 27-34
21. McGrory C.A., and Titterington D.M. Variational approximations in Bayesian model selection for finite mixture distributions. Computational Statistics & Data Analysis 51 (2007) 5352-5367
22. W.D. Penny, S.J. Roberts, Variational Bayes for 1-dimensional mixture models, Technical Report PARG-2000-01, Department of Engineering Science, Oxford University, 2000.
23. Waterhouse S., MacKay D., and Robinson T. Bayesian methods for mixtures of experts. In: Touretzky D.S., et al. (Ed). Advances in Neural Information Processing Systems vol. 8 (1996), MIT Press, Cambridge, MA
24. Wang B., and Titterington D.M. Convergence properties of a general algorithm for calculating variational Bayesian estimates for a normal mixture model. Bayesian Analysis 1 3 (2006) 625-650
25. W. Zajdel, Bayesian visual surveillance-from object detection to distributed cameras, Ph.D. Thesis, Universiteit van Amsterdam, 2006.
26. S. Dasgupta, Learning mixtures of Gaussians, in: Proceedings of the 40th Annual Symposium on Foundations of Computer Science, Washington, DC, USA, 1999, p. 634.