Factorisation and denoising of 0-1 data: A variational approach

Neurocomputing

Volumn 71, Issue 10-12, 2008, Pages 2291-2308

  Kabán, Ata ^a   Bingham, Ella ^b  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b UNIVERSITY OF HELSINKI   (Finland)

Author keywords

0 1 data; Data denoising; Factor models

Indexed keywords

COMPUTER SIMULATION; FACTORIZATION; PROBABILITY; SPURIOUS SIGNAL NOISE;

DATA DENOISING; FACTOR MODEL;

DATA PROCESSING;

ANALYTIC METHOD; ARTICLE; DNA FINGERPRINTING; FACTORIAL ANALYSIS; MATHEMATICAL ANALYSIS; PRIORITY JOURNAL; PROBABILITY; SOCIAL NETWORK; STATISTICAL MODEL;

EID: 44649150208     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2007.07.038     Document Type: Article

References (28)

1. Attias H. A variational Bayesian framework for graphical models. In: Solla S., Leen T., and Müller K.R. (Eds). Advances in Neural Information Processing Systems vol. 12 (2000), MIT Press, Cambridge, MA, USA 209-215
2. Beal M.J., and Ghahramani Z. Variational Bayesian learning of directed graphical models with hidden variables. Bayesian Stat. 1 4 (2006)
3. Berchtold A., and Raftery A. The mixture transition distribution model for high-order Markov chains and non-Gaussian time-series. Stat. Sci. 17 3 (2002) 328-356
4. Bernardo J.M., and Smith A.F.M. Bayesian Theory (2001), Wiley, New York
5. Blei D.M., Ng A.Y., and Jordan M.I. Latent Dirichlet allocation. J. Mach. Learn. Res. 3 5 (2003) 993-1022
6. Buntine W., and Jakulin A. Applying discrete PCA in data analysis. Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence (2004) 59-66
7. Constantinopoulos C., Titsias M.K., and Likas A. Bayesian feature and model selection for Gaussian mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 28 6 (2006) 1013-1018
8. Diamantaras K.I., and Papadimitriou T. Blind deconvolution of multi-input single-output systems with binary sources. IEEE Trans. Signal Process. 54 10 (2006) 3720-3731
9. T. Fawcett, ROC graphs: notes and practical considerations for researchers, Technical Report, HP Laboratories, MS 1143, Palo Alto CA, USA, April 2004.
10. Handcock M.S., and Raftery A.E. Model-based clustering for social networks. J. R. Stat. Soc. A 170 Part 2 (2007) 1-22
11. J. Himberg, A. Hyvärinen, Independent component analysis for binary data: an experimental study, in: Proceedings of the ICA2001, 2001, pp. 552-556.
12. Hyvärinen A., Karhunen J., and Oja E. Independent Component Analysis (2001), Wiley, New York
13. Jordan M., Ghahramani Z., Jaakkola T., and Saul L. An introduction to variational methods for graphical models. In: Jordan M. (Ed). Learning in Graphical Models (1999), MIT Press, Cambridge, MA, USA 105-161
14. Jung T.P., Makeig S., Humphries C., Lee T.W., McKeown M.J., Iragui V., and Sejnowski T.J. Removing electroencephalographic artifacts by blind source separation. Psychophysiology 37 (2000) 163-178
15. A. Kabán, E. Bingham, ICA-based binary feature construction, in: Proceedings of the 6th International Conference on Independent Component Analysis and Blind Source Separation (ICA06), Lecture Notes in Computer Science, vol. 3889, Springer, Berlin, 2006, pp. 140-148.
16. A. Kabán, X. Wang, Deconvolutive clustering of Markov states, in: Proceedings of the ECML'06, 2006, pp. 246-257.
17. H. Lappalainen, Ensemble learning for independent component analysis, in: Proceedings of the International Workshop on Independent Component Analysis and Signal Separation (ICA'99), Aussois, France, 1999, pp. 7-12.
18. Lee D.D., and Seung H.S. Algorithms for non-negative matrix factorization. Adv. Neural Inf. Process. Syst. (2000) 556-562
19. Li Y., Cichocki A., and Zhang L. Blind separation and extraction of binary sources. IEICE Trans. Fund. Electron. Commun. Comput. Sci. E86-A 3 (2003) 580-589
20. Marlin B. Modeling user rating profiles for collaborative filtering. Proceedings of the Neural Information Processing Systems (2003)
21. McCallum A., and Nigam K. A comparison of event models for Naive Bayes text classification. Proceedings of AAAI/ICML-98 Workshop on Learning for Text Categorization (1998) 41-48
22. McCullagh P., and Nelder J.A. Generalized Linear Models (1983), Chapmann & Hall, London
23. M. Rees, from 'research quotes' 〈http://www.c2i.ntu.edu.sg/AI+CI/Humor/researchquotes.html〉.
24. Saund E. A multiple cause model for unsupervised learning. Neural Comput. 7 (1995) 51-71
25. Singliar T., and Hauskrecht M. Noisy-OR component analysis and its application to link analysis. J. Mach. Learn. Res. 7 (2006) 2189-2213
26. Schein A.I., Saul L.K., and Ungar L.H. A generalised linear model for principal component analysis of binary data. Proceedings of the 9th International Workshop on Artificial Intelligence and Statistics (2003)
27. Tipping M.E. Probabilistic visualisation of high dimensional data. Adv. Neural Inf. Process. Syst. (1999) 592-598
28. Wilbur J.D., Ghosh J.K., Nakatsu C.H., Brouder S.M., and Doerge R.W. Variable selection in high-dimensional multivariate binary data with application to the analysis of microbial community DNA fingerprints. Biometrics 58 (2002) 378-386