The aspect Bernoulli model: Multiple causes of presences and absences

Pattern Analysis and Applications

Volumn 12, Issue 1, 2009, Pages 55-78

  Bingham, Ella ^a   Kabán, Ata ^b   Fortelius, Mikael ^a  

^a UNIVERSITY OF HELSINKI   (Finland)

^b UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

0 1 data; Data mining; Multiple cause models; Probabilistic latent variable models

Indexed keywords

EID: 58849140543     PISSN: 14337541     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10044-007-0096-4     Document Type: Article

References (63)

1. Harman HH (1967) Modern factor analysis, 2nd edn. University of Chicago Press, Chicago
2. E Saund 1995 A multiple cause mixture model for unsupervised learning Neural Comput 7 51 71
3. T Hofmann 2001 Unsupervised learning by probabilistic latent semantic analysis Mach Learn 42 177 196
4. Hyvärinen A, Karhunen J, Oja E (2001) Independent component analysis. Wiley Interscience, New York
5. DM Blei AY Ng MI Jordan 2003 Latent Dirichlet allocation J Mach Learn Res 3 993 1022
6. Kabán A, Bingham E, Hirsimäki T (2004) Learning to read between the lines: the aspect Bernoulli model. In: Proceedings of the 4th SIAM international conference on data mining, pp 462-466
7. Buntine W (2002) Variational extensions to EM and multinomial PCA. In: Machine learning: ECML 2002. Lecture notes in artificial intelligence (LNAI), vol 2430. Springer, New York, pp 23-34
8. McCallum A, Nigam K (1998) A comparison of event models for naive Bayes text classification. In: Sahami M (ed) Learning for text categorization. Papers from the AAAI Workshop, Technical report WS-98-05, AAAI, pp 41-48
9. Fortelius M, Werdelin L, Andrews P, Bernor RL, Gentry A, Humphrey L, Mittmann W, Viranta S (1996) Provinciality, diversity, turnover and paleoecology in land mammal faunas of the later Miocene of western Eurasia. In: Bernor R, Fahlbusch V, Mittmann W (eds) The evolution of Western Eurasian Neogene Mammal Faunas. Columbia University Press, Columbia, pp 414-448
10. Srebro N (2004) Learning with matrix factorizations. Ph.D. thesis, Massachusetts Institute of Technology
11. Hofmann T, Puzicha J (1998) Unsupervised learning from dyadic data. Technical Report TR-98-042, International Computer Science Insitute, Berkeley
12. T Hofmann 2004 Latent semantic models for collaborative filtering ACM Trans Inf Syst 22 89 115
13. Marlin B, Zemel R (2004) The multiple multiplicative factor model for collaborative filtering. ICML-2004. In: Proceedings of the 21st international conference on machine learning, pp 576-583
14. Buntine W, Jakulin A (2006) Discrete components analysis. In: Saunders C, Grobelnik M, Gunn S, Shawe-Taylor J (eds) Subspace, latent structure and feature selection techniques. Springer, Berlin
15. Marlin B (2004) Modeling user rating profiles for collaborative filtering. In: Thrun S, Saul L, Schölkopf B (eds) Advances in neural information processing systems, vol 16. MIT, Cambridge
16. Kabán A, Bingham E (2006) ICA-based binary feature construction. In: Rosca JP, Erdogmus D, Príncipe JC, Haykin S (eds) Independent component analysis and blind signal separation. 6th international conference, ICA 2006, Proceedings. Lecture notes in computer science, vol 3889. Springer, Berlin, pp 140-148
17. Kabán A, Bingham E. Factorisation and denoising of 0-1 data: a variational approach. Neurocomputing, special issue on advances in blind signal processing (in press)
18. Everitt BS, Hand DJ (1981) Finite mixture distributions. Chapman & Hall, London
19. M Gyllenberg T Koski E Reilink M Verlaan 1994 Non-uniqueness in probabilistic numerical identification of bacteria J Appl Probab 31 542 548
20. Meilǎ M (1999) An accelerated Chow and Liu algorithm: fitting tree distributions to high-dimensional sparse data. In: ICML '99: Proceedings of the sixteenth international conference on machine learning, Morgan Kaufmann, San Francisco, pp 249-257
21. Schein A, Saul L, Ungar L (2003) A generalized linear model for principal component analysis of binary data. In: Bishop CM, Frey BJ (eds) Proceedings of the 9th international workshop on artificial intelligence and statistics
22. Tipping ME (1999) Probabilistic visualisation of high-dimensional binary data. In: Kearns MS, Solla SA, Cohn DA (eds) Advances in neural information processing systems, vol 11, pp 592-598
23. Collins M, Dasgupta S, Schapire RE (2001) A generalization of principal component analysis to the exponential family. Advances in neural information processing systems, vol 14, pp 617-624
24. Hofmann T, Puzicha J (1999) Latent class models for collaborative filtering. In: Dean T (ed) Proceedings of the 16th international joint conference on artificial intelligence, IJCAI 99, Morgan Kaufmann, San Francisco, pp 688-693
25. P Dayan RS Zemel 1995 Competition and multiple cause models Neural Comput 7 565 579
26. Seppänen JK, Bingham E, Mannila H (2003) A simple algorithm for topic identification in 0-1 data. In: Lavrač N, Gamberger D, Todorovski L, Blockeel H (eds) Knowledge discovery in databases: PKDD 2003. Lecture notes in artificial intelligence, vol 2832, Springer, New York, pp 423-434
27. Jaakkola TS (1997) Variational methods for inference and estimation in graphical models. Ph.D. thesis, Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA
28. H Barlow T Kaushal G Mitchison 1989 Finding minimum entropy codes Neural Comput 1 412 423
29. P Földiák 1990 Forming sparse representations by local anti-Hebbian learning Biol Cybern 64 165 170
30. J Schmidhuber 1992 Learning factorial codes by predictability minimization Neural Comput 4 863 879
31. Zemel RS (1993) A minimum description length framework for unsupervised learning. Ph.D. thesis, University of Toronto
32. Kemp C, Griffiths TL, Tenenbaum JB (2004) Discovering latent classes in relational data. Technical Report AI Memo 2004-019, Massachusetts Institute of Technology, Computer Science and Artificial Intelligence Laboratory
33. Agrawal R, Mannila H, Srikant R, Toivonen H, Verkamo AI (1996) Fast discovery of association rules. In: Fayyad UM, Piatetsky-Shapiro G, Smyth P, Uthurusamy R (eds) Advances in knowledge discovery and data mining, Chap. 12. AAAI, New York, pp 307-328
34. Dhillon IS (2001) Co-clustering documents and words using bipartite spectral graph partitioning. Technical Report TR 2001-05, Department of Computer Sciences, University of Texas, Austin
35. Smolensky P (1986) Information processing in dynamical systems: foundations of harmony theory. In: Rumelhart DE, McClelland JL (eds) Parallel distributed processing: explorations in the microstructure of cognition, Foundations, vol 1. MIT, Cambridge, pp 194-281
36. Jolliffe IT (1986) Principal component analysis. Springer, Berlin
37. P Paatero U Tapper 1994 Positive matrix factorization: a non-negative factor model with optimal utilization of error estimates of data values Environmetrics 5 111 126
38. DD Lee HS Seung 1999 Learning the parts of objects by non-negative matrix factorization Nature 401 788 791
39. Lee DD, Seung HS (2000) Algorithms for non-negative matrix factorization. Advances in Neural Information Processing Systems, vol 13, 556-562
40. ME Tipping CM Bishop 1999 Probabilistic principal component analysis J R Stat Soc B Stat Methodol 61 611 622
41. R Dahyot P Charbonnier F Heitz 2004 A Bayesian approach to object detection using probabilistic appearance-based models Pattern Anal Appl 7 317 332
42. Srebro N, Jaakkola T (2003) Weighted low-rank approximations. In: Fawcett T, Mishra N (eds) Machine learning. Proceedings of the twentieth international conference (ICML 2003). AAAI, New York, pp 720-727
43. 2 models. In: Becker S, Thrun S, Obermayer K (eds) Advances in neural information processing systems, vol 15. MIT, Cambridge, pp 577-584
44. M Haft R Hofman V Tresp 2003 Generative binary codes Pattern Anal Appl 6 269 284
45. JC Barry M Morgan L Flynn D Pilbeam A Behrensmeyer S Raza I Khan C Badgley J Hicks J Kelley 2002 Faunal and environmental change in the late Miocene Siwaliks of Northern Pakistan Palaeobiology (Supplement) 28 1 71
46. K Puolamäki M Fortelius H Mannila 2006 Seriation in paleontological data using Markov chain Monte Carlo methods PLoS Comput Biol 2 e6
47. Ripley BD (1996) Pattern recognition and neural networks. Cambridge University Press, Cambridge
48. P Smyth 2000 Model selection for probabilistic clustering using cross-validated likelihood Stat Comput 10 63 72
49. Heckerman D, Chickering DM (1996) A comparison of scientific and engineering criteria for Bayesian model selection. Technical Report MSR-TR-96-12, Microsoft Research
50. Bernardo JM, Smith AFM (1994) Bayesian theory. Wiley, New York
51. Akaike H (1973) Information theory and an extension of the maximum likelihod principle. In: Petrox B, Csaki F (eds) Second international symposium on information theory, pp 267-281
52. A Kabán 2007 Predictive modelling of heterogeneous sequence collections by topographic ordering of histories Mach Learn 68 63 95
53. C Peterson B Söderberg 1989 A new method for mapping optimization problems onto neural networks Int J Neural Syst 1 3 22
54. J-M Wu S-J Chiu 2001 Independent component analysis using Potts models IEEE Trans Neural Netw 12 202 211
55. T-P Jung S Makeig C Humphries T-W Lee MJ McKeown V Iragui TJ Sejnowski 2000 Removing electroencephalographic artifacts by blind source separation Psychophysiology 37 163 178
56. O Alter PO Brown D Botstein 2000 Singular value decomposition for genome-wide expression data processing and modeling PNAS 97 10101 10106
57. MHC Law MAT Figueiredo AK Jain 2004 Simultaneous feature selection and clustering using mixture models IEEE Trans Pattern Anal Mach Intell 26 1154 1166
58. Hofmann T (1999) The cluster-abstraction model: unsupervised learning of topic hierarchies from text data. In: Dean T (ed) Proceedings of the 16th international joint conference on artificial intelligence, IJCAI 99. Morgan Kaufmann, San Francisco, pp 682-687
59. K Barnard P Duygulu D Forsyth 2001 Clustering art IEEE Conf Comput Vis Pattern Recognit 2 II 434 441
60. K Barnard P Duygulu D Forsyth N de Freitas DM Blei MI Jordan 2003 Matching words and pictures J Mach Learn Res 3 1107 1135
61. Blei DM, Griffiths TL, Jordan MI, Tenenbaum JB (2004) Hierarchical topic models and the nested Chinese restaurant process. In: Thrun S, Saul L, Schölkopf B (eds) Advances in neural information processing systems, vol 16. MIT, Cambridge
62. Wang X, Kabán A (2005) Finding uninformative features in binary data. In: Gallagher M, Hogan JM, Maire F (eds) Intelligent data engineering and automated learning-IDEAL 2005. Lecture notes in computer science, vol 3578. Springer, New York, pp 40-47
63. Cover TM, Thomas JA (1991) Elements of information theory. Wiley, New York