On multivariate binary data clustering and feature weighting

Computational Statistics and Data Analysis

Volumn 54, Issue 1, 2010, Pages 120-134

  Bouguila, Nizar ^a  

^a Concordia University ^*  (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

APRIORI; BINARY DATA; BINARY FEATURES; BINARY VECTORS; DATA SETS; DOCUMENT CLASSIFICATION; FEATURE WEIGHTING; FINITE MIXTURE MODELS; MULTIVARIATE BERNOULLI; NUMBER OF CLUSTERS; STOCHASTIC COMPLEXITY;

CLUSTERING ALGORITHMS; INFORMATION RETRIEVAL SYSTEMS;

STOCHASTIC MODELS;

EID: 70349290554     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2009.07.013     Document Type: Article

References (58)

1. Abel L., Golmard J., and Mallet A. An autologistic model for the genetic analysis of familial binary data. American Jounal of Human Genetics 53 4 (1993) 894-907
2. Agrawal R., and Srikant R. Fast algorithms for mining association rules. In: Bocca J.B., Jarke M., and Zaniolo C. (Eds). Proc. of the 20th International Conference on Very Large Databases. VLDB'94 (1994), Morgan Kaufman 487-499
3. Akaike H. A new look at the statistical model identification. IEEE Transaction on Automatic Control AC-19 6 (1974) 716-723
4. Bartholomew D.J. Scaling binary data using a factor model. Journal of the Royal Statistical Society. Series B (Methodological) 46 1 (1984) 120-123
5. Bartholomew D.J. Latent Variable Models and Factor Analysis (1987), Oxford University Press, New York
6. Blake, C.L., Merz, C.J., 1998. Repository of machine learning databases. University of California, Irvine, Dept. of Information and Computer Sciences. http://www.ics.uci.edu/~mlearn/MLRepository.html
7. Bloomfield P. Linear transformations for multivariate binary data. Biometrics 30 4 (1974) 609-617
8. Blum A.L., and Langley P. Selection of relevant features and examples in machine learning. Artificial Intelligence 97 (1997) 245-271
9. Bosch A., Munoz X., and Marti R. A review: Which is the best way to organize/classify images by content. Image and Vision Computing 25 6 (2007) 778-791
10. Bouguila N., and Daoudi K. A statistical approach for binary vectors modeling and clustering. Proc. of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining. PAKDD. LNAI vol. 5476 (2009), Springer-Verlag 184-195
11. Bouguila N., and Ziou D. High-dimensional unsupervised selection and estimation of a finite generalized dirichlet mixture model based on minimum message length. IEEE Transactions on Pattern Analysis and Machine Intelligence 29 10 (2007) 1716-1731
12. Boutemedjet S., Bouguila N., and Ziou D. A hybrid feature extraction selection approach for high-dimensional non-gaussian data clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 31 9 (2009) 1429-1443
13. Cardie C. A cognitive bias approach to feature selection and weighting for case-based learners. Machine Learning 41 1 (2000) 85-116
14. Celeux G., and Govaert G. Clustering criteria for discrete data and latent class models. Journal of Classification 8 2 (1991) 157-176
15. Cheeseman, P., Stutz, J., 1995. Bayesian classification (AutoClass): Theory and results. In: Advances in Knowledge Discovery and Data Mining, pp. 153-180 (Chapter 6)
16. Christoffersson A. Factor analysis of dichotomized variables. Psychometrika 40 1 (1975) 5-32
17. Cox D.R. The Analysis of Binary Data (1970), Methuen, London
18. Cox D.R. The analysis of multivariate binary data. Applied Statistics 21 2 (1972) 113-120
19. Csurka, G., Dance, C.R., Fan, L., Willamowski, J., Bray, C., 2004. Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, 8th European Conference on Computer Vision. ECCV
20. Dom, B.E., 1997. MDL estimation for small samples sizes and its application to segmentation binary strings. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition. CVPR, pp. 280-287
21. Dy J.G., and Brodley C.E. Feature selection for unsupervised learning. Journal of Machine Learning Research 5 (2004) 845-889
22. Everingham M., Zisserman A., Williams C.K.I., Van Gool L., et al. The 2005 PASCAL visual object classes challenge. Machine Learning Challenges. Evaluating Predictive Uncertainty, Visual Object Classification, and Recognising Textual Entailment. LNAI vol. 3944 (2006), Springer-Verlag 117-176
23. Fränti P., Xu M., and Kärkkäinen I. Classification of binary vectors by using Δ SC distance to minimize stochastic complexity. Pattern Recognition Letters 24 1 (2003) 65-73
24. Glasbey C.A. Inference on binary images from binary data. Advances in Applied Probability 28 3 (1996) 627-640
25. Govaert G. Classification binaire et modèles. Revue de Statistique Appliquée 38 1 (1990) 67-81
26. Govaert G., and Nadif M. Comparison of the mixture and the classification maximum likelihood in cluster analysis with binary data. Computational Statistics and Data Analysis 23 1 (1996) 65-81
27. Govaert G., and Nadif M. Block clustering with Bernoulli mixture models: Comparison of different approaches. Computational Statistics and Data Analysis 52 6 (2007) 3233-3245
28. Gower J.C. Some distance properties of latent root and vector methods used in multivariate analysis. Biometrika 53 3-4 (1966) 325-338
29. Graham M.W., and Miller D.J. Unsupervised learning of parsimonious mixtures on large spaces with integrated feature and component selection. IEEE Transactions on Signal Processing 54 4 (2006) 1289-1303
30. Gyllenberg M., and Koski T. Numerical taxonomy and the principle of maximum entropy. Journal of Classification 13 2 (1996) 213-229
31. Gyllenberg M., Koski T., and Verlaan M. Classification of binary vectors by stochastic complexity. Journal of Multivariate Analysis 63 (1997) 47-72
32. Hitchcock D., and Glasbey C.A. Binary image restoration at subpixel resolution. Biometrics 53 3 (1997) 1040-1053
33. Juan A., and Vidal E. On the use of Bernoulli mixture models for text classification. Pattern Recognition 35 (2002) 2705-2710
34. Kass R.E., and Raftery A.E. Bayes factors. Journal of the American Statistical Association 90 (1995) 773-795
35. Ke, Y., Sukthankar, R., 2004. PCA-SIFT: A more distinctive representation for local image descriptors. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition. CVPR, pp. 506-513
36. Kontkanen P., Myllymaki P., Silander T., Tirri H., and Grunwald P. On predective distributions and Bayesian networks. Statistics and Computing 10 (2000) 39-54
37. Law M.H.C., Figueiredo M.A.T., and Jain A.K. Simultaneous feature selection and clustering using mixture models. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 9 (2004) 1154-1166
38. Li T. A unified view on clustering binary data. Machine Learning 62 3 (2006) 199-215
39. Li T. A general model for clustering binary data. Proc. of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery in Data Mining. KDD (2005), ACM 188-197
40. Lowe D.G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60 2 (2004) 91-110
41. McCallum, A.K., 1996. Bow: A toolkit for statistical language modeling, Text Retrieval, Classification and Clustering. http://www.cs.cmu.edu/mccallum/bow
42. Muthén B. Contribution to factor analysis of dichotomized variables. Psychometrika 43 4 (1978) 551-560
43. Nadif M., and Govaert G. Clustering for binary data and mixture models-choice of the model. Applied Stochastic Models and Data Analysis 13 3-4 (1998) 269-278
44. Novovic̀ová J., Pudil P., and Kittler J. Divergence based feature selection for multimodal class densities. IEEE Transactions on Pattern Analysis and Machine Intelligence 18 2 (1996) 218-223
45. Prentice R.L. Correlated binary regression with covariates specific to each binary observation. Biometrics 44 4 (1988) 1033-1048
46. Ripley B.D. Pattern Recognition and Neural Networks (1996), Cambridge University Press
47. Rissanen J. Modeling by shortest data description. Automatica 14 (1978) 445-471
48. Rissanen J. Stochastic Complexity. Journal of the Royal Statistical Society. Series B (Methodological) 49 3 (1987) 223-239
49. Schwarz G. Estimating the dimension of a model. Annals of Statistics 16 (1978) 461-464
50. Tosteson T.D., and Rosner B. Logistic regression for clustered binary data in proband studies with application to familial aggregation of sleep disorders. Biometrics 47 4 (1991) 1257-1265
51. Vaithyanathan S., and Dom B. Generalized model selection for unsupervised learning in high dimensions. Proc. Advances in Neural Information Processing Systems. NIPS (1999), MIT Press 970-976
52. Wallace C.S. Statistical and Inductive Inference by Minimum Message Length (2005), Springer
53. Wang X., and Kabán A. Finding uninformative features in binary data. Proc. of 6th International Conference on Intelligent Data Engineering and Automated Learning. IDEAL2005. LNCS vol. 3578 (2005), Springer 40-47
54. Webb A.R. Statistical Pattern Recognition. second ed. (2002), John Wiley and Sons Ltd
55. Wilbur J.D., Ghosh J.K., Nakatsu C.H., Brouder S.M., and Doerge R.W. Variable selection in high-dimensional multivariate binary data with application to the analysis of microbial community DNA fingerprints. Biometrics 58 2 (2002) 378-386
56. Wilks S.S. Mathematical Statistics (1962), Wiley, New York
57. Yang J., Jiang Y.-G., Hauptmann A.G., and Ngo C.-W. Evaluating bag-of-visual-words representations in scene classification. Proc. of the International Workshop on Multimedia Information Retrieval. MIR (2007), ACM 197-206
58. Zhu L., Rao A., and Zhang A. Theory of keyblock-based image retrieval. ACM Transactions on Information Systems 20 2 (2002) 224-257