DANCo: An intrinsic dimensionality estimator exploiting angle and norm concentration

Pattern Recognition

Volumn 47, Issue 8, 2014, Pages 2569-2581

  Ceruti, Claudio ^a   Bassis, Simone ^a   Rozza, Alessandro ^b   Lombardi, Gabriele ^a   Casiraghi, Elena ^a   Campadelli, Paola ^a  

^a UNIVERSITY OF MILAN   (Italy)

^b UNIVERSITY OF NAPLES PARTHENOPE   (Italy)

Author keywords

Intrinsic dimensionality estimation; Kullback Leibler divergence; Manifold learning; Nearest neighbor distance distribution; Von Mises distribution

Indexed keywords

SOFTWARE ENGINEERING;

INTRINSIC DIMENSIONALITIES; KULLBACK LEIBLER DIVERGENCE; MANIFOLD LEARNING; NEAREST NEIGHBOR DISTANCE; VON MISES DISTRIBUTION;

PATTERN RECOGNITION;

EID: 84899486572     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.02.013     Document Type: Article

References (59)

1. K. Fukunaga, Intrinsic dimensionality extraction, in: P.R. Krishnaiah, L.N. Kanal (Eds.), Classification, Pattern Recognition and Reduction of Dimensionality, 1982.
2. R.E. Bellman Adaptive Control Processes A Guided Tour 1961 Princeton University Press, Princeton
3. M. Kirby Geometric Data Analysis An Empirical Approach to Dimensionality Reduction and the Study of Patterns 1998 John Wiley and Sons, New York
4. V. Vapnik Statistical Learning Theory 1998 John Wiley and Sons, New York
5. J. Friedman, T. Hastie, and R. Tibshirani The Elements of Statistical Learning - Data Mining, Inference and Prediction 2009 Springer Berlin
6. F. Camastra, and M. Filippone A comparative evaluation of nonlinear dynamics methods for time series prediction Neural Comput. Appl. 18 8 2009 1021 1029
7. M. Valle, and A.R. Oganov Crystal fingerprint space - a novel paradigm for studying crystal-structure sets Acta Crystallogr. Sect. A 66 5 2010 507 517
8. F. Camastra, and A. Vinciarelli Estimating the intrinsic dimension of data with a fractal-based method IEEE Trans. Pattern Anal. Mach. Intell. 24 2002 1404 1407 (Pubitemid 35327462)
9. G. Lombardi, A. Rozza, C. Ceruti, E. Casiraghi, P. Campadelli, Minimum neighbor distance estimators of intrinsic dimension, in: Proceedings of ECML-PKDD, vol. 6912, 2011, pp. 374-389.
10. A. Rozza, G. Lombardi, M. Rosa, E. Casiraghi, P. Campadelli, IDEA: intrinsic dimension estimation algorithm, in: Proceedings of ICIAP, vol. 6978, 2011, pp. 433-442.
11. A. Rozza, G. Lombardi, C. Ceruti, E. Casiraghi, and P. Campadelli Novel high intrinsic dimensionality estimators Mach. Learn. 89 1 2012 37 65
12. F. Camastra Data dimensionality estimation methods a survey Pattern Recognit. 36 12 2003 2945 2954 (Pubitemid 37293405)
13. I.T. Jollife Principal Component Analysis Springer Series in Statistics 1986 Springer-Verlag New York, NY
14. T. Lin, and H. Zha Riemannian manifold learning IEEE Trans. Pattern Anal. Mach. Intell. 30 5 2008 796 809 (Pubitemid 351486749)
15. K. Fukunaga An algorithm for finding intrinsic dimensionality of data IEEE Trans. Comput. 20 1971 176 183
16. P.J. Verveer, and R.P.W. Duin An evaluation of intrinsic dimensionality estimators IEEE Trans. Pattern Anal. Mach. Intell. 17 1995 81 86
17. M.E. Tipping, and C.M. Bishop Probabilistic principal component analysis J. R. Stat. Soc. Ser. B 61 Part 3 1997 611 622
18. C.M. Bishop, Bayesian PCA, in: Proceedings of NIPS, vol. 11, 1998, pp. 382-388.
19. J. Li, D. Tao, Simple exponential family PCA, in: Proceedings of AISTATS, 2010, pp. 453-460.
20. H. Zou, T. Hastie, and R. Tibshirani Sparse principal component analysis J. Comput. Gr. Stat. 15 2004 265 286 (Pubitemid 43935978)
21. Y. Guan, and J.G. Dy Sparse probabilistic principal component analysis J. Mach. Learn. Res. - Proc. Track 5 2009 185 192
22. E. Levina, and P.J. Bickel Maximum likelihood estimation of intrinsic dimension Proc. NIPS 171 2005 777 784
23. K. Pettis, T. Bailey, A. Jain, and R. Dubes An intrinsic dimensionality estimator from near-neighbor information IEEE Trans. Pattern Anal. Mach. Intell. 1 1979 25 37 (Pubitemid 9468506)
24. P. Mordohai, and G. Medioni Dimensionality estimation, manifold learning and function approximation using tensor voting J. Mach. Learn. Res. 11 2010 411 450
25. P. Grassberger, and I. Procaccia Measuring the strangeness of strange attractors Phys. D: Nonlinear Phenom. 9 1983 189 208
26. M. Brand Charting a manifold Adv. Neural Inf. Process. Syst. 15 2003 961 968
27. M. Hein, Intrinsic dimensionality estimation of submanifolds in euclidean space, in: Proceedings of ICML, 2005, pp. 289-296. (Pubitemid 43183345)
28. A.M. Farahmand, C. Szepesvari, J.Y. Audibert, Manifold-adaptive dimension estimation, in: Proceedings of ICML, 2007, pp. 265-272.
29. B. Kégl Intrinsic dimension estimation using packing numbers S. Becker, S. Thrun, K. Obermayer, Proceedings of NIPS 2002 MIT Press, Cambridge 681 688
30. M. Raginsky, S. Lazebnik, Estimation of intrinsic dimensionality using high-rate vector quantization, in: NIPS, 2005, pp. 1105-1112.
31. S. Graf, and H. Luschgy Foundations of Quantization for Probability Distributions 2000 Springer Berlin
32. J.A. Costa, A.O. Hero, Learning intrinsic dimension and entropy of high-dimensional shape spaces, in: Proceedings of EUSIPCO, 2004, pp. 1-22.
33. J.A. Costa, and A.O. Hero Geodesic entropic graphs for dimension and entropy estimation in manifold learning IEEE Trans. Signal Process. 52 8 2004 2210 2221
34. J. Tenenbaum, V. Silva, and J. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 2000 2319 2323 (Pubitemid 32041577)
35. J.P. Eckmann, and D. Ruelle Fundamental limitations for estimating dimensions and Lyapunov exponents in dynamical systems Phys. D: Nonlinear Phenom. 56 2-3 1992 185 187
36. Q. Wang, S.R. Kulkarni, S. Verdu, A nearest-neighbor approach to estimating divergence between continuous random vector, in: Proceedings of ISIT, 2006, pp. 242-246. (Pubitemid 351244090)
37. K.V. Mardia Statistics of Directional Data 1972 Academic Press, London
38. A. Sodergren On the distribution of angles between the N shortest vectors in a random lattice J. Lond. Math. Soc. 84 3 2011 749 764
39. K.V. Mardia, and P.E. Jupp Directional Statistics, Wiley Series in Probability and Statistics 2009 John Wiley & Sons, Chichester
40. E. Breitenberger Analogues of the normal distribution on the circle and the sphere Biometrika 50 1-2 1963 81 88
41. G.J.G. Upton New approximations to the distribution of certain angular statistics Biometrika 61 2 1974 369 373
42. M. Abramowitz, and I.A. Stegun Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables, ninth edition 1964 Dover New York
43. G.W. Hill New approximations to the von Mises distribution Biometrika 63 3 1976 673 676
44. G.J.G. Upton Approximate confidence intervals for the mean direction of a von Mises distribution Biometrika 73 2 1986 525 527
45. N.I. Fisher Statistical Analysis of Circular Data 1996 Cambridge University Press, Chichester
46. A.P.N. Vo, S. Oraintara, T.T. Nguyen, Statistical image modeling using von Mises distribution in the complex directional wavelet domain, in: Proceedings of ISCAS 2008, 2008, pp. 2885-2888.
47. B. O'Neill Elementary Differential Geometry 2006 Elsevier, Academic Press, San Diego
48. R.D. Lord The use of the Hankel transform in statistics I. General theory and examples Biometrika 41 1/2 1954 44 55
49. T.F. Coleman, and Y. Li An interior, trust region approach for nonlinear minimization subject to bounds SIAM J. Optim. 6 1996 418 445
50. G.S. Fishman Monte Carlo Concepts, Algorithms, and Applications, Springer Series in Operations Research 1996 Springer-Verlag New York, NY
51. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner Gradient-based learning applied to document recognition Proc. IEEE 86 1998 2278 2324
52. F.J. Pineda, J.C. Sommerer, Estimating generalized dimensions and choosing time delays: a fast algorithm, in: Time Series Prediction. Forecasting the Future and Understanding the Past, 1994, pp. 367-385.
53. A. Frank, A. Asuncion, UCI Machine Learning Repository, 2010, 〈 http://archive.ics.uci.edu/ml 〉.
54. J.A. Costa, A.O. Hero, Learning intrinsic dimension and entropy of shapes, in: Statistics and Analysis of Shapes, Birkhauser, 2005, pp. 650-663.
55. E. Ott Chaos in Dynamical Systems 1993 Cambridge University Press Cambridge
56. I. Kivimäki, K. Lagus, I. Nieminen, J. Väyrynen, T. Honkela, Using correlation dimension for analysing text data, in: Proceedings of the ICANN, Springer-Verlag, Berlin, Heidelberg, 2010, pp. 368-373.
57. L. Chua, M. Komuro, and T. Matsumoto The double scroll IEEE Trans. Circuits Syst. 32 1985 797 818
58. J. Demšar Statistical comparisons of classifiers over multiple data sets J. Mach. Learn. Res. 7 2006 1 30 (Pubitemid 43022939)
59. J.A. Parejo, J. García, A. Ruiz-Cortés, J.C. Riquelme, Statservice: Herramienta de análisis estadístico como soporte para la investigación con metaheurísticas, in: Actas del VIII Congreso Expañol sobre Metaheurísticas, Algoritmos Evolutivos y Bio-inspirados, 2012.