Data dimensionality estimation methods: A survey

Pattern Recognition

Volumn 36, Issue 12, 2003, Pages 2945-2954

  Camastra, Francesco ^a  

^a UNIVERSITY OF GENOA   (Italy)

Author keywords

Fractal dimension; Fukunaga Olsen's algorithm; Intrinsic dimensionality; Multidimensional scaling; Topological dimension

Indexed keywords

ALGORITHMS; DATA PROCESSING; PARAMETER ESTIMATION;

NEURAL AUTOASSOCIATORS;

PATTERN RECOGNITION;

ESTIMATION METHOD;

EID: 0142025120     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0031-3203(03)00176-6     Document Type: Article

References (84)

1. Jain A.K. Dubes R.C. Algorithms for Clustering Data 1988 Prentice-Hall Englewood Cliffs, NJ
2. K. Fukunaga, Intrinsic dimensionality extraction, in: P.R. Krishnaiah, L.N. Kanal (Eds.), Classification, Pattern Recognition and Reduction of Dimensionality, Handbook of Statistics, Vol. 2, North-Holland, Amsterdam, 1982, pp. 347-362.
3. Bellman R. Adaptive Control Processes: A Guided Tour 1961 Princeton University Press Princeton, NJ
4. Vapnik V. Statistical Learning Theory 1998 Wiley New York
5. Kirby M. Geometric Data Analysis: An Empirical Approach to Dimensionality Reduction and the Study of Patterns 2001 Wiley New York
6. Heyting A. Freudenthal H. Collected Works of L.E.J Brouwer 1975 North-Holland, Elsevier Amsterdam
7. Fukunaga K. Olsen D.R. An algorithm for finding intrinsic dimensionality of data IEEE Trans. Comput. 20 2 1976 165-171
8. Pettis K. Bailey T. Jain T. Dubes R. An intrinsic dimensionality estimator from near-neighbor information IEEE Trans. Pattern Anal. Mach. Intell. 1 1 1979 25-37
9. Martinetz T. Schulten K. Topology representing networks Neural Networks 3 1994 507-522
10. Linde Y. Buzo A. Gray R. An algorithm for vector quantizer design IEEE Trans. Commun. 28 1 1980 84-95
11. Trunk G.V. Statistical estimation of the intrinsic dimensionality of a noisy signal collection IEEE Trans. Comput. 25 1976 165-171
12. Verveer P.J. Duin R. An evaluation of intrinsic dimensionality estimators IEEE Trans. Pattern Anal. Mach. Intell. 17 1 1995 81-86
13. Bruske J. Sommer G. Intrinsic dimensionality estimation with optimally topology preserving maps IEEE Trans. Pattern Anal. Mach. Intell. 20 5 1998 572-575
14. F. Frisone, F. Firenze, P. Morasso, L. Ricciardiello, Application of topological-representing networks to the estimation of the intrinsic dimensionality of data, in: F. Fogelman-Soulie, P. Gallinari (Eds.), Proceedings of International Conference on Artificial Neural Networks, 1995, Paris, France, pp. 323-329.
15. Conway J.H. Sloane N.J.A. Sphere Packings, Lattices and Groups 1988 Springer Berlin
16. Jollife I.T. Principal Component Analysis 1986 Springer Berlin
17. Bishop C. Neural Networks for Pattern Recognition 1995 Cambridge University Press Cambridge
18. Karhunen J. Joutsensalo J. Representations and separation of signals using nonlinear pca type learning Neural Networks 7 1 1994 113-127
19. Schölkopf B. Smola A. Muller K.R. Nonlinear component analysis as a kernel eigenvalue problem Neural Computat. 10 1998 1299-1319
20. Press W.H. Flannery B.P. Teulkosky S.A. Vetterling W.T. Numerical Recipes: The Art of Scientific Computing 1989 Cambridge University Press Cambridge
21. Fotheringhame D. Baddeley R.J. Nonlinear principal component analysis of neuronal spike train data Biol. Cybernet. 77 1997 282-288
22. Malthouse E.C. Limitations of nonlinear pca as performed with generic neural networks IEEE Trans. Neural Networks 9 1 1998 165-173
23. Berg C. Christensen J.P.R. Ressel P. Harmonic analysis on semigroups 1984 Springer Berlin
24. F. Camastra, Kernel methods for unsupervised learning, Ph.d. Thesis Progress Report, University of Genova, 2002.
25. Broomhead D.S. Kirby M. A new approach to dimensionality reduction: Theory and algorithms SIAM J. Appl. Math. 60 6 2000 2114-2142
26. Whitney H. Differentiable manifolds Ann. Math. 37 1936 645-680
27. A.K. Romney, R.N. Shepard, S.B. Nerlove, Multidimensional Scaling, Vol. I, Theory, Seminar Press, New York, 1972.
28. A.K. Romney, R.N. Shepard, S.B. Nerlove, Multidimensional Scaling, Vol. 2, Applications, Seminar Press, New York, 1972.
29. Kruskal J.B. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis Psychometrika 29 1964 1-27
30. Shepard R.N. The analysis of proximities: Multidimensional scaling with an unknown distance function Psychometrika 27 1962 125-140
31. Bennett R.S. The intrinsic dimensionality of signal collections IEEE Trans. Inf. Theory 15 1969 517-525
32. Sammon J.W.J. A nonlinear mapping for data structure analysis IEEE Trans. Comput. C-18 1969 401-409
33. Chen C.K. Andrews H.C. Nonlinear intrinsic dimensionality computations IEEE Trans. System Man Cybernet. SMC-3 1973 197-200
34. Kruskal J.B. A nonlinear mapping for data structure analysis IEEE Trans. Comput. C-20 1971 1614
35. Chang C.L. Lee R.C.T. A heuristic relaxation method for nonlinear mapping in cluster analysis IEEE Trans. Comput. C-23 1974 178-184
36. R.N. Shepard, J.D. Carroll, Parametric representation of nonlinear data structures, in: K.V. Mardia, J.T. Kent, J.M. Bibby (Eds.), Multivariate Analysis, Academic Press, New York, 1969, pp. 561-592.
37. J.B. Kruskal, Linear transformation of multivariate data to reveal clustering, in: A.K. Romney, R.N. Shepard, S.B. Nerlove (Eds.), Multidimensional Scaling, Vol. I, Seminar Press, New York, 1972, pp. 101-115.
38. J.B. Kruskal, J.D. Carroll, Geometrical models and badness-of-fit functions, in: K.V. Mardia, J.T. Kent, J.M. Bibby (Eds.), Multivariate Analysis, Vol. 2, Academic Press, New York, 1969, pp. 639-671.
39. Shepard R.N. Representation of structure in similarity data problems and prospect Psychometrika 39 1974 373-421
40. Tenenbaum J.B. de Silva V. Langford J.C. A global geometric framework for nonlinear dimensionality reduction Science 290 12 2000 2319-2323
41. Roweis S. Saul L.K. Nonlinear dimensionality reduction by locally linear embedding Science 290 12 2000 2323-2326
42. Demartines P. Herault J. Curvilinear component analysis: A self-organizing neural network for nonlinear mapping in cluster analysis IEEE Trans. Neural Networks 8 1 1997 148-154
43. Kohonen T. Self-Organizing Map 1995 Springer Berlin
44. Kaplan D. Glass L. Understanding Nonlinear Dynamics 1995 Springer Berlin
45. Mandelbrot B. Fractals: Form, Chance and Dimension 1977 Freeman New York
46. Eckmann J.P. Ruelle D. Ergodic theory of chaos and strange attractors Rev. Mod. Phys. 57 1985 617-659
47. Ott E. Chaos in Dynamical Systems 1993 Cambridge University Press Cambridge
48. Hausdorff F. Dimension und äusseres mass Math. Ann. 79 1919 157-179
49. Grassberger P. An optimized box-assisted algorithm for fractal dimension Phys. Lett. A 148 1990 63-68
50. Tolle C.R. Mc Junkin T.R. Gorisch D.J. Suboptimal minimum cluster volume cover-based method for measuring fractal dimension IEEE Trans. Pattern Anal. Mach. Intell. 25 1 2003 32-41
51. B. Kégl, Intrinsic dimension estimation using packing numbers, in: S. Becker, S. Thrun, K. Obermayer (Eds.), Advances in Neural Information Processing, Vol. 15, MIT Press, Cambridge, MA, 2003.
52. Grassberger P. Procaccia I. Measuring the strangeness of strange attractors Physica D 9 1983 189-208
53. Broomhead D.S. Jones R. Time series analysis Proc. R. Soc. London Ser. A 423 1989 103-121
54. R.L. Smith, Optimal estimation of fractal dimension, in: M. Casdagli, S. Eubank (Eds.), Nonlinear Modeling and Forecasting, SFI Studies in the Sciences of Complexity, Vol. XII, Addison-Wesley, Reading, MA, 1992, pp. 115-135.
55. F. Takens, On the numerical determination of the dimension of an attractor, in: B. Braaksma, H. Broer, F. Takens (Eds.), Dynamical Systems and Bifurcations, Proceedings Groningen 1984, Springer, Berlin, 1984, pp. 99-106.
56. Duda R.O. Hart P.E. Pattern Classification and Scene Analysis 1973 Wiley New York
57. Fukunaga K. An Introduction to Statistical Pattern Recognition 1990 Academic Press New York
58. Theiler J. Statistical precision of dimension estimators Phys. Rev. A 41 1990 3038-3051
59. Theiler J. Lacunarity in a best estimator of fractal dimension Phys. Lett. A 133 1988 195-200
60. Eckmann J.P. Ruelle D. Fundamental limitations for estimating dimensions and lyapounov exponents in dynamical systems Phys. D 56 1992 185-187
61. Smith L.A. Intrinsic limits on dimension calculations Phys. Lett. A 133 1988 283-288
62. Theiler J. Eubank S. Longtin A. Galdrikian B. Farmer J.D. Testing for nonlinearity in time series: The method for surrogate date Physica D 58 1992 77-94
63. Efron B. Tibshirani R.J. An Introduction to the Bootstrap 1993 Chapman - Hall London
64. Camastra F. Vinciarelli A. Intrinsic estimation of data: An approach based on grassberger-procaccia's algorithm Neural Process. Lett. 14 1 2001 27-34
65. Camastra F. Vinciarelli A. Estimating the intrinsic dimension of data with a fractal-based method IEEE Trans. Pattern Anal. Mach. Intell. 24 10 2002 1404-1407
66. Kirby M. Sirovich L. Application of the karhunen-loève procedure for the characterization of human faces IEEE Trans. Pattern Anal. Mach. Intell. 12 1 1990 103-108
67. Huang Q. Lorch J.R. Dubes R.C. Can the fractal dimension of images be measured? Pattern Recognition 27 3 1994 339-349
68. Meisel L.V. Johnson M.A. Convergence of numerical box-counting and correlation integral multifractal analysis techniques Pattern Recognition 30 9 1997 1565-1570
69. V. Isham, Statistical aspects of chaos: A review, in: O.E. Barndorff-Nielsen, J.L. Jensen, W.S. Kendall (Eds.), Networks and Chaos-Statistical and Probabilistic Aspects, Chapman - Hall, London, 1993, pp. 124-200.
70. Chialvo D.R. Gilmour R.F. Jalife J. Low-dimensional chaos in cardiac tissue Nature 343 1990 653-658
71. Tirsch W.S. Keidel M. Perz S. Scherb H. Sommer G. Inverse covariation of spectral density and correlation dimension in cyclic eeg dimension of the human brain Biol. Cybernet. 82 2000 1-14
72. Haykin S. Bo Li X. Detection of signals in chaos Proc. IEEE 83 1 1995 95-122
73. Somervuo P. Speech dimensionality analysis on hypercubical self-organizing maps Neural Process. Lett. 17 2 2003 125-136
74. Scheinkman J.A. Le Baron B. Nonlinear dynamics and stock returns J. Bus. 62 1989 311-337
75. Kanz H. Schreiber T. Nonlinear Time Series Analysis 1997 Cambridge University Press Cambridge
76. Tong H. Nonlinear Time Series 1990 Oxford University Press Oxford
77. Packard N. Crutchfield J. Farmer J. Shaw R. Geometry from a time series Phys. Rev. Lett. 45 1 1980 712-716
78. F. Takens, Detecting strange attractor in turbolence, in: D. Rand, L.S. Young (Eds.), Dynamical Systems and Turbolence, Warwick 1980, Springer, Berlin, 1981, pp. 366-381.
79. R. Mañé, On the dimension of compact invariant sets of certain nonlinear maps, in: D. Rand, L.S. Young (Eds.), Dynamical Systems and Turbolence, Warwick 1980, Springer, Berlin, 1981, pp. 230-242.
80. Camastra F. Colla A.M. Neural short-term prediction based on dynamics reconstruction Neural Process. Lett. 9 1 1999 45-52
81. Dvorak I. Holden A. Mathematical Approaches to Brain Functioning Diagnostics 1991 Manchester University Press Manchester
82. Lorenz E.N. Deterministic non-periodic flow J. Atmos. Sci. 20 1963 130-141
83. Houghton J. The bakerian lecture 1991: The predictability of weather and climates Philos. Trans. R. Soc. London Ser. A 337 1991 521-572
84. Scargle J. Studies in astronomical time series analysis. iv. modeling chaotic and random processes with linear filters Astrophys. J. 359 1990 469-482