Mutual information estimation in higher dimensions: A speed-up of a k-nearest neighbor based estimator

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4431 LNCS, Issue PART 1, 2007, Pages 790-797

  Vejmelka, Martin ^a   Hlaváčková Schindler, Kateřina ^b  

^a INSTITUTE OF MATHEMATICS   (Czech Republic)

^b ERICH SCHMID INSTITUTE OF MATERIALS SCIENCE   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; ONLINE SEARCHING; PARAMETER ESTIMATION;

ENTROPY ESTIMATOR; INFORMATION ESTIMATION; SPATIAL INDEXING METHODS;

INDEXING (OF INFORMATION);

EID: 38049040231     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-71618-1_88     Document Type: Conference Paper

References (18)

1. Beirlant, J., Dudewitz, E.J., Györfi, L., and van der Meulen, E.C.: Nonparametric entropy estimation: An overview. Int. J. Math. And Statistical Sciences, 6, (1997) 17-39
2. Bentley, J.L.: Multidimensional binary search trees used in associative searching, Communications of the ACM, 18, 9 (1975), 509-517
3. Bingham S., Kot M.: Multidimensional trees, range searching, and a correlation dimension algorithm of reduced complexity, Phys Lett. A 140, 327 (1989)
4. Friedman, J.H., Baskett, F., Shustek, L.J.: An Algorithm for finding nearest neighbor. IEEE Transactions on Computers (1975) 1000-1006
5. Freidman, J.H., Bentley, J.L., and Finkel, R.A., An algorithm for finding best matches in logarithmic expected time. ACM Trans. Math. Softw. 3, 3 (Sep. 1977), 209-226
6. Goria, M.N., Leonenko, N.N., Mergel, V.V., Novi Inverardi, P.L., A new class of random vector entropy estimators and its applications in testing statistical hypotheses, Nonparametric Statistics, 17, 3, 2005, 277-297
7. Grassberger, P.: An optimized box-assisted algorithm for fractal dimensions. Phys. Lett.A, 148 (1990) 63-68
8. Hyvaerinnen, A., Karhunen, J., Oja, E.: Independent Component Analysis, Wiley 2001
9. Kozachenko, L.F., Leonenko, N.N.: Sample estimate of the entropy of a random vector. Problems of Information Transmission, 23(2) (1987) 95101
10. Kraskov, A., Stögbauer, H., Grassberger, P: Estimating mutual information, Physical Review E 69, 066138 (2004)
11. Kraskov, A.: Synchronization and interdependence measures and their applications to the electroencephalogram of epilepsy patients and clustering of data, PhD thesis, John von Neumann Institute for Computing, 2004
12. Kwak, N., Choi, CH.: Input feature selection by mutual information based on Parzen window. IEEE Trans. On Pattern Analysis and Machine Intellingence, 24 (12) (2002) 1667-1671
13. Paninski, L: Estimation of entropy and mutual information. Neural Computation 15 (2003) 1191-1253
14. http://en.wikipedia.org/wiki/Space-filling-curve
15. Schreiber, T: Efficient neighbor searching in nonlinear time series analysis. In: Int. Journal of Bifurc. and Chaos 5(2) (1995) 349-358
16. Shannon, C.: A mathematical theory of communication. Bell System Tech. J., 27 (1948) 379-423
17. Theiler, J.: Efficient algorithm for estimation the correlation dimension from a set of discrete points, Physical Review A 36 (1987) 44564462
18. Van Hulle, M.M.: Edgeworth approximation of multivariate differential entropy, Neural Computation 17 (2005) 1903-1910