Statistic to estimate the variance of the histogram-based mutual information estimator based on dependent pairs of observations

Signal Processing

Volumn 75, Issue 1, 1999, Pages 51-63

  Moddemeijer, R ^a  

^a UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; STATISTICAL METHODS;

MUTUAL INFORMATION ESTIMATORS;

DIGITAL SIGNAL PROCESSING;

EID: 0032654509     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0165-1684(98)00224-2     Document Type: Article

References (32)

1. Battini R. Using mutual information for selecting features in supervised neural net learning. IEEE Trans. Neural Networks. 5(4):1994;537-550.
2. B.V. Bonnlander, A.S. Weigend, Selecting input variables using mutual information and nonparametric density estimation, in: Proc. Internat. Symp. on Artificial Neural Networks (ISANN'94), Tainan, Taiwan, 1994, pp. 42-50.
3. S. Brandt, Statistical and Computational Methods in Data Analysis, 2nd ed., North-Holland, Amsterdam, 1976. ISBN 0-444-10893-9.
4. Brown P.F. et al. Class based n-gram models of natural language. Comput. Linguistics. 18(4):1992;467-477.
5. B. Efron, R.J. Tibshirani, An Introduction to the Bootstrap, Monographs on Statistics and Applied Probability, Vol. 57, Chapman & Hall, New York, 1993. ISBN 0-412-04231-2.
6. Gel'fand I.M., Yaglom A.M. Calculation of amount of information about a random function contained in another such function. Amer. Math. Soc. Trans. 12:1959;199-246.
7. Haris F.J. On the use of windows for harmonic analysis with discrete Fourier transform. Proc. IEEE. 66:1978;51-83.
8. P. Hastreiter et al., Fast mutual information based registration and fusion of registered tomographic image data, in: B. Arnolds et al. (Eds.), Workshop: Digitale Bildverarbeitung in der Medizin, Vol. 5, GI, Deutsche Gesellschaft fuer medizinische Informatik (GMDS), 1997, pp. 146-151.
9. S. Haykin, S. Kesler, Prediction-error filtering and maximum entropy estimation, in: S. Haykin (Ed.), Nonlinear Methods in Spectral Analysis, Springer, Berlin, 1979, pp. 9-72. ISBN 3540093516.
10. K. Henning, Die Entropie in der Systemtheorie, Technical Report, Rheinisch-Westfälischen Technische Hochschule, Aachen, Habilitationsheft, 1980.
11. Henning K., Schürmann B. Zur Bestimmung van totzeiten dynamischer nichtlinearer Übertragungssysteme mittels Entropiefunktionen. Automatisierungstechnik. 24:1986;115-120.
12. G.M. Jenkins, D.G.H.E. Watts, Spectral Analysis and its Applications, Holden-Day, San Francisco, CA, 1968.
13. S. Kutscha, Statistischer Bewertungskriterien für die Entropieanalyse dynamischer Systeme, Ph.D Thesis, Rheinisch-Westfälischen Technischen Hochschule, Aachen, 1988.
14. M.M. Lankhorst, R. Moddemeijer, Automatic word categorization: an information-theoretic approach, Technical Report, University of Groningen, Department of Computing Science, Groningen, 1992, CS 9209.
15. M.M. Lankhorst, R. Moddemeijer, Automatic word categorization: An information-theoretic approach, In: K.A. Schouwhamer Immink, P.G.M. Bot (Eds.), Proc. 14th Symp. on Information Theory in the Benelux, Veldhoven, 17-18 May 1993, pp. 62-69. Werkgemeenschap Informatie- en Communicatietheorie.
16. F. Maes et al., Multi-modality image registration using information theory, Technical Report, University Hospital Gasthuisberg, Leuven, 1996.
17. Maes F. et al. Multi-modality image registration by maximization of mutual information. IEEE Trans. Med. Imaging. 16:1997;187-198.
18. Mars N.J.I., van Arragon G.W. Time delay estimation in non-linear systems using average amount of mutual information analysis. Signal Processing. 4(2,3):1982;139-153.
19. Miller R.G. The jackknife - a review. Biometrika. 61(1):1974;1-15.
20. R. Moddemeijer, Delay-estimation with application to electroencephalograms in epilepsy, Ph.D Thesis, Universiteit Twente, Enschede, 1989.
21. Moddemeijer R. On estimation of entropy and mutual information of continuous distributions. Signal Processing. 16(3):1989;233-248.
22. Moon Y.-I., Rajagopalan B., Lall U. Estimation of mutual information using kernel density estimators. Phys. Rev. E. 52(3):1995;2318-2321.
23. Mosteller F. The jackknife. Rev. Internat. Statist. Inst. 29(3):1971;363-368.
24. S. Okawa, T. Kobayashi, K. Shirai, Automatic training of phoneme dictionary based on mutual information criterion, in: Proc. ICASSP '94, Adelaide, Australia, April 1994, pp. I-241-I-244.
25. J.P.W. Pluim, Multi-modality matching using mutual information, Technical Report, University of Groningen, Department of Computing Science, Groningen, 1992.
26. Quenouille M.H. Notes on bias in estimation. Biometrika. 43:1956;353-360.
27. Sakitt B. et al. The information transmitted at final position in visually triggered forearm movements. Biol. Cybernet. 46:1983;111-118.
28. Shannon C.E. A mathematical theory of communication 1. Bell System Tech. J. 27:1948;379-423.
29. Shannon C.E. A mathematical theory of communication 2. Bell System Tech. J. 27:1948;623-656.
30. C.E. Shannon, W. Weaver, The Mathematical Theory of Communication, The University of Illinois Press, Champaign, IL, 1963.
31. M.R. Spiegel, Schaum's Outline of Theory and Problems of Probability and Statistics, McGraw-Hill, New York, 1975. ISBN 0070602204.
32. P.A. Viola, Alignment by maximization of mutual information, Ph.D Thesis, Massachusetts Institute of Technology (MIT), Cambridge, MA, March 1995.