From error probability to information theoretic (multi-modal) signal processing

Signal Processing

Volumn 85, Issue 5 SPEC. ISS., 2005, Pages 875-902

  Butz, Torsten ^a   Thiran, Jean Philippe ^b  

^a EPFL   (Switzerland)

^b EPFL   (Switzerland)

Author keywords

Error probability; Information theory; Markov chain; Medical images; Multi media; Multi modal; Stochastic process

Indexed keywords

ALGORITHMS; ERROR ANALYSIS; IMAGE SEGMENTATION; INFORMATION THEORY; MARKOV PROCESSES; MEDICAL IMAGING; MODAL ANALYSIS; MULTIMEDIA SYSTEMS; PROBABILITY; RANDOM PROCESSES; SPEECH PROCESSING;

IMAGE REGISTRATION; MULTI-MODAL SIGNAL PROCESSING; RANDOM VARIABLES (RV); VIDEO SEQUENCES;

SIGNAL PROCESSING;

EID: 14844344462     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2004.11.027     Document Type: Article

References (45)

1. J.W. Fisher III, J.C. Principe, A methodology for information theoretic feature extraction, in: World Congress on Computational Intelligence, Anchorage, USA, March 1998.
2. J.C. Principe, D. Xu, and J.W. Fisher III Learning from examples with information theoretic criteria J. VLSI Signal Process. Syst. 26 2000 61 77
3. T. Darrell, J.W. Fisher III, P. Viola, and W. Freeman Audio-visual segmentation and the cocktail party effect International Conference on Multimodal Interfaces Beijing, China 2000 32 40
4. A.O. Hero, B. Ma, and O. Michel Imaging applications of stochastic minimal graphs IEEE International Conference on Image Processing Thessaloniki, Greece 2001 573 576
5. J.C. Principe, J.W. Fisher III, D. Xu, Information theoretic learning, Unsupervised Adaptive Filtering, Wiley, New York, 2000 (Chapter 7).
6. W.M. Wells III, P. Viola, H. Atsumi, S. Nakajima, and R. Kikinis Multi-modal volume registration by maximization of mutual information Med. Image Analysis 1 1 1996 35 51
7. F. Maes, A. Collignon, D. Vandermeulen, G. Marchal, and P. Suetens Multimodality image registration by maximization of mutual information IEEE Trans. Med. Imaging 16 2 1997 187 198
8. C. Studholme, D.J. Hawkes, and D.L.G. Hill A normalised entropy measure for multi-modality image alignment SPIE Medical Imaging Image Processing San Diego, USA 1998 132 142
9. A. Roche, G. Malandin, X. Pennec, and N. Ayache The correlation ratio as a new similarity measure for multimodal image registration Medical Image Computing and Computer-Assisted Intervention Cambridge, USA 1998 1115 1124
10. E. Gokcay, and J.C. Principe Information theoretic clustering IEEE Trans. Pattern Anal. Mach. Intell. 24 2 2002 158 171
11. T.M. Cover, and J.A. Thomas Elements of Information Theory 1991 Wiley New York
12. R.M. Fano Transmission of Information A Statistical Theory of Communication 1961 MIT Press, Wiley Cambridge
13. A. Renyi Probability Theory 1970 Elsevier Publishing Company Amsterdam
14. D. Erdogmus, and J.C. Principe Information transfer through classifiers and its relation to probability of error International Joint Conference on Neural Networks Washington, DC 2001
15. C.E. Shannon A mathematical theory of communication Bell Systems Technol. J. 27 1948 379 423
16. L. Devroye, and L. Györfi Non-parametric Density Estimation 1985 Wiley New York
17. L. Devroye A Course in Density Estimation 1987 Birkhäuser Basel
18. S.P. Lloyd, Least squares quantization in PCM, Bell Laboratories Technical Note, 1957.
19. S. Winkler, Vision models and quality metrics for image processing applications, Ph.D. Thesis, Swiss Federal Institute of Technology, 2000.
20. M. Rosenblatt Remarks on some nonparametric estimates of a density function Ann. Math. Stat. 27 3 1956 832 837
21. E. Parzen On estimation of a probability density function and mode Ann. Math. Stat. 33 3 1962 1065 1076
22. A. Renyi On measures of entropy and information Fourth Berkeley Symposium on Probability Mathematics and Statistics 1 1960 547 561
23. M. Unser, A. Aldroubi, and M. Eden B-spline signal processing Part I - theory IEEE Trans. Signal Process. 41 2 1993 821 833
24. M. Unser, A. Aldroubi, and M. Eden B-spline signal processing Part II - Efficient design and applications IEEE Trans. Signal Process. 41 2 1993 834 848
25. T. Butz, J.-Ph. Thiran, Multi-modal signal processing: an information theoretical framework, Technical Report 02.01, Signal Processing Institute (ITS), Swiss Federal Institute of Technology (EPFL), 2002.
26. T. Butz, O. Cuisenaire, J.-Ph. Thiran, Multi-modal medical image registration: from information theory to optimization objective, in: IEEE International Conference on Digital Signal Processing, Santorini, Greece, July 2002, vol. I, pp. 407-414.
27. T. Butz, J.-Ph. Thiran, Feature-space mutual information for multi-modal signal processing, with application to medical image registration, in: XI. European Signal Processing Conference, Toulouse, France, September 2002, vol. I, pp. 3-10.
28. J.N. Kapur, and H.K. Kesavan Entropy Optimization Principles with Applications 1992 Academic Press New York
29. C. Studholme, D.J. Hawkes, and D.L.G. Hill An overlap invariant entropy measure of 3D medical image alignment Pattern Recogn. 32 1999 71 86
30. M. Holden, D.L.G. Hill, E.R.E. Denton, J.M. Jarosz, T.C.S. Cox, D.J. Hawkes, Voxel similarity measures for 3D serial MR brain image registration, in: Information Processing in Medical Imaging, Visegrd, Hungary, 1999, vol. 1613, pp. 466-471.
31. A. Roche, G. Malandain, N. Ayache, Unifying maximum likelihood approaches in medical image registration, Technical Report 3741, Inst. National de Recherche en Informatique et en Automatique, Sophia Antipolis, July 1999.
32. D.E. Goldberg Genetic Algorithms in Search, Optimization, and Machine Learning 1989 Addison-Wesley Publishing Company Reading, MA
33. M. Wall, GAlib 2.4.5: A C++ Library of Genetic Algorithm Components, Massachusetts Institute of Technology, 1999.
34. W. Gropp, E. Lusk, and A. Skjellum Using MPI Portable Parallel Programming with the Message-Passing Interface second ed. 1999 MIT Press Cambridge, MA
35. MPI Forum, A Message-Passing Interface Standard, University of Tennessee, 1999.
36. J. West, J.M. Fitzpatrick, M.Y. Wang, B.M. Dawant, C.R. Maurer Jr., R.M. Kessler, R.J. Maciunas, Ch. Barillot, D. Lemoine, A. Collignon, F. Maes, P. Suetens, D. Vandermeulen, P.A. van den Elsen, S. Napel, T.S. Sumanaweera, B. Harkness, P.F. Hemler, D.L.G. Hill, D.J. Hawkes, C. Studholme, J.B.A. Maintz, M.A. Viergever, G. Malandain, X. Pennec, M.E. Noz, G.Q. Maguire Jr., M. Pollack, Ch.A. Pelizzari, R.A. Robb, D. Hanson, and R.P. Woods Comparison and evaluation of retrospective intermodality brain image registration techniques J. Comput. Assisted Tomogr. 21 1997 554 566
37. D.L. Collins, A.P. Zijdenbos, V. Kollokian, J.G. Sled, N.J. Kabani, C.J. Holmes, and A.C. Evans Design and construction of a realistic digital brain phantom IEEE Trans. Med. Imaging 17 3 1998 463 468
38. R.K.-S. Kwan, A.C. Evans, and G.B. Pike MRI simulation-based evaluation of image-processing and classification methods IEEE Trans. Med. Imaging 18 11 1999 1085 1097
39. P. Viola, W.M. Wells III, Alignment by maximization of mutual information, in: Fifth International Conference on Computer Vision, 1995, pp. 16-23.
40. T. Butz, and J.-Ph. Thiran Affine registration with feature space mutual information Medical Image Computing and Computer-Assisted Intervention 2001 Utrecht The Netherlands 549 556
41. G. Gerig, O. Kübler, R. Kikinis, and F.A. Jolesz Nonlinear anisotropic filtering of MRI data IEEE Trans. Med. Imaging 11 2 1992 221 232
42. E. Solanas, and J.-Ph. Thiran Exploiting voxel correlation for automated MRI bias field Medical Image Computing and Computer-Assisted Intervention 2001 Utrecht The Netherlands 1220 1221
43. B. Likar, M.A. Viergever, F. Pernus, Retrospective correction of MR intensity inhomogeneity by information minimization, in: Medical Image Computing and Computer-Assisted Intervention, Pittsburgh, PA, 2000, pp. 375-384.
44. J.W. Fisher III, T. Darrell, W.T. Freeman, and P. Viola Learning joint statistical models for audio-visual fusion and segregation Advances in Neural Information Processing Systems November 2000 Denver USA
45. T. Butz, J.-Ph. Thiran, Feature space mutual information in video-speech sequences, in: IEEE International Conference on Multimedia and Expo, Lausanne, Switzerland, August 2002, vol. II, pp. 361-364.