Measuring the correlation between variables based on the probability density function estimation

CCIS2011 - Proceedings: 2011 IEEE International Conference on Cloud Computing and Intelligence Systems

Volumn , Issue , 2011, Pages 144-148

  Chen, Sisi ^a  

^a XINGTAI UNIVERSITY   (China)

Author keywords

Continuous value variable; Discretization; Entropy; Mutual information; Nonlinear correlation; Probability density estimation

Indexed keywords

CONTINUOUS-VALUE VARIABLE; DISCRETIZATION; MUTUAL INFORMATION; NONLINEAR CORRELATION; PROBABILITY DENSITY ESTIMATION;

CLOUD COMPUTING; COMPUTER SYSTEMS; ESTIMATION; PROBABILITY;

PROBABILITY DENSITY FUNCTION;

EID: 80055106354     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCIS.2011.6045049     Document Type: Conference Paper

References (27)

1. B. Scholkopf, A. Smola, K.R. Muller. Nonlinear Component Analysis as a Kernel Eigenvalue Problem. Neural Computation, VOL. 10, NO. 5, pp. 1299-1319, 1998. (Pubitemid 128463674)
2. C. Lee, D.A. Landgrebe. Feature Extraction Based on Decision Boundaries. IEEE Transactions Pattern Analysis and Machine Intelligence, VOL. 15, NO. 4, pp. 388-400, 1993.
3. H. Peng, F. Long, C. Ding. Feature Selection Based on Mutual Information: Criteria of Max-Dependency, Max-Relevance, and Min-Redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence, VOL. 27, NO. 8, pp. 1228-1238, 2005.
4. A. Freno. Selecting Features by Learning Markov Blankets. KES/WIRN, LNCS, Springer-Verlag Berlin Heidelberg, VOL. 4692, pp. 69-76, 2007.
5. Nir Friedman, Dan Geiger, Moises Goldszmidt. Bayesian Network Classifiers. Machine Learning, VOL. 29, pp. 131-163, 1997.
6. Yushi Jing, Vladimir Pavlovic, James M. Rehg. Boosted Bayesian network classifiers. Machine Learning, VOL. 73, pp. 155-184, 2008.
7. S. Watanabe. Information theoretical analysis of multivariate correlation. IBM Journal of Research and Development, VOL. 4, pp. 66-82, 1960.
8. Andrew M. Fraser, Harry L. Swinney. Independent coordinates for strange attractors from mutual information. Physical Review A, VOL. 33, NO. 2, pp. 1134-1140, 1986.
9. William M. Wells III, Paul Viola, Hideki Atsumi, Shin Nakajima, Ron Kikinis. Multimodal volume registration by maximization of mutual information. Medical Image Analysis, VOL. 1, NO. 1, pp. 35-51, 1996.
10. Frederik Maes, Andre Collignon, Dirk Vandermeulen, Guy Marchal, Paul Suetens. Multimodality image registration by maximization of mutual information. IEEE Transactions on Medical Imaging, VOL. 16, NO. 2, pp. 187-198, 1997.
11. Kenneth Ward Church, Patrick Hanks. Word association norms, mutual information, and lexicography. Computational Linguistics, VOL. 16, NO. 1, pp. 22-29, 1990.
12. James V. Stone. Independent component analysis: a tutorial introduction. The MIT Press, 2004.
13. M. L. Samuels, J. A. Witmer. Statistics for the Life Sciences, Second Edition. Prentice-Hall, 1999.
14. Hanchuan Peng. Available on the website: http://penglab.janelia.org/proj/ mRMR/.
15. S. G. Ghurye, B. R. Johnson. Discrete Approximations to the Information Integral. The Canadian Journal of Statistics, VOL. 9, NO. 1, pp. 27-37, 1981.
16. Sotiris Kotsiantis, Dimitris Kanellopoulos. Discretization Techniques: A recent survey. GESTS International Transactions on Computer Science and Engineering, VOL. 32, NO. 1, pp. 47-58, 2006.
17. E. Parzen. On Estimation of a Probability Density Function and Mode. Annals of Mathematical Statistics, VOL. 33, NO. 3, pp. 1065-1076, 1962.
18. I. Usta, Y. M. Kantar. On the performance of the flexible maximum entropy distributions within partially adaptive estimation. Computational Statistics & Data Analysis, VOL. 55, NO. 6, pp. 2172-2182, 2011.
19. S. Nadarajah, K. Zografos. Expressions for Rényi and Shannon entropies for bivariate distributions. Information Sciences, VOL. 170, NO. 2-4, pp. 173-189, 2005. (Pubitemid 40183404)
20. Y. M. Wang, G. Baciu. Human motion estimation from monocular image sequence based on cross-entropy regularization. Pattern Recognition Letters, VOL. 24, NO. 1-3, pp. 315-325, 2003. (Pubitemid 36080779)
21. James Dougherty, Ron Kohavi, Mehran Sahami. Supervised and Unsupervised Discretization of Continuous Features. In Proceedings of the Twelfth International Conference on Machine Learning, pp. 194-202, 1995.
22. D. W. Scott. Multivariate Density Estimation: Theory, Practice, and Visualization. John Wiley & Sons, Inc, 1992.
23. M. P. Wand, M. C. Jones. Kernel Smoothing. Chapman and Hall, 1995.
24. M. C. Jones, J. S. Marron, S. J. Sheather. A Brief Survey of Bandwidth Selection for Density Estimation. Journal of the American Statistical Association, VOL. 91, NO. 433, pp. 401-407. 1996.
25. I. Usta, Y. M. Kantar. On the performance of the flexible maximum entropy distributions within partially adaptive estimation, Computational Statistics & Data Analysis, VOL. 55, NO. 6, pp. 2172-2182, 2011.
26. S. Nadarajah, K. Zografos. Expressions for Rényi and Shannon entropies for bivariate distributions, Information Sciences, VOL. 170, NO. 2-4, pp. 173-189, 2005. (Pubitemid 40183404)
27. Y. M. Wang, G. Baciu. Human motion estimation from monocular image sequence based on cross-entropy regularization, Pattern Recognition Letters, VOL. 24, NO. 1-3, pp. 315-325, 2003. (Pubitemid 36080779)