Distributions of the Kullback-Leibler divergence with applications

British Journal of Mathematical and Statistical Psychology

Volumn 64, Issue 2, 2011, Pages 291-309

  Belov, Dmitry I ^a   Armstrong, Ronald D ^b  

^a Law School Admission Council   (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BAYES THEOREM; CHI SQUARE DISTRIBUTION; EDUCATION; GENETIC ASSOCIATION; HUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; POISSON DISTRIBUTION; PSYCHOLOGIC TEST; SAMPLE SIZE; STATISTICS; SYSTEM ANALYSIS;

BAYES THEOREM; CHI-SQUARE DISTRIBUTION; EDUCATIONAL MEASUREMENT; GENETIC ASSOCIATION STUDIES; HUMANS; MAGNETIC RESONANCE IMAGING; POISSON DISTRIBUTION; PROBABILITY THEORY; PSYCHOLOGICAL TESTS; SAMPLE SIZE; STOCHASTIC PROCESSES;

EID: 79954619285     PISSN: 00071102     EISSN: 20448317     Source Type: Journal    
DOI: 10.1348/000711010X522227     Document Type: Article

References (36)

1. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716-723. doi.
2. Arizono, I., & Ohta, H. (1989). A test for normality based on Kullback-Leibler information. American Statistician, 43, 20-22. doi.
3. Belov, D. I., & Armstrong, R. D. (2009). Automatic detection of answer copying via Kullback-Leibler divergence and K-index. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA
4. Belov, D. I., Pashley, P. J., Lewis, C., & Armstrong, R. D. (2007). Detecting aberrant responses with Kullback-Leibler distance. In K. Shigemasu, A. Okada, T. Imaizumi, & T. Hoshino (Eds.), New trends in psychometrics (pp. 7-14). Tokyo Universal Academy Press.
5. Bradlow, E. T., & Zaslavsky, A. M. (1997). Case influence analysis in Bayesian inference. Journal of Computational and Graphical Statistics, 6, 314-331. doi.
6. Burnham, K. P., & Anderson, D. R. (2004). Understanding AIC and BIC in model selection. Sociological Methods and Research, 33, 261-304. doi.
7. Cabella, B. C. T., Sturzbecher, M. J., Tedeschi, W., Filho, O. B., de Araujo, D. B., & Neves, U. P. C. (2008). A numerical study of the Kullback-Leibler distance in functional magnetic resonance imaging. Brazilian Journal of Physics, 38, 20-25. doi.
8. Chang, H.-H., & Stout, W. (1993). The asymptotic posterior normality of the latent trait in an IRT model. Psychometrika, 58, 37-52. doi.
9. Chang, H.-H., & Ying, Z. (1996). A global information approach to computerized adaptive testing. Applied Psychological Measurement, 20, 213-229. doi.
10. Clarke, B. (1999). Asymptotic normality of the posterior in relative entropy. IEEE Transactions on Information Theory, 45, 165-176. doi.
11. Cover, T. M., & Thomas, J. A. (1991). Elements of information theory. New York Wiley.
12. Eggen, T. J. H. M. (1999). Item selection in adaptive testing with the sequential probability ratio test. Applied Psychological Measurement, 23, 249-261. doi.
13. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2004). Bayesian data analysis (2nd ed.). Boca Raton, FL Chapman & Hall.
14. Hurvich, C. M., & Tsai, C. L. (1995). Model selection for extended quasi-likelihood models in small samples. Biometrics, 51, 1077-1084. doi.
15. Johnson, N. L., Kotz, S., & Balakrishnan, N. (1995). Continuous univariate distributions (2nd ed., Vol. 2). New York Wiley.
16. Karabatsos, G. (2003). Comparing the aberrant response detection performance of thirty-six person-fit statistics. Applied Measurement in Education, 16, 277-298. doi.
17. Karabatsos, G., & Walker, S. G. (2009). Coherent psychometric modelling with Bayesian nonparametrics. British Journal of Mathematical and Statistical Psychology, 62, 1-20. doi.
18. Kullback, S., & Leibler, R. A. (1951). On information and sufficiency. Annals of Mathematical Statistics, 22, 79-86. doi.
19. Kupperman, M. (1957). Further applications of information theory to multivariate analysis and statistical inference. PhD dissertation, The George Washington University
20. LeBreton, J. M., Barksdale, C. D., Robin, J., & James, L. R. (2007). Measurement issues associated with conditional reasoning tests: Indirect measurement and test faking. Journal of Applied Psychology, 92, 1-16. doi.
21. Lehmann, E. L. (1986). Testing statistical hypotheses (2nd ed.). New York Wiley.
22. Li, Y., & Wang, L. (2008). Testing for homogeneity in mixture using weighted relative entropy. Communications in Statistics - Simulation and Computation, 37, 1981-1995. doi.
23. Lin, X., Pittman, J., & Clarke, B. (2007). Information conversion, effective samples, and parameter size. IEEE Transactions on Information Theory, 53, 4438-4456. doi.
24. Lindley, D. V. (1956). On a measure of the information provided by an experiment. Annals of Mathematical Statistics, 27, 986-1005. doi.
25. Lord, F. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ Erlbaum.
26. McCulloch, R. E. (1989). Local model influence. Journal of the American Statistical Association, 84, 473-478. doi.
27. Pan, J. X., & Fung, W. K. (2000). Bayesian influence assessment in the growth curve model with unstructured covariance. Annals of the Institute of the Statistical Mathematics, 52, 737-752. doi.
28. Pardo, L. (2006). Statistical inference based on divergence measures. Boca Raton, FL Chapman & Hall/CRC.
29. Schwarz, G. (1978). Estimating dimension of a model. Annals of the Statistics, 6, 461-464. doi.
30. Shannon, C. E. (1948). A mathematical theory of communications. Bell Systems Technical Journal, 27, 379-423 (see also 623-656).
31. Song, K. S. (2002). Goodness-of-fit tests based on Kullback-Leibler discrimination information. IEEE Transactions on Information Theory, 48, 1103-1117. doi.
32. Sugiura, N. (1978). Further analysis of the data by Akaike's information criterion and finite corrections. Communications in Statistics, Theory and Methods, A7, 13-26.
33. van der Linden, W. J. (2009). Conceptual issues in response-time modeling. Journal of Educational Measurement, 46, 247-272. doi.
34. Volkau, I., Bhanu Prakash, K. N., Anand, A., Aziz, A., & Nowinski, W. L. (2006). Extraction of the midsagittal plane from morphological neuroimages using the Kullback-Leibler's measure. Medical Image Analysis, 10, 863-874. doi.
35. Weissman, A. (2007). Mutual information item selection in adaptive classification testing. Educational and Psychological Measurement, 67, 41-58. doi.
36. Xu, X., & Douglas, J. (2006). Computerized adaptive testing under nonparametric IRT models. Psychometrika, 71, 121-137. doi.