Information utility: Quantifying the total psychometric information provided by a measure

Psychological Methods

Volumn 18, Issue 1, 2013, Pages 15-35

  Markon, Kristian E ^a  

^a E11 SSH   (United States)

Author keywords

Computerized adaptive testing; Information; Reference prior; Reliability

Indexed keywords

ARTICLE; HUMAN; METHODOLOGY; PSYCHOMETRY; REPRODUCIBILITY; STANDARD; STATISTICAL ANALYSIS; STATISTICAL MODEL;

DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS;

EID: 84879203909     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0030638     Document Type: Article

References (60)

1. Balasubramanian, V. (1997). Statistical inference, Occam's Razor, and statistical mechanics on the space of probability distributions. Neural Computation, 9, 349-368. doi:10.1162/neco.1997.9.2.349
2. Barron, A., Rissanen, J., &, Yu, B. (1998). The minimum description length principle in coding and modeling. IEEE Transactions on Information Theory, 44, 2743-2760. doi:10.1109/18.720554
3. Berger, J. O., Bernardo, J. M., & Sun, D. (2009). The formal definition of reference priors. Annals of Statistics, 37, 905-938. doi:10.1214/07-AOS587
4. Bernardo, J. M. (1979a). Expected information as expected utility. Annals of Statistics, 7, 686-690. doi:10.1214/aos/1176344689
5. Bernardo, J. M. (1979b). Reference posterior distributions for Bayesian inference. Journal of the Royal Statistical Society: Series B, 41, 113-147.
6. Bernardo, J. M., & Smith, A. F. M. (2000). Bayesian theory. Chichester, England: Wiley.
7. Carver, R. P. (1974). Two dimensions of tests: Psychometric and edumetric. American Psychologist, 29, 512-518. doi:10.1037/h0036782
8. Chang, H. (1996). The asymptotic posterior normality of the latent trait for polytomous IRT models. Psychometrika, 61, 445-463. doi:10.1007/BF02294549
9. Chang, H., & Stout, W. (1993). The asymptotic posterior normality of the latent trait in an IRT model. Psychometrika, 58, 37-52. doi:10.1007/BF02294469
10. Chang, H., & Ying, Z. (1996). A global information approach to computerized adaptive testing. Applied Psychological Measurement, 20, 213-229. doi:10.1177/014662169602000303
11. Clark, L. A., Simms, L. J., Wu, K. D., & Casillas, A. (in press). Schedule for Nonadaptive and Adaptive Personality-Second Edition (SNAP-2). Minneapolis, MN: University of Minnesota Press.
12. Clarke, B., & Barron, A. R. (1990). Information-theoretic asymptotics of Bayes methods. IEEE Transactions on Information Theory, 36, 453-471. doi:10.1109/18.54897
13. Clarke, B., & Barron, A. R. (1994). Jeffreys' prior is asymptotically least favorable under entropy risk. Journal of Statistical Planning and Inference, 41, 37-60. doi:10.1016/0378-3758(94)90153-8
14. Cover, T. M., & Thomas, J. A. (1991). Elements of information theory. doi:10. 1002/0471200611
15. Davisson, L. D., & Leon-Garcia, A. (1980). A source matching approach to finding minimax codes. IEEE Transactions on Information Theory, 26, 166-174. doi:10.1109/TIT.1980.1056167
16. Dawes, R. M. (1962). A note on base rates and psychometric efficiency. Journal of Consulting Psychology, 26, 422-424. doi:10.1037/h0044612
17. Drmota, M., & Szpankowski, W. (2004). Precise minimax redundancy and regret. IEEE Transactions on Information Theory, 50, 2686-2707. doi: 10.1109/TIT.2004.836702
18. Feder, M., & Merhav, N. (1996). Hierarchical universal coding. IEEE Transactions on Information Theory, 42, 1354-1364. doi:10.1109/18.532877
19. Fergusson, D. M., Horwood, L. J., & Boden, J. M. (2006). Structure of internalising symptoms in early adulthood. The British Journal of Psychiatry, 189, 540-546. doi:10.1192/bjp.bp.106.022384
20. Gallager, R. (1979). Source coding with side information and universal coding (Technical Report LIDS-P-937). Cambridge, MA: Laboratory for Information and Decision Systems, MIT. Retrieved from http://web.mit.edu/gallager/www/papers/paper5.pdf
21. Ghosal, S., Ghosh, J. K., & Ramamoorthi, R. V. (1997). Non-informative priors via sieves and packing numbers. In S. Panchapakesan & N. Balakrishnan (Eds.), Advances in statistical decision theory and applications (pp. 119-132). doi:10.1007/978-1-4612-2308-5_8
22. Ghosh, M., Mergel, V., & Liu, R. (2011). A general divergence criterion for prior selection. Annals of the Institute of Statistical Mathematics, 63, 43-58. doi:10.1007/s10463-009-0226-4
23. Good, I. J. (1968, September 28). Utility of a distribution. Nature, 219, 1392. doi:10.1038/2191392a0
24. Grunwald, P. D. (2007). The minimum description length principle. Cambridge, MA: MIT Press.
25. Haussler, D., & Opper, M. (1997). Mutual information, metric entropy and cumulative relative entropy risk. Annals of Statistics, 25, 2451-2492. doi:10.1214/aos/1030741081
26. Hoijtink, H., & Boomsma, A. (1996). Statistical inference based on latent ability estimates. Psychometrika, 61, 313-330. doi:10.1007/BF02294342
27. Jeffreys, H. (1946). An invariant form for the prior probability in estimation problems. Proceedings of the Royal Society A: Mathematical, Physical, & Engineering Sciences, 186, 453-461. doi:10.1098/rspa.1946.0056
28. Kang, S. S., & MacDonald, A. W. (2010). Limitations of true score variance to measure discriminating power: Psychometric simulation study. Journal of Abnormal Psychology, 119, 300-306. doi:10.1037/a0018400
29. Kendler, K. S., Neale, M. C., Kessler, R. C., Heath, A. C., & Eaves, L. J. (1992). Major depression and generalized anxiety disorder: Same genes, (partly) different environments? Archives of General Psychiatry, 49, 716-722. doi:10.1001/archpsyc.1992.01820090044008
30. Lindley, D. V. (1956). On a measure of information provided by an experiment. Annals of Mathematical Statistics, 27, 986-1005. doi: 10.1214/aoms/1177728069
31. Livesley, W. J., & Jackson, D. (2009). Manual for the Dimensional Assessment of Personality Pathology-Basic Questionnaire. Port Huron, MI: Sigma Press.
32. Magis, D., & Raiche, G. (2012). On the relationships between Jeffreys modal and weighted likelihood estimation of ability under logistic IRT models. Psychometrika, 77, 163-169.
33. Markon, K. E., Krueger, R. F., & Watson, D. (2005). Delineating the structure of normal and abnormal personality: An integrative hierarchical approach. Journal of Personality and Social Psychology, 88, 139-157. doi:10.1037/0022-3514.88.1.139
34. Matarazzo, J. D. (1990). Psychological assessment versus psychological testing: Validation from Binet to the school, clinic, and courtroom. American Psychologist, 45, 999-1017. doi:10.1037/0003-066X.45.9.999
35. Meehl, P. E., & Rosen, A. (1955). Antecedent probability and the efficiency of psychometric signs, patterns, or cutting scores. Psychological Bulletin, 52, 194-216. doi:10.1037/h0048070
36. Mellenbergh, G. J. (1994). Generalized linear item response theory. Psychological Bulletin, 115, 300-307. doi:10.1037/0033-2909.115.2.300
37. Mellenbergh, G. J. (1996). Measurement precision in test score and item response models. Psychological Methods, 1, 293-299. doi:10.1037/1082-989X.1.3.293
38. Merhav, N., & Feder, M. (1995). A strong version of the redundancycapacity theorem of universal coding. IEEE Transactions on Information Theory, 41, 714-722. doi:10.1109/18.382017
39. Moustaki, I., & Knott, M. (2000). Generalized latent trait models. Psychometrika, 65, 391-411. doi:10.1007/BF02296153
40. Mulder, J., & van der Linden, W. J. (2010). Multidimensional adaptive testing with Kullback-Leibler information item selection. In W. J. van der Linden & C. A.W. Glas (Eds.), Elements of adaptive testing (pp. 77-101). New York, NY: Springer.
41. Myung, I., Balasubramanian, V., & Pitt, M. (2000). Counting probability distributions: Differential geometry and model selection. Proceedings of the National Academy of Sciences, USA, 97, 11170-11175.
42. Qian, G., & Kunsch, H. R. (1998). Some notes on Rissanen's stochastic complexity. IEEE Transactions on Information Theory, 44, 782-786. doi:10.1109/18.661521
43. Razavi, S. A., & Giurcaneanu, C. D. (2009). Optimally distinguishable distributions: A new approach to composite hypothesis testing with applications to the classical linear model. IEEE Transactions on Signal Processing, 57, 2445-2455. doi:10.1109/TSP.2009.2017568
44. Rissanen, J. (1996). Fisher information and stochastic complexity. IEEE Transactions on Information Theory, 42, 40-47. doi:10.1109/18.481776
45. Rissanen, J. (2001). Strong optimality of the normalized ML models as universal codes and information in data. IEEE Transactions on Information Theory, 47, 1712-1717. doi:10.1109/18.930912
46. Rissanen, J. (2006). The structure function and distinguishable models of data. Computer Journal, 49, 657-664. doi:10.1093/comjnl/bxl045
47. Rissanen, J. (2007). Information and complexity in statistical modeling. New York, NY: Springer.
48. Rizopoulos, D. (2006). ltm: An R package for latent variable modeling and item response theory analyses. Journal of Statistical Software, 17, 1-25.
49. Ryabko, B. (1981). Comments on "A source matching approach to finding minimax codes" by Davisson, L. D. and Leon-Garcia, A. IEEE Transactions on Information Theory, 27, 780-781. doi:10.1109/TIT.1981.1056409
50. Samejima, F. (1994). Some critical observations of the test information function as a measure of local accuracy in ability estimation. Psychometrika, 59, 307-329. doi:10.1007/BF02296127
51. Samuel, D. B., Simms, L. J., Clark, L. A., Livesley, W. J., & Widiger, T. A. (2010). An item response theory integration of normal and abnormal personality scales. Personality Disorders: Theory, Research, and Treatment, 1, 5-21. doi:10.1037/a0018136
52. Seeley, J. R., Kosty, D. B., Farmer, R. F., & Lewinsohn, P. M. (2011). The modeling of internalizing disorders on the basis of patterns of lifetime comorbidity: Associations with psychosocial functioning and psychiatric disorders among first-degree relatives. Journal of Abnormal Psychology, 120, 308-321. doi:10.1037/a0022621
53. Simms, L. J., Turkheimer, E., & Clark, L. A. (2007). Novel approaches to the structure of personality disorder. Symposium presented at the 21st Annual Meeting of the Society for Research in Psychopathology, Iowa City, IA. Abstract retrieved from http://www.psychopathology.org/programs.asp?mode=viewslot&id=187
54. Skrondal, A., & Rabe-Hesketh, S. (2004). Generalized latent variable modeling: Multilevel, longitudinal, and structural equation models. Boca Raton, FL: Chapman & Hall/CRC.
55. van der Linden, W. J. (1998). Bayesian item selection criteria for adaptive testing. Psychometrika, 63, 201-216. doi:10.1007/BF02294775
56. van der Vaart, A. W. (1998). Asymptotic statistics. Cambridge, England: Cambridge University Press.
57. Veerkamp, W. J. J., & Berger, M. P. F. (1997). Some new item selection criteria for adaptive testing. Journal of Educational and Behavioral Statistics, 22, 203-226.
58. Wang, C., & Chang, H. (2010, July). Item selection in multidimensional computerized adaptive tests-The new application of KL information. Paper presented at the 75th International Meeting of the Psychometric Society, Athens, GA.
59. Warm, T. A. (1989). Weighted likelihood estimation of ability in item response theory. Psychometrika, 54, 427-450. doi:10.1007/BF02294627
60. Williamson, J. (2010). In defence of objective Bayesianism. New York, NY: Oxford University Press.