An Introduction to Network Psychometrics: Relating Ising Network Models to Item Response Theory Models

Multivariate Behavioral Research

Volumn 53, Issue 1, 2018, Pages 15-35

  Marsman, M ^a   Borsboom, D ^a   Kruis, J ^a   Epskamp, S ^a   van Bork, R ^a   Waldorp, L J ^a   Maas, H L J van der ^a   Maris, G ^a,b  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b Cito group   (Netherlands)

Author keywords

latent variable model; network model; Psychometrics; Rasch model

Indexed keywords

PROBABILITY; PSYCHOMETRY; RASCH ANALYSIS; THEORETICAL STUDY; ALGORITHM; DEPRESSION; HUMAN; PSYCHOLOGY; THEORETICAL MODEL;

ALGORITHMS; DEPRESSION; HUMANS; MODELS, THEORETICAL; PSYCHOMETRICS;

EID: 85033402904     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1080/00273171.2017.1379379     Document Type: Article

References (113)

1. Adams, R., Wilson, M., & Wu, M., (1997). Multilevel item response models: An approach to errors in variables regression. Journal of Educational and Behavioral Statistics, 22(1), 47–76. doi: 10.3102/10769986022001047
2. Anderson, C., Li, Z., & Vermunt, J., (2007). Estimation of models in a Rasch family of polytomous items and multiple latent variables. Journal of Statistical Software, 20(6), 1–36. doi: 10.18637/jss.v020.i06
3. Anderson, C., & Vermunt, J., (2000). Log-multiplicative association models as latent variable models for nominal and/or ordinal data. Sociological Methodology, 30(1), 81–121. doi: 10.1111/0081-1750.00076
4. Anderson, C., & Yu, H., (2007). Log-multiplicative association models as item response models. Psychometrika, 72(1), 5–23. doi: 10.1007/s11336-005-1419-2
5. Ashkin, J., & Teller, E., (1943). Statistics of two-dimensional lattices with four components. Physical Review, 64(5–6), 178–184. doi: 10.1103/PhysRev.64.178
6. Bartolucci, F., & Pennoni, F., (2007). On the approximation of the quadratic exponential distribution in a latent variable context. Biometrika, 94(3), 745–754. doi: 10.1093/biomet/asm045
7. Bechger, T., & Maris, G., (2015). A statistical test for differential item pair functioning. Psychometrika, 80(2), 317–340. doi: 10.1007/s11336-014-9408-y
8. Berger, V., & Zhou, Y., (2014). Kolmogorov–Smirnov test: Overview. In Wiley statsref: Statistics reference online. New York: John Wiley & Sons, Ltd. doi: 10.1002/9781118445112.stat06558
9. Birnbaum, A., (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M., Lord & M. R., Novick (Eds.), Statistical theories of mental test scores (pp. 395–479). Reading: Addison-Wesley.
10. Blalock, H., (1971). Causal models involving unmeasured variables in stimulus response situations. In H., Blalock (Ed.), Causal models in the social sciences (pp. 335–347). Chicago: Aldine-Atherton.
11. Bock, R., & Aitken, M., (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46(4), 179–197. doi: 10.1007/BF02293801
12. Bollen, K., & Lennox, R., (1991). Conventional wisdom on measurement: A structural equation perspective. Psychological Bulletin, 110(2), 305–314. doi: 10.1037/0033-2909.110.2.305
13. Borsboom, D., (2008). Psychometric perspectives on diagnostic systems. Journal of Clinical Psychology, 64(9), 1089–1108. doi: 10.1002/jclp.20503
14. Borsboom, D., & Cramer, A., (2013). Network analysis: An integrative approach to the structure of psychopathology. Annual Review of Clinical Psychology, 9, 91–121. doi: 10.1146/annurev-clinpsy-050212-185608
15. Borsboom, D., & Molenaar, D., (2015). Psychometrics. In J., Wright (Ed.), International encyclopedia of the social & behavioral sciences (Second ed., Vol. 19, pp. 418–422). Amsterdam: Elsevier.
16. Brennan, R. L., (2001). Generalizability theory. New York: Springer-Verlag.
17. Broadbent, S., & Hammersley, J., (1957). Percolation processes: I. Crystals and mazes. Proceedings of the Cambridge Philosophical Society, 53(3), 629–641. doi: 10.1017/S0305004100032680
18. Brout, R., (1968). Phase transitions. In M., Chrétien, E., Gross, & S., Deser (Eds.), Statistical physics: Phase transitions and superfluidity, vol. 1, Brandeis university summer institute in theoretical physics (pp. 1–100). New York: Gordon and Breach Science Publishers.
19. Brush, S., (1967). History of the Lenz-Ising model. Reviews of Modern Physics, 39(4), 883–895. doi: 10.1103/RevModPhys.39.883
20. Chang, H.-H., (1996). The asymptotic posterior normality of the latent trait for polytomous IRT models. Psychometrika, 61(3), 445–463. doi: 10.1007/BF02294549
21. Chang, H.-H., & Stout, W., (1993). The asymptotic posterior normality of the latent trait in an IRT model. Psychometrika, 58(1), 37–52. doi: 10.1007/BF02294469
22. Chen, Y., Li, X., Liu, J., & Ying, Z., (2016). A fused latent and graphical model for multivariate binary data. arXiv preprint arXiv:1606.08925.
23. Cox, D., (1972). The analysis of multivariate binary data. Journal of the Royal Statistical Society. Series C (Applied Statistics), 21(2), 113–120. doi: 10.2307/2346482
24. Cox, D., & Wermuth, N., (2002). On some models for multivariate binary variables parallel in complexity with the multivariate Gaussian distribution. Biometrika, 89(2), 462–469. doi: 10.1093/biomet/89.2.462
25. Cramer, A., Waldorp, L., van der Maas, H., & Borsboom, D., (2010). Comorbidity: A network perspective. Behavioral and Brain Sciences, 33(2–3), 137–150. doi: 10.1017/S0140525X09991567
26. Cressie, N., & Holland, P., (1983). Characterizing the manifest probabilities of latent variable models. Psychometrika, 48(1), 129–141. doi: 10.1007/BF02314681
27. Cronbach, L., Gleser, G., Harinder, N., & Rajaratnam, N., (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: John Wiley & Sons.
28. Cronbach, L., & Meehl, P., (1955). Construct validity on psychological tests. Psychological Bulletin, 52(4), 281–302. doi: 10.1037/h0040957
29. Cronbach, L., Rajaratnam, N., & Gleser, G., (1963). Theory of generalizability: A liberation of reliability theory. British Journal of Mathematical and Statistical Psychology, 16(2), 137–163. doi: 10.1111/j.2044-8317.1963.tb00206.x
30. de Leeuw, J., & Verhelst, N., (1986). Maximum likelihood estimation in generalized Rasch models. Journal of educational statistics, 11(3), 183–196. doi: 10.2307/1165071
31. Eckart, C., & Young, G., (1936). The approximation of one matrix by another of lower rank. Psychometrika, 1(3), 211–218. doi: 10.1007/BF02288367
32. Edwards, J., & Bagozzi, R., (2000). On the nature and direction of relationships between constructs and measures. Psychological Methods, 5(2), 155–174. doi: 10.1037/1082-989X.5.2.155
33. Ellis, J., & Junker, B., (1997). Tail-measurability in monotone latent variable models. Psychometrika, 62(4), 495–523. doi: 10.1007/BF02294640
34. Elwert, F., & Winship, C., (2014). Endogenous selection bias: The problem of conditioning on a collider variable. Annual Review of Sociology, 40, 31–53. doi: 10.1146/annurev-soc-071913-043455
35. Embretson, S., & Reise, S., (2000). Item response theory for psychologists. London: Lawrence Erlbaum Associates.
36. Emch, G., & Knops, H., (1970). Pure thermodynamical phases as extremal KMS states. Journal of Mathematical Physics, 11, 3008–3018. doi: 10.1063/1.1665087
37. Epskamp, S., Maris, G., Waldorp, L., & Borsboom, D., (in press). Network psychometrics. In P., Irwing, D., Hughes, & T., Booth (Eds.), Handbook of psychometrics. New York: Wiley.
38. Epskamp, S., Rhemtulla, M., & Borsboom, D., (2017). Generalized network psychometrics: Combining network and latent variable models. Psychometrika [in press]. doi: 10.1007/s11336-017-9557-x
39. Fierst, J., & Phillips, P., (2015). Modeling the evolution of complex genetic systems: The gene network family tree. Journal of Experimental Zoology Part B: Molecular and Developmental Evolution, 324(1), 1–12. doi: 10.1002/jez.b.22597
40. Fortuin, C., & Kasteleyn, P., (1972). On the random-cluster model: I. Introduction and relation to other models. Physica, 57(4), 536–564. doi: 10.1016/0031-8914(72)90045-6
41. Galam, S., Gefen, Y., & Shapir, Y., (1982). Sociophysics: a new approach of sociological collective behavior. Journal of Mathematical Sociology, 9(1), 1–13. doi: 10.1080/0022250X.1982.9989929
42. Galam, S., & Moscovici, S., (1991). Towards a theory of collective phenomena: Consensus and attitude changes in groups. European Journal of Social Psychology, 21(1), 49–74. doi: 10.1002/ejsp.2420210105
43. Gelfand, A., & Smith, A., (1990). Sampling-based approaches to calculating marginal densities. Journal of the American Statistical Association, 85(410), 398–409. doi: 10.2307/2289776
44. Gelman, A., Meng, X., & Stern, H., (1996). Posterior predictive assessment of model fitness via realized discrepancies. Statistica Sinica, 6(4), 733–760.
45. Geman, S., & Geman, D., (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6(6), 721–741. doi: 10.1109/TPAMI.1984.4767596
46. Glas, C., (1989). Contributions to estimating and testing Rasch models (Unpublished doctoral dissertation). University of Twente, Enschede, Netherlands.
47. Greenland, S., (2003). Quantifying biases in causal models: Classical confounding vs collider-stratification bias. Epidemiology, 14(3), 300–306. doi: 10.1097/01.EDE.0000042804.12056.6C
48. Greenland, S., Pearl, J., & Robins, J., (1999). Causal diagrams for epidemiological research. Epidemiology, 10(1), 37–48.
49. Heckman, J., (1979). Sample selection bias as a specification error. Econometrica, 47(1), 153–161. doi: 10.2307/1912352
50. Hernán, M., Hernández-Diaz, S., & Robins, J., (2004). A structural approach to selection bias. Epidemiology, 15(5), 615–625. doi: 10.1097/01.ede.0000135174.63482.43
51. Hessen, D., (2011). Loglinear representations of multivariate Bernoulli Rasch models. British Journal of Mathematical and Statistical Psychology, 64(2), 337–354. doi: 10.1348/2044-8317.002000
52. Hessen, D., (2012). Fitting and testing conditional multinormal partial credit models. Psychometrika, 77(4), 693–709. doi: 10.1007/s11336-012-9277-1
53. Holland, P., (1990). The Dutch identity: A new tool for the study of item response models. Psychometrika, 55(6), 5–18. doi: 10.1007/BF02294739
54. Hume, D., (1896). A treatise of human nature. Oxford, UK: Clarendon Press.
55. Ising, E., (1925). Beitrag zur theorie des ferromagnetismus. Zeitschrift für Physik, 31(1), 253–258. doi: 10.1007/BF02980577
56. Jeffreys, H., (1961). Theory of probability (third ed.). Oxford, UK: Oxford University Press.
57. Kac, M., (1968). Mathematical mechanisms of phase transitions. In M., Chrétien, E., Gross, & S., Deser (Eds.), Statistical physics: Phase transitions and superfluidity, vol. 1, Brandeis university summer institute in theoretical physics (pp. 241–305). New York: Gordon and Breach Science Publishers.
58. Kamata, A., & Bauer, D., (2008). A note on the relation between factor analytic and item response theory models. Structural Equation Modeling, 15(1), 136–153. doi: 10.1080/10705510701758406
59. Kindermann, R., & Snell, J., (1980). Markov random fields and their applications (Vol. 1). Providence, Rhode Island: American Mathematical Society.
60. Kochmański, M., Paskiewicz, T., & Wolski, S., (2013). Curie-Weiss magnet–a simple model of phase transition. European Journal of Physics, 34(6), 1555–1573.
61. Kruis, J., & Maris, G., (2016). Three representations of the Ising model. Scientific Reports, 6(34175), 1–11. doi: 10.1038/srep34175
62. Lauritzen, S., (1996). Graphical models. Oxford: Oxford University Press.
63. Lauritzen, S., & Wermuth, N., (1989). Graphical models for associations between variables, some of which are qualitative and some quantitative. The Annals of Statistics, 17(1), 31–57. doi: 10.1214/aos/1176347003
64. Lenz, W., (1920). Beiträge zum verständnis der magnetischen eigenschaften in festen körpern. Physikalische Zeitschrift, 21, 613–615.
65. Maris, G., Bechger, T., & San Martin, E., (2015). A Gibbs sampler for the (extended) marginal Rasch model. Psychometrika, 80(4), 859–879. doi: 10.1007/s11336-015-9479-4
66. Markus, K., (2002). Statistical equivalence, semantic equivalence, eliminative induction, and the Raykov-Marcoulides proof of infinite equivalence. Structural Equation Modeling, 9(4), 503–522. doi: 10.1207/S15328007SEM0904_3
67. Markus, K., & Borsboom, D., (2013). Frontiers of test validity theory: Measurement, causation, and meaning. New York, NY: Routledge.
68. Marsman, M., Maris, G., & Bechger, T., (2012). Don’t tie yourself to an onion: Don’t tie yourself to assumptions of normality. In T., Eggen & B., Veldkamp (Eds.), Psychometrics in practice at RCEC (pp. 103–114). Enschede: RCEC.
69. Marsman, M., Maris, G., Bechger, T., & Glas, C., (2015). Bayesian inference for low-rank Ising networks. Scientific Reports, 5(9050), 1–7. doi: 10.1038/srep09050
70. Marsman, M., Maris, G., Bechger, T., & Glas, C., (2016). What can we learn from Plausible Values? Psychometrika, 81(2), 274–289. doi: 10.1007/s11336-016-9497-x
71. Marsman, M., Maris, G., Bechger, T., & Glas, C., (2017). Turning simulation into estimation: Generalized exchange algorithms for exponential family models. PLoS One, 12(1), e0169787. doi: 10.1371/journal.pone.0169787
72. Marsman, M., Waldorp, L., & Maris, G., (2016). A note on large-scale logistic prediction: Using an approximate graphical model to deal with collinearity and missing data. [in press]. doi: 10.1007/s41237-017-0024-x
73. McCullagh, P., (1994). Exponential mixtures and quadratic exponential families. Biometrika, 81(4), 721–729. doi: 10.2307/2337075
74. McDonald, R. P., (2003). Behavior domains in theory and in practice. The Alberta Journal of Educational Research, 49(3), 212–230.
75. Mellenbergh, G., (1994). Generalized item response theory. Psychological Bulletin, 115(2), 300–307. doi: 10.1037/0033-2909.115.2.300
76. Mislevy, R., (1991). Randomization-based inference about latent variables from complex samples. Psychometrika, 56(2), 177–196. doi: 10.1007/BF02294457
77. Mislevy, R., (1993). Should “multiple imputations” be treated as “multiple indicators”? Psychometrika, 58(1), 79–85. doi: 10.1007/BF02294472
78. Mislevy, R., Beaton, A., Kaplan, B., & Sheehan, K., (1992). Estimating population characteristics from sparse matrix samples of item responses. Journal of Educational Measurement, 29(2), 133–161. doi: 10.1111/j.1745-3984.1992.tb00371.x
79. Molenaar, P., (2003). State space techniques in structural equation modeling: Transformation of latent variables in and out of latent variable models. Retrieved from http://hhd.psu.edu/media/dsg/files/StateSpaceTechniques.pdf
80. Murray, I., Ghahramani, Z., & MacKay, D. J. C., (2006). MCMC for doubly-intractable distributions. In Proceedings of the 22nd annual conference in artificial intelligence (pp. 359–366). Arlington, Virginia: AUAI Press.
81. Niss, M., (2005). History of the Lenz–Ising model 1920–1950: From ferromagnetic to cooperative phenomena. Archive for History of Exact Sciences, 59(3), 267–318. doi: 10.1007/s00407-004-0088-3
82. Niss, M., (2009). History of the Lenz–Ising model 1950–1965: From irrelevance to relevance. Archive for History of Exact Sciences, 63(3), 243–287. doi: 10.1007/s00407-008-0039-5
83. Niss, M., (2011). History of the Lenz–Ising model 1965–1971: The role of a simple model in understanding critical phenomena. Archive for History of Exact Sciences, 65(6), 625–658. doi: 10.1007/s00407-011-0086-1
84. Olkin, I., & Tate, R., (1961). Multivariate correlation models with mixed discrete and continuous variables. The Annals of Mathematical Statistics, 32(2), 448–465. doi: 10.1214/aoms/1177705052
85. Pearl, J., (2000). Causality: Models, reasoning and inference. Cambridge: Cambridge University Press.
86. Pearson, K., (1901). On lines and planes of closest fit to systems of points in space. Philosophical Magazine, 2(11), 559–572. doi: 10.1080/14786440109462720
87. Potts, R., (1952). Some generalized order-disorder transformations. Mathematical Proceedings of the Cambridge Philosophical Society, 48(1), 106–109. doi: 10.1017/S0305004100027419
88. Rasch, G., (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: The Danish Institute of Educational Research.
89. Reckase, M., (2009). Multidimensional item response theory. New York: Springer.
90. Reichenbach, H., (1956). The direction of time. Berkeley: University of California Press.
91. Rubin, D., (1984). Bayesianly justifiable and relevant frequency calculations for the applied statistician. The Annals of Statistics, 12(4), 1151–1172. doi: 10.1214/aos/1176346785
92. Rubin, D., (1987). Multiple imputation for nonresponse in surveys. New-York: Wiley.
93. Spearman, C., (1904). “General intelligence,” objectively determined and measured. The American Journal of Psychology, 15(2), 201–292. doi: 10.2307/1412107
94. Stutz, C., & Williams, B., (1999). Ernst Ising (obituary). Physics Today, 52(3), 106–108. doi: 10.1063/1.882538
95. Takane, Y., & de Leeuw, J., (1987). On the relationship between item response theory and factor analysis of discretized variables. Psychometrika, 52(3), 393–408. doi: 10.1007/BF02294363
96. Tate, R., (1954). Correlation between a discrete and a continuous variable. Point-Biserial correlation. The Annals of Mathematical Statistics, 25(3), 603–607. doi: 10.1214/aoms/1177728730
97. Tate, R., (1966). Conditional-normal regression models. Journal of the American Statistical Association, 61(314), 477–489. doi: 10.2307/2282837
98. Thissen, D., & Steinberg, L., (1986). A taxonomy of item response models. Psychometrika, 51(4), 567–577. doi: 10.1007/BF02295596
99. Thomson, G., (1916). A hierarchy without a general factor. British Journal of Psychology, 8(3), 271–281. doi: 10.1111/j.2044-8295.1916.tb00133.x
100. Tierney, L., (1994). Markov chains for exploring posterior distributions. The Annals of Statistics, 22(4), 1701–1762. doi: 10.1214/aos/1176325750
101. Tierney, L., (1998). A note on Metropolis-Hastings kernels for general state spaces. Annals of applied probability, 8(1), 1–9. doi: 10.1214/aoap/1027961031
102. Tjur, T., (1982). A connection between Rasch’s item analysis model and a multiplicative Poisson model. Scandinavian Journal of Statistics, 9(1), 23–30.
103. Tuerlinckx, F., & de Boeck, P., (2005). Two interpretations of the discrimination parameter. Psychometrika, 70(4), 629–650. doi: 10.1007/s11336-000-0810-3
104. van der Linden, W., & Hambleton, R., (1997). Handbook of modern item response theory. New-York: Springer-Verlag.
105. van der Maas, H., Dolan, C., Grasman, R., Wicherts, J., Huizenga, H., & Raijmakers, M., (2006). A dynamical model of general intelligence: The positive manifold of intelligence by mutualism. Psychological Review, 113(4), 842–861. doi: 10.1037/0033-295X.113.4.842
106. van der Maas, H., Kan, K., Marsman, M., & Stevenson, C., (2017). Network models for cognitive development and intelligence. Journal of Intelligence, 5(2), 1–17. doi: 10.3390/jintelligence5020016
107. van der Maas, H., Molenaar, D., Maris, G., Kievit, R., & Borsboom, D., (2011). Cognitive psychology meets psychometric theory: On the relation between process models for decision making and latent variable models for individual differences. Psychological Review, 118(2), 339–356. doi: 10.1037/a0022749
108. Waller, N., & Reise, S. P., (2010). Measuring psychopathology with non-standard IRT models: Fitting the four-parameter model to the MMPI. In S., Embretson (Ed.), Measuring psychological constructs with model-based approaches (pp. 147–173). Washington, DC: American Psychological Association Books.
109. Wickens, T., (1989). Multiway contingency tables analysis for the social sciences. Hillsdale, NJ: Lawrence Earlbaum.
110. Woodward, J., (2003). Making things happen: A theory of causal explanation. Oxford, UK: Oxford University Press.
111. Zermelo, E., (1929). Die berechnung der turnier-ergebnisse als ein maximumproblem der wahrscheinlichkeitsrechnung. Mathematische Zeitschrift, 29(1), 436–460. doi: 10.1007/BF01180541
112. Zermelo, E., (2001). The evaluation of tournament results as a maximization problem in probability theory. In H., David & A., Edwards (Eds.), Annotated readings in the history of statistics (pp. 167–186). New York: Springer.
113. Zhang, J., & Stout, W., (1997). On Holland’s Dutch Identity conjecture. Psychometrika, 62(3), 375–392. doi:10.1007/BF02294557