Explanatory item response modeling of children's change on a dynamic test of analogical reasoning

Intelligence

Volumn 41, Issue 3, 2013, Pages 157-168

  Stevenson, Claire E ^a   Hickendorff, Marian ^a   Resing, Wilma C M ^a   Heiser, Willem J ^a   de Boeck, Paul A L ^b,c  

^a LEIDEN UNIVERSITY   (Netherlands)

^b OHIO STATE UNIVERSITY   (United States)

^c UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Explanatory item response theory; Figural matrices; Individual change; Training effects

Indexed keywords

EID: 84874783420     PISSN: 01602896     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intell.2013.01.003     Document Type: Article

References (105)

1. Alloway T.P. Automated Working Memory Assessment (AWMA) 2007, Harcourt Assessment, London.
2. Alloway T.P., Gathercole S.E., Willis C., Adams A. A structural analysis of working memory and related cognitive skills in young children. Journal of Experimental Child Psychology 2004, 87:85-106.
3. Baayen R.H., Davidson D.J., Bates D.M. Mixed-effects modeling with crossed random effects in for subjects and items. Journal of Memory and Language 2008, 59(4):390-412.
4. Balboni G., Naglieri J.A., Cubelli R. Concurrent and predictive validity of the Progressive Matrices and the Naglieri Nonverbal Ability Test. Journal of Psychoeducational Assessment 2010, 28(3):222-235.
5. Ball L.J., Hoyle A.M., Towse A.S. The facilitatory effect of negative feedback on the emergence of analogical reasoning abilities. The British Journal of Developmental Psychology 2011, 28(3):583-602.
6. Bates D., Maecheler M. The lme4 Package http://r-forge.r-project.org/projects/lme4/.
7. Beckmann J.F. Superiority: Always and everywhere? On some misconceptions in the validation of dynamic testing. Educational and Child Psychology 2006, 23(3):35-49.
8. Belmont J.M., Butterfield E.C. The instructional approach to developmental cognitive research. Perspectives on the development of memory and cognition 1977, Lawrence Erlbaum Associates, Hillsdale, NJ. R.V. Kail, J.W. Hagen (Eds.).
9. Bosma T., Resing W.C.M. Need for instruction: Dynamic testing in special education. European Journal of Special Needs Education 2012, 27(1):1-19.
10. Bosma T. Dynamic Testing in Practice: Shall I give you a hint? (Doctoral dissertation) 2012, Leiden University, Leiden, The Netherlands.
11. Caffrey E., Fuchs D., Fuchs L.S. The predictive validity of dynamic assessment: A review. Journal of Special Education 2008, 41(4):254-270.
12. Calero M.D., Belen G.M., Robles M.A. Learning potential in high IQ children: The contribution of dynamic assessment to the identification of gifted children. Learning and Individual Differences 2011, 21(2):176-181.
13. Campione J.C., Brown A.L. Linking dynamic assessment with school achievement. Dynamic assessment: An interactional approach to evaluating learning potential 1987, 82-109. Guilford Press, New York. C.S. Lidz (Ed.).
14. Campione J.C., Brown A.L., Ferrara R.A., Jones R.S., Steinberg E. Breakdowns in flexible use of information: Intelligence-related differences in transfer following equivalent learning performance. Intelligence 1985, 9:297-315.
15. Cheshire A., Ball L.J., Lewis C. Self-explanation, feedback and the development of analogical reasoning skill: Microgenetic evidence for a metacognitive processing account. Perspectives on thought and language: Interrelations in development 2005, 435-440. Lawrence Erlbaum Associates, Inc., New Jersey. B.G. Bara, L. Barsalou, M. Bucciarelli (Eds.).
16. Student and educational tracking system, Math for Kindergartner [Leerling- en onderwijsvolgsysteem, Rekenen-Wiskunde, groep 3] 2010, Author, Arnhem, The Netherlands.
17. Cito Student and educational tracking system, Math, First grade [Leerling- en onderwijsvolgsysteem, Rekenen-Wiskunde, groep 3] 2010, Author, Arnhem, The Netherlands.
18. Cito Student and educational tracking system, Math, Second grade [Leerling- en onderwijsvolgsysteem, Rekenen-Wiskunde, groep 3] 2010, Author, Arnhem, The Netherlands.
19. Csapó B. The development of inductive reasoning: Cross-sectional assessments in an educational context. International Journal of Behavioral Development 1997, 20(4):609-626.
20. De Beer M. Development of the Learning Potential Computerized Adaptive Test (LPCAT). South African Journal of Psychology 2005, 35(4):717-747.
21. De Bock D.F. Basic issues in the measurement of change. Advances in psychological and educational measurement 1976, Wiley, New York. D.N.M. de Gruijter, L.J.T. van der Kamp (Eds.).
22. De Boeck P. Random item IRT models. Psychometrika 2008, 73(4):533-559.
23. De Boeck P., Bakker M., Zwitser R., Nivard M., Hofman A., Tuerlinckx F., et al. The estimation of item response models with the lme4 package in R. Journal of Statistical Software 2011, 39(12):1-28.
24. Explanatory item response models: A generalized linear and nonlinear approach 2004, Springer, New York, NY. P. De Boeck, M. Wilson (Eds.).
25. De Boeck P., Wilson M., Acton S.G. A conceptual and psychometric framework for distinguishing categories and dimensions. Psychological Review 2005, 112(1):129-158.
26. De Smedt B., Janssen R., Bouwens K., Verschaffel L., Boets B., Ghesquière P. Working memory and individual differences in math achievement: A longitudinal study from first grade to second grade. Journal of Experimental Child Psychology 2009, 103(2):186-201.
27. Elliott J.G. Dynamic assessment in educational settings: Realising potential. Educational Review 2003, 55(1):15-32.
28. Elliott J.G., Grigorenko E.L., Resing W.C.M. Dynamic assessment: The need for a dynamic approach. International Encyclopaedia of Education 2010, Elsevier, Oxford. 3rd ed. E. Baker, B. McGraw, P. Peterson (Eds.).
29. Embretson S.E. Improving the measurement of spatial aptitude by dynamic testing. Intelligence 1987, 11:333-358.
30. Embretson S.E. A multidimensional latent trait model for measuring learning and change. Psychometrika 1991, 56(3):495-515.
31. Embretson S.E. Implications of a multidimensional latent trait model for measuring change. Best methods for the analysis of change 1991, 184-203. American Psychological Association, Washington, DC. L.M. Collins, J.L. Horn (Eds.).
32. Embretson S.E. Measuring and validating cognitive modifiability as an ability: A study in the spatial domain. Journal of Educational Measurement 1992, 29(1):25-50.
33. Embretson S.E. Multidimensional measurement from dynamic tests: Abstract reasoning under stress. Multivariate Behavioral Research 2000, 35(4):505-542.
34. Embretson S.E., Reise S. Item response theory for psychologists 2000, Erlbaum Publishers, Mahwah, NJ.
35. Engel de Abreu P.M.J., Conway A.R.A., Gathercole S.E. Working memory and fluid intelligence in young children. Intelligence 2010, 38:552-561.
36. Fabio R.A. Dynamic assessment of intelligence is a better reply to adaptive behavior and cognitive plasticity. The Journal of General Psychology 2005, 132(1):41-66.
37. Ferrer E., McArdle J.J. An experimental analysis of dynamic hypotheses about cognitive abilities and achievement from childhood to early adulthood. Developmental Psychology 2004, 40(6):935-952.
38. Fischer G.H. Some probabilistic models for measuring change. Advances in Psychological Measurement 1976, 97-110. D.N.M. de Gruijter, L. van der Kamp (Eds.).
39. Freund P.A., Holling H. How to get really smart: Modeling retest and training effects in ability testing using computer-generated figural matrix items. Intelligence 2011, 39:233-243.
40. Freund P.A., Holling H. Retest effects in matrix test performance: Differential impact of predictors at different hierarchy levels in an educational setting. Learning and Individual Differences 2011, 21(5):597-601.
41. Fry A.F., Hale S. Processing speed, working memory and fluid intelligence: Evidence for a developmental cascade. Psychological Science 1996, 7(4):237-241.
42. Fuchs L.S., Compton D.L., Fuchs D., Hollenbeck K.N., Craddock C.F., Hamlett C.L. Dynamic assessment of algebraic learning in predicting third graders' development of mathematical problem solving. Journal of Educational Psychology 2008, 100(4):829-850.
43. Goswami U. Analogical reasoning in children 1992, Lawrence Erlbaum Associates, Hove, UK.
44. Grigorenko E.L. Dynamic testing and response to intervention: Two sides of one coin. Journal of Learning Disabilities 2009, 42(2):111-132.
45. Grigorenko E.L., Sternberg R.J. Dynamic testing. Psychological Bulletin 1998, 124(1):75-111.
46. Guthke J. The learning test concept - An alternative to the traditional static intelligence test. German Journal of Psychology 1982, 6:306-324.
47. Harpaz-Itay Y., Kaniel S., Ben-Amram E. Analogy construction versus analogy solution, and their influence on transfer. Journal of Learning and Instruction 2006, 16:583-591.
48. Hattie J., Biggs J., Purdie N. Effects of learning skills interventions on student learning: A meta-analysis. Review of Educational Research 1996, 66:99-136.
49. Haywood H.C., Lidz C.S. Dynamic assessment in practice. Clinical and educational applications 2007, Cambridge University Press, New York.
50. Hessels M.G.P. Estimation of the predictive value of the HART by means of a dynamic test of geography. Journal of Cognitive Education and Psychology 2009, 8(1):5-21.
51. Hessels, M. G. P., & Bosson, M. O. (2003). Hessels Analogical Reasoning Test (HART): Instruction manual (unpublished). University of Geneva, Faculty of Psychology and Educational Sciences.
52. Hickendorff M., Heiser W.J., Van Putten C.M., Verhelst N.D. Solution strategies and achievement in Dutch complex arithmetic: Latent variable modeling of change. Psychometrika 2008, 74(2):331-350.
53. Hickendorff M., Van Putten C.M., Verhelst N.D., Heiser W.J. Individual differences in strategy use on division problems: Mental versus written computation. Journal of Educational Psychology 2010, 102(2):438-452.
54. Hornung C., Brunner M., Ruetuer R.A.P., Romain M. Children's working memory: Its structure and relationship to fluid intelligence. Intelligence 2011, 39:210-221.
55. Hosenfeld B., Van den Boom D.C., Resing W.C.M. Constructing geometric analogies for the longitudinal testing of elementary school children. Journal of Educational Measurement 1997, 34:367-372.
56. Jaeggi S.M., Buschkuehl M., Jonides J., Perrig W.J. Improving fluid intelligence with training on working memory. Proceedings of National Academy of Science 2008, 105(19):6829-6833.
57. Janssen R., De Boeck P., Viane M., Vallaeys L. Simple mental addition in children with and without mild mental retardation. Journal of Experimental Child Psychology 1999, 74:261-281.
58. Janssen R., Schepers J., Peres D. Models with item group parameters. Explanatory item response models: A generalized linear and nonlinear approach 2004, 189-212. Springer, New York. P. De Boeck, M. Wilson (Eds.).
59. Jarosz A.F., Wiley J. Why does working memory capacity predict RAPM performance? A possible role of distraction. Intelligence 2012, 40(5):427-438.
60. Jeltova I., Birney D., Fredine N., Jarvin L., Sternberg R.J., Grigorenko E.L. Dynamic assessment as process-oriented assessment in educational settings. International Journal of Speech-Language Pathology 2007, 9(4):273-285.
61. Jeltova I., Birney D., Fredine N., Jarvin L., Sternberg R.J., Grigorenko E.L. Making instruction and assessment responsive to diverse students' progress: Group-administered dynamic assessment in teaching mathematics. Journal of Learning Disabilities 2011, 44(4):381-395.
62. Kail R.V. Longitudinal evidence that increases in processing speed and working memory enhance children's reasoning. Psychological Science 2007, 18(4):312-313.
63. Lidz C.S. Historical perspectives. An interactional approach to evaluating learning potential 1987, The Guilford Press, New York. C.S. Lidz (Ed.).
64. Lievens F., Reeve C.L., Heggestad E.D. An examination of psychometric bias due to retesting on cognitive ability tests in selection settings. The Journal of Applied Psychology 2007, 92:1672-1682.
65. Lord F.M. Elementary models for measuring change. Problems in measuring change 1963, University of Wisconsin Press, Madison. C.W. Harris (Ed.).
66. Luwel K., Foustana A., Papadatos Y., Verschaffel L. The role of intelligence and feedback in children's strategy competence. Journal of Experimental Child Psychology 2010, 108:61-76.
67. Mackey A.P., Hill S.S., Stone S.I., Bunge S.A. Differential effects of reasoning and speed training in children. Developmental Science 2010, 14(3):582-590.
68. Meredith W. Measurement invariance, factor analysis and factorial invariance. Psychometrika 1993, 4:525-543.
69. Millsap R. Testing measurement invariance using item response theory in longitudinal data: An introduction. Child Development Perspectives 2010, 4:5-9.
70. Mulholland T.M., Pellegrino J.W., Glaser R. Components of geometric analogy solution. Cognitive Psychology 1980, 12:252-284.
71. Neisser U., Boodoo G., Bouchard T.J., Boykin A.W., Brody N., Halpern D.F., et al. Intelligence: Knowns and unknowns. The American Psychologist 1996, 51(2):77-101.
72. Primi R., Eugénia Ferrão E., Almeida L.S. Fluid intelligence as a predictor of learning: A longitudinal multilevel approach applied to math. Learning and Individual Differences 2010, 20:445-451.
73. Rasch G. On general laws and the meaning of measurement in psychology. Proceedings of the Fourth Berkeley Symposium on Mathematics, Statistics and Probability 1961, 4:321-333.
74. Raven J., Raven J.C., Court J.H. Manual for Raven's progressive matrices and vocabulary scales 2004, Harcourt Assessment, San Antonio, Texas.
75. Resing W.C.M. Learning potential assessment: The alternative for measuring intelligence?. Educational and Child Psychology 1997, 14:68-82.
76. Resing W.C.M., Elliott J.G. Dynamic testing with tangible electronics: Measuring children's change in strategy use with a series completion task. The British Journal of Educational Psychology 2011, 81(4):579-605.
77. Resing W.C.M., Elliott J.G., Grigorenko E.L. Dynamic testing & assessment. Encyclopedia of the Sciences of Learning 2011, Springer Verlag.
78. Resing W.C.M., Steijn W.M.P., Xenidou-Dervou I., Stevenson C.E., Elliott J.G. Computerized dynamic testing: A study of the potential of an approach using sensor technology. Journal of Cognitive Education and Psychology 2011, 10(2):178-194.
79. Resing W.C.M., Tunteler E., De Jong F.M., Bosma T. Dynamic testing in indigenous and ethnic minority children. Learning and Individual Differences 2009, 19(4):445-450.
80. Richland L.E., Morrison R.G., Holyoak K.J. Children's development of analogical reasoning: Insights from scene analogy. Journal of Experimental Child Psychology 2006, 94:249-273.
81. Rijmen F., De Boeck P.A.L. Propositional reasoning: the differential contribution of "rules" to the difficulty of complex reasoning problems. Memory & Cognition 2001, 29(1):165-175.
82. Rizopoulos D. ltm: An R package for Latent Variable Modeling and Item Response Analysis. Journal of Statistical Software 2006, 17(5):1-25.
83. Siegler R.S., Booth J.L. Developmental and individual differences in pure numerical estimation. Developmental Psychology 2006, 42(1):189-201.
84. Siegler R.S., Svetina M. A microgenetic/cross-sectional study of matrix completion: comparing short-term and long-term change. Child Development 2002, 73(3):793-809.
85. Sternberg R.J., Grigorenko E.L. Dynamic Testing 2002, Cambridge University Press, New York, United States of America.
86. Sternberg R.J., Grigorenko E.L., Birney D.P., Fredine N., Jarvin L., Jeltova I. Dynamic instruction for and assessment of developing expertise in four ethnic groups. Research Monograph of the National Research Center on the Gifted and Talented 2007, University of Connecticut. E.J. Gubbins (Ed.).
87. Sternberg R.J., Grigorenko E.L., Bundy D.A. The predictive value of IQ. Merrill-Palmer Quarterly 2001, 47(1):1-41.
88. The Cambridge handbook of Intelligence 2011, Cambridge University Press, New York, New York. R.J. Sternberg, S.B. Kaufmann (Eds.).
89. Sternberg R.J., Rifkin B. The development of analogical reasoning processes. Journal of Experimental Child Psychology 1979, 27:195-232.
90. Stevenson, C. E., Heiser, W. J., & Resing W.C.M. (in press). Working memory as a moderator of training and transfer of analogical reasoning in children. Contemporary Educational Psychology.
91. Stevenson C.E. Puzzzling with potential: Dynamic testing of analogical reasoning in children.(Doctoral dissertation) 2012, Leiden University, Leiden, The Netherlands, isbn: 978-94-6191-395-1.
92. Stevenson C.E., Resing W.C.M., Froma M.N. Analogical reasoning skill acquisition with self-explanation in 7-8year olds: Does feedback help?. Educational & Child Psychology 2009, 26(3):6-17.
93. Stevenson C.E., Touw K.W.J., Resing W.C.M. Computer or paper analogy puzzles: Does assessment mode influence young children's strategy development?. Educational & Child Psychology 2011, 28(2):67-84.
94. Swanson H.L. Working memory and intelligence in children: What develops?. Journal of Educational Psychology 2008, 100:581-602.
95. Swanson H.L. Does the dynamic testing of working memory predict growth in non-word fluency and vocabulary in children with reading disabilities?. Journal of Cognitive Education and Psychology 2011, 9(2):139-165.
96. Swanson H.L., Lussier C.M. A selective synthesis of the experimental literature on dynamic assessment. Review of Educational Research 2001, 71(2):321-363.
97. Taub G.E., Floyd R.G., Keith T.Z., McGrew T.Z. Effects of general and broad cognitive abilities on mathematics achievement. School Psychology Quarterly 2008, 23:187-198.
98. Thorell L.B., Lindqvist S., Bergman Nutley S., Bohlin G., Klingberg T. Training and transfer effects of executive functions in preschool children. Developmental Science 2009, 12(1):106-113.
99. Tillman C.M., Nyberg L., Bohlin G. Working memory components and intelligence in children. Intelligence 2008, 36:394-402.
100. Tunteler E., Pronk C.M.E., Resing W.C.M. Inter- and intra-individual variability in the process of change in the use of analogical strategies to solve geometric tasks in children: A microgenetic analysis. Learning and Individual Differences 2008, 18(1):44-60.
101. Tunteler E., Resing W.C.M. Effects of prior assistance on young children's unprompted analogical problem solving over time: A microgenetic study. The British Journal of Educational Psychology 2007, 77(1):43-68.
102. Tunteler E., Resing W.C.M. Change in spontaneous analogical transfer in young children: A microgenetic study. Infant and Child Development 2007, 16(1):71-94.
103. Tunteler E., Resing W.C.M. The effects of self- and other-scaffolding on progression and variation in children's geometric analogy performance: A microgenetic research. Journal of Cognitive Education and Psychology 2010, 9(3):251-272.
104. Tzuriel D., Egozi G. Gender differences in spatial ability of young children: The effects of training and processing strategies. Child Development 2010, 81(5):1417-1430.
105. Von Davier M., Xu X., Carstensen C.H. Measuring growth in a longitudinal large-scale assessment with a general latent variable model. Psychometrika 2011, 76(2):318-336.