Psychometric technology: Automatic dual-component item generation exemplified using a new item type for the measurement of arithmetic fluency;Psychometrische Technologie Automatische Zwei-Komponenten-Itemgenerierung am Beispiel Eines Neuen Aufgabentyps zur Messung der Numerischen Flexibilität

Diagnostica

Volumn 53, Issue 3, 2007, Pages 119-130

  Arendasy, Martin E ^a   Sommer, Markus ^b   Hergovich, Andreas ^a  

^a UNIVERSITY OF VIENNA   (Austria)

^b SCHUHFRIED GMBH   (Austria)

Author keywords

Automatic item generation; Cognitive flexibility; IRT; Item generator; Mixed Rasch model; Psychometric technology; Quantitative reasoning; Rascn model

Indexed keywords

EID: 38749144391     PISSN: 00121924     EISSN: None     Source Type: Journal    
DOI: 10.1026/0012-1924.53.3.119     Document Type: Article

References (53)

1. Alibali, M. W. (1999). How children change their minds: Strategy change can be gradual or abrupt. Developmental Psychology, 35,127-145.
2. Andersen, E. B. (1973). A goodness of fit test for the Rasch model. Psychometrica, 8,123-140.
3. Arbuckle, J. L. (2003). Amos 5.0 Update to the Amos User's Guide. Smallwaters Corporation, Chicago IL.
4. Arendasy, M. (2002). TestWeb - Ein webbasiertes psychologisches Testsystem. [Online] UrI: http://l 31.130.64.42/diffps-labor/start.aspx (23.2.2003).
5. Arendasy, M. (2004). NGen: Ein Itemgenerator zur Erstellung von Aufgaben zur Messung numerischer Flexibilität. Universität Wien: Wien.
6. C. International Journal of Testing, 5 (3), 197-224.
7. Arendasy, M. (2005 b). Automatisierte Erzeugung psychodiagnostischer Testaufgaben. Patent AT-206202005.
8. Arendasy, M. (2006, in Druck). Automatisierte Itemgenerierung und psychometrische Qualitätssicherung am Beispiel des Matrizentests GEOM. Peter Lang Academic Publishers: Frankfurt am Main, New York.
9. Arendasy, M. & Sommer, M. (2005). The effect of different types of perceptual manipulations on the dimensionality of automatically generated figurai matrices. Intelligence, 33(3), 307-324.
10. Ashcraft, M. H. (1995). Cognitive psychology and simple arithmetic: A review and summary of new directions. Mathematical Cognition, 1, 3-34.
11. Baddeley, A.. D. ( 1992). Is working memory working? Quarterly Journal of Experimental Psychology, 44A (1), 1-31.
12. Baker F. B. (1992). Item response theory parameter estimation techniques. New York: Marcel Dekker.
13. Bejar, 1.1, (2002). Generative Testing: From Conception to Implementation. In S. H. Irvine & P. C. Kyllonen (Eds.), Item Generation for Test Development. New Jersey: Lawrence Erlbaum Associates.
14. Bejar, I. L, Lawless, R. R., Morley, M. E., Wagner, M. E., Bennett, R. E. & Revuelta, J. (2002). A Feasibility Study of OnThe-Fly Item Generation in Adaptive Testing. GRE Board Professional Report No. 98-12P (October 2002). Princeton, NJ: Educational Testing Service.
15. Brittingham, M. E., Singley, M. K., Zelman, M. G., Jha, K. N., Fife, J. H., Rarich, R. L., Katz, I. R. & Bennett, E. B. (2001). The Mathematics Test Creation Assistant. Educational Testing Service, Princeton: NJ.
16. Browne, M. W. & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 445-455). Newbury Park: Sage.
17. Byrne, B. M. (2001). Structural equation modelling with AMOS. Basic concepts, application, and programming. London: Lawrence Erlbaum Associates.
18. Campbell, J. P. & Fiske, D. W. (1959) Convergent and discriminant validation by themultitrait-multimethod matrix, Psychological Bulletin, 36, 81-105.
19. Campbell, J. I. D. & Xu, Q. (2001). Cognitive arithmetics across cultures. Journal of Experimental Psychology, 130 (2), 299-315.
20. Carroll, J. B. (1993). Human cognitive abilities. A survey of factor-analytic studies. Cambridge: Cambridge University Press.
21. De Boeck, P. & Wilson, M. (2004). Explanatory Item Response Models - A Generalized Linear and Nonlinear Approach. Springer: New York.
22. Dehaene, S. (1997). The number sense: How the mind creates mathematics. New York: Oxford University Press.
23. Embretson, S. E. (1983). Construct validity : Construct representation versus nomothetic span. Psychological Bulletin, 93, 179-197.
24. Embretson, S. (2003). Automatic Item Generator. Patent 2003/ 0157469 Al.
25. Fairon, C. & Williamson, D. M. (2002). Automatic Item Text Generation in Educational Assessment. TALN 2002, Nancy, June 24th-27th 2002.
26. Fischer, G. H. ( 1973). The linear logistic test model as an instrument in educational research. Acta Psychologica, 36,207-220.
27. Fischer, G. H. & Ponocny-Seliger, E. (1999). LPCM-Win Software and Manual. Assessment Software Corporation, MN.
28. Greeno, J. G. (1991). Number sense as situated knowing in a conceptual domain. Journal for Research in Mathematics Education, 22, 170-218.
29. Greeno, J. G., Moore, J. L. & Smith, D. R. (1993). Transfer of situated learning. In D. K. Dettermann & R. J. Sternberg (Eds.), Transfer on trial: Intelligence, cognition, and instruction (pp. 99-167). Wetsport, CT, US: Ablex Publishing.
30. Gustafsson, J. E. (1984). A unifying model for the structure of intellectual abilities. Intelligence, 8,179-203
31. Hornke, L. F., Arendasy, M., Sommer, M., Häusler, J., WagnerMenghin, M., Gittler, G., Bognar, B. & Wenzl, M. (2004). Intelligenz-Struktur- Batterie (INSBAT): Eine Testbatterie zur Messung von Intelligenz. Mödling: Dr. Gernot Schuhfried GmbH.
32. Hu, L. T. & Bentler, P. M. (1999). Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternaties. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1-55.
33. Irvine, S. H. (2002). The foundations of Item Generation for Mass Testing. In S. H. Irvine & P. C. Kyllonnen (Eds.), Item Generation for Test Development (pp. 3-34), Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.
34. Irvine, S. H. & Kyllonnen, P. C. (2002). Item Generation for Test Development. Mahwah, NJ: Lawrence Erlbaum Associates, Publishers.
35. Kline, R. B. (1998). Principles and practice of structural equation modeling. New York: Guilford.
36. Kubinger, K. D. (1989). Moderne Testtheorie. Weinheim: Beltz.
37. LeFevre, J., Bisanz, J., Daley, K. E., Buffone, L. & Sadesky, G. S. (1996). Multiple routes to solution of single-digit multiplication problems. Journal of Experimental Psychology: General, 125, 284-306.
38. Lochy, A., Seron, X., Delazer, M. & Butterworth, B. (2000). The odd/even effect in multiplication: Parity rule or familiarity with even numbers? Memory & Cognition, 28, 358-365.
39. Luchins, A. S. & Luchins, E. H. (1959). Rigidity of behavior. Eugene: University of Oregon Books.
40. Martin-Löf, P. (1973). Statistiska Modeller. Anteckningar fran seminarier lasaret 1969-1970 utarbetade av Rolf Sundberg. Obetydligt ändrat nytryck, October 1973 (fotokopiertes Manuskript). Institutet for säkringsmatematik och matematisk statistik vid Stockholms universitet.
41. Marsh, H. W., Hau, K. & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu & Bentler's findings. Structural Equation Modeling, 11, 320-341.
42. Newell, A. (1990). Unified Theories of Cognition. Cambridge, MA: Harvard University Press.
43. Phelps, L., McGrew, K., Knopik, S. & Ford, L. (2005). The general (g), broad, and narrow CHC stratum characteristics of the WJ-III and WISC-III tests: A confirmatory cross-battery investigation. School Psychology Quarterly, 20,5866.
44. Rasch, G. ( 1980). Probabilistic models for some intelligence and attainment tests. Chicago: The University of Chicago Press. (Original erschienen 1960).
45. Rittle-Johnson, B., Siegler, R. S. & Alibali, M. W. (2001). Developing conceptual understanding and procedural skill in mathematics: An iterative process. Journal of Educational Psychology, 93, 346-362.
46. Rost, J. (2004). Lehrbuch Testtheorie Testkonstruktion. Bern: Huber.
47. Siegler, R. S. (1996). Emerging minds: The process of change in children's thinking. New York: Oxford Press.
48. Siegler, R. S. & Stern, E. (1998). Conscious and unconscious strategy discoveries: A microgenetic analysis. Journal of Experimental Psychology: General, 127, 211-391.
49. Stocking, M. L. & Lewis, Ch. (2000). Methods of Controlling the Exposure of Items in CAT. In W. J. Van der Linden & C. A. W. Glas (Eds.), Computerized Adaptive Testing: Theory and Practice. Boston: Kluwer Academic Publishers.
50. Undheim, J. O. & Gustafsson, J. E. (1987). The Hierarchical Organization of Cognitive Abilities: Restoring General Intelligence through the use of Linear Structural Relations (LISREL). Multivariate Behavioral Research, 22, 149-171.
51. Van der Linden, W. J. & Glas, C. A. W. (2000). Computerized Adaptive Testing: Theory and Practice. Boston: Kluwer Academic Publishers.
52. Verhaeghen, P., Kliegl, R. & Mayr, U. (1997). Sequential and coordinative complexity in time-accuracy functions for mental arithmetic. Psychology and Aging, 12, 555-564.
53. nd edition). Computerized Adaptive Testing: A Primer. New Jersey: Lawrence Erlbaum Associates.