Adaptive testing for hierarchical student models

User Modeling and User-Adapted Interaction

Volumn 17, Issue 1-2, 2007, Pages 119-157

  Guzmán, Eduardo ^a   Conejo, Ricardo ^a   Pérez De La Cruz, José Luis ^a  

^a UNIVERSITY OF MÁLAGA   (Spain)

Author keywords

Adaptive testing; Item response theory; ITS; Statistical kernel smoothing; Student diagnosis

Indexed keywords

ALGORITHMS; DATABASE SYSTEMS; KNOWLEDGE REPRESENTATION; MATHEMATICAL MODELS; PROBABILITY DISTRIBUTIONS; STUDENTS; TREES (MATHEMATICS);

ADAPTIVE TESTING; ITEM RESPONSE THEORY; STATISTICAL KERNEL SMOOTHING; STUDENT DIAGNOSIS;

ADAPTIVE SYSTEMS;

EID: 33847330763     PISSN: 09241868     EISSN: 15731391     Source Type: Journal    
DOI: 10.1007/s11257-006-9018-1     Document Type: Article

References (69)

1. Barbero, M.I.: Gestion informatizada de bancos de ítems. In: Olea, J., Ponsoda, V., Prieto, G. (eds.) Tests Informatizados: Fundamentos y aplicaciones, pp. 63-83. Pirámide (1999)
2. Birnbaum, A.: Some latent trait models and their use in inferring an examinee's mental ability'. In: Statistical Theories of Mental Test Scores. Addison-Wesley: Reading, MA (1968)
3. Bock, R.D.: The nominal categories model. In: van der Linden, W.J., Hambleton, R.K., (eds.) Handbook of Modern Item Response Theory, pp. 33-49. Springer Verlag New York (1997)
4. Burton, R.: Diagnosing bugs in a simple procedural skill. In: Sleeman, D., Brown, J. (eds.) Intelligent Tutoring Systems, pp. 57-183. Academic Press (1982)
5. Carver, C. A., Howard, R. A., Lane, W.D.: Enhancing student learning through hypermedia courseware and incorporation of student learning styles. IEEE Trans. Educ. 42(1), 33-38 (1999)
6. Castillo, E., Gutiérrez, J.M., Hadi, A.S.: Expert Systems and Probabilistic Network Models. Monographs in Computer Science. Springer-Verlag (1997)
7. Chickering, D.M., Paek, T.: Personalizing influence diagrams: applying online learning strategies to dialogue management. User Modeling and User-Adapted Interaction (in this issue) (2007)
8. Collins, J.A.: Adaptive testing with granularity. Master's thesis, University of Saskatchewan (1996)
9. Collins, J.A., Greer, J.E., Huang, S.X.: Adaptive assessment using granularity hierarchies and bayesian nets. In: Frasson, C., Gauthier, G., Lesgold, A. (eds.) Proceedings of the 3rd International Conference on Intelligent Tutoring Systems. ITS 1996. Lecture Notes in Computer Science, No. 1086, pp. 569-577. Springer Verlag, New York (1996)
10. Conati, C.: Probabilistic assessment of user's emotions in educational games. App. Artif. Intell. 16, 555-575 (2002)
11. Conejo, R., Guzmán, E., Millán, E., Trella, M., Pérez de la Cruz, J.L., Ríos, A.: SIETTE: a Web-based tool for adaptive testing. J Artif. Intell. Educ. 14, 29-61 (2004)
12. Desmarais, M.C., Pu, X.: a bayesian inference adaptive testing framework and its comparison with item response theory. Int. J Artif. Intell. Educ. 15, 291-323 (2005)
13. Dodd, B.G., De Ayala, R.J., Koch, W.R.: Computerized adaptive testing with polytomous items. Appl. Psychol. Measure. 19(1), 5-22 (1995)
14. Domshlak, C., Joachmis, T.: Efficient and non-parametric reasoning over user preferences. User Model. User-adap. Interac. (in this issue) (2007)
15. Douglas, J., Cohen, A.: Nonparametric item response function estimation for assessing parametric model fit. Appl. Psychol. Measure. 25(3), 234-243 (2001)
16. Embretson, S.E.: A multidimensional latent trait model for measuring learning and change. Psychometrika 56(3), 495-515 (1991)
17. Embretson, S.E., Reise, S.P.: Item Response Theory for Psychologists. Lawrence Erlbaum, Mahwah, NJ (2000)
18. Gentner, D., Stevens, A.L. (eds.): Mental Models. Lawrence Erlbaum, Hillsdale, NJ (1983)
19. Greer, J.E., McCalla, G.: Granularity-based reasoning and belief revision in student models. In: Greer, J.E., McCalla, G. (eds.) Student Modelling: The Key to Individualized Knowledge-Based Instruction, vol. 125, pp. 39-62. Springer Verlag, New York (1994)
20. Guzmán, E.: Un modelo de evaluacíon cognitiva basado en Tests Adaptativos Informatizados para el diagnóstico en Sistemas Tutores Inteligentes. Unpublished doctoral dissertation, Dpto. Lenguajes y Ciencias de la Computación. E.T.S.I. Informática., Universidad de Malaga (2005)
21. Guzmán, E., Conejo, R. Simultaneous evaluation of multiple topics in SIETTE. In: Cerri, S., Gouardres, G., Paraguacu, F. (eds.) Proceedings of the 6th International Conference on Intelligent Tutoring Systems (ITS 2002). Lecture Notes in Computer Science, No. 2363, pp. 739-748. Springer Verlag, New York (2002)
22. Guzmán, E., Conejo, R.: A library of templates for exercise construction in an adaptive assessment system. Technol. Instruct. Cogn. Learning (TICL) 2(1-2), 21-43 (2004a)
23. Guzmán, E., Conejo, R.: A model for student knowledge diagnosis through adaptive testing. In: Lester, J.C., Vicari, R.M., Paraguau, F. (eds.) Proceedings of the 7th International Conference on Intelligent Tutoring Systems (ITS 2004). Lecture Notes in Computer Science, No. 3220, pp. 12-21. Springer Verlag, New York (2005b)
24. Guzmán, E., Conejo, R.: Self-assessment in a feasible, adaptive web-based testing system. IEEE Trans. Educ. 48(4), 688-695 (2005a)
25. Guzmán, E., Conejo, R.: Towards efficient item calibration in adaptive testing. In: Ardissono, L., Brna, P., Mitrovic, A. (eds.) Proceedings of the 10th International Conference on User Modeling (UM 2005). Lecture Notes in Artificial Intelligence, No. 3538, pp. 414-418. Springer Verlag, New York (2005b)
26. Habing, B.: Nonparametric regression and the parametric bootstrap for local dependence assessment. Appl. Psychol. Measure. 25(3), 221-233 (2001)
27. Härdle, W.: Applied Nonparametric Regression. University Press, Cambridge (1992)
28. Holt, P., Dubs, S., Jones, M., Greer, J.: The state of student modelling. In: Greer, J.E., McCalla, G. (eds.) Student Modelling: The Key to Individualized Knowledge-Based Instruction, vol. 125, pp. 3-35. Springer Verlag, New York (1994)
29. Hontangas, P., Ponsoda, V., Olea, J., Abad, F.: Los test adaptativos informatizados en la frontera del siglo XXI: una revisión. Metodología de las Ciencias del Comportamiento 2(2), 183-216 (2000)
30. Horvitz, E., Paek, T.: Complementary computing: policies for transferring callers from dialog systems to human receptionists. User Model. User-Adapted Interact. (in this issue) (2007)
31. Huang, S.X.: A content-balanced adaptive testing algorithm for computer-based training systems. In: Frasson, C., Gauthier, G., Lesgold, A. (eds.). Lecture Notes in Computer Science 1086. Proceedings of the 3rd International Conference on Intelligent Tutoring Systems. ITS 1996, pp. 306-314. Springer Verlag New York (1996)
32. Junker, B.W., Sijtsma, K.: Nonparametric item response theory in action: an overview of the Special Issue. Appl. Psychol. Measure. 25(3), 211-220 (2001)
33. Kingsbury, G.G., Weiss, D.J.: An adaptive testing strategy for mastery decision. Psychometric Method Program Research Report 79-5, Department of Psychology. University of Minnesota (1979)
34. Lilley, M., Barker, T., Britton, C.: The development and evaluation of a software prototype for computer-adaptive testing. Comp. Educ. 43, 109-123 (2004)
35. Lord, EM.: Applications of item response theory to practical testing problems. Lawrence Erlbaum Associates, Hillsdale, NJ (1980)
36. Mayo, M., Mitrovic, A.: Optimising ITS behaviour with bayesian networks and decision theory. Int. J. Artif. Intell. Educ. 12, 124-153 (2001)
37. Melis, E., Andres, E., Bndenbender, J., Frischauf, A., Goguadze, G., Libbrecht, P., Pollet, M., Ullrich, C.: ACTIVEMATH: a generic and adaptive web-based learning environment. Int. J. Artif. Intell. Educ. 12, 385-407 (2001)
38. Millián, E., Pérez de la Cruz, J.L.: Diagnosis algorithm for student modeling diagnosis and its evaluation. User Model. User-adapted Interact. 12(2-3), 281-330 (2002)
39. Mislevy, R.J., Steinberg, L.S., Almond, R.G.: On the roles of task model variables in assessment design. Technical Report CSE Technical Report 500, Education Testing Service (1999)
40. Mislevy, R.J., Steinberg, L.S., Almond, R.G.: Evidence-centered assessment design. Technical Report A Submission for the NCME Award for Technical or Scientific Contributions to the Field of Educational Measurement, Education Testing Service (2000)
41. Muraki, E.: A generalized partial credit model: Application to an EM algorithm. Appl. Psychol. Measure. 16, 159-176(1992)
42. Murray, T.: Formative qualitative evaluation for 'Exploratory' ITS research. Int. Artif. Intell. Educ.: Special Issue on Evaluation 4(2/3), 179-207 (1993)
43. Nanas, N., Uren, V.: Exploting term dependencies for multi-topic information filtering with single user profile. User Model. User-Adapted Interact. (in this issue) (2007)
44. Owen, R.J.: A Bayesian approach to tailored testing. Research Report 69-92, Educational Testing Service (1969)
45. Owen, R.J.: A Bayesian sequential procedure for quantal response in the context of adaptive mental testing. J. Am. Stat. Associ. 70(350), 351-371 (1975)
46. Pack, T., Chickering, D.M.: Improving command and control speech recognition on mobile devices: using predictive user models for language modeling. User Model. User-Adapted Interact. (in this issue) (2007)
47. Papanikolaou, K. A., Grigoriadou, M., Kornikolakis, H., Magoulas, G.D.: Personalizing the interaction in a web-based educational hypermedia system: the case of INSPIRE. User Model. User-Adapted Interact. 13, 213-267 (2003)
48. Ramsay, J.O.: Kernel smoothing approaches to nonparametric item characteristic curve estimation. Psychometrika 56, 611-630 (1991)
49. Reye, J.: A belief net backbone for student modelling. In: Cerri, S.A., Gouardres, G., Paraguacu, F. (eds.) Proceedings of the 6th International Conference on Intelligent Tutoring Systems (ITS 2002). Lecture Notes in Computer Science, No. 2363, pp. 596-604. Springer Verlag, New York (2002)
50. Samejima, F.: The graded response model. In: van der Linden, W.J., Hambleton, R.K., (eds.) Handbook of Modern Item Response Theory, pp. 85-100. Springer Verlag, New York (1997)
51. Schank, R.C., Cleary, C.: Engines for Education. Lawrence Erlbaum Associates, Flillscale, NJ (1994)
52. Scriven, M.: The methodology of evaluation. In: Stake, R.E., (ed.) Perspectives of Curriculum Evaluation. Rand McNally, Chicago, IL (1967)
53. Segall, D.O.: Multidimensional adaptive testing. Psychometrika 61(1), 331-354 (1996)
54. Self, J.A.: Formal approaches to student modeling. In: Greer, J.E., McCalla, G. (eds.) Student Modeling: The Key to Individualized Knowledge-Based Instruction, vol. 125, pp. 295-352. Springer Verlag, New York (1994)
55. Shute, V.J., Graf, E.A., Hansen, E.G.: Technology-Based Education: Bringing Researchers and Practicioners Together, Chapt. Design Adaptive, Diagnostic Math Assessments for Sighted and Visually Disabled Students, pp. 169-202. Information Age Publishing (2005)
56. Simonoff, J.S.: Smoothing Methods in Statistics. Springer-Verlag, New York (1996)
57. Stout, W.: Psychometrics: from practice to theory and back. Psychometrika 67, 485-518 (2002)
58. Tam, S.S.: A comparison of methods for adaptive estimation of a multidimensional trait. Ph.D. thesis, Graduate School of Arts and Science, Columbia University. Order number: 9221219 (1992)
59. Tatsuoka, K.: A probabilistic model for diagnosing misconceptions in the pattern classification approach. J. Educ. Stat. 12(1), 55-73 (1985)
60. Thissen, D., Steinberg, L.: A response model for multiple choice items. In: van der Linden, W.J., Hambleton, R.K. (eds.) Handbook of modern item response theory, pp. 51-65. Springer Verlag, New York (1997)
61. Twidale, M.: Redressing the balance: the advantages of informal evaluation techniques for intelligent learning environments. Int. J. Artif. Intell. Educ. Special Issue on Evaluation 4(2/3), 155-178 (1993)
62. van der Linden, W.J., Glas, C.A.W.: Computerized Adaptive Testing: Theory and Practice. Kluwer Academic Publishers (2000)
63. van der Linden, W.J., Pashley, P.J.: Item selection and ability estimation in Adaptive Testing. In: van der Linden, W. J., Glas, C.A.W, (eds.) Computerized Adaptive Testing: Theory and Practice, pp. 1-26. Kluwer Academic Publisher, Dordrecht
64. Van Lehn, K., Niu, Z., Siler, S., Gertner, A.S.: student modeling from conventional test data: a Bayesian approach without priors. In: Goettl, B., Redfield, C.L., Halff, H.M., Shute, V.J. (eds.) Proceedings of 4th International Conference on Intelligent Tutoring Systems. ITS'98. Lecture Notes in Computer Science, vol. 1452. pp. 434-443 (1998)
65. Vassileva, J.: Dynamic course generation on the WWW. In: du Bolay, B., Mizoguchi, R. (eds.) Knowledge and Media in Learning Systems. Proceedings of the 8th World Conference on Artificial Intelligence in Education AIED'97. pp. 498-505 (1997)
66. Wand, M.P., Jones, M.C.: Kernel Smoothing. Chapman and Hall, London (1995)
67. Wang, W.C., Chen, P.H.: Implementation and measurement efficiency of multidimensional computerized adaptive testing. Appl. Psychol. Measure. 28(5), 295-316 (2004)
68. Weber, G., Brusilovsky, P.: ELM-ART: an adaptive versatile system for web-based instruction. Int. J. Artif. Intell. Educ. 12, 351-383 (2001)
69. Zukerman, I., Albrecht, D.: Predictive statistical models for user modeling. User Model. User-Adapted Interact. 11, 5-18 (2001)