Evaluation parameters for computer-adaptive testing

British Journal of Educational Technology

Volumn 37, Issue 2, 2006, Pages 261-278

  Georgiadou, Elisabeth ^a   Triantafillou, Evangelos ^b   Economides, Anastasios A ^a  

^a UNIVERSITY OF MACEDONIA   (Greece)

^b ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER ADAPTIVE TESTING (CAT); PSYCHOLOGICAL TESTING; PSYCHOMETRIC THEORY; USABILITY;

ADAPTIVE SYSTEMS; COMPUTER SELECTION AND EVALUATION; INSPECTION; PARAMETER ESTIMATION; PSYCHOLOGY COMPUTING; STANDARDS;

COMPUTER AIDED ANALYSIS;

EID: 33644979380     PISSN: 00071013     EISSN: 14678535     Source Type: Journal    
DOI: 10.1111/j.1467-8535.2005.00525.x     Document Type: Article

References (45)

1. American Council on Education (ACE). (1995). Guidelines for computerized adaptive test development and use in education, Washington DC: American Council on Education.
2. American Educational Research Association (AERA), American Psychological Association (APA), National Council on Measurement in Education (NCME). (1999). Standards for educational and psychological testing. Washington DC: American Educational Research Association.
3. American Psychological Association (1985). Standards for Educational and Psychological Tests. Washington DC, APA.
4. Association of Test Publishers (ATP). (2000). Guidelines for computer-based testing. Washington DC: Association of Test Publishers.
5. Ayersman, D. J. & Minden, A. V. (1995). Individual differences, computers, and instruction. Computers in Human Behavior, 11, 3-4, 371-390.
6. Bajraktarevic, N., Hall, W. & Fullick, P. (2003). ILASH: Incorporating learning styles in hypermedia. In Proceedings of the AH2003 Workshop, Budapest, Hungary, 20 May 2003 (pp. 145-154).
7. Baklavas, G., Economides, A. A. & Roumeliotis, M. (1999). Evaluation and comparison of web-based testing tools. In Proceedings WebNet-99, World Conference on WWW and Internet (pp. 81-86). Honolulu, Hawaii: AACE, 1999.
8. Brusilovsky, P. (1996). Methods and techniques of adaptive hypermedia. User modelling and user-adapted interaction, 6, 2-3, 87-129.
9. Brusilovsky, P. (2001). Adaptive hypermedia. User modeling and user-adapted interaction, 11, 87-110.
10. Carver, C., Hill, M. &Pooch, U. (1999). Third generation adaptive hypermedia systems. WebNet 99, Honolulu, Hawaii, 1999.
11. Carver, C. A., Howard, R. A. & Lavelle, E. (1996). Enhancing student learning by incorporating learning styles into adaptive hypermedia. Proceedings of 1996 ED-MEDIA World Conference on Educational Multimedia and Hypermedia (pp. 118-123). Boston, MA.
12. Clarke, A. (1992). The principles of screen design for computer based learning materials. London, UK: Department Of Employment.
13. Cox, K. & Walker, D. (1993). User interface design (2nd ed.) New York: Prentice Hall.
14. De Bra, P. (1999). Design issues in adaptive web-site development. Proceedings of the 2nd Workshop on Adaptive Systems and User Modelling on the WWW, 29-39.
15. Dunkel, P. A. (1999). Considerations in developing and using computer-adaptive tests to assess second language proficiency. Language Learning & Technology, 2, 2, 77-93.
16. Eggen, T. & Straetmans, G. (1996). Computerized adaptive testing for classifying examinees into three categories. Measurement and Research Department Reports. 96-3. Cito, Netherlands: Arnhem.
17. Green, B., Bock, R. D., Humphreys, L., Linn, R. & Reckase, M. (1984). Technical guidelines for assessing computerized adaptive tests. Journal of Educational Measurement, 21, 347360.
18. Giouroglou, H. & Economides, A. (2004). State-of-the-Art and adaptive open-closed items in adaptive foreign language assessment. Proceedings 4th Conference on Information and Communications Technologies in Education, Athens 2004 (pp. 747-756).
19. Grigoriadou, M., Papanikolaou, K., Kornilakis, H. & Magoulas, G. (2001). INSPIRE: an intelligent system for personalized instruction in a remote environment. Proceedings of 3rd Workshop on Adaptive Hypertext and Hypermedia, Sonthoven, Germany (pp. 13-24).
20. Hambleton, R. K., Swamination, H. & Rogers, H. J. (1991). Fundamentals of item response theory. California: Sage Publications Inc.
21. Harvey, J. & Mogey, N. (1999). Pragmatic issues when integrating technology into the assessment of students. In S. Brown, P. Race & J. Bull (Eds), Computer-assisted assessment in higher education (pp. 7-20). London: Kogan-Page.
22. International Test Commission (ITC). (2004). International guidelines on computer-based and internet delivered testing. Draft Version 0.6, July, 2004.
23. Jettmar, E. & Nass C. (2002). Adaptive Testing: effects on user performance. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 20-25, Minneapolis, Minnesota, USA (pp. 129-134).
24. Kay, J. (1994). Lies, damned lies, and stereotypes: pragmatic approximations of users, In A. Kobsa & D. Litman (Eds), Proceedings of the, 4th International Conference on User Modeling (pp. 73-78), Hyannis, MA: Mitre Corp.
25. Lewis, C. & Sheehan, K. (1990). Using Bayesian decision theory to design a computerized mastery test. Applied Psychological Measurement, 14, 367-386.
26. Lilley, M. & Barker, T. (2002). The development and evaluation of a computer-adaptive testing application for English language. In Proceedings of the 6th Computer-assisted Assessment Conference, Loughborough University, UK.
27. Linacre, J. M. (2000). Computer-adaptive testing: a methodology whose time has come. MESA Memorandum No. 69. Published in S. Chae, U. Kang, E. Jeon & J. M. Linacre. Development of computerised middle school achievement test (in Korean). Seoul, South Korea: Komesa Press.
28. Lord, F. M. (1980). Applications of item response theory to practical testing problems, NJ: Lawrence Erlbaum Associates, Publishers.
29. Mcatter, E. & Shaw, R. (1995). The design of multimedia learning programs, Glasgow: University of Glasgow, The EMASHE Group.
30. Molich, R. &Nielsen, J. (March 1990). Improving a human-computer dialogue, Communications of the ACM, 33, 3, 338-348.
31. st century (pp. 225-284). Harrisburg, London: Idea Group Publishing.
32. Nielsen, J. (1994). Heuristic evaluation. In J. Nielsen & R. L. Mack (Eds), Usability inspection methods (pp. 25-62). New York, NY: John Wiley & Sons.
33. Oppermann, R., Rashev, R., Kinshuk. (1997). Adaptability and adaptativity in learning systems. In A. Behrooz (Ed.), Knowledge transfer Vol. 2 (pp. 173-179). London, UK: Pace.
34. Preece, J. (1993). Hypermedia, multimedia and human factors. In C. Latchem, J. Williamson & L. Henderson-Lancett (Eds), Interactive multimedia: practice and promise (pp. 135-150). London: Kogan Page.
35. Reckase, M. D. (2003). Item pool design for computerized adaptive testing. Annual meeting of the national council of measurement in education, Chicago, IL, April 2003.
36. Rudner, L. M. (1994). Questions to ask when evaluating tests. Practical assessment, research and evaluation, 4, 2.
37. Rudner, L. M. (1998). An online, interactive, computer adaptive testing tutorial. Retrieved 12 December 2004, from http://EdRes.org/scripts/cat
38. Rudner, L. M. (2002). An examination of decision theory adaptive testing procedures. Annual meeting of the American educational research association, New Orleans, LA, April 1-5.
39. Triantafillou, E., Demetriadis S., Pombortsis, A. & Georgiadou E. (2004). The value of adaptivity based on cognitive style: an empirical study. British Journal of Educational Technology, 35, 1, 95-106.
40. Triantafillou, E., Pomportsis, A. & Georgiadou E. (2002). AES-CS: adaptive educational system based on cognitive styles. Proceedings of the AH2002 Workshop, Malaga, Spain, 2002 (pp. 10-20).
41. Wainer, H. (1990). Computerized adaptive testing (a primer), NJ: Lawrence Erlbaum Associates.
42. Wainer, H. (Ed.) (2000). Computerized adaptive testing: a primer (2nd ed.) Mahwah, NJ: Lawrence Erlbaum.
43. Weiss, D. J. (1985). Adaptive Testing by Computer. Journal of Consulting and Clinical Psychology, 53, 6, 774-789.
44. Wise, S. (1997). Examine issues in CAT. Paper presented at the annual meeting of the National Council of Measurement in Education, Chicago.
45. Wise S. L. & Kingsbury G. G. (2000). Practical issues in developing and maintaining a computerized adaptive testing program. Psicológica, 21, 135-155.