Evaluation of Computer Adaptive Testing Systems

International Journal of Web-Based Learning and Teaching Technologies (IJWLTT)

Volumn 2, Issue 1, 2007, Pages 70-87

  Economides, Anastasios A ^a   Roupas, Chrysostomos ^a  

^a UNIVERSITY OF MACEDONIA   (Greece)

Author keywords

computer adaptive testing; computer based instruction; computer based testing; distance education; evaluation; human computer interface; interactive learning environments; online test; requirements

Indexed keywords

COMPUTER TESTING; E-LEARNING; HUMAN COMPUTER INTERACTION; ONLINE SYSTEMS;

ADAPTIVE TESTING SYSTEMS; COMPUTER ADAPTIVE TESTING; COMPUTER-BASED INSTRUCTIONS; COMPUTER-BASED TESTING; EDUCATIONAL ORGANIZATIONS; EVALUATION; HUMAN COMPUTER INTERFACES; INTERACTIVE LEARNING ENVIRONMENT; ONLINE TESTS; REQUIREMENT;

COMPUTER AIDED INSTRUCTION;

EID: 85001728379     PISSN: 15481093     EISSN: 15481107     Source Type: Journal    
DOI: 10.4018/jwltt.2007010104     Document Type: Article

References (43)

1. Baklavas, G., Economides, A. A., & Roumeliotis, M. (1999). Evaluation and comparison of Web-based testing tools. In Proceedings of the WebNet-99 World Conference on WWW and Internet (pp. 81–86). AACE.
2. Boyle, A., & O'Hare, D. (2003). Finding appropriate methods to assure quality computer-based development in UK Higher Education. In Proceedings of the 7th Computer-Assisted Assessment Conference, Loughborough University, United Kingdom.
3. Brown, J. D. (1997). Computers in language testing: Present research and some future directions. Language Learning & Technology, 1(1), 44–59.
4. Carlson, R. D. (1994). Computer-adaptive testing: A shift in the evaluation paradigm. Journal of Educational Technology Systems, 22(3), 213–224.
5. Cisco Retrieved August 17, 2006, from http://www.cisco.com, http://www. topsjareware.com/Cisco-Pratice-Tests-from-Boson-download-10944. htm
6. Cito Group Retrieved August 17, 2006, from http://www.cito.nl/
7. CompTIA Retrieved August 17, 2006, from http://www.comptia.org/cer-ticfcation/
8. Dennis, A., Wixom, B. H., & Tegarden, D. (2005). Systems analysis and design with UML version 2.0 (2nd ed.). John Wiley & Sons Inc.
9. Dunkel, P. (1999, January). Considerations in developing or using second/foreign language profciency computer-adaptive tests. Language Learning & Technology, 2(2), 77–93.
10. Economides, A. A. (2005a). Computer adaptive testing quality requirements. In Proceedings of the E-Learn 2005 World Conference on E-Learning in Corporate, Government, Healthcare, & Higher Education (pp. 288–295). AACE.
11. Economides, A. A. (2005b, July). Personalized feedback in CAT. WSEAS Transactions on Advances in Engineering Education, 2(3), 174–181.
12. Eduventures Retrieved August 17, 2006, from http://www.eduventures.com
13. FastTest Pro Retrieved August 17, 2006, from http://www.assess.com/Soft-ware/FTP16Main.htm
14. Georgiadou, E., Triantafllou, E., & Economides, A. A. (2005). Evaluation parameters for computer adaptive testing. British Journal of Educational Technology,37(2). pp. 261–278.
15. Georgouli, K. (2004, December). WASA: An intelligent agent for Web-based self-assessment. In Kinhuk, D. Sampson, & P. Isaias (Eds.), L. Rodrigues & P. Barbosa (Assoc. Eds.), Cognition and exploratory learning in digital age (pp. 43–50). Lisbon. CELDA 2004. ISBN: 972–98947–7–9.
16. Giouroglou, H., & Economides, A. (2004). State-of-the-art and adaptive open-closed items in adaptive foreign language assessment. In Proceedings of the 4th Hellenic Conference with International Participation: Informational and Communication Technologies in Education (pp. 747–756), Athens, Greece.
17. Giouroglou, H., & Economides, A. A. (2005). The development of the adaptive item language assessment (AILA) for mixed-ability students. In Proceedings of the E-Learn 2005 World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education (pp. 643–650). AACE.
18. GMAT Retrieved August 17, 2006, from http://www.gmat.org, http://www. mba.com, http://www.gmat-mba-prep.com/, http://www.800score. com/gmat-home.html
19. GRE Retrieved August 17, 2006, from http:// www.ets.org, http://www.800score. com/gre-index.html
20. Hableton, R. K., Zaal, J. N., & Pieters, J. P. (2000). Computerized adaptive testing: Theory, applications, and standards. Reston, MA: Kluwer.
21. Jacobson, R. L. (1993). New computer technique seen producing a revolution in educational testing. Chronicle of Higher Education, 40(4), 22–23.
22. Kapsalis, A. G. (2004). Pedagogic psychology (3rd ed.). Kiriakidis S.A.
23. Lilley, M., & Barker, T. (2003). An evaluation of a computer-adaptive test in a UK University context. In Proceedings of the 7th Computer-Assisted Assessment Conference, Loughborough University, United Kingdom.
24. Lilley, M., Barker, T., & Britton, C. (2004). The development and evaluation of a software prototype for computer-adaptive testing. Computers & Education, 43, 109–123.
25. MCSE Retrieved August 17, 2006, from http://www.microsoft.com/learning/ mcp/mcse/, http://www.sybex.com/ sybexbooks.nsf/AdditionalContent/ 2946OnlineDemo?OpenDocument#
26. Meijer, R. R., & Nering, M. L. (1999). Computerized adaptive testing: Overview and introduction. Applied Psychological Measurement, 23(3), 187–194.
27. MSDE Retrieved August 17, 2006, from http://www.marylandpublicschools. org/MSDE
28. Olea, J., Revuelta, J., Ximenez, M. C., & Abad, F. J. (2000). Psychometric and psychological effects of review on computerized fixed and adaptive tests. Psicologica, 21, 157–173.
29. Roever, C. (2001, May). Web-based language testing. Language Learning & Technology, 5(2), 84–94.
30. Rudner, L. M. An on-line interactive computer adaptive testing tutorial. Retrieved August 17, 2006, from http://edres.org/scripts/cat/catdemo. htm
31. Rudner, L. M. (2002, April 1–5). An examination of decision-theory adaptive testing procedures. Paper presented at the Conference of American Educational Research Association, New Orleans, Louisiana.
32. Sclater, N., & Howie, K. (2003). User requirements of the ultimate online assessment engine. Computers & Education, 40, 285–306.
33. Straetmans, G. J. M., & Eggen T. J. H. M. (1998, January-February). Computerized adaptive testing: What it is and how it works. Educational Technology, pp. 82–89.
34. TOEFL Retrieved August 17, 2006, from http://www.ets.org, http://www.toefl. org, http://toefpractice.ets.org/
35. Valenti, S., Cucchiarelli, A., & Panti, M. (2001). A framework for the evaluation of test management systems. Current Issues in Education, 4, 6.
36. Valenti, S., Cucchiarelli, A., & Panti, M. (2002). Computer based assessment systems evaluation via the ISO9126 quality model. Journal of Information Technology Education, 1(3).
37. Wainer, H. (1990). Computerized adaptive testing: A primer. Hillsdale, NJ: Lawrence Erlbaum Associates.
38. Wainer, H., Dorans, D. J., Eignor, D., Flaugher, R., Green, B. F., Mislevy, R. J., Steinberg, L., & Thissen, D. (2000). Computerized adaptive testing: A primer (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
39. Weiss, D. J., Kingsbury, G. G. (1984). Application of computerized adaptive testing to educational problems. Journal of Educational Measurement, 21(4), 361–375.
40. Welch, R. E., & Frick, T. W. (1993). Computerized adaptive testing in instructional settings. Educational Technology Research & Development, 41(3), 47–62.
41. Wise, S. L., & Kingsbury, G. G. (2000). Practical issues in developing and maintaining a computerized adaptive testing program. Psicologica, 21, 135–155.
42. Young, R., Shermis, M. D., Brutten, S. R., & Perkins, K. (1996). From conventional to computer-adaptive testing of ESL reading comprehension. System, 24(1), 23–40.
43. Zahorian, S.A., Lakdawala, V. K., Gonzalez, O. R., Starsman, S., & Leathrum, J. F., Jr. (2001). Question model for intelligent questioning systems in engineering education. In Proceedings of the 31st ASEE/IEEE Frontiers in Education Conference, T2B7–12. IEEE.