A defense of checklists for courseware evaluation

ReCALL

Volumn 13, Issue 2, 2001, Pages 261-276

  Susser, Bernard ^a  

^a DOSHISHA WOMEN'S COLLEGE OF LIBERAL ARTS   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 43549084021     PISSN: 09583440     EISSN: 14740109     Source Type: Journal    
DOI: 10.1017/S0958344001001021a     Document Type: Article

References (94)

1. Akahori, K. (1988) Evaluation of educational computer software in Japan (I): Methods and results. Programmed Learning and Educational Technology, 25: 46-56.
2. Bader, M. J. (2000) Choosing CALL software: Beginning the evaluation process. TESOL Journal, 9(2): 18-22.
3. Bailin, A. (1995) AI and language learning: Theory and evaluations. In: Holland, V. M., Kaplan, J. D. and Sams, M. R. (eds.), Intelligent Language Tutors: Theory Shaping Technology. Mahwah, NJ: Lawrence Erlbaum, pp. 327-343.
4. Barker, P. and King, T. (1993) Evaluating interactive multimedia courseware: A methodology. Computers and Education, 21(4): 307-319.
5. Blease, D. (1986) Evaluating Educational Software. London: Croom Helm.
6. Blomeyer, R. L. Jr. (1991) Microcomputers in foreign language teaching: A case study on computer aided learning. In: Blomeyer, R. L. Jr. and Martin, C. D. (eds.), Case Studies in Computer Aided Learning. London: Falmer Press, pp. 115-150.
7. Borton, W. and Rossett, A. (1989) Educational software and published reviews: Congruence of teacher, developer, and evaluator perceptions. Education, 109(4): 434-444.
8. Bowers, C. A. (1988) The Cultural Dimensions of Educational Computing: Understanding the Non-neutrality of Technology. New York: Teachers College Press.
9. Callison, D. (1987) Experience and time investment factors in public school teacher evaluation of educational microcomputer software. Journal of Educational Technology Systems, 16(2): 129-149.
10. Cavallari, B. and Brown, A. (1999) Instructional Design and New Technologies - EU888. Teaching and Educational Development Institute, University of Queensland, Australia. http://www.ems.uq.edu.au/projects/eu888/. Checklist at http://www.ems.uq.edu.au/projects/eu888/graphics/check1.gifand/check2.gif
11. Chandler, D. (1984) Young Learners and the Microcomputer. Milton Keynes: Open University Press.
12. Chang, L. L. and Osguthorpe, R. T. (1987) An evaluation system for educational software: A self-instructional approach. Educational Technology, 27(6): 15-19.
13. Chapelle, C. A. (2001) Computer applications in second language acquisition: Foundations for teaching, testing and research. Cambridge, UK: Cambridge University Press.
14. Chomsky, C. (1984) Finding the best language arts software. Classroom Computer Learning, 4(6): 61-65.
15. Cole, J. D. (2000) EDIN 616: Courseware evaluation and selection. http://iris.nyit.edu/∼jcole/html/body_edin_616.html.
16. Committee on Instructional Technology, NCTE. (1992) NCTE guidelines for review and evaluation of English language arts software. Computers and Composition, 10(1): 37-44.
17. Cornick, L. B. (1984) Evaluating foreign-language CAI: A checklist. Unterrichtspraxis, 17(2): 315-318.
18. Criswell, E. L. and Swezey, R. W. (1984) Behavioral learning theory-based computer courseware evaluation. Educational Technology, 24(11): 43-46.
19. Cunningham, P. (1995) Evaluating CALLware for your classroom. CAELL Journal, 6(3): 13-19.
20. Curley, W. P. and Strickland, J. (1986) Garbage in/garbage out: Evaluating computer software. Annual Symposium of the New York College Learning Skills Association, Ellenville, N Y. ERIC Document Reproduction Service ED 284536.
21. Curtin, C. O. and Shinall, S. L. (1987) Teacher training for CALL and its implications. In: Smith, W. F. (ed.), Modern Media in Foreign Language Education: Theory and Implementation. Lincolnwood, IL: National Textbook Company, pp. 255-285.
22. Davies, G. (2001) ICT4LT module 2.2: Introduction to multimedia CALL. http://www.ict4lt.org/en/en_mod2-2.htm.
23. Day, H. (1984) Evaluating microcomputer courseware: Comparing the results of three evaluation methodologies with external data collected during field-testing. Unpublished doctoral dissertation.
24. Decoo, W. (1984) An application of didactic criteria to courseware evaluation. CALICO Journal, 2(2): 42-46.
25. Decoo, W. (1994) In defense of drill and practice in CALL: A reevaluation of fundamental strategies. Computers and Education, 23(1-2): 151-158.
26. Duchastel, P. C. (1987) Structures and methodologies for the evaluation of educational software. Studies in Educational Evaluation, 13: 111-117.
27. Dudley-Marling, C. and Owston, R. D. (1987) The state of educational software: A criterion-based evaluation. Educational Technology, 27(3): 25-29.
28. Fetner, C. and Johnson, K. (1990) Selecting software… who, me? Te aching and Computers. (Reprinted in: Cannings, T. R. and Finkel, L. (eds.), The Technology Age Classroom. Wilsonville, OR: Franklin, Beedle and Associates, 1993, pp. 358-360.)
29. Foelsche, O. (1997) The IALL foreign language software database. In: Liddell, P., Ledgerwood, M. and Iwasaki, A. (eds.), FLEAT III: Foreign Language Education and Technology: Proceedings of the Third Conference, Victoria, BC, Canada: Language Centre, University of Victoria, pp. 39-50.
30. Garrett, N. (1991) Technology in the service of language learning: Trends and issues. The Modern Language Journal, 75(1): 74-101.
31. Garrido, P. and Geissler, C. (1997) A methodology for software evaluation. http://132.205.43.t430_97/Methodwebpage/tableofcontents.html.
32. Hall, J. and Johnson, J. M. (eds.) (1998) 1998 Educational Software Preview Guide. Eugene, OR: International Society for Technology in Education.
33. Hardison, O. B. (1989/1990) Disappearing through the Skylight: Culture and Technology in the Twentieth Century. New York: Viking Penguin.
34. Hayles, N. K. (1999) How We Became Posthuman: Virtual Bodies in Cybernetics, Literature, and Informatics. Chicago, IL: University of Chicago Press.
35. Healey, D. and Johnson, N. (eds.). (1999) 1999 TESOL CALL Interest Section Software List. Waldorf, MD: Teachers of English to Speakers of Other Languages.
36. Heller, R. S. (1991) Evaluating software: A review of the options. Computers and Education, 17(4): 285-291.
37. Hémard, D. (1999) A methodology for designing student-centered hypermedia CALL. In: Debski, R. and Levy, M. (eds.), WORLDCALL: Global Perspectives on Computer-assisted Language Learning. Lisse, The Netherlands: Swets and Zeitlinger, pp. 215-228.
38. Hertz, R. M. (1984) A software evaluation guide for the language arts. CALICO Journal, 1(5): 21-23.
39. Hoffman, J. L. and Lyons, D. J. (1997) Evaluating instructional software. Learning and Leading with Technology, 25(2): 52-56.
40. Hope, G. R., Taylor, H. F. and Pusack, J. P. (1984) Using Computers in Teaching Foreign Languages. New York: Harcourt Brace Jovanovich.
41. Hopey, C. E., Rethemeyer, R. K. and Elmore, J. A. (1995) Making the right choice: Evaluating computer software and hardware for adult literacy instruction. Practice guide. NCAL Practice Guide PG95-04, November 1995. National Center on Adult Literacy, University of Pennsylvania, Philadelphia, PA. ERIC Document Reproduction Service ED 393009.
42. Hubbard, P. L. (1987) Language teaching approaches, the evaluation of CALL software, and design implications. In: Smith, W. F. (ed.), Modern Media in Foreign Language Education: Theory and Implementation. Lincolnwood, IL: National Textbook Company, pp. 227-254.
43. Hubbard, P. L. (1988) An integrated framework for CALL courseware evaluation. CALICO Journal, 6(2): 51-72.
44. Hubbard, P. L. (1992) A methodological framework for CALL courseware development. In: Pennington, M. C. and Stevens, V. (eds.), Computers in Applied Linguistics: An International Perspective. Clevedon, England: Multilingual Matters, pp. 39-65.
45. Hubbard, P. L. (1996) Elements of CALL methodology: Development, evaluation, and implementation. In: Pennington, M. C. (ed.), The Power of CALL. Houston, TX: Athelstan, pp. 15-32.
46. Hummel, J. W. and Senf, G. M. (1985) The courseware review process. Journal of Learning Disabilities, 18(8): 486-494.
47. IC4LT. (2001) ICT4LT project: Evaluation forms. http://www.cilt-ICT.org.uk.
48. Jabaji, R., Joyce, C., Kostoff, J., Rieb, D., Taylor, R. and Tulpar, C. (1994/1997) Computer-assisted Language Learning Software Guide for ESL Instructors at Post-secondary Institutions in British Columbia. Victoria. British Columbia, Canada: Ministry of Skills, Training and Labour, Province of British Columbia.
49. Jolicoeur, K. and Berger, D. E. (1986) Do we really know what makes educational software effective? A call for empirical research on effectiveness. Educational Technology, 26(12): 7-11.
50. Jones, C. and Fortescue, S. (1987) Using Computers in the Language Classroom. London: Longman Group UK Limited.
51. Kazlauskas, E. (1997) CTSE 540. Evaluation of learning materials and software: L.A. County and U.S.C. Masters Degree Program. Summer 1997. http://www-rcf.usc.edu/∼kazlausk/540_int.html.
52. Knowles, S. (1992) Evaluation of CALL software: A checklist of criteria for evaluation. On-CALL, 6(2): 9-20.
53. Legenhausen, L. and Wolff, D. (1989) Evaluating software: The Dusseldorf CALL project. CALL Digest, 5(1): 7-9.
54. Levitt, R. (1984) Computers in education. In: Chew, C. R. (ed.), Computers in the English Program: Promises and Pitfalls. Liverpool, NY: New York State English Council, pp. 89-93.
55. Levy, M. (1997) Theory-driven CALL and the development process. Computer Assisted Language Learning, 10(1): 41-56.
56. Mandell, M. (1984) Just because the bear dances. In: Chew, C. R. (ed.), Computers in the English Program: Promises and Pitfalls. Liverpool, NY: New York State English Council, pp. 103-109.
57. McDougall, A. and Squires, D. (1995a) A critical examination of the checklist approach in software selection. Journal of Educational Computing Research, 12(3): 263-274.
58. McDougall, A. and Squires, D. (1995b) An empirical study of a new paradigm for choosing educational software. Computers and Education, 25(3): 93-103.
59. Micceri, T., Pritchard, W. H. and Barrett, A. J. (1989) Must computer courseware evaluation be totally subjective? British Journal of Educational Technology, 20(2): 120-128.
60. Miller, L. and Burnett, J. D. (1986) Theoretical considerations in selecting language arts software. Computers and Education, 10(1): 159-165.
61. Moore, P. (1986) Using Computers in English: A Practical Guide. London: Methuen.
62. Murphy, C. A. (1995) An evaluation format for ‘open' software tools. Computers in Human Behavior, 11(3-4): 619-631.
63. Murray, L. and Barnes, A. (1998) Beyond the ‘wow' factor: Evaluating multimedia language learning software from a pedagogical viewpoint. System, 26(2): 249-259.
64. National Foreign Language Resource Center, University of Hawai'i. (1999) Taxonomy of features for evaluating foreign language multimedia software. http://www.nflrc.hawaii.edu/ithompson/flmedia/evaluation/general/gencriteria.htm.
65. Nielsen, J. and Molich, R. (1990) Heuristic evaluation of user interfaces. In: Chew, J. C. and Whiteside, J. (eds.), Empowering People: Human Factors in Computing Systems: CHI '90 Conference Proceedings. Seattle, WA: Addison-Wesley, pp. 249-256.
66. Odell, A. (1986) Evaluating CALL software. In: Leech, G. and Candlin, C. N. (eds.), Computers in English Language Teaching and Research. London: Longman, pp. 61-77.
67. Oliver, M. (2000) An introduction to the evaluation of learning technology, Educational Technology and Society, 3(4): 20-30.
68. Owston, R. D. and Dudley-Marling, C. (1988) A criterion-based approach to software evaluation. Journal of Research on Computing in Education, 20(3): 234-244.
69. Preece, J. and Jones, A. (1985) Training teachers to select educational computer software: Results of a formative evaluation of an Open University pack. British Journal of Educational Technology, 16(1): 9-20.
70. Reiser, R. A. and Dick, W. (1990) Evaluating instructional software. Educational Technology, Research and Development, 38(3): 43-50.
71. Reiser, R. A. and Kegelmann, H. W. (1994) Evaluating instructional software: A review and critique of current methods. Educational Technology, Research and Development, 42(3): 63-69.
72. Rilling, S. (2000) A teacher preparation course for computer-assisted language learning. In: Hanson-Smith, E. (ed.), Technology-enhanced Learning Environments. Alexandria, VI: TESOL, pp. 149-161.
73. Ring, G. (1993) The effects of instruction in courseware preview methodology on the predictive validity of teacher preview ratings. Journal of Educational Computing Research, 9(2):197-218.
74. Robb, T. N. and Susser, B. (2000) The life and death of software: Examining the selection process. CALICO Journal, 18(1): 41-52.
75. Röllinghoff, A. (1998) Software evaluation checkliste [sic], New Learning Technologies. http://it-resources.isca.ch/Evaluation/SolftEvQE.html.
76. Rowley, J. E. (1993) Selection and evaluation of software. Aslib Proceedings, 45(3): 77-81.
77. Schueckler, L. M. and Shuell, T. J. (1989) A comparison of software evaluation forms and reviews. Journal of Educational Computing Research, 5(1): 17-33.
78. Schwarz, I. and Lewis, M. (1989) Basic concept microcomputer courseware: A critical evaluation system for educators. Educational Technology, 29(5): 16-21.
79. Shade, D. D. (1996) Software evaluation. Young Children, 51(6): 17-21.
80. Shucart, S. A. (1998) “Where in CALL is Carmen Sandiego?”: An evaluative software review. The Language Teacher, 22(2): 31-33, 39.
81. Shuell, T. J. and Schueckler, L. M. (1989) Toward evaluating software according to principles of teaching and learning. Journal of Educational Computing Research, 5(2): 135-149.
82. Sloane, H. N., Gordon, H. M., Gunn, C. and Mickelsen, V. G. (1989) Evaluating Educational Software: A Guide for Teachers. Englewood Cliffs, NJ: Prentice Hall.
83. Sorge, D. H., Campbell, J. P. and Russell, J. D. (1993) Evaluating interactive video: Software and hardware. Tech Trends, 38(3): 19-26.
84. Squires, D. and McDougall, A. (1994) Choosing and Using Educational Software: A Teachers' Guide. London: Falmer Press.
85. Squires, D. and McDougall, A. (1996) Software evaluation: A situated approach. Journal of Computer Assisted Learning, 12(3): 146-161.
86. Squires, D. and Preece, J. (1996) Usability and learning: Evaluating the potential of educational software. Computers and education, 27(1): 15-22.
87. Strei, G. (1983) Format for the evaluation of courseware used in computer-assisted language instruction (CALI). CALICO Journal, 1(2): 43-46.
88. Tanaka, S. (1997) One proposal on evaluation checklists for multimedia software on English learning. Language Laboratory, 34: 107-122.
89. Tang, E. and Ng, C. (1999) A learner generated checklist for evaluating multimedia instructional materials. Applied Linguistics Forum (TESOL), 19(2): 4-5.
90. Taylor, R. (1987) Selecting effective courseware: Three fundamental instructional factors. Contemporary Educational Psychology, 12: 231-243.
91. Tergan, S.-O. (1998) Checklists for the evaluation of educational software: Critical review and prospects. Innovations in Education and Training International, 35(1): 9-20.
92. Vaille, J. A. (1998) Guidelines for the Evaluation of Instructional Technology Resources. Eugene, OR: International Society for Technology in Education.
93. Voogt, J. (1990) Courseware evaluation by teachers: An implementation perspective. Computers and Education, 14(4): 299-307.
94. Zappone, F. (1984) The bits and bytes of software evaluation. In: Chew, C. R. (ed.), Computers in the English Program: Promises and Pitfalls. Liverpool, NY: New York State English Council, pp. 95-102.