Evaluation of an automated reading tutor that listens: Comparison to human tutoring and classroom instruction

Journal of Educational Computing Research

Volumn 29, Issue 1, 2003, Pages 61-117

  Mostow, Jack ^a   Aist, Greg ^a   Burkhead, Paul ^a   Corbett, Albert ^a   Cuneo, Andrew ^a   Eitelman, Susan ^a   Huang, Cathy ^a   Junker, Brian ^a   Beth Sklar, Mary ^a   Tobin, Brian ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0344253674     PISSN: 07356331     EISSN: None     Source Type: Journal    
DOI: 10.2190/06AX-QW99-EQ5G-RDCF     Document Type: Article

References (51)

1. Aist, G. (1998, December). Expanding a time-sensitive conversational architecture for turn-taking to handle content-driven interruption. Proceedings of the International Conference on Speech and Language Processing (ICSLP98), Sydney, Australia, Paper 928.
2. Aist, G. (2001). Helping children learn vocabulary during computer-assisted oral reading. Unpublished Ph.D. dissertation, Carnegie Mellon University, Pittsburgh, PA.
3. Aist, G. (200la). Factoids: Automatically constructing and administering vocabulary assistance and assessment. In J. D. Moore, C. L. Redfield, & W. L. Johnson (Eds.), Artificial intelligence in education: AI-ED in the wired and wireless future (pp. 234-245). San Antonio, TX/Amsterdam: IOS Press.
4. Aist, G. (2001b). Towards automatic glossarization: Automatically constructing and administering vocabulary assistance factoids and multiple-choice assessment. International Journal of Artificial Intelligence in Education, 12, 212-231.
5. Aist, G. (2002a). Helping children learn vocabulary during computer-assisted oral reading. Educational Technology and Society, 5(2), http://ifets.ieee.org/periodical/vol_2_2002/aist.html.
6. Aist, G. (2002b, April 29). Helping children learn vocabulary during computer-assisted oral reading: A dissertation summary [Poster presented as a Distinguished Finalist for the Outstanding Dissertation of the Year Award]. 47th Annual Convention of the International Reading Association, San Francisco, CA.
7. Aist, G., & Mostow, J. (1997a, November). A time to be silent and a time to speak: Time-sensitive communicative actions in a reading tutor that listens. AAAI Fall Symposium on Communicative Actions in Humans and Machines, Boston, MA.
8. Aist, G., & Mostow, J. (1997b, October). When speech input is not an after-thought: A reading tutor that listens. Workshop on Perceptual User Interfaces, Banff, Canada.
9. Aist, G., & Mostow, J. (1999, September). Measuring the effects of backchanneling in computerized oral reading tutoring. Proceedings of the ESCA Workshop on Prosody and Dialog, Eindhoven, Netherlands.
10. Aist, G., & Mostow, J. (2000, June). Improving story choice in a reading tutor that listens. Proceedings of the Fifth International Conference on Intelligent Tutoring Systems (ITS'2000), Montreal, Canada, 645.
11. Aist, G., & Mostow, J. (2003). Faster, better task choice in a reading tutor that listens. In V. M. Holland & F. N. Fisher (Eds.), Speech technology for language learning. Lisse, The Netherlands: Swets & Zeitlinger Publishers.
12. Aist, G., Mostow, J., Tobin, B., Burkhead, P., Corbett, A., Cuneo, A., Junker, B., & Sklar, M. B. (2001). Computer-assisted oral reading helps third graders learn vocabulary better than a classroom control - About as well as one-on-one human-assisted oral reading. In J. D. Moore, C. L. Redfield, & W. L. Johnson (Eds.), Artificial intelligence in education: AI-ED in the wired and wireless future (pp. 267-277). San Antonio, TX/Amsterdam: IOS Press.
13. Betts, E. A. (1946). Foundations of reading instruction. New York: American Book Company.
14. Clay, M. M. (1991). Why is an inservice programme for reading recovery teachers necessary? Reading Horizons, 31(5), 355-372.
15. Cunningham, A. E., & Stanovich, K. E. (1991). Tracking the unique effects of print exposure in children: Associations with vocabulary, general knowledge, and spelling. Journal of Educational Psychology, 83(2), 264-274.
16. Deno, S. L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional Children, 52(3), 219-232.
17. Fielding, L., Wilson, P., & Anderson, R. (1986). A new focus on reading: The role of trade books in reading instruction. In T. Raphael & R. Reynolds (Eds.), Contexts of literacy. New York: Longman.
18. Fogarty, J., Dabbish, L., Steck, D., & Mostow, J. (2001). Mining a database of reading mistakes: For what should an automated Reading Tutor listen? In J. D. Moore, C. L. Redfield, & W. L. Johnson (Eds.), Artificial intelligence in education: AI-ED in the wired and wireless future (pp. 422-433). San Antonio, TX/Amsterdam: IOS Press.
19. Foorman, B. R., Francis, D. J., Fletcher, J. M., Mehta, P., & Schatschneider, C. (1998). The role of instruction in learning to read: Preventing reading failure in at-risk children. Journal of Educational Psychology, 90(1), 37-55.
20. Fuchs, L. S., Fuchs, D., Hamlett, C. L., Walz, L., & Germann, G. (1993). Formative evaluation of academic progress: How much growth can we expect? School Psychology Review, 22(1), 27-48.
21. Icabone, D., & Hannaford, A. (1986). Comparison of two methods of teaching unknown reading words to fourth graders: Microcomputer and tutor. Educational Technology, 26, 36-39.
22. Juel, C. (1996). What makes literacy tutoring effective? Reading Research Quarterly, 31(3), 268-289.
23. Kamil, M. L., Mosenthal, P. B., Pearson, P. D., & Barr, R. (Eds.) (2000). Handbook of reading research (Vol. III). Mahwah, NJ: Lawrence Erlbaum Associates.
24. Leinhardt, G., Zigmond, N., & Cooley, W. W. (1981). Reading instruction and its effects. American Education Research Journal, 13(3), 343-361.
25. Levy, B. A., Nicholls, A., & Kohen, D. (1993). Repeated readings: Process benefits for good and poor readers. Journal of Experimental Child Psychology, 56, 303-327.
26. Lundberg, I., & Olofsson, A. (1993). Can computer speech support reading comprehension? Computers in Human Behaviour, 9(2-3), 283-293.
27. McConkie, G. W. (1990). Electronic vocabulary assistance facilitates reading comprehension: Computer aided reading. Unpublished manuscript.
28. Mostow, J., & Aist, G. (1999a, July). Authoring new material in a reading tutor that listens. Proceedings of the Sixteenth National Conference on Artificial Intelligence (AAAI-99), Intelligent Systems Demonstration track, Orlando, FL, pp. 918-919.
29. Mostow, J., & Aist, G. (1999b). Giving help and praise in a reading tutor with imperfect listening - because automated speech recognition means never being able to say you're certain. CALICO Journal, 16(3), 407-424.
30. Mostow, J., & Aist, G. (1999c). Reading and pronunciation tutor (United States Patent No. 5,920,838), US Patent and Trademark Office.
31. Mostow, J., & Aist, G. (2001). Evaluating tutors that listen: An overview of Project LISTEN. In K. Forbus & P. Feltovich (Eds.), Smart Machines in Education (pp. 169-234). Menlo Park, CA: MIT/AAAI Press.
32. Mostow, J., Aist, G., Beck, J., Chalasani, R., Cuneo, A., Jia, P., & Kadaru, K. (2002, June 5-7). A La Recherche du Temps Perdu [As Time Goes By: Where does the time go in a Reading Tutor that listens?] Proceedings of the Sixth International Conference on Intelligent Tutoring Systems (ITS'2002) (pp. 320-329). Biarritz, France.
33. Mostow, J., Aist, G., Bey, J., Burkhead, P., Cuneo, A., Rossbach, S., Tobin, B., Valeri, J., & Wilson, S. (2001). A hands-on demonstration of Project LISTEN'S Reading Tutor and its embedded experiments (refereed demo). Language Technologies 2001: The Second Meeting of the North American Chapter of the Association for Computational Linguistics, Pittsburgh, PA.
34. Mostow, J., Aist, G., Huang, C., Junker, B., Kennedy, R., Lan, H., IV, D. L., O'Connor, R., Tassone, R., Tobin, B., & Wierman, A. (2003). 4-Month evaluation of a learner-controlled reading tutor that listens. In V. M. Holland & F. N. Fisher (Eds.), Speech technology for language learning. Lisse, The Netherlands: Swets & Zeitlinger Publishers.
35. Mostow, J., Beck, J., Winter, S. V., Wang, S., & Tobin, B. (2002, September 16-20). Predicting oral reading miscues. Proceedings of the Seventh International Conference on Spoken Language Processing (ICSLP-02) (pp. 1221-1224). Denver, CO.
36. Mostow, J., Hauptmann, A. G., Chase, L. L., & Roth, S. (1993, July). Towards a reading coach that listens: Automated detection of oral reading errors. Proceedings of the Eleventh National Conference on Artificial Intelligence (AAAI93) (pp. 392-397). Washington, D.C.
37. Mostow, J., Huang, C., & Tobin, B. (2001). Pause the video: Quick but quantitative expert evaluation of tutorial choices in a reading tutor that listens. In J. D. Moore, C. L. Redfield, & W. L. Johnson (Eds.), Artificial intelligence in education: AI-ED in the wired and wireless future (pp. 343-353). San Antonio, TX/Amsterdam: IOS Press.
38. Mostow, J., Roth, S. F., Hauptmann, A. G., & Kane, M. (1994, August). A prototype reading coach that listens [AAAI-94 Outstanding Paper Award]. Proceedings of the Twelfth National Conference on Artificial Intelligence (pp. 785-792). Seattle, WA.
39. Nagy, W., Herman, P., & Anderson, R. (1985). Learning words from context. Reading Research Quarterly, 20, 233-253.
40. NCES (2000). National Assessment of Educational Progress, from http://nces.ed.gov/nationsreportcard
41. NRP (2000). Report of the National Reading Panel: Teaching children to read. Washington, DC: National Institute of Child Health & Human Development. No. 00-4769.
42. Olson, R., Foltz, G., & Wise, B. (1986). Reading instruction and remediation with the aid of computer speech. Behavior Research Methods, Instruments, & Computers, 18(2), 93-99.
43. Olson, R. K., & Wise, B. (1987). Computer speech in reading instruction. In D. Reinking (Ed.), Computers and reading: Issues for theory and practice. New York: Teachers College Press.
44. Snow, C. E., Burns, M. S., & Griffin, P. (1998). Preventing reading difficulties in young children. Washington, D.C.: National Academy Press.
45. Wasik, B. A., & Slavin, R. E. (1993). Preventing early reading failure with one-to-one tutoring: A review of five programs. Reading Research Quarterly, 28(2), 178-200.
46. Wise, B. W. (1992). Whole words and decoding for short-term learning: Comparisons on a "talking-computer" system. Journal of Experimental Child Psychology, 54(2), 147-167.
47. Wise, B. W., & Olson, R. K. (1992). How poor readers and spellers use interactive speech in a computerized spelling program. Reading and Writing: An Interdisciplinary Journal, 4(2), 145-163.
48. Wise, B. W., Olson, R., Anstett, M., Andrews, L., Terjak, M., Schneider, V., Kostuch, J., & Kriho, L. (1989). Implementing a long-term computerized remedial reading program with synthetic speech feedback: Hardware, software and real-world issues. Behavior Research Methods, Instruments, & Computers, 21(2), 173-180.
49. Wise, B. W., Ring, J., & Olson, R. K. (1999). Training phonological awareness with and without explicit attention to articulation. Journal of Experimental Child Psychology, 72(4), 271-304.
50. Woodcock, R. W. (1987). Woodcock reading mastery tests-revised. Circle Pines, MN: American Guidance Service.
51. Woodcock, R. W. (1998). Woodcock reading mastery tests-revised (WRMT-R/NU). Circle Pines, MN: American Guidance Service.