The textevaluator tool: Helping teachers and test developers select texts for use in instruction and assessment

Elementary School Journal

Volumn 115, Issue 2, 2014, Pages 185-209

  Sheehan, Kathleen M ^a   Kostin, Irene ^a   Napolitano, Diane ^a   Flor, Michael ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84928158708     PISSN: 00135984     EISSN: 15548279     Source Type: Journal    
DOI: None     Document Type: Article

References (43)

1. ACT. (2006). Reading between the lines: What the ACT reveals about college readiness in reading. Iowa City: Author.
2. Alderson, J. C.(2000). Assessing reading.Cambridge: Cambridge University Press.
3. Biber, D.(1986). Spoken and written textual dimension in English: Resolving the contradictory findings. Language,62, 394-414.
4. Biber, D.(1988). Variation across speech and writing. Cambridge: Cambridge University Press. Biber, D., Conrad, S., Reppen, R., Byrd, P., Helt, M., Clark, V.,... Urzua, A. (2004). Representing language use in the university: Analysis of the TOEFL 2000 Spoken and Written Academic Language Corpus. TOEFL Monograph Series, MS-25, January2004. Princeton, NJ: Educational Testing Service.
5. Biber, D. Johansson, S., Leech, G., Conrad, S., & Finegan, E. (1999)Longman grammar of spoken and written English.Essex, UK: Pearson Education.
6. Bormuth, J. R.(1964). Mean word depth as a predictor of comprehension difficulty. California Journal of Educational Research, 15, 226 -231.
7. Carroll, J. B., Davies, P., & Richman, B.(1971).The American heritage word frequency book.New York: American Heritage.
8. Coltheart, M.(1981).The MRC psycholinguistic database.Quarterly Journal of Experimental Psychology,33A, 497-505.
9. Common Core State Standards Initiative.(2010, June).Common Core State Standards for English language arts & literacy in history/social studies, science and technical subjects. Washington, DC: CCSSO & National Governors Association.
10. Coxhead, A.(2000). A new academic word list.TESOL Quarterly,34, 213-238.
11. Deane, P., Sheehan, K. M., Sabatini, J. P., Futagi, Y., & Kostin, I.(2006).Differences in text structure and its implications for the assessment of struggling readers.Scientific Studies of Reading, 10(3), 257-275.
12. Flor, M., Beigman Klebanov, B., & Sheehan, K. M. (2013).Lexical tightness and text complexity. In Proceedings of the Second Workshop on Natural Language Processing for Improving Textual Accessibility (NLP4ITA), annual conference ofthe Association for Computational Linguistics, Atlanta.
13. Graesser, A. C., McNamara, D. S., & Kulikowich, J. M.(2011).Coh-Metrix: Providing multilevel analyses of text characteristics. Educational Researcher,40(5), 223-234.
14. Graesser, A. C., McNamara, D. S., Louwerse, M. W., & Cai, Z. (2004). Coh-Metrix: Analysis oftext on cohesion andlanguage. Behavior Research Methods, Instruments & Computers,36(2), 193-202.
15. Halliday, M. A. K., & Hasan, R.(1976)Cohesion in English.London: Longman.
16. Heilman, M., Collins-Thompson, K., Callan, J., & Eskenazi, M.(2006).Classroom success of an intelligent tutoring system for lexical practice and reading comprehension.Proceedings of the Ninth International Conference on Spoken Language Processing, Pittsburgh.
17. Hiebert, E. H.(2011). Using multiple sources of information in establishing text complexity (Reading Research Report No. 11.03).Santa Cruz, CA: TextProject.
18. Just, M. A., & Carpenter, P. A.(1987).The psychology of reading and language comprehension.Boston: Allyn & Bacon.
19. Kane, M. T.(2006). Validation.In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 17-64).Westport, CT: Praeger.
20. Kincaid, J. P., Fishburne, R. P., Rogers, R. L., & Chissom, B. S.(1975).Derivation of new readability formulas (automated readability index, Fog count and Flesch reading ease formula) for Navy enlisted personnel (Research Branch Report No. 8 -75), NavalAir Station, Memphis, TN.
21. Kintsch, W.(1998).Comprehension: A paradigm for cognition.Cambridge: Cambridge University Press.
22. Landauer, T.(2011).Pearson’s text complexity measure.White Paper, Pearson.
23. McNamara, D. S., Graesser, A. C., & Louwerse, M. M.(2012).Sources oftext difficulty: Across genres and grades. In J. P. Sabatini, E. Albro, & T. O’Reilly (Eds.), Measuring up: Advances in how we assess reading ability.Lanham, MD: Rowman & Littlefield.
24. McNamara, D. S., Louwerse, M. M., McCarthy, P. M., & Graesser, A. C.(2010).Coh-Metrix: Capturing linguistic features of cohesion. Discourse Processes,47, 292-330.
25. Mesmer, H. A., Cunningham, J. W., & Hiebert, E. H.(2012).Toward a theoretical model of text complexity for the early grades: Learning from the past, anticipating the future. Reading Research Quarterly,47(3), 235-258.
26. Messick, S.(1989).Validity.In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103).New York: Macmillan.
27. Milone, M.(2008).The development of ATOS: The Renaissance readability formula.Wisconsin Rapids, WI: Renaissance Learning.
28. Nelson, J., Perfetti, C., Liben, D., & Liben, M. (2012).Measures oftext difficulty: Testing their predictive value for grade levels and student performance.Council of Chief State School Officers.
29. Pitler, E., & Nenkova, A. (2008).Revisiting readability: A unified framework for predicting text quality.In Proceedings ofthe 2008 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics.
30. Sheehan, K. M.(2013). Measuring cohesion: An approach that accounts for differences in the degree of integration challenge presented by different types of sentences.Educational Measurement: Issues and Practice,32(4), 28-37.
31. Sheehan, K. M., Flor, M., & Napolitano, D. (2013).A two-stage approach for generating unbiased estimates of text complexity. In Proceedings of the Second Workshop on Natural Language Processing for Improving Textual Accessibility (NLP4ITA), annual conference of the Association for Computational Linguistics, Atlanta.
32. Sheehan, K. M., Kostin, I., & Futagi, Y.(2007, August).Reading level assessment for literary and expository texts.In D. S. McNamara & J. G. Trafton (Eds.), Proceedings of the 29th Annual Meeting of the Cognitive Science Society,Nashville, TN.
33. Sheehan, K. M., Kostin, I., & Futagi, Y.(2008).When do standard approaches for measuring vocabulary difficulty, syntactic complexity and referential cohesion yield biased estimates of text difficulty?In B. C. Love, K. McRae, & V. M. Sloutsky (Eds.), Proceedings of the 30th Annual Conference of the Cognitive Science Society,Washington, DC.
34. Sheehan, K. M., Kostin, I., Futagi, Y., & Flor, M. (2010).Generating automated text complexity classifications that are aligned with targeted text complexity standards (ETS RR-10-28). Princeton, NJ: ETS.
35. Stenner, A. J., Burdick, H., Sanford, E., & Burdick, D.(2006).How accurate are Lexile text measures?Journal of Applied Measurement,7(3), 307-322.
36. Surowiecki, J.(2005). The wisdom of crowds.New York: Anchor Books.
37. Tabachnick, B. G., & Fidell, L. S.(2001).Using multivariate statistics.Boston: Allyn & Bacon.
38. TukeyJ. W.(1962). The future of data analysis.Annals of Mathematical Statistics,33(1), 1-67.
39. Vajjala, S., & Meurers, D. (2012).On improving the accuracy of readability classifications using insights from second language acquisition.In Proceedings of the Seventh Workshop on the Innovative Use of NLP for Building Educational Applications.
40. Wainer, H. (2011).Uneducated guesses: Using evidence to uncover misguided education policies. Princeton, NJ: Princeton University Press.
41. Williamson, G. L. (2006). Aligning the journey with a destination: A model for K-16 reading standards. Durham, NC: Metametrics.
42. Yngve, V. H.(1960). A model and an hypothesis for language structure. Proceedings of the American Philosophical Society,104, 444-466.
43. Zeno, S. M., Ivens, S. H., Millard, R. T., & Duvvuri, R.(1995).The educator’s word frequency guide.Brewster, NY: Touchstone Applied Science Associates.