A validity critique of language program evaluations and analysis of English learner test scores

Education Policy Analysis Archives

Volumn 10, Issue , 2002, Pages

  Thompson, Marilyn S ^a,b   DiCerbo, Kristen E ^a   Mahoney, K ^a   MacSwan, J ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

^b EDCARE Laboratory at ASU   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 3042539582     PISSN: 10682341     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (80)

1. Alamillo, L., & Viramontes, C. (2000). Reflections from the classroom: Teacher perspectives on the implementation of Proposition 227. Bilingual Research Journal, 24, 155-168.
2. American Educational Research Association, American Psychological Association, National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: Author.
3. Amselle, J., & Allison, A. C. (2000, August). Two years of success: An analysis of California test scores after Proposition 227. READ Abstracts [On-line]. Available: http://www.ceousa.org/html/227rep.html
4. Anastasi, A. (1981). Coaching, test sophistication, and developed abilities. American Psychologist, 36, 1086-1093.
5. August, D., & Hakuta, K. (Eds.). (1998). Educating language-minority children. Washington, DC: National Academy Press.
6. Bangert-Drowns, R. L., Kulik, J. A., & Kulik, C. C. (1983). Effects of coaching programs on achievement test performance. Review of Educational Research, 53, 571-585.
7. Berliner, D. C. (1988). Meta-comment: A discussion of critiques of L. M. Dunn's monograph Bilingual Hispanic Children on the U.S. Mainland. Hispanic Journal of Behavioral Sciences, 10, 273-300.
8. Berliner, D., & Biddle, B. (1995). The manufactured crisis: Myths, fraud, and the attack on America's schools. Reading, MA: Addison-Wesley.
9. Bond, L. (1989). The effects of special preparation on measures of scholastic ability. In R. L. Linn (Ed.), Educational Measurement (3rd ed.) (pp. 13-103). New York: Macmillan Publishing Company.
10. Butler, Y. G., Orr, J. E., Gutierrez, M. B., & Hakuta, K. (2000). Inadequate conclusions from an inadequate assessment: What can SAT-9 scores tell us about the impact of Proposition 227 in California. Bilingual Research Journal, 24, 141-154.
11. California Academic Performance Index Data Files. (2000). Sacramento, CA: California Department of Education. [On-line database, 8/15/2000] Available: http://api.cde.ca.gov/datafiles.html
12. California Education Code (2001). English language education for immigrant children, Division 1, Part 1, Chapter 3. [On-line]. Available: http://www.leginfo.ca.gov/calaw.html
13. California Language Census Data Files. (2000). Sacramento, CA: California Department of Education. [On-line database, 8/15/2000] Available: http://www.cde.ca.gov/demographics/files/census.htm
14. California Standardized Testing and Reporting (2000). Sacramento, CA: California Department of Education. [On-line database, 8/15/2000] Available: http://star.cde.ca.gov
15. California State Board of Education. (2000). State Monetary Awards Programs Based on the Academic Performance Index. [On-line] Available: http://www.cde.ca.gov/ope/ae/pages/certstaffact.html
16. Californians Together. (2000, August 21). Schools with large enrollments of English learners and substantial bilingual instruction are effective in teaching English [On-line]. Available: http://www.bilingualeducation.org/news. htm
17. Camilli, G., & Bulkley, K. (2001, March 4). Critique of "An evaluation of the Florida A-Plus Accountability and School Choice Program." Educational Policy Analysis Archives, 9 [On-line journal] Available: http://epaa.asu.edu/
18. Campbell, D. T., & Kenny, D. A. (1999). A primer on regression artifacts. New York: Guilford Press.
19. Campbell, D. T., & Stanley, J. C. (1966). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.
20. Campbell, P. R. (1994). Population projections for states by age, race, and sex: 1993 to 2020 (U.S. Bureau of the Census - Current population reports, pp. 17-23). Washington, DC: Government Printing Office.
21. Crawford, J. (1999). Bilingual education: History, politics, theory, and practice. Los Angeles: Bilingual Education Services.
22. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Orlando, FL: Holt, Rinehart, and Wilson.
23. Cronbach, L. J. (1960). Essentials of psychological testing (2nd ed.). New York: Harper.
24. de Cos, P. (1999). Educating California's immigrant children: Overview of bilingual education (CRB-99-010). California Research Bureau.
25. Duran, R. P. (1989). Testing of linguistic minorities. In R. L. Linn (Ed.), Educational measurement (3rd ed.) (pp. 13-103). New York: Macmillan Publishing Company.
26. Eastin (2000). Eastin releases additional STAR 2000 test results. [On-line] Available: http://www.cde.ca.gov/statetests/star/pressrelease2000b.pdf
27. English for the Children. (2000, August 14). After two years of Prop. 227 English immersion, a huge rise in California's immigrant scores; Pro-bilingual education districts lag behind. [On-line]. Available: http://www.yeson227.org/ releases.html
28. Gándera, P. (2000). In the aftermath of the storm: English learners in the post-227 era. Bilingual Research Journal, 24, 1-14.
29. Gándera, P., Maxwell-Jolly, J., Garcia, E., Asato, J., Gutierrez, K., Stritikus, T., & Curry, J. (2000, April). The initial impact of Proposition 227 on the instruction of English learners. [On-line]. Available: http://lmri.ucsb.edu/RESDISS/prop227effects.pdf.
30. Garcia, E. E., & Curry-Rodriguez, J. E. (2000). The education of Limited English Proficient students in California schools: An assessment of the influence of Proposition 227 in selected districts and schools. Bilingual Research Journal, 24, 15-36.
31. Genesee, F. (1984). On Cummins' theoretical framework. In C. Rivera (Ed.) Language proficiency and academic achievement. (pp. 20-27). Clevedon, UK: Multilingual Matters.
32. Glass, G. V, & Hopkins, K. D. (1996). Statistical methods in education and psychology (3rd ed.). Boston: Allyn & Bacon.
33. Gonzalez, D. (2000, November 8). Bilingual education gets rebuke from state voters. Arizona Republic, p. EX1.
34. Greene, J. P. (2001). An evaluation of the Florida A-Plus Accountability and School Choice Program. New York: The Manhattan Institute.
35. Groves, M. (2000, August 15). English skills still the key in test scores; Stanford 9: Results show vast divide in achievement between students who have language fluency and those who don't. Los Angeles Times, p. A3.
36. Gutiérrez, K. D., Asato, J., & Baquedano-Lopez, P. (2000). "English for the Children": The new literacy of the old world order, language policy, and educational reform. Bilingual Research Journal, 24, 87-112.
37. Hakuta, K. (2001). Silence from Oceanside and the future of bilingual education. Stanford University manuscript. Available at http://www.stanford.edu/ ~hakuta/SAT9/Silence%20from%20Oceanside.htm.
38. Harcourt Brace Educational Measurement. (1997a). Sample questions for the Stanford Achievement Test, Ninth Edition. San Antonio, TX: Author. [On-line]. Available: http://www.cde.ca.gov/statetests/star/stanford9.pdf
39. Harcourt Brace Educational Measurement. (1997b). Spring norms book. San Antonio, TX: Author.
40. Harcourt Brace Educational Measurement. (1997c). Technical data report. San Antonio, TX: Author.
41. Hayes, K., & Salazar, J. (2001). Evaluation of the Structured English Immersion Program Final Report: Year I. Language Acquisition and Literacy, Program Evaluation and Research Branch, Los Angeles Unified School District.
42. Juffs, A., & Harrington, M. (1995). Parsing effects in second language sentence processing: Subject and object asymmetries in wh-extraction. Studies in Second Language Acquisition, 17(4), 483-516.
43. Juffs, A., & Harrington, M. (1996). Garden path sentences and error data in second language sentence processing. Language Learning, 46(2), 283-326.
44. Kerr, J. (2000, August 15). English learners show gains. Associated Press.
45. Krashen, S. (1996). Under attack: The case against bilingual education. Culver City, CA: Language Education Associates.
46. Linn, R., Graue, E., & Sanders, N. (1990). Comparing state and district test results to national norms: The validity of claims that "everyone is above average". Educational Measurement: Issues and Practice, 5-14.
47. Macías, R. F., Nishikawa, S., & Venegas, J. (1998). Summary report of the survey of the states' limited English proficient students and available educational programs and services, 1996-97. Washington, DC: National Clearinghouse for Bilingual Education.
48. Maxwell-Jolly, J. (2000). Factors influencing implementation of mandated policy change: Proposition 227 in seven Northern California school districts. Bilingual Research Journal, 24, 37-56.
49. McNeil, L. (2000). Contradictions of school reform: Educational costs of standardized testing. New York: Routledge.
50. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational Measurement (3rd ed.) (pp. 13-103). New York: Macmillan Publishing Company.
51. Meyer, M., & Fienberg, S. (Eds.). (1992). Assessing evaluation studies: The case of bilingual education strategies. Washington, DC: National Academy Press.
52. Moran, C. (2000, July 23). School test gains may be illusory, critics say. San Diego Union-Tribune, p. A1.
53. Moran, C., & Spielvogel, J. (2000, August 15). Students share in test gains; however, the gap between advantaged, disadvantaged has widened, data show. San Diego Union-Tribune, p. B1.
54. Muthén, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28, 338-354.
55. Myles, F. (1996). The acquisition of interrogatives by English learners of French: The role played by structural distance. Jyvaskyla Cross Language Studies, 17, 195-208.
56. New York Times News Service. (2000, August 20). Spanish-speaking pupils gain after cored move to English; students in California improve strikingly with end of bilingual education. The Baltimore Sun, P. 3A.
57. Pilkington, C. L., Piersel, W. C. & Ponterotto, J. G. (1988). Home language as a predictor of first-grade achievement for Anglo- and Mexican-American children. Contemporary Educational Psychology, 13, 1-14.
58. Public Schools Accountability Act. (1999). [On-line] Available: http://www.cde.ca.gov/psaa/
59. Ramirez, D., Pasta, D., Yuen, S., Billings, D., & Ramey, D. (1991). Final report. Longitudinal study of structured English immersion strategy, early-exit and late-exit transitional bilingual education programs for language-miority children. (Vols. 1 & 2). San Mateo, CA: Aguirre International.
60. Rogosa, D. R. (1999). How accurate are the STAR national percentile rank scores for individual students? An interpretive guide. Los Angeles, CA: National Center for Research on Evaluation, Standards, and Student Testing [On-line]. Available: http://cresst96.cse.ucla.edu/CRESST/Reports/drrguide.html
61. Rosenthal, A., Milne, A., Ellman, F., Ginsburg, A., & Baker, K. (1983). A comparison of the effects of language background and socioeconomic status on achievement among elementary-school students. In K. Baker & E. de Kanter (Eds.). Bilingual education: A reappraisal of federal policy. Lexington, MA: Lexington Books.
62. Rossell, C., & Baker, K. (1996). The educational effectiveness of bilingual education. Research in the Teaching of English, 30, 7-74.
63. Sacks, P. (1999). Standardized minds: The high price of America's testing culture and what we can do to change it. Cambridge: Perseus Books.
64. Schirling, E., Contreras, F., & Ayala, C. (2000). Proposition 227: Tales from the schoolhouse. Bilingual Research Journal, 24, 127-140.
65. Simon, T. F., Fico, F., & Lacy, S. (1989). Covering conflict and controversy: Measuring balance, fairness, defamation. Journalism Quarterly, 66, 427-434.
66. Singer, E. & Endreny, P. (1993). Reporting on risk: How the mass media portray accidents, diseases, and other hazards. New York: Russell Sage Foundation.
67. Stabler, E. P. Jr. (1986). Possible contributing factors in test item difficulty: Research memorandum. Princeton, NJ: Educational Testing Service.
68. Stabler, E. P., Jr. (1994). The finite connectivity of linguistic structure. In C. Clifton, L. Frazier, & K. Rayner (Eds.), Perspectives on sentence processing. New York, NY: Erlbaum.
69. Steinberg, J. (2000a, August 20). Increase in test scores counters dire forecasts for bilingual ban. New York Times, p. A1.
70. Steinberg, J. (2000b, August 20). English-only classes appear a success; after ending bilingual programs, California schools see boosts in test scores. Milwaukee Journal Sentinel, p. 3A.
71. Steinberg, J. (2000c, August 20). Rising test scores shock critics of English-only law. The Plain Dealer, p. 21A.
72. Tankard, J., & Ryan, M. (1974). News source perceptions of accuracy in science coverage. Journalism Quarterly, 51, 219-225, 334.
73. Thompson, M. S. (April, 2000). Investigating dependency at the classroom and school levels in educational research: A multilevel approach. Presented at the Annual Meeting of the American Educational Research Association, New Orleans, Louisiana.
74. Ulibarri, D. M., Spencer, M. L., & Rivas, G. A. (1981). Language proficiency and academic achievement: A study of language proficiency tests and their relationship to school ratings as predictors of academic achievement. NABE Journal, 5, 47-80.
75. United States Department of Education. (1994). Summary of the bilingual education state educational agency program survey of states' limited English proficient persons and available educational services (1992-1993): Final report. Arlington, VA: Development Associates.
76. United States Department of Education. (1997). 1993-94 schools and staffing survey: A profile of policies and practices for limited English proficient students: Screening methods, program support, and teacher training. Washington, D.C.: U.S. Department of Education. [On-line]. Available: http://nces.ed.gov/pubs/97472.pdf
77. Weiss, C., & Singer, E. (1987). Reporting of social science in the national media. New York: Russell Sage Foundation.
78. Willen, L., & Kowal, J. (2000, September 9). Study: Bilingual ed falling short. Newsday, p. A10.
79. Willig, A. (1985). A meta-analysis of selected studies on the effectiveness of bilingual education. Review of Educational Research, 55, 269-318.
80. Wright, C. R., & Michael, W. B. (1989). The relationship of average scores of seniors in 172 southern California high schools on a statewide standardized achievement test to percentages of families receiving federal aid and to percentages of limited-English proficient speakers. Educational and Psychological Measurement, 49, 937-944.