Developing indicators of classroom practice to evaluate the impact of district mathematics reform initiative: A generalizability analysis

Studies in Educational Evaluation

Volumn 36, Issue 1-2, 2010, Pages 1-13

  Newton, Xiaoxia A ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Classroom practice indicators; Cost effective consideration; District initiative evaluation; Evaluation practice; Generalizability analysis

Indexed keywords

EID: 78649671298     PISSN: 0191491X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.stueduc.2010.10.002     Document Type: Article

References (34)

1. American Evaluation Association. (2004). AEA guiding principles for evaluators. Accessible at: http://www.eval.org/Publications/GuidingPrinciples.asp.
2. Aschbacher P. Developing indictors of classroom practice to monitor and support school reform (CSE Technical Report, No. 513) 1999, University of California, National Center for Research on Evaluation, Standards, and Student Testing, Los Angeles.
3. Berk R., Rossi P. Thinking about program evaluation 1999, Sage Publications, Inc., Thousand Oaks, CA. 2nd ed.
4. Booth C.L., Mitchell S.K., Solin F.K. The generalizability study as a method of assessing intra- and interobserver reliability in observational research. Behavior Research Methods and Instrumentation 1979, 11(5):491-494.
5. Brennan R.L. Generalizability theory 2001, Springer-Verlag, New York, NY.
6. Burstein L., McDonnell L., Van Winkle J., Ormseth T., Mirocha J., Guitton G. Validating national curriculum indicators 1995, RAND, Santa Monica, CA.
7. Chazan D. Beyond formulas in mathematics and teaching: Dynamics of the high school algebra classroom 2000, Teachers College Press, New York, NY.
8. Clare L. Using teachers' assignments as an indictor of classroom practice (CSE Technical Report, No. 532) 2000, University of California, National Center for Research on Evaluation, Standards, and Student Testing, Los Angeles.
9. Cohen E. Restructuring the classroom: Conditions for productive small groups. Review of Educational Research 1994, 64(1):1-35.
10. Cronbach L.J., Gleser G.C., Nanda H., Rajaratnam N. The dependability of behavioral measurements: Theory of generalizability of scores and profiles 1972, John Wiley, New York.
11. Cronbach L.J., Rajaratnam N., Gleser G.C. Theory of generalizability: A liberalization of reliability theory. British Journal of Statistical Psychology 1963, 16:137-163.
12. Doyle W. Work in mathematics classes: The context of students' thinking during instruction. Educational Psychologist 1988, 23(2):167-180.
13. Duffy G. Teacher effectiveness research: Implications for the reading profession. Directions in reading: Research and instruction (30th yearbook of the Nation Reading Conference) 1981, 113-136. National Reading Conference, Washington, DC. M. Kamil (Ed.).
14. Erlich O., Borich G. Occurrence and generalizability of scores on a classroom interaction instrument. Journal of Educational Measurement 1979, 16(1):11-18.
15. Evertson C., Weade R. Classroom management and teaching style: Instructional stability and variability in two junior high English classrooms. The Elementary School Journal 1989, 89(3):378-393.
16. Haertel E. New forms of teacher assessment. Review of Research in Education 1991, 17:3-29.
17. Hiebert J., Carpenter T., Fennema E., Fuson K., Wearne D., Murray H., et al. Making sense: Teaching and learning mathematics with understanding 1997, Heinemann, Portsmouth, NH.
18. Kennedy M. Approximations to indicators of student outcomes. Educational Evaluation and Policy Analysis 1999, 21(4):345-363.
19. Marcoullides G.A. The application of generalizability analysis to observational studies. Quality & Quantity: The International Journal of Methodology 1989, 23(2):115-127.
20. Marcoullides G.A. Maximizing power in generalizability studies under budget constraints. Journal of Educational and Behavioral Statistics 1993, 18(2):197-206.
21. Marcoullides G.A., Goldstein Z. The optimization of generalizability studies with resource constraints. Educational and Psychological Measurement 1990, 50(4):782-789.
22. Marcoullides G.A., Goldstein Z. Selecting the number of observations in multivariate measurement studies under budget constraints. Educational and Psychological Measurement 1991, 51(3):573-584.
23. Mayer D. Measuring instructional practice: Can policymakers trust survey data?. Educational Evaluation and Policy Analysis 1999, 21(1):29-45.
24. Shadish W.R., Cook T.D., Leviton L.C. Foundations of program evaluation: Theories of practice 1991, Sage Publications, Newbury Park, CA.
25. Shavelson R., Dempsey-Atwood N. Generalizability of measures of teaching behavior. Review of Educational Research 1976, 46(4):553-611.
26. Shavelson R., Webb N. Generalizability theory: A primer 1991, Sage Publications, Inc., Newbury, CA.
27. Spillane J., Jennings N. Aligned instructional policy and ambitious pedagogy: Exploring instructional reform from the classroom perspective. Teachers College Record 1997, 98(3):449-481.
28. Spillane J., Zeuli J. Reform and teaching: Exploring patterns of practice in the context of national and state mathematics reforms. Educational Evaluation and Policy Analysis 1999, 21(1):1-27.
29. Stevenson H., Stigler J. The learning gap: Why our schools are failing and what we can learn from Japanese and Chinese education 1992, Summit Books, Simon & Schuster Inc., New York, NY.
30. Stigler J., Lee S., Stevenson H. Mathematical knowledge of Japanese, Chinese, and American elementary school children 1990, The National Council of Teachers of Mathematics, Reston, VA.
31. Tharp R., Gallimore R. Rousing minds to life: Teaching, learning, and schooling in social context 1988, Cambridge University Press, Cambridge, MA.
32. The Joint Committee on Standards for Educational Evaluation The program evaluation standards 1994, Sage, Newbury Park, CA. 2nd ed.
33. U.S.Department of Education The TIMSS videotape classroom study: Methods and findings from an exploratory research project on eighth-grade mathematics instruction in Germany, Japan and the United States 1999, U.S. Government Printing Office, Washington, DC.
34. Webb N.M., Shavelson R.J., Haertel E.H. Reliability coefficients and generalizability theory. Handbook of Statistics 2007, 26. ISSN: 0169-7161. 10.1016/S0169-7161(06)26004-8.