Design, validation, and use of an evaluation instrument for monitoring systemic reform

Journal of Research in Science Teaching

Volumn 38, Issue 6, 2001, Pages 646-662

  Scantlebury, Kathryn ^a   Boone, William ^b   Kahle, Jane Butler ^c   Fraser, Barry J ^d  

^a UNIVERSITY OF DELAWARE   (United States)

^b INDIANA UNIVERSITY   (United States)

^c MIAMI UNIVERSITY   (United States)

^d CURTIN UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0035422936     PISSN: 00224308     EISSN: None     Source Type: Journal    
DOI: 10.1002/tea.1024     Document Type: Article

References (54)

1. Boone, W.J. (1998a). Assumptions, caution, and solutions in the use of omitted test data to evaluate the achievement of underrepresented groups on science: Implications for long-term evaluation. Journal of Women and Minorities in Science and Engineering, 4, 183-194.
2. Boone, W.J. (1998b, April). Test item measurement - Key steps to accurately calculating achievement measures. Paper presented at the annual meeting of the National Association for Research in Science Teaching, San Diego, CA.
3. Chubin, D. (1997). What have we learned about systems and their reform? In W. Clune., S. Millar, S. Raizen, N. Webb, D. Bowcock, E. Britton, R. Gunter, & R. Mesquita (Eds.), Workshop Report No. 4 - Research on systemic reform: What have we learned? What do we need to know? Synthesis of Second Annual NISE Forum Vol. 2: Proceedings (pp. 21-23). Madison, WI: National Institute for Science Education, University of Wisconsin-Madison.
4. Clune, W., & Webb, N. (1997). An introduction to the papers and think piece themes. In W. Clune, S. Millar, S. Raizen, N. Webb, D. Bowcock, E. Britton, R. Gunter, & R. Mesquita (Eds.), Workshop Report No. 4 - Research on systemic reform: What have we learned? What do we need to know? Synthesis of Second Annual NISE Forum Vol. 1: Analysis (pp. 6-12). Madison, WI: National Institute for Science Education, University of Wisconsin-Madison.
5. Coleman, J.S., Campbell, E.Q., Hobson, C.J., McPartland, J., Mood, A.M., Weinfield, F.D., & York, R.L. (1966). Equality of educational opportunity. Washington, DC: U.S. Office of Education.
6. Cronin-Jones, L., & Shaw, E. (1992). The influence of methods instruction on the beliefs of preservice elementary and secondary science teachers: Preliminary comparative analysis. School Science and Mathematics, 92, 14-22.
7. Damnjanovic, A. (1998). Ohio State-wide Systemic Initiative (SSI) factors associated with urban middle school science achievement: Differences by student sex and race. Journal of Women and Minorities in Science and Engineering, 4, 217-234.
8. Eccles, J. (1989). Bringing young women to math and science. In M. Crawford & M. Gentry (Eds.), Gender and thought: Psychological perspectives (pp. 36-58). New York: Springer-Verlag.
9. Enochs, L., Riggs, R., & Ellis, J. (1993). The development and partial validation of microcomputer utilization in teaching efficacy beliefs instrument in a science setting. School Science and Mathematics, 93, 257-263.
10. Fraser, B.J. (1981). Test of Science-Related Attitudes handbook (TOSRA). Melbourne, Australia: Australian Council for Educational Research.
11. Fraser, B. (1986). Classroom environment. London: Croom Helm.
12. Fraser, B. (1994). Research on classroom and school climate. In D. Gabel (Ed.), Handbook of research on science teaching and learning (pp. 493-541). New York: Macmillan.
13. Fraser, B.J. (1998a). Science learning environments: Assessment, effects and determinants. In B.J. Fraser & K.G. Tobin (Eds.), International handbook of science education (pp. 527-564). Dordrecht, The Netherlands: Kluwer.
14. Fraser, B.J. (1998b). Classroom environment instruments: Development, validity and applications. Learning Environments Research, 1, 7-33.
15. Fraser, B.J. (1998c). The birth of a new journal: Editor's introduction. Learning Environments Research, 1, 1-5.
16. Fraser, B. (1999). "Grain sizes" in learning environment research: Combining qualitative and quantitative methods. In H. Waxman & H.J. Walberg (Eds.), New directions for teaching practice and research (pp. 285-296). Berkeley, CA: McCutchan.
17. Fraser, B., & Fisher, D. (1983). Student achievement as a function of person-environment fit: A regression surface analysis. British Journal of Educational Psychology, 53, 89-99.
18. Fraser, B.J., Giddings, G., & McRobbie, C. (1995). Evolution and validation of a personal form of an instrument for assessing science laboratory classroom environments. Journal of Research in Science Teaching, 32, 399-422.
19. Fraser, B.J., & Walberg, H.J. (Eds.). (1991). Educational environments: Evaluation, antecedents and consequences. Oxford, UK: Pergamon Press.
20. Fraser, B., Walberg, H., Welch, W., & Hattie, J. (1987). Syntheses of educational product research [Special issue]. International Journal of Educational Research, 11(2).
21. Fraser, B., Welch, W., & Walberg, H. (1986). Using secondary analysis of national assessment data to identify predictors of junior high school students' outcomes. Alberta Journal of Educational Research, 22, 37-50.
22. Goh, S.C., Young, D., & Fraser, B.J. (1995). Psychosocial climate and student outcomes in elementary mathematics classrooms: A multilevel analysis. Journal of Experimental Education, 43, 90-93.
23. Heck, D. (1999, February). Understanding evaluation of systemic reform: Purposes and vision for evaluation. Paper presented at Fourth Annual National Institute for Science Education Forum, Washington, DC.
24. Kahle, J.B. (1997). Systemic reform: Challenges and changes. Science Educator, 6, 1-6.
25. Kahle, J.B. (1999, February). Discovering from Discovery: The evaluation of Ohio's systemic reform. Paper presented at Fourth Annual National Institute for Science Education Forum, Washington, DC.
26. Kelleghan, T., Sloan, K., Alvarez, B., & Bloom, B. (1993). The home environment and school learning: Promoting parental involvement in the education of children. San Francisco: Jossey-Bass.
27. Ladson-Billings, G. (1994). The dreamkeepers: Successful teachers of African American children. San Francisco: Jossey-Bass.
28. Lewin, K. (1936). Principals of topological psychology. New York: McGraw.
29. Linacre, John M. (1999). Investigating rating scale category utility. Journal of Outcome Measurement, 3, 103-122.
30. Loevinger, J. (1965). Person and population as psychometric concepts. Psychological Review, 72, 143-155.
31. Marjoribanks, K. (1999). Environmental and individual influences on adolescents' aspirations: A moderation-mediation model. Learning Environments Research, 2, 43-64.
32. Moos, R.H. (1974). The Social Climate Scales: An overview. Palo Alto, CA: Consulting Psychologist Press.
33. Moos, R.H. (1991). Connections between school, work, and family settings. In B.J. Fraser & H.J. Walberg (Eds.), Educational environments: Evaluation, antecedents and consequences (pp. 29-53). Oxford, UK: Pergamon Press.
34. Mullis, I.V.S., & Jenkins, L.B. (1988). The science report card: Elements of risk and recovery. Princeton, NJ: Educational Testing Service.
35. National Council of Teachers of Mathematics. (1989). Curriculum and evaluation standards for school mathematics. Reston, Va: Author.
36. National Research Council. (1996). National science education standards. Washington, DC: National Academy Press.
37. National Science Foundation. (1998, January). Infusing equity in systemic reform: An implementation scheme. Washington, DC: Author.
38. Porter, A.C. (1993). Opportunity to learn (Brief No. 7). Madison, WI: University of Wisconsin, Center on Organization and Restructuring of Schools.
39. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danmarks Paedagogiske Institut.
40. Shemesh, M., Eckstein, S., & Lazarowitz, R. (1992). An experimental study of the development of formal reasoning among secondary school students. School Science and Mathematics, 92, 26-30.
41. Simpson, R.D., & Oliver, J.S. (1990). A summary of major influences on attitude toward and achievement in science among adolescent student. Science Education, 74, 1-18.
42. Stern, G.G. (1970). People in context: Measuring person-environment congruence in education and industry. New York: Wiley.
43. Stevens, F.I. (1993). Opportunity to learn: Issues of equity for poor and minority students (Report NCES 93-232). Washington, D.C.: U.S. Department of Education, Office of Educational Research and Improvement, National Center for Education Statistics.
44. Sunal, D. (1991). Rural school science teaching: What affects achievement? School Science and Mathematics, 91, 202-210.
45. Taylor, P., Fraser, B.J., & Fisher, D.L. (1997). Monitoring constructivist classroom learning environments. International Journal of Educational Research, 27, 293-302.
46. Tobin, K., & Fraser, B. (1998). Qualitative and quantitative landscapes of classroom learning environments. In B.J. Fraser & K.G. Tobin (Eds.), International handbook of science education (pp. 623-640). Dordrecht, The Netherlands: Kluwer.
47. Walberg, H.J. (1979). Educational environments and effects: Evaluation, policy and productivity. Berkeley, CA: McCutchan.
48. Walberg, H.J. (1981). A psychological theory of educational productivity. In F.H. Farley & N.J. Gordon (Eds.), Psychology and education: The state of the union (pp. 81-108). Berkeley, CA: McCutchan.
49. Walberg, H.J., Fraser, B.J., & Welch, W.W. (1986). A test of a model of educational productivity among senior high school students. Journal of Educational Research, 23, 699-706.
50. Webb, N.L. (1998). Conditional equity metrics as tools for evaluating equity in schools and educational systems. Journal of Women and Minorities in Science and Engineering, 4, 141-160.
51. Webb, N.L. (1999, February). Challenges to evaluating systemic reform. Paper presented at Fourth Annual National Institute for Science Education Forum, Washington, DC.
52. Witte, J.F. (1996). Achievement testing in systemic educational reform: How to incorporate class, gender, race and disability differences. Unpublished paper, University of Wisconsin-Madison, Robert M. La Follette Institute of Public Affairs.
53. Wright, B.D. (1968). Sample-free test calibration and person measurement. In Proceedings of the 1967 Invitational Conference on Testing Problems. Princeton, NJ: Educational Testing Service.
54. Wright, B.D., & Masters, G.N. (1982). Rating scale analysis. Chicago: Mesa Press, University of Chicago.