Variability analysis for effectiveness and improvement in classrooms and schools in upper secondary education in Slovenia: Assessment of/for Learning Analytic Tool

School Effectiveness and School Improvement

Volumn 20, Issue 1, 2009, Pages 89-122

  Zupanc, Darko ^a   Urank, Matjaž ^a   Bren, Matevž ^b  

^a National Examinations Centre   (Slovenia)

^b UNIVERSITY OF MARIBOR   (Slovenia)

Author keywords

Data analysis tool; Data gathering; Effectiveness; Feedback system; Formative and summative assessment; School performance

Indexed keywords

EID: 68149165444     PISSN: 09243453     EISSN: 17445124     Source Type: Journal    
DOI: 10.1080/09243450802696695     Document Type: Review

References (59)

1. Allal, L. (1979). Stratégies d'évaluation formative: Conceptions psychopédagogiques et modalités d'application [Strategies of formative assessment: Psycho-pedagogical conceptions and models of application]. In L. Allal, J. Cardinet, & P. Perrenoud (Eds.), L'évaluation formative dans un enseignement différencié (pp. 153-183). Bern, Switzerland: Peter Lang.
2. Allal, L., & Mottier Lopez, L. (2005). Formative assessment of learning: A review of publications in French. Formative assessment - Improving learning in secondary classrooms (pp. 241-264). Paris: OECD.
3. Black, P., & William, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy and Practice, 5(1), 7-74.
4. Brejc, M., & Trunk Širca, N. (2007). Sistemi vodenja kakovosti - Sinergija med notranjo in zunanjo evalvacijo [Quality management systems - Synergy between internal and external evaluation]. Vodenje v vzgoji in izobraževanju [Leadership in education], 5(2), 41-50.
5. Bren, M., Zupanc, D., & Blejec, A. (2007, September). Grades from 1 to 5 or A to E: From theory to practice. Paper presented at the 23rd International Conference Applied Statistics, Ribno Bled, Slovenia.
6. Bucik, V. (2001). Predictive validity of the Slovene Matura. Horizons of Psychology, 10(3), 75- 87.
7. Burstein, L. (1980). The role of levels of analysis in the specification of educational effects. In R. Dreeben & J.A. Thomas (Eds.), The analysis of educational productivity. Vol. 1: Issues in microanalysis (pp. 116-190). Cambridge, MA: Ballinger.
8. Cankar, G. (2000). Predictive validity of Matura for the psychology study. Horizons of Psychology, 9(1), 59-68.
9. Coe, R. (2002). Evidence on the role and impact of performance feedback in schools. In A.J. Visscher & R. Coe (Eds.), School improvement through performance feedback (pp. 3-26). Lisse, The Netherlands: Swets & Zeitlinger.
10. Coe, R., & Visscher, A.J. (2002). Introduction. In A.J. Visscher & R. Coe (Eds.), School improvement through performance feedback (pp. xi-xviii). Lisse, The Netherlands: Swets & Zeitlinger.
11. Creemers, B.P.M., & Kyriakides, L. (2006). Critical analysis of the current approaches to modelling educational effectiveness: The importance of establishing a dynamic model. School Effectiveness and School Improvement, 17, 347-366.
12. Creemers, B.P.M., & Kyriakides, L. (2008). The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools. London/New York: Routledge.
13. Crighton, J. (2003). Assessment: General overview of international practice (Education Support Program, Open Society Institute, 1-22). Retrieved September 12, 2006, from http:// www.soros.org/initiatives/esp/ articles-publications/general-20030801/overview-20030801. pdf
14. Cronbach, L.J., Linn, R.L., Brennan, R.L., & Haertel, E.H. (1997). Generalizability analysis for performance assessments of student's achievement or school effectiveness. Educational and Psychological Measurement, 57(3), 373-399.
15. De Fraine, B., Van Damme, J., Van Landeghem, G., Opdenakker, M.-C., & Onghena, P. (2003). The effect of schools and classes on language achievement. British Educational Research Journal, 29(6), 841-859.
16. Deming, W.E. (1986). Out of the crisis. Cambridge, MA: Massachusetts Institute of Technology, Center for Advanced Engineering Study.
17. European Union. (2001). Qualitative assessment of school education (Activities of the European Union, Summaries of Legislation). Retrieved November 2, 2005, from http:// europa.eu/scadplus/leg/en/cha/c11038b.htm
18. Fertig, M. (2000). Old wine in new bottles? Researching effective schools in developing countries. School Effectiveness and School Improvement, 11, 385-403.
19. Fitz-Gibbon, C.T., & Tymms, P. (2002). Technical and ethical issues in indicator systems: Doing things right and doing wrong things. Education Policy Analysis Archives, 10(6). Retrieved February 8, 2008, from http://epaa.asu.edu/epaa/v10n6/
20. Fullan, M., & Watson, N. (2000). School-based management: Reconceptualizing to improve learning outcomes. School Effectiveness and School Improvement, 11, 453-473.
21. Gabrscek, S. (2001). Access to higher education in Slovenia: Assessment reform and recreation of a national examination. Assessment in Education: Principles, policy & practice, 8(3), 369-390.
22. Gray, J. (2002). Jolts and reactions: Two decades on feeding back information on schools' performance. In A.J. Visscher & R. Coe (Eds.), School improvement through performance feedback (pp. 143-162). Lisse, The Netherlands: Swets & Zeitlinger.
23. Guion, R.M. (1995). Commentary on values and standards in performance assessment. Educational Measurement: Issues and Practice, 14(4), 25-27.
24. Hendriks, M.A., Doolaard, S., & Bosker, R.J. (2002). Using school effectiveness as a knowledge base for self-evaluation in Dutch schools: The ZEBO-project. In A.J. Visscher & R. Coe (Eds.), School improvement through performance feedback (pp. 115-142). Lisse, The Netherlands: Swets & Zeitlinger.
25. Koren, A. (2007). Centralisation and autonomy: A case study of ''constructed'' views. International Journal of Innovation and Learning, 4(5), 487-500.
26. Kyriakides, L. (2005). Extending the comprehensive model of educational effectiveness by an empirical investigation. School Effectiveness and School Improvement, 16(2), 103-152.
27. Kyriakides, L., Campbell, R.J., & Gagatsis, A. (2000). The significance of the classroom effect in primary schools: An application of Creemers' comprehensive model of educational effectiveness. School Effectiveness and School Improvement, 11, 501-529.
28. Lee, V., Bryk, A., & Smith, J. (1993). Organization of effective secondary schools. Review of Research in Education, 19, 171-226.
29. Leicester City Council. (2006). Matters arising. Retrieved February 8, 2008, from www.leicester.gov.uk/EasySite/lib/serveDocument.asp?doc= 68888&pgid=81693
30. Linn, R.L., & Gronlund, N.E. (2000). Measurement and Assessment in teaching (8th ed.). New York: Upper Saddle River, Merrilll/Prentice Hall.
31. McGaw, B. (2006, May). Assessment fit for purpose. Paper presented at the 32nd Annual Conference of the International Association for Educational Assessment, Singapore.
32. Mortimore, P., Sammons, P., Stoll, L., Lewis, D., & Ecob, R. (1988). School matters: The junior years. London: Paul Chapman.
33. Muijs, D., & Reynolds, D. (2000). School effectiveness and teacher effectiveness in mathematics: Some preliminary findings from the Evaluation of the Mathematics Enhancement Programme (Primary). School Effectiveness and School Improvement, 11, 273-303.
34. National Foundation for Educational Research. (2006). Glossary. Retrieved December 31, 2006, from http://www.nfer-nelson.co.uk/glossary/ glossary.asp?css=1
35. Opdenakker, M.-C, Van Damme, J., De Fraine, B., Van Landeghem, G., & Onghena, P. (2002). The effect of schools and classes on mathematics achievement. School Effectiveness and School Improvement, 13, 399-427.
36. Organisation for Economic Co-operation and Development. (2005). Formative assessment-Improving learning in secondary classrooms. Paris: Organisation for Economic Cooperation and Development.
37. Reynolds, D. (1998). ''World Class'' school improvement: An analysis of the implications of recent international school effectiveness and school improvement research for improvement practice. In A. Hargreaves, A. Lieberman, M. Fullan, & D. Hopkins (Eds.), International handbook of educational change (pp. 1275-1285). Dordrecht, The Netherlands: Kluwer Academic Publishers.
38. Reezigt, G.J., Guldemond, H, & Creemers, B.P.M. (1999). Empirical validity for a comprehensive model on educational effectiveness. School Effectiveness and School Improvement, 10, 193-216.
39. Rowe, K.J., Turner, R., & Lane, K. (2002). Performance feedback to schools of students' Year 12 assessments: The VCED data project. In A.J. Visscher & R. Coe (Eds.), School improvement through performance feedback (pp. 163-190). Lisse, The Netherlands: Swets & Zeitlinger.
40. Sanocki, T. (2001). Student friendly statistics. New York: Prentice Hall.
41. Scheerens, J., & Bosker, R. (1997). The foundations of educational effectiveness. Oxford, UK: Pergamon.
42. Scheerens, J., Glas, C, & Thomas, S.M. (2007). Educational evaluation, assessment, and monitoring: A systematic approach. New York: Taylor & Francis.
43. Siegel, S., & Castellan, N.J., Jr. (1988). Nonparametric statistics for the behavioral sciences. New York: McGraw-Hill.
44. Šimenc, M. (Ed.). (2007). Letno poročilo - splošna matura 2007 [Matura annual report 2007]. Ljubljana, Slovenia: Državni izpitni center.
45. Slivar, B. (1998). Mnenja ravnateljev, učiteljev in dijakov [Head teacher', teachers' and students' opinions]. In F. Brešar (Ed.), Notranje vrednotenje mature [Internal Matura evaluation] (pp. 50-61). Ljubljana, Slovenia: Državni izpitni center.
46. Sočan, G. (2000). Assessment of reliability of Matura examinations. Horizons of Psychology, 9(1), 79-90.
47. Stubbs, B. (2004). Student performance analysis - Value-added analysis of GCSE and A level examination results. Retrieved August 28, 2007, from http://www.bstubbs.co.uk/ Welcome.htm
48. Teddlie, C, Kochan, S., & Taylor, D. (2002). The ABC+ Model for School Diagnosis, Feedback, and Improvement. In A.J. Visscher & R. Coe (Eds.), School improvement through performance feedback (pp. 75-114). Lisse, The Netherlands: Swets & Zeitlinger.
49. Teddlie, C, & Reynolds, D. (2000). The international handbook of school effectiveness research. London: Falmer Press.
50. Topping, K.J., & Sanders, W.L. (2000). Teacher effectiveness and computer assessment of reading. Relating value added and learning information system data. School Effectiveness and School Improvement, 11, 305-337.
51. Tymms, P., & Albone, S. (2002). Performance indicators in primary schools. In A.J. Visscher & R. Coe (Eds.), School improvement through performance feedback (pp. 191-218). Lisse, The Netherlands: Swets & Zeitlinger.
52. Van Landeghem, G., Van Damme, J., Opdenakker, M.-C, De Fraine, B., & Onghena, P. (2002). The effect of schools and classes on noncognitive outcomes. School Effectiveness and School Improvement, 13, 429-451.
53. Verhaeghe, J.-P. (2006). Research projects. Retrieved February 8, 2008, from http:// ppw.kuleuven.be/coe/research.htm
54. Visscher, A.J. (2002). A framework for studying school performance feedback systems. In A.J. Visscher & R. Coe (Eds.), School improvement through performance feedback (pp. 41-72). Lisse, The Netherlands: Swets & Zeitlinger.
55. Visscher, A.J., & Coe, R. (2003). School performance feedback systems: Conceptualisation, analysis, and reflection. School Effectiveness and School Improvement, 14, 321-349.
56. Zupanc, D. (2005). Standardi znanja v slovenski soli [Knowledge standards in the Slovenian schools]. Sodobna pedagogika [Contemporary Pedagogy], 56(1), 124-147.
57. Zupanc, D. (2006). Javno objavljanje izpitnih rezultatov po solah [Public announcing of schools' exam results]. Vodenje v vzgoji in izobraževanju [Leadership in education], 4(1), 5-32.
58. Zupanc, D., & Bren, M. (2007, September). Public examination system as a support for teaching and learning improvement in Slovenia - Assessment for Learning Analytic Tool. Paper presented at the 33rd Annual Conference of the International Association for Educational Assessment, Baku, Azerbaijan.
59. Webster, B.J., & Fisher, D.L. (2000). Accounting for variation in science and mathematics achievement: A multilevel analysis of Australian data Third International Mathematics and Science Study (TIMSS). School Effectiveness and School Improvement, 11, 339-360.