The effect of clustering on statistical tests: An illustration using classroom environment data

Educational Psychology

Volumn 28, Issue 5, 2008, Pages 583-595

  Dorman, Jeffrey Paul ^a  

^a AUSTRALIAN CATHOLIC UNIVERSITY   (Australia)

Author keywords

Classroom environment; Instrument; Secondary

Indexed keywords

EID: 47749154808     PISSN: 01443410     EISSN: 14695820     Source Type: Journal    
DOI: 10.1080/01443410801954201     Document Type: Article

References (56)

1. Alker, H.R. (1969). A typology of ecological fallacies. In H. Dogan & S. Rokkan (Eds.), Quantitative ecological analysis in the social sciences (pp. 69-86). London: MIT Press.
2. Allen, D., & Fraser, B.J. (2007). Parent and student perceptions of the classroom learning environment and its association with student outcomes. Learning Environments Research, 10, 67-82.
3. Anderson, L. (1981). Assessing affective characteristics in the schools. Boston, MA: Allyn & Bacon.
4. Antia, S.D., Sabers, D.L., & Stinson, M.S. (2006). Validity and reliability of the Classroom Participation Questionnaire with deaf and hard of hearing students in public schools. Journal of Deaf Studies and Deaf Education, 12, 158-171.
5. Aitkin, M., & Longford, N. (1986). Statistical modelling issues in school effectiveness studies (with discussion). Journal of the Royal Statistical Society, Series A, 149, 1-43.
6. Azimioara, M., & Fraser, B.J. (2007, April). The effect of extended instructional time on learning environment, achievement, and attitudes in middle schools algebra classes. Paper presented at the annual meeting of the American Educational Research Association, Chicago.
7. Burstein, L. (1980). The analysis of multi-level data in educational research and evaluation. In D.C. Berliner (Ed.), Review of research in education, Vol. 8 (pp. 158-233). Washington: American Educational Research Association.
8. Cavanagh, R.F., & Romanoski, J.T. (2006). Rating scale instruments and measurement. Learning Environments Research, 9, 273-289.
9. Cronbach, L.J. (1976). Research on classrooms and schools: Formulation of questions, design and analysis. Occasional paper of the Stanford Evaluation Consortium. Stanford, CA: Stanford University.
10. den Brok, P., Brekelmans, M., & Wubbels, T. (2006). Multilevel issues in research using students' perceptions of learning environments: The case of the Questionnaire on Teacher Interaction. Learning Environments Research, 9, 199-213.
11. Dorman, J.P. (1994). A study of school and classroom environments in Queensland Catholic secondary schools. Unpublished PhD thesis, Curtin University of Technology, Perth, Australia.
12. Dorman, J.P. (2002). Classroom environment research: Progress and possibilities. Queensland Journal of Educational Research, 18, 112-140.
13. Dorman, J.P. (2003). Cross national validation of the What Is Happening In this Class? questionnaire using confirmatory factor analysis. Learning Environments Research, 6, 231-245.
14. Dorman, J.P. (in press a). Partitioning the variance in scores on classroom environment instruments. Journal of Educational Research.
15. Dorman, J.P. (in press b). Use of multitrait-multimethod modelling to validate actual and preferred forms of the 'What Is Happening In this Class?' questionnaire. Learning Environments Research.
16. Dorman, J.P., McRobbie, C.J., & Foster, W.J. (2002). Associations between psychosocial environment in religious education classes and students' attitude to Christianity. Religious Education, 97, 23-42.
17. Fiedler, M.L. (1975). Bidirectionality of influence in classroom interaction. Journal of Educational Psychology, 67, 735-744.
18. Fisher, D.L., & Khine, M.S. (Eds.). (2006). Contemporary approaches to research on learning environments. Singapore: World Scientific.
19. Freilich, M., Kesner, M., & Hofstein, A. (2007). The influence of web-based chemistry learning on students' perceptions, attitudes, and achievements. Research in Science and Technological Education, 25, 179-197.
20. Fraser, B.J. (1986). Classroom environment. London: Croom Helm.
21. Fraser, B.J. (1990). Individualised classroom environment questionnaire. Melbourne, NSW: Australian Council for Educational Research.
22. Fraser, B.J. (1998). Science learning environments: Assessments, effects and determinants. In B.J. Fraser & K.G. Tobin (Eds.), International handbook of science education (pp. 527-564). Dordrecht, the Netherlands: Kluwer.
23. Fraser, B.J., Anderson, G.J., & Walberg, H.J. (1982). Assessment of learning environments: Manual for learning environment inventory (LEI) and My Class Inventory (MCI) (3rd version). Perth: Western Australian Institute of Technology.
24. Fraser, B.J., Giddings, G.J., & McRobbie, C.J. (1995). Evolution and validation of a personal form of an instrument for assessing science laboratory classroom environment. Journal of Research in Science Teaching, 32, 399-422.
25. Freedman, D.A. (1999). Ecological inference and the ecological fallacy. Report prepared for the International Encyclopedia of the Social and Behavioral Sciences (Technical Report no. 549). Retrieved August 30, 2007, from http://www.stanford.edu/class/ed260/freedman549.pdf
26. Goh, S.C., & Fraser, B.J. (1998). Teacher interpersonal behaviour, classroom environment and student outcomes in primary mathematics in Singapore. Learning Environments Research, 1, 199-229.
27. Goldstein, H. (2003). Multilevel statistical models (3rd ed.). London: Edward Arnold.
28. Goldstein, H. (2004). Some observations on the definition and estimation of effect sizes. In I. Schagen & K. Elliot (Eds.), But what does it mean? The use of effect sizes in educational research (pp. 67-71). Slough, UK: NFER.
29. Goldstein, H., Browne, W., & Rasbash, J. (2002). Partitioning variation in multilevel models. Understanding Statistics, 1, 223-231.
30. Hedges, L.V. (2007). Correcting a significance test for clustering. Journal of Educational and Behavioral Statistics, 32, 151-179.
31. Hedges, L.V., & Hedberg, E.C. (2007). Intraclass correlations for planning group-randomised trials in education. Educational Evaluation and Policy Analysis, 29, 60-87.
32. Hox, J.J. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Erlbaum.
33. Khine, M.S., & Fisher, D.L. (Eds.). (2003). Technology-rich learning environments: A future perspective. Singapore: World Scientific.
34. Kunter, M., & Baumert, J. (2006). Who is the expert? Construct and criteria validity of student and teacher ratings of instruction. Learning Environments Research, 9, 231-251.
35. Lee, V.E. (2000). Using hierarchical linear modeling to study social contexts: The case of school effects. Educational Psychologist, 35, 125-141.
36. Logan, K. A. (2007). Should computing be taught in single-sex environments? An analysis of the computing learning environment of upper secondary students. Educational Studies, 33, 233-248.
37. Moos, R.H., & Trickett, E.J. (1987). Classroom Environment Scale manual (2nd ed.). Palo Alto, CA: Consulting Psychologists Press.
38. Murray, H.A. (1938). Explorations in personality. New York: Oxford University Press.
39. Patrick, H., Ryan, A.M., & Kaplan, A. (2007). Early adolescents' perceptions of the classroom social environment, motivational beliefs, and engagement. Journal of Educational Psychology, 99, 83-98.
40. Rasbash, J., Steele, F., Browne, W., & Prosser, B. (2005). A user's guide to MLwiN version 2.0. Bristol, UK: Centre for Multilevel Modelling, University of Bristol.
41. Raudenbush, S., & Bryk, A. (2002). Hierarchical linear models. Thousand Oaks, CA: Sage.
42. Raudenbush, S.W., & Willms, J.D. (Eds.). (1991). Schools, classrooms and pupils: International studies of schooling from multilevel perspective. San Diego, CA: Academic.
43. Rosenshine, B. (1970). Evaluation of classroom instruction. Review of Educational Research, 40, 279-300.
44. Rowe, K.J. (2007). Practical multilevel analysis with MLwiN and LISREL: An integrated course (7th ed.). Camberwell, VIC: ACER.
45. Schmidt, M., & Cagran, B. (2006). Classroom climate in regular primary school settings with children with special needs. Educational Studies, 32, 361-372.
46. Seidel, T. (2006). The role of student characteristics in studying micro teaching-learning environments. Learning Environments Research, 9, 253-271.
47. Shavelson, R.J., & Seidel, T. (2006). Approaches in measuring learning environments. Learning Environments Research, 9, 195-197.
48. Snijders, T.A.B., & Bosker, R.J. (1999). Multilevel analysis: An introduction to basic and advanced multi-level modeling. London: Sage.
49. Tabachnick, B.G., & Fidell, L.S. (2007). Understanding multivariate statistics (5th ed.). Boston, MA: Pearson.
50. Telli, S., den Brok, P., & Cakiroglu, J. (2007). students' perceptions of science teachers' interpersonal behaviour in secondary schools: Development of a Turkish version of the Questionnaire on Teacher Interaction. Learning Environments Research, 10, 115-129.
51. Veltri, S., Banning, J.H., & Davies, T.G. (2006). The community college classroom environment: Student perceptions. College Student Journal, 40, 517-527.
52. Villar, L.M., & Alegre, O.M. (2007). Student perceptions of classroom environment and instructors' reflections. University of Seville. (ERIC Document Reproduction Service No. ED495249)
53. Walberg, H.J. (1976). Psychology of learning environments: Behavioral, structural, or perceptual? Review of Research in Education, 4, 142-178.
54. Waldrip, B.G., Reene, P., Fisher, D.L., & Dorman, J.P. (2008). Changing primary students' perceptions of teacher interpersonal behaviours. Research in Science Education, 38, 213-235.
55. Wheldall, K., Beaman, R., & Mok, M. (1999). Does the Individualized Classroom Environment Questionnaire (ICEQ) measure classroom climate? Educational and Psychological Measurement, 59, 847-854.
56. Wubbels, T., & Levy, J. (Eds.). (1993). Do you know what you look like? Interpersonal relationships in education. London: Falmer.