Implementation Problems in Meta-Analysis

Review of Educational Research

Volumn 58, Issue 2, 1988, Pages 151-179

  Abrami, Philip C ^a   Cohen, Peter A ^b   D’Apollonia, Sylvia ^c  

^a School of Kinesiology and Health Sciences Sport Management   (United States)

^b UNIVERSITY OF TEXAS   (United States)

^c Vanier College   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84965799932     PISSN: 00346543     EISSN: None     Source Type: Journal    
DOI: 10.3102/00346543058002151     Document Type: Article

References (90)

1. Abrami PC Using meta-analytic techniques to review the instructional evaluation literature Postsecondary Education Newsletter, 1984 1984 February 6 8
2. Abrami PC D’Apollonia S A conceptual critique of meta-analysis: The literature on student ratings of instruction 1987 April Paper presented at the annual meeting of the American Educational Research Association Washington, DC
3. Abrami PC D’Apollonia S The literature on the validity of student ratings: A conceptual solution to some implementation problems of meta-analysis 1988 April Paper presented at the annual meeting of the American Educational Research Association New Orleans
4. Abrami PC Leventhal L Perry RP Educational seduction Review of Educational Research 1982 52 446 464
5. Bangert-Drowns RL Review of developments in meta-analytic method Psychological Bulletin 1986 99 388 399
6. Bangert-Drowns RL Kulik JA Kulik C-LC Effects of coaching programs on achievement test performance Review of Educational Research 1983 53 571 585
7. Bendig AW The relation of level of course achievement to students’ instructor course ratings in introductory psychology Educational and Psychological Measurement 1953a 13 437 448
8. Bendig AW Student achievement in introductory psychology and student ratings of the competence and empathy of their instructors Journal of Psychology 1953b 36 427 433
9. Benton SE Scott O A comparison of the criterion validity of two types of student response inventory for appraising instructors 1976 April Paper presented at the annual meeting of the National Council on Measurement in Education San Francisco
10. Bolton A Bonge D Marr J Ratings of instruction, examination performance, and subsequent enrollment in psychology courses Teaching of Psychology 1979 6 82 85
11. Borg WR Hamilton ER Comparison between a performance test and criteria of instructor effectiveness Psychological Reports 1956 2 111 116
12. Braskamp LA Caulley D Costin F Student ratings and instructor self-ratings and their relationship to student achievement American Educational Research Journal 1979 16 295 306
13. Bryant FB Wortman PM Yeaton WH Wortman PM Methodological issues in the meta-analysis of quasi-experiments Issues in data synthesis 1984 San Francisco Jossey-Bass 5 24
14. Bryson R Teacher evaluations and student learning: A re-examination The Journal of Educational Research 1974 68 12 14
15. Carlberg CG Johnson DW Johnson RT Maruyama GM Kavale K Kulik C-L Kulik JA Lysakowski RS Pflaum SW Walberg HJ Metaanalysis in education: A reply to Slavin Educational Researcher 1984 13 8 16 23
16. Centra J Student ratings of instruction and their relationship to student learning American Educational Research Journal 1977 14 17 24
17. Chase CI Keene JM Jr Validity of student ratings of faculty 1979 Bloomington Indiana University, Bureau of Evaluative Studies and Testing (Indiana Studies in Higher Education, Number 40) (ERIC Document Reproduction Service No. ED 169 870)
18. Chow SI Significance test or effect size? Psychological Bulletin 1988 103 105 110
19. Cohen J The statistical power of abnormal-social psychological research: A review Journal of Abnormal and Social Psychology 1962 65 145 153
20. Cohen J Statistical power analyses for the behavioral sciences 1977 rev. ed New York Academic Press
21. Cohen PA A meta-analysis of the relationship between student ratings of instruction and student achievement 1980 University of Michigan, Ann Arbor Unpublished doctoral dissertation
22. Cohen PA Student ratings of instruction and student achievement: A meta-analysis of multisection validity studies Review of Educational Research 1981 51 281 309
23. Cohen PA Validity of student ratings in psychology courses: A research synthesis Teaching of Psychology 1982 9 78 82
24. Cohen PA Comment on a selective review of the validity of student ratings of teaching Journal of Higher Education 1983 54 448 458
25. Cohen SH Berger WG Dimensions of students’ ratings of college instructors underlying subsequent achievement on course examinations Proceedings of the 78th Annual Convention of the American Psychological Association 1970 5 605 606
26. Cooper HM The integrative research review 1984 Beverly Hills, CA Sage
27. Costin F Do student ratings of college teachers predict student achievement? Teaching of Psychology 1978 5 86 88
28. Cronbach LJ Meehl PE Construct validity in psychological tests Psychological Bulletin 1955 52 281 302
29. Crooks TJ Smock HR Student ratings of instructors related to student achievement 1974 University of Illinois-Urbana Office of Instructional Resources
30. D’Apollonia S Abrami PC An empirical critique of meta-analysis: The literature on student ratings of instruction 1987 April Paper presented at the annual meeting of the American Educational Research Association Washington, DC
31. Dowell DA Neal JA A selective review of the validity of student ratings of teaching Journal of Higher Education 1982 53 51 62
32. Dowell DA Neal JA The validity and accuracy of student ratings of instruction: A reply to Peter A. Cohen Journal of Higher Education 1983 54 459 463
33. Doyle KO Crichton LI Student, peer, and self-evaluation of college instructors Journal of Educational Psychology 1978 70 815 826
34. Doyle KO Whitely SE Student ratings as criteria for effective teaching American Educational Research Journal 1974 11 259 274
35. Elliott DN Characteristics and relationships of various criteria of college and university teaching Purdue University Studies in Higher Education 1950 70 5 61
36. Ellis NR Rickard HC Evaluating the teaching of introductory psychology Teaching of Psychology 1977 4 128 132
37. Endo GT Della-Piana GA A validation study of course evaluation ratings Improving College and University Teaching 1976 24 84 86
38. Eysenck HJ An exercise in mega-silliness American Psychologist 1978 33 517
39. Frey PW Student ratings of teaching: Validity of several rating factors Science 1973 182 83 85
40. Frey PW Validity of student instructional ratings: Does timing matter? Journal of Higher Education 1976 47 327 336
41. Frey PW Leonard DW Beatty WW Student ratings of instruction: Validation research American Educational Research Journal 1975 12 435 447
42. Gessner PK Evaluation of instruction Science 1973 180 566 570
43. Glass GV Primary, secondary, and meta-analysis of research Educational Researcher 1976 5 10 3 8
44. Glass GV Integrating findings: The meta-analysis of research Review of Research in Education 1978 5 351 379
45. Glass GV McGaw B Smith ML Meta-analysis in social research 1981 Beverly Hills, CA Sage
46. Greenwood GE Hazelton AE Smith AB Ware WB A study of the validity of four types of student ratings of college teaching assessed on criterion of student achievement gains Research in Higher Education 1976 5 171 178
47. Grush JE Costin F The student as consumer of the teaching process American Educational Research Journal 1975 12 55 66
48. Hays WL Statistics 1981 3rd ed New York Holt, Rinehart and Winston
49. Hazelton AE A study of the validity of student ratings of college teaching assessed on a criterion of student achievement in a first course in calculus 1980 University of Florida Doctoral dissertation (University Microfilms No. ADG81-05581)
50. Hedges LV Olkin I Statistical methods for meta-analysis 1985 Orlando, FL Academic Press
51. Hoffman RG Student descriptions of instructional characteristics as relevant indices of teaching effectiveness 1976 College Park University of Maryland Doctoral dissertation
52. Hoffman RG Variables affecting university student ratings of instructor behavior American Educational Research Journal 1978 15 287 299
53. Huberty CJ On statistical testing Educational Researcher 1987 16 11 4 9
54. Hunter JE Schmidt FL Jackson GB Meta-analysis: Cumulating research findings across studies 1982 Beverly Hills, CA Sage
55. Jackson GB Methods for integrative reviews Review of Educational Research 1980 50 438 460
56. Light RJ Pillemer DB Summing up: The science of reviewing research 1984 Cambridge, MA Harvard University Press
57. Marsh HW Fleiner J Thomas CS Validity and usefulness of student evaluations of instructional quality Journal of Educational Psychology 1975 67 833 839
58. Marsh HW Overall JU Validity of students’ evaluations of teaching effectiveness: Cognitive and affective criteria Journal of Educational Psychology 1980 72 468 475
59. McCallum LW A meta-analysis of course evaluation data and its use in the tenure decision Research in Higher Education 1984 21 150 158
60. McKeachie WJ Lin Y-G Mann W Student ratings of teacher effectiveness: Validity studies American Educational Research Journal 1971 8 435 445
61. McKeachie WJ Lin Y-G Mendelson CN A small study assessing teacher effectiveness: Does learning last? Contemporary Educational Psychology 1978 3 352 357
62. Mintzes JJ Field test and validation of a teaching evaluation instrument: The student opinion of teaching 1977 Windsor, Ontario University of Windsor (ERIC Document Reproduction Service No. ED 146 185)
63. Morgan WD Vasche JD An educational production function approach to teaching effectiveness and evaluation Journal of Economic Education 1978 123 126
64. Morsh JE Burgess GG Smith PN Student achievement as a measure of instructor effectiveness Journal of Educational Psychology 1956 47 79 88
65. Mosteller FM Bush RR Lindzey G Selected quantitative techniques Handbook of social psychology: Vol. 1. Theory and method 1954 Cambridge, MA Addison-Wesley 289 334
66. Murdock RP The effect of student ratings of their instructor on the student’s achievement and rating 1969 (ERIC Document Reproduction Service No. ED 034 715)
67. Murray HG Low-inference classroom teaching behaviors in relation to six measures of college teaching effectiveness Proceedings of the conference on the Evaluation and Improvement of University Teaching: The Canadian Experience 1983 November Montreal McGill University, Centre for Teaching and Learning Services 43 73
68. Orpen C Student evaluation of lecturers as an indicator of instructional quality Journal of Educational Research 1980 74 5-7
69. Palmer JG Carliner G Romer T Leniency, learning, and evaluations Journal of Educational Psychology 1978 70 855 863
70. Rankin EF Greenmun R Tracy RJ Factors related to student evaluations of a college reading course Journal of Reading 1965 9 10 15
71. Raudenbush SW Becker BJ Kalaian H Modeling multivariate effect sizes Psychological Bulletin 1988 103 111 120
72. Remmers HH Martin FD Elliot DN Are students’ ratings of instructors related to their grades? Purdue University Studies in Higher Education 1949 66 17 26
73. Reynolds DV Hansvick C Graduate instructors who grade higher receive lower evaluations by students 1978 September Paper presented at the annual meeting of the American Psychological Association Toronto, Ontario
74. Rodin M Rodin B Student evaluations of teachers Science 1972 177 1164 1166
75. Rosenthal R Combining results of independent studies Psychological Bulletin 1978 85 185 193
76. Rosenthal R The “file drawer problem” and tolerance for null results Psychological Bulletin 1979 86 638 641
77. Rosenthal R Meta-analytic procedures for social research 1984 Beverly Hills, CA Sage
78. Rosenthal R Rubin DB Meta-analytic procedures for combining studies with multiple effect sizes Psychological Bulletin 1986 99 400 406
79. Rubinstein J Mitchell H Feeling free, student involvement, and appreciation Proceedings of the 78th Annual Convention of the American Psychological Association 1970 5 623 624
80. Slavin RE Meta-analysis in education: How has it been used? Educational Researcher 1984 13 8 6 15 24 27
81. Slavin RE Best-evidence synthesis: An alternative to meta-analytic and traditional reviews Educational Researcher 1986 15 9 5 11
82. Slavin RE Best-evidence synthesis: Why less is more Educational Researcher 1987 16 4 15 16
83. Solomon D Rosenberg L Bezdek WE Teacher behavior and student learning Journal of Educational Psychology 1964 55 23 30
84. Soper JC Soft research on a hard subject: Student evaluations reconsidered Journal of Economic Education 1973 22 26
85. Sorge DH Kline CE Verbal behavior of college instructors and attendant effect upon student attitudes and achievement College Student Journal 1973 7 24 29
86. Spencer RE Dick W Course evaluation questionnaire: Manual of interpretation 1965 Urbana University of Illinois, Office of Instructional Resources (Research Report No. 200)
87. Sullivan AM Skanes GR Validity of student evaluation of teaching and the characteristics of successful instructors Journal of Educational Psychology 1974 66 584 590
88. Turner RL Thompson RP Relationships between college student ratings of instructors and residual learning 1974 April Paper presented at the annual meeting of the American Educational Research Association Chicago
89. Wherry RJ Control of bias in ratings 1952 Washington, DC Department of the Army, Adjutant General’s Office (PRS Reports 914, 915, 9191, 920, 921)
90. Whitely SE Doyle KO Validity and generalizability of student ratings from between-class and within-class data Journal of Educational Psychology 1979 71 117 124