When Are Prescriptive Statements in Educational Research Justified?

Educational Psychology Review

Volumn 23, Issue 2, 2011, Pages 197-206

  Marley, Scott C ^a   Levin, Joel R ^b  

^a UNIVERSITY OF NEW MEXICO   (United States)

^b UNIVERSITY OF ARIZONA   (United States)

Author keywords

Causal claims; Generalizability; Prescriptive statements; Programmatic research; Validity

Indexed keywords

EID: 79958041264     PISSN: 1040726X     EISSN: 1573336X     Source Type: Journal    
DOI: 10.1007/s10648-011-9154-y     Document Type: Article

References (44)

1. Berkowitz, L., & Donnerstein, E. (1982). External validity is more than skin deep. The American Psychologist, 37(3), 245-257.
2. Bracht, G. H., & Glass, G. V. (1968). The external validity of experiments. American Educational Research Journal, 5(4), 437-474.
3. Brown, A. L. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings. Journal of the Learning Sciences, 2(2), 141-178.
4. Brunswik, E. (1955). Representative design and probabilistic theory in a functional psychology. Psychological Review, 62(3), 193-217.
5. Byar, D. P., Simon, R. M., Friedewald, W. T., Schlesselman, J. J., DeMets, D. L., Ellenberg, J. H., et al. (1976). Randomized clinical trials: Perspectives on some recent ideas. The New England Journal of Medicine, 295(2), 74.
6. Campbell, D. T., & Stanley, J. C. (1966). Experimental and quasi-experimental designs for research. Boston: Houghton Mifflin.
7. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design & analysis issues for field settings. Chicago: Rand McNally.
8. Cronbach, L. J., & Shapiro, K. (1982). Designing evaluations of educational and social programs. San Francisco: Jossey-Bass.
9. Cronbach, L. J., & Snow, R. E. (1977). Aptitudes and instructional methods: A handbook for research on interactions. New York: Irvington Publishers.
10. Derry, S. J., Levin, J. R., Osana, H. P., Jones, M. S., & Peterson, M. (2000). Fostering students' statistical and scientific thinking: Lessons learned from an innovative college course. American Educational Research Journal, 37(3), 747.
11. Finn, J. D., Gerber, S. B., Achilles, C. M., & Boyd-Zaharias, J. (2001). The enduring effects of small classes. Teachers College Record, 103(2), 145-183.
12. Freedman, D. A. (1991). Statistical models and shoe leather. Sociological Methodology, 21, 291-313.
13. Friedman, L. M., Furberg, C., & DeMets, D. L. (1998). Fundamentals of clinical trials. New York: Springer Verlag.
14. Fuchs, D., Fuchs, L. S., Thompson, A., Al Otaiba, S., Yen, L., Yang, N. J., et al. (2001). Is reading important in reading readiness programs?: A randomized field trial with teachers as program implementers. Journal of Educational Psychology, 93(2), 251-267.
15. Gersten, R., Baker, S., & Lloyd, J. W. (2000). Designing high-quality research in special education: Group experimental design. Journal of Special Education, 34(1), 2.
16. Glenberg, A. M., Brown, M., & Levin, J. R. (2007). Enhancing comprehension in small reading groups using a manipulation strategy. Contemporary Educational Psychology, 32(3), 389-399.
17. Goertzel, T. (2002). Myths of murder and multiple regression. Skeptical Inquirer, 26(1), 19-23.
18. Greene, M. (1994). Epistemology and educational research: The influence of recent approaches to knowledge. Review of Research in Education, 20, 423-464.
19. Guba, E. G., & Lincoln, Y. S. (1994). Competing paradigms in qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of Qualitative Research (pp. 105-117). Thousand Oaks: Sage Publications.
20. Kaptchuk, T. J. (2001). The double-blind, randomized, placebo-controlled trial gold standard or golden calf? Journal of Clinical Epidemiology, 54(6), 541-549.
21. Kazdin, A. E., & Nock, M. K. (2003). Delineating mechanisms of change in child and adolescent therapy: Methodological issues and research recommendations. Journal of Child Psychology and Psychiatry, 44(8), 1116-1129.
22. Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York: Guilford Press.
23. Koro-Ljungberg, M., Yendol-Hoppey, D., Smith, J. J., & Hayes, S. B. (2009). Epistemological awareness, instantiation of methods, and uninformed methodological ambiguity in qualitative research projects. Educational Researcher, 38(9), 687.
24. Kuhn, T. S. (1962). The structure of scientific revolutions. Chicago: University of Chicago Press.
25. Levin, J. R. (1994). Crafting educational intervention research that's both credible and creditable. Educational Psychology Review, 6(3), 231-243.
26. Levin, J. R. (2004). Random thoughts on the (in)credibility of educational-psychological intervention research. Educational Psychologist, 39(3), 173-184.
27. Levin, J. R., & O'Donnell, A. M. (1999). What to do about educational research's credibility gaps? Issues in Education: Contributions from Educational Psychology, 5(2), 177-229.
28. Marlatt, G. A. (1973). Are college students "real people"? The American Psychologist, 28(9), 852-853.
29. Marley, S. C., Levin, J. R., & Glenberg, A. M. (2007). Improving Native American children's listening comprehension through concrete representations. Contemporary Educational Psychology, 32(3), 537-550.
30. Marley, S. C., Levin, J. R., & Glenberg, A. M. (2010). What cognitive benefits do dynamic visual representations of a narrative text afford young Native American readers? Journal of Experimental Education, 78(3), 395-417.
31. Mayer, R. E. (2005). The failure of educational research to impact educational reform: Six obstacles to educational reform. In G. D. Phye, D. H. Robinson, & J. R. Levin (Eds.), Empirical methods for evaluating educational interventions (pp. 67-81). San Diego: Elsevier Academic Press.
32. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. The American Psychologist, 50(9), 741-749.
33. Mook, D. G. (1983). In defense of external invalidity. The American Psychologist, 38(4), 379-387.
34. Mosteller, F., & Boruch, R. (Eds.). (2002). Evidence matters: Randomized trials in education research. Washington, DC: Brookings Institution Press.
35. Mulaik, S. A. (2009). Linear causal modeling with structural equations. London: Chapman & Hall.
36. Murnane, R. J., & Willett, J. B. (2011). Methods matter: Improving causal inference in educational and social science research. New York: Oxford University Press.
37. Oakes, W. (1972). External validity and the use of real people as subjects. The American Psychologist, 27(10), 959-962.
38. Pencil, M. (1976). Salt passage research: The state of the art. The Journal of Communication, 26(4), 31-36.
39. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. Thousand Oaks: Sage Publications.
40. Robinson, D. H., & Levin, J. R. (2011). The not-so-quiet revolution: Cautionary comments on the rejection of hypothesis testing in favor of a "causal" modeling alternative. Journal of Modern Applied Statistical Methods.
41. Robinson, D. H., Levin, J. R., Thomas, G. D., Pituch, K. D., & Vaughan, S. (2007). The incidence of causal statements in teaching and learning research journals. American Educational Research Journal, 44(2), 400-413.
42. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.
43. Shaw, S. M., Walls, S. M., Dacy, B. S., Levin, J. R., & Robinson, D. H. (2010). A follow-up note on prescriptive statements in nonintervention research studies. Journal of Educational Psychology, 102(4), 982-988.
44. Wilkinson, L., & The Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. The American Psychologist, 54(8), 594-604.