What works? Evidence-based practice in education is complex

Australian Journal of Learning Difficulties

Volumn 19, Issue 2, 2014, Pages 113-127

  Hempenstall, Kerry ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84914676386     PISSN: 19404158     EISSN: 19404166     Source Type: Journal    
DOI: 10.1080/19404158.2014.921631     Document Type: Article

References (62)

1. Adams, M. J., Beck, I., Brady, S., Chapman, J., Chard, D., Connor, C. M., … Williams, J. (2013). Guessing: Why the reading wars won't end (Letter to Washington Post from 41 researchers concerning the NCTQ report on teacher training). Retrieved from http://www.washingtonpost.com/blogs/answer-sheet/wp/2013/09/17/another-blast-in-the-reading-wars/.
2. Australian Bureau of Statistics. (2010). ABS research and experimental development, all sector summary, Australia, 2008–09. Retrieved from http://www.abs.gov.au/AUSSTATS/abs@.nsf/DetailsPage/8112.02008-09?OpenDocument.
3. Australian National Audit Office. (2012). National partnership agreement on literacy and numeracy. Retrieved from http://www.anao.gov.au/Publications/Audit-Reports/2011-2012/National-Partnership-Agreement-on-Literacy-and-Numeracy/Audit-brochure.
4. Baker, S., Berninger, V. W., Bruck, M., Chapman, J., Eden, G., Elbaum, B., … Wolf, M. (2002). Evidence-based research on Reading Recovery (Letter from 31 researchers). Retrieved from http://www.wrightslaw.com/info/read.rr.ltr.experts.htm.
5. Bloom, H. S., Hill, C. J., Black, A. R., & Lipsey, M. W. (2008). Performance trajectories and performance gaps as achievement effect-size benchmarks for educational interventions. MDRC Working Papers on Research Methodology. Retrieved from http://mdrc.org/sites/default/files/full_473.pdf.
6. Briggs, D. C. (2008). Synthesizing causal inferences. Educational Researcher, 37, 15–22.
7. Carlson, C. D., & Francis, D. J. (2002). Increasing the reading achievement of at-risk children through direct instruction: Evaluation of the Rodeo Institute for Teacher Excellence (RITE). Journal of Education for Students Placed At Risk, 7, 141–166.
8. Carnine, D. (1995). Trustworthiness, usability, and accessibility of educational research. Journal of Behavioral Education, 5, 251–258.
9. Carter, M., & Wheldall, K. (2008). Why can't a teacher be more like a scientist? Science, pseudoscience and the art of teaching. Australasian Journal of Special Education, 32, 5–21.
10. Center, Y., Freeman, L., & Robertson, G. (2001). The relative effect of a code-oriented and a meaning-oriented early literacy program on regular and low progress Australian students in year 1 classrooms which implement Reading Recovery. International Journal of Disability, Development, and Education, 48, 207–232.
11. Chapman, J. W., Greaney, K. T., & Tunmer, W. E. (2007). How well is Reading Recovery really working in New Zealand?New Zealand Journal of Educational Studies, 42, 17–29.
12. Chapman, J. E., & Tunmer, W. E. (2011). Reading Recovery: Does it work?Perspectives on Language and Literacy, 21, 21–24.
13. Chapman, J. W., Tunmer, W. E., & Prochnow, J. E. (2001). Does success in the Reading Recovery program depend on developing proficiency in phonological skills? A longitudinal study in a meaning-based instructional context. Scientific Studies of Reading, 5, 141–176.
14. Chard, D. J., Ketterlin-Geller, L. R., Baker, S. K., Doabler, C., & Apichatabutra, C. (2009). Repeated reading interventions for students with learning disabilities: Status of the evidence. Exception Children, 75, 263–281.
15. Cooke, N. L., Gibbs, S. L., Campbell, M. L., & Shalvis, S. L. (2004). A comparison of Reading Mastery fast cycle and horizons fast track A-B on the reading achievement of students with mild disabilities. Journal of Direct Instruction, 4, 139–151.
16. Cuttance, P. (2005, July 5). Education research ‘irrelevant’. The Age, p. 5.
17. DEECD. (2012, June). New directions for school leadership and the teaching profession: Discussion paper. Department of Education and Early Childhood Development. Retrieved from http://www.eduweb.vic.gov.au/edulibrary/public/commrel/about/teachingprofession.pdf.
18. Department of Education, Employment and Workplace Relations. (n.d.). Standards of evidence for submissions for the teach, learn, share: The national literacy and numeracy evidence base. Retrieved from http://www.teachlearnshare.gov.au/Static/StandardsOfEvidenceForPublicationFinal.pdf.
19. Engelmann, S. (2008). Machinations of What Works Clearinghouse. Retrieved from http://zigsite.com/PDFs/MachinationsWWC(V4).pdf.
20. Ferrari, J. (2012, December 12). Lack of reform slammed: A decade of lost action on literacy. WeekEnd Australian. Retrieved from http://www.theaustralian.com.au/national-affairs/a-decade-of-lost-action-on-literacy/story-fn59niix-1226542150781#.
21. Greene, J. P. (2010). What doesn't work clearinghouse. Education Next. Retrieved from http://educationnext.org/what-doesnt-work-clearinghouse/.
22. Hattie, J. A. C. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. London: Routledge.
23. Hempenstall, K. (1996). The gulf between educational research and policy: The example of Direct Instruction and whole language. Behaviour Change, 13, 33–46.
24. Hempenstall, K. (2006). What does evidence-based practice in education mean?Australian Journal of Learning Disabilities, 11, 83–92.
25. Herrera, J. A., Logan, C. H., Cooker, P. G., Morris, D. P., & Lyman, D. E. (1997). Phonological awareness and phonetic-graphic conversion: A study of the effects of two intervention paradigms with learning disabled children. Learning disability or learning difference?Reading Improvement, 34, 71–89.
26. Horner, R. H., Swaminathan, K., Sugai, G., & Smolkowski, K. (2012). Considerations for the systematic analysis and use of single-case research. Education and Treatment of Children, 35, 269–290.
27. Iversen, S., & Tunmer, W. E. (1993). Phonological processing skills and the Reading Recovery program. Journal of Educational Psychology, 85, 112–126.
28. Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskoph, D. M., & Shadish, W. R. (2010). Single-case designs technical documentation. Retrieved from http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf.
29. Law, M. (2002). Evidence-based rehabilitation: A guide to practice. Thoroughfare, NJ: Slack.
30. Lipsey, M. W., Puzio, K., Yun, C., Hebert, M. A., Steinka-Fry, K., Cole, M. W., Roberts, M., Anthony, K. S., & Busick, M. D. (2012). Translating the statistical representation of the effects of education interventions into more readily interpretable forms (NCSER 2013-3000). Washington, DC: U.S. Government Printing Office. Retrieved from http://ies.ed.gov/ncser/pubs/20133000/
31. Lloyd, J. W. (2007, May 29). WWC report on Direct Instruction. Spedpro Forum. Retrieved from spedpro@virginia.edu.
32. Lomax, R. G. (2004). Whither the future of quantitative literacy research?Reading Research Quarterly, 39, 107–112.
33. Marshall, J. (1993). Why Johnny can't teach. Reason, 25, 102–106.
34. McArthur, G. (2008). Does What Works Clearinghouse work? A brief review of Fast ForWord®. Australasian Journal of Special Education, 32, 101–107.
35. National Early Literacy Panel. (2008). Executive summary: Developing early literacy: Report of the National Early Literacy Panel. Jessup, MD: National Institute for Literacy.
36. National Inquiry into the Teaching of Literacy. (2005). Teaching reading: National inquiry into the teaching of literacy. Canberra: Department of Education, Science, and Training.
37. National Reading Panel. (2000). Report of the National Reading Panel: Teaching children to read. Bethesda, MD: National Institute of Child Health and Human Development.
38. O'Keeffe, B. V., Slocum, T. A., Burlingame, C., Snyder, K., & Bundock, K. (2012). Comparing results of systematic reviews: Parallel reviews of research on repeated reading. Education & Treatment of Children, 35, 333–366.
39. Productivity Commission. (2012). Schools workforce (Research Report). Canberra. JEL code: I21, I28, J24. Retrieved from http://www.pc.gov.au/projects/study/education-workforce/schools/report.
40. Reynolds, M., & Wheldall, K. (2007). Reading Recovery 20 years down the track: Looking forward, looking back. International Journal of Disability, 54, 199–223.
41. Reynolds, M., Wheldall, K., & Madelaine, A. (2009). The devil is in the detail regarding the efficacy of Reading Recovery: A rejoinder to Schwartz, Hobsbaum, Briggs, and Scull. International Journal of Disability, Development and Education, 56, 17–35.
42. Slavin, R. E. (2003). A reader's guide to scientifically based research. Educational Leadership, 60, 12–16. Retrieved from http://www.ascd.org/publications/educational-leadership/feb03/vol60/num05/A-Reader%27s-Guide-to-Scientifically-Based-Research.aspx.
43. Slavin, R. E. (2008). Evidence-based reform in education: Which evidence counts?Educational Researcher, 37, 47–50.
44. Slavin, R. E. (2013a). Overcoming four barriers to evidence-based education. Education Week, 32, 1–2. Retrieved from http://www.edweek.org/ew/articles/2013/05/01/30slavin.h32.html?tkn = YVYFwfchIRt5fS7cgOjTWRtaP54JDVCPeTtt&cmp = clp-edweek.
45. Slavin, R. E. (2013b). How to do lots of high-quality educational evaluations for peanuts. Retrieved from http://www.huffingtonpost.com/robert-e-slavin/how-to-do-lots-of-high-qu_b_3953209.html.
46. Slavin, R. E., & Smith, D. (2009). The relationship between sample sizes and effect sizes in systematic reviews in education. Educational Evaluation and Policy Analysis, 31, 500–506. Retrieved from http://www.bestevidence.org/methods/eff_sample_size.htm.
47. Slocum, T. A., Spencer, T. D., & Detrich, R. (2012). Best available evidence: Three complementary approaches. Education and Treatment of Children, 35, 153–181.
48. Spencer, T. D., Detrich, R., & Slocum, T. A. (2012). Evidence-based practice: A framework for making effective decisions. Education & Treatment of Children, 35, 127–151.
49. Stockard, J. (2008). The What Works Clearinghouse beginning reading reports and rating of Reading Mastery: An evaluation and comment (Technical Report 2008-04). National Institute for Direct Instruction. Retrieved from http://www.nifdi.org/research/reviews-of-di/what-works-clearinghouse.
50. Stockard, J. (2010). An analysis of the fidelity implementation policies of the What Works Clearinghouse. Current Issues in Education, 13. Retrieved from http://cie.asu.edu/.
51. Stockard, J., & Wood, T. W. (2012). Reading Mastery and learning disabled students: A comment on the What Works Clearinghouse review. National Institute for Direct Instruction. Retrieved from http://www.nifdi.org/documents-library/doc_download/245-response-to-wwc-rm-and-ld-july-2012.
52. Stockard, J., & Wood, T. W. (2013a). The WWC review process: An analysis of errors in two recent reports (Technical Report 2013-4). Office of Research and Evaluation, National Institute for Direct Instruction. Retrieved from http://www.nifdi.org/documents-library/doc_download/283-technical-report-2013-4-wwc.
53. Stockard, J., & Wood, T. W. (2013b, September 9). Does the What Works Clearinghouse work? Office of Research and Evaluation, National Institute for Direct Instruction. Retrieved from http://www.nifdi.org/what-works-clearinghouse.
54. Stone, J. E. (1996, April 23). Developmentalism: An obscure but pervasive restriction on educational improvement. Education Policy Analysis Archives.
55. Strauss, V. (2013, September 24). Education department suspends ‘doing what works’ website. The Washington Post. Retrieved from http://www.washingtonpost.com/blogs/answer-sheet/wp/2013/09/24/education-department-suspends-doing-what-works-website/.
56. The 1999 Omnibus Appropriations Bill. (1998). The reading excellence act, pp. 956–1007. Retrieved from http://www.gpo.gov/fdsys/pkg/BILLS-105s1596is/html/BILLS-105s1596is.htm.
57. Tunmer, W. E., Chapman, J. E., Greaney, K. T., Prochnow, J. E., & Arrow, A. W. (2013). Why the New Zealand national literacy strategy has failed and what can be done about it: Evidence from the Progress in International Reading Literacy Study (PIRLS) 2011 and Reading Recovery Monitoring Reports. Massey University Institute of Education, Retrieved from http://www.massey.ac.nz/massey/about-massey/news/article.cfm?mnarticle_uuid = F287725F-9E6F-011D-BE0E-F34366B8376A.
58. Victorian Auditor-General. (2012). Programs for students with special learning needs: Audit summary. Retrieved from http://www.audit.vic.gov.au/publications/20120829-Special-Learning-Need/20120829-Special-Learning-Need.rtf.
59. Wolery, M. (2013). A commentary: Single-case design technical document of the What Works Clearinghouse. Remedial and Special Education, 34, 39–43.
60. WWC (What Works Clearinghouse). (2013a). WWC procedures and standards handbook (Version 3.0). Washington, DC: Institute of Education Sciences. Retrieved from http://ies.ed.gov/ncee/wwc/documentsum.aspx?sid = 19.
61. WWC. (2013b). Evidence for what works in education. Washington, DC: Institute of Education Sciences, U.S. Department of Education. Retrieved from http://ies.ed.gov/ncee/wwc/.
62. Zient, J. D. (2012). Use of evidence and evaluation in the 2014 budget: Memorandum to the heads of executive departments and agencies. Executive Office of the President, Office of Management and Budget. Retrieved from http://www.whitehouse.gov/sites/default/files/omb/memoranda/2012/m-12-14.pdf.