Can we overcome the methodological schism? Four models for combining qualitative and quantitative evidence

Research Papers in Education

Volumn 17, Issue 4, 2002, Pages 345-361

  Gorard, Stephen ^a  

^a CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

Combining methods; Complex interventions; Design experiments; Political arithmetic; Research capacity building; Systematic reviews

Indexed keywords

EID: 84993099475     PISSN: 02671522     EISSN: 14701146     Source Type: Journal    
DOI: 10.1080/0267152022000031405     Document Type: Article

References (96)

1. Badger, D., Nursten, J., Williams, P. and Woodward, M. (2000). ‘Should all literature reviews be systematic?’, Evaluation and Research in Education, 14, 3&4, 220-30.
2. Bailey, R. (2001). ‘Overcoming veriphobia-learning to love truth again’, British Journal of Educational Studies, 49, 2, 159-72.
3. Ball, S. (2001). ‘“You’ve been NERFed!” Dumbing down the academy’, Journal of Education Policy, 16, 3, 265-8.
4. Bernado, J. and Smith, A. (1994). Bayesian Theory. Chichester: John Wiley.
5. Bridges, D. (1999). ‘Educational research: pursuit of truth or flight into fancy?’, British Educational Research Journal, 25, 5, 597-616.
6. Brown, A. (1992). ‘Design experiments: theoretical and methodological challenges in creating complex interventions in classroom settings’, The Journal of the Learning Sciences, 2, 2, 141-78.
7. Brown, A. and Dowling, P. (1998). Doing Research/Reading Research: a Mode of Interogation for Education. London: Falmer.
8. Bryman, A. (2001). Social Research Methods. Oxford: Oxford University Press.
9. Campbell, M., Fitzpatrick, R., Haines, A. et al. (2000). ‘Framework for design and evaluation of complex interventions to improve health’, British Medical Journal, 321, 694-6.
10. Chalmers, A. (1990). Science and its Fabrication. Milton Keynes: Open University Press.
11. Chalmers, A. (1999). What is This Thing Called Science? Milton Keynes: Open University Press.
12. Clegg, F. (1992). Simple Statistics: a Course Book for the Social Sciences. Cambridge: Cambridge University Press.
13. Collins, A., Bielaczyc, K. and Joseph, D. (2001). Design Experiments: Theoretical and Methodological Issues, (mimeo).
14. Collins, H. and Pinch, T. (1993). The Golem: What you Should Know About Science. Cambridge: Cambridge University Press.
15. DE Vaus, D. (2001). Research Design in Social Science. London: Sage.
16. Debats, D., Drost, J. and Hansen, P. (1995). ‘Experiences of meaning in life: a combined qualitative and quantitative approach’, British Journal of Psychology, 86, 3, 359-75.
17. Department of Health (1997). Research and Development: Towards an Evidence-based Health Service. London: Department of Health.
18. Dixon-Woods, M., Fitzpatrick, R. and Roberts, K. (1999). ‘Including qualitative research in systematic reviews’, Journal of Evaluation in Clinical Practice, 7, 125-33.
19. Dyson, A. and Robson, E. (1999). School, Family, Community: Mapping School Inclusion in the UK. Leicester: Youth Work Press.
20. Eiser, J. and Van Der Plight, J. (1988). Attitudes and Decisions. London: Routledge.
21. Ellmore, P. and Woehilke, P. (1998). Twenty years of research methods employed in American Educational Research Journal, Education Researcher, and Review of Educational Research from 1978 to 1997. (mimeo) ERIC ED 420701.
22. Evans, J. and Benefield, P. (2001). ‘Systematic reviews of educational research: does the medical model fit?’, British Educational Research Journal, 27, 5, 527-42.
23. Feyerabend, P. (1993). Against Method. London: Verso.
24. Fitz, J., Taylor, C., Gorard, S. and White, P. (2002). ‘Local education authorities and the regulation of educational markets: four case studies’, Research Papers in Education, 17, 2, 373-93.
25. Fitz-Gibbon, C. (2000). ‘Education: realising the potential’. In: H. Davies, S. Nutley and P. Smith (Eds) What works? Evidence-based policy and practice in public services. Bristol: Policy Press.
26. Fitz-Gibbon, C. (2001). ‘What’s all this about “evidence”?’, Learning and Skills Research, 5, 1, 27-9.
27. Frazer, E. (1995). ‘What’s new in the philosophy of science?’, Oxford Review of Education, 21, 3, 267.
28. French, S. and Smith, J. (1997). ‘Bayesian analysis’. In S. FRENCH, J. SMITH (Eds) The practice of Bayesian analysis. London: Arnold, pp. 1-25.
29. Furlong, J. and White, P. (2001). Educational research capacity in Wales: UCET/BERA report. Cardiff University School of Social Sciences.
30. Gephart, R. (1988). Ethnostatistics: Qualitative Foundations for Quantitative Research. London: Sage.
31. Glymour, C., Scheines, R., Spirtes, P. and Kelly, K. (1987). Discovering Causal Structure. Orlando: Academic Press.
32. Gorard, S. (1997). School Choice in an Established Market. Aldershot: Ashgate.
33. Gorard, S. (1998). The Call for a Middle-Way in Educational Research. BERA Internet Conference, March 1998, .
34. Gorard, S. (1999). ‘“Well. That about wraps it up for school choice research”: a state of the art review’, School Leadership and Management, 19, 18, 25-47.
35. Gorard, S. (2000). Education and Social Justice. Cardiff: University of Wales Press.
36. Gorard, S. (2001a). A Changing Climate for Educational Research? The role of research capability-building. Presentation to BERA September 2001, Leeds, also available on Education-line.
37. Gorard, S. (2001b). Quantitative Methods in Educational Research: The role of numbers made easy. London: Continuum.
38. Gorard, S. (2002). ‘The role of causal models in education as a social science?’, Evaluation and Research in Education 16, 1, 51-65.
39. Gorard, S. (2003). ‘What is multi-level modelling for?’, British Journal of Educational Studies, 15, 1.
40. Gorard, S. and Rees, G. (2002). Creating a Learning Society. Bristol: Policy Press.
41. Gorard, S. and Taylor, C. (2002). ‘Diversity or hierarchy? The role of school allocation procedures in maintaining equity’. In: Handbook of Educational Management. London: Pearson.
42. Gorard, S., Rees, G. and Fevre, R. (1999a). ‘Patterns of participation in lifelong learning: do families make a difference?’, British Educational Research Journal, 25, 4, 517-32.
43. Gorard, S., Rees, G., Fevre, R. and Welland, T. (2001). ‘Lifelong learning trajectories: some voices of those in transit’, International Journal of Lifelong Education, 20, 3, 169-87.
44. Gorard, S., Salisbury, J. and Rees, G. (1999b). ‘Reappraising the apparent underachievement of boys at school’, Gender and Education, 11, 4, 441-54.
45. Guba, E. (1990). ‘The Alternative Paradigm Dialog’. In: E. Guba (Ed.) The paradigm dialog. London: Sage, pp. 17-27.
46. Hakuta, K. (2000). Perspectives on the state of education research in the US. Presentation at AERA, New Orleans, April 2000.
47. Hammersley, M. (1997). ‘Educational research and teaching: a response to David Hargreaves’ TTA lecture’, British Educational Research Journal, 23, 2, 141-62.
48. Hammersley, M. (2001). Some questions about Evidence-based Practice in Education. Presentation to BERA, Leeds, 13-15 September 2001.
49. Hartigan, J. (1983). Bayes theory. New York: Springer-Verlag.
50. Hausman, C. (2000). Reviewing the review process: what can we learn? Presentation at AERA, New Orleans, April 2000.
51. Hayes, E. (1992). ‘The impact of feminism on adult education publications: an analysis of British and American Journals’, International Journal of Lifelong Education, 11, 2, 125-38.
52. Hillage, J., Pearson, R., Anderson, A. and Tamkin, P. (1998). Excellence on Research in Schools. Sudbury: DfEE.
53. Kuhn, T. (1970). The Structure of Scientific Revolutions. Chicago: University of Chicago Press.
54. Lakatos, I. (1978). The Methodology of Scientific Research Programmes. Cambridge: Cambridge University Press.
55. Levacic, R. and Glatter, R. (2001). ‘Really good ideas? Developing evidence-informed policy and practice in educational leadership and management’, Educational Management and Administration, 29, 1, 5-25.
56. Mahoney, J. (2000). ‘Strategies of causal inference in small-N analysis’, Sociological Methods and Research, 28, 4, 387-424.
57. Marshall, G. (2001). Social Sciences. Swindon: Economic and Social Research Council.
58. Mayer, R. (2001). ‘Resisting the assault on science: the case for evidence-based reasoning in educational research’, Educational Researcher, 30, 7, 29-30.
59. Mcintyre, D. and Mcintyre, A. (2000). Capacity for Research into Teaching and Learning. Report to TLRP.
60. Medical Research Council (2000). A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health. London: MRC.
61. Millett, A. (1997). Speech to TTA Research Conference, 5 December 1997. London: TTA.
62. Moore, L. (2002). ‘Lessons from using randomised trials in health promotion’, Building Research Capacity, 1, 1, 4-5.
63. Morrison, K. (2001). ‘Randomised controlled trials for evidence-based education: some problems in judging “what works”’, Evaluation and Research in Education, 15, 2, 69-83.
64. Mortimore, P. (2000). ‘Does educational research matter?’, British Educational Research Journal, 26, 1, 5-24.
65. Murray, S. (2000). ‘Relation between private health insurance and high rates of caesarean section in Chile: qualitative and quantitative study’, British Medical Journal, 321, 1501-5.
66. National Institute Of Health (1999). Qualitative methods in health research: opportunities and considerations in application and review. Available online at: (12/2/02).
67. National Research Council (1999). Improving Student Learning: a Strategic Plan for Educational Research and its Utilization. Washington DC: National Academy Press.
68. NERF (2001). A Research and Development Strategy for Education: Developing Quality and Diversity. Nottingham: National Educational Research Forum.
69. Nutbeam, D., Macaskill, P., Smith, C. et al. (1993). ‘Evaluation of two school smoking programmes under normal classroom conditions’, British Medical Journal, 306, 102-7.
70. Oakley, A. (2001). ‘Making evidence-based practice educational: a rejoinder to John Elliott’, British Educational Research Journal, 27, 5, 575-6.
71. Oppenheim, A. (1992). Questionnaire Design, Interviewing and Attitude Measurement. London: Continuum.
72. Pedhazur, E. (1982). Multiple Regression in Behavioural Research. London: Holt, Rhinehart and Winston.
73. Popkewitz, T. (1984). Paradigm and Ideology in Educational Research. Lewes: Falmer Press.
74. Postan, M. (1971). Fact and Relevance: Essays on Historical Method. Cambridge: Cambridge University Press.
75. Prandy, K. (2002). ‘Measuring qualities: the prior role of theory and quality’, Building Research Capacity, 2, 2-3.
76. Pring, R. (2000a). Philosophy of Educational Research, London: Continuum.
77. Pring, R. (2000b). ‘Editorial conclusion: a philosophical perspective’, Oxford Review of Education, 26, 3&4, 495-501.
78. Research Fortnight (2001). ‘Crisis in quality for evidence research’, Research Fortnight, 21 November 2001, p.6.
79. Resnick, L. (2000). Strengthening the Capacity of the Research System: a Report of the National Academy of Education. Presentation at AERA, New Orleans, April 2000.
80. Roberts, I. (2000). ‘Randomised trials or the test of time?: The story of human albumin administration’, Evaluation and Research in Education, 14, 3&4, 231-6.
81. Roberts, K., Dixon-Woods, M., Jones, D., Fitzpatrick, R. and Abrams, K. (1999). Meta-analysis of Qualitative and Quantitative Evidence: an Example Based on Uptake of Childhood Immunisation. Presentation at VII Cochrane Colloquium, Rome, October 1999.
82. Rogers, A. and Nicolaas, G. (1998). ‘Understanding the patterns and processes of primary care use: a combined quantitative and qualitative approach’, Sociological Research Online, 3, 4.
83. Schorr, R. and Firestone, W. (2001). Changing Mathematics Teaching in Response to a State Testing Program. Presentation at AERA Annual Conference, Seattle WA, April 2001.
84. Shavelson, R. and Towne, L. (2001). Scientific Inquiry in Education. Report of the National Research Council, Washington: National Academy Press.
85. Snow, C. (2001). ‘Knowing what we know: children, teachers, researchers’, Educational Researcher, 30, 7, 3-9.
86. Sooben, P. (2002). ‘Developing quantitative capacity in UK social science’, Social Sciences, 50, 8.
87. Speller, V., Learmonth, A. and Harrison, D. (1997). ‘The search for evidence of effective health promotion’, British Medical Journal, 315, 361-3.
88. Spillane, J. and Zeuli, J. (1999). ‘Reform and teaching: exploring patterns of practice in the context of national and state mathematics reforms’, Educational Evaluation and Policy Analysis, 21, 1, 1-28.
89. Suter, L. and Frechtling, J. (2000). Guiding principles for mathematics and science education research methods. Arlington VA: National Science Foundation.
90. Taylor, E. (2001). ‘From 1989 to 1999: A content analysis of all submissions’, Adult Education Quarterly, 51, 4, 322-40.
91. Tooley, J. and Darby, D. (1998). Educational research: a critique. London: OFSTED.
92. Torgerson, C. and Torgerson, D. (2001). ‘The need for randomised controlled trials in educational research’, British Journal of Educational Studies, 49, 3, 316-28.
93. Travis, G. and Collins, H. (1991). ‘New light on old boys: cognitive and institutional particularism in the peer-review system’, Science, Technology and Human Values, 16, 3, 322-41.
94. West, M. and Harrison, J. (1997). Bayesian Forecasting and Dynamic Models. New York: Springer.
95. White, P., Gorard, S., Fitz, J. and Taylor, C. (2001). ‘Regional and local differences in admission arrangements for schools’, Oxford Review of Education, 27, 3, 317-37.
96. Woodhead, C. (1998). ‘Academia gone to seed’, New Statesman, 26 March, pp. 51-2.