Call for mixed analysis: A philosophical framework for combining qualitative and quantitative approaches

International Journal of Multiple Research Approaches

Volumn 3, Issue 2, 2009, Pages 114-139

  Onwuegbuzie, Anthony J ^a   Johnson, R Burke ^b   Collins, Kathleen M T ^c  

^a SAM HOUSTON STATE UNIVERSITY   (United States)

^b UNIVERSITY OF SOUTH ALABAMA   (United States)

^c UNIVERSITY OF ARKANSAS   (United States)

Author keywords

Constructivism; Critical theory; Descriptive statistics; Empirical data analysis; Epistemology; Inferential statistics; Methodology; Mixed analysis strategies; Mixed methods; Multiple operationalism; Multiple research approaches; Ontology; Participatory; Post positivism; Pragmatism; Qualitative and quantitative; Quasi statistics; Research paradigm; Social science research typology

Indexed keywords

EID: 77958188920     PISSN: 18340806     EISSN: 18340814     Source Type: Journal    
DOI: 10.5172/mra.3.2.114     Document Type: Article

References (126)

1. Barton, A. and Lazarsfeld, F. (1955) Some functions of qualitative data analysis in sociological research. Sociologica, 1, 321-361.
2. Bazeley, P. (2003) Computerized data analysis for mixed methods research. In A. Tashakkori and C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 385-422) Thousand Oaks CA: Sage.
3. Bazeley, P. (2006) The contribution of computer software to integrating qualitative and quantitative data and analyses. Research in the Schools, 13(1), 64-74.
4. Becker, H. S. (1970) Sociological work: Method and substance. New Brunswick NJ: Transaction Books.
5. Becker, H. S., Geer, B., Hughes, E. C. and Strauss, A. L. (1977) Boys in white: Student culture in medical school. New Brunswick NJ: Transaction Books. (Original work published by University of Chicago Press 1961)
6. Bergman, M. (Ed.) (2008) Advances in mixed methods research. Theories and applications. Thousand Oaks CA: Sage.
7. Blaikie, N. (1993) Approaches to social enquiry. Cambridge: Polity.
8. Brewer, J. and Hunter, A. (1989) Multimethod research. Thousand Oaks CA: Sage.
9. Bryman, A. (1988) Quantity and quality in social research. London: Urwin Hyman.
10. Bryman, A. (1992) Quantitative and qualitative research: Further reflections on their integration. In J. Brannen (Ed.), Mixing methods: Qualitative and quantitative research (pp. 89-111) Aldershot: Avebury Press.
11. Bryk, A. S. and Raudenbush, S. W. (1992) Hierarchical linear models: Applications and data analysis methods. Newbury Park CA: Sage.
12. Campbell, D. T. and Fiske, D. W. (1959) Convergent and discriminant validation by the multitrait-multi-method matrix. Psychological Bulletin, 56, 81-105.
13. Caracelli, V. W. and Greene, J. C. (1993) Data analysis strategies for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 15 195-207.
14. Chen, H. T. (2006) A theory-driven evaluation perspective on mixed methods research. Research in the Schools, 13(1), 75-83.
15. Chi, M. T. H. (1997) Quantifying qualitative analyses of verbal data: A practical guide. The Journal of the Learning Sciences, 6, 271-315.
16. Collins, K. M. T., Onwuegbuzie, A. J. and Sutton, I. L. (2006) A model incorporating the rationale and purpose for conducting mixed methods research in special education and beyond. Learning Disabilities: A Contemporary Journal, 4, 67-100.
17. Cook, T. D. and Campbell, D. T. (1979) Quasiexperimentation: Design and analysis issues for field settings. Chicago: Rand McNally.
18. Corden, A. and Hirst, M. (2008) Implementing a mixed methods approach to explore the financial implications of death of a life partner. Journal of Mixed Methods, 2, 208-220.
19. Creswell, J. W. and Plano Clark, V. L. (2007) Designing and conducting mixed methods research. Thousand Oaks CA: Sage.
20. Creswell, J. W. and Plano Clark, V. L. (2008) Conducting Mixed Methods Research and the Practice of Research. Workshop presented at the annual Mixed Methods Conference. Cambridge UK.
21. Curtis, S., Gesler, W., Smith, G. and Washburn, S. (2000) Approaches to sampling and case selection in qualitative research: Examples in the geography of health. Social Science and Medicine, 50, 1001-1014.
22. Denscombe, M. (2008) Communities of practice: A research paradigm for the mixed methods approach. Journal of Mixed Methods Research, 2, 270-283.
23. Denzin, N. K. and Lincoln, Y. S. (2005) Paradigmatic controversies, contradictions and emerging confluences. In N. K. Denzin and Y. S. Lincoln (Eds.), Sage handbook of qualitative research (2nd edn, pp. 191-216) Thousand Oaks CA: Sage.
24. Firestone, W. A. (1993) Alternative arguments for generalizing from data, as applied to qualitative research. Educational Researcher, 22(4), 16-23.
25. Fischer, G. (2001) Communities of interest: Learning through the interaction of multiple knowledge systems. In S. Bjornestad, R. Moe, A. Morch and A. Opdahl (Eds.), Proceedings of the 24th IRIS Conference, Ulvik, Norway.
26. Flick, U. (1998) An introduction to qualitative research: Theory, method and applications. London: Sage.
27. Fox, J. (1997) Applied regression analysis, linear models and related methods. Thousand Oaks CA: Sage.
28. Fryer, D. and Feather, N. T. (1994) Intervention techniques. In C. Cassell and G. Symon (Eds.), Qualitative methods in organizational research (pp. 230-247) London: Sage.
29. Glaser, B. G. and Strauss, A. L. (1967) The discovery of grounded theory: Strategies for qualitative research. Chicago: Aldine.
30. Gorard, S. and Smith, E. (Eds.) (2006) Special Issue on ‘Combining numbers with narratives.’ Evaluation and Research in Education 19(2) Retrieved March 28 2009, from http://www.multilingual-matters.net/erie/019/2
31. Greene, J. C. (2006) Toward a methodology of mixed methods social inquiry. Research in the Schools, 13(1), 93-98.
32. Greene, J. C. (2007) Mixed methods in social inquiry. San Francisco: Jossey-Bass.
33. Greene, J. C. (2008) Is mixed methods social inquiry a distinctive methodology? Journal of Mixed Methods Research, 2, 7-22.
34. Greene, J. C. and Caracelli, V. J. (1997) Defining and describing the paradigm issue in mixed-method evaluation. In J. C. Greene and V. J. Caracelli (Eds.), Advances in mixed-method evaluation: The challenges and benefits of integrating diverse paradigms (New Directions for Evaluation, No. 74, pp. 5-17) San Francisco: Jossey-Bass.
35. Greene, J. C., Caracelli, V. J. and Graham, W. F. (1989) Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 11, 255-274.
36. Guba, E. G. (1990) The alternative paradigm dialog. In E. G. Guba (Ed.), The paradigm dialog (pp. 17-27) Newbury Park CA: Sage.
37. Hacking, I. (1983) Representing and intervening: Introductory topics in the philosophy of natural science. New York: Cambridge University Press.
38. Hammersley, M. (1992) Deconstructing the qualitative-quantitative divide. In J. Brannen (Ed.) Mixing methods: Qualitative and quantitative research (pp. 39-55) Aldershot: Avebury Press.
39. Henson, R. K., Capraro, R. M. and Capraro, M. M. (2004) Reporting practice and use of exploratory factor analysis in educational research journals: Errors and explanation. Research in the Schools, 11(2), 61-72.
40. Henson, R. K. and Roberts, J. K. (2006) Use of exploratory factor analysis in published research. Educational and Psychological Measurement, 66, 393-416.
41. Heron, J. and Reason, P. (1997) A participatory inquiry paradigm. Qualitative Inquiry, 3, 274-294.
42. Hetzel, R. D. (1996) A primer on factor analysis with comments on patterns of practice and reporting. In B. Thompson (Ed.), Advances in social science methodology (Vol. 4, pp. 175-206) Greenwich CT: JAI Press.
43. Houston, S. (2001) Beyond social constructionism: Critical realism and social work. British Journal of SocialWork, 31, 845-861.
44. Jick, T. D. (1983) Mixing qualitative and quantitative methods: Triangulation in action. In J. Vam Maanen (Ed.), Qualitative methodology (pp. 135-148) Thousand Oaks CA: Sage.
45. Johnson, R. B. (2006) Special issue on ‘New directions in mixed methods research.’ Research in the Schools, 13(1) Retrieved July 8 2008, from http://www.msera.org/rits_131.htm
46. Johnson, R. B. (2008) Editorial: Living with tensions. Journal of Mixed Methods Research, 2, 202-207.
47. Johnson, R. B. and Christensen, L. B. (2008) Educational research: Quantitative, qualitative and mixed approaches (3rd edn) Thousand Oaks CA: Sage.
48. Johnson, R. B. and Onwuegbuzie, A. J. (2004) Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14-26.
49. Johnson, R. B., Onwuegbuzie, A. J. and Turner, L. A. (2007) Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1, 112-133.
50. Kant, I. (1781/1998) The Cambridge edition of the works of Immanuel Kant: Critique of pure reason. Cambridge UK: Cambridge University Press.
51. Kennedy, M. (1979) Generalizing from single case studies. Evaluation Quarterly, 3, 661-678.
52. Kidder, L. H. and Fine, M. (1987) Qualitative and quantitative methods: When stories converge. In M. M. Mark and R. L. Shotland (Eds.), Multiple methods in program evaluation (New Directions of Program Evaluation, No. 35, pp. 57-75) San Francisco: Jossey-Bass.
53. Kuhn, T. S. (1962) The structure of scientific revolutions. Chicago: University of Chicago Press.
54. Lather, P. (1986) Research as praxis. Harvard Educational Review, 56, 257-277.
55. Lather, P. (2006) Paradigm proliferation as a good thing to think with: Teaching research in education as a wild profusion. International Journal of Qualitative Studies 19(1), 35-57.
56. Layder, D. (1993) New strategies in social research: An introduction and guide. Cambridge UK: Polity Press.
57. LeCompte, M. D. and Preissle, J. (1993) Ethnography and qualitative design in educational research (2nd edn) San Diego CA: Academic Press.
58. Lee, Y-j. and Greene, J. C. (2007) The predictive validity of an ESL placement test: A mixed methods approach. Journal of Mixed Methods Research, 1, 366-389.
59. Leech, N. L. and Onwuegbuzie, A. J. (2007) An array of qualitative data analysis tools: A call for qualitative data analysis triangulation. School Psychology Quarterly, 22, 557-584.
60. Leech, N. L. and Onwuegbuzie, A. J. (2008) Qualitative data analysis: A compendium of techniques and a framework for selection for school psychology research and beyond. School Psychology Quarterly, 23, 587-604.
61. Leech, N. L. and Onwuegbuzie, A. J. (Eds) (2010) Special issue on ‘Teaching mixed methods.’ International Journal of Multiple Research Approaches, 4(1), in press.
62. Li, S., Marquart, J. M. and Zercher, C. (2000) Conceptual issues and analytical strategies in mixed-method studies of preschool inclusion. Journal of Early Intervention, 23, 116-132.
63. Lincoln, Y. S. and Guba, E. G. (1985) Naturalistic inquiry. Beverly Hills CA: Sage.
64. Louis, K. S. (1982) Sociologist as sleuth: Integrating methods in the RDU study. American Behavioral Scientist, 26(1), 101-120.
65. Madey, D. L. (1982) Some benefits of integrating qualitative and quantitative methods in program evaluation, with some illustrations. Educational Evaluation and Policy Analysis, 4, 223-236.
66. Mark, M. M. and Shotland, R. L. (1987) Alternative models for the use of multiple methods. In M. M. Mark and R. L. Shotland (Eds.), Multiple methods in program evaluation (New Directions of Program Evaluation, No. 35 pp. 95-100) San Francisco: Jossey-Bass.
67. Maxcy, S. J. (2003) Pragmatic threads in mixed methods research in the social sciences: The search for multiple modes of inquiry and the end of the philosophy of formalism. In A. Tashakkori and C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 5189) Thousand Oaks CA: Sage.
68. Maxwell, J. A. (1996) Qualitative research design. Newbury Park CA: Sage.
69. Maxwell, J. A. (2004, April) Realism as a stance for mixed methods research. Paper presented at the annual meeting of the American Educational Research Association, San Diego CA.
70. Maxwell, J. A., Bashook, G. and Sandlow, C. J. (1986) Combining ethnographic and experimental methods in educational evaluation. In D. M. Fetterman and M. A. Pittman (Eds.), Educational evaluation: Ethnography in theory, practice and politics (pp. 121-143) Thousand Oaks CA: Sage.
71. Maxwell, J. A. and Loomis, D. M. (2003) Mixed methods design: An alternative approach. In A. Tashakkori and C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 241-272) Thousand Oaks CA: Sage.
72. McConney, A., Rudd, A. and Ayres, R. (2002) Getting to the bottom line: A method for synthesizing findings within mixed-method program evaluations. American Journal of Evaluation, 23, 121-140.
73. McEvoy, P. and Richards, D. (2003) Critical realism: A way forward for evaluation research in nursing? Journal of Advanced Nursing, 43, 411-420.
74. McEvoy, P. and Richards, D. (2006) A critical realist rationale for using a combination of quantitative and qualitative methods. Journal of Research in Nursing, 11, 66-78.
75. Mertens, D. (2003) Mixed methods and the politics of human research: The transformative-emancipatory perspective. In A. Tashakkori and C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 135-164) Thousand Oaks CA: Sage.
76. Mertens, D. (2008, July) Transformative mixed methods research. Workshop presented at the annual mixed methods conference. Cambridge UK.
77. Miles, M. B. and Huberman, A. M. (1994) Qualitative data analysis: An expanded sourcebook (2nd edn) Thousand Oaks CA: Sage.
78. Morrow, R. A. and Brown, D. D. (1994) Critical theory and methodology (Contemporary Social Theory) Thousand Oaks CA: Sage.
79. Morse, J. M. (1995) The significance of saturation. Qualitative Health Research, 5, 147- 149.
80. Morse, J. M. (2003) Principles of mixed methods and multimethod research design. In A. Tashakkori and C. Teddlie (Eds), Handbook of mixed methods in social and behavioral research (pp. 189-208) Thousand Oaks CA: Sage.
81. O’Cathain, A. (2008, July) ‘Any other comments?’ The use of open questions in questionnaires. Workshop presented at the annual mixed methods conference. Cambridge UK.
82. O’Cathain, A. and Collins, K. M. T. (Eds) (2009) Special issue ‘Mixed methods for novice researchers.’ International Journal of Multiple Research Approaches, 3(1), 1-112.
83. Onwuegbuzie, A. J. (2002) Why can’t we all get along? Towards a framework for unifying research paradigms. Education, 122, 518-530.
84. Onwuegbuzie, A. J. (2003) Effect sizes in qualitative research: A prolegomenon. Quality and Quantity: International Journal of Methodology, 37, 393-409.
85. Onwuegbuzie, A. J. (2007) Mixed methods research in sociology and beyond. In G. Ritzer (Ed.), Encyclopedia of Sociology (Vol. VI, pp. 2978-2981) Oxford: Blackwell.
86. Onwuegbuzie, A. J. and Collins, K. M. T. (2008, July) A step-by-step guide to publishing mixed research articles. Workshop presented at the annual mixed methods conference. Cambridge UK.
87. Onwuegbuzie, A. J. and Combs, J. P. (2009) Toward a conceptual framework for mixing data analysis strategies. Manuscript submitted for publication.
88. Onwuegbuzie, A. J. and Daniel, L. G. (2003, February 12) Typology of analytical and interpretational errors in quantitative and qualitative educational research. Current Issues in Education [On-line], 6(2) Retrieved March 28 2009, from http://cie.ed.asu.edu/volume6/number2
89. Onwuegbuzie, A. J. and Dickinson, W. B. (2008) Mixed methods analysis and information visualization: Graphical display for effective communication of research results. The Qualitative Report, 13, 204-225. Retrieved March 28 2009, from http://www.nova.edu/ssss/QR/QR13-2/onwueg buzie.pdf
90. Onwuegbuzie, A. J. and Johnson, R. B. (2006) The validity issue in mixed research. Research in the Schools, 13(1), 48-63.
91. Onwuegbuzie, A. J. and Leech, N. L. (2004) Enhancing the interpretation of ‘significant’ findings: The role of mixed methods research. The Qualitative Report, 9, 770-792. Retrieved March 28 2009, from http://www.nova.edu/ssss/QR/QR9-4/onwuegbuzie.pdf
92. Onwuegbuzie, A. J. and Leech, N. L. (2005) On becoming a pragmatist researcher: The importance of combining quantitative and qualitative research methodologies. International Journal of Social Research Methodology: Theory and Practice, 8, 375-387.
93. Onwuegbuzie, A. J. and Leech, N. L. (2006) Linking research questions to mixed methods data analysis procedures. The Qualitative Report, 11, 474-498. Retrieved July 8 2008, from http://www.nova.edu/ssss/QR/QR11-3/onwuegbuzie.pdf
94. Onwuegbuzie, A. J., Slate, J. R., Leech, N. L. and Collins, K. M. T. (2007) Conducting mixed analyses: A general typology. International Journal of Multiple Research Approaches, 1, 4-17.
95. Onwuegbuzie, A. J., Slate, J. R., Leech, N. L. and Collins, K. M. T. (2008, March) Mixed data analysis techniques: A comprehensive step-by-step approach. Professional Development Training Course presented at the annual meeting of the American Educational Research Association, New York.
96. Onwuegbuzie, A. J., Slate, J. R., Leech, N. L. and Collins, K. M. T. (2009) Mixed data analysis: Innovative integration techniques. International Journal of Multiple Research Approaches, 3(1), 13-33.
97. Onwuegbuzie, A. J. and Teddlie, C. (2003) A framework for analyzing data in mixed methods research. In A. Tashakkori and C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 351-383) Thousand Oaks CA: Sage.
98. Onwuegbuzie, A. J., Witcher, A. E., Collins, K. M. T., Filer, J. D., Wiedmaier, C. D. and Moore, C. W. (2007) Students’ perceptions of characteristics of effective college teachers: A validity study of a teaching evaluation form using a mixed methods analysis. American Educational Research Journal, 44, 113-160.
99. Patton, M. Q. (2002) Qualitative research and evaluation methods. Thousand Oaks CA: Sage.
100. Phelan, P. (1987) Compatibility of qualitative and quantitative methods: Studying child sexual abuse in America. Education and Urban Society, 20(1), 35-41.
101. Phillips, D. C. and Burbules, N. C. (2000) Postpositivism and educational research. New York: Rowman & Littlefield.
102. Plano Clark, V. L. and Creswell, J. W. (2007) The mixed methods reader. Thousand Oaks CA: Sage.
103. Popper, K. (1994) In search of a better world: Lectures and essays from thirty years. London: Routledge.
104. Putnam, H. (2002) The collapse of the fact/value dichotomy and other essays. Cambridge MA: Harvard University Press.
105. Reichardt, C. S. and Cook, T. D. (1979) Beyond qualitative versus quantitative methods. In T. D. Cook and C. S. Reichardt (Eds.), Qualitative and quantitative methods in evaluation research (pp. 732) Thousand Oaks CA: Sage.
106. Rescher, N. (2000) Realistic pragmatism: An introduction to pragmatic philosophy. Albany: State University of New York Press.
107. Ridenour, C. S. and Newman, I. (2008) Mixed methods research: Exploring the interactive continuum. Carbondale IL: Southern Illinois Press.
108. Roberts, A. (2002) A principled complementarity of method: In defence of methodological eclecticism and the qualitative-qualitative debate. The Qualitative Report 7(3) Retrieved March 28 2009, from www.nova.edu/ssss/QR/QR7-3/roberts.html.
109. Rorty, R. (1991) Objectivity, relativism and truth: Philosophical papers (Vol. 1). Cambridge UK: Cambridge University Press.
110. Rossman, G. B. and Wilson, B. L. (1985) Numbers and words: Combining quantitative and qualitative methods in a single large-scale evaluation study. Evaluation Review, 9, 627-643.
111. Sandelowski, M. (2000) Combining qualitative and quantitative sampling, data collection and analysis techniques in mixed-method studies. Research in Nursing Health, 23, 246-255.
112. Sandelowski, M. (2001) Real qualitative researchers don’t count: The use of numbers in qualitative research. Research in Nursing and Health, 24, 230-240.
113. Sechrest, L. and Sidana, S. (1995) Quantitative and qualitative methods: Is there an alternative? Evaluation and Program Planning, 18, 77-87.
114. Schumacker, R. E. and Lomax, R. G. (1996) A beginner’s guide to structural equation modeling. Mahwah NJ: Lawrence Erlbaum Associates.
115. Smith, M. L. (1997) Mixing and matching: Methods and models. In J. C. Greene and V. J Caracelli (Eds), Advances in mixed-method evaluation: The challenges and benefits of integrating diverse paradigms (New Directions for Evaluation No. 74, pp. 73-85) San Francisco: Jossey-Bass.
116. Stake, R. E. (1980) The case study method in social enquiry. In H. Simons (Ed.), Towards a science of the singular (pp. 62-75) CARE Occasional Publications No. 10. Norwich, UK: Center for Applied Research in Education, University of East Anglia.
117. Stake, R. E. (2005) Qualitative case studies. In N. K. Denzin and Y. S. Lincoln (Eds.), The Sage handbook of qualitative research (3rd edn, pp. 443-466) Thousand Oaks CA: Sage.
118. Stake, R. E. and Trumbull, D. J. (1982) Naturalistic generalizations. Review Journal of Philosophy and Social Science, 7, 3-12.
119. Strauss, A. and Corbin, J. (1990) Basics of qualitative research: Grounded theory procedures and techniques. Newbury Park CA: Sage.
120. Tashakkori, A. and Teddlie, C. (1998) Mixed methodology: Combining qualitative and quantitative approaches. Applied Social Research Methods Series (Vol. 46) Thousand Oaks CA: Sage.
121. Tashakkori, A. and Teddlie, C. (Eds) (2003) Handbook of mixed methods in social and behavioral research. Thousand Oaks CA: Sage.
122. Teddlie, C. and Johnson, R. B. (2009) Methodological thought since the 20th century. In C. Teddlie and A. Tashakkori (Eds), Foundations of mixed methods research: Integrating quantitative and qualitative techniques in the social and behavioral sciences (pp. 62-82) Thousand Oaks CA: Sage.
123. Teddlie, C. and Tashakkori, A. (2009) Foundations of mixed methods research: Integrating quantitative and qualitative techniques in the social and behavioral sciences. Thousand Oaks CA: Sage.
124. Teddlie, C., Tashakkori, A. and Johnson, R. B. (2008) Emergent techniques in the gathering and analysis of mixed methods data. In S. N. Hesse-Biber and P. Leavy (Eds), Handbook of emergent methods (pp. 389-414) New York: The Guilford Press.
125. Yin, R. K. (2009) Case study research: Design and methods (4th edn) Thousand Oaks CA: Sage.
126. Yu, C. H. (2003) Misconceived relationships between logical positivism and quantitative research. Research Methods Forum [On-line]. Retrieved September 2 2004, from http://www.aom.pace. edu/rmd/2002forum.html.