Conducting Configurational Comparative Research With Qualitative Comparative Analysis: A Hands-On Tutorial for Applied Evaluation Scholars and Practitioners

American Journal of Evaluation

Volumn 38, Issue 3, 2017, Pages 420-433

  Thiem, Alrik ^a  

^a UNIVERSITY OF GENEVA   (Switzerland)

Author keywords

configurational comparative methods (CCMs); empirical research methods; evaluation methods; qualitative comparative analysis (QCA)

Indexed keywords

EID: 85028583160     PISSN: 10982140     EISSN: 15570878     Source Type: Journal    
DOI: 10.1177/1098214016673902     Document Type: Article

References (60)

1. Balthasar A., (2006). The effects of institutional design on the utilization of evaluation. Evaluation, 12, 353–371.
2. Baumgartner M., (2009). Inferring causal complexity. Sociological Methods & Research, 38, 71–101.
3. Baumgartner M., (2015). Parsimony and causality. Quality & Quantity, 49, 839–856.
4. Baumgartner M., Thiem A., (2015a). Identifying complex causal dependencies in configurational data with Coincidence Analysis. The R Journal, 7, 176–184.
5. Baumgartner M., Thiem A., (2015b). Model ambiguities in configurational comparative research. Sociological Methods & Research. Advance online publication. doi:10.1177/0049124115610351
6. Baumgartner M., Thiem A., (2015c). Often trusted but never (properly) tested: Evaluating Qualitative Comparative Analysis. Paper presented at the 12th conference of the European Sociological Association, Czech Technical University Prague, Czech Republic. Retrieved July 15, 2016, from https://www.researchgate.net/publication/280555425_Often_Trusted_But_Never_Properly_Tested_Evaluating_Qualitative_Comparative_Analysis
7. Baxter S., Killoran A., Kelly M. P., Goyder E., (2010). Synthesizing diverse evidence: The use of primary qualitative data analysis methods and logic models in public health reviews. Public Health, 124, 99–106.
8. Befani B., (2013). Between complexity and generalization: Addressing evaluation challenges with QCA. Evaluation, 19, 269–283.
9. Befani B., Ledermann S., Sager F., (2007). Realistic evaluation and QCA: Conceptual parallels and an empirical application. Evaluation, 13, 171–192.
10. Blackman T., Wistow J., Byrne D., (2013). Using qualitative comparative analysis to understand complex policy problems. Evaluation, 19, 126–140.
11. Cooper B., Glaesser J., (2016). Qualitative comparative analysis, necessary conditions, and limited diversity: Some problematic consequences of Schneider and Wagemann’s Enhanced Standard Analysis. Field Methods, 28, 300–315.
12. Cragun D., DeBate R. D., Vadaparampil S. T., Baldwin J., Hampel H., Pal T., (2014). Comparing universal Lynch syndrome tumor-screening programs to evaluate associations between implementation strategies and patient follow-through. Genetics in Medicine, 16, 773–782.
13. Cragun D., Pal T., Vadaparampil S. T., Baldwin J., Hampel H., DeBate R. D., (2016). Qualitative comparative analysis: A hybrid method for identifying factors associated with program effectiveness. Journal of Mixed Methods Research, 10, 251–272.
14. Craig N., (2013). Seeing the wood and the trees: Using outcomes frameworks to inform planning, monitoring and evaluation in public health. Journal of Public Health, 35, 467–474.
15. Duşa A., Thiem A., (2014). QCA: A package for Qualitative Comparative Analysis (R package version 1.1-4). Retrieved September 19, 2016, from http://www.alrik-thiem.net/software/
16. Duşa A., Thiem A., (2015). Enhancing the minimization of Boolean and multivalue output functions with eQMC. Journal of Mathematical Sociology, 39, 92–108.
17. Freedman R., (1993). Necessary condition analysis: A new tool for program evaluation. Research Evaluation, 3, 127–131.
18. Gerrits L., Verweij S., (2016). Qualitative comparative analysis as a method for evaluating complex cases: An overview of literature and a stepwise guide with empirical application. Zeitschrift für Evaluation, 15, 7–22.
19. Gross M., Garvin M., (2011). Structuring PPP toll-road contracts to achieve public pricing objectives. Engineering Project Organization Journal, 1, 143–156.
20. Haesebrouck T., (2015). The added value of multi-value Qualitative Comparative Analysis. Forum Qualitative Sozialforschung, 17, Art.12. Retrieved March 11, 2016, from http://www.qualitative-research.net/index.php/fqs/article/view/2307/3917
21. Herrmann A. M., Cronqvist L., (2009). When dichotomisation becomes a problem for the analysis of middle-sized datasets. International Journal of Social Research Methodology, 12, 33–50.
22. Holvoet N., Dewachter S., (2013). Multiple paths to effective national evaluation societies: Evidence from 37 low- and middle-income countries. American Journal of Evaluation, 34, 519–544.
23. Ledermann S., (2012). Exploring the necessary conditions for evaluation use in program change. American Journal of Evaluation, 33, 159–178.
24. Mackie J. L., (1965). Causes and conditions. American Philosophical Quarterly, 2, 245–264.
25. Mackie J. L., (1974). The cement of the universe: A study of causation. Oxford, England: Oxford University Press.
26. Mahoney J., Kimball E., Koivu K. L., (2009). The logic of historical explanation in the social sciences. Comparative Political Studies, 42, 114–146.
27. Mayne J., (2001). Addressing attribution through contribution analysis: Using performance measures sensibly. Canadian Journal of Program Evaluation, 16, 1–24.
28. Mayne J., (2012). Contribution analysis: Coming of age? Evaluation, 18, 270–280.
29. Ozegowski S., (2013). Effective policy mechanisms for an equitable geographical distribution of general practitioners: A Qualitative Comparative Analysis of the accessibility of primary care in Europe. Journal of Health Services Research & Policy, 18, 151–159.
30. Pattyn V., Brans M., (2015). Organisational analytical capacity: Policy evaluation in Belgium. Policy and Society, 34, 183–196.
31. Pennell J., Rikard R. V., Sanders-Rice T., (2014). Family violence: Fathers assessing and managing their risk to children and women. Children and Youth Services Review, 47, Part 1, 36–45.
32. Ragin C. C., (1987). The comparative method: Moving beyond qualitative and quantitative strategies. Berkeley, CA: University of California Press.
33. Ragin C. C., (2000). Fuzzy-set social science. Chicago, IL: University of Chicago Press.
34. Ragin C. C., (2008). Redesigning social inquiry: Fuzzy sets and beyond. Chicago, IL: University of Chicago Press.
35. Rihoux B., (2006). Qualitative Comparative Analysis (QCA) and related systematic comparative methods: Recent advances and remaining challenges for social science research. International Sociology, 21, 679–706.
36. Sager F., Andereggen C., (2012). Dealing with complex causality in realist synthesis: The promise of Qualitative Comparative Analysis. American Journal of Evaluation, 33, 60–78.
37. Schneider C. Q., Wagemann C., (2012). Set-theoretic methods for the social sciences: A guide to Qualitative Comparative Analysis (QCA). Cambridge, MA: Cambridge University Press.
38. Thiem A., (2013). Clearly crisp, and not fuzzy: A reassessment of the (putative) pitfalls of multi-value QCA. Field Methods, 25, 197–207.
39. Thiem A., (2014a). Membership function sensitivity of descriptive statistics in fuzzy-set relations. International Journal of Social Research Methodology, 17, 625–642.
40. Thiem A., (2014b). Mill’s methods, induction and case sensitivity in qualitative comparative analysis: A comment on Hug (2013). Qualitative & Multi-Method Research, 12, 19–24.
41. Thiem A., (2014c). Navigating the complexities of Qualitative Comparative Analysis: Case numbers, necessity relations, and model ambiguities. Evaluation Review, 38, 487–513.
42. Thiem A., (2014d). Unifying configurational comparative methods: Generalized-set qualitative comparative analysis. Sociological Methods & Research, 43, 313–337.
43. Thiem A., (2015a). Parameters of fit and intermediate solutions in multi-value Qualitative Comparative Analysis. Quality & Quantity, 49, 657–674.
44. Thiem A., (2015b). Using Qualitative Comparative Analysis for identifying causal chains in configurational data: A methodological commentary on Baumgartner and Epple (2014). Sociological Methods & Research, 44, 723–736.
45. Thiem A., (2016a). Analyzing multilevel data with QCA: Yet another straightforward procedure. Quality & Quantity, 50, 121–128.
46. Thiem A., (2016b). QCApro: Professional functionality for performing and evaluating Qualitative Comparative Analysis (R package version 1.1-1). Retrieved September 19, 2016, from http://www.alrik-thiem.net/software/
47. Thiem A., (2016c). Standards of good practice and the methodology of necessary conditions in Qualitative Comparative Analysis. Political Analysis, 24, 478–484.
48. Thiem A., Baumgartner M., (2016a). Back to square one: A reply to Munck, Paine, and Schneider. Comparative Political Studies, 49, 801–806.
49. Thiem A., Baumgartner M., (2016b). Glossary for Configurational Comparative Methods, version 1.1. In Thiem A., (Ed.), QCApro: Professional functionality for performing and evaluating qualitative comparative analysis (Package Version 1.1-1). Retrieved from http://www.alrik-thiem.net/software/
50. Thiem A., Baumgartner M., (2016c). Modeling causal irrelevance in evaluations of configurational comparative methods. Sociological Methodology, 46, 345–357.
51. Thiem A., Baumgartner M., Bol D., (2016). Still lost in translation! A correction of three misunderstandings between configurational comparativists and regressional analysts. Comparative Political Studies, 49, 742–774.
52. Thiem A., Duşa A., (2013a). Boolean minimization in social science research: A review of current software for Qualitative Comparative Analysis (QCA). Social Science Computer Review, 31, 505–521.
53. Thiem A., Duşa A., (2013b). QCA: A package for Qualitative Comparative Analysis. The R Journal, 5, 87–97.
54. Thiem A., Duşa A., (2013c). Qualitative Comparative Analysis with R: A user’s guide. New York, NY: Springer.
55. Thiem A., Spöhel R., Duşa A., (2016). Enhancing sensitivity diagnostics for Qualitative Comparative Analysis: A combinatorial approach. Political Analysis, 24, 104–120.
56. Thygeson N. M., Solberg L. I., Asche S. E., Fontaine P., Gregory Pawlson L., Scholle S. H., (2012). Using fuzzy set Qualitative Comparative Analysis (fs/QCA) to explore the relationship between medical “homeness” and quality. Health Services Research, 47, 22–45.
57. Verweij S., Gerrits L. M., (2013). Understanding and researching complexity with Qualitative Comparative Analysis: Evaluating transportation infrastructure projects. Evaluation, 19, 40–55.
58. Vink M. P., Vliet O. v., (2009). Not quite crisp, not yet fuzzy? Assessing the potentials and pitfalls of multi-value QCA. Field Methods, 21, 265–289.
59. von Bertalanffy L., (1950). The theory of open systems in physics and biology. Science, 111, 23–29.
60. Zadeh L. A., (1965). Fuzzy sets. Information and Control, 8, 338–353.