ECPR

Install the app

Install this application on your home screen for quick and easy access when you’re on the go.

Just tap Share then “Add to Home Screen”

ECPR

Install the app

Install this application on your home screen for quick and easy access when you’re on the go.

Just tap Share then “Add to Home Screen”

Your subscription could not be saved. Please try again.
Your subscription to the ECPR Methods School offers and updates newsletter has been successful.

Discover ECPR's Latest Methods Course Offerings

We use Brevo as our email marketing platform. By clicking below to submit this form, you acknowledge that the information you provided will be transferred to Brevo for processing in accordance with their terms of use.

Advanced Topics in Set-Theoretic Methods and QCA

Course Dates and Times

Monday 29 February to Friday 4 March 2016
Generally classes are either 09:00-12:30 or 14:00-17:30
15 hours over 5 days

Carsten Q. Schneider

schneiderc@ceu.edu

Central European University

This course addresses advanced issues that arise if and when scholars embrace notions of sets and their relations. While it is a course about set-theoretic methods writ large, most of the time, we will discuss issues that are specific to Qualitative Comparative Analysis (QCA). Although much effort has been put into developing standards of good practice, still many important issues remain unresolved, and even sometimes unaddressed. This has given rise to a recent wave of literature sceptical of set-methods, in general, and QCA, in particular. In this course we not only discuss the issues raised by theses critiques, but go beyond them and explore the hitherto under-used potentials of set-theoretic methods. Depending on needs and interests of participants, we choose among the following topics:

  • set-theoretic multi-method principles and practices;
  • robustness and uncertainty;
  • set-theoretic theory evaluation;
  • enhanced Standard Analysis;
  • time and set-theoretic methods;
  • model ambiguity;
  • and/or two-step QCA.

Instructor Bio

Carsten Q. Schneider is Professor of Political Science at Central European University Budapest.

His research focuses on regime transitions, autocratic regimes, the qualities of democracies, and the link between social and political inequalities. He also works in the field of comparative methodology, especially on set-theoretic methods.

Carsten has published in leading political science journals, and he is the author three books, among them Set-Theoretic Methods for the Social Sciences (Cambridge University Press, 2012).

The book Qualitative Comparative Analysis (QCA) using R: A Gentle Introduction, co-authored with Ioana-Elena Oana and Eva Thomann, appeared in 2021 with Cambridge University Press and his book Set-Theoretic Multi-Method Research: A Guide to Combining QCA and Case Studies is forthcoming with the same publisher.

  @CarstenQSchneid

Participants who are in good command of all the issues addressed above under “prerequisite knowledge” can expect from this course a deepened understanding of potentials and pitfalls of set-theoretic methods. This should enable them to be both more critical and assertive if and when they choose or reject set-theoretic methods as the most appropriate research method for their research project. Successfully completing the course will also enable participants to produce QCA studies of a quality and level of sophistication beyond the current mainstream and thus yield substantive results that are more compelling both for themselves and their (critical) audience. Since much of the course explores the boundaries of the still relatively young family of set-theoretic methods, it will be unavoidable that some of our debates will have to remain inconclusive. Participants should therefore be prepared to not always be provided ready-made and fool-proof answers and procedures for all the issues that they will face when trying to implement a high-quality QCA. Rather, this course invites students to think critically about set-theoretic methods, and, by extension, also about other data analysis techniques that they will have to choose when doing empirical comparative research.

This course is the result of two developments. First, the toolbox of set-theoretic methods is quickly expanding. Second, there are renewed and forceful critiques that question the fundamental logic of set-theoretic methods and QCA and the way it is put into practice in applied research. This course deals with these two, partially overlapping, recent developments. We proceed as follows.

In order to set the stage, we discuss several recent writings that are heavily critical of set-theoretic methods and QCA. From this debate, we distil the most important issues of contention. These are, among others, the question of how robust QCA results are and how (not) concerned QCA scholars are about this issue; the unrecognized assumptions incorporated in a QCA and the preconditions that are thus required in order to meaningfully apply QCA; the status of fuzzy sets, especially their alleged distinctiveness vis-à-vis variables; and the connection between QCA and proper within-case analyses. Days 2 and 3 are dedicated to discussing these critiques. On day 2, we read and discuss contrasting arguments about the distinctiveness of STM vis-à-vis quantitative techniques. On day 3, we engage with the notion of robustness in set-theoretic methods and try to systematize the debate by specifying the analytic decisions to be made against which QCA results should be expected to be robust. Along these lines, we aim at formulating criteria for meaningful robustness tests and, based on these criteria, evaluate existing, simulation-based robustness test. On day 4, we introduce set-theoretic multi-method research as an attempt at specifying just how QCA should be combined with within-case process tracing. We define the meaning of typical and deviant cases after a QCA, spell out the different rationales for studying each of them, and provide formulas for selecting the best available cases for (comparative) within-case analysis after a QCA.

Unless student demand dictates otherwise, on day 5, we tackle two issues. First, we discuss the principles and computer-assisted practice of set-theoretic theory evaluation. Second, we present strategies for including notions of time into set-theoretic analyses. Along these lines, we discuss calibration strategies, sequence elaboration, and temporal QCA, the same as an analytic tool for analysing set-theoretic panel data.

Participants of the course should not expect to be provided a general introduction to the basics of set-theoretic methods and QCA. We will also not introduce into the very basics of the R software environment.

Participants are expected to have a firm command of basic formal logic, Boolean algebra, and set-theory. Participants also need to be familiar with the basic protocol of Qualitative Comparative Analysis (QCA), including the following topics:

  • the difference between sets and variables;
  • the notion of set calibration;
  • the meaning of set relations (sufficiency, necessity, INUS, SUIN);
  • the construction and logical minimization of a truth table;
  • the calculation and interpretation of the parameters of fit (consistency and coverage);
  • the treatment of logical remainders as done by the Standard Analysis.

In short, participants should check whether they are in command of all the issues addressed in Schneider/Wagemann (2012) “Set-Theoretic Methods for the Social Sciences”, chapters 1-7. In case of doubt, students are encouraged to consult the online appendix of the book, which contains exercises and test questions for all these chapters. Participants are further expected to be familiar with the basics of the R software environment as we will use the R packages relevant for performing set-theoretic analyses (QCA, QCAGUI, and SetMethods) during the course. Students who have attended the two-week course on Set-Theoretic Methods and QCA at the ECPR Summer School in Ljubljana should be well prepared for this advanced course.

Day Topic Details
1 Set-Theoretic Methods and QCA in a Nutshell; Critiques of STM I 120’ seminar: - the standard QCA protocol - overview of criticisms (robustness, hidden assumptions, the status of (fuzzy) sets, the detachment from cases, the superiority of non-set methods). 60’ lab: - implementation of standard QCA protocol in R.
2 Critiques of STM II: are STM and QCA really distinct? 120’ lecture: - arguments against and in favour of similarities between STM and quantitative methods. 60’ lab: - empirical assessment of arguments claiming similarity – with special focus on skewed set membership scores.
3 Critiques of STM III: how robust are QCA? 90’ lecture: - What can and cannot be the meaning of robust results in set-theoretic methods? - Robustness against what? - the inherently inductive nature of QCA - designing meaningful robustness tests. 90’ lab: - applying set-theoretic robustness tests to published QCA studies
4 Topics not addressed by critiques I: Set-theoretic multi-method research 90’ lecture: - how to select cases after a QCA - how to make use of the insights gained from these (comparative) within-case analyses. 90’ lab: - applying the post-QCA case selection principles to examples of published QCA studies.
5 Topics not addressed by critiques II: - the proper treatment of logical remainders - the inclusion of time into set-theoretic analyses (panel data) 90’ lecture: - the avoidance of untenable assumptions on remainders and the inclusion of good counterfactuals. - the intrinsic challenges of including notions of time as causally relevant. 90’ lab: - applying the Enhanced Standard Analysis to examples of published QCA studies. - implementing analysis of set-theoretic panel data.
Day Readings
Day 1 Standard QCA protocol; critiques of STM I - overview Collier, David. 2014. “Symposium. The Set-Theoretic Comparative Method: Critical Assements and the Search for Alternatives.” Qualitative & Multi-Method Research Newsletter 12(1): 1–52. Rohlfing, Ingo, and Carsten Q Schneider. 2014. “Clarifying Misunderstandings , Moving Forward: Towards Standards and Tools for Set-Theoretic Methods.” Qualitative & Multi-Method Research Newsletter 12(2): 27–34. Optional: Fiss, Peer C, Axel Marx, and Benoît Rihoux. 2014. “Getting QCA Right: Some Comments on Lucas and Szatrowski.” Sociological Methodology 44. Lucas, Samuel R, and Alisa Szatrowski. 2014. “Qualitative Comparative Analysis in Critical Perspective.” Sociological Methodology 44, DOI: 10.1177/0081175014532763. Mahoney, James. 2014. „Set Diagrams and Qualitative Research.“ Comparative Political Studies. DOI 10.1177/0010414013519410 Ragin, Charles C. 2014. “Lucas and Szatrowski (2014) in Critical Perspective.” Sociological Methodology 44. Vaisey, Stephen. 2014. “Why I ’ m Still Using QCA - Comment on Lucas and Szatrowski.” Sociological Methodology 44.Skaaning, Svend-Erik. 2011. “Assessing the Robustness of Crisp-Set and Fuzzy-Set QCA Results.” Sociological Methods & Research 40(2): 391–408.
Day 2 critiques of STM II - distinctiveness Paine, Jack. 2015. “Set-Theoretic Comparative Methods: Less Distinctive Than Claimed.” Comparative Political Studies. online first, DOI: 10.1177/0010414014564851 Thiem, Alrik, Michael Baumgartner, and Damien Bol. 2015. “Still Lost in Translation! A Correction of Three Misunderstandings between Configurational Comparativists and Regressional Analysts.” Comparative Political Studies, online first. DOI: 10.1177/0010414014565892 Schneider, Carsten Q. 2015. “Real Differences and Overlooked Similarities. A Reply to Paine (2015).” Comparative Political Studies forthcoming Optional Cooper, Barry, and Judith Glaesser. 2011. “Paradoxes and Pitfalls in Using Fuzzy Set QCA: Illustrations from a Critical Review of a Study of Educational Inequality.” Sociological Research Online 16(3). Schneider, Carsten Q., and Claudius Wagemann. 2012. Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, chapters 9
Day 3 critiques of STM III - sensitivity Krogslund, Chris, Donghyun Danny Choi, and Mathias Poertner. 2014. “Fuzzy Sets on Shaky Ground : Parametric and Specification Sensitivity in fsQCA.” Political Analysis, 23(1), 21-41. Rohlfing, Ingo. 2015. “Why Simulations are Appropriate for Evaluating Qualitative Comparative Analysis.” Quality and Quantity, online first. DOI: 10.1007/s11135-015-0251-8 Seawright, Jason. 2014. “Comment: Limited Diversity and the Unreliability of QCA.” Sociological Methodology, 44(1), 118-121. Optional Braumoeller, Bear. 2015. “Guarding Against False Positives in Qualitative Comparative Analysis.” Political Analysis, online first. DOI: 10.1093/pan/mpv017 Collier, D. 2014. “Comment: QCA Should Set Aside the Algorithms.” Sociological Methodology. http://smx.sagepub.com/lookup/doi/10.1177/0081175014542568 (August 12, 2014) Hug, S. 2013. “Qualitative Comparative Analysis: How Inductive Use and Measurement Error Lead to Problematic Inference.” Political Analysis 21(2): 252–65. Schneider, Carsten Q., and Claudius Wagemann. 2012. Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, chapters 11.2 Thiem, A. (2014). Mill's Methods, Induction and Case Sensitivity in Qualitative Comparative Analysis: A Comment on Hug (2013). Qualitative & Multi-Method Research, 12(2), 19-24
Day 4 set-theoretic multi-method research Schneider, Carsten Q., and Ingo Rohlfing. 2013. “Set-Theoretic Methods and Process Tracing in Multi-Method Research: Principles of Case Selection after QCA.” Sociological Methods and Research, 42(4), 559-597 Rohlfing, Ingo, and Carsten Q. Schneider. 2013. “Combining QCA With Process Tracing in Analyses of Necessity.” Political Research Quarterly 66(1): 220–35. Optional Mikkelsen, Kim Sass. “Fuzzy-Set Case Studies.” 2015. Sociological Methods and Research. online first. DOI: 10.1177/0049124115578032 Mikkelsen, Kim Sass. “Negative Case Selection: Justifications and Consequences for Set-Theoretic MMR.” Sociological Methods and Research. online first. DOI: 10.1177/0049124115591015 Ragin, Charles C. and Garrett Andrew Schneider. 2011. “Case-Oriented Theory Building and Theory Testing.” In The SAGE Handbook of Innovations in Social Research Methods, ed. Malcolm; Vogt Williams W. Paul. London, 150–66. Rihoux, Benoit, and Bojana Lobe. 2009. “The Case for Qualitative Comparative Analysis (QCA): Adding Leverage for Thick Cross-Case Comparison.” In Sage Handbook Of Case-Based Methods, eds. David Byrne and Charles C Ragin. London: Sage, 222–42.
Day 5 Theory evaluation/ inclusion of time Baumgartner, Michael and Ruedi Epple. 2014. “A Coincidence Analysis of a Causal Chain: The Swiss Minaret Vote.” Sociological Methods and Research, 43(2), 280-312. García-Castro, Roberto, and Miguel A. Arino. 2013. “A General Approach to Panel Data Set-Theoretic Research.” Compasss Working Paper, WP2013-76; 1–27. Schneider, Carsten Q., and Claudius Wagemann. 2012. Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, chapters 8 + 10.3 Thiem, Alrik. 2015. “Using Qualitative Comparative Analysis for Identifying Causal Chains in Configurational Data: A Methodological Commentary on Baumgartner and Epple (2014).” Sociological Methods and Research, online first. DOI: 10.1177/0049124115589032. Optional Caren, Neal, and Aaron Panofsky. 2005. “TQCA. a Technique for Adding Temporality to Qualitative Comparative Analysis.” Sociological Methods & Research 34(2): 147–72. Ragin, Charles C. 2008. Redesigning Social Inquiry: Fuzzy Sets and Beyond. Chicago: University of Chicago Press., chapters 8 + 9 Ragin, Charles C, and Sarah Strand. 2008. “Using Qualitative Comparative Analysis to Study Causal Order. Comment on Caren and Panofsky (2005).” Sociological Methods & Research 36(4): 431–41. Rihoux, Benoît. 2012. “It’s About Time. Which Best Strategies to Articulate Sequence and Process with QCA?” Paper prepared for workshop nr3 on “Methodological Advances, Bridges and Limits in the Application of Qualitative Comparative Analysis”, ECPR Joint Sessions of Workshops, Antwerp, 11-14 April 2012: 1–27 Schneider, Carsten Q, and Claudius Wagemann. 2006. “Reducing Complexity in Qualitative Comparative Analysis (QCA): Remote and Proximate Factors and the Consolidation of Democracy.” European Journal of Political Research 45(5): 751–86.

Software Requirements

R, R packages QCA, QCAGUI, SetMethods, and all their dependencies, RStudio

Hardware Requirements

None

Literature


Goertz, Gary, and James Mahoney. 2012. A Tale of Two Cultures: Contrasting Qualitative and Quantitative Paradigms. Princeton, N.J: Princeton University Press

Ragin, Charles C. 2008. Redesigning Social Inquiry: Fuzzy Sets and Beyond. Chicago: University of Chicago Press

Schneider, Carsten Q., and Claudius Wagemann. 2012. Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press

Recommended Courses to Cover Before this One

Summer School

  • Set-Theoretic Methods: Qualitative Comparative Analysis and Related Approaches
  • Introduction to R

Recommended Courses to Cover After this One

Summer School

  • Case Study Research – Method and Practice