SB111 - Qualitative Comparative Analysis and Fuzzy Sets

Instructor Details

Instructor Photo

Patrick A. Mello

Institution:
Bavarian School of Public Policy

Instructor Bio

Patrick A. Mello is Research and Teaching Associate at the Chair of European and Global Governance at the Bavarian School of Public Policy, Technical University of Munich.

His substantive research focuses on international security and foreign policy analysis, and his methodological research interests lie in comparative and case study approaches, with an emphasis on fuzzy-set QCA.

Patrick's work has appeared in journals such as the European Journal of International Relations, the Journal of International Relations and Development, and West European Politics.

His book Democratic Participation in Armed Conflict: Military Involvement in Kosovo, Afghanistan and Iraq was published with Palgrave Macmillan in 2014.

  @patrickamello

Instructor Details

Instructor Photo

Carsten Q. Schneider

Institution:
Central European University

Instructor Bio

Carsten Q. Schneider is Professor of Political Science and Head of the Political Science Department at CEU.

His research focuses on regime transitions, autocratic regimes, and the qualities of democracies. He is also working in the field of comparative methodology, especially on set-theoretic methods.

Carsten has published articles in several peer-reviewed journals and three books, among them the 2012 Cambridge University Press title Set-Theoretic Methods for the Social Sciences, co-authored with Claudius Wagemann.

  @CarstenQSchneid


Course Dates and Times

Monday 31 July - Friday 4 August and Monday 7 - Friday 11 August

14:00-17:30

Please see Timetable for full details.

Location
Building: N13 Room: 303
Prerequisite Knowledge

Participants are not required to have any prior knowledge of QCA or the R software environment and the package relevant for set-theoretic methods. However, they would profit from prior empirical-comparative training and we strongly encourage advance familiarization with the basic principles of the method by reading the recommended literature as specified in the reading list. A previous introduction to the basic functions of R and RStudio will be useful to start working with the software from day 1.

Short Outline

This course introduces participants to set-theoretic methods and their application in the social sciences with a focus on Qualitative Comparative Analysis. The introductory course is complemented by an advanced course that is taught at the ECPR Winter School in Bamberg. The course starts out by familiarizing students with the basic concepts of the underlying methodological perspective, among them the central notions of necessity and sufficiency, formal logic and Boolean algebra. From there, we move to the logic and analysis of truth tables and discuss the most important problems that emerge when this analytical tool is used for exploring social science data. Right from the beginning, students will be exposed to performing set-theoretic analyses with the relevant R software packages. When discussing set-theoretic methods, in-class debates will engage on broad, general comparative social research issues, such as case selection principles, concept formation, questions of data aggregation and the treatment of causally relevant notions of time. Examples are drawn from published applications in the social sciences. Participants are encouraged to bring their own raw data for in-class exercises and assignments, if available.

Long Course Outline

The central aim of week 1 (P.A. Mello) is to familiarize the participants with the formal logic of set-theoretic methods and to introduce QCA as an approach, its main assumptions, the technical environment (software) and the standard procedures and operations. Particular emphasis is put on a thorough understanding of the notions of necessity and sufficiency, as they are the nuts and bolts of QCA that set it apart from the majority of other available cross-case comparative techniques.

  • On day 1, participants will be introduced to the course topic, the content and sequence of the course sessions, as well as the course resources. We will also touch upon the basics of set-theoretic methods, the epistemology of QCA, its different variants, and how it compares to other standard qualitative and quantitative social scientific research designs. The centrepiece of the first session will be a demonstration of QCA on the basis of a recently published study.
  • On day 2, we turn to the methodological foundations of QCA including a thorough discussion of the basic mathematical concepts of QCA, which are derived from set theory. The session begins by with an outline of sets and set membership, including the notion of fuzzy sets as opposed to crisp sets. Once these essentials are in place, we turn to Boolean and fuzzy algebra, formal logic and operations on complex expressions.
  • On day 3, we will start by revisiting notions of causal complexity with a focus on INUS and SUIN causes. Afterwards we address the question of how to prepare observational data to perform QCA, i.e. how to calibrate. In doing so, we will cover various modes of calibrating raw data for crisp-set, multi-value and fuzzy-set QCA. We will go through various calibration techniques using R and discuss the consequences of different calibration decisions.
  • On day 4, we will define the notion of a truth table in crisp-set and fuzzy-set QCA and how it differs from a data matrix. We will show how to analyse truth tables with respect to necessary and sufficient conditions in order to derive solution formulas. This includes the Quine-McCluskey Algorithm for the logical minimization of the sufficiency statements in a truth table.
  • On day 5, we will turn to the so-called parameters of fit that are central to any QCA study, i.e. the measures of consistency and coverage for necessary and sufficient conditions. We will further discuss some methodological issues that are related to the parameters of fit. The first week will be concluded with an informal course evaluation and a consideration of topics that the participants would like to see covered in more depth in week 2.

The purpose of week 2 (C.Q. Schneider) is fourfold: (1) to re-visit the core points of QCA addressed in week 1 (calibration, tests of necessity and sufficiency, truth tables, parameters of fit); (2) to elaborate on further issues that arise when neat formal logical tools and concepts, such as necessity, sufficiency, and truth tables, are applied to social science data (mainly the issues of limited diversity and the challenge to make good counterfactuals on so-called logical remainders); (3) to get better acquainted with the standards of good practice, both in its fundamental aspects and in using the relevant software programmes; (4) to discuss general methodological issues such as robustness and theory evaluation from a set-theoretic point of view.

  • On day 6, we will start by briefly reviewing what we learned in week 1, above all with regard to the basics of the analysis of necessary and sufficient conditions and how truth tables are used to reveal the latter. Putting everything together, we explain how the Truth Table algorithm, the standard mode for analysing crisp and fuzzy sets in QCA, works. We will recap the notions of parameters of fit, problematize some of their properties, and elaborate on potential improvements of these formulas. Since several of the problems have their roots in what could be called skewed set membership scores, we will be looking into this issue more closely.
  • On day 7, we will discuss the second problem of incomplete truth tables: logical remainder rows. We will explain how this phenomenon of limited diversity arises and which basic strategies are at the researcher’s disposal to mitigate its impact on drawing inferences. Above all, we will show how counterfactual thinking can be used to resolve problems of limited diversity. This leads to the development of “intermediate solutions” in a so-called standard analysis.
  • On day 8, we continue with the issue of limited diversity and introduce several amendments to the standard analysis. In addition to distinguishing between easy and difficult counterfactuals, we introduce the notion of tenable and untenable assumptions on remainders.
  • On day 9, we put together the material of the entire course by spelling out the Truth Table algorithm, i.e. the process from turning the data matrix into a truth table, then logically minimizing the table, allowing for different strategies vis-à-vis the logical remainders, and calculating the parameters of fit for each solution formula. During this day, participants are asked to apply their knowledge gained during the course to different published data sets and/or their own data.
  • Day 10 will be devoted to deepening our knowledge on how to perform a QCA. In addition, we spell out the principles of Set-Theoretic Multi-Method Research, that is, how to combine cross-case analyses using QCA with within-case analyses using process tracing.

Throughout the course, we will analyse fake and real data in the computer lab, using the R software environment and its QCA package. In addition to prepared datasets, which will be made available, participants are encouraged to bring their own raw data (even if this data is still tentative), which can be used for lab exercises and project work. Instructors and teaching assistants will be available for individual appointments with course participants to discuss research projects, questions regarding the design of a QCA study, the “formatting” of raw data to be compatible with QCA, and similar issues.

Day-to-Day Schedule

Day 
Topic 
Details 
Week 1: Goals- Address fundamental issues in comparative research - Introduce set-theoretic principles and formal logic - Become familiar with the terminology and principles of QCA - Practice the use of the QCA software package for the R environment 
Monday 1Course Introduction (120’) - Detailed course overview - Set-theoretic methods - Causal complexity (Introduction) - Rationale for applying QCA - Empirical demonstration

Introduction (60’)

-  Tour of QCA resources

-  Introduction to R and the QCA package

Tuesday 2Set Theory (90’) - Methodological foundations: set theory, Boolean and fuzzy algebra, formal logic - Set operations and set relations

Exercises (90’)

-  Further introduction to R

-  Calculation of Boolean operations

    -  Assessing necessity and sufficiency

Wednesday 3Causal Complexity and Calibration (90’) - Causal complexity - Measurement and calibration - Calibration techniques - Differences in calibration and their consequences

Exercises (90’)

-  Calibrating fuzzy sets (participants are  encouraged to bring their own raw data for the exercises, if available)

Thursday 4Truth Table Analysis (90’) - From data matrix to truth table - Analyzing truth tables - Quine-McCluskey Algorithm

Exercises (90’)

-  Running the standard analysis

-  Calculation of solution terms

Friday 5Parameters of Fit (90’) - Consistency and coverage measures for necessary and sufficient conditions - Issues related to the parameters of fit

Exercises (90’)

-  Calculating parameters of fit

-  Graphical tools for assessing consistency

-  Informal evaluation of week 1

Week 2: Goals- Deepen the skills and knowledge on QCA - Apply QCA to real data and learn how to address typical challenges of applied QCA - Become further acquainted with standards of good practice - Explore the limitations and pitfalls of set-theoretic methods  
Monday 8Recap of Week 1 and Alternative Parameters of Fit (120’) - Calibration - Set relations - Truth Table analysis - Parameters of Fit - Skewed set membership scores

Exercises (60’)

Rehearsal of analytic procedures learned during week 1

Tuesday 9Limited Diversity I (90’) - Origins of remainders - Types of remainders - Types of assumptions on remainders - The Standard Analysis

Exercises (90’)

Using the appropriate software package for producing the conservative, intermediate, and most parsimonious solution

Wednesday 10Limited Diversity II (90’) - Untenable versus tenable assumptions - Enhanced Standard Analysis

Exercises (90’)

Using the appropriate software packages for performing the Enhanced Standard Analysis

Thursday 11Advanced Standard Analysis (60’) - From data matrix to truth table - From truth table to solution formula

Exercises (120’)

Practicing full-blown QCA: from raw data to calibrated data to truth table representation to analyses of truth table and the interpretation of the resulting solution formula

Friday 12Deepening of Knowledge and Set-Theoretic Multi-Method Research (60’) - Post-QCA case selection principles and practices - Conclusion/debriefing of course

Exercises (120’)  

  • Exercises on reanalysing published QCA and further improving such analyses

Identification of typical cases and deviant cases after a QCA

Day-to-Day Reading List

Day 
Readings 
General note

The mandatory reading for this course is:

Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press.

Below, we specify for each day which chapter(s) from this book are to be read and which additional optional literature students may want to consult.

Monday 1

*Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, pp. 1-20.

Tuesday 2

*Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, pp. 21-31; 42-90.

Goertz, Gary and James Mahoney (2012). A Tale of Two Cultures: Qualitative and Quantitative Research in the Social Sciences. Princeton: Princeton University Press, chapter 2.

Ragin, Charles C. (1987). The Comparative Method. Moving Beyond Qualitative and Quantitative Strategies. Berkeley: University of California Press, chapter 6.

Wednesday 3

*Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, pp. 32-41, 76-90.

Ragin, Charles C. (2008). Redesigning Social Inquiry: Fuzzy Sets and Beyond. Chicago: University of Chicago Press, chapters 4 & 5.

Rohlfing, Ingo (2012). Case Studies and Causal Inference: An Integrative Framework. Basingstoke: Palgrave Macmillan, chapter 2.

Thursday 4

*Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, pp. 91-115.

Ragin, Charles C. (2008). Redesigning Social Inquiry: Fuzzy Sets and Beyond. Chicago: University of Chicago Press chapter 7.

Friday 5

*Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, pp. 119-150.

Ragin, Charles C. (2008). Redesigning Social Inquiry: Fuzzy Sets and Beyond. Chicago: University of Chicago Press, chapter 3.

Monday 8

*Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, chapter 9.2.

Goertz, Gary (2006). “Assessing the Trivialness, Relevance, and Relative Importance of Necessary or Sufficient Conditions in Social Science.” Studies in Comparative International Development 41(2): 88-109.

Tuesday 9

*Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, chapter 6.

Ragin, Charles C. (1987). The Comparative Method. Moving Beyond Qualitative and Quantitative Strategies. Berkeley: University of California Press, chapter 7.

Ragin, Charles C. (2008). Redesigning Social Inquiry: Fuzzy Sets and Beyond. Chicago: University of Chicago Press, chapters 8 & 9.

Wednesday 10

*Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, chapter 8.

Emmenegger, Patrick (2012). “How Good Are Your Counterfactuals? Assessing Quantitative Macro-Comparative Welfare State Research.” Journal of European Social Policy, 21 (4): 365-80.

Thursday 11

*Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, chapter 7

Ragin, Charles C. (2008). Redesigning Social Inquiry: Fuzzy Sets and Beyond. Chicago: University of Chicago Press, chapter 9.

Friday 12

*Schneider, Carsten Q. and Ingo Rohlfing (2013). “Set-Theoretic Methods and Process Tracing in Multi-Method Research: Principles of Case Selection after QCA.” Sociological Methods and Research, DOI: 10.1177/0049124113481341

*Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press, chapters 11.1 and conclusion.

Rohlfing, Ingo and Carsten Q. Schneider (2013) “Combining QCA With Process Tracing in Analyses of Necessity.” Political Research Quarterly 66(1): 220–35.

Software Requirements

R, RStudio, packages “QCA”, “SetMethods” and all their dependencies

Hardware Requirements

None

Literature

a) Mandatory reading

Schneider, Carsten Q. and Claudius Wagemann (2012). Set-Theoretic Methods for the Social Sciences: A Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press.

b) Recommended books

Goertz, Gary and James Mahoney (2012). A Tale of Two Cultures: Qualitative and Quantitative Research in the Social Sciences. Princeton: Princeton University Press.

Rihoux, Benoît and Charles C. Ragin, eds. (2009). Configurational Comparative Methods. Qualitative Comparative Analysis (QCA) and Related Techniques. Thousand Oaks and London: Sage.

Ragin, Charles C. (1987). The Comparative Method: Moving Beyond Quantitative and Qualitative Strategies. Berkeley: University of Berkeley Press.

Ragin, Charles C. (2000). Fuzzy-Set Social Science. Chicago: University of Chicago Press.

Ragin, Charles C. (2008). Redesigning Social Inquiry: Fuzzy Sets and Beyond. Chicago: University of Chicago Press.

The following other ECPR Methods School courses could be useful in combination with this one in a ‘training track .
Recommended Courses Before

Introduction to R

Comparative Research Design

Recommended Courses After

Advanced Topics in Set-Theoretic Methods and QCA

Advanced Multi-Method Research

Case Study Research – Method and Practice

Process Tracing Methodology I and II

Additional Information

Disclaimer

The information contained in this course description form may be subject to subsequent adaptations (e.g. taking into account new developments in the field, specific participant demands, group size etc.). Registered participants will be informed in due time in case of adaptations.

Note from the Academic Convenors

By registering to this course, you certify that you possess the prerequisite knowledge that is requested to be able to follow this course. The instructor will not teach these prerequisite items. If you are not sure if you possess this knowledge to a sufficient level, we suggest you contact the instructor before you proceed with your registration.


Share this page
 

"Aristocracies … may preserve themselves longest, but only democracies, which refresh their ruling class, can expand" - Hugh Trevor-Roper


Back to top