ECPR

Install the app

Install this application on your home screen for quick and easy access when you’re on the go.

Just tap Share then “Add to Home Screen”

AI and Political Theory: Exploring Argument Mining for Normative Research—A Political Theorist's Perspective

Political Methodology
Political Theory
Methods
Ethics
Normative Theory
Empirical
Nahshon Perez
Bar Ilan University
Nahshon Perez
Bar Ilan University

To access full paper downloads, participants are encouraged to install the official Event App, available on the App Store.


Abstract

This article examines how artificial intelligence—specifically, argument mining—can contribute to the methodological turn in contemporary political theory. While political theorists increasingly reflect on their methods, research designs, and forms of reasoning, discussions of argumentative structure remain largely implicit, rarely articulated within published work. At the same time, advances in AI, particularly large language models (LLMs), offer new tools for identifying argumentative patterns across large bodies of text. This study explores whether such tools can meaningfully support political theorists in clarifying, evaluating, and teaching normative argumentation. Focusing on argument mining, an NLP technique for detecting claims, premises, and inferential relations, the article presents an exploratory analysis of fifteen analytical political theory articles. Each article was coded twice—once by a human coder and once by an AI system—using a shared Toulmin-based framework consisting of Claims, Data, Warrants, Backings, Qualifiers, and Rebuttals. Precision, Recall, and F1-scores were calculated for each element and equally weighted across articles to allow systematic comparison. The findings highlight clear strengths, such as the consistent identification of claims and data, alongside persistent challenges, particularly in detecting context-sensitive elements like qualifiers. The analysis also underscores the need for human validation when dealing with dense, abstract normative texts. The article argues that AI-assisted argument mining cannot replace interpretive judgment, but it can illuminate recurring structures, support methodological transparency, and strengthen pedagogical clarity in political theory. By integrating computational tools with reflective normative inquiry, political theorists can expand their methodological repertoire while preserving the discipline’s commitment to argumentative rigor.