ECPR

Install the app

Install this application on your home screen for quick and easy access when you’re on the go.

Just tap Share then “Add to Home Screen”

Leveraging Crowdcoding and LLMs for the analysis of gender mainstreaming: gender- sensitive recovery policies in the EU

Gender
Political Methodology
Public Policy
Matilde Ceron
European University Institute
Matilde Ceron
European University Institute

Abstract

Gender mainstreaming, the transversal consideration of gendered implications in all policy-making, has become a widespread policy commitment in Europe and is a cornerstone of the EU approach to the promotion of gender equality. Measuring gender mainstreaming presents several challenges. Firstly, its transversal nature implies it is potentially relevant in all policy documents. At the same time, gender-sensitive content is usually rare. An additional challenge of comparative analyses rests on the multi-lingual context they generally imply. As a result, the overwhelming majority of extant research focuses on (qualitative) case studies narrowly situated within specific policy domain(s) and/or country/ies. This paper addresses these challenges in the analysis of gender mainstreaming in the EU National Recovery and Resilience Plans (NRRPs) by developing a novel methodological approach that combines crowd coding and LLMs. Automated translation and bag-of-words approaches revealed geographical differences in gender equality saliency across Member States. Yet these approaches have limitations in the nuanced classification of text across policy domains and — especially — in distinguishing between rhetorical mentions and policy commitments. This paper develops a scalable classification of gender-sensitive policy-relevant content, adapting crowdcoding approaches used in political communication to the analysis of gender equality policies. The approach refines multilingual dictionaries for the identification of gender-related content in the 27 plans with the qualitative crowdcoding in their original languages, distinguishing as well across policy area and policy relevance, which serves as high-quality training data. The analysis compares traditional semi-supervised approaches, zero-shot classification and few-shot learning across the three - progressively more complex - tasks. The paper contributes to advancing the analysis of gender equality, bridging nuanced qualitative coding and scalability, extremely valuable in the analysis of a transversal approach such as gender mainstreaming in the EU with low-frequency content across large multilingual corpora.