ECPR

Install the app

Install this application on your home screen for quick and easy access when you’re on the go.

Just tap Share then “Add to Home Screen”

Measuring Learning in Informative Processes

Political Methodology
Political Psychology
Knowledge
Methods
Robert Luskin
Sciences Po Paris
Robert Luskin
Sciences Po Paris
Gaurav Sood
Leland Stanford Junior University

Abstract

Some political processes, both natural (e.g., election campaigns) and artificial (e.g., Deliberative Polls), are broadly informative, exposing people to sizable quantities of information. The natural measure of the individual-level learning (G) is the observed knowledge gain (g): the increase in the proportion of knowledge questions answered correctly (k2 – k1). Yet taking g as a left- or righthand-side variable in analyses seeking to explain it or use it to explain other variables often produces disappointing results. Observed post-event knowledge (k2) often does better. Here we confirm this pattern, examine its roots, and suggest one simple escape. First, we show mathematically that the correlation between G and g can be negative and, even when positive, less than that between G and k2. Numerical simulations then show that these are not mere possibilities. Indeed, g is a generally weak and occasionally perverse indicator of G; k2, a much stronger one, should be used instead.