ECPR

Install the app

Install this application on your home screen for quick and easy access when you’re on the go.

Just tap Share then “Add to Home Screen”

Method Bias in Comparative Research: Problems of Construct Validity as Exemplified by the Measurement of Ethnic Diversity

Robert Neumann
TU Dresden
Peter Graeff
Johann Wolfgang Goethe-Universität Frankfurt
Robert Neumann
TU Dresden

Abstract

The study investigates indices of ethnic diversity and their underlying theoretical models for method effects due to differences in operationalization. It adapts the methodology of Multitrait-Multimethod analysis to the field of comparative research. While approaches for checking construct validity or method bias are common in psychology and educational research, they are rarely applied in other social science disciplines such as economics and political science. We find that measures of polarization show considerable method effects which call their empirical utilization for multivariate modelling into question. We conclude that improved overall measures, which are based on a theoretical augmentation of a construct’s measurement instrument, do not necessarily lead to improved results, neither on the measurement level nor for hypothesis testing.