An Initial Review of Probability-based Online Panel Surveys for ISSP Research

Online probability-based panels have emerged as a response to the challenges of traditional survey methods, such as declining response rates and higher costs. However, there are both advantages and disadvantages of the technical characteristics of panels compared to cross section online panels. These challenges are even more important for studies that aim to collect data across different countries and aim to achieve methodological comparability, such as the International Social Survey Programme (ISSP). The ISSP data is free of charge for academic research and come from high quality nationally representative surveys of over 40 countries and feature a wide range of topics, that help to study public opinion and voting behavior. In the ISSP, most studies are conducted in a face-to-face mode across countries, although some countries use alternative modes (due to the availability of adequate sampling frames and technology). This presentation aims to discuss challenges linked to the use of online panels for the ISSP. It will present a review of the most recent survey methodology literature and discuss major sources of error with a focus on discussing whether online panels may be a possible vehicle for data collection in the future. The sources of error discussed include coverage of the population, panel attrition, panel conditioning and panel measurement error. This presentation seeks to encourage a discussion on pros and cons from ISSP users on the limitations and trade-offs for data quality.