Item comparability in cross-national surveys: results from asking probing questions in cross-national web surveys about attitudes towards civil disobedience

Dorothée Behr, Michael Braun, Lars Kaczmirek, Wolfgang Bandilla

Veröffentlichungen: Beitrag in FachzeitschriftArtikelPeer Reviewed


This article focuses on assessing item comparability in cross-national surveys by asking probing questions in Web surveys. The “civil disobedience” item from the “rights in a democracy” scale of the International Social Survey Program (ISSP) serves as a substantive case study. Identical Web surveys were fielded in Canada (English-speaking), Denmark, Germany, Hungary, Spain, and the U.S. A category-selection and a comprehension probe, respectively, were incorporated into the Web surveys after the closed-ended “civil disobedience” item. Responses to the category selection-probe reveal that notably in Germany, Hungary, and Spain the detachment of politicians from the people and their lack of responsiveness is deplored. Responses to the comprehension probe show that mainly in the U.S. and Canada violence and/or destruction are associated with civil disobedience. These results suggest reasons for the peculiar statistical results found for the “civil disobedience” item in the ISSP study. On the whole, Web probing proves to be a valuable tool for identifying interpretation differences and potential bias in cross-national survey research.
Seiten (von - bis)127-148
FachzeitschriftQuality & Quantity
PublikationsstatusVeröffentlicht - Jan. 2014
Extern publiziertJa

ÖFOS 2012

  • 501030 Kognitionswissenschaft
  • 501018 Psychologische Diagnostik
  • 501006 Experimentalpsychologie
  • 504007 Empirische Sozialforschung