Exploring Language Effects in Crosscultural Survey Research: Does the Language of Administration Affect Answers About Politics?

2018/01/30 by Diana Zavala‐Rojas, Zavala-Rojas, Diana
Social Sciences · #Electoral Systems and Political Participation #Social Capital and Networks #Social and Intergroup Psychology #bilingualism #language effects #measurement equivalence

paper · doi:10.12758/mda.2017.16

openalex publication_date 2018/01/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We study if the language of administration of a survey has an effect on the answers of bilingual respondents to questions measuring political dimensions. This is done in two steps. In the first we test whether the measurement instruments are equivalent for the same individual in two languages. After measurement invariance is established, we test if latent mean differences are significant across the two languages. We also test if the correlation of the same concept in two languages is equal to one or not. Results show evidence for language effects, the latent correlation is below one, although mean differences are not significant. We use data of the LISS migration panel in a within subject design, respondents answer a questionnaire twice first in Dutch and then in their (second) native language among Arabic, English, German, Papiamento and Turkish.

Citations

• Bicultural Identity Integration (BII): Components and Psychosocial Antecedents
• Measurement Equivalence in Cross-National Research

Related

• Mother Tongue or Non-Native Language? – The Influence of Language on Response Behavior in Surveys
• Do Political Opinions Transfer Between Western Languages? An Analysis of Unaligned and Aligned Multilingual LLMs
• Questioning the Survey Responses of Large Language Models
• Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMs
• Language, Ethnicity, and Separatism: Survey Results from Two Post-Soviet Regions