2024/01/01 by Lukas Rudolph, Markus Freitag, Paul W Thurner +1 · 1 voice · 10 citations
Business, Management and Accounting · Decision Sciences · Economics, Econometrics and Finance · Psychology · #Cognition #Cognitive psychology #Conjoint analysis #Consumer Market Behavior and Pricing #Decision-Making and Behavioral Economics #Econometrics #Economic and Environmental Valuation #Economics #Microeconomics #Preference #Psychiatry #Psychology
paper · doi:10.1093/poq/nfae038
published in Public Opinion Quarterly 88(3), 991-1016 (Oxford University Press)
openalex publication_date 2024/01/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/04
Abstract Conjoint experiments offer a flexible way to elicit population preferences on complex decision tasks. We investigate whether we can improve respondents’ survey experience and, ultimately, choice quality by departing from the current recommendation of completely randomized conjoint attribute ordering. Such random ordering guarantees that potential bias from attribute order cancels out on average. However, in situations with many attributes, this may unnecessarily increase cognitive burden, as attributes belonging together conceptually are presented scattered across the choice table. Hence, we study experimentally whether purposeful ordering (“theoretically important” attributes first) or block randomized ordering (attributes belonging to the same theoretical concept displayed in randomized bundles) affects survey experience, response time, and choice itself, as compared to completely randomized ordering. Drawing on a complex preregistered choice design with nine attributes (N = 6,617), we find that ordering type affects neither self-reported survey experience, choice task timing, nor attribute weighting. Potentially, block randomization reduces cognitive burden for some subgroups. To our knowledge, we thereby provide the first systematic empirical evidence that ordering effects are likely of low relevance in conjoint choice experiments and that the trade-off between cognitive burden and ordering effects is minimal from the perspective of respondents, at least for our substantive application.