vix.ing · top · new · best · stats · spec

Evaluation of an Adapted Design in a Multi-device Online Panel: A DemoSCOPE Case Study

2015/12/21 by Birgit Arn, Arn, Birgit, Stefan Klug +3
Computer Science · Social Sciences · #CAWI surveys #Focus Groups and Qualitative Methods #Mobile Crowdsensing and Crowdsourcing #Survey Methodology and Nonresponse #design guidelines #simplicity #tile design

paper · doi:10.12758/mda.2015.011

openalex publication_date 2016/07/12 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

In this paper, we look at the challenge of optimizing survey layout in online research to enable multi-device use. Several studies provide useful advice on target-oriented implementation of web design for CAWI surveys. This paper presents results of the implementation of a new adapted design at the panel of DemoSCOPE that allows the participants to take part in a survey on multiple (especially mobile) devices. To evaluate this adapted design, we compare interview data and question timing of panellists who participated in an insurance study before and after the design transition. Central key figures concerning the completion rate, item non-response, open questions, straightlining, timing of single questions and the length of the total interview are presented. In addition, we have presented examples of both old and new design to the community and invited them to assess these examples concerning orientation, color, design and usability. We evaluate the differences in these assessments before and after the design transition for smartphone and desktop users. We end with suggestions for best practice for online studies on different devices.

Citations

Related