Beyond the Turk: Alternative platforms for crowdsourcing behavioral research

2017/02/01 by Eyal Peer, Laura Brandimarte, Sonam Samat +1 · 3,008 citations
Computer Science · Psychology · Social Sciences · #Applied psychology #Behavioral Health and Interventions #Computer science #Crowdsourcing #Demography #Experimental Behavioral Economics Studies #Mobile Crowdsensing and Crowdsourcing #Population #Psychology #Quality (philosophy) #Social psychology #Sociology #World Wide Web

paper · pdf · doi:10.1016/j.jesp.2017.01.006

published in Journal of Experimental Social Psychology 70, 153-163 (Elsevier BV)

openalex publication_date 2017/02/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/04

Citations

• The consideration of future consequences: Weighing immediate and distant outcomes of behavior.

Cited by

• Understanding how personality traits, experiences, and attitudes shape negative bias toward AI-generated artworks
• Task-Dependent Algorithm Aversion
• Bilingualism predicts executive function resilience after COVID-19 in aging
• Worst of the Bunch: Visual Comparative Benchmarks Change Evaluations of Government Performance
• The limits of Brexit prejudice
• “Get rich quick,” scheme or script? The effect of cryptoculture on the susceptibility of fraud victimization among cryptocurrency purchasers
• Internalizing Symptoms in Men: The Role of Masculine Norms, Alexithymia, and Emotion Regulation
• Understanding Labor Market Discrimination Against Transgender People: Evidence from a Double List Experiment and a Survey
• Enhancing Intellectual Humility About Political Topics: An Intervention Tournament Including Five Conceptual Replications
• Dynamic presentation in 3D modulates face similarity judgements: a human-aligned encoding model approach
• Who's the deceiver? Identifying deceptive intentions in communication
• Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA
• Personalizing Emotion-aware Conversational Agents? Exploring User Traits-driven Conversational Strategies for Enhanced Interaction
• Effect of a Short, Animated Storytelling Video on Transphobia Among US Parents: Randomized Controlled Trial
• Signed, Sealed, Counted? An Experimental Study of Mail-in Ballot Signature Verification
• People of color in North America report improvements in racial trauma and mental health symptoms following psychedelic experiences
• Not every story has two sides: the effect of false balance on perceived scientific consensus about interrogation practices
• The effectiveness of feature attribution methods and its correlation with automatic evaluation scores
• The False Balance Effect: Exploring Partition Dependence as a Potential Explanation
• Procrastination in early childhood: Associations with self-regulation, negative affectivity, and the home environment
• Machines As Social Entities (MASE) Scale: Validation of a New Scale Measuring Beliefs in the Sociality of Intelligent Machine Agents
• Semantic memory network resilience in aging: The role of abstract and semantically diverse words
• Trans broken arm syndrome: A mixed-methods exploration of gender-related medical misattribution and invasive questioning
• The role of defendant race, expert testimony and interrogation coerciveness on Canadian mock jurors' perceptions of recanted confessions
• Paternity leave-taking and US Fathers’ participation in housework
• Psychedelic microdosing benefits and challenges: an empirical codebook
• Human rights violations and public support for sanctions
• Prevalence estimates as priors: Juror characteristics, perceived base rates, and verdicts in cases reliant on complainant and defendant testimony
• Pervasive Ambiguity About Gender: Quantifying the Cognitive and Affect Experience of Disorientation Related to Changing Understandings of Gender in Society
• Do or do not. Cognitive configurations affecting open innovation adoption in SMEs
• Powered by compassion: The effect of loving-kindness meditation on entrepreneurs' sustainable decision-making
• Identity economics meets identity leadership: Exploring the consequences of elevated CEO pay
• Data quality of platforms and panels for online behavioral research
• The self‐regulatory consequences of dependence on intelligent machines at work: Evidence from field and experimental studies
• Too Anecdotal to Be True? Mechanical Turk Is Not All Bots and Bad Data: Response to Webb and Tangney (2022)
• Climate policy support in the UK: An interaction of worldviews and policy types
• Not in My Schoolyard: Disability Discrimination in Educational Access
• The Misinformation Susceptibility Test (MIST): A psychometrically validated measure of news veracity discernment
• Perceptual adaptation to dysarthric speech is modulated by concurrent phonological processing: A dual task study
• Amazon Mechanical Turk: The Human Sciences’ Labor Problem
• Developing and Validating the Arabic Version of the Attitudes Toward Large Language Models Scale
• The properties of personal semantics
• Large-Scale Public Stigma Reduction Toward Individuals With Psychosis Using Brief Videos: A Secondary Data Analysis
• Externalities and norms in the context of a novel virus
• In generative artificial intelligence we trust: unpacking determinants and outcomes for cognitive trust
• How COVID‐19 can promote workplace cheating behavior via employee anxiety and self‐interest – And how prosocial messages may overcome this effect
• Trouble with big brother: Counterproductive consequences of electronic monitoring through the erosion of leader‐member social exchange
• Communicating Economic Evidence About Immigration Changes Attitudes and Policy Preferences
• To respond or not to respond: The effects of interpersonal goals on responsive Facebook behaviours
• Location Matters: Everyday Gender Discrimination in Remote and On-site Work
• Occupational prestige and occupational social value in the United Kingdom: New indices for the modern British economy
• The Hidden Cost of Prayer: Religiosity and the Gender Wage Gap
• Eye-opening! Exploring uncertainty marketing through hedonic blind box collectibles
• The General Attitudes towards Artificial Intelligence Scale (GAAIS): Confirmatory Validation and Associations with Personality, Corporate Distrust, and General Trust
• Attention checks and how to use them: Review and practical recommendations
• Measuring Human Beliefs About Nonhuman Animal Emotions
• Work-place Mismatch, Work-Family Conflict, and Psychological Well-being among Parents
• Sensitivity to visual features in inattentional blindness
• The robot saw it coming: physical human interference, deservingness, and self-efficacy in service robot failures
• Ghosting and destiny: Implicit theories of relationships predict beliefs about ghosting
• Variation in Skin Red and Yellow Undertone: Reliability of Ratings and Predicted Relevance for Social Experiences
• Economic Inequality Increases Materialism and Conspicuous Consumption
• Chatbots Are Undermining Crowdsourced Research in the Behavioral Sciences: Detecting Artificial Intelligence–Assisted Cheating With a Keystroke-Based Tool
• SP-10K: A Large-scale Evaluation Set for Selectional Preference Acquisition
• Seeing brands as humans: Development and validation of a brand anthropomorphism scale
• Understanding Privacy Attitudes and Concerns Towards Remote Communications During the COVID-19 Pandemic
• The Impact of Linguistic Prediction Violations on Downstream Recognition Memory and Sentence Recall
• What is your status portfolio? Higher status variance across groups increases interpersonal helping but decreases intrapersonal well-being
• Bridging Cultures in the Era of Big Data: A Cross-Language Equivalence Framework in Machine-Learning Research With Social Media Texts
• Conversational Inoculation to Enhance Resistance to Misinformation
• Exploring the Role of Randomization on Belief Rigidity in Online Social Networks
• A multisystem, dimensional interplay of assets versus adversities: Revised benevolent childhood experiences (BCEs) in the context of childhood maltreatment, threat, and deprivation
• Dual Evolutionary Foundations of Political Ideology Predict Divergent Responses to COVID-19
• Moral framing effects within subjects
• Beyond algorithm aversion: How users trade off decisional agency and optimal outcomes when choosing between algorithms and human decision-makers
• Actively open-minded thinking and liberal ideology: associations and dissociations
• Ego Does Not Deplete Over Time
• Extroverts Tweet Differently from Introverts in Weibo
• Coping with technostress in the software industry: Coping strategies and factors underlying their selection
• Gone too long or back too soon? Perceptions of paid parental leave‐taking and variations by gender and family structure
• A randomized intervention to gauge preferred tax rates and progressivity
• Private Rank Aggregation under Local Differential Privacy
• Evidence for separate backward recall and n -back working memory factors: a large-scale latent variable analysis
• Is Sustainability a Liability? Green Marketing and Consumer Beliefs About Eco-Friendly Products
• Cognitive housework and Parents' relationship satisfaction
• Revealing complexities when adult readers engage in the credibility evaluation of social media posts
• How was my performance? Exploring the role of anchoring bias in AI-assisted decision making
• A Fully Generative Motivational Interviewing Counsellor Chatbot for Moving Smokers Towards the Decision to Quit
• Sensitivity to visual features in inattentional blindness
• Personal Beauty Values: Development and Validation of a Multidimensional Measurement Scale
• Virtual reality facilitated travel inspiration: the role of pleasure and arousal
• Personalizing Privacy Protection With Individuals' Regulatory Focus: Would You Preserve or Enhance Your Information Privacy?
• Aesthetic Motivation Impacts Judgments of Others’ Prosociality and Mental Life
• Can a racial justice frame help overcome opposition to automated traffic enforcement?
• Bounded Normative Equivalence in Human-AI Cooperation: Group Behaviour, Not Partner Labels, Predicts Cooperation under Anonymous Aggregate Feedback
• Mixed signals of status: luxury consumption shapes competence and warmth impressions through different routes
• Economic system justification predicts muted emotional responses to inequality
• Empirical Understanding of Deletion Privacy: Experiences, Expectations, and Measures
• Political polarization on COVID-19 pandemic response in the United States
• Evaluating Reddit as a Crowdsourcing Platform for Psychology Research Projects
• Evaluating CloudResearch’s Approved Group as a solution for problematic data quality on MTurk
• Impression Management on Instagram and Unethical Behavior: The Role of Gender and Social Media Fatigue
• Ironic Egalitarianism: When hierarchy-attenuating motives increase hierarchy-enhancing beliefs
• Impacts of Personal Characteristics on User Trust in Conversational Recommender Systems
• Can You Really Study an Army on the Internet? Comparing How Status Tasks Perform in the Laboratory and Online Settings
• Stop the Spread: A Contextual Integrity Perspective on the Appropriateness of COVID-19 Vaccination Certificates
• Submitting surveys via a conversational interface: An evaluation of user acceptance and approach effectiveness
• Conducting interactive experiments online. [europepmc]
• Comparing the use of open and closed questions for Web-based measures of the continued-influence effect. [europepmc]
• The Very Efficient Assessment of Need for Cognition: Developing a Six-Item Version. [europepmc]
• Feeling Pressure to Be a Perfect Mother Relates to Parental Burnout and Career Ambitions. [europepmc]
• The Light vs. Dark Triad of Personality: Contrasting Two Very Different Profiles of Human Nature. [europepmc]
• Psychedelic microdosing benefits and challenges: an empirical codebook. [europepmc]
• Online panels in social science research: Expanding sampling methods beyond Mechanical Turk. [europepmc]
• Is sitting invisible? Exploring how people mentally represent sitting. [europepmc]
• Good News about Bad News: Gamified Inoculation Boosts Confidence and Cognitive Immunity Against Fake News. [europepmc]
• Let's talk about pain catastrophizing measures: an item content analysis. [europepmc]
• Exposure to coronavirus news on mainstream media: The role of risk perceptions and depression. [europepmc]
• Non-pharmaceutical Interventions for Pandemic COVID-19: A Cross-Sectional Investigation of US General Public Beliefs, Attitudes, and Actions. [europepmc]
• Obesity, eating behavior and physical activity during COVID-19 lockdown: A study of UK adults. [europepmc]
• Intention to Vaccinate Against the Novel 2019 Coronavirus Disease: The Role of Health Locus of Control and Religiosity. [europepmc]
• Mental Health Outcomes and Associations During the COVID-19 Pandemic: A Cross-Sectional Population-Based Study in the United States. [europepmc]
• Exploring the Relationship Between Empathy, Self-Construal Style, and Self-Reported Social Distancing Tendencies During the COVID-19 Pandemic. [europepmc]
• The Coronavirus Health and Impact Survey (CRISIS) reveals reproducible correlates of pandemic-related mood states across the Atlantic. [europepmc]
• People of color in North America report improvements in racial trauma and mental health symptoms following psychedelic experiences. [europepmc]
• Longitudinal analysis of the UK COVID-19 Psychological Wellbeing Study: Trajectories of anxiety, depression and COVID-19-related stress symptomology. [europepmc]
• Concerns and recommendations for using Amazon MTurk for eating disorder research. [europepmc]
• Data quality of platforms and panels for online behavioral research. [europepmc]
• Fatalism, beliefs, and behaviors during the COVID-19 pandemic. [europepmc]
• Incidence and prevalence of coma in the UK and the USA. [europepmc]
• Evaluating CloudResearch's Approved Group as a solution for problematic data quality on MTurk. [europepmc]
• Users' experience with health-related content on YouTube: an exploratory study. [europepmc]