The Relationship Between the Perceived and Actual Effectiveness of Persuasive Messages: A Meta-Analysis With Implications for Formative Campaign Research

2007/12/12 by James Price Dillard, Kirsten M Weber, Kirsten Weber +2 · 33 citations
Social Sciences · Arts and Humanities · #Social Media and Politics #Media Influence and Health #Social and Intergroup Psychology

paper · doi:10.1111/j.1460-2466.2007.00360.x

Abstract

Although measures of perceived message effectiveness are commonly employed in formative evaluation research, the validity of such measures has been assumed rather than demonstrated. A meta-analysis revealed a corrected-for-attenuation correlation of.41 between perceived effectiveness (PE) and attitude (k= 40). This association was apparently subject to the influence of moderator variables, although the pattern of influence was unstable across different types of analysis. Overall, the results empirically demonstrate the value of PE judgments in formative research and in circumstances in which actual effectiveness (AE) is difficult or impossible to measure. They also prompt a host of questions concerning (a) the causal relationship between PE and AE, (b) the possibility of bias in these judgments, and (c) the potential for developing methods to reduce or remove bias in effectiveness judgments. Future research is needed to corroborate these results as well as broaden the range of AE measures.

Cited by

• Virtuelle Räume und reale Erregungszyklen
• The persuasive effects of political microtargeting in the age of generative artificial intelligence
• A Meta-Analysis of the Persuasive Power of Large Language Models
• Message-level Claims Require Message-level Data Analyses: Aligning Claims and Evidence in Communication Research
• A meta-analysis of gain–loss framing effects in narrative persuasion
• Psychological reactance theory and politeness theory: A test of competing explanations for the role of threat to freedom in conveying persuasive resistance
• Diagnosticity of perceived message effectiveness in campaign message pretesting: multilevel analysis of the between-message correlation and message-pair standing comparisons
• Emotional responses to prosocial messages increase willingness to self-isolate during the COVID-19 pandemic
• Efficiently and Effectively Evaluating Public Service Announcements: Additional Evidence for the Utility of Perceived Effectiveness. [europepmc]
• Pictorial cigarette pack warnings: a meta-analysis of experimental studies. [europepmc]
• Finding the keys to successful adult-targeted advertisements on obesity prevention: an experimental audience testing study. [europepmc]
• Effect of Character-Audience Similarity on the Perceived Effectiveness of Antismoking PSAs via Engagement. [europepmc]
• Smokers' and E-Cigarette Users' Perceptions about E-Cigarette Warning Statements. [europepmc]
• Youth Receptivity to FDA's The Real Cost Tobacco Prevention Campaign: Evidence From Message Pretesting. [europepmc]
• The Effects of Gain-, Loss-, and Balanced-Framed Messages for Preventing Indoor Tanning among Young Adult Women. [europepmc]
• Comparing perceived effectiveness of FDA-proposed cigarette packaging graphic health warnings between sexual and gender minorities and heterosexual adults. [europepmc]
• Mobile Phone Multilevel and Multimedia Messaging Intervention for Breast Cancer Screening: Pilot Randomized Controlled Trial. [europepmc]
• Perceived effectiveness rating scales applied to insomnia help-seeking messages for middle-aged Japanese people: a validity and reliability study. [europepmc]
• Effects of cultural cues on perceptions of HPV vaccination messages among parents and guardians of American Indian youth. [europepmc]
• Comparing responses to differently framed and formatted persuasive messages to encourage help-seeking for depression in Japanese adults: a cross-sectional study with 2-month follow-up. [europepmc]
• Fear and Humor Appeals in "The Real Cost" Campaign: Evidence of Potential Effectiveness in Message Pretesting. [europepmc]
• Impact of tobacco-pack pictorial warnings on youth and young adults: A systematic review of experimental studies. [europepmc]
• Comparison of Message and Effects Perceptions for The Real Cost E-Cigarette Prevention Ads. [europepmc]
• Incremental criterion validity of message perceptions and effects perceptions in the context of anti-smoking messages. [europepmc]
• Getting to the Heart of the Matter in Later Life: The Central Role of Affect in Health Message Framing. [europepmc]
• Emotional responses to prosocial messages increase willingness to self-isolate during the COVID-19 pandemic. [europepmc]
• People in E-Cigarette Ads Attract More Attention: An Eye-Tracking Study. [europepmc]
• Message perceptions and effects perceptions as proxies for behavioral impact in the context of anti-smoking messages. [europepmc]
• Effects of Communication Source and Racial Representation in Clinical Trial Recruitment Flyers. [europepmc]
• Reach, Receptivity, And Beliefs Associated With the Fresh Empire Campaign to Prevent and Reduce Cigarette Use Among Youth in the United States. [europepmc]
• Minoritized Sexual Identity and Perceived Effectiveness of Instagram Public Health Messaging about E-cigarettes. [europepmc]
• Dealing with Alcohol-Related Posts on Social Media: Using a Mixed-Method Approach to Understand Young Peoples' Problem Awareness and Evaluations of Intervention Ideas. [europepmc]
• Examining the Longitudinal Relationship Between Perceived and Actual Message Effectiveness: A Randomized Trial. [europepmc]

Related

• Affect and Persuasion
• The Persuasive Effect of Source Credibility: Tests of Cognitive Response
• The Impact of Persuasive Messages on IAT Performance is Moderated by Source Attractiveness and Likeability
• The Effectiveness of Advertising: A Meta-Meta-Analysis of Advertising Inputs and Outcomes
• Identifying the Effect of Persuasion