Rankings and Reactivity: How Public Measures Recreate Social Worlds

2007/07/01 by Wendy Nelson Espeland, Wendy Nelson Espeland, Michael Sauder · 86 citations
Social Sciences · Business, Management and Accounting · #Judicial and Constitutional Studies #Law in Society and Culture #Political Influence and Corporate Strategies

paper · doi:10.1086/517897

Abstract

Recently, there has been a proliferation of measures responding to demands for accountability and transparency. Using the example of media rankings of law schools, this article argues that the methodological concept of reactivity - the idea that people change their behavior in reaction to being evaluated, observed, or measured- offers a useful lens for disclosing how these measures effect change. A framework is proposed for investigating the consequences, both intended and unintended, of public measures. The article first identifies two mechanisms, self-fulfilling prophecy and commensuration, that induce reactivity and then distinguishes patterns of effects produced by reactivity. This approach demonstrates how these increasingly fateful public measures change expectations and permeate institutions, suggesting why it is important for scholars to investigate the impact of these measures more systematically.

Citations

• On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications.

Cited by

• The Discipline of Rankings: Tight Coupling and Organizational Change
• Order in the Court: How Firm Status and Reputation Shape the Outcomes of Employment Discrimination Suits
• Shaming the Corporation
• Algorithmic governmentality and the space of ethics: Examples from ‘People Analytics’
• Audit Culture Revisited
• Trans-exclusionary data activism in the UK
• Fairness and Abstraction in Sociotechnical Systems
• ‘Judgement’ versus ‘metrics’ in higher education management
• The Chinese Social Credit System: A Model for Other Countries?
• Von Performativität zu Generativität: Bewertung und ihre Folgen im Kontext der Digitalisierung
• Strategic Bureaucracy: The Convergence of Bureaucratic and Strategic Management Logics in the Organizational Restructuring of Universities
• Unsustainable Growth, Hyper-Competition, and Worth in Life Science Research: Narrowing Evaluative Repertoires in Doctoral and Postdoctoral Scientists’ Work and Lives
• Has education become more positional? Educational expansion and labour market outcomes, 1985–2007
• Academic socialization: On a neglected effect of competition in science
• Human Interest or Hard Numbers? Experiments on Citizens’ Selection, Exposure, and Recall of Performance Information
• What drives corporate social performance? The role of nation-level institutions
• Indicators as a Technology of Global Governance
• Divergent institutional logics of quantification in research evaluation: evidence from RPT policies in Chinese and U.S. research universities
• University ranking as social exclusion
• Market for lemons in academia: adverse selection with dynamic human capital formation and policy lock-in
• The Emergence of the Academic Candidate. Evaluation as Textual Dramaturgy
• Influencers in Parliament? Platform Pressures and Normative Conflict in Political Social Media Adoption
• Accounting for Socialization: Quantitative Priming, Language, and Tools in a Masters of Public Affairs Program
• Marked: School Grades and the Quantified Life
• Status: Insights from Organizational Sociology
• The violence of good intentions: A queer of color critique of institutionalized scholar activism in the governance of Black queer life
• How the Basis for Status Perceptions Varies with Perceiver Status
• Why and How Counting Counts: Perspectives on calculative practices for organization studies
• An Autoethnographic Perspective on Scholarly Impact, Citation Politics, and North–South Power Dynamics
• Yliopistovertailut kvantifioituna hallinnan välineenä
• The Reproduction and Evolution of Institutional Logics: A practice-centric perspective
• Beneath the numbers: a qualitative study of the politics of resistance to transparent workforce data reporting
• The UK higher education senior management survey: a statactivist response to managerialist governance
• Deciphering Markets and Money: A Sociological Analysis of Economic Institutions
• The Journal Attention Cycle: Indicators as Assets in the Chinese Scientific Publishing Economy
• A matter of culture? Conceptualizing and investigating “Evidence Cultures” within research on evidence-informed policymaking
• Hyvä numero ja hyvä tarina
• Constructing Replaceability: Authenticity Regimes and the Automation of Emotional Labor
• What's Observed in a Rating? Rankings as Orientation in the Face of Uncertainty
• Gaming and Performance Metrics in Higher Education: The Consequences of Journal Lists
• The organisation of evaluations: the influence of the ministry of finance on evaluation systems
• Many a Slip: The Challenge of Impact as Boundary Object in Social Finance
• Formalizing the Future: How Central Banks Set Out to Govern Expectations but Ended Up (En-)Trapped in Indicators
• Quantifying human resource management: a literature review
• Thinking with indicators. Exploring the epistemic impacts of academic performance indicators in the life sciences
• Classifications, Quantifications and Quality Conventions in Markets – Perspectives of the Economics of Convention
• Quo vadis, ‚Migrationshintergrund‘? – Herausforderungen der empirischen Forschungspraxis
• How to track progress on the Global Goal on Adaptation?: a stocktaking of Parties’ positions on measurement one year into the GlaSS work programme
• Reactivity to Benchmarking Corporate Human Rights: A configurational perspective
• Offering safe passage: grading systems and gendered enrollment patterns in undergraduate mathematics
• The neglected organisation of failure: Activities, infrastructures and subjectivities
• (Pragmatist) geographies of rankings
• Does government transparency really matter for citizens’ satisfaction to public service? Empirical evidence from China
• Where models fail: causality and self-reference in financial economics
• Enchanted Determinism: Power without Responsibility in Artificial Intelligence
• Professionalizing Contingency: How Journalism Schools Adapt to Deprofessionalization
• How Do Companies Respond to Environmental, Social and Governance (ESG) ratings? Evidence from Italy
• The Community Index: A More Comprehensive Approach to Assessing Scholarly Impact
• Reverse Engineering and Emotional Attachments as Mechanisms Mediating the Effects of Quantification
• The political economy of academic publishing: On the commodification of a public good
• Law school rankings in the United States [wikipedia]
• Accounting for quality: on the relationship between accounting and quality improvement in healthcare. [europepmc]
• Inconsistent year-to-year fluctuations limit the conclusiveness of global higher education rankings for university management. [europepmc]
• Unsustainable Growth, Hyper-Competition, and Worth in Life Science Research: Narrowing Evaluative Repertoires in Doctoral and Postdoctoral Scientists' Work and Lives. [europepmc]
• From Eminent Men to Excellent Universities: University Rankings as Calculative Devices. [europepmc]
• Forms of uncertainty reduction: decision, valuation, and contest. [europepmc]
• An equity-oriented rethink of global rankings with complex networks mapping development. [europepmc]
• Inclusiveness of Urban Space and Tools for the Assessment of the Quality of Urban Life-A Critical Approach. [europepmc]
• Toward a sociology of finitude: life, death, and the question of limits. [europepmc]
• The political economy of academic publishing: On the commodification of a public good. [europepmc]
• Understanding the Societal Impact of the Social Sciences and Humanities: Remarks on Roles, Challenges, and Expectations. [europepmc]
• Organising knowledge to prevent global health crises: a comparative analysis of pandemic preparedness indicators. [europepmc]
• "How do we measure justice?": missions and metrics in urban agriculture. [europepmc]
• Territorial bias in university rankings: a complex network approach. [europepmc]
• Exploring the Effectiveness of Sustainability Measurement: Which ESG Metrics Will Survive COVID-19? [europepmc]
• Quantitative ESG disclosure and divergence of ESG ratings. [europepmc]
• Social signals predict contemporary art prices better than visual features, particularly in emerging markets. [europepmc]
• Challenging assumptions: "unveiling meritocracy's reality in neurosurgery". [europepmc]
• Effectively Maintained Inequality in Canada Revisited. [europepmc]
• Network assortativity for a multidimensional evaluation of socio-economic territorial biases in university rankings. [europepmc]
• [The commensurability of public health indicators - and the unresolved question of the incommensurableComensurabilidade de indicadores em saúde pública e o problema em aberto do incomensurável]. [europepmc]
• The digital transformation of medical education collaborative governance in the era of smart education: an innovative management restructuring of medical talent cultivation systems. [europepmc]
• Encoding Justice with Data: Environmental Justice Screening Tools and the Limits of Quantification. [europepmc]
• A quantum probabilistic framework for reasoning coherence under contextual variability. [europepmc]
• Beneath the numbers: a qualitative study of the politics of resistance to transparent workforce data reporting [europepmc]
• International university rankings: composite indicators and methodological approaches [europepmc]

Related

• The Discipline of Rankings: Tight Coupling and Organizational Change
• Reaction value: affective reflex in the digital public sphere
• What's Observed in a Rating? Rankings as Orientation in the Face of Uncertainty
• Reflexive Measurement
• Reactivity to Benchmarking Corporate Human Rights: A configurational perspective