What do citation counts measure? A review of studies on citing behavior
2008/01/18 by Lutz Bornmann, Hans‐Dieter Daniel · 43 citations
Arts and Humanities · Decision Sciences · #Academic Writing and Publishing #Meta-analysis and systematic reviews #scientometrics and bibliometrics research
paper · doi:10.1108/00220410810844150
openalex publication_date 2008/01/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/30
Abstract
Purpose The purpose of this paper is to present a narrative review of studies on the citing behavior of scientists, covering mainly research published in the last 15 years. Based on the results of these studies, the paper seeks to answer the question of the extent to which scientists are motivated to cite a publication not only to acknowledge intellectual and cognitive influences of scientific peers, but also for other, possibly non‐scientific, reasons. Design/methodology/approach The review covers research published from the early 1960s up to mid‐2005 (approximately 30 studies on citing behavior‐reporting results in about 40 publications). Findings The general tendency of the results of the empirical studies makes it clear that citing behavior is not motivated solely by the wish to acknowledge intellectual and cognitive influences of colleague scientists, since the individual studies reveal also other, in part non‐scientific, factors that play a part in the decision to cite. However, the results of the studies must also be deemed scarcely reliable: the studies vary widely in design, and their results can hardly be replicated. Many of the studies have methodological weaknesses. Furthermore, there is evidence that the different motivations of citers are “not so different or ‘randomly given’ to such an extent that the phenomenon of citation would lose its role as a reliable measure of impact”. Originality/value Given the increasing importance of evaluative bibliometrics in the world of scholarship, the question “What do citation counts measure?” is a particularly relevant and topical issue.
Citations
Cited by
- Citation Pathways in the AI Era: Interpretive Knowledge Nodes, Citation Compression Layers, and the Measurement Boundary of Scholarly Impact
- Assessing the impact of Open Research Information Infrastructures using NLP driven full-text Scientometrics: A case study of the LXCat open-access platform
- How Deep Do Large Language Models Internalize Scientific Literature and Citation Practices?
- The Future of NLP may not be at NLP Conferences: Scholarly Migration Patterns in Natural Language Processing
- Any Old Tom, Dick or Harry: The Citation Impact of First Name Genderedness
- Persistent geographical biases in global scientific collaboration and citations
- SciRAG: Adaptive, Citation-Aware, and Outline-Guided Retrieval and Synthesis for Scientific Literature
- BioMedJImpact: A Comprehensive Dataset and LLM Pipeline for AI Engagement and Scientific Impact Analysis of Biomedical Journals
- Authorship, titles and open access as drivers of citation performance in orthopaedics: a scientometric analysis
- Bias at the Borderline: Who Gets the Benefit of the Doubt in Peer Review?
- Beyond conditional visibility: operationalizing epistemic justice in conservation science
- Digging deeper into data citations: recognizing and rewarding data work
- Which cities produce excellent papers worldwide more than can be\n expected? A new mapping approach--using Google Maps--based on statistical\n significance testing
- Philosophy of science viewed through the lense of "References\n Publication Years spectrosopy" (RPYS)
- Counting publications and citations: Is more always better?
- Finding Citations to Social Work Literature: The Relative Benefits of Using Web of Science, Scopus, or Google Scholar
- Just how multi-level is leadership research? A document co-citation analysis 1980–2013 on leadership constructs and outcomes
- A bibliometric review of the leadership development field: How we got here, where we are, and where we are headed
- How to calculate the practical significance of citation impact differences? An empirical example from evaluative institutional bibliometrics using adjusted predictions and marginal effects
- Referenced Publication Years Spectroscopy applied to iMetrics:\n Scientometrics, Journal of Informetrics, and a relevant subset of JASIST
- Measuring impact in research evaluations: A thorough discussion of\n methods for, effects of, and problems with impact measurements
- Citation Mania in Academic Theses Writing: A Case Study
- Citation penalties following sexual versus scientific misconduct allegations
- Replication value as a function of citation impact and sample size
- Merging the citations received by arXiv-deposited e-prints and their corresponding published journal articles: Problems and perspectives
- One in four citations in marine biology papers is inappropriate
- Biology Needs Philosophy, But What Philosophy?
- Alternative metrics in scientometrics: A meta-analysis of research into\n three altmetrics
- Citation personal display: A case study of personal websites by physicists in 11 well-known universities
- Assessing scientific output through self-evaluation: Evidence from four social science fields
- The Matthew effect in SDG-related architectural research: a scientometric analysis of global productivity and citation inequality
- Following the propagation of erroneous x-ray photoelectron spectroscopy peak fitting through the literature. A genealogical approach
- Tracing the origins of citation: exploring citation practices in ancient Chinese literature
- Mapping Transnational Policy Interactions: Evidence From Open Government Policy Documents
- Analysis of direct citation, co-citation and bibliographic coupling in scientific topic identification
- Journal topic citation potential and between-field comparisons: The\n topic normalized impact factor
- SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generation
- Artificial Intelligence in Management Studies (2021-2025): A Bibliometric Mapping of Themes, Trends, and Global Contributions
- The discussion of gender and citations in submission guidelines of 102 political science journals
- On the causes of subject-specific citation rates in Web of Science
- How to analyse percentile impact data meaningfully in bibliometrics: The statistical analysis of distributions, percentile rank classes and top-cited papers
- Ranking and mapping of universities and research-focused institutions\n worldwide based on highly-cited papers: A visualization of results from\n multi-level models
- Citations: Indicators of Quality? The Impact Fallacy
Related