vix.ing · top · new · best · stats · spec

Do PageRank-based author rankings outperform simple citation counts?

2015/03/13 by Dalibor Fiala, Lovro Šubelj, Slavko Žitnik +1
Computer Science · Decision Sciences · Mathematics · Physics and Astronomy · #Citation #Citation analysis #Complex Network Analysis Techniques #Computer science #Data mining #Data science #Field (mathematics) #Impact factor #Information retrieval #Mathematics #PageRank #Popularity #Prestige #Promotion (chess) #Ranking (information retrieval) #Scientific Computing and Data Management #World Wide Web #cs.DL #cs.SI #physics.soc-ph #scientometrics and bibliometrics research

paper · pdf · doi:10.1016/j.joi.2015.02.008

published as J. Infometr. 9(2), 334-348 (2015) · 28 pages, 5 figures, 6 tables

openalex publication_date 2015/03/13 · arxiv created 2015/05/12 · arxiv updated 2015/05/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05

Abstract

The basic indicators of a researcher's productivity and impact are still the number of publications and their citation counts. These metrics are clear, straightforward, and easy to obtain. When a ranking of scholars is needed, for instance in grant, award, or promotion procedures, their use is the fastest and cheapest way of prioritizing some scientists over others. However, due to their nature, there is a danger of oversimplifying scientific achievements. Therefore, many other indicators have been proposed including the usage of the PageRank algorithm known for the ranking of webpages and its modifications suited to citation networks. Nevertheless, this recursive method is computationally expensive and even if it has the advantage of favouring prestige over popularity, its application should be well justified, particularly when compared to the standard citation counts. In this study, we analyze three large datasets of computer science papers in the categories of artificial intelligence, software engineering, and theory and methods and apply 12 different ranking methods to the citation networks of authors. We compare the resulting rankings with self-compiled lists of outstanding researchers selected as frequent editorial board members of prestigious journals in the field and conclude that there is no evidence of PageRank-based methods outperforming simple citation counts.

Citations