vix.ing · top · new · best · stats · spec

Web of Science: showing a bug today that can mislead scientific research output's prediction

2016/11/04 by Pablo Diniz Batista, Igor Marques-Carneiro, Batista, Pablo Diniz +5
Computer Science · Decision Sciences · #Digital Libraries (cs.DL) #FOS: Computer and information sciences #FOS: Physical sciences #Physics and Society (physics.soc-ph) #Research Data Management Practices #Scientific Computing and Data Management #scientometrics and bibliometrics research

paper · pdf · doi:10.48550/arxiv.1611.01548

openalex publication_date 2016/11/04 · openalex created_date 2016/11/30 · openalex updated_date 2026/07/28

Abstract

As it happened in all domains of human activities, economic issues and the increase of people working in scientific research have altered the way scientific production is evaluated so as the objectives of performing the evaluation. Introduced in 2005 by J. E. Hirsch as an indicator able to measure individual scientific output not only in terms of quantity, but also in terms of quality, h index has spread throughout the world. In 2007, Hirsch proposed its adoption also as the best to predict future scientific achievement and, consequently, a useful guide for investments in research and for institutions when hiring members for their scientific staff. Since then, several authors have also been using the Thomson ISI Web of Science database to develop their proposals for evaluating research output. Here, using a software we have developed, we analyse more than 100 thousand articles and show that a subtle flaw in Web of Science can inflate the results of info collected, therefore compromising the exactness and, consequently, the effectiveness of Hirsch's proposal and its variations.

Citations

Related