2015/01/06 by Jian Du, Du, Jian, Xiaoli Tang +3
Computer Science · Decision Sciences · Medicine · #Digital Libraries (cs.DL) #FOS: Computer and information sciences #Health and Medical Research Impacts #Meta-analysis and systematic reviews #cs.DL #scientometrics and bibliometrics research
paper · pdf · doi:10.48550/arxiv.1501.01076
15 pages. arXiv admin note: text overlap with arXiv:1404.0359, arXiv:1303.3875 by other authors; Journal of the Association for Information Science and Technology, 2015
openalex publication_date 2015/01/06 · arxiv created 2015/03/11 · arxiv updated 2015/03/12 · openalex created_date 2019/06/27 · openalex updated_date 2026/07/28
F1000 recommendations have been validated as a potential data source for research evaluation, but reasons for differences between F1000 Article Factor (FFa scores) and citations remain to be explored. By linking 28254 publications in F1000 to citations in Scopus, we investigated the effect of research level and article type on the internal consistency of assessments based on citations and FFa scores. It turns out that research level has little impact, while article type has big effect on the differences. These two measures are significantly different for two groups: non-primary research or evidence-based research publications are more highly cited rather than highly recommended, however, translational research or transformative research publications are more highly recommended by faculty members but gather relatively lower citations. This can be expected because citation activities are usually practiced by academic authors while the potential for scientific revolutions and the suitability for clinical practice of an article should be investigated from the practitioners' points of view. We conclude with a policy relevant recommendation that the application of bibliometric approaches in research evaluation procedures should include the proportion of three types of publications: evidence-based research, transformative research, and translational research. The latter two types are more suitable to be assessed through peer review.