Novel bibliometric scores for evaluating research quality and output: a correlation study with established indexes

Research output: Contribution to journalArticle

Abstract

INTRODUCTION: Novel bibliometric indexes (commonly known as altmetrics) are gaining interest within the scientific community and might represent an important alternative measure of research quality and output.

AIMS: We evaluate how these new metrics correlate with established bibliometric indexes such as the impact factor (IF), currently used as a measure of scientific production as well as a criterion for scientific research funding, and how they might be helpful in assessing the impact of research.

METHODS: We calculated altmetrics scores for all the articles published at our institution during a single year and examined the correlation between altmetrics scores and IFs as a measure of research quality and impact in all departments.

RESULTS: For all articles from the various departments published in a single year, the altmetrics score and the sum of all IFs showed a strong and significant correlation (Spearman's rho 0.88). The correlation was significant also when the major components of altmetrics, including Facebook, Twitter and Mendeley, were analyzed. The implementation of altmetrics has been found to be easy and effective at both the researcher and librarian levels.

CONCLUSIONS: The novel bibliographic index altmetrics is consistent and reliable and can complement or be considered a valid alternative to standard bibliometric indexes to benchmark output and quality of research for academic and funding purposes.

Original languageEnglish
Pages (from-to)e451-e455
JournalInternational Journal of Biological Markers
Volume31
Issue number4
DOIs
Publication statusPublished - Dec 23 2016

Fingerprint

Bibliometrics
Research
Librarians
Benchmarking
Research Personnel

Keywords

  • Journal Article

Cite this

@article{0a2b62e9435947419b8406f1d0361f38,
title = "Novel bibliometric scores for evaluating research quality and output: a correlation study with established indexes",
abstract = "INTRODUCTION: Novel bibliometric indexes (commonly known as altmetrics) are gaining interest within the scientific community and might represent an important alternative measure of research quality and output.AIMS: We evaluate how these new metrics correlate with established bibliometric indexes such as the impact factor (IF), currently used as a measure of scientific production as well as a criterion for scientific research funding, and how they might be helpful in assessing the impact of research.METHODS: We calculated altmetrics scores for all the articles published at our institution during a single year and examined the correlation between altmetrics scores and IFs as a measure of research quality and impact in all departments.RESULTS: For all articles from the various departments published in a single year, the altmetrics score and the sum of all IFs showed a strong and significant correlation (Spearman's rho 0.88). The correlation was significant also when the major components of altmetrics, including Facebook, Twitter and Mendeley, were analyzed. The implementation of altmetrics has been found to be easy and effective at both the researcher and librarian levels.CONCLUSIONS: The novel bibliographic index altmetrics is consistent and reliable and can complement or be considered a valid alternative to standard bibliometric indexes to benchmark output and quality of research for academic and funding purposes.",
keywords = "Journal Article",
author = "Valeria Scotti and {De Silvestri}, Annalisa and Luigia Scudeller and Paola Abele and Funda Topuz and Moreno Curti",
year = "2016",
month = "12",
day = "23",
doi = "10.5301/jbm.5000217",
language = "English",
volume = "31",
pages = "e451--e455",
journal = "International Journal of Biological Markers",
issn = "0393-6155",
publisher = "Wichtig Publishing Srl",
number = "4",

}

TY - JOUR

T1 - Novel bibliometric scores for evaluating research quality and output

T2 - International Journal of Biological Markers

AU - Scotti, Valeria

AU - De Silvestri, Annalisa

AU - Scudeller, Luigia

AU - Abele, Paola

AU - Topuz, Funda

AU - Curti, Moreno

PY - 2016/12/23

Y1 - 2016/12/23

N2 - INTRODUCTION: Novel bibliometric indexes (commonly known as altmetrics) are gaining interest within the scientific community and might represent an important alternative measure of research quality and output.AIMS: We evaluate how these new metrics correlate with established bibliometric indexes such as the impact factor (IF), currently used as a measure of scientific production as well as a criterion for scientific research funding, and how they might be helpful in assessing the impact of research.METHODS: We calculated altmetrics scores for all the articles published at our institution during a single year and examined the correlation between altmetrics scores and IFs as a measure of research quality and impact in all departments.RESULTS: For all articles from the various departments published in a single year, the altmetrics score and the sum of all IFs showed a strong and significant correlation (Spearman's rho 0.88). The correlation was significant also when the major components of altmetrics, including Facebook, Twitter and Mendeley, were analyzed. The implementation of altmetrics has been found to be easy and effective at both the researcher and librarian levels.CONCLUSIONS: The novel bibliographic index altmetrics is consistent and reliable and can complement or be considered a valid alternative to standard bibliometric indexes to benchmark output and quality of research for academic and funding purposes.

AB - INTRODUCTION: Novel bibliometric indexes (commonly known as altmetrics) are gaining interest within the scientific community and might represent an important alternative measure of research quality and output.AIMS: We evaluate how these new metrics correlate with established bibliometric indexes such as the impact factor (IF), currently used as a measure of scientific production as well as a criterion for scientific research funding, and how they might be helpful in assessing the impact of research.METHODS: We calculated altmetrics scores for all the articles published at our institution during a single year and examined the correlation between altmetrics scores and IFs as a measure of research quality and impact in all departments.RESULTS: For all articles from the various departments published in a single year, the altmetrics score and the sum of all IFs showed a strong and significant correlation (Spearman's rho 0.88). The correlation was significant also when the major components of altmetrics, including Facebook, Twitter and Mendeley, were analyzed. The implementation of altmetrics has been found to be easy and effective at both the researcher and librarian levels.CONCLUSIONS: The novel bibliographic index altmetrics is consistent and reliable and can complement or be considered a valid alternative to standard bibliometric indexes to benchmark output and quality of research for academic and funding purposes.

KW - Journal Article

U2 - 10.5301/jbm.5000217

DO - 10.5301/jbm.5000217

M3 - Article

VL - 31

SP - e451-e455

JO - International Journal of Biological Markers

JF - International Journal of Biological Markers

SN - 0393-6155

IS - 4

ER -