Meta-Analysis of Correlations between Altmetric Attention Score and Citations in Health Sciences

Introduction. In recent years, several controversial reports of the correlation between altmetric score and citations have been published (range: -0.2 to 0.8). We conducted a meta-analysis to provide an in-depth statistical analysis of the correlation between altmetric score and number of citations...

Full description

Bibliographic Details
Main Authors: Jafar Kolahi, Saber Khazaei, Pedram Iranmanesh, Jeehyoung Kim, Heejung Bang, Abbasali Khademi
Format: Article
Language:English
Published: Hindawi Limited 2021-01-01
Series:BioMed Research International
Online Access:http://dx.doi.org/10.1155/2021/6680764
id doaj-3e00ea03bf5f4c60beec348b232aaf2b
record_format Article
spelling doaj-3e00ea03bf5f4c60beec348b232aaf2b2021-04-19T00:05:21ZengHindawi LimitedBioMed Research International2314-61412021-01-01202110.1155/2021/6680764Meta-Analysis of Correlations between Altmetric Attention Score and Citations in Health SciencesJafar Kolahi0Saber Khazaei1Pedram Iranmanesh2Jeehyoung Kim3Heejung Bang4Abbasali Khademi5Independent Research ScientistDepartment of EndodonticsDepartment of EndodonticsDepartment of Orthopedic SurgeryDivision of BiostatisticsDepartment of EndodonticsIntroduction. In recent years, several controversial reports of the correlation between altmetric score and citations have been published (range: -0.2 to 0.8). We conducted a meta-analysis to provide an in-depth statistical analysis of the correlation between altmetric score and number of citations in the field of health sciences. Methods. Three online databases (Web of Science, Scopus, and PubMed) were systematically searched, without language restrictions, from the earliest publication date available through February 29, 2020, using the keywords “altmetric,” “citation,” and “correlation.” Grey literature was also searched via WorldCat, Open Grey, and Google Scholar (first 100 hits only). All studies in the field of health sciences that reported on this correlation were included. Effect sizes were calculated using Fisher’s z transformation of correlations. Subgroup analyses based on citation source and sampling methods were performed. Results. From 27 included articles, 8 articles comprise several independent studies. The total sample size was 9,943 articles comprised of 35 studies. The overall pooled effect size was 0.19 (95% confidence interval 0.13 to 0.26). Bivariate partial prediction of interaction between effect size, citation source, and sampling method showed a greater effect size with Web of Science compared with Scopus and Dimensions. Egger’s regression showed a marginally nonsignificant publication bias (p=0.055), and trim-and-fill analysis estimated one missing study in this meta-analysis. Conclusion. In health sciences, currently altmetric score has a positive but weak correlation with number of citations (pooled correlation=0.19, 95% C.I 0.12 to 0.25). We emphasize on future examinations to assess changes of correlation pattern between altmetric score and citations over time.http://dx.doi.org/10.1155/2021/6680764
collection DOAJ
language English
format Article
sources DOAJ
author Jafar Kolahi
Saber Khazaei
Pedram Iranmanesh
Jeehyoung Kim
Heejung Bang
Abbasali Khademi
spellingShingle Jafar Kolahi
Saber Khazaei
Pedram Iranmanesh
Jeehyoung Kim
Heejung Bang
Abbasali Khademi
Meta-Analysis of Correlations between Altmetric Attention Score and Citations in Health Sciences
BioMed Research International
author_facet Jafar Kolahi
Saber Khazaei
Pedram Iranmanesh
Jeehyoung Kim
Heejung Bang
Abbasali Khademi
author_sort Jafar Kolahi
title Meta-Analysis of Correlations between Altmetric Attention Score and Citations in Health Sciences
title_short Meta-Analysis of Correlations between Altmetric Attention Score and Citations in Health Sciences
title_full Meta-Analysis of Correlations between Altmetric Attention Score and Citations in Health Sciences
title_fullStr Meta-Analysis of Correlations between Altmetric Attention Score and Citations in Health Sciences
title_full_unstemmed Meta-Analysis of Correlations between Altmetric Attention Score and Citations in Health Sciences
title_sort meta-analysis of correlations between altmetric attention score and citations in health sciences
publisher Hindawi Limited
series BioMed Research International
issn 2314-6141
publishDate 2021-01-01
description Introduction. In recent years, several controversial reports of the correlation between altmetric score and citations have been published (range: -0.2 to 0.8). We conducted a meta-analysis to provide an in-depth statistical analysis of the correlation between altmetric score and number of citations in the field of health sciences. Methods. Three online databases (Web of Science, Scopus, and PubMed) were systematically searched, without language restrictions, from the earliest publication date available through February 29, 2020, using the keywords “altmetric,” “citation,” and “correlation.” Grey literature was also searched via WorldCat, Open Grey, and Google Scholar (first 100 hits only). All studies in the field of health sciences that reported on this correlation were included. Effect sizes were calculated using Fisher’s z transformation of correlations. Subgroup analyses based on citation source and sampling methods were performed. Results. From 27 included articles, 8 articles comprise several independent studies. The total sample size was 9,943 articles comprised of 35 studies. The overall pooled effect size was 0.19 (95% confidence interval 0.13 to 0.26). Bivariate partial prediction of interaction between effect size, citation source, and sampling method showed a greater effect size with Web of Science compared with Scopus and Dimensions. Egger’s regression showed a marginally nonsignificant publication bias (p=0.055), and trim-and-fill analysis estimated one missing study in this meta-analysis. Conclusion. In health sciences, currently altmetric score has a positive but weak correlation with number of citations (pooled correlation=0.19, 95% C.I 0.12 to 0.25). We emphasize on future examinations to assess changes of correlation pattern between altmetric score and citations over time.
url http://dx.doi.org/10.1155/2021/6680764
work_keys_str_mv AT jafarkolahi metaanalysisofcorrelationsbetweenaltmetricattentionscoreandcitationsinhealthsciences
AT saberkhazaei metaanalysisofcorrelationsbetweenaltmetricattentionscoreandcitationsinhealthsciences
AT pedramiranmanesh metaanalysisofcorrelationsbetweenaltmetricattentionscoreandcitationsinhealthsciences
AT jeehyoungkim metaanalysisofcorrelationsbetweenaltmetricattentionscoreandcitationsinhealthsciences
AT heejungbang metaanalysisofcorrelationsbetweenaltmetricattentionscoreandcitationsinhealthsciences
AT abbasalikhademi metaanalysisofcorrelationsbetweenaltmetricattentionscoreandcitationsinhealthsciences
_version_ 1714674086538379264