Data reuse and the open data citation advantage

Background. Attribution to the original contributor upon reuse of published data is important both as a reward for data creators and to document the provenance of research findings. Previous studies have found that papers with publicly available datasets receive a higher number of citations than sim...

Full description

Bibliographic Details
Main Authors: Heather A. Piwowar, Todd J. Vision
Format: Article
Language:English
Published: PeerJ Inc. 2013-10-01
Series:PeerJ
Subjects:
Online Access:https://peerj.com/articles/175.pdf
id doaj-229aaa9d26b445a0ae6462997f4709b1
record_format Article
spelling doaj-229aaa9d26b445a0ae6462997f4709b12020-11-25T00:18:26ZengPeerJ Inc.PeerJ2167-83592013-10-011e17510.7717/peerj.175175Data reuse and the open data citation advantageHeather A. Piwowar0Todd J. Vision1National Evolutionary Synthesis Center, Durham, NC, USANational Evolutionary Synthesis Center, Durham, NC, USABackground. Attribution to the original contributor upon reuse of published data is important both as a reward for data creators and to document the provenance of research findings. Previous studies have found that papers with publicly available datasets receive a higher number of citations than similar studies without available data. However, few previous analyses have had the statistical power to control for the many variables known to predict citation rate, which has led to uncertain estimates of the “citation benefit”. Furthermore, little is known about patterns in data reuse over time and across datasets. Method and Results. Here, we look at citation rates while controlling for many known citation predictors and investigate the variability of data reuse. In a multivariate regression on 10,555 studies that created gene expression microarray data, we found that studies that made data available in a public repository received 9% (95% confidence interval: 5% to 13%) more citations than similar studies for which the data was not made available. Date of publication, journal impact factor, open access status, number of authors, first and last author publication history, corresponding author country, institution citation history, and study topic were included as covariates. The citation benefit varied with date of dataset deposition: a citation benefit was most clear for papers published in 2004 and 2005, at about 30%. Authors published most papers using their own datasets within two years of their first publication on the dataset, whereas data reuse papers published by third-party investigators continued to accumulate for at least six years. To study patterns of data reuse directly, we compiled 9,724 instances of third party data reuse via mention of GEO or ArrayExpress accession numbers in the full text of papers. The level of third-party data use was high: for 100 datasets deposited in year 0, we estimated that 40 papers in PubMed reused a dataset by year 2, 100 by year 4, and more than 150 data reuse papers had been published by year 5. Data reuse was distributed across a broad base of datasets: a very conservative estimate found that 20% of the datasets deposited between 2003 and 2007 had been reused at least once by third parties. Conclusion. After accounting for other factors affecting citation rate, we find a robust citation benefit from open data, although a smaller one than previously reported. We conclude there is a direct effect of third-party data reuse that persists for years beyond the time when researchers have published most of the papers reusing their own data. Other factors that may also contribute to the citation benefit are considered. We further conclude that, at least for gene expression microarray data, a substantial fraction of archived datasets are reused, and that the intensity of dataset reuse has been steadily increasing since 2003.https://peerj.com/articles/175.pdfData reuseData repositoriesGene expression microarrayIncentivesData archivingOpen data
collection DOAJ
language English
format Article
sources DOAJ
author Heather A. Piwowar
Todd J. Vision
spellingShingle Heather A. Piwowar
Todd J. Vision
Data reuse and the open data citation advantage
PeerJ
Data reuse
Data repositories
Gene expression microarray
Incentives
Data archiving
Open data
author_facet Heather A. Piwowar
Todd J. Vision
author_sort Heather A. Piwowar
title Data reuse and the open data citation advantage
title_short Data reuse and the open data citation advantage
title_full Data reuse and the open data citation advantage
title_fullStr Data reuse and the open data citation advantage
title_full_unstemmed Data reuse and the open data citation advantage
title_sort data reuse and the open data citation advantage
publisher PeerJ Inc.
series PeerJ
issn 2167-8359
publishDate 2013-10-01
description Background. Attribution to the original contributor upon reuse of published data is important both as a reward for data creators and to document the provenance of research findings. Previous studies have found that papers with publicly available datasets receive a higher number of citations than similar studies without available data. However, few previous analyses have had the statistical power to control for the many variables known to predict citation rate, which has led to uncertain estimates of the “citation benefit”. Furthermore, little is known about patterns in data reuse over time and across datasets. Method and Results. Here, we look at citation rates while controlling for many known citation predictors and investigate the variability of data reuse. In a multivariate regression on 10,555 studies that created gene expression microarray data, we found that studies that made data available in a public repository received 9% (95% confidence interval: 5% to 13%) more citations than similar studies for which the data was not made available. Date of publication, journal impact factor, open access status, number of authors, first and last author publication history, corresponding author country, institution citation history, and study topic were included as covariates. The citation benefit varied with date of dataset deposition: a citation benefit was most clear for papers published in 2004 and 2005, at about 30%. Authors published most papers using their own datasets within two years of their first publication on the dataset, whereas data reuse papers published by third-party investigators continued to accumulate for at least six years. To study patterns of data reuse directly, we compiled 9,724 instances of third party data reuse via mention of GEO or ArrayExpress accession numbers in the full text of papers. The level of third-party data use was high: for 100 datasets deposited in year 0, we estimated that 40 papers in PubMed reused a dataset by year 2, 100 by year 4, and more than 150 data reuse papers had been published by year 5. Data reuse was distributed across a broad base of datasets: a very conservative estimate found that 20% of the datasets deposited between 2003 and 2007 had been reused at least once by third parties. Conclusion. After accounting for other factors affecting citation rate, we find a robust citation benefit from open data, although a smaller one than previously reported. We conclude there is a direct effect of third-party data reuse that persists for years beyond the time when researchers have published most of the papers reusing their own data. Other factors that may also contribute to the citation benefit are considered. We further conclude that, at least for gene expression microarray data, a substantial fraction of archived datasets are reused, and that the intensity of dataset reuse has been steadily increasing since 2003.
topic Data reuse
Data repositories
Gene expression microarray
Incentives
Data archiving
Open data
url https://peerj.com/articles/175.pdf
work_keys_str_mv AT heatherapiwowar datareuseandtheopendatacitationadvantage
AT toddjvision datareuseandtheopendatacitationadvantage
_version_ 1725376673467072512