Revisiting the Data Lifecycle with Big Data Curation
As science becomes more data-intensive and collaborative, researchers increasingly use larger and more complex data to answer research questions. The capacity of storage infrastructure, the increased sophistication and deployment of sensors, the ubiquitous availability of computer clusters, the deve...
Main Author: | |
---|---|
Format: | Article |
Language: | English |
Published: |
University of Edinburgh
2015-06-01
|
Series: | International Journal of Digital Curation |
Online Access: | http://www.ijdc.net/index.php/ijdc/article/view/342 |
id |
doaj-e0e02744bc1247dc8e833598f74b8f6f |
---|---|
record_format |
Article |
spelling |
doaj-e0e02744bc1247dc8e833598f74b8f6f2020-11-24T23:14:59ZengUniversity of EdinburghInternational Journal of Digital Curation1746-82562015-06-0110217619210.2218/ijdc.v10i2.342338Revisiting the Data Lifecycle with Big Data CurationLine PouchardAs science becomes more data-intensive and collaborative, researchers increasingly use larger and more complex data to answer research questions. The capacity of storage infrastructure, the increased sophistication and deployment of sensors, the ubiquitous availability of computer clusters, the development of new analysis techniques, and larger collaborations allow researchers to address grand societal challenges in a way that is unprecedented. In parallel, research data repositories have been built to host research data in response to the requirements of sponsors that research data be publicly available. Libraries are re-inventing themselves to respond to a growing demand to manage, store, curate and preserve the data produced in the course of publicly funded research. As librarians and data managers are developing the tools and knowledge they need to meet these new expectations, they inevitably encounter conversations around Big Data. This paper explores definitions of Big Data that have coalesced in the last decade around four commonly mentioned characteristics: volume, variety, velocity, and veracity. We highlight the issues associated with each characteristic, particularly their impact on data management and curation. We use the methodological framework of the data life cycle model, assessing two models developed in the context of Big Data projects and find them lacking. We propose a Big Data life cycle model that includes activities focused on Big Data and more closely integrates curation with the research life cycle. These activities include planning, acquiring, preparing, analyzing, preserving, and discovering, with describing the data and assuring quality being an integral part of each activity. We discuss the relationship between institutional data curation repositories and new long-term data resources associated with high performance computing centers, and reproducibility in computational science. We apply this model by mapping the four characteristics of Big Data outlined above to each of the activities in the model. This mapping produces a set of questions that practitioners should be asking in a Big Data project.http://www.ijdc.net/index.php/ijdc/article/view/342 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Line Pouchard |
spellingShingle |
Line Pouchard Revisiting the Data Lifecycle with Big Data Curation International Journal of Digital Curation |
author_facet |
Line Pouchard |
author_sort |
Line Pouchard |
title |
Revisiting the Data Lifecycle with Big Data Curation |
title_short |
Revisiting the Data Lifecycle with Big Data Curation |
title_full |
Revisiting the Data Lifecycle with Big Data Curation |
title_fullStr |
Revisiting the Data Lifecycle with Big Data Curation |
title_full_unstemmed |
Revisiting the Data Lifecycle with Big Data Curation |
title_sort |
revisiting the data lifecycle with big data curation |
publisher |
University of Edinburgh |
series |
International Journal of Digital Curation |
issn |
1746-8256 |
publishDate |
2015-06-01 |
description |
As science becomes more data-intensive and collaborative, researchers increasingly use larger and more complex data to answer research questions. The capacity of storage infrastructure, the increased sophistication and deployment of sensors, the ubiquitous availability of computer clusters, the development of new analysis techniques, and larger collaborations allow researchers to address grand societal challenges in a way that is unprecedented. In parallel, research data repositories have been built to host research data in response to the requirements of sponsors that research data be publicly available. Libraries are re-inventing themselves to respond to a growing demand to manage, store, curate and preserve the data produced in the course of publicly funded research. As librarians and data managers are developing the tools and knowledge they need to meet these new expectations, they inevitably encounter conversations around Big Data. This paper explores definitions of Big Data that have coalesced in the last decade around four commonly mentioned characteristics: volume, variety, velocity, and veracity. We highlight the issues associated with each characteristic, particularly their impact on data management and curation. We use the methodological framework of the data life cycle model, assessing two models developed in the context of Big Data projects and find them lacking. We propose a Big Data life cycle model that includes activities focused on Big Data and more closely integrates curation with the research life cycle. These activities include planning, acquiring, preparing, analyzing, preserving, and discovering, with describing the data and assuring quality being an integral part of each activity. We discuss the relationship between institutional data curation repositories and new long-term data resources associated with high performance computing centers, and reproducibility in computational science. We apply this model by mapping the four characteristics of Big Data outlined above to each of the activities in the model. This mapping produces a set of questions that practitioners should be asking in a Big Data project. |
url |
http://www.ijdc.net/index.php/ijdc/article/view/342 |
work_keys_str_mv |
AT linepouchard revisitingthedatalifecyclewithbigdatacuration |
_version_ |
1725592597348483072 |