Improving open and rigorous science: ten key future research opportunities related to rigor, reproducibility, and transparency in scientific research [version 1; peer review: 3 approved]
Background: As part of a coordinated effort to expand research activity around rigor, reproducibility, and transparency (RRT) across scientific disciplines, a team of investigators at the Indiana University School of Public Health-Bloomington hosted a workshop in October 2019 with international lead...
Main Authors: | , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
F1000 Research Ltd
2020-10-01
|
Series: | F1000Research |
Online Access: | https://f1000research.com/articles/9-1235/v1 |
id |
doaj-f952230d206240f1ae2d6154976c610c |
---|---|
record_format |
Article |
spelling |
doaj-f952230d206240f1ae2d6154976c610c2021-02-22T16:42:58ZengF1000 Research LtdF1000Research2046-14022020-10-01910.12688/f1000research.26594.129358Improving open and rigorous science: ten key future research opportunities related to rigor, reproducibility, and transparency in scientific research [version 1; peer review: 3 approved]Danny Valdez0Colby J. Vorland1Andrew W. Brown2Evan Mayo-Wilson3Justin Otten4Richard Ball5Sean Grant6Rachel Levy7Dubravka Svetina Valdivia8David B. Allison9Indiana University School of Public Health, Bloomington, IN, 47403, USAIndiana University School of Public Health, Bloomington, IN, 47403, USAIndiana University School of Public Health, Bloomington, IN, 47403, USAIndiana University School of Public Health, Bloomington, IN, 47403, USAIndiana University School of Public Health, Bloomington, IN, 47403, USAProject TIER, Haverford College, Haverford, Pennsylvania, 19041, USAIndiana University Purdue University Indianapolis Fairbanks School of Public Health, Indianapolis, IN, 46223, USARachel Levy, Mathematical Association of America, 1529 18th St. NW, Washington, DC, 20036, USAIndiana University School of Education, Bloomington, IN, 47401, USAIndiana University School of Public Health, Bloomington, IN, 47403, USABackground: As part of a coordinated effort to expand research activity around rigor, reproducibility, and transparency (RRT) across scientific disciplines, a team of investigators at the Indiana University School of Public Health-Bloomington hosted a workshop in October 2019 with international leaders to discuss key opportunities for RRT research. Objective: The workshop aimed to identify research priorities and opportunities related to RRT. Design: Over two-days, workshop attendees gave presentations and participated in three working groups: (1) Improving Education & Training in RRT, (2) Reducing Statistical Errors and Increasing Analytic Transparency, and (3) Looking Outward: Increasing Truthfulness and Accuracy of Research Communications. Following small-group discussions, the working groups presented their findings, and participants discussed the research opportunities identified. The investigators compiled a list of research priorities, which were circulated to all participants for feedback. Results: Participants identified the following priority research questions: (1) Can RRT-focused statistics and mathematical modeling courses improve statistics practice?; (2) Can specialized training in scientific writing improve transparency?; (3) Does modality (e.g. face to face, online) affect the efficacy RRT-related education?; (4) How can automated programs help identify errors more efficiently?; (5) What is the prevalence and impact of errors in scientific publications (e.g., analytic inconsistencies, statistical errors, and other objective errors)?; (6) Do error prevention workflows reduce errors?; (7) How do we encourage post-publication error correction?; (8) How does ‘spin’ in research communication affect stakeholder understanding and use of research evidence?; (9) Do tools to aid writing research reports increase comprehensiveness and clarity of research reports?; and (10) Is it possible to inculcate scientific values and norms related to truthful, rigorous, accurate, and comprehensive scientific reporting? Conclusion: Participants identified important and relatively unexplored questions related to improving RRT. This list may be useful to the scientific community and investigators seeking to advance meta-science (i.e. research on research).https://f1000research.com/articles/9-1235/v1 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Danny Valdez Colby J. Vorland Andrew W. Brown Evan Mayo-Wilson Justin Otten Richard Ball Sean Grant Rachel Levy Dubravka Svetina Valdivia David B. Allison |
spellingShingle |
Danny Valdez Colby J. Vorland Andrew W. Brown Evan Mayo-Wilson Justin Otten Richard Ball Sean Grant Rachel Levy Dubravka Svetina Valdivia David B. Allison Improving open and rigorous science: ten key future research opportunities related to rigor, reproducibility, and transparency in scientific research [version 1; peer review: 3 approved] F1000Research |
author_facet |
Danny Valdez Colby J. Vorland Andrew W. Brown Evan Mayo-Wilson Justin Otten Richard Ball Sean Grant Rachel Levy Dubravka Svetina Valdivia David B. Allison |
author_sort |
Danny Valdez |
title |
Improving open and rigorous science: ten key future research opportunities related to rigor, reproducibility, and transparency in scientific research [version 1; peer review: 3 approved] |
title_short |
Improving open and rigorous science: ten key future research opportunities related to rigor, reproducibility, and transparency in scientific research [version 1; peer review: 3 approved] |
title_full |
Improving open and rigorous science: ten key future research opportunities related to rigor, reproducibility, and transparency in scientific research [version 1; peer review: 3 approved] |
title_fullStr |
Improving open and rigorous science: ten key future research opportunities related to rigor, reproducibility, and transparency in scientific research [version 1; peer review: 3 approved] |
title_full_unstemmed |
Improving open and rigorous science: ten key future research opportunities related to rigor, reproducibility, and transparency in scientific research [version 1; peer review: 3 approved] |
title_sort |
improving open and rigorous science: ten key future research opportunities related to rigor, reproducibility, and transparency in scientific research [version 1; peer review: 3 approved] |
publisher |
F1000 Research Ltd |
series |
F1000Research |
issn |
2046-1402 |
publishDate |
2020-10-01 |
description |
Background: As part of a coordinated effort to expand research activity around rigor, reproducibility, and transparency (RRT) across scientific disciplines, a team of investigators at the Indiana University School of Public Health-Bloomington hosted a workshop in October 2019 with international leaders to discuss key opportunities for RRT research. Objective: The workshop aimed to identify research priorities and opportunities related to RRT. Design: Over two-days, workshop attendees gave presentations and participated in three working groups: (1) Improving Education & Training in RRT, (2) Reducing Statistical Errors and Increasing Analytic Transparency, and (3) Looking Outward: Increasing Truthfulness and Accuracy of Research Communications. Following small-group discussions, the working groups presented their findings, and participants discussed the research opportunities identified. The investigators compiled a list of research priorities, which were circulated to all participants for feedback. Results: Participants identified the following priority research questions: (1) Can RRT-focused statistics and mathematical modeling courses improve statistics practice?; (2) Can specialized training in scientific writing improve transparency?; (3) Does modality (e.g. face to face, online) affect the efficacy RRT-related education?; (4) How can automated programs help identify errors more efficiently?; (5) What is the prevalence and impact of errors in scientific publications (e.g., analytic inconsistencies, statistical errors, and other objective errors)?; (6) Do error prevention workflows reduce errors?; (7) How do we encourage post-publication error correction?; (8) How does ‘spin’ in research communication affect stakeholder understanding and use of research evidence?; (9) Do tools to aid writing research reports increase comprehensiveness and clarity of research reports?; and (10) Is it possible to inculcate scientific values and norms related to truthful, rigorous, accurate, and comprehensive scientific reporting? Conclusion: Participants identified important and relatively unexplored questions related to improving RRT. This list may be useful to the scientific community and investigators seeking to advance meta-science (i.e. research on research). |
url |
https://f1000research.com/articles/9-1235/v1 |
work_keys_str_mv |
AT dannyvaldez improvingopenandrigoroussciencetenkeyfutureresearchopportunitiesrelatedtorigorreproducibilityandtransparencyinscientificresearchversion1peerreview3approved AT colbyjvorland improvingopenandrigoroussciencetenkeyfutureresearchopportunitiesrelatedtorigorreproducibilityandtransparencyinscientificresearchversion1peerreview3approved AT andrewwbrown improvingopenandrigoroussciencetenkeyfutureresearchopportunitiesrelatedtorigorreproducibilityandtransparencyinscientificresearchversion1peerreview3approved AT evanmayowilson improvingopenandrigoroussciencetenkeyfutureresearchopportunitiesrelatedtorigorreproducibilityandtransparencyinscientificresearchversion1peerreview3approved AT justinotten improvingopenandrigoroussciencetenkeyfutureresearchopportunitiesrelatedtorigorreproducibilityandtransparencyinscientificresearchversion1peerreview3approved AT richardball improvingopenandrigoroussciencetenkeyfutureresearchopportunitiesrelatedtorigorreproducibilityandtransparencyinscientificresearchversion1peerreview3approved AT seangrant improvingopenandrigoroussciencetenkeyfutureresearchopportunitiesrelatedtorigorreproducibilityandtransparencyinscientificresearchversion1peerreview3approved AT rachellevy improvingopenandrigoroussciencetenkeyfutureresearchopportunitiesrelatedtorigorreproducibilityandtransparencyinscientificresearchversion1peerreview3approved AT dubravkasvetinavaldivia improvingopenandrigoroussciencetenkeyfutureresearchopportunitiesrelatedtorigorreproducibilityandtransparencyinscientificresearchversion1peerreview3approved AT davidballison improvingopenandrigoroussciencetenkeyfutureresearchopportunitiesrelatedtorigorreproducibilityandtransparencyinscientificresearchversion1peerreview3approved |
_version_ |
1724256579329458176 |