Toward a comprehensive evidence map of overview of systematic review methods: paper 2—risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence
Abstract Background Overviews of systematic reviews (SRs) attempt to systematically retrieve and summarise the results of multiple systematic reviews. This is the second of two papers from a study aiming to develop a comprehensive evidence map of the methods used in overviews. Our objectives were to...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
BMC
2018-10-01
|
Series: | Systematic Reviews |
Subjects: | |
Online Access: | http://link.springer.com/article/10.1186/s13643-018-0784-8 |
id |
doaj-07110699493049c680e8009250920c67 |
---|---|
record_format |
Article |
spelling |
doaj-07110699493049c680e8009250920c672020-11-24T21:16:07ZengBMCSystematic Reviews2046-40532018-10-017113110.1186/s13643-018-0784-8Toward a comprehensive evidence map of overview of systematic review methods: paper 2—risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidenceCarole Lunny0Sue E. Brennan1Steve McDonald2Joanne E. McKenzie3Cochrane Australia, School of Public Health and Preventive Medicine, Monash UniversityCochrane Australia, School of Public Health and Preventive Medicine, Monash UniversityCochrane Australia, School of Public Health and Preventive Medicine, Monash UniversitySchool of Public Health and Preventive Medicine, Monash UniversityAbstract Background Overviews of systematic reviews (SRs) attempt to systematically retrieve and summarise the results of multiple systematic reviews. This is the second of two papers from a study aiming to develop a comprehensive evidence map of the methods used in overviews. Our objectives were to (a) develop a framework of methods for conducting, interpreting and reporting overviews (stage I)—the Methods for Overviews of Reviews (MOoR) framework—and (b) to create an evidence map by mapping studies that have evaluated overview methods to the framework (stage II). In the first paper, we reported findings for the four initial steps of an overview (specification of purpose, objectives and scope; eligibility criteria; search methods; data extraction). In this paper, we report the remaining steps: assessing risk of bias; synthesis, presentation and summary of the findings; and assessing certainty of the evidence arising from the overview. Methods In stage I, we identified cross-sectional studies, guidance documents and commentaries that described methods proposed for, or used in, overviews. Based on these studies, we developed a framework of possible methods for overviews, categorised by the steps in conducting an overview. Multiple iterations of the framework were discussed and refined by all authors. In stage II, we identified studies evaluating methods and mapped these evaluations to the framework. Results Forty-two stage I studies described methods relevant to one or more of the latter steps of an overview. Six studies evaluating methods were included in stage II. These mapped to steps involving (i) the assessment of risk of bias (RoB) in SRs (two SRs and three primary studies, all reporting evaluation of RoB tools) and (ii) the synthesis, presentation and summary of the findings (one primary study evaluating methods for measuring overlap). Conclusion Many methods have been described for use in the latter steps in conducting an overview; however, evaluation and guidance for applying these methods is sparse. The exception is RoB assessment, for which a multitude of tools exist—several with sufficient evaluation and guidance to recommend their use. Evaluation of other methods is required to provide a comprehensive evidence map.http://link.springer.com/article/10.1186/s13643-018-0784-8Overview of systematic reviewsOverviewMeta-reviewUmbrella reviewReview of reviewsSystematic review methods |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Carole Lunny Sue E. Brennan Steve McDonald Joanne E. McKenzie |
spellingShingle |
Carole Lunny Sue E. Brennan Steve McDonald Joanne E. McKenzie Toward a comprehensive evidence map of overview of systematic review methods: paper 2—risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence Systematic Reviews Overview of systematic reviews Overview Meta-review Umbrella review Review of reviews Systematic review methods |
author_facet |
Carole Lunny Sue E. Brennan Steve McDonald Joanne E. McKenzie |
author_sort |
Carole Lunny |
title |
Toward a comprehensive evidence map of overview of systematic review methods: paper 2—risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence |
title_short |
Toward a comprehensive evidence map of overview of systematic review methods: paper 2—risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence |
title_full |
Toward a comprehensive evidence map of overview of systematic review methods: paper 2—risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence |
title_fullStr |
Toward a comprehensive evidence map of overview of systematic review methods: paper 2—risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence |
title_full_unstemmed |
Toward a comprehensive evidence map of overview of systematic review methods: paper 2—risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence |
title_sort |
toward a comprehensive evidence map of overview of systematic review methods: paper 2—risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence |
publisher |
BMC |
series |
Systematic Reviews |
issn |
2046-4053 |
publishDate |
2018-10-01 |
description |
Abstract Background Overviews of systematic reviews (SRs) attempt to systematically retrieve and summarise the results of multiple systematic reviews. This is the second of two papers from a study aiming to develop a comprehensive evidence map of the methods used in overviews. Our objectives were to (a) develop a framework of methods for conducting, interpreting and reporting overviews (stage I)—the Methods for Overviews of Reviews (MOoR) framework—and (b) to create an evidence map by mapping studies that have evaluated overview methods to the framework (stage II). In the first paper, we reported findings for the four initial steps of an overview (specification of purpose, objectives and scope; eligibility criteria; search methods; data extraction). In this paper, we report the remaining steps: assessing risk of bias; synthesis, presentation and summary of the findings; and assessing certainty of the evidence arising from the overview. Methods In stage I, we identified cross-sectional studies, guidance documents and commentaries that described methods proposed for, or used in, overviews. Based on these studies, we developed a framework of possible methods for overviews, categorised by the steps in conducting an overview. Multiple iterations of the framework were discussed and refined by all authors. In stage II, we identified studies evaluating methods and mapped these evaluations to the framework. Results Forty-two stage I studies described methods relevant to one or more of the latter steps of an overview. Six studies evaluating methods were included in stage II. These mapped to steps involving (i) the assessment of risk of bias (RoB) in SRs (two SRs and three primary studies, all reporting evaluation of RoB tools) and (ii) the synthesis, presentation and summary of the findings (one primary study evaluating methods for measuring overlap). Conclusion Many methods have been described for use in the latter steps in conducting an overview; however, evaluation and guidance for applying these methods is sparse. The exception is RoB assessment, for which a multitude of tools exist—several with sufficient evaluation and guidance to recommend their use. Evaluation of other methods is required to provide a comprehensive evidence map. |
topic |
Overview of systematic reviews Overview Meta-review Umbrella review Review of reviews Systematic review methods |
url |
http://link.springer.com/article/10.1186/s13643-018-0784-8 |
work_keys_str_mv |
AT carolelunny towardacomprehensiveevidencemapofoverviewofsystematicreviewmethodspaper2riskofbiasassessmentsynthesispresentationandsummaryofthefindingsandassessmentofthecertaintyoftheevidence AT sueebrennan towardacomprehensiveevidencemapofoverviewofsystematicreviewmethodspaper2riskofbiasassessmentsynthesispresentationandsummaryofthefindingsandassessmentofthecertaintyoftheevidence AT stevemcdonald towardacomprehensiveevidencemapofoverviewofsystematicreviewmethodspaper2riskofbiasassessmentsynthesispresentationandsummaryofthefindingsandassessmentofthecertaintyoftheevidence AT joanneemckenzie towardacomprehensiveevidencemapofoverviewofsystematicreviewmethodspaper2riskofbiasassessmentsynthesispresentationandsummaryofthefindingsandassessmentofthecertaintyoftheevidence |
_version_ |
1726017002560028672 |