A systematic review of the use and reporting of evaluation frameworks within evaluations of physical activity interventions
Abstract Background Evaluation of physical activity interventions is vital to inform, and justify, evidence-based policy and practice to support population-wide changes in physical activity. Several evaluation frameworks and guidance documents have been developed to facilitate the evaluation and rep...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
BMC
2020-08-01
|
Series: | International Journal of Behavioral Nutrition and Physical Activity |
Subjects: | |
Online Access: | http://link.springer.com/article/10.1186/s12966-020-01013-7 |
id |
doaj-88fb7a1b674546e48f6b6105b64a43bb |
---|---|
record_format |
Article |
spelling |
doaj-88fb7a1b674546e48f6b6105b64a43bb2020-11-25T02:47:10ZengBMCInternational Journal of Behavioral Nutrition and Physical Activity1479-58682020-08-0117111710.1186/s12966-020-01013-7A systematic review of the use and reporting of evaluation frameworks within evaluations of physical activity interventionsJudith F. Fynn0Wendy Hardeman1Karen Milton2Joseph Murphy3Andy Jones4UKCRC Centre for Diet and Activity Research (CEDAR) and Norwich Medical School, University of East AngliaSchool of Health Sciences, University of East AngliaNorwich Medical School, University of East AngliaPhysical Activity for Health Research Cluster, Physical Education and Sport Sciences Department, University of LimerickUKCRC Centre for Diet and Activity Research (CEDAR) and Norwich Medical School, University of East AngliaAbstract Background Evaluation of physical activity interventions is vital to inform, and justify, evidence-based policy and practice to support population-wide changes in physical activity. Several evaluation frameworks and guidance documents have been developed to facilitate the evaluation and reporting of evaluation studies in public health. However, there is a lack of evidence about whether frameworks are being used to guide evaluation. There continues to be claims of poor and inconsistent reporting in evaluation studies. The aim of this review was to assess the use of evaluation frameworks and the quality of reporting of how they were applied within evaluation studies of physical activity interventions. Objectives 1. To identify whether evaluation frameworks are reported to have been used within evaluation studies of physical activity interventions, and which frameworks have been used. 2. To appraise the quality of reporting with regards to how evaluation frameworks have been used. Method We developed a checklist of indicators to enable a critical appraisal of the use and reporting of different evaluation frameworks in evaluation studies. We conducted a systematic search and review of evaluation studies published between 2015 and the date of the search to appraise the use and reporting of evaluation frameworks. A narrative synthesis is provided. Results The review identified 292 evaluation studies of physical activity interventions, only 69 (23%) of these mentioned using an evaluation framework, and only 16 different frameworks were referred to. There was variation in the quality of reporting of framework use. 51 (74%) studies were identified as being explicitly based on the stated framework, however only 26 (38%) provided detailed descriptions consistently across all the checklist indicators. Details of adaptations and limitations in how frameworks were applied were less frequently reported. The review also highlighted variability in the reporting of intervention components. More consistent and precise reporting of framework and intervention components is needed. Conclusion Evaluation frameworks can facilitate a more systematic evaluation report and we argue their limited use suggests missed opportunities to apply frameworks to guide evaluation and reporting in evaluation studies. Variability in the quality of reporting of framework use limits the comparability and transferability of evidence. Where a framework has been used, the checklist of indicators can be employed to facilitate the reporting of an evaluation study and to review the quality of an evaluation report.http://link.springer.com/article/10.1186/s12966-020-01013-7Evaluation frameworkPhysical activitySystematic reviewIntervention |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Judith F. Fynn Wendy Hardeman Karen Milton Joseph Murphy Andy Jones |
spellingShingle |
Judith F. Fynn Wendy Hardeman Karen Milton Joseph Murphy Andy Jones A systematic review of the use and reporting of evaluation frameworks within evaluations of physical activity interventions International Journal of Behavioral Nutrition and Physical Activity Evaluation framework Physical activity Systematic review Intervention |
author_facet |
Judith F. Fynn Wendy Hardeman Karen Milton Joseph Murphy Andy Jones |
author_sort |
Judith F. Fynn |
title |
A systematic review of the use and reporting of evaluation frameworks within evaluations of physical activity interventions |
title_short |
A systematic review of the use and reporting of evaluation frameworks within evaluations of physical activity interventions |
title_full |
A systematic review of the use and reporting of evaluation frameworks within evaluations of physical activity interventions |
title_fullStr |
A systematic review of the use and reporting of evaluation frameworks within evaluations of physical activity interventions |
title_full_unstemmed |
A systematic review of the use and reporting of evaluation frameworks within evaluations of physical activity interventions |
title_sort |
systematic review of the use and reporting of evaluation frameworks within evaluations of physical activity interventions |
publisher |
BMC |
series |
International Journal of Behavioral Nutrition and Physical Activity |
issn |
1479-5868 |
publishDate |
2020-08-01 |
description |
Abstract Background Evaluation of physical activity interventions is vital to inform, and justify, evidence-based policy and practice to support population-wide changes in physical activity. Several evaluation frameworks and guidance documents have been developed to facilitate the evaluation and reporting of evaluation studies in public health. However, there is a lack of evidence about whether frameworks are being used to guide evaluation. There continues to be claims of poor and inconsistent reporting in evaluation studies. The aim of this review was to assess the use of evaluation frameworks and the quality of reporting of how they were applied within evaluation studies of physical activity interventions. Objectives 1. To identify whether evaluation frameworks are reported to have been used within evaluation studies of physical activity interventions, and which frameworks have been used. 2. To appraise the quality of reporting with regards to how evaluation frameworks have been used. Method We developed a checklist of indicators to enable a critical appraisal of the use and reporting of different evaluation frameworks in evaluation studies. We conducted a systematic search and review of evaluation studies published between 2015 and the date of the search to appraise the use and reporting of evaluation frameworks. A narrative synthesis is provided. Results The review identified 292 evaluation studies of physical activity interventions, only 69 (23%) of these mentioned using an evaluation framework, and only 16 different frameworks were referred to. There was variation in the quality of reporting of framework use. 51 (74%) studies were identified as being explicitly based on the stated framework, however only 26 (38%) provided detailed descriptions consistently across all the checklist indicators. Details of adaptations and limitations in how frameworks were applied were less frequently reported. The review also highlighted variability in the reporting of intervention components. More consistent and precise reporting of framework and intervention components is needed. Conclusion Evaluation frameworks can facilitate a more systematic evaluation report and we argue their limited use suggests missed opportunities to apply frameworks to guide evaluation and reporting in evaluation studies. Variability in the quality of reporting of framework use limits the comparability and transferability of evidence. Where a framework has been used, the checklist of indicators can be employed to facilitate the reporting of an evaluation study and to review the quality of an evaluation report. |
topic |
Evaluation framework Physical activity Systematic review Intervention |
url |
http://link.springer.com/article/10.1186/s12966-020-01013-7 |
work_keys_str_mv |
AT judithffynn asystematicreviewoftheuseandreportingofevaluationframeworkswithinevaluationsofphysicalactivityinterventions AT wendyhardeman asystematicreviewoftheuseandreportingofevaluationframeworkswithinevaluationsofphysicalactivityinterventions AT karenmilton asystematicreviewoftheuseandreportingofevaluationframeworkswithinevaluationsofphysicalactivityinterventions AT josephmurphy asystematicreviewoftheuseandreportingofevaluationframeworkswithinevaluationsofphysicalactivityinterventions AT andyjones asystematicreviewoftheuseandreportingofevaluationframeworkswithinevaluationsofphysicalactivityinterventions AT judithffynn systematicreviewoftheuseandreportingofevaluationframeworkswithinevaluationsofphysicalactivityinterventions AT wendyhardeman systematicreviewoftheuseandreportingofevaluationframeworkswithinevaluationsofphysicalactivityinterventions AT karenmilton systematicreviewoftheuseandreportingofevaluationframeworkswithinevaluationsofphysicalactivityinterventions AT josephmurphy systematicreviewoftheuseandreportingofevaluationframeworkswithinevaluationsofphysicalactivityinterventions AT andyjones systematicreviewoftheuseandreportingofevaluationframeworkswithinevaluationsofphysicalactivityinterventions |
_version_ |
1724754066455658496 |