Evaluating “Take the Stairs, Wyoming!” Through the RE-AIM Framework: Challenges and Opportunities

Introduction: Health promotion delivery systems are increasingly being asked to implement policy, systems, and environmental interventions (PSEs). However, evaluating PSEs is challenging, especially in low-resource community settings. This paper describes the use of RE-AIM to evaluate a physical act...

Full description

Bibliographic Details
Main Authors: Laura E. Balis, Thomas Strayer
Format: Article
Language:English
Published: Frontiers Media S.A. 2019-12-01
Series:Frontiers in Public Health
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fpubh.2019.00368/full
id doaj-6a7d8bd322d84b9fafeb605b3146829f
record_format Article
spelling doaj-6a7d8bd322d84b9fafeb605b3146829f2020-11-25T02:37:04ZengFrontiers Media S.A.Frontiers in Public Health2296-25652019-12-01710.3389/fpubh.2019.00368498779Evaluating “Take the Stairs, Wyoming!” Through the RE-AIM Framework: Challenges and OpportunitiesLaura E. Balis0Thomas Strayer1Division of Agriculture Cooperative Extension Service, University of Arkansas System, Little Rock, AR, United StatesCenter for Quality Aging, Vanderbilt University Medical Center, Nashville, TN, United StatesIntroduction: Health promotion delivery systems are increasingly being asked to implement policy, systems, and environmental interventions (PSEs). However, evaluating PSEs is challenging, especially in low-resource community settings. This paper describes the use of RE-AIM to evaluate a physical activity PSE delivered through University of Wyoming Extension and highlights challenges and opportunities in pragmatic, real-world program evaluation.Methods: Extension health educators adapted a point-of-decision prompt intervention encouraging stairway use through posters, called Take the Stairs, Wyoming! Reach was assessed through estimates of daily traffic, effectiveness was assessed through opportunistic interviews, adoption was calculated as the number and proportion of sites that agreed to hang posters, implementation was calculated as the proportion of sites with a poster in place at a 2-weeks follow-up visit, and maintenance was assessed through 6-months opportunistic interviews (individual level) and proportion of sites with a poster in place (organizational level).Results: Overall, the posters were widely adopted and most posters were implemented as intended. However, capturing reach, effectiveness, and maintenance was challenging, as health educators found the evaluation burdensome. Therefore, it was difficult to determine if the posters were effective at increasing physical activity levels.Discussion: Suggestions are provided for capturing reach, effectiveness, and maintenance data in community settings. Future efforts are needed to create evaluation tools to pragmatically measure effectiveness of PSEs on changing behaviors, as well as to prioritize program evaluation in Extension.https://www.frontiersin.org/article/10.3389/fpubh.2019.00368/fullPSEsRE-AIMextensionevaluationpoint-of-decision promptphysical activity
collection DOAJ
language English
format Article
sources DOAJ
author Laura E. Balis
Thomas Strayer
spellingShingle Laura E. Balis
Thomas Strayer
Evaluating “Take the Stairs, Wyoming!” Through the RE-AIM Framework: Challenges and Opportunities
Frontiers in Public Health
PSEs
RE-AIM
extension
evaluation
point-of-decision prompt
physical activity
author_facet Laura E. Balis
Thomas Strayer
author_sort Laura E. Balis
title Evaluating “Take the Stairs, Wyoming!” Through the RE-AIM Framework: Challenges and Opportunities
title_short Evaluating “Take the Stairs, Wyoming!” Through the RE-AIM Framework: Challenges and Opportunities
title_full Evaluating “Take the Stairs, Wyoming!” Through the RE-AIM Framework: Challenges and Opportunities
title_fullStr Evaluating “Take the Stairs, Wyoming!” Through the RE-AIM Framework: Challenges and Opportunities
title_full_unstemmed Evaluating “Take the Stairs, Wyoming!” Through the RE-AIM Framework: Challenges and Opportunities
title_sort evaluating “take the stairs, wyoming!” through the re-aim framework: challenges and opportunities
publisher Frontiers Media S.A.
series Frontiers in Public Health
issn 2296-2565
publishDate 2019-12-01
description Introduction: Health promotion delivery systems are increasingly being asked to implement policy, systems, and environmental interventions (PSEs). However, evaluating PSEs is challenging, especially in low-resource community settings. This paper describes the use of RE-AIM to evaluate a physical activity PSE delivered through University of Wyoming Extension and highlights challenges and opportunities in pragmatic, real-world program evaluation.Methods: Extension health educators adapted a point-of-decision prompt intervention encouraging stairway use through posters, called Take the Stairs, Wyoming! Reach was assessed through estimates of daily traffic, effectiveness was assessed through opportunistic interviews, adoption was calculated as the number and proportion of sites that agreed to hang posters, implementation was calculated as the proportion of sites with a poster in place at a 2-weeks follow-up visit, and maintenance was assessed through 6-months opportunistic interviews (individual level) and proportion of sites with a poster in place (organizational level).Results: Overall, the posters were widely adopted and most posters were implemented as intended. However, capturing reach, effectiveness, and maintenance was challenging, as health educators found the evaluation burdensome. Therefore, it was difficult to determine if the posters were effective at increasing physical activity levels.Discussion: Suggestions are provided for capturing reach, effectiveness, and maintenance data in community settings. Future efforts are needed to create evaluation tools to pragmatically measure effectiveness of PSEs on changing behaviors, as well as to prioritize program evaluation in Extension.
topic PSEs
RE-AIM
extension
evaluation
point-of-decision prompt
physical activity
url https://www.frontiersin.org/article/10.3389/fpubh.2019.00368/full
work_keys_str_mv AT lauraebalis evaluatingtakethestairswyomingthroughthereaimframeworkchallengesandopportunities
AT thomasstrayer evaluatingtakethestairswyomingthroughthereaimframeworkchallengesandopportunities
_version_ 1724796871300349952