Readiness assessment for pragmatic trials (RAPT): a model to assess the readiness of an intervention for testing in a pragmatic trial

Abstract Background Pragmatic randomized, controlled trials (PCTs) test the effectiveness of interventions implemented in routine clinical practice. Because PCT findings are generalizable, this approach is gaining momentum among interventionists and funding agencies seeking to accelerate the testing...

Full description

Bibliographic Details
Published in:BMC Medical Research Methodology
Main Authors: Rosa R. Baier, Eric Jutkowitz, Susan L. Mitchell, Ellen McCreedy, Vincent Mor
Format: Article
Language:English
Published: BMC 2019-07-01
Subjects:
Online Access:http://link.springer.com/article/10.1186/s12874-019-0794-9
_version_ 1856971106177515520
author Rosa R. Baier
Eric Jutkowitz
Susan L. Mitchell
Ellen McCreedy
Vincent Mor
author_facet Rosa R. Baier
Eric Jutkowitz
Susan L. Mitchell
Ellen McCreedy
Vincent Mor
author_sort Rosa R. Baier
collection DOAJ
container_title BMC Medical Research Methodology
description Abstract Background Pragmatic randomized, controlled trials (PCTs) test the effectiveness of interventions implemented in routine clinical practice. Because PCT findings are generalizable, this approach is gaining momentum among interventionists and funding agencies seeking to accelerate the testing and adoption of evidence-based strategies to improve care and outcomes. Particular attention is being paid to non-pharmacological interventions, which are often complex and may be difficult to uniformly implement across multiple sites. While many such non-pharmacological interventions have proven efficacious in small trials, most have not been widely adopted. PCTs could accelerate effectiveness testing and adoption, yet there are no established criteria to identify interventions ready for testing in a PCT. Methods We convened 30 interventionists and healthcare leaders to identify criteria to assess the readiness of non-pharmacological interventions for PCTs. Based on this discussion, we created a model with multiple domains, qualitative scoring guidelines for each domain, and a graphical summary of readiness assessments. All workshop participants had an opportunity to review and comment on the resulting model; three piloted it with their own interventions. Several other experts also provided input. Results The Readiness Assessment for Pragmatic Trials (RAPT) model enables interventionists to assess an intervention’s readiness for PCTs. RAPT includes nine domains: implementation protocol, evidence, risk, feasibility, measurement, cost, acceptability, alignment, and impact. Domains reflect a range of considerations regarding the feasibility of successfully employing PCT methods and the prospect of an intervention’s widespread adoption, if proven effective. Individuals evaluating an intervention are asked to qualitatively assess each domain from low to high readiness. In this report, we provide assessment guidelines and examples of scored interventions. Conclusions RAPT is the first model to help interventionists and funders assess the extent to which interventions are ready for PCTs. Scoring efficacious interventions using RAPT can inform research team discussions regarding whether or not to advance an intervention to effectiveness testing using a PCT and how to design that PCT.
format Article
id doaj-art-aa7b3225ce074c8a8a9bf5ce45ba7df2
institution Directory of Open Access Journals
issn 1471-2288
language English
publishDate 2019-07-01
publisher BMC
record_format Article
spelling doaj-art-aa7b3225ce074c8a8a9bf5ce45ba7df22025-08-19T20:00:09ZengBMCBMC Medical Research Methodology1471-22882019-07-011911810.1186/s12874-019-0794-9Readiness assessment for pragmatic trials (RAPT): a model to assess the readiness of an intervention for testing in a pragmatic trialRosa R. Baier0Eric Jutkowitz1Susan L. Mitchell2Ellen McCreedy3Vincent Mor4Center for Long-Term Care Quality & Innovation, Brown University School of Public HealthDepartment of Health Services, Policy & Practice, Brown University School of Public HealthCenter for Gerontology & Healthcare PracticeDepartment of Health Services, Policy & Practice, Brown University School of Public HealthDepartment of Health Services, Policy & Practice, Brown University School of Public HealthAbstract Background Pragmatic randomized, controlled trials (PCTs) test the effectiveness of interventions implemented in routine clinical practice. Because PCT findings are generalizable, this approach is gaining momentum among interventionists and funding agencies seeking to accelerate the testing and adoption of evidence-based strategies to improve care and outcomes. Particular attention is being paid to non-pharmacological interventions, which are often complex and may be difficult to uniformly implement across multiple sites. While many such non-pharmacological interventions have proven efficacious in small trials, most have not been widely adopted. PCTs could accelerate effectiveness testing and adoption, yet there are no established criteria to identify interventions ready for testing in a PCT. Methods We convened 30 interventionists and healthcare leaders to identify criteria to assess the readiness of non-pharmacological interventions for PCTs. Based on this discussion, we created a model with multiple domains, qualitative scoring guidelines for each domain, and a graphical summary of readiness assessments. All workshop participants had an opportunity to review and comment on the resulting model; three piloted it with their own interventions. Several other experts also provided input. Results The Readiness Assessment for Pragmatic Trials (RAPT) model enables interventionists to assess an intervention’s readiness for PCTs. RAPT includes nine domains: implementation protocol, evidence, risk, feasibility, measurement, cost, acceptability, alignment, and impact. Domains reflect a range of considerations regarding the feasibility of successfully employing PCT methods and the prospect of an intervention’s widespread adoption, if proven effective. Individuals evaluating an intervention are asked to qualitatively assess each domain from low to high readiness. In this report, we provide assessment guidelines and examples of scored interventions. Conclusions RAPT is the first model to help interventionists and funders assess the extent to which interventions are ready for PCTs. Scoring efficacious interventions using RAPT can inform research team discussions regarding whether or not to advance an intervention to effectiveness testing using a PCT and how to design that PCT.http://link.springer.com/article/10.1186/s12874-019-0794-9Pragmatic clinical trialPragmatic trialEffectivenessTranslational researchImplementation scienceModel
spellingShingle Rosa R. Baier
Eric Jutkowitz
Susan L. Mitchell
Ellen McCreedy
Vincent Mor
Readiness assessment for pragmatic trials (RAPT): a model to assess the readiness of an intervention for testing in a pragmatic trial
Pragmatic clinical trial
Pragmatic trial
Effectiveness
Translational research
Implementation science
Model
title Readiness assessment for pragmatic trials (RAPT): a model to assess the readiness of an intervention for testing in a pragmatic trial
title_full Readiness assessment for pragmatic trials (RAPT): a model to assess the readiness of an intervention for testing in a pragmatic trial
title_fullStr Readiness assessment for pragmatic trials (RAPT): a model to assess the readiness of an intervention for testing in a pragmatic trial
title_full_unstemmed Readiness assessment for pragmatic trials (RAPT): a model to assess the readiness of an intervention for testing in a pragmatic trial
title_short Readiness assessment for pragmatic trials (RAPT): a model to assess the readiness of an intervention for testing in a pragmatic trial
title_sort readiness assessment for pragmatic trials rapt a model to assess the readiness of an intervention for testing in a pragmatic trial
topic Pragmatic clinical trial
Pragmatic trial
Effectiveness
Translational research
Implementation science
Model
url http://link.springer.com/article/10.1186/s12874-019-0794-9
work_keys_str_mv AT rosarbaier readinessassessmentforpragmatictrialsraptamodeltoassessthereadinessofaninterventionfortestinginapragmatictrial
AT ericjutkowitz readinessassessmentforpragmatictrialsraptamodeltoassessthereadinessofaninterventionfortestinginapragmatictrial
AT susanlmitchell readinessassessmentforpragmatictrialsraptamodeltoassessthereadinessofaninterventionfortestinginapragmatictrial
AT ellenmccreedy readinessassessmentforpragmatictrialsraptamodeltoassessthereadinessofaninterventionfortestinginapragmatictrial
AT vincentmor readinessassessmentforpragmatictrialsraptamodeltoassessthereadinessofaninterventionfortestinginapragmatictrial