Using a theory of change for evaluation: has the FAIMER international faculty development program improved the field of health professions education?
Program theories have not been extensively used in evaluating faculty development programs in medical education. Ample evidence shows that a well-formulated program theory plays a pivotal role in program implementation and evaluation. Program theory links activities and expected outcomes using a log...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Association for Medical Education in Europe (AMEE)
2019-03-01
|
Series: | MedEdPublish |
Subjects: | |
Online Access: | https://www.mededpublish.org/Manuscripts/2200 |
id |
doaj-347f39d417464a7087ddfa0e12d5518c |
---|---|
record_format |
Article |
spelling |
doaj-347f39d417464a7087ddfa0e12d5518c2020-11-25T01:33:14ZengAssociation for Medical Education in Europe (AMEE)MedEdPublish2312-79962019-03-0181Using a theory of change for evaluation: has the FAIMER international faculty development program improved the field of health professions education?Shiyao Yuan0Snigdha Mukherjee1Rashmi Vyas2William Burdick3Foundation for Advancement of International Medical Education and ResearchFoundation for Advancement of International Medical Education and ResearchFoundation for Advancement of International Medical Education and ResearchFoundation for Advancement of International Medical Education and ResearchProgram theories have not been extensively used in evaluating faculty development programs in medical education. Ample evidence shows that a well-formulated program theory plays a pivotal role in program implementation and evaluation. Program theory links activities and expected outcomes using a logical process showing how they lead to long-term goals. It also develops appropriate metrics or indicators for assessing if those outcomes and activities really occurred. In this study, FAIMER's theory of change was adopted as a framework for evaluation. Survey data from FAIMER Fellows was used to assess the effectiveness of FAIMER's faculty development program in meeting the goal of improving health professions education. We used structural equation modeling to examine the association among outcomes mapped out in our theory of change and their association with improving field of health professions education. The study results indicated that FAIMER's faculty development program appeared to have positively influenced advancement of multiple facets of health professions education as envisaged in our theory of change. Using a theoretical framework for evaluating a program helped us identify the specific areas of outcomes that need to be strengthened for program improvement as well as provided us with a data-driven evaluation framework to measure program progress. https://www.mededpublish.org/Manuscripts/2200International Faculty Development ProgramHealth Professions EducationTheory of ChangeProgram Evaluation |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Shiyao Yuan Snigdha Mukherjee Rashmi Vyas William Burdick |
spellingShingle |
Shiyao Yuan Snigdha Mukherjee Rashmi Vyas William Burdick Using a theory of change for evaluation: has the FAIMER international faculty development program improved the field of health professions education? MedEdPublish International Faculty Development Program Health Professions Education Theory of Change Program Evaluation |
author_facet |
Shiyao Yuan Snigdha Mukherjee Rashmi Vyas William Burdick |
author_sort |
Shiyao Yuan |
title |
Using a theory of change for evaluation: has the FAIMER international faculty development program improved the field of health professions education? |
title_short |
Using a theory of change for evaluation: has the FAIMER international faculty development program improved the field of health professions education? |
title_full |
Using a theory of change for evaluation: has the FAIMER international faculty development program improved the field of health professions education? |
title_fullStr |
Using a theory of change for evaluation: has the FAIMER international faculty development program improved the field of health professions education? |
title_full_unstemmed |
Using a theory of change for evaluation: has the FAIMER international faculty development program improved the field of health professions education? |
title_sort |
using a theory of change for evaluation: has the faimer international faculty development program improved the field of health professions education? |
publisher |
Association for Medical Education in Europe (AMEE) |
series |
MedEdPublish |
issn |
2312-7996 |
publishDate |
2019-03-01 |
description |
Program theories have not been extensively used in evaluating faculty development programs in medical education. Ample evidence shows that a well-formulated program theory plays a pivotal role in program implementation and evaluation. Program theory links activities and expected outcomes using a logical process showing how they lead to long-term goals. It also develops appropriate metrics or indicators for assessing if those outcomes and activities really occurred. In this study, FAIMER's theory of change was adopted as a framework for evaluation. Survey data from FAIMER Fellows was used to assess the effectiveness of FAIMER's faculty development program in meeting the goal of improving health professions education. We used structural equation modeling to examine the association among outcomes mapped out in our theory of change and their association with improving field of health professions education. The study results indicated that FAIMER's faculty development program appeared to have positively influenced advancement of multiple facets of health professions education as envisaged in our theory of change. Using a theoretical framework for evaluating a program helped us identify the specific areas of outcomes that need to be strengthened for program improvement as well as provided us with a data-driven evaluation framework to measure program progress.
|
topic |
International Faculty Development Program Health Professions Education Theory of Change Program Evaluation |
url |
https://www.mededpublish.org/Manuscripts/2200 |
work_keys_str_mv |
AT shiyaoyuan usingatheoryofchangeforevaluationhasthefaimerinternationalfacultydevelopmentprogramimprovedthefieldofhealthprofessionseducation AT snigdhamukherjee usingatheoryofchangeforevaluationhasthefaimerinternationalfacultydevelopmentprogramimprovedthefieldofhealthprofessionseducation AT rashmivyas usingatheoryofchangeforevaluationhasthefaimerinternationalfacultydevelopmentprogramimprovedthefieldofhealthprofessionseducation AT williamburdick usingatheoryofchangeforevaluationhasthefaimerinternationalfacultydevelopmentprogramimprovedthefieldofhealthprofessionseducation |
_version_ |
1725078683180335104 |