Effect Heterogeneity in Responding to Performance-Based Incentives: A Quasi-Experimental Comparison of Impacts on Health Service Indicators Between Hospitals and Health Centers in Malawi

• Main Authors: Stephan Brenner, Rachel P. Chase, Shannon A. McMahon, Julia Lohmann, Christopher J. Makwero, Adamson S. Muula, Manuela De Allegri
• Format: Article
• Language: English
• Published: Taylor & Francis Group 2020-12-01
• Series: Health Systems & Reform
• Subjects: performance-based incentives; impact evaluation; effect heterogeneity; quality of care; health facility
• Online Access: http://dx.doi.org/10.1080/23288604.2020.1745580
• ISSN: 2328-8604; 2328-8620

Heterogeneity of effects produced by performance-based incentives (PBIs) at different levels of care provision is not well understood. This study analyzes effect heterogeneities between different facility types resulting from a PBI program in Malawi. Identical PBIs were applied to both district hospitals and health centers to improve the performance of essential health services provision. We conducted two complementary quasi-experiments comparing all 17 interventions with 17 matched independent control facilities (each 12 health centers, five hospitals). A pre- and post-test design with difference-in-differences analysis was used to estimate effects on 14 binary quality indicators; interrupted time series analysis of monthly routine data was used to estimate effects on 11 continuous quantity indicators. Effects were estimated separately for health centers and hospitals. Most quality indicators performed high at baseline, producing ceiling effects on further measurable improvements. Significant positive effects were observed for stocks of iron supplements (hospitals) and partographs (health centers). Four quantity indicators showed similar positive trend improvements across facility types (first-trimester antenatal visits, voluntary HIV-testing of couples, iron supplementation in pregnancy, vitamin A supplementation of children); two showed no change for either type of facility (skilled birth attendance, fully immunized one-year-olds); five indicators revealed different effect patterns for health centers and hospitals. In both health centers and hospitals, the largely positive PBI effects on antenatal care included resilience against interrupted supply chains and improvements in attendance rates. Observed heterogeneity might have been influenced by the availability of specific resources or the redistribution of service use.