An administrative model for benchmarking hospitals on their 30-day sepsis mortality

Abstract Background Given the increased attention to sepsis at the population level there is a need to assess hospital performance in the care of sepsis patients using widely-available administrative data. The goal of this study was to develop an administrative risk-adjustment model suitable for pro...

Full description

Bibliographic Details
Main Authors: Jennifer L. Darby, Billie S. Davis, Ian J. Barbash, Jeremy M. Kahn
Format: Article
Language:English
Published: BMC 2019-04-01
Series:BMC Health Services Research
Subjects:
Online Access:http://link.springer.com/article/10.1186/s12913-019-4037-x
id doaj-ba245f133993450c947524f3d34f132e
record_format Article
spelling doaj-ba245f133993450c947524f3d34f132e2020-11-25T04:04:34ZengBMCBMC Health Services Research1472-69632019-04-011911910.1186/s12913-019-4037-xAn administrative model for benchmarking hospitals on their 30-day sepsis mortalityJennifer L. Darby0Billie S. Davis1Ian J. Barbash2Jeremy M. Kahn3CRISMA Center, Department of Critical Care Medicine, University of Pittsburgh School of MedicineCRISMA Center, Department of Critical Care Medicine, University of Pittsburgh School of MedicineCRISMA Center, Department of Critical Care Medicine, University of Pittsburgh School of MedicineCRISMA Center, Department of Critical Care Medicine, University of Pittsburgh School of MedicineAbstract Background Given the increased attention to sepsis at the population level there is a need to assess hospital performance in the care of sepsis patients using widely-available administrative data. The goal of this study was to develop an administrative risk-adjustment model suitable for profiling hospitals on their 30-day mortality rates for patients with sepsis. Methods We conducted a retrospective cohort study using hospital discharge data from general acute care hospitals in Pennsylvania in 2012 and 2013. We identified adult patients with sepsis as determined by validated diagnosis and procedure codes. We developed an administrative risk-adjustment model in 2012 data. We then validated this model in two ways: by examining the stability of performance assessments over time between 2012 and 2013, and by examining the stability of performance assessments in 2012 after the addition of laboratory variables measured on day one of hospital admission. Results In 2012 there were 115,213 sepsis encounters in 152 hospitals. The overall unadjusted mortality rate was 18.5%. The final risk-adjustment model had good discrimination (C-statistic = 0.78) and calibration (slope and intercept of the calibration curve = 0.960 and 0.007, respectively). Based on this model, hospital-specific risk-standardized mortality rates ranged from 12.2 to 24.5%. Comparing performance assessments between years, correlation in risk-adjusted mortality rates was good (Pearson’s correlation = 0.53) and only 19.7% of hospitals changed by more than one quintile in performance rankings. Comparing performance assessments after the addition of laboratory variables, correlation in risk-adjusted mortality rates was excellent (Pearson’s correlation = 0.93) and only 2.6% of hospitals changed by more than one quintile in performance rankings. Conclusions A novel claims-based risk-adjustment model demonstrated wide variation in risk-standardized 30-day sepsis mortality rates across hospitals. Individual hospitals’ performance rankings were stable across years and after the addition of laboratory data. This model provides a robust way to rank hospitals on sepsis mortality while adjusting for patient risk.http://link.springer.com/article/10.1186/s12913-019-4037-xSepsisIntensive careCritical careMechanical ventilationPerformanceQuality
collection DOAJ
language English
format Article
sources DOAJ
author Jennifer L. Darby
Billie S. Davis
Ian J. Barbash
Jeremy M. Kahn
spellingShingle Jennifer L. Darby
Billie S. Davis
Ian J. Barbash
Jeremy M. Kahn
An administrative model for benchmarking hospitals on their 30-day sepsis mortality
BMC Health Services Research
Sepsis
Intensive care
Critical care
Mechanical ventilation
Performance
Quality
author_facet Jennifer L. Darby
Billie S. Davis
Ian J. Barbash
Jeremy M. Kahn
author_sort Jennifer L. Darby
title An administrative model for benchmarking hospitals on their 30-day sepsis mortality
title_short An administrative model for benchmarking hospitals on their 30-day sepsis mortality
title_full An administrative model for benchmarking hospitals on their 30-day sepsis mortality
title_fullStr An administrative model for benchmarking hospitals on their 30-day sepsis mortality
title_full_unstemmed An administrative model for benchmarking hospitals on their 30-day sepsis mortality
title_sort administrative model for benchmarking hospitals on their 30-day sepsis mortality
publisher BMC
series BMC Health Services Research
issn 1472-6963
publishDate 2019-04-01
description Abstract Background Given the increased attention to sepsis at the population level there is a need to assess hospital performance in the care of sepsis patients using widely-available administrative data. The goal of this study was to develop an administrative risk-adjustment model suitable for profiling hospitals on their 30-day mortality rates for patients with sepsis. Methods We conducted a retrospective cohort study using hospital discharge data from general acute care hospitals in Pennsylvania in 2012 and 2013. We identified adult patients with sepsis as determined by validated diagnosis and procedure codes. We developed an administrative risk-adjustment model in 2012 data. We then validated this model in two ways: by examining the stability of performance assessments over time between 2012 and 2013, and by examining the stability of performance assessments in 2012 after the addition of laboratory variables measured on day one of hospital admission. Results In 2012 there were 115,213 sepsis encounters in 152 hospitals. The overall unadjusted mortality rate was 18.5%. The final risk-adjustment model had good discrimination (C-statistic = 0.78) and calibration (slope and intercept of the calibration curve = 0.960 and 0.007, respectively). Based on this model, hospital-specific risk-standardized mortality rates ranged from 12.2 to 24.5%. Comparing performance assessments between years, correlation in risk-adjusted mortality rates was good (Pearson’s correlation = 0.53) and only 19.7% of hospitals changed by more than one quintile in performance rankings. Comparing performance assessments after the addition of laboratory variables, correlation in risk-adjusted mortality rates was excellent (Pearson’s correlation = 0.93) and only 2.6% of hospitals changed by more than one quintile in performance rankings. Conclusions A novel claims-based risk-adjustment model demonstrated wide variation in risk-standardized 30-day sepsis mortality rates across hospitals. Individual hospitals’ performance rankings were stable across years and after the addition of laboratory data. This model provides a robust way to rank hospitals on sepsis mortality while adjusting for patient risk.
topic Sepsis
Intensive care
Critical care
Mechanical ventilation
Performance
Quality
url http://link.springer.com/article/10.1186/s12913-019-4037-x
work_keys_str_mv AT jenniferldarby anadministrativemodelforbenchmarkinghospitalsontheir30daysepsismortality
AT billiesdavis anadministrativemodelforbenchmarkinghospitalsontheir30daysepsismortality
AT ianjbarbash anadministrativemodelforbenchmarkinghospitalsontheir30daysepsismortality
AT jeremymkahn anadministrativemodelforbenchmarkinghospitalsontheir30daysepsismortality
AT jenniferldarby administrativemodelforbenchmarkinghospitalsontheir30daysepsismortality
AT billiesdavis administrativemodelforbenchmarkinghospitalsontheir30daysepsismortality
AT ianjbarbash administrativemodelforbenchmarkinghospitalsontheir30daysepsismortality
AT jeremymkahn administrativemodelforbenchmarkinghospitalsontheir30daysepsismortality
_version_ 1724436102426656768