The Improvement Readiness scale of the SCORE survey: a metric to assess capacity for quality improvement in healthcare

Abstract Background Quality improvement efforts are inextricably linked to the readiness of healthcare workers to take them on. The current study aims to clarify the nature and measurement of Improvement Readiness (IR) by 1) examining the psychometric properties of a novel IR scale, 2) assessing rel...

Full description

Bibliographic Details
Main Authors: Kathryn C. Adair, Krystina Quow, Allan Frankel, Paul J. Mosca, Jochen Profit, Allison Hadley, Michael Leonard, J. Bryan Sexton
Format: Article
Language:English
Published: BMC 2018-12-01
Series:BMC Health Services Research
Subjects:
Online Access:http://link.springer.com/article/10.1186/s12913-018-3743-0
id doaj-1eb62f05d3464594ad73eb36dc218363
record_format Article
spelling doaj-1eb62f05d3464594ad73eb36dc2183632020-11-25T02:56:06ZengBMCBMC Health Services Research1472-69632018-12-0118111010.1186/s12913-018-3743-0The Improvement Readiness scale of the SCORE survey: a metric to assess capacity for quality improvement in healthcareKathryn C. Adair0Krystina Quow1Allan Frankel2Paul J. Mosca3Jochen Profit4Allison Hadley5Michael Leonard6J. Bryan Sexton7Duke Patient Safety Center, Duke University Health SystemDuke University School of Medicine, Duke University Health SystemSafe and Reliable HealthcareDuke Network Services, Duke University Health SystemDivision of Neonatal Developmental Medicine, Department of Pediatrics, Stanford UniversityDivision of Pediatric Critical Care Medicine, Department of Pediatrics, Duke Children’s Hospital and Health CenterSafe and Reliable HealthcareDuke Patient Safety Center, Duke University Health SystemAbstract Background Quality improvement efforts are inextricably linked to the readiness of healthcare workers to take them on. The current study aims to clarify the nature and measurement of Improvement Readiness (IR) by 1) examining the psychometric properties of a novel IR scale, 2) assessing relationships between IR and other safety culture domains 3) exploring whether IR differs by healthcare worker demographic factors, and 4) examining linguistic differences in word type use between high and low scoring IR work settings from their free text responses. Methods Of 13,040 eligible healthcare workers across a large academic health system, 10,627 (response rate 81%) completed the 5-item IR scale, demographics, safety culture scales, and two open-ended questions. Psychometric analyses, correlations and ANOVAs tested the properties of IR. Linguistic Inquiry Word Count software assessed comments from open-ended questions. Results The IR scale exhibited strong psychometric properties and a one factor model fit the data well (Cronbach’s alpha = .93; RMSEA = .07; CFI = 99; TLI = .99). IR scores differed significantly by role, shift, shift length, and years in specialty. IR correlated significantly and in expected directions with safety culture scales. Linguistic analyses revealed that people in low versus high IR work settings used significantly more words in their responses, and specifically more past tense verbs (e.g., “ignored”), negative emotion words (e.g., “upset”), and first person singular (“I”). Workers from high IR work settings used significantly more positive emotions words (e.g., “grateful”) and social words (e.g., “team”). Conclusion The IR scale exhibits strong psychometric properties, is associated with better safety and teamwork climate, lower burnout, and predicts linguistic differences in high versus low IR groups.http://link.springer.com/article/10.1186/s12913-018-3743-0Improvement readinessSCORE, quality improvementQualitative responsesLearning environmentSafety culture survey
collection DOAJ
language English
format Article
sources DOAJ
author Kathryn C. Adair
Krystina Quow
Allan Frankel
Paul J. Mosca
Jochen Profit
Allison Hadley
Michael Leonard
J. Bryan Sexton
spellingShingle Kathryn C. Adair
Krystina Quow
Allan Frankel
Paul J. Mosca
Jochen Profit
Allison Hadley
Michael Leonard
J. Bryan Sexton
The Improvement Readiness scale of the SCORE survey: a metric to assess capacity for quality improvement in healthcare
BMC Health Services Research
Improvement readiness
SCORE, quality improvement
Qualitative responses
Learning environment
Safety culture survey
author_facet Kathryn C. Adair
Krystina Quow
Allan Frankel
Paul J. Mosca
Jochen Profit
Allison Hadley
Michael Leonard
J. Bryan Sexton
author_sort Kathryn C. Adair
title The Improvement Readiness scale of the SCORE survey: a metric to assess capacity for quality improvement in healthcare
title_short The Improvement Readiness scale of the SCORE survey: a metric to assess capacity for quality improvement in healthcare
title_full The Improvement Readiness scale of the SCORE survey: a metric to assess capacity for quality improvement in healthcare
title_fullStr The Improvement Readiness scale of the SCORE survey: a metric to assess capacity for quality improvement in healthcare
title_full_unstemmed The Improvement Readiness scale of the SCORE survey: a metric to assess capacity for quality improvement in healthcare
title_sort improvement readiness scale of the score survey: a metric to assess capacity for quality improvement in healthcare
publisher BMC
series BMC Health Services Research
issn 1472-6963
publishDate 2018-12-01
description Abstract Background Quality improvement efforts are inextricably linked to the readiness of healthcare workers to take them on. The current study aims to clarify the nature and measurement of Improvement Readiness (IR) by 1) examining the psychometric properties of a novel IR scale, 2) assessing relationships between IR and other safety culture domains 3) exploring whether IR differs by healthcare worker demographic factors, and 4) examining linguistic differences in word type use between high and low scoring IR work settings from their free text responses. Methods Of 13,040 eligible healthcare workers across a large academic health system, 10,627 (response rate 81%) completed the 5-item IR scale, demographics, safety culture scales, and two open-ended questions. Psychometric analyses, correlations and ANOVAs tested the properties of IR. Linguistic Inquiry Word Count software assessed comments from open-ended questions. Results The IR scale exhibited strong psychometric properties and a one factor model fit the data well (Cronbach’s alpha = .93; RMSEA = .07; CFI = 99; TLI = .99). IR scores differed significantly by role, shift, shift length, and years in specialty. IR correlated significantly and in expected directions with safety culture scales. Linguistic analyses revealed that people in low versus high IR work settings used significantly more words in their responses, and specifically more past tense verbs (e.g., “ignored”), negative emotion words (e.g., “upset”), and first person singular (“I”). Workers from high IR work settings used significantly more positive emotions words (e.g., “grateful”) and social words (e.g., “team”). Conclusion The IR scale exhibits strong psychometric properties, is associated with better safety and teamwork climate, lower burnout, and predicts linguistic differences in high versus low IR groups.
topic Improvement readiness
SCORE, quality improvement
Qualitative responses
Learning environment
Safety culture survey
url http://link.springer.com/article/10.1186/s12913-018-3743-0
work_keys_str_mv AT kathryncadair theimprovementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT krystinaquow theimprovementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT allanfrankel theimprovementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT pauljmosca theimprovementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT jochenprofit theimprovementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT allisonhadley theimprovementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT michaelleonard theimprovementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT jbryansexton theimprovementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT kathryncadair improvementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT krystinaquow improvementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT allanfrankel improvementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT pauljmosca improvementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT jochenprofit improvementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT allisonhadley improvementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT michaelleonard improvementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
AT jbryansexton improvementreadinessscaleofthescoresurveyametrictoassesscapacityforqualityimprovementinhealthcare
_version_ 1724714183116718080