Family-Reported Experiences Evaluation (FREE) study: a mixed-methods study to evaluate families’ satisfaction with adult critical care services in the NHS
Background: To improve care it is necessary to feed back experiences of those receiving care. Of patients admitted to intensive care units (ICUs), approximately one-quarter die, and few survivors recollect their experiences, so family members have a vital role. The most widely validated tool to seek...
Main Authors: | , , , , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
NIHR Journals Library
2015-12-01
|
Series: | Health Services and Delivery Research |
Online Access: | https://doi.org/10.3310/hsdr03450 |
id |
doaj-91f3a7c7889c47de9d516ccaec3c561d |
---|---|
record_format |
Article |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Stephen E Wright Emma Walmsley Sheila E Harvey Emily Robinson Paloma Ferrando-Vivas David A Harrison Ruth R Canter Elaine McColl Annette Richardson Michael Richardson Lisa Hinton Daren K Heyland Kathryn M Rowan |
spellingShingle |
Stephen E Wright Emma Walmsley Sheila E Harvey Emily Robinson Paloma Ferrando-Vivas David A Harrison Ruth R Canter Elaine McColl Annette Richardson Michael Richardson Lisa Hinton Daren K Heyland Kathryn M Rowan Family-Reported Experiences Evaluation (FREE) study: a mixed-methods study to evaluate families’ satisfaction with adult critical care services in the NHS Health Services and Delivery Research |
author_facet |
Stephen E Wright Emma Walmsley Sheila E Harvey Emily Robinson Paloma Ferrando-Vivas David A Harrison Ruth R Canter Elaine McColl Annette Richardson Michael Richardson Lisa Hinton Daren K Heyland Kathryn M Rowan |
author_sort |
Stephen E Wright |
title |
Family-Reported Experiences Evaluation (FREE) study: a mixed-methods study to evaluate families’ satisfaction with adult critical care services in the NHS |
title_short |
Family-Reported Experiences Evaluation (FREE) study: a mixed-methods study to evaluate families’ satisfaction with adult critical care services in the NHS |
title_full |
Family-Reported Experiences Evaluation (FREE) study: a mixed-methods study to evaluate families’ satisfaction with adult critical care services in the NHS |
title_fullStr |
Family-Reported Experiences Evaluation (FREE) study: a mixed-methods study to evaluate families’ satisfaction with adult critical care services in the NHS |
title_full_unstemmed |
Family-Reported Experiences Evaluation (FREE) study: a mixed-methods study to evaluate families’ satisfaction with adult critical care services in the NHS |
title_sort |
family-reported experiences evaluation (free) study: a mixed-methods study to evaluate families’ satisfaction with adult critical care services in the nhs |
publisher |
NIHR Journals Library |
series |
Health Services and Delivery Research |
issn |
2050-4349 2050-4357 |
publishDate |
2015-12-01 |
description |
Background: To improve care it is necessary to feed back experiences of those receiving care. Of patients admitted to intensive care units (ICUs), approximately one-quarter die, and few survivors recollect their experiences, so family members have a vital role. The most widely validated tool to seek their views is the Family Satisfaction in the Intensive Care Unit questionnaire (FS-ICU). Objectives: To test face and content validity and comprehensibility of the FS-ICU (phase 1). To establish internal consistency, construct validity and reliability of the FS-ICU; to describe family satisfaction and explore how it varies by family member, patient, unit/hospital and other contextual factors and by country; and to model approaches to sampling for future use in quality improvement (phase 2). Design: Mixed methods: qualitative study (phase 1) and cohort study (phase 2). Setting: NHS ICUs (n = 2, phase 1; n = 20, phase 2). Participants: Health-care professionals, ex-patients, family members of ICU patients (n = 41, phase 1). Family members of ICU patients (n = 12,303, phase 2). Interventions: None. Main outcome measures: Key themes regarding each item of the 24-item FS-ICU (FS-ICU-24) (phase 1). Overall family satisfaction and domain scores of the FS-ICU-24 (phase 2). Results: In phase 1, face validity, content validity and comprehensibility were good. Adaptation to the UK required only minor edits. In phase 2, one to four family members were recruited for 60.6% of 10,530 patients (staying in ICU for 24 hours or more). Of 12,303 family members, 7173 (58.3%) completed the questionnaire. Psychometric assessment of the questionnaire established high internal consistency and criterion validity. Exploratory factor analysis indicated new domains: satisfaction with care, satisfaction with information and satisfaction with the decision-making process. All scores were high with skewed distributions towards more positive scores. For family members of ICU survivors, factors associated with increased/decreased satisfaction were age, ethnicity, relationship to patient, and visit frequency, and patient factors were acute severity of illness and invasive ventilation. For family members of ICU non-survivors, average satisfaction was higher but no family member factors were associated with increased/decreased satisfaction; patient factors were age, acute severity of illness and duration of stay. Neither ICU/hospital factors nor seasonality were associated. Funnel plots confirmed significant variation in family satisfaction across ICUs. Adjusting for family member and patient characteristics reduced variation, resulting in fewer ICUs identified as potential outliers. Simulations suggested that family satisfaction surveys using short recruitment windows can produce relatively unbiased estimates of average family satisfaction. Conclusions: The Family-Reported Experiences Evaluation study has provided a UK-adapted, psychometrically valid questionnaire for overall family satisfaction and three domains. The large sample size allowed for robust multilevel multivariable modelling of factors associated with family satisfaction to inform important adjustment of any future evaluation. Limitations: Responses to three free-text questions indicate the questionnaire may not be sensitive to all aspects of family satisfaction. Future work: Reservations remain about the current questionnaire. While formal analysis of the free-text questions did not form part of this proposal, brief analysis suggested considerable scope for improvement of the FS-ICU-24. Study registration: Current Controlled Trials ISRCTN47363549. Funding details: The National Institute for Health Research Health Services and Delivery Research programme. |
url |
https://doi.org/10.3310/hsdr03450 |
work_keys_str_mv |
AT stephenewright familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT emmawalmsley familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT sheilaeharvey familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT emilyrobinson familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT palomaferrandovivas familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT davidaharrison familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT ruthrcanter familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT elainemccoll familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT annetterichardson familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT michaelrichardson familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT lisahinton familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT darenkheyland familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs AT kathrynmrowan familyreportedexperiencesevaluationfreestudyamixedmethodsstudytoevaluatefamiliessatisfactionwithadultcriticalcareservicesinthenhs |
_version_ |
1725967621222825984 |
spelling |
doaj-91f3a7c7889c47de9d516ccaec3c561d2020-11-24T21:29:04ZengNIHR Journals LibraryHealth Services and Delivery Research2050-43492050-43572015-12-0134510.3310/hsdr0345011/2003/56Family-Reported Experiences Evaluation (FREE) study: a mixed-methods study to evaluate families’ satisfaction with adult critical care services in the NHSStephen E Wright0Emma Walmsley1Sheila E Harvey2Emily Robinson3Paloma Ferrando-Vivas4David A Harrison5Ruth R Canter6Elaine McColl7Annette Richardson8Michael Richardson9Lisa Hinton10Daren K Heyland11Kathryn M Rowan12Freeman Hospital, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UKClinical Trials Unit, Intensive Care National Audit & Research Centre (ICNARC), London, UKClinical Trials Unit, Intensive Care National Audit & Research Centre (ICNARC), London, UKClinical Trials Unit, Intensive Care National Audit & Research Centre (ICNARC), London, UKClinical Trials Unit, Intensive Care National Audit & Research Centre (ICNARC), London, UKClinical Trials Unit, Intensive Care National Audit & Research Centre (ICNARC), London, UKClinical Trials Unit, Intensive Care National Audit & Research Centre (ICNARC), London, UKNewcastle Clinical Trials Unit, Institute of Health and Society, Newcastle University, Newcastle upon Tyne, UKFreeman Hospital, Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UKMichael Richardson & Partners, Newcastle upon Tyne, UKHealth Experiences Research Group, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UKClinical Evaluation Research Unit, Kingston General Hospital, Kingston, ON, CanadaClinical Trials Unit, Intensive Care National Audit & Research Centre (ICNARC), London, UKBackground: To improve care it is necessary to feed back experiences of those receiving care. Of patients admitted to intensive care units (ICUs), approximately one-quarter die, and few survivors recollect their experiences, so family members have a vital role. The most widely validated tool to seek their views is the Family Satisfaction in the Intensive Care Unit questionnaire (FS-ICU). Objectives: To test face and content validity and comprehensibility of the FS-ICU (phase 1). To establish internal consistency, construct validity and reliability of the FS-ICU; to describe family satisfaction and explore how it varies by family member, patient, unit/hospital and other contextual factors and by country; and to model approaches to sampling for future use in quality improvement (phase 2). Design: Mixed methods: qualitative study (phase 1) and cohort study (phase 2). Setting: NHS ICUs (n = 2, phase 1; n = 20, phase 2). Participants: Health-care professionals, ex-patients, family members of ICU patients (n = 41, phase 1). Family members of ICU patients (n = 12,303, phase 2). Interventions: None. Main outcome measures: Key themes regarding each item of the 24-item FS-ICU (FS-ICU-24) (phase 1). Overall family satisfaction and domain scores of the FS-ICU-24 (phase 2). Results: In phase 1, face validity, content validity and comprehensibility were good. Adaptation to the UK required only minor edits. In phase 2, one to four family members were recruited for 60.6% of 10,530 patients (staying in ICU for 24 hours or more). Of 12,303 family members, 7173 (58.3%) completed the questionnaire. Psychometric assessment of the questionnaire established high internal consistency and criterion validity. Exploratory factor analysis indicated new domains: satisfaction with care, satisfaction with information and satisfaction with the decision-making process. All scores were high with skewed distributions towards more positive scores. For family members of ICU survivors, factors associated with increased/decreased satisfaction were age, ethnicity, relationship to patient, and visit frequency, and patient factors were acute severity of illness and invasive ventilation. For family members of ICU non-survivors, average satisfaction was higher but no family member factors were associated with increased/decreased satisfaction; patient factors were age, acute severity of illness and duration of stay. Neither ICU/hospital factors nor seasonality were associated. Funnel plots confirmed significant variation in family satisfaction across ICUs. Adjusting for family member and patient characteristics reduced variation, resulting in fewer ICUs identified as potential outliers. Simulations suggested that family satisfaction surveys using short recruitment windows can produce relatively unbiased estimates of average family satisfaction. Conclusions: The Family-Reported Experiences Evaluation study has provided a UK-adapted, psychometrically valid questionnaire for overall family satisfaction and three domains. The large sample size allowed for robust multilevel multivariable modelling of factors associated with family satisfaction to inform important adjustment of any future evaluation. Limitations: Responses to three free-text questions indicate the questionnaire may not be sensitive to all aspects of family satisfaction. Future work: Reservations remain about the current questionnaire. While formal analysis of the free-text questions did not form part of this proposal, brief analysis suggested considerable scope for improvement of the FS-ICU-24. Study registration: Current Controlled Trials ISRCTN47363549. Funding details: The National Institute for Health Research Health Services and Delivery Research programme.https://doi.org/10.3310/hsdr03450 |