Robustness of meta-analysis results in Cochrane systematic reviews: A case for acupuncture trials

Background: Fragility index (FI) refers to the smallest value that change statistical significance of study results. Meta-analyses of Cochrane systematic reviews are considered as the best evidence for stake holders because they enable effect size estimation that cannot be derived by individual stud...

وصف كامل

التفاصيل البيبلوغرافية
الحاوية / القاعدة:Integrative Medicine Research
المؤلف الرئيسي: Jiyoon Won
التنسيق: مقال
اللغة:الإنجليزية
منشور في: Elsevier 2022-12-01
الموضوعات:
الوصول للمادة أونلاين:http://www.sciencedirect.com/science/article/pii/S2213422022000579
_version_ 1849456594436227072
author Jiyoon Won
author_facet Jiyoon Won
author_sort Jiyoon Won
collection DOAJ
container_title Integrative Medicine Research
description Background: Fragility index (FI) refers to the smallest value that change statistical significance of study results. Meta-analyses of Cochrane systematic reviews are considered as the best evidence for stake holders because they enable effect size estimation that cannot be derived by individual studies, particularly in the field of complementary and integrative medicine (CIM). Thus, this study aimed to evaluate robustness of meta-analysis in Cochrane systematic reviews of acupuncture, one of the most used CIM treatment, using FI of meta-analysis. Methods: Meta-analyses of acupuncture Cochrane systematic reviews with binary benefit outcome measures were searched in PubMed, Embase, and CENTRAL and subject to analysis. Randomized clinical trials (RCTs) or quasi RCTs adopted penetrating needles as treatment and compared with controls such as sham acupuncture, usual care, and active control were included. FI of meta-analyses was calculated in web (https://clinicalepidemio.fr/fragility_ma/); and fragility quotient (FQ) was calculated by dividing FI by total sample size of meta-analysis. Results: Of 248 retrieved studies, 12 Cochrane systematic reviews with 48 meta-analyses were analyzed. The median FI for statistically significant and non-significant meta-analyses was 7 [interquartile range: 3 - 12] and 6 [interquartile range: 3 - 10]. FQ was similar irrespective of statistical significance. Among controls, meta-analyses adopting sham acupuncture displayed the widest range of FI and FQ. Conclusion: Robustness of meta-analyses in Cochrane systematic reviews for acupuncture was similar irrespective of statistical significance. Impact of control intervention cannot be determined in this study. As FI enables intuitive interpretation, applications for CIM field can be useful.
format Article
id doaj-art-e8bc64b6c5f8481da249bb05341b0734
institution Directory of Open Access Journals
issn 2213-4220
language English
publishDate 2022-12-01
publisher Elsevier
record_format Article
spelling doaj-art-e8bc64b6c5f8481da249bb05341b07342025-08-20T03:24:47ZengElsevierIntegrative Medicine Research2213-42202022-12-0111410089010.1016/j.imr.2022.100890Robustness of meta-analysis results in Cochrane systematic reviews: A case for acupuncture trialsJiyoon Won0KM Science Research Division, Korea Institute of Oriental Medicine, Daejeon, 34054, Republic of KoreaBackground: Fragility index (FI) refers to the smallest value that change statistical significance of study results. Meta-analyses of Cochrane systematic reviews are considered as the best evidence for stake holders because they enable effect size estimation that cannot be derived by individual studies, particularly in the field of complementary and integrative medicine (CIM). Thus, this study aimed to evaluate robustness of meta-analysis in Cochrane systematic reviews of acupuncture, one of the most used CIM treatment, using FI of meta-analysis. Methods: Meta-analyses of acupuncture Cochrane systematic reviews with binary benefit outcome measures were searched in PubMed, Embase, and CENTRAL and subject to analysis. Randomized clinical trials (RCTs) or quasi RCTs adopted penetrating needles as treatment and compared with controls such as sham acupuncture, usual care, and active control were included. FI of meta-analyses was calculated in web (https://clinicalepidemio.fr/fragility_ma/); and fragility quotient (FQ) was calculated by dividing FI by total sample size of meta-analysis. Results: Of 248 retrieved studies, 12 Cochrane systematic reviews with 48 meta-analyses were analyzed. The median FI for statistically significant and non-significant meta-analyses was 7 [interquartile range: 3 - 12] and 6 [interquartile range: 3 - 10]. FQ was similar irrespective of statistical significance. Among controls, meta-analyses adopting sham acupuncture displayed the widest range of FI and FQ. Conclusion: Robustness of meta-analyses in Cochrane systematic reviews for acupuncture was similar irrespective of statistical significance. Impact of control intervention cannot be determined in this study. As FI enables intuitive interpretation, applications for CIM field can be useful.http://www.sciencedirect.com/science/article/pii/S2213422022000579Fragility indexCochrane systematic reviewMeta-analysisComplementary and integrative medicineAcupuncture
spellingShingle Jiyoon Won
Robustness of meta-analysis results in Cochrane systematic reviews: A case for acupuncture trials
Fragility index
Cochrane systematic review
Meta-analysis
Complementary and integrative medicine
Acupuncture
title Robustness of meta-analysis results in Cochrane systematic reviews: A case for acupuncture trials
title_full Robustness of meta-analysis results in Cochrane systematic reviews: A case for acupuncture trials
title_fullStr Robustness of meta-analysis results in Cochrane systematic reviews: A case for acupuncture trials
title_full_unstemmed Robustness of meta-analysis results in Cochrane systematic reviews: A case for acupuncture trials
title_short Robustness of meta-analysis results in Cochrane systematic reviews: A case for acupuncture trials
title_sort robustness of meta analysis results in cochrane systematic reviews a case for acupuncture trials
topic Fragility index
Cochrane systematic review
Meta-analysis
Complementary and integrative medicine
Acupuncture
url http://www.sciencedirect.com/science/article/pii/S2213422022000579
work_keys_str_mv AT jiyoonwon robustnessofmetaanalysisresultsincochranesystematicreviewsacaseforacupuncturetrials