Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - An update.

<h4>Objective</h4>To systematically review methods developed and employed to evaluate the diagnostic accuracy of medical test when there is a missing or no gold standard.<h4>Study design and settings</h4>Articles that proposed or applied any methods to evaluate the diagnostic...

Full description

Bibliographic Details
Main Authors: Chinyereugo M Umemneku Chikere, Kevin Wilson, Sara Graziadio, Luke Vale, A Joy Allen
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2019-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0223832
id doaj-07b09a69fda84081969cc0cf6e6ddfdc
record_format Article
spelling doaj-07b09a69fda84081969cc0cf6e6ddfdc2021-03-04T10:23:38ZengPublic Library of Science (PLoS)PLoS ONE1932-62032019-01-011410e022383210.1371/journal.pone.0223832Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - An update.Chinyereugo M Umemneku ChikereKevin WilsonSara GraziadioLuke ValeA Joy Allen<h4>Objective</h4>To systematically review methods developed and employed to evaluate the diagnostic accuracy of medical test when there is a missing or no gold standard.<h4>Study design and settings</h4>Articles that proposed or applied any methods to evaluate the diagnostic accuracy of medical test(s) in the absence of gold standard were reviewed. The protocol for this review was registered in PROSPERO (CRD42018089349).<h4>Results</h4>Identified methods were classified into four main groups: methods employed when there is a missing gold standard; correction methods (which make adjustment for an imperfect reference standard with known diagnostic accuracy measures); methods employed to evaluate a medical test using multiple imperfect reference standards; and other methods, like agreement studies, and a mixed group of alternative study designs. Fifty-one statistical methods were identified from the review that were developed to evaluate medical test(s) when the true disease status of some participants is unverified with the gold standard. Seven correction methods were identified and four methods were identified to evaluate medical test(s) using multiple imperfect reference standards. Flow-diagrams were developed to guide the selection of appropriate methods.<h4>Conclusion</h4>Various methods have been proposed to evaluate medical test(s) in the absence of a gold standard for some or all participants in a diagnostic accuracy study. These methods depend on the availability of the gold standard, its' application to the participants in the study and the availability of alternative reference standard(s). The clinical application of some of these methods, especially methods developed when there is missing gold standard is however limited. This may be due to the complexity of these methods and/or a disconnection between the fields of expertise of those who develop (e.g. mathematicians) and those who employ the methods (e.g. clinical researchers). This review aims to help close this gap with our classification and guidance tools.https://doi.org/10.1371/journal.pone.0223832
collection DOAJ
language English
format Article
sources DOAJ
author Chinyereugo M Umemneku Chikere
Kevin Wilson
Sara Graziadio
Luke Vale
A Joy Allen
spellingShingle Chinyereugo M Umemneku Chikere
Kevin Wilson
Sara Graziadio
Luke Vale
A Joy Allen
Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - An update.
PLoS ONE
author_facet Chinyereugo M Umemneku Chikere
Kevin Wilson
Sara Graziadio
Luke Vale
A Joy Allen
author_sort Chinyereugo M Umemneku Chikere
title Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - An update.
title_short Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - An update.
title_full Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - An update.
title_fullStr Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - An update.
title_full_unstemmed Diagnostic test evaluation methodology: A systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - An update.
title_sort diagnostic test evaluation methodology: a systematic review of methods employed to evaluate diagnostic tests in the absence of gold standard - an update.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2019-01-01
description <h4>Objective</h4>To systematically review methods developed and employed to evaluate the diagnostic accuracy of medical test when there is a missing or no gold standard.<h4>Study design and settings</h4>Articles that proposed or applied any methods to evaluate the diagnostic accuracy of medical test(s) in the absence of gold standard were reviewed. The protocol for this review was registered in PROSPERO (CRD42018089349).<h4>Results</h4>Identified methods were classified into four main groups: methods employed when there is a missing gold standard; correction methods (which make adjustment for an imperfect reference standard with known diagnostic accuracy measures); methods employed to evaluate a medical test using multiple imperfect reference standards; and other methods, like agreement studies, and a mixed group of alternative study designs. Fifty-one statistical methods were identified from the review that were developed to evaluate medical test(s) when the true disease status of some participants is unverified with the gold standard. Seven correction methods were identified and four methods were identified to evaluate medical test(s) using multiple imperfect reference standards. Flow-diagrams were developed to guide the selection of appropriate methods.<h4>Conclusion</h4>Various methods have been proposed to evaluate medical test(s) in the absence of a gold standard for some or all participants in a diagnostic accuracy study. These methods depend on the availability of the gold standard, its' application to the participants in the study and the availability of alternative reference standard(s). The clinical application of some of these methods, especially methods developed when there is missing gold standard is however limited. This may be due to the complexity of these methods and/or a disconnection between the fields of expertise of those who develop (e.g. mathematicians) and those who employ the methods (e.g. clinical researchers). This review aims to help close this gap with our classification and guidance tools.
url https://doi.org/10.1371/journal.pone.0223832
work_keys_str_mv AT chinyereugomumemnekuchikere diagnostictestevaluationmethodologyasystematicreviewofmethodsemployedtoevaluatediagnostictestsintheabsenceofgoldstandardanupdate
AT kevinwilson diagnostictestevaluationmethodologyasystematicreviewofmethodsemployedtoevaluatediagnostictestsintheabsenceofgoldstandardanupdate
AT saragraziadio diagnostictestevaluationmethodologyasystematicreviewofmethodsemployedtoevaluatediagnostictestsintheabsenceofgoldstandardanupdate
AT lukevale diagnostictestevaluationmethodologyasystematicreviewofmethodsemployedtoevaluatediagnostictestsintheabsenceofgoldstandardanupdate
AT ajoyallen diagnostictestevaluationmethodologyasystematicreviewofmethodsemployedtoevaluatediagnostictestsintheabsenceofgoldstandardanupdate
_version_ 1714806271939444736