Fast and Unbiased Estimation of Volume Under Ordered Three-Class ROC Surface (VUS) With Continuous or Discrete Measurements
Receiver Operating Characteristic (ROC) surfaces have been studied in the literature essentially during the last decade and are considered as a natural generalization of ROC curves in three-class problems. The volume under the surface (VUS) is useful for evaluating the performance of a trichotomous...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9146132/ |
id |
doaj-70a928c587ef4c09b531b657a30193db |
---|---|
record_format |
Article |
spelling |
doaj-70a928c587ef4c09b531b657a30193db2021-03-30T03:23:46ZengIEEEIEEE Access2169-35362020-01-01813620613622210.1109/ACCESS.2020.30111599146132Fast and Unbiased Estimation of Volume Under Ordered Three-Class ROC Surface (VUS) With Continuous or Discrete MeasurementsShun Liu0https://orcid.org/0000-0002-8751-7509Hongbin Zhu1Kai Yi2Xu Sun3Weichao Xu4https://orcid.org/0000-0001-6516-0927Chao Wang5https://orcid.org/0000-0002-0454-8079School of Automation, Guangdong University of Technology, Guangzhou, ChinaSchool of Automation, Guangdong University of Technology, Guangzhou, ChinaMediaTek Inc., Shenzhen, ChinaBaidu, Inc., Beijing, ChinaSchool of Automation, Guangdong University of Technology, Guangzhou, ChinaSchool of Engineering and Digital Arts, University of Kent, Canterbury, U.K.Receiver Operating Characteristic (ROC) surfaces have been studied in the literature essentially during the last decade and are considered as a natural generalization of ROC curves in three-class problems. The volume under the surface (VUS) is useful for evaluating the performance of a trichotomous diagnostic system or a three-class classifier's overall accuracy when the possible disease condition or sample belongs to one of three ordered categories. In the areas of medical studies and machine learning, the VUS of a new statistical model is typically estimated through a sample of ordinal and continuous measurements obtained by some suitable specimens. However, discrete scales of the prediction are also frequently encountered in practice. To deal with such scenario, in this paper, we proposed a unified and efficient algorithm of linearithmic order, based on dynamic programming, for unbiased estimation of the mean and variance of VUS with unidimensional samples drawn from continuous or non-continuous distributions. Monte Carlo simulations verify our theoretical findings and developed algorithms.https://ieeexplore.ieee.org/document/9146132/Volume under the surface (VUS)variancediscrete measurementsdynamic programmingreceiver operating characteristic (ROC) |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Shun Liu Hongbin Zhu Kai Yi Xu Sun Weichao Xu Chao Wang |
spellingShingle |
Shun Liu Hongbin Zhu Kai Yi Xu Sun Weichao Xu Chao Wang Fast and Unbiased Estimation of Volume Under Ordered Three-Class ROC Surface (VUS) With Continuous or Discrete Measurements IEEE Access Volume under the surface (VUS) variance discrete measurements dynamic programming receiver operating characteristic (ROC) |
author_facet |
Shun Liu Hongbin Zhu Kai Yi Xu Sun Weichao Xu Chao Wang |
author_sort |
Shun Liu |
title |
Fast and Unbiased Estimation of Volume Under Ordered Three-Class ROC Surface (VUS) With Continuous or Discrete Measurements |
title_short |
Fast and Unbiased Estimation of Volume Under Ordered Three-Class ROC Surface (VUS) With Continuous or Discrete Measurements |
title_full |
Fast and Unbiased Estimation of Volume Under Ordered Three-Class ROC Surface (VUS) With Continuous or Discrete Measurements |
title_fullStr |
Fast and Unbiased Estimation of Volume Under Ordered Three-Class ROC Surface (VUS) With Continuous or Discrete Measurements |
title_full_unstemmed |
Fast and Unbiased Estimation of Volume Under Ordered Three-Class ROC Surface (VUS) With Continuous or Discrete Measurements |
title_sort |
fast and unbiased estimation of volume under ordered three-class roc surface (vus) with continuous or discrete measurements |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
Receiver Operating Characteristic (ROC) surfaces have been studied in the literature essentially during the last decade and are considered as a natural generalization of ROC curves in three-class problems. The volume under the surface (VUS) is useful for evaluating the performance of a trichotomous diagnostic system or a three-class classifier's overall accuracy when the possible disease condition or sample belongs to one of three ordered categories. In the areas of medical studies and machine learning, the VUS of a new statistical model is typically estimated through a sample of ordinal and continuous measurements obtained by some suitable specimens. However, discrete scales of the prediction are also frequently encountered in practice. To deal with such scenario, in this paper, we proposed a unified and efficient algorithm of linearithmic order, based on dynamic programming, for unbiased estimation of the mean and variance of VUS with unidimensional samples drawn from continuous or non-continuous distributions. Monte Carlo simulations verify our theoretical findings and developed algorithms. |
topic |
Volume under the surface (VUS) variance discrete measurements dynamic programming receiver operating characteristic (ROC) |
url |
https://ieeexplore.ieee.org/document/9146132/ |
work_keys_str_mv |
AT shunliu fastandunbiasedestimationofvolumeunderorderedthreeclassrocsurfacevuswithcontinuousordiscretemeasurements AT hongbinzhu fastandunbiasedestimationofvolumeunderorderedthreeclassrocsurfacevuswithcontinuousordiscretemeasurements AT kaiyi fastandunbiasedestimationofvolumeunderorderedthreeclassrocsurfacevuswithcontinuousordiscretemeasurements AT xusun fastandunbiasedestimationofvolumeunderorderedthreeclassrocsurfacevuswithcontinuousordiscretemeasurements AT weichaoxu fastandunbiasedestimationofvolumeunderorderedthreeclassrocsurfacevuswithcontinuousordiscretemeasurements AT chaowang fastandunbiasedestimationofvolumeunderorderedthreeclassrocsurfacevuswithcontinuousordiscretemeasurements |
_version_ |
1724183525379276800 |