Assessment Measure for Discriminability of Multi-Classification Markers

碩士 === 國立臺灣大學 === 數學研究所 === 99 === To evaluate overall discrimination capacity of a marker for multi-class classification tasks, the performance function is a natural assessment tool and fully provides the essential ingredients in receiver operating characteristic (ROC) analysis. The connection betw...

Full description

Bibliographic Details
Main Authors: Yun-Jhong Wu, 吳允中
Other Authors: Chin-Tsang Chiang
Format: Others
Language:en_US
Published: 2011
Online Access:http://ndltd.ncl.edu.tw/handle/80578359007768157229
Description
Summary:碩士 === 國立臺灣大學 === 數學研究所 === 99 === To evaluate overall discrimination capacity of a marker for multi-class classification tasks, the performance function is a natural assessment tool and fully provides the essential ingredients in receiver operating characteristic (ROC) analysis. The connection between admissible and utility classifiers facilitates illustrating the optimality of likelihood ratio scores as well as constructing a parameterized optimal ROC manifold. The manifolds supply a geometric characterization of the magnitude of separation among multiple classes. It is shown that the hypervolume under the optimal ROC manifold (HUM) is a well-defined and meaningful accuracy measure only in suitable ROC subspaces. Moreover, we provide a rigorous proof for the equality of HUM and its alternative form, the correctness probability, which is directly related to an explicit U-estimator. Our theoretical framework further allows more sophisticated modeling on performance of markers and helps practitioners examine the optimality of applied classification procedures.