Two-sided exponential concentration bounds for Bayes error rate and Shannon entropy

We provide a method that approximates the Bayes error rate and the Shannon entropy with high probability. The Bayes error rate approximation makes possible to build a classifier that polynomially approaches Bayes error rate. The Shannon entropy approximation provides provable performance guarantees...

Full description

Bibliographic Details
Main Authors: Honorio, Jean (Contributor), Jaakkola, Tommi S. (Contributor)
Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory (Contributor), Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science (Contributor)
Format: Article
Language:English
Published: Association for Computing Machinery (ACM), 2015-12-18T13:51:02Z.
Subjects:
Online Access:Get fulltext