Learnability for the Information Bottleneck

The Information Bottleneck (IB) method provides an insightful and principled approach for balancing compression and prediction for representation learning. The IB objective I ( X ; Z ) - β I ( Y ; Z ) employs a Lagrange multiplier β to tune this trade-off. However, in practice, not only is β chosen...

Full description

Bibliographic Details
Main Authors: Wu, Tailin (Author), Fischer, Ian (Author), Chuang, Isaac L. (Author), Tegmark, Max Erik (Author)
Other Authors: Massachusetts Institute of Technology. Department of Physics (Contributor)
Format: Article
Language:English
Published: MDPI AG, 2020-07-02T16:14:43Z.
Subjects:
Online Access:Get fulltext