The Partial Information Decomposition of Generative Neural Network Models
In this work we study the distributed representations learnt by generative neural network models. In particular, we investigate the properties of redundant and synergistic information that groups of hidden neurons contain about the target variable. To this end, we use an emerging branch of informati...
Main Authors: | Tycho M.S. Tax, Pedro A.M. Mediano, Murray Shanahan |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2017-09-01
|
Series: | Entropy |
Subjects: | |
Online Access: | https://www.mdpi.com/1099-4300/19/9/474 |
Similar Items
-
Quantifying Information Modification in Developing Neural Networks via Partial Information Decomposition
by: Michael Wibral, et al.
Published: (2017-09-01) -
Partial and Entropic Information Decompositions of a Neuronal Modulatory Interaction
by: Jim W. Kay, et al.
Published: (2017-10-01) -
Bivariate Partial Information Decomposition: The Optimization Perspective
by: Abdullah Makkeh, et al.
Published: (2017-10-01) -
Discovering Higher-Order Interactions Through Neural Information Decomposition
by: Kyle Reing, et al.
Published: (2021-01-01) -
Partial Information Decomposition and the Information Delta: A Geometric Unification Disentangling Non-Pairwise Information
by: James Kunert-Graf, et al.
Published: (2020-11-01)