Examining the Causal Structures of Deep Neural Networks Using Information Theory

Deep Neural Networks (DNNs) are often examined at the level of their response to input, such as analyzing the mutual information between nodes and data sets. Yet DNNs can also be examined at the level of causation, exploring “what does what” within the layers of the network itself. Historically, ana...

Full description

Bibliographic Details
Main Authors: Scythia Marrow, Eric J. Michaud, Erik Hoel
Format: Article
Language:English
Published: MDPI AG 2020-12-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/22/12/1429