Study of Sensitivity to Weight Perturbation for Convolution Neural Network

Exploring underlying properties of a neural network contributes to pursuing its internal behavior and functionality. For convolution neural networks (CNNs), a sensitivity measure to weight perturbation is introduced in this paper to reflect the extent of the network output variation, which could eva...

全面介紹

書目詳細資料
發表在:IEEE Access
Main Authors: Lin Xiang, Xiaoqin Zeng, Yuhu Niu, Yanjun Liu
格式: Article
語言:英语
出版: IEEE 2019-01-01
主題:
在線閱讀:https://ieeexplore.ieee.org/document/8755296/
實物特徵
總結:Exploring underlying properties of a neural network contributes to pursuing its internal behavior and functionality. For convolution neural networks (CNNs), a sensitivity measure to weight perturbation is introduced in this paper to reflect the extent of the network output variation, which could evaluate the effect of the weights on the network. The sensitivity is defined as the mathematical expectation of absolute output variation due to weight perturbation with respect to all possible inputs. Assuming that the conditional distribution of input obeys the normal, the sensitivity is iteratively computed layer to layer until the entire network. Without loss of generality, the paper proposes an approximate algorithm to compute a theoretical sensitivity, which is actually a function of mapping between the network's output variation and its weight perturbation. The experimental results demonstrate the coincidence of the computed theoretical sensitivity with the simulated actual output variation of the network. Thus a criterion can be established to evaluate the influence of weights on CNNs' output.
ISSN:2169-3536