Entropy Learning in Neural Network

In this paper, entropy term is used in the learning phase of a neural network.  As learning progresses, more hidden nodes get into saturation.  The early creation of such hidden nodes may impair generalisation.  Hence entropy approach is proposed to dampen the early creation of such nodes.  The entr...

Full description

Bibliographic Details
Main Authors: Geok See Ng, D. Shi, A. Wahab, H. Singh
Format: Article
Language:English
Published: Universitas Gadjah Mada 2017-12-01
Series:ASEAN Journal on Science and Technology for Development
Online Access:http://www.ajstd.org/index.php/ajstd/article/view/362