Preparing Deep Belief Networks for Practical Tasks

• Main Authors: Lu, LiWei, 盧立偉
• Other Authors: Dr. N. Michael, Mayer
• Format: Others
• Language: en_US
• Published: 2012
• Online Access: http://ndltd.ncl.edu.tw/handle/68415284452640040030

碩士 === 國立中正大學 === 電機工程研究所 === 100 === Deep Belief Networks (DBNs) is a probabilistic generative models composed of multiple layers of stochastic, latent variables. multiple layers of stochastic, latent variables. The network can learn many layers of features on various type of data such as binary images, gray scaled images, color images and acoustic data. This paper further examined the ability of DBNs to interpret the binary representation of data. The performance is validated by learning given distributions such as normal distribution, Poisson distribution and random number generator. We have shown that Deep Believe Networks can successfully learn the probability distribution with binary encoded dataset. With this property, we can further extend DBNs into states or properties prediction application, we will provide an example showing that DBNs can take multiple binary encoded parameters as input vector and predict the belonging category of these input. Generally, the sensory input of DBNs contains information belong to a certain timestep, that is, the prediction depends only on the current input. However, in some practical tasks, prediction often depend not only on the current state but also the history of states. We propose a method combining DBNs with Echo State Networks(ESNs), using the properties of ESNs’ reservoir, a type of Recurrent Neural Networks, to encoded the history of previous states in which gives us an idea of artificial dreaming.