Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activations

This article concerns the expressive power of depth in neural nets with ReLU activations and a bounded width. We are particularly interested in the following questions: What is the minimal width <inline-formula> <math display="inline"> <semantics> <mrow> <msub>...

Full description

Bibliographic Details
Main Author: Boris Hanin
Format: Article
Language:English
Published: MDPI AG 2019-10-01
Series:Mathematics
Subjects:
Online Access:https://www.mdpi.com/2227-7390/7/10/992