Gradient Descent Effects on Differential Neural Architecture Search: A Survey

Gradient Descent, an effective way to search for the local minimum of a function, can minimize training and validation loss of neural architectures and also be incited in an appropriate order to decrease the searching cost of neural architecture search. In recent trends, the neural architecture sear...

Full description

Bibliographic Details
Main Authors: Santanu Santra, Jun-Wei Hsieh, Chi-Fang Lin
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9461192/