The Weights Reset Technique for Deep Neural Networks Implicit Regularization

We present a new regularization method called Weights Reset, which includes periodically resetting a random portion of layer weights during the training process using predefined probability distributions. This technique was applied and tested on several popular classification datasets, Caltech-101,...

Full description

Bibliographic Details
Published in:	Computation
Main Authors:	Grigoriy Plusch, Sergey Arsenyev-Obraztsov, Olga Kochueva
Format:	Article
Language:	English
Published:	MDPI AG 2023-08-01
Subjects:	machine learning deep learning implicit regularization computer vision
Online Access:	https://www.mdpi.com/2079-3197/11/8/148

Similar Items

Preserved learning of implicit regularities with predictive social cues in older adults
by: Claudia Salera, et al.
Published: (2024-12-01)

Implicit Uniform Rational Spline Reconstruction Method With Regularization Term
by: Shenghan Huang
Published: (2024-01-01)

Implicit sequence learning in people with Parkinson’s disease
by: Katherine R Gamble, et al.
Published: (2014-08-01)

Can sign-naïve adults learn about the phonological regularities of an unfamiliar sign language from minimal exposure?
by: Chloe Marshall, et al.
Published: (2024-11-01)

KNOWLEDGE WITHOUT CONSCIOUSNESS: RESEARCHES OF IMPLICIT LEARNING
by: A. P. Kryukova
Published: (2016-11-01)

Enhancing Implicit Neural Representations With Transfer Learning
by: Euijune Lee, et al.
Published: (2025-01-01)

Implicit and Explicit Memory Factors in Cumulative Structural Priming
by: Timothy J. Kutta, et al.
Published: (2017-05-01)

Unit-Centric Regularization for Efficient Deep Neural Networks
by: Carles R. Riera Molina, et al.
Published: (2025-01-01)

Extracting Explicit and Implicit Aspects Using Deep Learning
by: Mikail Muhammad Azman Busst, et al.
Published: (2024-02-01)

Structure transfer and consolidation in visual implicit learning
by: Dominik Garber, et al.
Published: (2025-09-01)

Implicit sensorimotor learning in ballistic movement for transporting an object to a target
by: Naoyoshi Matsuda, et al.
Published: (2024-09-01)

A Hybrid Deep Implicit Neural Model for Sentiment Analysis via Transfer Learning
by: Kia Jahanbin, et al.
Published: (2024-01-01)

Errorless Practice to Facilitate Implicit Motor Learning in Children
by: Hamid Salehi, et al.
Published: (2018-12-01)

Effects of second language learning conditions along the implicit/explicit continuum: an extension of Ishikawa (2019)
by: Keiichi Ishikawa
Published: (2024-11-01)

Implicit and explicit learning of a sequential postural weight-shifting task in young and older adults
by: Simone eCaljouw, et al.
Published: (2016-05-01)

The Use of Hypermedia in Implicit Vocabulary Learning
by: Patrícia Nora de Souza
Published: (2011-07-01)

An Implicit Weighted Degree Condition For Heavy Cycles
by: Cai Junqing, et al.
Published: (2014-11-01)

Attenuation of implicit motor learning with consecutive exposure to visual errors
by: Naoyoshi Matsuda, et al.
Published: (2024-12-01)

Understanding implicit and explicit learning in adolescents with and without anorexia nervosa
by: Lot C. Sternheim, et al.
Published: (2021-06-01)

Influence of Mind Wandering and Increased Attentional Demands on Multitasking and Implicit Learning
by: Cameron G. Wittschen, et al.
Published: (2025-02-01)

Implicit Memory in Music and Language
by: Marc eEttlinger, et al.
Published: (2011-09-01)

The Effect of Implicit and Explicit Learning of Bimanual Coordination on Debilitating Behaviours in Autism
by: Benyamin Ghelichpoor, et al.
Published: (2020-02-01)

A semi-supervised deep learning algorithm combining consistency regularization and manifold regularization
by: Jie WANG, et al.
Published: (2022-05-01)

Consensus-Regularized Federated Learning for Superior Generalization in Wind Turbine Diagnostics
by: Lan Li, et al.
Published: (2025-08-01)

Effects of Implicit and Explicit Instruction on Learning Adjective Order
by: Shefali Elizabeth Mathew
Published: (2022-04-01)

The effects of prediction representations on implicit learning: Evidence from sentence reading and perceptual identification
by: Xuliu Ren, et al.
Published: (2024-11-01)

Neuronal Mesh Reconstruction from Image Stacks Using Implicit Neural Representations
by: Xiaoqiang Zhu, et al.
Published: (2025-04-01)

The Timing of Feedback and Learners’ Age on Implicit and Explicit Grammar Learning
by: Leila Ahmadpour, et al.
Published: (2019-02-01)

Deep Learning Using Context Vectors to Identify Implicit Aspects
by: Thuy Le Thi, et al.
Published: (2023-01-01)

Translational symmetry in convolutions with localized kernels causes an implicit bias toward high frequency adversarial examples
by: Josue O. Caro, et al.
Published: (2024-06-01)

The power of the cognitive unconscious: the case of implicit learning
by: Ελένη Ζιώρη
Published: (2023-12-01)

Interventions designed to reduce implicit prejudices and implicit stereotypes in real world contexts: a systematic review
by: Chloë FitzGerald, et al.
Published: (2019-05-01)

Treatment of agrammatism in oral and written production in patients with Broca’s aphasia The use of implicit and explicit learning
by: Marcela Lima Silagi, et al.
Published: (2020-06-01)

The influence of extinction and counterconditioning procedures on operant evaluative conditioning and intersecting regularity effects
by: Sean Hughes, et al.
Published: (2020-10-01)

A Three-Stage Algorithm Based on a Semi-Implicit Approach for Solving the Power-Flow in Realistic Large-Scale ill-Conditioned Systems
by: Marcos Tostado-Veliz, et al.
Published: (2020-01-01)

Implicit measure for yoga research: Yoga implicit association test
by: Judu V Ilavarasu, et al.
Published: (2014-01-01)

Implicit Solutions of the Electrical Impedance Tomography Inverse Problem in the Continuous Domain with Deep Neural Networks
by: Thilo Strauss, et al.
Published: (2023-03-01)

Comparison of the effects of explicit and implicit learning on the balance of the elderly
by: Parichehr Farhangiyan, et al.
Published: (2024-07-01)

The influence of articulatory suppression on the control of implicit sequence knowledge
by: Vinciane eGaillard, et al.
Published: (2012-07-01)

Numerical differentiation for two-dimensional scattered data on arbitrary domain base on Hermite extension with an implicit iteration process
by: Benxue Gong, et al.
Published: (2022-01-01)