LDD: High-Precision Training of Deep Spiking Neural Network Transformers Guided by an Artificial Neural Network

The rise of large-scale Transformers has led to challenges regarding computational costs and energy consumption. In this context, spiking neural networks (SNNs) offer potential solutions due to their energy efficiency and processing speed. However, the inaccuracy of surrogate gradients and feature s...

Full description

Bibliographic Details

Published in:	Biomimetics
Main Authors:	Yuqian Liu, Chujie Zhao, Yizhou Jiang, Ying Fang, Feng Chen
Format:	Article
Language:	English
Published:	MDPI AG 2024-07-01
Subjects:	spiking neural networks (SNNs) Transformer distillation image classification
Online Access:	https://www.mdpi.com/2313-7673/9/7/413