Efficient knowledge distillation for hybrid models: A vision transformer‐convolutional neural network to convolutional neural network approach for classifying remote sensing images

Abstract In various fields, knowledge distillation (KD) techniques that combine vision transformers (ViTs) and convolutional neural networks (CNNs) as a hybrid teacher have shown remarkable results in classification. However, in the realm of remote sensing images (RSIs), existing KD research studies...

Full description

Bibliographic Details

Published in:	IET Cyber-systems and Robotics
Main Authors:	Huaxiang Song, Yuxuan Yuan, Zhiwei Ouyang, Yu Yang, Hui Xiang
Format:	Article
Language:	English
Published:	Wiley 2024-09-01
Subjects:	hybrid‐model knowledge distillation remote sensing image classification vision transformer
Online Access:	https://doi.org/10.1049/csy2.12120