Padding Load:Load Reducing Cluster Resource Waste and Deep Learning Training Costs

In recent years,large-scale models have achieved remarkable success in multiple domains such as bioinformatics,natural language processing,and computer vision.However,these models often require substantial computational resources during the training and inference stages,resulting in considerable com...

Full description

Bibliographic Details

Published in:	Jisuanji kexue
Main Author:	DU Yu, YU Zishu, PENG Xiaohui, XU Zhiwei
Format:	Article
Language:	Chinese
Published:	Editorial office of Computer Science 2024-09-01
Subjects:	deep learning|distributed training|resource utilization|computing cluster|programming framework
Online Access:	https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2024-51-9-71.pdf