BPCM: A Flexible High-Speed Bypass Parallel Communication Mechanism for GPU Cluster

With the increasing complexity of computational tasks faced by artificial intelligence technology, the scale of machine learning models continues to expand, and the data volume and frequency of parameter synchronization also increase. This will cause the communication bandwidth within the GPU cluste...

Full description

Bibliographic Details
Main Authors: Mingjie Wu, Qingkui Chen, Jingjuan Wang
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9104965/