Relevance of Latency in Ethernet Networking for AI Infrastructure
Conference: ECOC 2024 - 50th European Conference on Optical Communication
09/22/2024 - 09/26/2024 at Frankfurt, Germany
Proceedings: ITG-Fb. 317: ECOC 2024
Pages: 4Language: englishTyp: PDF
Authors:
Mi, Guangcan; He, Xiang; Zheng, Xiaolong
Abstract:
We broke down the Ethernet link latency, investigated its impact to AI training time by simulating an 8192-server AI cluster network, showing less than 0.01% performance degradation for 20 mus of added link latency. The result was verified in a real-world testbed.