research
∙
07/22/2023
Optimized Network Architectures for Large Language Model Training with Billions of Parameters
This paper challenges the well-established paradigm for building any-to-...
share
research
∙
02/07/2022
Optimal Direct-Connect Topologies for Collective Communications
We consider the problem of distilling optimal network topologies for col...
research
∙
02/01/2022
TopoOpt: Optimizing the Network Topology for Distributed DNN Training
We explore a novel approach for building DNN training clusters using com...
research
∙
11/18/2019
Distributed Low Precision Training Without Mixed Precision
Low precision training is one of the most popular strategies for deployi...
research
∙
04/30/2019
Segmentation is All You Need
We propose a new paradigm of the detection task that is anchor-box free ...
research
∙
04/22/2019