research
∙
02/22/2023
A critical look at the evaluation of GNNs under heterophily: are we really making progress?
Node classification is a classical graph representation learning task on...
share
research
∙
01/27/2023
SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient
Many deep learning applications benefit from using large models with bil...
research
∙
07/07/2022
Training Transformers Together
The infrastructure necessary for training state-of-the-art models is bec...
research
∙
06/21/2021
Secure Distributed Training at Scale
Some of the hardest problems in deep learning can be solved with the com...
research
∙
06/18/2021