research
∙
05/22/2023
Rethinking Machine Learning Collective Communication as a Multi-Commodity Flow Problem
We show communication schedulers' recent work proposed for ML collective...
share
research
∙
05/22/2023
A Framework for Fine-Grained Synchronization of Dependent GPU Kernels
Machine Learning (ML) models contain highly-parallel computations, such ...
research
∙
01/21/2023
SuperScaler: Supporting Flexible DNN Parallelization via a Unified Abstraction
With the growing model size, deep neural networks (DNN) are increasingly...
research
∙
10/21/2022
Optimal Pose Estimation and Covariance Analysis with Simultaneous Localization and Mapping Applications
This work provides a theoretical analysis for optimally solving the pose...
research
∙
10/21/2022
Error-Covariance Analysis of Monocular Pose Estimation Using Total Least Squares
This study presents a theoretical structure for the monocular pose estim...
research
∙
01/27/2022
GC3: An Optimizing Compiler for GPU Collective Communication
Machine learning models made up of millions or billions of parameters ar...
research
∙
11/08/2021
Synthesizing Collective Communication Algorithms for Heterogeneous Networks with TACCL
Large ML models and datasets have necessitated the use of multi-GPU syst...
research
∙
06/22/2021
Total Least Squares for Optimal Pose Estimation
This work provides a theoretical framework for the pose estimation probl...
research
∙
05/12/2021
Breaking the Computation and Communication Abstraction Barrier in Distributed Machine Learning Workloads
Recent trend towards increasing large machine learning models require bo...
research
∙
08/19/2020
Synthesizing Optimal Collective Algorithms
Collective communication algorithms are an important component of distri...
research
∙
06/04/2020
Scaling Distributed Training with Adaptive Summation
Stochastic gradient descent (SGD) is an inherently sequential training a...
research
∙
09/08/2019
Distributed Word2Vec using Graph Analytics Frameworks
Word embeddings capture semantic and syntactic similarities of words, re...
research
∙
10/01/2018
CHET: Compiler and Runtime for Homomorphic Evaluation of Tensor Programs
Fully Homomorphic Encryption (FHE) refers to a set of encryption schemes...
research
∙
05/22/2017