research
∙
06/05/2022
E^2VTS: Energy-Efficient Video Text Spotting from Unmanned Aerial Vehicles
Unmanned Aerial Vehicles (UAVs) based video text spotting has been exten...
share
research
∙
06/11/2021
DouZero: Mastering DouDizhu with Self-Play Deep Reinforcement Learning
Games are abstractions of the real world, where artificial agents learn ...
research
∙
02/04/2021
1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed
Scalable training of large models (like BERT and GPT-3) requires careful...
research
∙
08/26/2020
APMSqueeze: A Communication Efficient Adam-Preconditioned Momentum SGD Algorithm
Adam is the important optimization algorithm to guarantee efficiency and...
research
∙
03/09/2020
Stochastic Recursive Momentum for Policy Gradient Methods
In this paper, we propose a novel algorithm named STOchastic Recursive M...
research
∙
12/31/2019
Stochastic Recursive Variance Reduction for Efficient Smooth Non-Convex Compositional Optimization
Stochastic compositional optimization arises in many important machine l...
research
∙
07/17/2019
DeepSqueeze: Decentralization Meets Error-Compensated Compression
Communication is a key bottleneck in distributed training. Recently, an ...
research
∙
07/17/2019
DeepSqueeze: Parallel Stochastic Gradient Descent with Double-Pass Error-Compensated Compression
Communication is a key bottleneck in distributed training. Recently, an ...
research
∙
05/15/2019
DoubleSqueeze: Parallel Stochastic Gradient Descent with Double-Pass Error-Compensated Compression
A standard approach in large scale machine learning is distributed stoch...
research
∙
10/15/2018
Revisit Batch Normalization: New Understanding from an Optimization View and a Refinement via Composition Optimization
Batch Normalization (BN) has been used extensively in deep learning to a...
research
∙
03/19/2018
D^2: Decentralized Training over Decentralized Data
While training a machine learning model using multiple workers, each of ...
research
∙
10/18/2017
Asynchronous Decentralized Parallel Stochastic Gradient Descent
Recent work shows that decentralized parallel stochastic gradient decent...
research
∙
05/25/2017
Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descent
Most distributed machine learning systems nowadays, including TensorFlow...
research
∙
06/27/2015