
First Place Solution of KDD Cup 2021 OGB LargeScale Challenge GraphLevel Track
In this technical report, we present our solution of KDD Cup 2021 OGB La...
read it

Do Transformers Really Perform Bad for Graph Representation?
The Transformer architecture has become a dominant choice in many domain...
read it

Towards a Theoretical Framework of OutofDistribution Generalization
Generalization to outofdistribution (OOD) data, or domain generalizati...
read it

A Theory of Label Propagation for Subpopulation Shift
One of the central problems in machine learning is domain adaptation. Un...
read it

Towards Certifying ℓ_∞ Robustness using Neural Networks with ℓ_∞dist Neurons
It is wellknown that standard neural networks, even with a high classif...
read it

SanityChecking Pruning Methods: Random Tickets can Win the Jackpot
Network pruning is a method for reducing testtime computational resourc...
read it

GraphNorm: A Principled Approach to Accelerating Graph Neural Network Training
Normalization plays an important role in the optimization of deep neural...
read it

RANDOM MASK: Towards Robust Convolutional Neural Networks
Robustness of neural networks has recently been highlighted by the adver...
read it

Locally Differentially Private (Contextual) Bandits Learning
We study locally differentially private (LDP) bandits learning in this p...
read it

Defective Convolutional Layers Learn Robust CNNs
Robustness of convolutional neural networks has recently been highlighte...
read it

Convergence of Adversarial Training in Overparametrized Networks
Neural networks are vulnerable to adversarial examples, i.e. inputs that...
read it

Adversarially Robust Generalization Just Requires More Unlabeled Data
Neural network robustness has recently been highlighted by the existence...
read it

A GramGaussNewton Method Learning Overparameterized Deep Neural Networks for Regression Problems
Firstorder methods such as stochastic gradient descent (SGD) are curren...
read it
Tianle Cai
is this you? claim profile