research
∙
09/03/2023
Implicit regularization of deep residual networks towards neural ODEs
Residual neural networks are state-of-the-art deep learning models. Thei...
share
research
∙
02/02/2023
Fast, Differentiable and Sparse Top-k: a Convex Analysis Perspective
The top-k operator returns a k-sparse vector, where the non-zero values ...
research
∙
10/13/2022
Vision Transformers provably learn spatial structure
Vision Transformers (ViTs) have achieved comparable or superior performa...
research
∙
05/29/2022
Do Residual Neural Networks discretize Neural Ordinary Differential Equations?
Neural Ordinary Differential Equations (Neural ODEs) are the continuous ...
research
∙
10/22/2021
Sinkformers: Transformers with Doubly Stochastic Attention
Attention based models such as Transformers involve pairwise interaction...
research
∙
02/15/2021