research
∙
03/12/2020
Efficient Content-Based Sparse Attention with Routing Transformers
Self-attention has recently been adopted for a wide range of sequence mo...
share
research
∙
06/13/2019
Stand-Alone Self-Attention in Vision Models
Convolutions are a fundamental building block of modern computer vision ...
research
∙
09/12/2018
An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation
Music relies heavily on self-reference to build structure and meaning. W...
research
∙
02/15/2018
Image Transformer
Image generation has been successfully cast as an autoregressive sequenc...
research
∙
06/12/2017
