Philip Pham | DeepAI

Chat Image Generator Video Music Voice Chat Photo Editor

Featured Co-authors

Manzil Zaheer
12 publications
Sebastian Ruder
12 publications
Mostafa Dehghani
11 publications
Yi Tay
9 publications
Liu Yang
7 publications
Qifan Wang
6 publications
Dara Bahri
5 publications
Donald Metzler
5 publications
Joshua Ainslie
4 publications
Guru Guruganesh
4 publications
Chris Alberti
3 publications

research

∙ 11/08/2020

Long Range Arena: A Benchmark for Efficient Transformers

Transformers do not scale very well to long sequence lengths largely bec...

5 Yi Tay, et al. ∙

research

∙ 07/28/2020

Big Bird: Transformers for Longer Sequences

Transformers-based models, such as BERT, have been one of the most succe...

73 Manzil Zaheer, et al. ∙

Success!

An error occurred