Yury Zemlyanskiy | DeepAI

AI Chat

Featured Co-authors

Yi Tay
76 publications
Fei Sha
72 publications
William W. Cohen
61 publications
Tao Lei
34 publications
Santiago Ontañón
32 publications
Joshua Ainslie
25 publications
Panupong Pasupat
21 publications
Luke Vilnis
17 publications
Peter Shaw
17 publications
Mandy Guo
17 publications
Siddhartha Brahma
15 publications

∙ 08/28/2023

MEMORY-VQ: Compression for Tractable Internet-Scale Memory

Retrieval augmentation is a powerful but expensive method to make langua...

0 Yury Zemlyanskiy, et al. ∙

∙ 06/17/2023

GLIMMER: generalized late-interaction memory reranker

Memory-augmentation is a powerful approach for efficiently incorporating...

0 Michiel de Jong, et al. ∙

∙ 05/22/2023

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

Multi-query attention (MQA), which only uses a single key-value head, dr...

0 Joshua Ainslie, et al. ∙

∙ 03/17/2023

CoLT5: Faster Long-Range Transformers with Conditional Computation

Many natural language processing tasks benefit from long inputs, but pro...

0 Joshua Ainslie, et al. ∙

∙ 01/25/2023

Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute

Retrieval-augmented language models such as Fusion-in-Decoder are powerf...

0 Michiel de Jong, et al. ∙

∙ 12/15/2022

FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference

Fusion-in-Decoder (FiD) is a powerful retrieval-augmented language model...

0 Michiel de Jong, et al. ∙

∙ 10/18/2022

Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models

Decoding methods for large language models often trade-off between diver...

0 Luke Vilnis, et al. ∙

∙ 09/29/2022

Generate-and-Retrieve: use your predictions to improve retrieval for semantic parsing

A common recent approach to semantic parsing augments sequence-to-sequen...

0 Yury Zemlyanskiy, et al. ∙

∙ 10/12/2021

Mention Memory: incorporating textual knowledge into Transformers through entity mention attention

Natural language understanding tasks such as open-domain question answer...

0 Michiel de Jong, et al. ∙

∙ 05/10/2021

ReadTwice: Reading Very Large Documents with Memories

Knowledge-intensive tasks such as question answering often require assim...

0 Yury Zemlyanskiy, et al. ∙

∙ 02/26/2021

DOCENT: Learning Self-Supervised Entity Representations from Large Document Collections

This paper explores learning rich self-supervised entity representations...

19 Yury Zemlyanskiy, et al. ∙

∙ 08/21/2018

Aiming to Know You Better Perhaps Makes Me a More Engaging Dialogue Partner

There have been several attempts to define a plausible motivation for a ...

4 Yury Zemlyanskiy, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world