Jacob Devlin | DeepAI

AI Chat

Featured Co-authors

Dhruv Batra
141 publications
Honglak Lee
129 publications
Devi Parikh
115 publications
Xiaodong He
101 publications
Pushmeet Kohli
93 publications
Hao Cheng
85 publications
Yi Tay
76 publications
Orhan Firat
68 publications
Ross Girshick
67 publications
Jiatao Gu
61 publications
Charles Sutton
54 publications

∙ 11/09/2022

Efficiently Scaling Transformer Inference

We study the problem of efficient generative inference for Transformer m...

0 Reiner Pope, et al. ∙

∙ 04/05/2022

PaLM: Scaling Language Modeling with Pathways

Large language models have been shown to achieve remarkable performance ...

6 Aakanksha Chowdhery, et al. ∙

∙ 06/18/2019

Zero-Shot Entity Linking by Reading Entity Descriptions

We present the zero-shot entity linking task, where mentions must be lin...

0 Lajanugen Logeswaran, et al. ∙

∙ 06/12/2019

Synthetic QA Corpora Generation with Roundtrip Consistency

We introduce a novel method of generating synthetic question answering c...

0 Chris Alberti, et al. ∙

∙ 01/26/2019

Language Model Pre-training for Hierarchical Document Representations

Hierarchical neural architectures are often used to capture long-distanc...

0 Ming-Wei Chang, et al. ∙

∙ 10/11/2018

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

We introduce a new language representation model called BERT, which stan...

0 Jacob Devlin, et al. ∙

∙ 05/11/2018

Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis

Program synthesis is the task of automatically generating a program cons...

0 Rudy Bunel, et al. ∙

∙ 02/15/2018

Universal Neural Machine Translation for Extremely Low Resource Languages

In this paper, we propose a new universal machine translation approach f...

0 Jiatao Gu, et al. ∙

∙ 10/30/2017

Semantic Code Repair using Neuro-Symbolic Transformation Networks

We study the problem of semantic code repair, which can be broadly defin...

0 Jacob Devlin, et al. ∙

∙ 10/11/2017

Neural Program Meta-Induction

Most recently proposed methods for Neural Program Induction work under t...

0 Jacob Devlin, et al. ∙

∙ 05/04/2017

Sharp Models on Dull Hardware: Fast and Accurate Neural Machine Translation Decoding on the CPU

Attentional sequence-to-sequence models have become the new standard for...

0 Jacob Devlin, et al. ∙

∙ 04/13/2016

Visual Storytelling

We introduce the first dataset for sequential vision-to-language, and ex...

0 Ting-Hao, et al. ∙

∙ 03/19/2016

Generating Natural Questions About an Image

There has been an explosion of work in the vision & language community d...

0 Nasrin Mostafazadeh, et al. ∙

∙ 11/03/2015

Detecting Interrogative Utterances with Recurrent Neural Networks

In this paper, we explore different neural network architectures that ca...

0 Junyoung Chung, et al. ∙

∙ 06/23/2015

A Survey of Current Datasets for Vision and Language Research

Integrating vision and language has long been a dream in work on artific...

0 Francis Ferraro, et al. ∙

∙ 05/07/2015

Language Models for Image Captioning: The Quirks and What Works

Two recent approaches have achieved state-of-the-art results in image ca...

0 Jacob Devlin, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world