research
∙
08/14/2023
CausalLM is not optimal for in-context learning
Recent empirical evidence indicates that transformer based in-context le...
share
research
∙
06/06/2023
Evaluating the Potential of Disaggregated Memory Systems for HPC applications
Disaggregated memory is a promising approach that addresses the limitati...
research
∙
11/22/2022
Improving Robust Generalization by Direct PAC-Bayesian Bound Minimization
Recent research in robust optimization has shown an overfitting-like phe...
research
∙
09/14/2022
PaLI: A Jointly-Scaled Multilingual Language-Image Model
Effective scaling and a flexible task interface enable large language mo...
research
∙
05/04/2022
All You May Need for VQA are Image Captions
Visual Question Answering (VQA) has benefited from increasingly sophisti...
research
∙
03/10/2022
PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Tasks
With the increasing abundance of pretrained models in recent years, the ...
research
∙
05/28/2021
Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learning
Despite recent advances in its theoretical understanding, there still re...
research
∙
02/23/2021
Do Transformer Modifications Transfer Across Implementations and Applications?
The research community has proposed copious modifications to the Transfo...
research
∙
02/17/2021
Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts
The availability of large-scale image captioning and visual question ans...
research
∙
10/13/2020
Improving Text Generation Evaluation with Batch Centering and Tempered Word Mover Distance
Recent advances in automatic evaluation metrics for text have shown that...
research
∙
10/07/2020
TeaForN: Teacher-Forcing with N-grams
Sequence generation models trained with teacher-forcing suffer from issu...
research
∙
09/29/2020
Attention that does not Explain Away
Models based on the Transformer architecture have achieved better accura...
research
∙
03/05/2020
Talking-Heads Attention
We introduce "talking-heads attention" - a variation on multi-head atten...
research
∙
02/12/2020
LOGAN: High-Performance GPU-Based X-Drop Long-Read Alignment
Pairwise sequence alignment is one of the most computationally intensive...
research
∙
02/07/2020
iqiyi Submission to ActivityNet Challenge 2019 Kinetics-700 challenge: Hierarchical Group-wise Attention
In this report, the method for the iqiyi submission to the task of Activ...
research
∙
04/11/2018
SHAPED: Shared-Private Encoder-Decoder for Text Style Adaptation
Supervised training of abstractive language generation models results in...
research
∙
12/22/2016
Understanding Image and Text Simultaneously: a Dual Vision-Language Machine Comprehension Task
We introduce a new multi-modal task for computer systems, posed as a com...
research
∙
12/14/2016
Multilingual Word Embeddings using Multigraphs
We present a family of neural-network--inspired models for computing con...
research
∙
12/13/2016
Building Large Machine Reading-Comprehension Datasets using Paragraph Vectors
We present a dual contribution to the task of machine reading-comprehens...
research
∙
10/21/2016
On the Convergence of Stochastic Gradient MCMC Algorithms with High-Order Integrators
Recent advances in Bayesian learning with large-scale data have witnesse...
research
∙
10/21/2016
Stochastic Gradient MCMC with Stale Gradients
Stochastic gradient MCMC (SG-MCMC) has played an important role in large...
research
∙
06/18/2012
Dependent Hierarchical Normalized Random Measures for Dynamic Topic Modeling
We develop dependent hierarchical normalized random measures and apply t...
research
∙
05/18/2012