research
∙
07/04/2023
On Conditional and Compositional Language Model Differentiable Prompting
Prompts have been shown to be an effective method to adapt a frozen Pret...
share
research
∙
06/15/2023
Block-State Transformer
State space models (SSMs) have shown impressive results on tasks that re...
research
∙
04/27/2023
JaxPruner: A concise library for sparsity research
This paper introduces JaxPruner, an open-source JAX-based pruning and sp...
research
∙
01/24/2023
Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction
Crosslingual conditional generation (e.g., machine translation) has long...
research
∙
10/14/2022
Using Graph Algorithms to Pretrain Graph Completion Transformers
Recent work on Graph Neural Networks has demonstrated that self-supervis...
research
∙
12/09/2021
Towards Neural Functional Program Evaluation
This paper explores the capabilities of current transformer-based langua...
research
∙
10/21/2020
Learning to Summarize Long Texts with Memory Compression and Transfer
We introduce Mem2Mem, a memory-to-memory mechanism for hierarchical recu...
research
∙
09/19/2020
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters Less Data
Multi-Task Learning (MTL) has emerged as a promising approach for transf...
research
∙
02/21/2020
On the impressive performance of randomly weighted encoders in summarization tasks
In this work, we investigate the performance of untrained randomly initi...
research
∙
09/07/2019