research
∙
01/31/2023
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
We study the design decisions of publicly available instruction tuning m...
share
research
∙
01/30/2023
SingSong: Generating musical accompaniments from singing
We present SingSong, a system that generates instrumental music to accom...
research
∙
11/17/2022
VeLO: Training Versatile Learned Optimizers by Scaling Up
While deep learning models have replaced hand-designed features across m...
research
∙
11/15/2022
Large Language Models Struggle to Learn Long-Tail Knowledge
The internet contains a wealth of knowledge – from the birthdays of hist...
research
∙
03/31/2022
Scaling Up Models and Data with and
Recent neural network-based language models have benefited greatly from ...
research
∙
05/28/2021
ByT5: Towards a token-free future with pre-trained byte-to-byte models
Most widely-used pre-trained language models operate on sequences of tok...
research
∙
02/10/2020
How Much Knowledge Can You Pack Into the Parameters of a Language Model?
It has recently been observed that neural language models trained on uns...
research
∙
01/14/2020
DDSP: Differentiable Digital Signal Processing
Most generative models of audio directly generate samples in one of two ...
research
∙
03/18/2019
Counterpoint by Convolution
Machine learning models of music typically break up the task of composit...
research
∙
02/23/2019
GANSynth: Adversarial Neural Audio Synthesis
Efficient audio synthesis is an inherently difficult machine learning ta...
research
∙
10/30/2017
