research
∙
05/26/2023
Training Socially Aligned Language Models in Simulated Human Society
Social alignment in AI systems aims to ensure that these models behave a...
share
research
∙
02/17/2023
Massively Multilingual Shallow Fusion with Large Language Models
While large language models (LLM) have made impressive progress in natur...
research
∙
10/11/2022
Mind's Eye: Grounded Language Model Reasoning through Simulation
Successful and effective communication between humans and AI relies on a...
research
∙
04/05/2022
PaLM: Scaling Language Modeling with Pathways
Large language models have been shown to achieve remarkable performance ...
research
∙
12/14/2021
Co-training Transformer with Videos and Images Improves Action Recognition
In learning action recognition, models are typically pre-trained on obje...
research
∙
12/13/2021
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Scaling language models with more data, compute and parameters has drive...
research
∙
09/03/2021
Finetuned Language Models Are Zero-Shot Learners
This paper explores a simple method for improving the zero-shot learning...
research
∙
07/17/2021
BEDS-Bench: Behavior of EHR-models under Distributional Shift–A Benchmark
Machine learning has recently demonstrated impressive progress in predic...
research
∙
02/03/2021
MUFASA: Multimodal Fusion Architecture Search for Electronic Health Records
One important challenge of applying deep learning to electronic health r...
research
∙
10/22/2020
Learnability and Complexity of Quantum Samples
Given a quantum circuit, a quantum computer can sample the output distri...
research
∙
10/13/2020
Training independent subnetworks for robust prediction
Recent approaches to efficiently ensemble neural networks have shown tha...
research
∙
07/10/2020
Learning Unstable Dynamical Systems with Time-Weighted Logarithmic Loss
When training the parameters of a linear dynamical model, the gradient d...
research
∙
12/02/2019
Flow Contrastive Estimation of Energy-Based Models
This paper studies a training method to jointly estimate an energy-based...
research
∙
11/14/2019
Modelling EHR timeseries by restricting feature interaction
Time series data are prevalent in electronic health records, mostly in t...
research
∙
11/13/2019
Federated and Differentially Private Learning for Electronic Health Records
The use of collaborative and decentralized machine learning techniques s...
research
∙
10/24/2019
Capacity, Bandwidth, and Compositionality in Emergent Language Learning
Many recent works have discussed the propensity, or lack thereof, for em...
research
∙
09/20/2019
Learning an Adaptive Learning Rate Schedule
The learning rate is one of the most important hyper-parameters for mode...
research
∙
09/06/2019
Improved Patient Classification with Language Model Pretraining Over Clinical Notes
Clinical notes in electronic health records contain highly heterogeneous...
research
∙
06/11/2019
Graph Convolutional Transformer: Learning the Graphical Structure of Electronic Health Records
Effective modeling of electronic health records (EHR) is rapidly becomin...
research
∙
06/10/2019
Analyzing the Role of Model Uncertainty for Electronic Health Records
In medicine, both ethical and monetary costs of incorrect predictions ca...
research
∙
09/12/2018
An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation
Music relies heavily on self-reference to build structure and meaning. W...
research
∙
09/12/2018
Music Transformer
Music relies heavily on repetition to build structure and meaning. Self-...
research
∙
08/20/2018
Peptide-Spectra Matching from Weak Supervision
As in many other scientific domains, we face a fundamental problem when ...
research
∙
06/12/2018
Embedding Text in Hyperbolic Spaces
Natural language text exhibits hierarchical structure in a variety of re...
research
∙
03/01/2018
Learning Longer-term Dependencies in RNNs with Auxiliary Losses
Despite recent advances in training recurrent neural networks (RNNs), ca...
research
∙
01/24/2018
Scalable and accurate deep learning for electronic health records
Predictive modeling with electronic health record (EHR) data is anticipa...
research
∙
01/23/2018
MaskGAN: Better Text Generation via Filling in the ______
Neural text generation models are often autoregressive language models o...
research
∙
10/23/2017
Many Paths to Equilibrium: GANs Do Not Need to Decrease a Divergence At Every Step
Generative adversarial networks (GANs) are a family of generative models...
research
∙
03/26/2017
Who Said What: Modeling Individual Labelers Improves Classification
Data are often labeled by many different experts with each expert only l...
research
∙
05/25/2016
Adversarial Training Methods for Semi-Supervised Text Classification
Adversarial training provides a means of regularizing supervised learnin...
research
∙
11/19/2015
Generating Sentences from a Continuous Space
The standard recurrent neural network language model (RNNLM) generates s...
research
∙
11/04/2015
Semi-supervised Sequence Learning
We present two approaches that use unlabeled data to improve sequence le...
research
∙
07/29/2015
Document Embedding with Paragraph Vectors
Paragraph Vectors has been recently proposed as an unsupervised method f...
research
∙
12/17/2014