research
∙
09/14/2023
CoLLD: Contrastive Layer-to-layer Distillation for Compressing Multilingual Pre-trained Speech Encoders
Large-scale self-supervised pre-trained speech encoders outperform conve...
share
research
∙
08/22/2023
SeamlessM4T-Massively Multilingual Multimodal Machine Translation
What does it take to create the Babel Fish, a tool that can help individ...
research
∙
12/15/2022
UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Units
Direct speech-to-speech translation (S2ST), in which all components can ...
research
∙
11/11/2022
Speech-to-Speech Translation For A Real-world Unwritten Language
We study speech-to-speech translation (S2ST) that translates speech from...
research
∙
10/20/2021
SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training
Unsupervised pre-training is now the predominant approach for both text ...
research
∙
08/07/2021
W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training
Motivated by the success of masked language modeling (MLM) in pre-traini...
research
∙
02/02/2021
PSLA: Improving Audio Event Classification with Pretraining, Sampling, Labeling, and Aggregation
Audio event classification is an active research area and has a wide ran...
research
∙
11/01/2020
Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies
Self-supervised speech representations have been shown to be effective i...
research
∙
10/22/2020
Similarity Analysis of Self-Supervised Speech Representations
Self-supervised speech representation learning has recently been a prosp...
research
∙
10/05/2020
Semi-Supervised Speech-Language Joint Pre-Training for Spoken Language Understanding
Spoken language understanding (SLU) requires a model to analyze input ac...
research
∙
05/17/2020
Vector-Quantized Autoregressive Predictive Coding
Autoregressive Predictive Coding (APC), as a self-supervised objective, ...
research
∙
04/11/2020
Improved Speech Representations with Multi-Target Autoregressive Predictive Coding
Training objectives based on predictive coding have recently been shown ...
research
∙
02/29/2020
Clinical Text Summarization with Syntax-Based Negation and Semantic Concept Identification
In the era of clinical information explosion, a good strategy for clinic...
research
∙
10/23/2019
Generative Pre-Training for Speech with Autoregressive Predictive Coding
Learning meaningful and general representations from unannotated speech ...
research
∙
10/02/2019
SummAE: Zero-Shot Abstractive Text Summarization using Length-Agnostic Auto-Encoders
We propose an end-to-end neural model for zero-shot abstractive text sum...
research
∙
06/17/2019
Towards Transfer Learning for End-to-End Speech Synthesis from Deep Pre-Trained Language Models
Modern text-to-speech (TTS) systems are able to generate audio that soun...
research
∙
04/05/2019
An Unsupervised Autoregressive Model for Speech Representation Learning
This paper proposes a novel unsupervised autoregressive neural model for...
research
∙
02/04/2019
Unsupervised Clinical Language Translation
As patients' access to their doctors' clinical notes becomes common, tra...
research
∙
11/04/2018
Towards Unsupervised Speech-to-Text Translation
We present a framework for building speech-to-text translation (ST) syst...
research
∙
08/30/2018
Semi-Supervised Training for Improving Data Efficiency in End-to-End Speech Synthesis
Although end-to-end text-to-speech (TTS) models such as Tacotron have sh...
research
∙
05/18/2018
Unsupervised Cross-Modal Alignment of Speech and Text Embedding Spaces
Recent research has shown that word embedding spaces learned from text c...
research
∙
03/23/2018
Speech2Vec: A Sequence-to-Sequence Framework for Learning Word Embeddings from Speech
In this paper, we propose a novel deep neural network architecture, Spee...
research
∙
11/22/2017
Learning Deep Representations of Medical Images using Siamese CNNs with Application to Content-Based Image Retrieval
Deep neural networks have been investigated in learning latent represent...
research
∙
11/14/2017
Supervised and Unsupervised Transfer Learning for Question Answering
Although transfer learning has been shown to be successful for tasks lik...
research
∙
11/05/2017
Learning Word Embeddings from Speech
In this paper, we propose a novel deep neural network architecture, Sequ...
research
∙
11/16/2016
Cost-Sensitive Deep Learning with Layer-Wise Cost Estimation
While deep neural networks have succeeded in several visual applications...
research
∙
11/30/2015