research
∙
05/24/2023
ComSL: A Composite Speech-Language Model for End-to-End Speech-to-Text Translation
Joint speech-language training is challenging due to the large demand fo...
share
research
∙
03/01/2023
Building High-accuracy Multilingual ASR with Gated Language Experts and Curriculum Training
We propose gated language experts to improve multilingual transformer tr...
research
∙
01/05/2023
Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
We introduce a language modeling approach for text to speech synthesis (...
research
∙
11/21/2022
VATLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning
Although speech is a simple and effective way for humans to communicate ...
research
∙
11/05/2022
LAMASSU: Streaming Language-Agnostic Multilingual Speech Recognition and Translation Using Neural Transducers
End-to-end formulation of automatic speech recognition (ASR) and speech ...
research
∙
10/31/2022
Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation
Direct speech-to-speech translation (S2ST) is an attractive research top...
research
∙
10/27/2022
Robust Data2vec: Noise-robust Speech Representation Learning for ASR by Combining Regression and Improved Contrastive Learning
Self-supervised pre-training methods based on contrastive learning or re...
research
∙
10/07/2022
SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training
The rapid development of single-modal pre-training has prompted research...
research
∙
09/30/2022
SpeechLM: Enhanced Speech Pre-Training with Unpaired Textual Data
How to boost speech pre-training with textual data is an unsolved proble...
research
∙
06/12/2022
The YiTrans End-to-End Speech Translation System for IWSLT 2022 Offline Shared Task
This paper describes the submission of our end-to-end YiTrans speech tra...
research
∙
04/07/2022
Speech Pre-training with Acoustic Piece
Previous speech pre-training methods, such as wav2vec2.0 and HuBERT, pre...
research
∙
03/31/2022
Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data
This paper studies a novel pre-training technique with unpaired speech d...
research
∙
10/26/2021
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Self-supervised learning (SSL) achieves great success in speech recognit...
research
∙
07/13/2021
A Configurable Multilingual Model is All You Need to Recognize All Languages
Multilingual automatic speech recognition (ASR) models have shown great ...
research
∙
09/22/2020
CodeBLEU: a Method for Automatic Evaluation of Code Synthesis
Evaluation metrics play a vital role in the growth of an area as it defi...
research
∙
09/17/2020
GraphCodeBERT: Pre-training Code Representations with Data Flow
Pre-trained models for programming language have achieved dramatic empir...
research
∙
12/16/2019
Synchronous Speech Recognition and Speech-to-Text Translation with Interactive Decoding
Speech-to-text translation (ST), which translates source language speech...
research
∙
06/23/2019
Sequence Generation: From Both Sides to the Middle
The encoder-decoder framework has achieved promising process for many se...
research
∙
05/13/2019
Synchronous Bidirectional Neural Machine Translation
Existing approaches to neural machine translation (NMT) generate the tar...
research
∙
02/24/2019
Synchronous Bidirectional Inference for Neural Sequence Generation
In sequence to sequence generation tasks (e.g. machine translation and a...
research
∙
11/01/2018
Language-Independent Representor for Neural Machine Translation
Current Neural Machine Translation (NMT) employs a language-specific enc...
research
∙
11/13/2017
Word, Subword or Character? An Empirical Study of Granularity in Chinese-English NMT
Neural machine translation (NMT), a new approach to machine translation,...
research
∙
08/30/2017
Look-ahead Attention for Generation in Neural Machine Translation
The attention model has become a standard component in neural machine tr...
research
∙
04/21/2017