b'Xu Tan'

research

∙ 05/26/2023

TranSFormer: Slow-Fast Transformer for Machine Translation

Learning multiscale Transformer models has been evidenced as a viable ap...

0 Bei Li, et al. ∙

research

∙ 05/22/2023

DiffusionNER: Boundary Diffusion for Named Entity Recognition

In this paper, we propose DiffusionNER, which formulates the named entit...

0 Yongliang Shen, et al. ∙

research

∙ 05/22/2023

NAS-FM: Neural Architecture Search for Tunable and Interpretable Sound Synthesis based on Frequency Modulation

Developing digital sound synthesizers is crucial to the music industry a...

0 Zhen Ye, et al. ∙

research

∙ 05/11/2023

CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model

Denoising diffusion probabilistic models (DDPMs) have shown promising pe...

0 Zhen Ye, et al. ∙

research

∙ 04/21/2023

CLaMP: Contrastive Language-Music Pre-training for Cross-Modal Symbolic Music Information Retrieval

We introduce CLaMP: Contrastive Language-Music Pre-training, which learn...

0 Shangda Wu, et al. ∙

research

∙ 04/03/2023

Improving Autoencoder-based Outlier Detection with Adjustable Probabilistic Reconstruction Error and Mean-shift Outlier Scoring

Autoencoders were widely used in many machine learning tasks thanks to t...

0 Xu Tan, et al. ∙

research

∙ 03/30/2023

HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace

Solving complicated AI tasks with different domains and modalities is a ...

0 Yongliang Shen, et al. ∙

research

∙ 03/09/2023

Improving Few-Shot Learning for Talking Face System with TTS Data Augmentation

Audio-driven talking face has attracted broad interest from academia and...

0 Qi Chen, et al. ∙

research

∙ 03/06/2023

FoundationTTS: Text-to-Speech for ASR Customization with Generative Language Model

Neural text-to-speech (TTS) generally consists of cascaded architecture ...

0 Ruiqing Xue, et al. ∙

research

∙ 01/30/2023

ERA-Solver: Error-Robust Adams Solver for Fast Sampling of Diffusion Probabilistic Models

Though denoising diffusion probabilistic models (DDPMs) have achieved re...

0 Shengmeng Li, et al. ∙

research

∙ 01/11/2023

WuYun: Exploring hierarchical skeleton-guided melody generation using knowledge-enhanced deep learning

Although deep learning has revolutionized music generation, existing met...

0 Kejun Zhang, et al. ∙

research

∙ 11/22/2022

PromptTTS: Controllable Text-to-Speech with Text Descriptions

Using a text description as prompt to guide the generation of text or im...

0 Zhifang Guo, et al. ∙

research

∙ 11/14/2022

Towards Understanding Omission in Dialogue Summarization

Dialogue summarization aims to condense the lengthy dialogue into a conc...

0 Yicheng Zou, et al. ∙

research

∙ 08/30/2022

MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks

Human usually composes music by organizing elements according to the mus...

11 Peiling Lu, et al. ∙

research

∙ 08/29/2022

StableFace: Analyzing and Improving Motion Stability for Talking Face Generation

While previous speech-driven talking face generation methods have made s...

13 Jun Ling, et al. ∙

research

∙ 07/12/2022

ReLyMe: Improving Lyric-to-Melody Generation by Incorporating Lyric-Melody Relationships

Lyric-to-melody generation, which generates melody according to given ly...

0 Chen Zhang, et al. ∙

research

∙ 07/11/2022

DelightfulTTS 2: End-to-End Speech Synthesis with Adversarial Vector-Quantized Auto-Encoders

Current text to speech (TTS) systems usually leverage a cascaded acousti...

0 Yanqing Liu, et al. ∙

research

∙ 05/30/2022

BinauralGrad: A Two-Stage Conditional Diffusion Probabilistic Model for Binaural Audio Synthesis

Binaural audio plays a significant role in constructing immersive augmen...

1 Yichong Leng, et al. ∙

research

∙ 05/25/2022

Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling

Sentence scoring aims at measuring the likelihood score of a sentence an...

0 Kaitao Song, et al. ∙

research

∙ 05/09/2022

NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality

Text to speech (TTS) has made rapid progress in both academia and indust...

18 Xu Tan, et al. ∙

research

∙ 04/01/2022

AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios

Adaptive text to speech (TTS) can synthesize new voices in zero-shot sce...

4 Yihan Wu, et al. ∙

research

∙ 02/26/2022

Revisiting Over-Smoothness in Text to Speech

Non-autoregressive text to speech (NAR-TTS) models have attracted much a...

0 Yi Ren, et al. ∙

research

∙ 02/08/2022

InferGrad: Improving Diffusion Models for Vocoder by Considering Inference in Training

Denoising diffusion probabilistic models (diffusion models for short) re...

7 Zehua Chen, et al. ∙

research

∙ 11/18/2021

Transformer-S2A: Robust and Efficient Speech-to-Animation

We propose a novel robust and efficient Speech-to-Animation (S2A) approa...

0 Liyang Chen, et al. ∙

research

∙ 10/08/2021

A study on the efficacy of model pre-training in developing neural text-to-speech system

In the development of neural text-to-speech systems, model pre-training ...

3 Guangyan Zhang, et al. ∙

research

∙ 09/16/2021

PDAugment: Data Augmentation by Pitch and Duration Adjustments for Automatic Lyrics Transcription

Automatic lyrics transcription (ALT), which can be regarded as automatic...

0 Chen Zhang, et al. ∙

research

∙ 08/29/2021

Analyzing and Mitigating Interference in Neural Architecture Search

Weight sharing has become the de facto approach to reduce the training c...

0 Jin Xu, et al. ∙

research

∙ 07/06/2021

AdaSpeech 3: Adaptive Text to Speech for Spontaneous Style

While recent text to speech (TTS) models perform very well in synthesizi...

9 Yuzi Yan, et al. ∙

research

∙ 07/05/2021

DeepRapper: Neural Rap Generation with Rhyme and Rhythm Modeling

Rap generation, which aims to produce lyrics and corresponding singing b...

0 Lanqing Xue, et al. ∙

research

∙ 06/29/2021

A Survey on Neural Speech Synthesis

Text to speech (TTS), or speech synthesis, which aims to synthesize inte...

63 Xu Tan, et al. ∙

research

∙ 06/11/2021

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Driven Adaptive Prior

Denoising diffusion probabilistic models have been recently proposed to ...

5 Sang-gil Lee, et al. ∙

research

∙ 05/30/2021

NAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Search

While pre-trained language models (e.g., BERT) have achieved impressive ...

12 Jin Xu, et al. ∙

research

∙ 05/09/2021

FastCorrect: Fast Error Correction with Edit Alignment for Automatic Speech Recognition

Error correction techniques have been used to refine the output sentence...

5 Yichong Leng, et al. ∙

research

∙ 04/20/2021

AdaSpeech 2: Adaptive Text to Speech with Untranscribed Data

Text to speech (TTS) is widely used to synthesize personal voice for a t...

13 Yuzi Yan, et al. ∙

research

∙ 04/15/2021

Cross-domain Speech Recognition with Unsupervised Character-level Distribution Matching

End-to-end automatic speech recognition (ASR) can achieve promising perf...

0 Wenxin Hou, et al. ∙

research

∙ 04/13/2021

Improving Long-Tailed Classification from Instance Level

Data in the real world tends to exhibit a long-tailed label distribution...

11 Yan Zhao, et al. ∙

research

∙ 03/01/2021

AdaSpeech: Adaptive Text to Speech for Custom Voice

Custom voice, a specific text to speech (TTS) service in commercial spee...

25 Mingjian Chen, et al. ∙

research

∙ 02/27/2021

MBNet: MOS Prediction for Synthesized Speech with Mean-Bias Network

Mean opinion score (MOS) is a popular subjective metric to assess the qu...

0 Yichong Leng, et al. ∙

research

∙ 02/25/2021

MixSpeech: Data Augmentation for Low-resource Automatic Speech Recognition

In this paper, we propose MixSpeech, a simple yet effective data augment...

14 Linghui Meng, et al. ∙

research

∙ 02/10/2021

BRECQ: Pushing the Limit of Post-Training Quantization by Block Reconstruction

We study the challenging task of neural network quantization without end...

12 Yuhang Li, et al. ∙

research

∙ 02/08/2021

LightSpeech: Lightweight and Fast Text to Speech with Neural Architecture Search

Text to speech (TTS) has been broadly used to synthesize natural and int...

14 Renqian Luo, et al. ∙

research

∙ 12/17/2020

DenoiSpeech: Denoising Text to Speech with Frame-Level Noise Modeling

While neural-based text to speech (TTS) models can synthesize natural an...

0 Chen Zhang, et al. ∙

research

∙ 12/09/2020

SongMASS: Automatic Song Writing with Pre-training and Alignment Constraint

Automatic song writing aims to compose a song (lyric and/or melody) by m...

4 Zhonghao Sheng, et al. ∙

research

∙ 10/23/2020

Speech enhancement aided end-to-end multi-task learning for voice activity detection

Robust voice activity detection (VAD) is a challenging task in low signa...

8 Xu Tan, et al. ∙

research

∙ 09/12/2020

DualLip: A System for Joint Lip Reading and Generation

Lip reading aims to recognize text from talking lip, while lip generatio...

0 Weicong Chen, et al. ∙

research

∙ 09/03/2020

HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesis

High-fidelity singing voices usually require higher sampling rate (e.g.,...

0 Jiawei Chen, et al. ∙

research

∙ 08/18/2020

PopMAG: Pop Music Accompaniment Generation

In pop music, accompaniments are usually played by multiple instruments ...

0 Yi Ren, et al. ∙

research

∙ 08/09/2020

LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition

Speech synthesis (text to speech, TTS) and recognition (automatic speech...

0 Jin Xu, et al. ∙

research

∙ 07/21/2020

Neural Machine Translation with Error Correction

Neural machine translation (NMT) generates the next target token given a...

0 Kaitao Song, et al. ∙

research

∙ 07/17/2020

Task-Level Curriculum Learning for Non-Autoregressive Neural Machine Translation

Non-autoregressive translation (NAT) achieves faster inference speed but...

0 Jinglin Liu, et al. ∙

Xu Tan

Featured Co-authors