research
∙
09/19/2023
MelodyGLM: Multi-task Pre-training for Symbolic Melody Generation
Pre-trained language models have achieved impressive results in various ...
share
research
∙
08/09/2023
VAST: Vivify Your Talking Avatar via Zero-Shot Expressive Facial Style Transfer
Current talking face generation methods mainly focus on speech-lip synch...
research
∙
08/01/2023
Context-Aware Talking-Head Video Editing
Talking-head video editing aims to efficiently insert, delete, and subst...
research
∙
05/26/2023
TranSFormer: Slow-Fast Transformer for Machine Translation
Learning multiscale Transformer models has been evidenced as a viable ap...
research
∙
05/22/2023
DiffusionNER: Boundary Diffusion for Named Entity Recognition
In this paper, we propose DiffusionNER, which formulates the named entit...
research
∙
05/22/2023
NAS-FM: Neural Architecture Search for Tunable and Interpretable Sound Synthesis based on Frequency Modulation
Developing digital sound synthesizers is crucial to the music industry a...
research
∙
05/11/2023
CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model
Denoising diffusion probabilistic models (DDPMs) have shown promising pe...
research
∙
04/21/2023
CLaMP: Contrastive Language-Music Pre-training for Cross-Modal Symbolic Music Information Retrieval
We introduce CLaMP: Contrastive Language-Music Pre-training, which learn...
research
∙
04/03/2023
Improving Autoencoder-based Outlier Detection with Adjustable Probabilistic Reconstruction Error and Mean-shift Outlier Scoring
Autoencoders were widely used in many machine learning tasks thanks to t...
research
∙
03/30/2023
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace
Solving complicated AI tasks with different domains and modalities is a ...
research
∙
03/09/2023
Improving Few-Shot Learning for Talking Face System with TTS Data Augmentation
Audio-driven talking face has attracted broad interest from academia and...
research
∙
03/06/2023
FoundationTTS: Text-to-Speech for ASR Customization with Generative Language Model
Neural text-to-speech (TTS) generally consists of cascaded architecture ...
research
∙
01/30/2023
ERA-Solver: Error-Robust Adams Solver for Fast Sampling of Diffusion Probabilistic Models
Though denoising diffusion probabilistic models (DDPMs) have achieved re...
research
∙
01/11/2023
WuYun: Exploring hierarchical skeleton-guided melody generation using knowledge-enhanced deep learning
Although deep learning has revolutionized music generation, existing met...
research
∙
11/22/2022
PromptTTS: Controllable Text-to-Speech with Text Descriptions
Using a text description as prompt to guide the generation of text or im...
research
∙
11/14/2022
Towards Understanding Omission in Dialogue Summarization
Dialogue summarization aims to condense the lengthy dialogue into a conc...
research
∙
08/30/2022
MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks
Human usually composes music by organizing elements according to the mus...
research
∙
08/29/2022
StableFace: Analyzing and Improving Motion Stability for Talking Face Generation
While previous speech-driven talking face generation methods have made s...
research
∙
07/12/2022
ReLyMe: Improving Lyric-to-Melody Generation by Incorporating Lyric-Melody Relationships
Lyric-to-melody generation, which generates melody according to given ly...
research
∙
07/11/2022
DelightfulTTS 2: End-to-End Speech Synthesis with Adversarial Vector-Quantized Auto-Encoders
Current text to speech (TTS) systems usually leverage a cascaded acousti...
research
∙
05/30/2022
BinauralGrad: A Two-Stage Conditional Diffusion Probabilistic Model for Binaural Audio Synthesis
Binaural audio plays a significant role in constructing immersive augmen...
research
∙
05/25/2022
Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling
Sentence scoring aims at measuring the likelihood score of a sentence an...
research
∙
05/09/2022
NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality
Text to speech (TTS) has made rapid progress in both academia and indust...
research
∙
04/01/2022
AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios
Adaptive text to speech (TTS) can synthesize new voices in zero-shot sce...
research
∙
02/26/2022
Revisiting Over-Smoothness in Text to Speech
Non-autoregressive text to speech (NAR-TTS) models have attracted much a...
research
∙
02/08/2022
InferGrad: Improving Diffusion Models for Vocoder by Considering Inference in Training
Denoising diffusion probabilistic models (diffusion models for short) re...
research
∙
11/18/2021
Transformer-S2A: Robust and Efficient Speech-to-Animation
We propose a novel robust and efficient Speech-to-Animation (S2A) approa...
research
∙
10/08/2021
A study on the efficacy of model pre-training in developing neural text-to-speech system
In the development of neural text-to-speech systems, model pre-training ...
research
∙
09/16/2021
PDAugment: Data Augmentation by Pitch and Duration Adjustments for Automatic Lyrics Transcription
Automatic lyrics transcription (ALT), which can be regarded as automatic...
research
∙
08/29/2021
Analyzing and Mitigating Interference in Neural Architecture Search
Weight sharing has become the de facto approach to reduce the training c...
research
∙
07/06/2021
AdaSpeech 3: Adaptive Text to Speech for Spontaneous Style
While recent text to speech (TTS) models perform very well in synthesizi...
research
∙
07/05/2021
DeepRapper: Neural Rap Generation with Rhyme and Rhythm Modeling
Rap generation, which aims to produce lyrics and corresponding singing b...
research
∙
06/29/2021
A Survey on Neural Speech Synthesis
Text to speech (TTS), or speech synthesis, which aims to synthesize inte...
research
∙
06/11/2021
PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Driven Adaptive Prior
Denoising diffusion probabilistic models have been recently proposed to ...
research
∙
05/30/2021
NAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Search
While pre-trained language models (e.g., BERT) have achieved impressive ...
research
∙
05/09/2021
FastCorrect: Fast Error Correction with Edit Alignment for Automatic Speech Recognition
Error correction techniques have been used to refine the output sentence...
research
∙
04/20/2021
AdaSpeech 2: Adaptive Text to Speech with Untranscribed Data
Text to speech (TTS) is widely used to synthesize personal voice for a t...
research
∙
04/15/2021
Cross-domain Speech Recognition with Unsupervised Character-level Distribution Matching
End-to-end automatic speech recognition (ASR) can achieve promising perf...
research
∙
04/13/2021
Improving Long-Tailed Classification from Instance Level
Data in the real world tends to exhibit a long-tailed label distribution...
research
∙
03/01/2021
AdaSpeech: Adaptive Text to Speech for Custom Voice
Custom voice, a specific text to speech (TTS) service in commercial spee...
research
∙
02/27/2021
MBNet: MOS Prediction for Synthesized Speech with Mean-Bias Network
Mean opinion score (MOS) is a popular subjective metric to assess the qu...
research
∙
02/25/2021
MixSpeech: Data Augmentation for Low-resource Automatic Speech Recognition
In this paper, we propose MixSpeech, a simple yet effective data augment...
research
∙
02/10/2021
BRECQ: Pushing the Limit of Post-Training Quantization by Block Reconstruction
We study the challenging task of neural network quantization without end...
research
∙
02/08/2021
LightSpeech: Lightweight and Fast Text to Speech with Neural Architecture Search
Text to speech (TTS) has been broadly used to synthesize natural and int...
research
∙
12/17/2020
DenoiSpeech: Denoising Text to Speech with Frame-Level Noise Modeling
While neural-based text to speech (TTS) models can synthesize natural an...
research
∙
12/09/2020
SongMASS: Automatic Song Writing with Pre-training and Alignment Constraint
Automatic song writing aims to compose a song (lyric and/or melody) by m...
research
∙
10/23/2020
Speech enhancement aided end-to-end multi-task learning for voice activity detection
Robust voice activity detection (VAD) is a challenging task in low signa...
research
∙
09/12/2020
DualLip: A System for Joint Lip Reading and Generation
Lip reading aims to recognize text from talking lip, while lip generatio...
research
∙
09/03/2020
HiFiSinger: Towards High-Fidelity Neural Singing Voice Synthesis
High-fidelity singing voices usually require higher sampling rate (e.g.,...
research
∙
08/18/2020