research
∙
05/18/2023
MolXPT: Wrapping Molecules with Text for Generative Pre-training
Generative pre-trained Transformer (GPT) has demonstrates its great succ...
share
research
∙
03/13/2023
AMOM: Adaptive Masking over Masking for Conditional Masked Language Model
Transformer-based autoregressive (AR) methods have achieved appealing pe...
research
∙
01/31/2023
Retrosynthetic Planning with Dual Value Networks
Retrosynthesis, which aims to find a route to synthesize a target molecu...
research
∙
12/24/2022
An Adaptive Deep RL Method for Non-Stationary Environments with Piecewise Stable Context
One of the key challenges in deploying RL to real-world applications is ...
research
∙
10/19/2022
BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining
Pre-trained language models have attracted increasing attention in the b...
research
∙
08/30/2022
MeloForm: Generating Melody with Musical Form based on Expert Systems and Neural Networks
Human usually composes music by organizing elements according to the mus...
research
∙
07/18/2022
Inspector: Pixel-Based Automated Game Testing via Exploration, Detection, and Investigation
Deep reinforcement learning (DRL) has attracted much attention in automa...
research
∙
07/14/2022
Unified 2D and 3D Pre-Training of Molecular Representations
Molecular representation learning has attracted much attention recently....
research
∙
07/12/2022
ReLyMe: Improving Lyric-to-Melody Generation by Incorporating Lyric-Melody Relationships
Lyric-to-melody generation, which generates melody according to given ly...
research
∙
06/30/2022
Building Multilingual Machine Translation Systems That Serve Arbitrary X-Y Translations
Multilingual Neural Machine Translation (MNMT) enables one system to tra...
research
∙
06/20/2022
SMT-DTA: Improving Drug-Target Affinity Prediction with Semi-supervised Multi-task Training
Drug-Target Affinity (DTA) prediction is an essential task for drug disc...
research
∙
05/30/2022
BinauralGrad: A Two-Stage Conditional Diffusion Probabilistic Model for Binaural Audio Synthesis
Binaural audio plays a significant role in constructing immersive augmen...
research
∙
05/25/2022
Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling
Sentence scoring aims at measuring the likelihood score of a sentence an...
research
∙
05/25/2022
Tiered Reinforcement Learning: Pessimism in the Face of Uncertainty and Constant Regret
We propose a new learning framework that captures the tiered structure o...
research
∙
05/09/2022
NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality
Text to speech (TTS) has made rapid progress in both academia and indust...
research
∙
04/20/2022
A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond
Non-autoregressive (NAR) generation, which is first proposed in neural m...
research
∙
04/01/2022
AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios
Adaptive text to speech (TTS) can synthesize new voices in zero-shot sce...
research
∙
02/26/2022
Revisiting Over-Smoothness in Text to Speech
Non-autoregressive text to speech (NAR-TTS) models have attracted much a...
research
∙
02/14/2022
Towards Deployment-Efficient Reinforcement Learning: Lower Bound and Optimality
Deployment efficiency is an important criterion for many real-world appl...
research
∙
02/03/2022
Direct Molecular Conformation Generation
Molecular conformation generation aims to generate three-dimensional coo...
research
∙
01/31/2022
You May Not Need Ratio Clipping in PPO
Proximal Policy Optimization (PPO) methods learn a policy by iteratively...
research
∙
01/03/2022
Adaptive Memory Networks with Self-supervised Learning for Unsupervised Anomaly Detection
Unsupervised anomaly detection aims to build models to effectively detec...
research
∙
12/01/2021
Federated Learning with Adaptive Batchnorm for Personalized Healthcare
There is a growing interest in applying machine learning techniques for ...
research
∙
11/16/2021
Towards Generating Real-World Time Series Data
Time series data generation has drawn increasing attention in recent yea...
research
∙
10/29/2021
Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language Model
Understanding protein sequences is vital and urgent for biology, healthc...
research
∙
10/27/2021
Object-Aware Regularization for Addressing Causal Confusion in Imitation Learning
Behavioral cloning has proven to be effective for learning sequential de...
research
∙
10/26/2021
Distributional Reinforcement Learning for Multi-Dimensional Reward Functions
A growing trend for value-based reinforcement learning (RL) algorithms i...
research
∙
10/07/2021
GNN is a Counter? Revisiting GNN for Question Answering
Question Answering (QA) has been a long-standing research topic in AI an...
research
∙
09/27/2021
Discovering Drug-Target Interaction Knowledge from Biomedical Literature
The Interaction between Drugs and Targets (DTI) in human body plays a cr...
research
∙
09/16/2021
PDAugment: Data Augmentation by Pitch and Duration Adjustments for Automatic Lyrics Transcription
Automatic lyrics transcription (ALT), which can be regarded as automatic...
research
∙
08/29/2021
Analyzing and Mitigating Interference in Neural Architecture Search
Weight sharing has become the de facto approach to reduce the training c...
research
∙
08/10/2021
AdaRNN: Adaptive Learning and Forecasting of Time Series
Time series has wide applications in the real world and is known to be d...
research
∙
07/06/2021
AdaSpeech 3: Adaptive Text to Speech for Spontaneous Style
While recent text to speech (TTS) models perform very well in synthesizi...
research
∙
07/05/2021
DeepRapper: Neural Rap Generation with Rhyme and Rhythm Modeling
Rap generation, which aims to produce lyrics and corresponding singing b...
research
∙
07/03/2021
Supervised Off-Policy Ranking
Off-policy evaluation (OPE) leverages data generated by other policies t...
research
∙
06/30/2021
On the Generative Utility of Cyclic Conditionals
We study whether and how can we model a joint distribution p(x,z) using ...
research
∙
06/29/2021
A Survey on Neural Speech Synthesis
Text to speech (TTS), or speech synthesis, which aims to synthesize inte...
research
∙
06/28/2021
R-Drop: Regularized Dropout for Neural Networks
Dropout is a powerful and widely used technique to regularize the traini...
research
∙
06/17/2021
Dual-view Molecule Pre-training
Inspired by its success in natural language processing and computer visi...
research
∙
06/11/2021
PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Driven Adaptive Prior
Denoising diffusion probabilistic models have been recently proposed to ...
research
∙
05/30/2021
NAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Search
While pre-trained language models (e.g., BERT) have achieved impressive ...
research
∙
05/27/2021
Learning Structures for Deep Neural Networks
In this paper, we focus on the unsupervised setting for structure learni...
research
∙
05/18/2021
Exploiting Adapters for Cross-lingual Low-resource Speech Recognition
Cross-lingual speech adaptation aims to solve the problem of leveraging ...
research
∙
05/09/2021
FastCorrect: Fast Error Correction with Edit Alignment for Automatic Speech Recognition
Error correction techniques have been used to refine the output sentence...
research
∙
04/20/2021
AdaSpeech 2: Adaptive Text to Speech with Untranscribed Data
Text to speech (TTS) is widely used to synthesize personal voice for a t...
research
∙
04/15/2021
Cross-domain Speech Recognition with Unsupervised Character-level Distribution Matching
End-to-end automatic speech recognition (ASR) can achieve promising perf...
research
∙
04/11/2021
UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost
Transformer architecture achieves great success in abundant natural lang...
research
∙
03/05/2021
IOT: Instance-wise Layer Reordering for Transformer Structures
With sequentially stacked self-attention, (optional) encoder-decoder att...
research
∙
03/02/2021
Generalizing to Unseen Domains: A Survey on Domain Generalization
Domain generalization (DG), i.e., out-of-distribution generalization, ha...
research
∙
03/01/2021
