research
∙
05/18/2023
MolXPT: Wrapping Molecules with Text for Generative Pre-training
Generative pre-trained Transformer (GPT) has demonstrates its great succ...
share
research
∙
04/12/2023
Filler Word Detection with Hard Category Mining and Inter-Category Focal Loss
Filler words like “um" or “uh" are common in spontaneous speech. It is d...
research
∙
03/13/2023
AMOM: Adaptive Masking over Masking for Conditional Masked Language Model
Transformer-based autoregressive (AR) methods have achieved appealing pe...
research
∙
02/24/2023
Retrieved Sequence Augmentation for Protein Representation Learning
Protein language models have excelled in a variety of tasks, ranging fro...
research
∙
10/31/2022
Improving Temporal Generalization of Pre-trained Language Models with Lexical Semantic Change
Recent research has revealed that neural language models at scale suffer...
research
∙
07/14/2022
Unified 2D and 3D Pre-Training of Molecular Representations
Molecular representation learning has attracted much attention recently....
research
∙
06/20/2022
SMT-DTA: Improving Drug-Target Affinity Prediction with Semi-supervised Multi-task Training
Drug-Target Affinity (DTA) prediction is an essential task for drug disc...
research
∙
04/20/2022
A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond
Non-autoregressive (NAR) generation, which is first proposed in neural m...
research
∙
02/28/2022
A Mutually Reinforced Framework for Pretrained Sentence Embeddings
The lack of labeled data is a major obstacle to learning high-quality se...
research
∙
02/03/2022
Direct Molecular Conformation Generation
Molecular conformation generation aims to generate three-dimensional coo...
research
∙
12/13/2021
C^2-Rec: An Effective Consistency Constraint for Sequential Recommendation
Sequential recommendation methods play an important role in real-world r...
research
∙
10/29/2021
Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language Model
Understanding protein sequences is vital and urgent for biology, healthc...
research
∙
09/27/2021
Discovering Drug-Target Interaction Knowledge from Biomedical Literature
The Interaction between Drugs and Targets (DTI) in human body plays a cr...
research
∙
06/28/2021
R-Drop: Regularized Dropout for Neural Networks
Dropout is a powerful and widely used technique to regularize the traini...
research
∙
06/08/2021
Incorporating NODE with Pre-trained Neural Differential Operator for Learning Dynamics
Learning dynamics governed by differential equations is crucial for pred...
research
∙
04/11/2021
UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost
Transformer architecture achieves great success in abundant natural lang...
research
∙
03/05/2021
IOT: Instance-wise Layer Reordering for Transformer Structures
With sequentially stacked self-attention, (optional) encoder-decoder att...
research
∙
12/11/2020
ADD: Augmented Disentanglement Distillation Framework for Improving Stock Trend Forecasting
Stock trend forecasting has become a popular research direction that att...
research
∙
10/15/2020
Masked Contrastive Representation Learning for Reinforcement Learning
Improving sample efficiency is a key research problem in reinforcement l...
research
∙
07/10/2020
Learn to Use Future Information in Simultaneous Translation
Simultaneous neural machine translation (briefly, NMT) has attracted muc...
research
∙
07/09/2020
Learning to Teach with Deep Interactions
Machine teaching uses a meta/teacher model to guide the training of a st...
research
∙
06/18/2020
Multi-branch Attentive Transformer
While the multi-branch architecture is one of the key ingredients to the...
research
∙
02/17/2020
Incorporating BERT into Neural Machine Translation
The recently proposed BERT has shown great power on a variety of natural...
research
∙
11/07/2019
Microsoft Research Asia's Systems for WMT19
We Microsoft Research Asia made submissions to 11 language directions in...
research
∙
08/25/2019
Efficient Bidirectional Neural Machine Translation
The encoder-decoder based neural machine translation usually generates a...
research
∙
07/03/2019
Depth Growing for Neural Machine Translation
While very deep neural networks have shown effectiveness for computer vi...
research
∙
05/25/2019
Soft Contextual Data Augmentation for Neural Machine Translation
While data augmentation is an important trick to boost the accuracy of d...
research
∙
10/29/2018
Learning to Teach with Dynamic Loss Functions
Teaching is critical to human society: it is with teaching that prospect...
research
∙
09/01/2018
Beyond Error Propagation in Neural Machine Translation: Characteristics of Language Also Matter
Neural machine translation usually adopts autoregressive models and suff...
research
∙
08/27/2018
A Study of Reinforcement Learning for Neural Machine Translation
Recent studies have shown that reinforcement learning (RL) is an effecti...
research
∙
03/15/2018
Achieving Human Parity on Automatic Chinese to English News Translation
Machine translation has made rapid advances in recent years. Millions of...
research
∙
04/20/2017