research
∙
05/31/2023
Learning Music Sequence Representation from Text Supervision
Music representation learning is notoriously difficult for its complex h...
share
research
∙
09/15/2022
BadRes: Reveal the Backdoors through Residual Connection
Generally, residual connections are indispensable network components in ...
research
∙
06/01/2022
Task-Specific Expert Pruning for Sparse Mixture-of-Experts
The sparse Mixture-of-Experts (MoE) model is powerful for large-scale pr...
research
∙
06/01/2022
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption
As more and more pre-trained language models adopt on-cloud deployment, ...
research
∙
06/07/2021
RoSearch: Search for Robust Student Architectures When Distilling Pre-trained Language Models
Pre-trained language models achieve outstanding performance in NLP tasks...
research
∙
12/14/2020
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Many real-world applications require the prediction of long sequence tim...
research
∙
06/16/2020
Differentially-private Federated Neural Architecture Search
Neural architecture search, which aims to automatically search for archi...
research
∙
11/25/2017