b'Zhen Qin'

research

∙ 08/08/2023

All-pairs Consistency Learning for Weakly Supervised Semantic Segmentation

In this work, we propose a new transformer-based regularization to bette...

0 Weixuan Sun, et al. ∙

research

∙ 07/27/2023

Scaling TransNormer to 175 Billion Parameters

We present TransNormerLLM, the first linear attention-based Large Langua...

0 Zhen Qin, et al. ∙

research

∙ 07/19/2023

Exploring Transformer Extrapolation

Length extrapolation has attracted considerable attention recently since...

0 Zhen Qin, et al. ∙

research

∙ 07/18/2023

Linearized Relative Positional Encoding

Relative positional encoding is widely used in vanilla and linear transf...

0 Zhen Qin, et al. ∙

research

∙ 07/11/2023

PePNet: A Periodicity-Perceived Workload Prediction Network Supporting Rare Occurrence of Heavy Workload

Cloud providers can greatly benefit from accurate workload prediction. H...

0 Feiyi Chen, et al. ∙

research

∙ 06/15/2023

Stable Tomography for Structured Quantum States

The reconstruction of quantum states from experimental measurements, oft...

0 Zhen Qin, et al. ∙

research

∙ 06/14/2023

Learning to Rank when Grades Matter

Graded labels are ubiquitous in real-world learning-to-rank applications...

0 Le Yan, et al. ∙

research

∙ 06/07/2023

RD-Suite: A Benchmark for Ranking Distillation

The distillation of ranking models has become an important topic in both...

0 Zhen Qin, et al. ∙

research

∙ 05/08/2023

Toeplitz Neural Network for Sequence Modeling

Sequence modeling has important applications in natural language process...

0 Zhen Qin, et al. ∙

research

∙ 05/05/2023

Query Expansion by Prompting Large Language Models

Query expansion is a widely used technique to improve the recall of sear...

0 Rolf Jagerman, et al. ∙

research

∙ 03/27/2023

Fine-grained Audible Video Description

We explore a new task for audio-visual-language modeling called fine-gra...

0 Xuyang Shen, et al. ∙

research

∙ 12/21/2022

Learning List-Level Domain-Invariant Representations for Ranking

Domain adaptation aims to transfer the knowledge acquired by models trai...

0 Ruicheng Xian, et al. ∙

research

∙ 11/02/2022

Regression Compatible Listwise Objectives for Calibrated Ranking

As Learning-to-Rank (LTR) approaches primarily seek to improve ranking q...

0 Aijun Bai, et al. ∙

research

∙ 10/19/2022

The Devil in Linear Transformer

Linear transformers aim to reduce the quadratic space-time complexity of...

0 Zhen Qin, et al. ∙

research

∙ 10/15/2022

Linear Video Transformer with Feature Fixation

Vision Transformers have achieved impressive performance in video classi...

0 Kaiyue Lu, et al. ∙

research

∙ 10/12/2022

RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses

Recently, substantial progress has been made in text ranking based on pr...

0 Honglei Zhuang, et al. ∙

research

∙ 10/11/2022

Retrieval Augmentation for T5 Re-ranker using External Sources

Retrieval augmentation has shown promising improvements in different tas...

10 Kai Hui, et al. ∙

research

∙ 09/21/2022

A Validation Approach to Over-parameterized Matrix and Image Recovery

In this paper, we study the problem of recovering a low-rank matrix from...

16 Lijun Ding, et al. ∙

research

∙ 07/28/2022

Neural Architecture Search on Efficient Transformers and Beyond

Recently, numerous efficient Transformers have been proposed to reduce t...

28 Zexiang Liu, et al. ∙

research

∙ 07/09/2022

Error Analysis of Tensor-Train Cross Approximation

Tensor train decomposition is widely used in machine learning and quantu...

19 Zhen Qin, et al. ∙

research

∙ 06/21/2022

Vicinity Vision Transformer

Vision transformers have shown great success on numerous computer vision...

12 Weixuan Sun, et al. ∙

research

∙ 05/21/2022

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Federated learning (FL) is a promising technical support to the vision o...

0 Zhen Qin, et al. ∙

research

∙ 04/25/2022

ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference

State-of-the-art neural models typically encode document-query pairs usi...

3 Kai Hui, et al. ∙

research

∙ 02/17/2022

cosFormer: Rethinking Softmax in Attention

Transformer has shown great successes in natural language processing, co...

20 Zhen Qin, et al. ∙

research

∙ 12/17/2021

Rank4Class: A Ranking Formulation for Multiclass Classification

Multiclass classification (MCC) is a fundamental machine learning proble...

18 Nan Wang, et al. ∙

research

∙ 09/30/2021

Born Again Neural Rankers

We introduce Born Again neural Rankers (BAR) in the Learning to Rank (LT...

0 Zhen Qin, et al. ∙

research

∙ 06/23/2021

Charformer: Fast Character Transformers via Gradient-based Subword Tokenization

State-of-the-art models in natural language processing rely on separate ...

4 Yi Tay, et al. ∙

research

∙ 05/07/2021

Are Pre-trained Convolutions Better than Pre-trained Transformers?

In the era of pre-trained language models, Transformers are the de facto...

11 Yi Tay, et al. ∙

research

∙ 03/01/2021

OmniNet: Omnidirectional Representations from Transformers

This paper proposes Omnidirectional Representations from Transformers (O...

19 Yi Tay, et al. ∙

research

∙ 01/20/2021

Air-Ground Collaborative Mobile Edge Computing: Architecture, Challenges, and Opportunities

By pushing computation, cache, and network control to the edge, mobile e...

0 Zhen Qin, et al. ∙

research

∙ 12/21/2020

DeepKeyGen: A Deep Learning-based Stream Cipher Generator for Medical Image Encryption and Decryption

The need for medical image encryption is increasingly pronounced, for ex...

11 Yi Ding, et al. ∙

research

∙ 06/06/2020

Do RNN and LSTM have Long Memory?

The LSTM network was proposed to overcome the difficulty in learning lon...

0 Jingyu Zhao, et al. ∙

research

∙ 06/28/2019

An Improvement of PAA on Trend-Based Approximation for Time Series

Piecewise Aggregate Approximation (PAA) is a competitive basic dimension...

0 Chunkai Zhang, et al. ∙

research

∙ 09/15/2018

Multi-Task Learning for Email Search Ranking with Auxiliary Query Clustering

User information needs vary significantly across different tasks, and th...

0 Jiaming Shen, et al. ∙

Zhen Qin

Featured Co-authors