Jian Jiao | DeepAI

DeepAI AI Chat

Featured Co-authors

Jianfeng Gao
236 publications
Qi Zhang
225 publications
Yan Zhang
185 publications
Furu Wei
173 publications
Xiao Liu
162 publications
Houqiang Li
133 publications
Nan Duan
120 publications
Xuanjing Huang
117 publications
Ming Zhou
107 publications
Ning Zhang
99 publications
Daxin Jiang
97 publications

∙ 05/16/2023

AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation

Diffusion models have gained significant attention in the realm of image...

0 Tong Wu, et al. ∙

∙ 05/16/2023

Dual-Alignment Pre-training for Cross-lingual Sentence Embedding

Recent studies have shown that dual encoder models trained with the sent...

0 Ziheng Li, et al. ∙

∙ 03/29/2023

AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators

Many natural language processing (NLP) tasks rely on labeled data to tra...

0 Xingwei He, et al. ∙

∙ 03/28/2023

Pre-training Transformers for Knowledge Graph Completion

Learning transferable representation of knowledge graphs (KGs) is challe...

0 Sanxing Chen, et al. ∙

∙ 12/18/2022

Curriculum Sampling for Dense Retrieval with Document Expansion

The dual-encoder has become the de facto architecture for dense retrieva...

0 Xingwei He, et al. ∙

∙ 12/15/2022

Efficient Long Sequence Modeling via State Space Augmented Transformer

Transformer models have achieved superior performance in various natural...

0 Simiao Zuo, et al. ∙

∙ 12/10/2022

LEAD: Liberal Feature-based Distillation for Dense Retrieval

Knowledge distillation is often used to transfer knowledge from a strong...

0 Hao Sun, et al. ∙

∙ 10/21/2022

Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoning

Commonsense generation aims to generate a realistic sentence describing ...

0 Xingwei He, et al. ∙

∙ 09/27/2022

PROD: Progressive Distillation for Dense Retrieval

Knowledge distillation is an effective way to transfer knowledge from a ...

7 Zhenghao Lin, et al. ∙

∙ 08/17/2022

The Counterfactual-Shapley Value: Attributing Change in System Metrics

Given an unexpected change in the output metric of a large-scale system,...

0 Amit Sharma, et al. ∙

∙ 07/10/2022

NGAME: Negative Mining-aware Mini-batching for Extreme Classification

Extreme Classification (XC) seeks to tag data points with the most relev...

11 Kunal Dahiya, et al. ∙

∙ 05/23/2022

A Self-Paced Mixed Distillation Method for Non-Autoregressive Generation

Non-Autoregressive generation is a sequence generation paradigm, which r...

0 Weizhen Qi, et al. ∙

∙ 04/04/2022

Age of Information with Hybrid-ARQ: A Unified Explicit Result

Delivering timely status updates in a timeliness-critical communication ...

0 Aimin Li, et al. ∙

∙ 10/08/2021

Taming Sparsely Activated Transformer with Stochastic Experts

Sparsely activated models (SAMs), such as Mixture-of-Experts (MoE), can ...

2 Simiao Zuo, et al. ∙

∙ 09/14/2021

KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning

Pre-trained language models have led to substantial gains over a broad r...

5 Haonan Li, et al. ∙

∙ 03/25/2021

Mask Attention Networks: Rethinking and Strengthen Transformer

Transformer is an attention-based neural network, which consists of two ...

0 Zhihao Fan, et al. ∙

∙ 01/20/2021

Spinal Codes Optimization: Error Probability Analysis and Transmission Scheme Design

Spinal codes are known to be capacity achieving over both the additive w...

0 Aimin Li, et al. ∙

∙ 12/01/2020

An Enhanced Knowledge Injection Model for Commonsense Generation

Commonsense generation aims at generating plausible everyday scenario de...

0 Zhihao Fan, et al. ∙

∙ 10/21/2020

ProphetNet-Ads: A Looking Ahead Strategy for Generative Retrieval Models in Sponsored Search Engine

In a sponsored search engine, generative retrieval models are recently p...

9 Weizhen Qi, et al. ∙

∙ 08/28/2020

HittER: Hierarchical Transformers for Knowledge Graph Embeddings

This paper examines the challenging problem of learning representations ...

0 Sanxing Chen, et al. ∙

∙ 02/14/2020

TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval

Pre-trained language models like BERT have achieved great success in a w...

0 Wenhao Lu, et al. ∙

∙ 11/27/2018

MagicVO: End-to-End Monocular Visual Odometry through Deep Bi-directional Recurrent Convolutional Neural Network

This paper proposes a new framework to solve the problem of monocular vi...

0 Jian Jiao, et al. ∙

∙ 05/25/2018

A Novel High-Rate Polar-Staircase Coding Scheme

The long-haul communication systems can offer ultra high-speed data tran...

0 Bowen Feng, et al. ∙

∙ 02/18/2018

Recurrent Binary Embedding for GPU-Enabled Exhaustive Retrieval from Billion-Scale Semantic Vectors

Rapid advances in GPU hardware and multiple areas of Deep Learning open ...

0 Ying Shan, et al. ∙