RLTM: An Efficient Neural IR Framework for Long Documents

06/22/2019
by   Chen Zheng, et al.
0

Deep neural networks have achieved significant improvements in information retrieval (IR). However, most existing models are computational costly and can not efficiently scale to long documents. This paper proposes a novel End-to-End neural ranking framework called Reinforced Long Text Matching (RLTM) which matches a query with long documents efficiently and effectively. The core idea behind the framework can be analogous to the human judgment process which firstly locates the relevance parts quickly from the whole document and then matches these parts with the query carefully to obtain the final label. Firstly, we select relevant sentences from the long documents by a coarse and efficient matching model. Secondly, we generate a relevance score by a more sophisticated matching model based on the sentence selected. The whole model is trained jointly with reinforcement learning in a pairwise manner by maximizing the expected score gaps between positive and negative examples. Experimental results demonstrate that RLTM has greatly improved the efficiency and effectiveness of the state-of-the-art models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/01/2018

DeepTileBars: Visualizing Term Distribution for Neural Information Retrieval

Most neural Information Retrieval (Neu-IR) models derive query-to-docume...
research
10/16/2017

DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrieval

This paper concerns a deep learning approach to relevance ranking in inf...
research
11/06/2016

Hierarchical Question Answering for Long Documents

We present a framework for question answering that can efficiently scale...
research
06/23/2021

Learnt Sparsity for Effective and Interpretable Document Ranking

Machine learning models for the ad-hoc retrieval of documents and passag...
research
06/15/2017

DSRIM: A Deep Neural Information Retrieval Model Enhanced by a Knowledge Resource Driven Representation of Documents

The state-of-the-art solutions to the vocabulary mismatch in information...
research
06/20/2017

End-to-End Neural Ad-hoc Ranking with Kernel Pooling

This paper proposes K-NRM, a kernel based neural model for document rank...
research
08/08/2021

PoolRank: Max/Min Pooling-based Ranking Loss for Listwise Learning Ranking Balance

Numerous neural retrieval models have been proposed in recent years. The...

Please sign up or login with your details

Forgot password? Click here to reset