Local Citation Recommendation with Hierarchical-Attention Text Encoder and SciBERT-based Reranking

12/02/2021
by   Nianlong Gu, et al.
0

The goal of local citation recommendation is to recommend a missing reference from the local citation context and optionally also from the global context. To balance the tradeoff between speed and accuracy of citation recommendation in the context of a large-scale paper database, a viable approach is to first prefetch a limited number of relevant documents using efficient ranking methods and then to perform a fine-grained reranking using more sophisticated models. In that vein, BM25 has been found to be a tough-to-beat approach to prefetching, which is why recent work has focused mainly on the reranking step. Even so, we explore prefetching with nearest neighbor search among text embeddings constructed by a hierarchical attention network. When coupled with a SciBERT reranker fine-tuned on local citation recommendation tasks, our hierarchical Attention encoder (HAtten) achieves high prefetch recall for a given number of candidates to be reranked. Consequently, our reranker needs to rerank fewer prefetch candidates, yet still achieves state-of-the-art performance on various local citation recommendation datasets such as ACL-200, FullTextPeerRead, RefSeer, and arXiv.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/15/2020

HybridCite: A Hybrid Model for Context-Aware Citation Recommendation

Citation recommendation systems aim to recommend citations for either a ...
research
06/20/2021

Context-Aware Legal Citation Recommendation using Deep Learning

Lawyers and judges spend a large amount of time researching the proper l...
research
04/22/2021

Hybrid Encoder: Towards Efficient and Precise Native AdsRecommendation via Hybrid Transformer Encoding Networks

Transformer encoding networks have been proved to be a powerful tool of ...
research
10/01/2020

Dual Attention Model for Citation Recommendation

Based on an exponentially increasing number of academic articles, discov...
research
03/15/2019

A Context-Aware Citation Recommendation Model with BERT and Graph Convolutional Networks

With the tremendous growth in the number of scientific papers being publ...
research
02/22/2018

Content-Based Citation Recommendation

We present a content-based method for recommending citations in an acade...
research
10/03/2020

Multilevel Text Alignment with Cross-Document Attention

Text alignment finds application in tasks such as citation recommendatio...

Please sign up or login with your details

Forgot password? Click here to reset