Empowering Language Model with Guided Knowledge Fusion for Biomedical Document Re-ranking

05/07/2023
by   Deepak Gupta, et al.
0

Pre-trained language models (PLMs) have proven to be effective for document re-ranking task. However, they lack the ability to fully interpret the semantics of biomedical and health-care queries and often rely on simplistic patterns for retrieving documents. To address this challenge, we propose an approach that integrates knowledge and the PLMs to guide the model toward effectively capturing information from external sources and retrieving the correct documents. We performed comprehensive experiments on two biomedical and open-domain datasets that show that our approach significantly improves vanilla PLMs and other existing approaches for document re-ranking task.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/26/2022

Extracting Biomedical Factual Knowledge Using Pretrained Language Model and Electronic Health Record Context

Language Models (LMs) have performed well on biomedical natural language...
research
10/10/2022

Readability Controllable Biomedical Document Summarization

Different from general documents, it is recognised that the ease with wh...
research
05/24/2023

Fusion-in-T5: Unifying Document Ranking Signals for Improved Information Retrieval

Common IR pipelines are typically cascade systems that may involve multi...
research
08/29/2017

Design Patterns for Fusion-Based Object Retrieval

We address the task of ranking objects (such as people, blogs, or vertic...
research
10/08/2022

KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understanding

With the advent of pre-trained language models (LMs), increasing researc...
research
12/13/2021

Explanation Container in Case-Based Biomedical Question-Answering

The National Center for Advancing Translational Sciences(NCATS) Biomedic...
research
07/16/2018

Repeatability Corner Cases in Document Ranking: The Impact of Score Ties

Document ranking experiments should be repeatable: running the same rank...

Please sign up or login with your details

Forgot password? Click here to reset