Multiple Meta-model Quantifying for Medical Visual Question Answering

05/19/2021
by   Tuong Do, et al.
0

Transfer learning is an important step to extract meaningful features and overcome the data limitation in the medical Visual Question Answering (VQA) task. However, most of the existing medical VQA methods rely on external data for transfer learning, while the meta-data within the dataset is not fully utilized. In this paper, we present a new multiple meta-model quantifying method that effectively learns meta-annotation and leverages meaningful features to the medical VQA task. Our proposed method is designed to increase meta-data by auto-annotation, deal with noisy labels, and output meta-models which provide robust features for medical VQA tasks. Extensively experimental results on two public medical VQA datasets show that our approach achieves superior accuracy in comparison with other state-of-the-art methods, while does not require external data to train meta-models.

READ FULL TEXT

page 14

page 15

research
09/26/2019

Overcoming Data Limitation in Medical Visual Question Answering

Traditional approaches for Visual Question Answering (VQA) require large...
research
10/06/2021

Coarse-to-Fine Reasoning for Visual Question Answering

Bridging the semantic gap between image and question is an important ste...
research
11/19/2021

Medical Visual Question Answering: A Survey

Medical Visual Question Answering (VQA) is a combination of medical arti...
research
02/18/2021

SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answering

Medical visual question answering (Med-VQA) has tremendous potential in ...
research
04/05/2019

Actively Seeking and Learning from Live Data

One of the key limitations of traditional machine learning methods is th...
research
05/28/2019

Leveraging Medical Visual Question Answering with Supporting Facts

In this working notes paper, we describe IBM Research AI (Almaden) team'...
research
02/01/2022

Research on Question Classification Methods in the Medical Field

Question classification is one of the important links in the research of...

Please sign up or login with your details

Forgot password? Click here to reset