Dense Feature Memory Augmented Transformers for COVID-19 Vaccination Search Classification

12/16/2022
by   Jai Gupta, et al.
0

With the devastating outbreak of COVID-19, vaccines are one of the crucial lines of defense against mass infection in this global pandemic. Given the protection they provide, vaccines are becoming mandatory in certain social and professional settings. This paper presents a classification model for detecting COVID-19 vaccination related search queries, a machine learning model that is used to generate search insights for COVID-19 vaccinations. The proposed method combines and leverages advancements from modern state-of-the-art (SOTA) natural language understanding (NLU) techniques such as pretrained Transformers with traditional dense features. We propose a novel approach of considering dense features as memory tokens that the model can attend to. We show that this new modeling approach enables a significant improvement to the Vaccine Search Insights (VSI) task, improving a strong well-established gradient-boosting baseline by relative +15

READ FULL TEXT
research
05/21/2020

SpotFast Networks with Memory Augmented Lateral Transformers for Lipreading

This paper presents a novel deep learning architecture for word-level li...
research
07/02/2021

Google COVID-19 Vaccination Search Insights: Anonymization Process Description

This report describes the aggregation and anonymization process applied ...
research
03/01/2021

Combat COVID-19 Infodemic Using Explainable Natural Language Processing Models

Misinformation of COVID-19 is prevalent on social media as the pandemic ...
research
05/21/2020

Coswara – A Database of Breathing, Cough, and Voice Sounds for COVID-19 Diagnosis

The COVID-19 pandemic presents global challenges transcending boundaries...
research
05/04/2020

Is Time to Intervention in the COVID-19 Outbreak Really Important? A Global Sensitivity Analysis Approach

Italy has been one of the first countries timewise strongly impacted by ...
research
10/22/2021

Multiwave COVID-19 Prediction via Social Awareness-Based Graph Neural Networks using Mobility and Web Search Data

Recurring outbreaks of COVID-19 have posed enduring effects on global so...

Please sign up or login with your details

Forgot password? Click here to reset