A New Data Integration Framework for Covid-19 Social Media Information

10/08/2021
by   Lauren Ansell, et al.
0

The Covid-19 pandemic presents a serious threat to people's health, resulting in over 250 million confirmed cases and over 5 million deaths globally. In order to reduce the burden on national health care systems and to mitigate the effects of the outbreak, accurate modelling and forecasting methods for short- and long-term health demand are needed to inform government interventions aiming at curbing the pandemic. Current research on Covid-19 is typically based on a single source of information, specifically on structured historical pandemic data. Other studies are exclusively focused on unstructured online retrieved insights, such as data available from social media. However, the combined use of structured and unstructured information is still uncharted. This paper aims at filling this gap, by leveraging historical as well as social media information with a novel data integration methodology. The proposed approach is based on vine copulas, which allow us to improve predictions by exploiting the dependencies between different sources of information. We apply the methodology to combine structured datasets retrieved from official sources and to a big unstructured dataset of information collected from social media. The results show that the proposed approach, compared to traditional approaches, yields more accurate estimations and predictions of the evolution of the Covid-19 pandemic.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/30/2021

COVID-19 UK Social Media Dataset for Public Health Research: Methodology for Collection and Processing

We present a benchmark database of public social media postings from the...
research
04/05/2021

Social Media Integration of Flood Data: A Vine Copula-Based Approach

Floods are the most common and among the most severe natural disasters i...
research
11/09/2020

Challenges and Opportunities in Rapid Epidemic Information Propagation with Live Knowledge Aggregation from Social Media

A rapidly evolving situation such as the COVID-19 pandemic is a signific...
research
05/24/2022

COVID-19: An exploration of consecutive systemic barriers to pathogen-related data sharing during a pandemic

In 2020, the COVID-19 pandemic resulted in a rapid response from governm...
research
07/03/2023

A novel approach for predicting epidemiological forecasting parameters based on real-time signals and Data Assimilation

This paper proposes a novel approach to predict epidemiological paramete...
research
07/25/2023

A Primer on the Data Cleaning Pipeline

The availability of both structured and unstructured databases, such as ...
research
05/26/2010

Integrating Structured Metadata with Relational Affinity Propagation

Structured and semi-structured data describing entities, taxonomies and ...

Please sign up or login with your details

Forgot password? Click here to reset