Influenza Surveillance using Search Engine, SNS, On-line Shopping, Q A Service and Past Flu Patients

by   Taichi Murayama, et al.

Influenza, an infectious disease, causes many deaths worldwide. Predicting influenza victims during epidemics is an important task for clinical, hospital, and community outbreak preparation. On-line user-generated contents (UGC), primarily in the form of social media posts or search query logs, are generally used for prediction for reaction to sudden and unusual outbreaks. However, most studies rely only on the UGC as their resource and do not use various UGCs. Our study aims to solve these questions about Influenza prediction: Which model is the best? What combination of multiple UGCs works well? What is the nature of each UGC? We adapt some models, LASSO Regression, Huber Regression, Support Vector Machine regression with Linear kernel (SVR) and Random Forest, to test the influenza volume prediction in Japan during 2015 - 2018. For that, we use on-line five data resources: (1) past flu patients, (2) SNS (Twitter), (3) search engines (Yahoo! Japan), (4) shopping services (Yahoo! Shopping), and (5) Q A services (Yahoo! Chiebukuro) as resources of each model. We then validate respective resources contributions using the best model, Huber Regression, with all resources except one resource. Finally, we use Bayesian change point method for ascertaining whether the trend of time series on any resources is reflected in the trend of flu patient count or not. Our experiments show Huber Regression model based on various data resources produces the most accurate results. Then, from the change point analysis, we get the result that search query logs and social media posts for three years represents these resources as a good predictor. Conclusions: We show that Huber Regression based on various data resources is strong for outliers and is suitable for the flu prediction. Additionally, we indicate the characteristics of each resource for the flu prediction.


page 1

page 2

page 3

page 4


Predicting the Popularity of Reddit Posts with AI

Social media creates crucial mass changes, as popular posts and opinions...

Using Micro-collections in Social Media to Generate Seeds for Web Archive Collections

In a Web plagued by disappearing resources, Web archive collections prov...

Seasonal-adjustment Based Feature Selection Method for Large-scale Search Engine Logs

Search engine logs have a great potential in tracking and predicting out...

Subjective Metrics-based Cloud Market Performance Prediction

This paper explores an effective machine learning approach to predict cl...

WeSeer: Visual Analysis for Better Information Cascade Prediction of WeChat Articles

Social media, such as Facebook and WeChat, empowers millions of users to...

Machine Learning Based Detection of Clickbait Posts in Social Media

Clickbait (headlines) make use of misleading titles that hide critical i...