DeepAI AI Chat
Log In Sign Up

Adoption and implication of the Biased-Annotator Competence Estimation (BACE) model into COVID-19 vaccine Twitter data: Human annotation, valence prediction, and persuasiveness

by   Luhang Sun, et al.

Traditional quantitative content analysis approach (human coding method) has arbitrary weaknesses, such as assuming all human coders are equally accurate once the intercoder reliability for training reaches a threshold score. We adopt a new Bayesian statistical model in Political Science, the Biased-Annotator Competence Estimation (BACE) model (Tyler, 2021), into the Communication discipline, that draws on the Bayes rule. An important contribution of this model is it takes each coder's potential biases and reliability into consideration and assigns each coder a competence parameter for predicting the more accurate latent labels. In this extended abstract, we first criticize the weaknesses of conventional human coding; and then adopt the BACE model with COVID-19 vaccine Twitter data and compare BACE with other statistical models; finally, we look forward to adopting crowdsourcing as the next step to better understand the persuasiveness of COVID-19 vaccine social media content.


page 1

page 2

page 3

page 4


NAIST COVID: Multilingual COVID-19 Twitter and Weibo Dataset

Since the outbreak of coronavirus disease 2019 (COVID-19) in the late 20...

Identifying the Adoption or Rejection of Misinformation Targeting COVID-19 Vaccines in Twitter Discourse

Although billions of COVID-19 vaccines have been administered, too many ...

A First Look at COVID-19 Messages on WhatsApp in Pakistan

The worldwide spread of COVID-19 has prompted extensive online discussio...

How COVID-19 has Impacted American Attitudes Toward China: A Study on Twitter

Past research has studied social determinants of attitudes toward foreig...

An Exploratory Study of COVID-19 Misinformation on Twitter

Although a lot of correct and useful information is shared through chann...