Everything You Always Wanted to Know About TREC RTS* (*But Were Afraid to Ask)

12/13/2017
by   Gilles Hubert, et al.
0

The TREC Real-Time Summarization (RTS) track provides a framework for evaluating systems monitoring the Twitter stream and pushing tweets to users according to given profiles. It includes metrics, files, settings and hypothesis provided by the organizers. In this work, we perform a thorough analysis of each component of the framework used in 2016 and 2017 and found some limitations for the Scenario A of this track. Our main findings point out the weakness of the metrics and give clear recommendations to fairly reuse the collection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/18/2022

From Hesitancy Framings to Vaccine Hesitancy Profiles: A Journey of Stance, Ontological Commitments and Moral Foundations

While billions of COVID-19 vaccines have been administered, too many peo...
research
06/21/2021

How well do you know your summarization datasets?

State-of-the-art summarization systems are trained and evaluated on mass...
research
03/17/2019

A customisable pipeline for continuously harvesting socially-minded Twitter users

On social media platforms and Twitter in particular, specific classes of...
research
01/23/2020

Whose Tweets are Surveilled for the Police: An Audit of Social-Media Monitoring Tool via Log Files

Social media monitoring by law enforcement is becoming commonplace, but ...
research
12/04/2018

Unleashing the Power of Hashtags in Tweet Analytics with Distributed Framework on Apache Storm

Twitter is a popular social network platform where users can interact an...
research
02/02/2020

Investigating usability of MSstatsQC software

MSstatsQC [3] is an open-source software that provides longitudinal syst...

Please sign up or login with your details

Forgot password? Click here to reset