DeepAI AI Chat
Log In Sign Up

Everything You Always Wanted to Know About TREC RTS* (*But Were Afraid to Ask)

12/13/2017
by   Gilles Hubert, et al.
IRIT
0

The TREC Real-Time Summarization (RTS) track provides a framework for evaluating systems monitoring the Twitter stream and pushing tweets to users according to given profiles. It includes metrics, files, settings and hypothesis provided by the organizers. In this work, we perform a thorough analysis of each component of the framework used in 2016 and 2017 and found some limitations for the Scenario A of this track. Our main findings point out the weakness of the metrics and give clear recommendations to fairly reuse the collection.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/21/2021

How well do you know your summarization datasets?

State-of-the-art summarization systems are trained and evaluated on mass...
03/17/2019

A customisable pipeline for continuously harvesting socially-minded Twitter users

On social media platforms and Twitter in particular, specific classes of...
01/23/2020

Whose Tweets are Surveilled for the Police: An Audit of Social-Media Monitoring Tool via Log Files

Social media monitoring by law enforcement is becoming commonplace, but ...
12/04/2018

Unleashing the Power of Hashtags in Tweet Analytics with Distributed Framework on Apache Storm

Twitter is a popular social network platform where users can interact an...
02/02/2020

Investigating usability of MSstatsQC software

MSstatsQC [3] is an open-source software that provides longitudinal syst...