What the F-measure doesn't measure: Features, Flaws, Fallacies and Fixes

03/22/2015
by   David M. W. Powers, et al.
0

The F-measure or F-score is one of the most commonly used single number measures in Information Retrieval, Natural Language Processing and Machine Learning, but it is based on a mistake, and the flawed assumptions render it unsuitable for use in most contexts! Fortunately, there are better alternatives.

READ FULL TEXT
research
07/27/2022

Lecture Notes on Neural Information Retrieval

These lecture notes focus on the recent advancements in neural informati...
research
11/10/2015

Information retrieval in folktales using natural language processing

Our aim is to extract information about literary characters in unstructu...
research
09/29/1998

Using Local Optimality Criteria for Efficient Information Retrieval with Redundant Information Filters

We consider information retrieval when the data, for instance multimedia...
research
06/26/2023

Inter-Annotator Agreement in the Wild: Uncovering Its Emerging Roles and Considerations in Real-World Scenarios

Inter-Annotator Agreement (IAA) is commonly used as a measure of label c...
research
12/14/2022

Explainability of Text Processing and Retrieval Methods: A Critical Survey

Deep Learning and Machine Learning based models have become extremely po...
research
09/30/2019

ATOL: Measure Vectorisation for Automatic Topologically-Oriented Learning

Robust topological information commonly comes in the form of a set of pe...

Please sign up or login with your details

Forgot password? Click here to reset