Intrinsic Quality Assessment of Arguments

10/23/2020
by   Henning Wachsmuth, et al.
0

Several quality dimensions of natural language arguments have been investigated. Some are likely to be reflected in linguistic features (e.g., an argument's arrangement), whereas others depend on context (e.g., relevance) or topic knowledge (e.g., acceptability). In this paper, we study the intrinsic computational assessment of 15 dimensions, i.e., only learning from an argument's text. In systematic experiments with eight feature types on an existing corpus, we observe moderate but significant learning success for most dimensions. Rhetorical quality seems hardest to assess, and subjectivity features turn out strong, although length bias in the corpus impedes full validity. We also find that human assessors differ more clearly to each other than to our approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2020

Rhetoric, Logic, and Dialectic: Advancing Theory-based Argument Quality Assessment in Natural Language Processing

Argumentative quality is an important feature of everyday writing in man...
research
05/24/2023

Modeling Appropriate Language in Argumentation

Online discussion moderators must make ad-hoc decisions about whether th...
research
11/03/2020

Creating a Domain-diverse Corpus for Theory-based Argument Quality Assessment

Computational models of argument quality (AQ) have focused primarily on ...
research
09/03/2019

Automatic Argument Quality Assessment -- New Datasets and Methods

We explore the task of automatic assessment of argument quality. To that...
research
01/25/2021

Learning From Revisions: Quality Assessment of Claims in Argumentation at Scale

Assessing the quality of arguments and of the claims the arguments are c...
research
11/26/2019

A Large-scale Dataset for Argument Quality Ranking: Construction and Analysis

Identifying the quality of free-text arguments has become an important t...
research
12/06/2022

Cube Interestingness: Novelty, Relevance, Peculiarity and Surprise

In this paper, we discuss methods to assess the interestingness of a que...

Please sign up or login with your details

Forgot password? Click here to reset