Rhetoric, Logic, and Dialectic: Advancing Theory-based Argument Quality Assessment in Natural Language Processing

06/01/2020
by   Anne Lauscher, et al.
0

Argumentative quality is an important feature of everyday writing in many textual domains, such as online reviews and question-and-answer (Q A) forums. Authors can improve their writing with feedback targeting individual aspects of argument quality (AQ), even though preceding work has mostly focused on assessing the overall AQ. These individual aspects are reflected in theory-based dimensions of argument quality, but automatic assessment in real-world texts is still in its infancy – a large-scale corpus and computational models are missing. In this work, we advance theory-based argument quality research by conducting an extensive analysis covering three diverse domains of online argumentative writing: Q A forums, debate forums, and review forums. We start with an annotation study with linguistic experts and crowd workers, resulting in the first large-scale English corpus annotated with theory-based argument quality scores, dubbed AQCorpus. Next, we propose the first computational approaches to theory-based argument quality assessment, which can serve as strong baselines for future work. Our research yields interesting findings including the feasibility of large-scale theory-based argument quality annotations, the fact that relations between theory-based argument quality dimensions can be exploited to yield performance improvements, and demonstrates the usefulness of theory-based argument quality predictions with respect to the practical AQ assessment view.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/03/2020

Creating a Domain-diverse Corpus for Theory-based Argument Quality Assessment

Computational models of argument quality (AQ) have focused primarily on ...
research
10/23/2020

Intrinsic Quality Assessment of Arguments

Several quality dimensions of natural language arguments have been inves...
research
05/24/2023

Modeling Appropriate Language in Argumentation

Online discussion moderators must make ad-hoc decisions about whether th...
research
06/01/2023

Predicting the Quality of Revisions in Argumentative Writing

The ability to revise in response to feedback is critical to students' w...
research
12/04/2019

Implicit Knowledge in Argumentative Texts: An Annotated Corpus

When speaking or writing, people omit information that seems clear and e...
research
06/21/2023

Utilizing Natural Language Processing for Automated Assessment of Classroom Discussion

Rigorous and interactive class discussions that support students to enga...
research
11/26/2019

A Large-scale Dataset for Argument Quality Ranking: Construction and Analysis

Identifying the quality of free-text arguments has become an important t...

Please sign up or login with your details

Forgot password? Click here to reset