Epicurus at SemEval-2023 Task 4: Improving Prediction of Human Values behind Arguments by Leveraging Their Definitions

02/27/2023
by   Christian Fang, et al.
0

We describe our experiments for SemEval-2023 Task 4 on the identification of human values behind arguments (ValueEval). Because human values are subjective concepts which require precise definitions, we hypothesize that incorporating the definitions of human values (in the form of annotation instructions and validated survey items) during model training can yield better prediction performance. We explore this idea and show that our proposed models perform better than the challenge organizers' baselines, with improvements in macro F1 scores of up to 18

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/31/2023

The Touché23-ValueEval Dataset for Identifying Human Values behind Arguments

We present the Touché23-ValueEval Dataset for Identifying Human Values b...
research
05/15/2023

Adam-Smith at SemEval-2023 Task 4: Discovering Human Values in Arguments with Ensembles of Transformer-based Models

This paper presents the best-performing approach alias "Adam Smith" for ...
research
06/01/2023

Did You Read the Instructions? Rethinking the Effectiveness of Task Definitions in Instruction Learning

Large language models (LLMs) have shown impressive performance in follow...
research
11/30/2021

What to Learn, and How: Toward Effective Learning from Rationales

Learning from rationales seeks to augment model training with human-prov...
research
05/24/2021

Towards Standard Criteria for human evaluation of Chatbots: A Survey

Human evaluation is becoming a necessity to test the performance of Chat...
research
12/17/2020

Benchmarking Automatic Detection of Psycholinguistic Characteristics for Better Human-Computer Interaction

When two people pay attention to each other and are interested in what t...
research
05/31/2023

Human Control: Definitions and Algorithms

How can humans stay in control of advanced artificial intelligence syste...

Please sign up or login with your details

Forgot password? Click here to reset