DeepAI AI Chat
Log In Sign Up

Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences

by   Denis Emelin, et al.

In social settings, much of human behavior is governed by unspoken rules of conduct. For artificial systems to be fully integrated into social environments, adherence to such norms is a central prerequisite. We investigate whether contemporary NLG models can function as behavioral priors for systems deployed in social settings by generating action hypotheses that achieve predefined goals under moral constraints. Moreover, we examine if models can anticipate likely consequences of (im)moral actions, or explain why certain actions are preferable by generating relevant norms. For this purpose, we introduce 'Moral Stories', a crowd-sourced dataset of structured, branching narratives for the study of grounded, goal-oriented social reasoning. Finally, we propose decoding strategies that effectively combine multiple expert models to significantly improve the quality of generated actions, consequences, and norms compared to strong baselines, e.g. though abductive reasoning.


page 1

page 5

page 15

page 16

page 17

page 18

page 21


Bayesian Inference of Social Norms as Shared Constraints on Behavior

People act upon their desires, but often, also act in adherence to impli...

Value Engineering for Autonomous Agents

Machine Ethics (ME) is concerned with the design of Artificial Moral Age...

Social Chemistry 101: Learning to Reason about Social and Moral Norms

Social norms—the unspoken commonsense rules about acceptable social beha...

Practical Reasoning with Norms for Autonomous Software Agents (Full Edition)

Autonomous software agents operating in dynamic environments need to con...

Learning to Act Properly: Predicting and Explaining Affordances from Images

We address the problem of affordance reasoning in diverse scenes that ap...

A Framework for Automatic Monitoring of Norms that regulate Time Constrained Actions

This paper addresses the problem of proposing a model of norms and a fra...

That's Mine! Learning Ownership Relations and Norms for Robots

The ability for autonomous agents to learn and conform to human norms is...

Code Repositories


Data and code for the "Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences" (Emelin et al., 2020) paper.

view repo