Log In Sign Up

Scruples: A Corpus of Community Ethical Judgments on 32,000 Real-Life Anecdotes

by   Nicholas Lourie, et al.

As AI systems become an increasing part of people's everyday lives, it becomes ever more important that they understand people's ethical norms. Motivated by descriptive ethics, a field of study that focuses on people's descriptive judgments rather than theoretical prescriptions on morality, we investigate a novel, data-driven approach to machine ethics. We introduce Scruples, the first large-scale dataset with 625,000 ethical judgments over 32,000 real-life anecdotes. Each anecdote recounts a complex ethical situation, often posing moral dilemmas, paired with a distribution of judgments contributed by the community members. Our dataset presents a major challenge to state-of-the-art neural language models, leaving significant room for improvement. However, when presented with simplified moral situations, the results are considerably more promising, suggesting that neural models can effectively learn simpler ethical building blocks. A key take-away of our empirical analysis is that norms are not always clean-cut; many situations are naturally divisive. We present a new method to estimate the best possible performance on such tasks with inherently diverse label distributions, and explore likelihood functions that separate intrinsic from model uncertainty.


page 1

page 2

page 3

page 4


Social Chemistry 101: Learning to Reason about Social and Moral Norms

Social norms—the unspoken commonsense rules about acceptable social beha...

An Ethical Highlighter for People-Centric Dataset Creation

Important ethical concerns arising from computer vision datasets of peop...

Implementing AI Ethics in Practice: An Empirical Evaluation of the RESOLVEDD Strategy

As Artificial Intelligence (AI) systems exert a growing influence on soc...

Thou Shalt is not You Will

In this paper we discuss some reasons why temporal logic might not be su...

Delphi: Towards Machine Ethics and Norms

What would it take to teach a machine to behave ethically? While broad e...

Building Ethically Bounded AI

The more AI agents are deployed in scenarios with possibly unexpected si...

Ethical and Fairness Implications of Model Multiplicity

While predictive models are a purely technological feat, they may operat...

Code Repositories


A corpus and code for understanding norms and subjectivity. 🤖

view repo