Towards ethical multimodal systems

04/26/2023
by   Alexis Roger, et al.
0

The impact of artificial intelligence systems on our society is increasing at an unprecedented speed. For instance, ChatGPT is being tested in mental health treatment applications such as Koko, Stable Diffusion generates pieces of art competitive with (or outperforming) human artists, and so on. Ethical concerns regarding the behavior and applications of generative AI systems have been increasing over the past years, and the field of AI alignment - steering the behavior of AI systems towards being aligned with human values - is a rapidly growing subfield of modern AI. In this paper, we address the challenges involved in ethical evaluation of a multimodal artificial intelligence system. The multimodal systems we focus on take both text and an image as input and output text, completing the sentence or answering the question asked as input. We perform the evaluation of these models in two steps: we first discus the creation of a multimodal ethical database and then use this database to construct morality-evaluating algorithms. The creation of the multimodal ethical database is done interactively through human feedback. Users are presented with multiple examples and votes on whether they are ethical or not. Once these answers have been aggregated into a dataset, we built and tested different algorithms to automatically evaluate the morality of multimodal systems. These algorithms aim to classify the answers as ethical or not. The models we tested are a RoBERTa-large classifier and a multilayer perceptron classifier.

READ FULL TEXT
research
05/16/2017

Ethical Artificial Intelligence - An Open Question

Artificial Intelligence (AI) is an effective science which employs stron...
research
05/04/2019

Ethically Aligned Design: An empirical evaluation of the RESOLVEDD-strategy in Software and Systems development context

Use of artificial intelligence (AI) in human contexts calls for ethical ...
research
08/04/2023

From Military to Healthcare: Adopting and Expanding Ethical Principles for Generative Artificial Intelligence

In 2020, the U.S. Department of Defense officially disclosed a set of et...
research
12/23/2022

Ethical Design of Computers: From Semiconductors to IoT and Artificial Intelligence

Computing systems are tightly integrated today into our professional, so...
research
04/02/2019

Augmented Utilitarianism for AGI Safety

In the light of ongoing progresses of research on artificial intelligent...
research
07/19/2022

Mimetic Models: Ethical Implications of AI that Acts Like You

An emerging theme in artificial intelligence research is the creation of...
research
07/19/2021

Independent Ethical Assessment of Text Classification Models: A Hate Speech Detection Case Study

An independent ethical assessment of an artificial intelligence system i...

Please sign up or login with your details

Forgot password? Click here to reset