Applying Standards to Advance Upstream Downstream Ethics in Large Language Models

06/06/2023
by   Jose Berengueres, et al.
0

This paper explores how AI-owners can develop safeguards for AI-generated content by drawing from established codes of conduct and ethical standards in other content-creation industries. It delves into the current state of ethical awareness on Large Language Models (LLMs). By dissecting the mechanism of content generation by LLMs, four key areas (upstream/downstream and at user prompt/answer), where safeguards could be effectively applied, are identified. A comparative analysis of these four areas follows and includes an evaluation of the existing ethical safeguards in terms of cost, effectiveness, and alignment with established industry practices. The paper's key argument is that existing IT-related ethical codes, while adequate for traditional IT engineering, are inadequate for the challenges posed by LLM-based content generation. Drawing from established practices within journalism, we propose potential standards for businesses involved in distributing and selling LLM-generated content. Finally, potential conflicts of interest between dataset curation at upstream and ethical benchmarking downstream are highlighted to underscore the need for a broader evaluation beyond mere output. This study prompts a nuanced conversation around ethical implications in this rapidly evolving field of content generation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2023

Auditing large language models: a three-layered approach

The emergence of large language models (LLMs) represents a major advance...
research
07/05/2023

Citation: A Key to Building Responsible and Accountable Large Language Models

Large Language Models (LLMs) bring transformative benefits alongside uni...
research
06/20/2023

TrustGPT: A Benchmark for Trustworthy and Responsible Large Language Models

Large Language Models (LLMs) such as ChatGPT, have gained significant at...
research
10/28/2020

Towards Ethics by Design in Online Abusive Content Detection

To support safety and inclusion in online communications, significant ef...
research
06/02/2023

Prototyping the use of Large Language Models (LLMs) for adult learning content creation at scale

As Large Language Models (LLMs) and other forms of Generative AI permeat...
research
11/05/2020

Knowledge-Base Practicality for Cybersecurity Research Ethics Evaluation

Research ethics in Information and Communications Technology has seen a ...
research
05/29/2023

Voluminous yet Vacuous? Semantic Capital in an Age of Large Language Models

Large Language Models (LLMs) have emerged as transformative forces in th...

Please sign up or login with your details

Forgot password? Click here to reset