Can Large Language Models assist in Hazard Analysis?

03/25/2023
by   Simon Diemert, et al.
0

Large Language Models (LLMs), such as GPT-3, have demonstrated remarkable natural language processing and generation capabilities and have been applied to a variety tasks, such as source code generation. This paper explores the potential of integrating LLMs in the hazard analysis for safety-critical systems, a process which we refer to as co-hazard analysis (CoHA). In CoHA, a human analyst interacts with an LLM via a context-aware chat session and uses the responses to support elicitation of possible hazard causes. In this experiment, we explore CoHA with three increasingly complex versions of a simple system, using Open AI's ChatGPT service. The quality of ChatGPT's responses were systematically assessed to determine the feasibility of CoHA given the current state of LLM technology. The results suggest that LLMs may be useful for supporting human analysts performing hazard analysis.

READ FULL TEXT
research
08/09/2023

No Need to Lift a Finger Anymore? Assessing the Quality of Code Generation by ChatGPT

Large language models (LLMs) have demonstrated impressive capabilities a...
research
04/19/2023

How Secure is Code Generated by ChatGPT?

In recent years, large language models have been responsible for great a...
research
04/04/2023

Geotechnical Parrot Tales (GPT): Harnessing Large Language Models in geotechnical engineering

The widespread adoption of large language models (LLMs), such as OpenAI'...
research
04/02/2023

LLMMaps – A Visual Metaphor for Stratified Evaluation of Large Language Models

Large Language Models (LLMs) have revolutionized natural language proces...
research
04/11/2023

Toxicity in ChatGPT: Analyzing Persona-assigned Language Models

Large language models (LLMs) have shown incredible capabilities and tran...
research
04/26/2023

Evaluation of GPT-3.5 and GPT-4 for supporting real-world information needs in healthcare delivery

Despite growing interest in using large language models (LLMs) in health...
research
08/07/2023

A Cost Analysis of Generative Language Models and Influence Operations

Despite speculation that recent large language models (LLMs) are likely ...

Please sign up or login with your details

Forgot password? Click here to reset