Using Large Language Models for Interpreting Autonomous Robots Behaviors

The deployment of autonomous robots in various domains has raised significant concerns about their trustworthiness and accountability. This study explores the potential of Large Language Models (LLMs) in analyzing ROS 2 logs generated by autonomous robots and proposes a framework for log analysis that categorizes log files into different aspects. The study evaluates the performance of three different language models in answering questions related to StartUp, Warning, and PDDL logs. The results suggest that GPT 4, a transformer-based model, outperforms other models, however, their verbosity is not enough to answer why or how questions for all kinds of actors involved in the interaction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/15/2023

Can Large Language Models design a Robot?

Large Language Models can lead researchers in the design of robots....
research
06/15/2021

What Context Features Can Transformer Language Models Use?

Transformer-based language models benefit from conditioning on contexts ...
research
07/17/2023

LogPrécis: Unleashing Language Models for Automated Shell Log Analysis

The collection of security-related logs holds the key to understanding a...
research
07/24/2023

Leveraging Large Language Models (LLMs) for Process Mining (Technical Report)

This technical report describes the intersection of process mining and l...
research
03/21/2023

LogQA: Question Answering in Unstructured Logs

Modern systems produce a large volume of logs to record run-time status ...
research
07/05/2023

Abstractions, Scenarios, and Prompt Definitions for Process Mining with LLMs: A Case Study

Large Language Models (LLMs) are capable of answering questions in natur...
research
04/02/2023

Eight Things to Know about Large Language Models

The widespread public deployment of large language models (LLMs) in rece...

Please sign up or login with your details

Forgot password? Click here to reset