Towards VEsNA, a Framework for Managing Virtual Environments via Natural Language Agents

07/20/2022
by   Andrea Gatti, et al.
0

Automating a factory where robots are involved is neither trivial nor cheap. Engineering the factory automation process in such a way that return of interest is maximized and risk for workers and equipment is minimized, is hence of paramount importance. Simulation can be a game changer in this scenario but requires advanced programming skills that domain experts and industrial designers might not have. In this paper we present the preliminary design and implementation of a general-purpose framework for creating and exploiting Virtual Environments via Natural language Agents (VEsNA). VEsNA takes advantage of agent-based technologies and natural language processing to enhance the design of virtual environments. The natural language input provided to VEsNA is understood by a chatbot and passed to a cognitive intelligent agent that implements the logic behind displacing objects in the virtual environment. In the VEsNA vision, the intelligent agent will be able to reason on this displacement and on its compliance to legal and normative constraints. It will also be able to implement what-if analysis and case-based reasoning. Objects populating the virtual environment will include active objects and will populate a dynamic simulation whose outcomes will be interpreted by the cognitive agent; explanations and suggestions will be passed back to the user by the chatbot.

READ FULL TEXT

page 2

page 9

page 11

research
02/08/2020

SPA: Verbal Interactions between Agents and Avatars in Shared Virtual Environments using Propositional Planning

We present a novel approach for generating plausible verbal interactions...
research
07/17/2011

From decision to action : intentionality, a guide for the specification of intelligent agents' behaviour

This article introduces a reflexion about behavioural specification for ...
research
03/01/2019

Improving Grounded Natural Language Understanding through Human-Robot Dialog

Natural language understanding for robotics can require substantial doma...
research
05/16/2017

Text-based Adventures of the Golovin AI Agent

The domain of text-based adventure games has been recently established a...
research
08/28/2021

DASH: Modularized Human Manipulation Simulation with Vision and Language for Embodied AI

Creating virtual humans with embodied, human-like perceptual and actuati...
research
04/05/2019

Domain Authoring Assistant for Intelligent Virtual Agents

Developing intelligent virtual characters has attracted a lot of attenti...
research
02/20/2014

A logical model of Theory of Mind for virtual agents in the context of job interview simulation

Job interview simulation with a virtual agents aims at improving people'...

Please sign up or login with your details

Forgot password? Click here to reset