Building Cooperative Embodied Agents Modularly with Large Language Models

07/05/2023
by   Hongxin Zhang, et al.
0

Large Language Models (LLMs) have demonstrated impressive planning abilities in single-agent embodied tasks across various domains. However, their capacity for planning and communication in multi-agent cooperation remains unclear, even though these are crucial skills for intelligent embodied agents. In this paper, we present a novel framework that utilizes LLMs for multi-agent cooperation and tests it in various embodied environments. Our framework enables embodied agents to plan, communicate, and cooperate with other embodied agents or humans to accomplish long-horizon tasks efficiently. We demonstrate that recent LLMs, such as GPT-4, can surpass strong planning-based methods and exhibit emergent effective communication using our framework without requiring fine-tuning or few-shot prompting. We also discover that LLM-based agents that communicate in natural language can earn more trust and cooperate more effectively with humans. Our research underscores the potential of LLMs for embodied AI and lays the foundation for future research in multi-agent cooperation. Videos can be found on the project website https://vis-www.cs.umass.edu/Co-LLM-Agents/.

READ FULL TEXT

page 2

page 3

page 7

page 8

page 9

page 14

page 16

research
05/20/2018

Learning Attentional Communication for Multi-Agent Cooperation

Communication could potentially be an effective way for multi-agent coop...
research
04/22/2014

A Formal Analysis of Required Cooperation in Multi-agent Planning

Research on multi-agent planning has been popular in recent years. While...
research
06/05/2023

Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents

In this paper, we present a novel framework for enhancing the capabiliti...
research
05/13/2023

Investigating Emergent Goal-Like Behaviour in Large Language Models Using Experimental Economics

In this study, we investigate the capacity of large language models (LLM...
research
02/08/2020

SPA: Verbal Interactions between Agents and Avatars in Shared Virtual Environments using Propositional Planning

We present a novel approach for generating plausible verbal interactions...
research
10/15/2021

ToM2C: Target-oriented Multi-agent Communication and Cooperation with Theory of Mind

Being able to predict the mental states of others is a key factor to eff...
research
05/31/2023

Decision-Oriented Dialogue for Human-AI Collaboration

We describe a class of tasks called decision-oriented dialogues, in whic...

Please sign up or login with your details

Forgot password? Click here to reset