From Cooking Recipes to Robot Task Trees – Improving Planning Correctness and Task Efficiency by Leveraging LLMs with a Knowledge Network

09/17/2023
by   Md Sadman Sakib, et al.
0

Task planning for robotic cooking involves generating a sequence of actions for a robot to prepare a meal successfully. This paper introduces a novel task tree generation pipeline producing correct planning and efficient execution for cooking tasks. Our method first uses a large language model (LLM) to retrieve recipe instructions and then utilizes a fine-tuned GPT-3 to convert them into a task tree, capturing sequential and parallel dependencies among subtasks. The pipeline then mitigates the uncertainty and unreliable features of LLM outputs using task tree retrieval. We combine multiple LLM task tree outputs into a graph and perform a task tree retrieval to avoid questionable nodes and high-cost nodes to improve planning correctness and improve execution efficiency. Our evaluation results show its superior performance compared to previous works in task planning accuracy and efficiency.

READ FULL TEXT

page 1

page 5

research
06/01/2021

Evaluating Recipes Generated from Functional Object-Oriented Network

The functional object-oriented network (FOON) has been introduced as a k...
research
08/20/2023

ChatEDA: A Large Language Model Powered Autonomous Agent for EDA

The integration of a complex set of Electronic Design Automation (EDA) t...
research
07/12/2022

Long-Horizon Task and Motion Planning with Functional Object-Oriented Networks

Following work on joint object-action representations, functional object...
research
08/30/2023

Interactively Robot Action Planning with Uncertainty Analysis and Active Questioning by Large Language Model

The application of the Large Language Model (LLM) to robot action planni...
research
02/17/2018

HyP-DESPOT: A Hybrid Parallel Algorithm for Online Planning under Uncertainty

Planning under uncertainty is critical for robust robot performance in u...
research
06/08/2023

Robot Task Planning Based on Large Language Model Representing Knowledge with Directed Graph Structures

Traditional robot task planning methods face challenges when dealing wit...
research
05/30/2023

LLM-BRAIn: AI-driven Fast Generation of Robot Behaviour Tree based on Large Language Model

This paper presents a novel approach in autonomous robot control, named ...

Please sign up or login with your details

Forgot password? Click here to reset