PEARL: Parallelized Expert-Assisted Reinforcement Learning for Scene Rearrangement Planning

05/10/2021
by   Hanqing Wang, et al.
0

Scene Rearrangement Planning (SRP) is an interior task proposed recently. The previous work defines the action space of this task with handcrafted coarse-grained actions that are inflexible to be used for transforming scene arrangement and intractable to be deployed in practice. Additionally, this new task lacks realistic indoor scene rearrangement data to feed popular data-hungry learning approaches and meet the needs of quantitative evaluation. To address these problems, we propose a fine-grained action definition for SRP and introduce a large-scale scene rearrangement dataset. We also propose a novel learning paradigm to efficiently train an agent through self-playing, without any prior knowledge. The agent trained via our paradigm achieves superior performance on the introduced dataset compared to the baseline agents. We provide a detailed analysis of the design of our approach in our experiments.

READ FULL TEXT

page 1

page 5

research
05/30/2023

Fine-Grained is Too Coarse: A Novel Data-Centric Approach for Efficient Scene Graph Generation

Learning to compose visual relationships from raw images in the form of ...
research
12/09/2017

IQA: Visual Question Answering in Interactive Environments

We introduce Interactive Question Answering (IQA), the task of answering...
research
11/29/2017

Video Captioning via Hierarchical Reinforcement Learning

Video captioning is the task of automatically generating a textual descr...
research
07/26/2016

Semantic Clustering for Robust Fine-Grained Scene Recognition

In domain generalization, the knowledge learnt from one or multiple sour...
research
09/26/2021

Applying supervised and reinforcement learning methods to create neural-network-based agents for playing StarCraft II

Recently, multiple approaches for creating agents for playing various co...
research
05/12/2022

Feature and Instance Joint Selection: A Reinforcement Learning Perspective

Feature selection and instance selection are two important techniques of...
research
11/12/2020

Adding Knowledge to Unsupervised Algorithms for the Recognition of Intent

Computer vision algorithms performance are near or superior to humans in...

Please sign up or login with your details

Forgot password? Click here to reset