Actionet: An Interactive End-To-End Platform For Task-Based Data Collection And Augmentation In 3D Environment

10/03/2020
by   Jiafei Duan, et al.
1

The problem of task planning for artificial agents remains largely unsolved. While there has been increasing interest in data-driven approaches for the study of task planning for artificial agents, a significant remaining bottleneck is the dearth of large-scale comprehensive task-based datasets. In this paper, we present ActioNet, an interactive end-to-end platform for data collection and augmentation of task-based dataset in 3D environment. Using ActioNet, we collected a large-scale comprehensive task-based dataset, comprising over 3000 hierarchical task structures and videos. Using the hierarchical task structures, the videos are further augmented across 50 different scenes to give over 150,000 video. To our knowledge, ActioNet is the first interactive end-to-end platform for such task-based dataset generation and the accompanying dataset is the largest task-based dataset of such comprehensive nature. The ActioNet platform and dataset will be made available to facilitate research in hierarchical task planning.

READ FULL TEXT

page 3

page 4

research
02/21/2022

OpenRAN Gym: An Open Toolbox for Data Collection and Experimentation with AI in O-RAN

Open Radio Access Network (RAN) architectures will enable interoperabili...
research
12/06/2019

EdNet: A Large-Scale Hierarchical Dataset in Education

With advances in Artificial Intelligence in Education (AIEd) and the eve...
research
03/07/2019

COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysis

There are substantial instructional videos on the Internet, which enable...
research
02/09/2022

AIVC: Artificial Intelligence based Video Codec

This paper introduces AIVC, an end-to-end neural video codec. It is base...
research
06/27/2018

Primary Object Segmentation in Aerial Videos via Hierarchical Temporal Slicing and Co-Segmentation

Primary object segmentation plays an important role in understanding vid...
research
12/11/2017

Surgical task-space optimisation of the CYCLOPS robotic system

The CYCLOPS is a cable-driven parallel mechanism used for minimally inva...
research
03/15/2022

Blocks Assemble! Learning to Assemble with Large-Scale Structured Reinforcement Learning

Assembly of multi-part physical structures is both a valuable end produc...

Please sign up or login with your details

Forgot password? Click here to reset