VRGym: A Virtual Testbed for Physical and Interactive AI

by   Xu Xie, et al.

We propose VRGym, a virtual reality testbed for realistic human-robot interaction. Different from existing toolkits and virtual reality environments, the VRGym emphasizes on building and training both physical and interactive agents for robotics, machine learning, and cognitive science. VRGym leverages mechanisms that can generate diverse 3D scenes with high realism through physics-based simulation. We demonstrate that VRGym is able to (i) collect human interactions and fine manipulations, (ii) accommodate various robots with a ROS bridge, (iii) support experiments for human-robot interaction, and (iv) provide toolkits for training the state-of-the-art machine learning algorithms. We hope VRGym can help to advance general-purpose robotics and machine learning agents, as well as assisting human studies in the field of cognitive science.


page 1

page 2

page 3

page 4

page 5

page 6


Virtual Reality Platform to Develop and Test Applications on Human-Robot Social Interaction

Robotics simulation has been an integral part of research and developmen...

Robopheus: A Virtual-Physical Interactive Mobile Robotic Testbed

The mobile robotic testbed is an essential and critical support to verif...

From Machine Learning to Robotics: Challenges and Opportunities for Embodied Intelligence

Machine learning has long since become a keystone technology, accelerati...

Interactive Physically-Based Simulation of Roadheader Robot

Roadheader is an engineering robot widely used in underground engineerin...

VRKitchen: an Interactive 3D Virtual Environment for Task-oriented Learning

One of the main challenges of advancing task-oriented learning such as v...

Intuitive Robot Integration via Virtual Reality Workspaces

As robots become increasingly prominent in diverse industrial settings, ...

iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks

Recent research in embodied AI has been boosted by the use of simulation...

Please sign up or login with your details

Forgot password? Click here to reset