DeepAI AI Chat
Log In Sign Up

Morphology-Agnostic Visual Robotic Control

by   Brian Yang, et al.

Existing approaches for visuomotor robotic control typically require characterizing the robot in advance by calibrating the camera or performing system identification. We propose MAVRIC, an approach that works with minimal prior knowledge of the robot's morphology, and requires only a camera view containing the robot and its environment and an unknown control interface. MAVRIC revolves around a mutual information-based method for self-recognition, which discovers visual "control points" on the robot body within a few seconds of exploratory interaction, and these control points in turn are then used for visual servoing. MAVRIC can control robots with imprecise actuation, no proprioceptive feedback, unknown morphologies including novel tools, unknown camera poses, and even unsteady handheld cameras. We demonstrate our method on visually-guided 3D point reaching, trajectory following, and robot-to-robot imitation.


page 2

page 4

page 6

page 7


Active Visual SLAM with independently rotating camera

In active Visual-SLAM (V-SLAM), a robot relies on the information retrie...

Self-Modifying Morphology Experiments with DyRET: Dynamic Robot for Embodied Testing

Robots need to be able to adapt to complex and dynamic environments for ...

Controlling Robot Morphology from Incomplete Measurements

Mobile robots with complex morphology are essential for traversing rough...

Learning a generative model for robot control using visual feedback

We introduce a novel formulation for incorporating visual feedback in co...

Ex-DoF: Expansion of Action Degree-of-Freedom with Virtual Camera Rotation for Omnidirectional Image

Inter-robot transfer of training data is a little explored topic in lear...

Control and Morphology Optimization of Passive Asymmetric Structures for Robotic Swimming

Aquatic creatures exhibit remarkable adaptations of their body to effici...