A Neuro-Symbolic Humanlike Arm Controller for Sophia the Robot

10/27/2020
by   David Hanson, et al.
7

We outline the design and construction of novel robotic arms using machine perception, convolutional neural networks, and symbolic AI for logical control and affordance indexing. We describe our robotic arms built with a humanlike mechanical configuration and aesthetic, with 28 degrees of freedom, touch sensors, and series elastic actuators. The arms were modelled in Roodle and Gazebo with URDF models, as well as Unity, and implement motion control solutions for solving live games of Baccarat (the casino card game), rock paper scissors, handshaking, and drawing. This includes live interactions with people, incorporating both social control of the hands and facial gestures, and physical inverse kinematics (IK) for grasping and manipulation tasks. The resulting framework is an integral part of the Sophia 2020 alpha platform, which is being used with ongoing research in the authors work with team AHAM, an ANA Avatar Xprize effort towards human-AI hybrid telepresence. These results are available to test on the broadly released Hanson Robotics Sophia 2020 robot platform, for users to try and extend.

READ FULL TEXT

page 2

page 3

page 5

page 6

page 8

page 9

research
09/11/2019

Four-Arm Manipulation via Feet Interfaces

We seek to augment human manipulation by enabling humans to control two ...
research
05/02/2023

A Mobile Quad-Arm Robot ARMS: Wheel-Legged Tripedal Mobility and Quad-Arm Manipulation

This letter proposes a mobile quad-arm robot: ARMS that unifies wheel-le...
research
05/27/2019

Development of an Intuitive Foot-Machine Interface for Robotic Surgery

The human-machine interface is of critical importance for master-slave c...
research
05/20/2022

Open Arms: Open-Source Arms, Hands Control

Open Arms is a novel open-source platform of realistic human-like roboti...
research
04/17/2023

Topology, dynamics, and control of an octopus-analog muscular hydrostat

Muscular hydrostats, such as octopus arms or elephant trunks, lack bones...
research
06/23/2023

Exploring AI-enhanced Shared Control for an Assistive Robotic Arm

Assistive technologies and in particular assistive robotic arms have the...
research
03/28/2023

Augmented Reality Remote Operation of Dual Arm Manipulators in Hot Boxes

In nuclear isotope and chemistry laboratories, hot cells and gloveboxes ...

Please sign up or login with your details

Forgot password? Click here to reset