A Neuro-Symbolic Humanlike Arm Controller for Sophia the Robot

by   David Hanson, et al.

We outline the design and construction of novel robotic arms using machine perception, convolutional neural networks, and symbolic AI for logical control and affordance indexing. We describe our robotic arms built with a humanlike mechanical configuration and aesthetic, with 28 degrees of freedom, touch sensors, and series elastic actuators. The arms were modelled in Roodle and Gazebo with URDF models, as well as Unity, and implement motion control solutions for solving live games of Baccarat (the casino card game), rock paper scissors, handshaking, and drawing. This includes live interactions with people, incorporating both social control of the hands and facial gestures, and physical inverse kinematics (IK) for grasping and manipulation tasks. The resulting framework is an integral part of the Sophia 2020 alpha platform, which is being used with ongoing research in the authors work with team AHAM, an ANA Avatar Xprize effort towards human-AI hybrid telepresence. These results are available to test on the broadly released Hanson Robotics Sophia 2020 robot platform, for users to try and extend.



There are no comments yet.


page 2

page 3

page 5

page 6

page 8

page 9


Four-Arm Manipulation via Feet Interfaces

We seek to augment human manipulation by enabling humans to control two ...

Development of an Intuitive Foot-Machine Interface for Robotic Surgery

The human-machine interface is of critical importance for master-slave c...

Jenny 5 -- the robot

Jenny 5 is a fully open-source robot intended to be used mainly for rese...

Design and Workspace Characterisation of Malleable Robots

For the majority of tasks performed by traditional serial robot arms, su...

A Lyapunov-Based Approach to Exploit Asymmetries in Robotic Dual-Arm Task Resolution

Dual-arm manipulation tasks can be prescribed to a robotic system in ter...

CRANE: A highly dexterous needle placement robot for evaluation of interventional radiology procedures

Interventional Radiology (IR) enables earlier diagnosis and less invasiv...

IKBT: solving closed-form Inverse Kinematics with Behavior Tree

Serial robot arms have complicated kinematic equations which must be sol...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.