A System View of the Recognition and Interpretation of Observed Human Shape, Pose and Action

03/27/2015
by   David W. Arathorn, et al.
0

There is physiological evidence that our ability to interpret human pose and action from 2D visual imagery (binocular or monocular) engages the circuitry of the motor cortices as well as the visual areas of the brain. This implies that the capability of the motor cortices to solve inverse kinematics is flexible enough to apply to both motion planning as well as serving as a generative model for the visual processing of human figures, despite the differing functional requirements of the two tasks. This paper provides a computational model of the cooperation between visual and motor areas: in other words, a system view of an important class of brain computations. The model unifies the solution of the separate inverse problems involved in the task, visual transformation discovery, inverse kinematics, and adaptation to morphology variations, using several instances of the Map-seeking Circuit algorithm. While the paper is weighted toward the exposition of a neurobiological hypothesis, from mathematical formalization of the problem to neuronal circuitry, the algorithmic expression of the solution is also a functional machine vision system for human figure recognition, and 3D pose and body morphology reconstruction from monocular, perspective-less input imagery. With an inverse kinematic generative model capable of imposing a variety of endogenous and exogenous constraints the machine vision implementation acquires characteristics currently unique among such systems.

READ FULL TEXT

page 4

page 5

page 7

page 11

page 18

page 20

page 38

research
06/13/2023

Decoding Brain Motor Imagery with various Machine Learning techniques

Motor imagery (MI) is a well-documented technique used by subjects in BC...
research
02/04/2020

A Novel Framework for Visual Motion Imagery Classification Using 3D Virtual BCI Platform

In this study, 3D brain-computer interface (BCI) training platforms were...
research
08/24/2021

imGHUM: Implicit Generative Models of 3D Human Shape and Articulated Pose

We present imGHUM, the first holistic generative model of 3D human shape...
research
08/17/2014

Robust Statistical Approach for Extraction of Moving Human Silhouettes from Videos

Human pose estimation is one of the key problems in computer vision that...
research
07/31/2017

Recurrent 3D Pose Sequence Machines

3D human articulated pose recovery from monocular image sequences is ver...
research
08/03/2018

Cortical Microcircuits from a Generative Vision Model

Understanding the information processing roles of cortical circuits is a...
research
12/02/2021

Modeling human intention inference in continuous 3D domains by inverse planning and body kinematics

How to build AI that understands human intentions, and uses this knowled...

Please sign up or login with your details

Forgot password? Click here to reset