rCRF: Recursive Belief Estimation over CRFs in RGB-D Activity Videos

01/27/2020
by   Ozan Sener, et al.
0

For assistive robots, anticipating the future actions of humans is an essential task. This requires modeling both the evolution of the activities over time and the rich relationships between humans and the objects. Since the future activities of humans are quite ambiguous, robots need to assess all the future possibilities in order to choose an appropriate action. Therefore, a successful anticipation algorithm needs to compute all plausible future activities and their corresponding probabilities. In this paper, we address the problem of efficiently computing beliefs over future human activities from RGB-D videos. We present a new recursive algorithm that we call Recursive Conditional Random Field (rCRF) which can compute an accurate belief over a temporal CRF model. We use the rich modeling power of CRFs and describe a computationally tractable inference algorithm based on Bayesian filtering and structured diversity. In our experiments, we show that incorporating belief, computed via our approach, significantly outperforms the state-of-the-art methods, both in terms of accuracy and computation time.

READ FULL TEXT

page 1

page 3

page 7

research
10/04/2012

Learning Human Activities and Object Affordances from RGB-D Videos

Understanding human activities and object affordances are two very impor...
research
08/04/2012

Human Activity Learning using Object Affordances from RGB-D Videos

Human activities comprise several sub-activities performed in a sequence...
research
08/02/2017

Predicting Human Activities Using Stochastic Grammar

This paper presents a novel method to predict future human activities fr...
research
06/28/2021

Unsupervised Discovery of Actions in Instructional Videos

In this paper we address the problem of automatically discovering atomic...
research
03/08/2017

A Pursuit of Temporal Accuracy in General Activity Detection

Detecting activities in untrimmed videos is an important but challenging...
research
04/24/2016

Bayesian Inference of Recursive Sequences of Group Activities from Tracks

We present a probabilistic generative model for inferring a description ...
research
08/23/2013

How Did Humans Become So Creative? A Computational Approach

This paper summarizes efforts to computationally model two transitions i...

Please sign up or login with your details

Forgot password? Click here to reset