DeepAI AI Chat
Log In Sign Up

Online Action Recognition

by   Alejandro Suárez-Hernández, et al.
Universitat Pompeu Fabra
Universitat Politècnica de Catalunya

Recognition in planning seeks to find agent intentions, goals or activities given a set of observations and a knowledge library (e.g. goal states, plans or domain theories). In this work we introduce the problem of Online Action Recognition. It consists in recognizing, in an open world, the planning action that best explains a partially observable state transition from a knowledge library of first-order STRIPS actions, which is initially empty. We frame this as an optimization problem, and propose two algorithms to address it: Action Unification (AU) and Online Action Recognition through Unification (OARU). The former builds on logic unification and generalizes two input actions using weighted partial MaxSAT. The latter looks for an action within the library that explains an observed transition. If there is such action, it generalizes it making use of AU, building in this way an AU hierarchy. Otherwise, OARU inserts a Trivial Grounded Action (TGA) in the library that explains just that transition. We report results on benchmarks from the International Planning Competition and PDDLGym, where OARU recognizes actions accurately with respect to expert knowledge, and shows real-time performance.


page 1

page 14

page 15


Recognizing Manipulation Actions from State-Transformations

Manipulation actions transform objects from an initial state into a fina...

FSD-10: A Dataset for Competitive Sports Content Analysis

Action recognition is an important and challenging problem in video anal...

Goal Recognition as a Deep Learning Task: the GRNet Approach

In automated planning, recognising the goal of an agent from a trace of ...

RADACS: Towards Higher-Order Reasoning using Action Recognition in Autonomous Vehicles

When applied to autonomous vehicle settings, action recognition can help...

COREALMLIB: An ALM Library Translated from the Component Library

This paper presents COREALMLIB, an ALM library of commonsense knowledge ...

Learning Conditional Random Fields with Augmented Observations for Partially Observed Action Recognition

This paper aims at recognizing partially observed human actions in video...

Task planning and explanation with virtual actions

One of the challenges of task planning is to find out what causes the pl...