Online Action Recognition

Recognition in planning seeks to find agent intentions, goals or activities given a set of observations and a knowledge library (e.g. goal states, plans or domain theories). In this work we introduce the problem of Online Action Recognition. It consists in recognizing, in an open world, the planning action that best explains a partially observable state transition from a knowledge library of first-order STRIPS actions, which is initially empty. We frame this as an optimization problem, and propose two algorithms to address it: Action Unification (AU) and Online Action Recognition through Unification (OARU). The former builds on logic unification and generalizes two input actions using weighted partial MaxSAT. The latter looks for an action within the library that explains an observed transition. If there is such action, it generalizes it making use of AU, building in this way an AU hierarchy. Otherwise, OARU inserts a Trivial Grounded Action (TGA) in the library that explains just that transition. We report results on benchmarks from the International Planning Competition and PDDLGym, where OARU recognizes actions accurately with respect to expert knowledge, and shows real-time performance.

READ FULL TEXT

page 1

page 14

page 15

research
06/12/2019

Recognizing Manipulation Actions from State-Transformations

Manipulation actions transform objects from an initial state into a fina...
research
02/09/2020

FSD-10: A Dataset for Competitive Sports Content Analysis

Action recognition is an important and challenging problem in video anal...
research
10/05/2022

Goal Recognition as a Deep Learning Task: the GRNet Approach

In automated planning, recognising the goal of an agent from a trace of ...
research
09/28/2022

RADACS: Towards Higher-Order Reasoning using Action Recognition in Autonomous Vehicles

When applied to autonomous vehicle settings, action recognition can help...
research
08/06/2016

COREALMLIB: An ALM Library Translated from the Component Library

This paper presents COREALMLIB, an ALM library of commonsense knowledge ...
research
11/25/2018

Learning Conditional Random Fields with Augmented Observations for Partially Observed Action Recognition

This paper aims at recognizing partially observed human actions in video...
research
01/10/2022

Task planning and explanation with virtual actions

One of the challenges of task planning is to find out what causes the pl...

Please sign up or login with your details

Forgot password? Click here to reset