Anticipation and next action forecasting in video: an end-to-end model with memory

01/11/2019
by   Fiora Pirri, et al.
12

Action anticipation and forecasting in videos do not require a hat-trick, as far as there are signs in the context to foresee how actions are going to be deployed. Capturing these signs is hard because the context includes the past. We propose an end-to-end network for action anticipation and forecasting with memory, to both anticipate the current action and foresee the next one. Experiments on action sequence datasets show excellent results indicating that training on histories with a dynamic memory can significantly improve forecasting performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 9

page 11

research
12/10/2019

Forecasting Future Sequence of Actions to Complete an Activity

Future human action forecasting from partial observations of activities ...
research
08/15/2023

Memory-and-Anticipation Transformer for Online Action Understanding

Most existing forecasting systems are memory-based methods, which attemp...
research
04/08/2019

Relational Action Forecasting

This paper focuses on multi-person action forecasting in videos. More pr...
research
12/19/2016

Asynchronous Temporal Fields for Action Recognition

Actions are more than just movements and trajectories: we cook to eat an...
research
11/25/2022

Forecasting Actions and Characteristic 3D Poses

We propose to model longer-term future human behavior by jointly predict...
research
02/17/2023

Simplifying and Improving: Revisiting Bulgaria's Revenue Forecasting Models

In the thirty years since the end of real socialism, Bulgaria's went fro...
research
07/15/2021

Mid-flight Forecasting for CPA Lines in Online Advertising

For Verizon MediaDemand Side Platform(DSP), forecasting of ad campaign p...

Please sign up or login with your details

Forgot password? Click here to reset