Towards Learning to Perceive and Reason About Liquids

08/02/2016
by   Connor Schenck, et al.
0

Recent advances in AI and robotics have claimed many incredible results with deep learning, yet no work to date has applied deep learning to the problem of liquid perception and reasoning. In this paper, we apply fully-convolutional deep neural networks to the tasks of detecting and tracking liquids. We evaluate three models: a single-frame network, multi-frame network, and a LSTM recurrent network. Our results show that the best liquid detection results are achieved when aggregating data over multiple frames and that the LSTM network outperforms the other two in both tasks. This suggests that LSTM-based neural networks have the potential to be a key component for enabling robots to handle liquids using robust, closed-loop controllers.

READ FULL TEXT

page 3

page 4

page 5

page 8

page 10

research
06/20/2016

Detection and Tracking of Liquids with Fully Convolutional Networks

Recent advances in AI and robotics have claimed many incredible results ...
research
09/14/2017

Learning Multi-frame Visual Representation for Joint Detection and Tracking of Small Objects

Deep convolutional and recurrent neural networks have delivered signific...
research
09/06/2021

Active Perception with Neural Networks

Active perception has been employed in many domains, particularly in the...
research
05/14/2020

W-Cell-Net: Multi-frame Interpolation of Cellular Microscopy Videos

Deep Neural Networks are increasingly used in video frame interpolation ...
research
03/05/2017

Perceiving and Reasoning About Liquids Using Fully Convolutional Networks

Liquids are an important part of many common manipulation tasks in human...
research
11/07/2013

Exploring Deep and Recurrent Architectures for Optimal Control

Sophisticated multilayer neural networks have achieved state of the art ...
research
10/05/2018

Hierarchical Recurrent Filtering for Fully Convolutional DenseNets

Generating a robust representation of the environment is a crucial abili...

Please sign up or login with your details

Forgot password? Click here to reset