Achieving Competitive Play Through Bottom-Up Approach in Semantic Segmentation

02/28/2021
by   E. Pryzant, et al.
0

With the renaissance of neural networks, object detection has slowly shifted from a bottom-up recognition problem to a top-down approach. Best in class algorithms enumerate a near-complete list of objects and classify each into object/not object. In this paper, we show that strong performance can still be achieved using a bottom-up approach for vision-based object recognition tasks and achieve competitive video game play. We propose PuckNet, which is used to detect four extreme points (top, left, bottom, and right-most points) and one center point of objects using a fully convolutional neural network. Object detection is then a purely keypoint-based appearance estimation problem, without implicit feature learning or region classification. The method proposed herein performs on-par with the best in class region-based detection methods, with a bounding box AP of 36.4 points estimated directly resolve into a rectangular object mask, with a COCO Mask AP of 17.6 segmentation of extreme points further improves this to 32.1 applied the PuckNet vision system to the SuperTuxKart video game to test it's capacity to achieve competitive play in dynamic and co-operative multiplayer environments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/23/2019

Bottom-up Object Detection by Grouping Extreme and Center Points

With the advent of deep learning, object detection drifted from a bottom...
research
07/20/2017

Video Object Segmentation using Tracked Object Proposals

We present an approach to semi-supervised video object segmentation, in ...
research
04/16/2019

Objects as Points

Detection identifies objects as axis-aligned boxes in an image. Most suc...
research
09/17/2019

Masking Salient Object Detection, a Mask Region-based Convolutional Neural Network Analysis for Segmentation of Salient Objects

In this paper, we propose a broad comparison between Fully Convolutional...
research
04/29/2021

EPP-Net: Extreme-Point-Prediction-Based Object Detection

Object detection can be regarded as a pixel clustering task, and its bou...
research
04/18/2022

CenterNet++ for Object Detection

There are two mainstreams for object detection: top-down and bottom-up. ...
research
11/24/2017

Deep Extreme Cut: From Extreme Points to Object Segmentation

This paper explores the use of extreme points in an object (left-most, r...

Please sign up or login with your details

Forgot password? Click here to reset