Unidentified Video Objects: A Benchmark for Dense, Open-World Segmentation

04/10/2021
by   Weiyao Wang, et al.
0

Current state-of-the-art object detection and segmentation methods work well under the closed-world assumption. This closed-world setting assumes that the list of object categories is available during training and deployment. However, many real-world applications require detecting or segmenting novel objects, i.e., object categories never seen during training. In this paper, we present, UVO (Unidentified Video Objects), a new benchmark for open-world class-agnostic object segmentation in videos. Besides shifting the problem focus to the open-world setup, UVO is significantly larger, providing approximately 8 times more videos compared with DAVIS, and 7 times more mask (instance) annotations per video compared with YouTube-VOS and YouTube-VIS. UVO is also more challenging as it includes many videos with crowded scenes and complex background motions. We demonstrated that UVO can be used for other applications, such as object tracking and super-voxel segmentation, besides open-world object segmentation. We believe that UVo is a versatile testbed for researchers to develop novel approaches for open-world class-agnostic object segmentation, and inspires new research directions towards a more comprehensive video understanding beyond classification and detection.

READ FULL TEXT

page 1

page 5

research
08/10/2016

Object Detection, Tracking, and Motion Segmentation for Object-level Video Segmentation

We present an approach for object segmentation in videos that combines f...
research
04/04/2023

Towards Open-Vocabulary Video Instance Segmentation

Video Instance Segmentation(VIS) aims at segmenting and categorizing obj...
research
08/08/2023

Exploring Transformers for Open-world Instance Segmentation

Open-world instance segmentation is a rising task, which aims to segment...
research
12/03/2021

Class-agnostic Reconstruction of Dynamic Objects from Videos

We introduce REDO, a class-agnostic framework to REconstruct the Dynamic...
research
08/08/2023

1st Place Solution for CVPR2023 BURST Long Tail and Open World Challenges

Currently, Video Instance Segmentation (VIS) aims at segmenting and cate...
research
01/05/2016

Gamifying Video Object Segmentation

Video object segmentation can be considered as one of the most challengi...
research
05/26/2023

Towards Open-World Segmentation of Parts

Segmenting object parts such as cup handles and animal bodies is importa...

Please sign up or login with your details

Forgot password? Click here to reset