RendNet: Unified 2D/3D Recognizer With Latent Space Rendering

by   Ruoxi Shi, et al.

Vector graphics (VG) have been ubiquitous in our daily life with vast applications in engineering, architecture, designs, etc. The VG recognition process of most existing methods is to first render the VG into raster graphics (RG) and then conduct recognition based on RG formats. However, this procedure discards the structure of geometries and loses the high resolution of VG. Recently, another category of algorithms is proposed to recognize directly from the original VG format. But it is affected by the topological errors that can be filtered out by RG rendering. Instead of looking at one format, it is a good solution to utilize the formats of VG and RG together to avoid these shortcomings. Besides, we argue that the VG-to-RG rendering process is essential to effectively combine VG and RG information. By specifying the rules on how to transfer VG primitives to RG pixels, the rendering process depicts the interaction and correlation between VG and RG. As a result, we propose RendNet, a unified architecture for recognition on both 2D and 3D scenarios, which considers both VG/RG representations and exploits their interaction by incorporating the VG-to-RG rasterization process. Experiments show that RendNet can achieve state-of-the-art performance on 2D and 3D object recognition tasks on various VG datasets.


page 3

page 7

page 8


Recognizing Vector Graphics without Rasterization

In this paper, we consider a different data format for images: vector gr...

Zahir: a Object-Oriented Framework for Computer Graphics

In this article we present Zahir, a framework for experimentation in Com...

LASER: LAtent SpacE Rendering for 2D Visual Localization

We present LASER, an image-based Monte Carlo Localization (MCL) framewor...

Mixture of Volumetric Primitives for Efficient Neural Rendering

Real-time rendering and animation of humans is a core function in games,...

Anecdotal Survey of Variations in Path Stroking among Real-world Implementations

Stroking a path is one of the two basic rendering operations in vector g...

Modular Primitives for High-Performance Differentiable Rendering

We present a modular differentiable renderer design that yields performa...

Calendar-based graphics for visualizing people's daily schedules

Calendars are broadly used in society to display temporal information, a...

Please sign up or login with your details

Forgot password? Click here to reset