DeepAI AI Chat
Log In Sign Up

Image-free single-pixel segmentation

by   Haiyan Liu, et al.
Beijing Institute of Technology

The existing segmentation techniques require high-fidelity images as input to perform semantic segmentation. Since the segmentation results contain most of edge information that is much less than the acquired images, the throughput gap leads to both hardware and software waste. In this letter, we report an image-free single-pixel segmentation technique. The technique combines structured illumination and single-pixel detection together, to efficiently samples and multiplexes scene's segmentation information into compressed one-dimensional measurements. The illumination patterns are optimized together with the subsequent reconstruction neural network, which directly infers segmentation maps from the single-pixel measurements. The end-to-end encoding-and-decoding learning framework enables optimized illumination with corresponding network, which provides both high acquisition and segmentation efficiency. Both simulation and experimental results validate that accurate segmentation can be achieved using two-order-of-magnitude less input data. When the sampling ratio is 1 accuracy reaches above 96 technique can be widely applied in various resource-limited platforms such as UAV and unmanned vehicle that require real-time sensing.


page 1

page 4

page 8

page 11

page 13


Non-imaging single-pixel sensing with optimized binary modulation

The conventional high-level sensing tasks such as image classification r...

Weighted Encoding Optimization for Dynamic Single-pixel Imaging and Sensing

Using single-pixel detection, the end-to-end neural network that jointly...

Image-free multi-character recognition

The recently developed image-free sensing technique maintains the advant...

High-speed real-time single-pixel microscopy based on Fourier sampling

Single-pixel cameras based on the concepts of compressed sensing (CS) le...

Efficient Reflectance Capture with a Deep Gated Mixture-of-Experts

We present a novel framework to efficiently acquire near-planar anisotro...

On Efficient Real-Time Semantic Segmentation: A Survey

Semantic segmentation is the problem of assigning a class label to every...

Graph Attention Network Based Single-Pixel Compressive Direction of Arrival Estimation

In this paper, we present a single-pixel compressive direction of arriva...