Feature Completion for Occluded Person Re-Identification

06/24/2021
by   Ruibing Hou, et al.
0

Person re-identification (reID) plays an important role in computer vision. However, existing methods suffer from performance degradation in occluded scenes. In this work, we propose an occlusion-robust block, Region Feature Completion (RFC), for occluded reID. Different from most previous works that discard the occluded regions, RFC block can recover the semantics of occluded regions in feature space. Firstly, a Spatial RFC (SRFC) module is developed. SRFC exploits the long-range spatial contexts from non-occluded regions to predict the features of occluded regions. The unit-wise prediction task leads to an encoder/decoder architecture, where the region-encoder models the correlation between non-occluded and occluded region, and the region-decoder utilizes the spatial correlation to recover occluded region features. Secondly, we introduce Temporal RFC (TRFC) module which captures the long-term temporal contexts to refine the prediction of SRFC. RFC block is lightweight, end-to-end trainable and can be easily plugged into existing CNNs to form RFCnet. Extensive experiments are conducted on occluded and commonly holistic reID benchmarks. Our method significantly outperforms existing methods on the occlusion datasets, while remains top even superior performance on holistic datasets. The source code is available at https://github.com/blue-blue272/OccludedReID-RFCnet.

READ FULL TEXT

page 13

page 14

page 15

page 16

page 18

research
03/03/2023

Feature Completion Transformer for Occluded Person Re-identification

Occluded person re-identification (Re-ID) is a challenging problem due t...
research
03/28/2022

HandOccNet: Occlusion-Robust 3D Hand Mesh Estimation Network

Hands are often severely occluded by objects, which makes 3D hand mesh e...
research
07/19/2022

Dynamic Prototype Mask for Occluded Person Re-Identification

Although person re-identification has achieved an impressive improvement...
research
09/07/2023

Region Generation and Assessment Network for Occluded Person Re-Identification

Person Re-identification (ReID) plays a more and more crucial role in re...
research
04/10/2019

Foreground-aware Pyramid Reconstruction for Alignment-free Occluded Person Re-identification

Re-identifying a person across multiple disjoint camera views is importa...
research
03/02/2023

BIFRNet: A Brain-Inspired Feature Restoration DNN for Partially Occluded Image Recognition

The partially occluded image recognition (POIR) problem has been a chall...
research
03/13/2021

OCID-Ref: A 3D Robotic Dataset with Embodied Language for Clutter Scene Grounding

To effectively apply robots in working environments and assist humans, i...

Please sign up or login with your details

Forgot password? Click here to reset