Threatening Patch Attacks on Object Detection in Optical Remote Sensing Images

02/13/2023
by   Xuxiang Sun, et al.
0

Advanced Patch Attacks (PAs) on object detection in natural images have pointed out the great safety vulnerability in methods based on deep neural networks. However, little attention has been paid to this topic in Optical Remote Sensing Images (O-RSIs). To this end, we focus on this research, i.e., PAs on object detection in O-RSIs, and propose a more Threatening PA without the scarification of the visual quality, dubbed TPA. Specifically, to address the problem of inconsistency between local and global landscapes in existing patch selection schemes, we propose leveraging the First-Order Difference (FOD) of the objective function before and after masking to select the sub-patches to be attacked. Further, considering the problem of gradient inundation when applying existing coordinate-based loss to PAs directly, we design an IoU-based objective function specific for PAs, dubbed Bounding box Drifting Loss (BDL), which pushes the detected bounding boxes far from the initial ones until there are no intersections between them. Finally, on two widely used benchmarks, i.e., DIOR and DOTA, comprehensive evaluations of our TPA with four typical detectors (Faster R-CNN, FCOS, RetinaNet, and YOLO-v4) witness its remarkable effectiveness. To the best of our knowledge, this is the first attempt to study the PAs on object detection in O-RSIs, and we hope this work can get our readers interested in studying this topic.

READ FULL TEXT

page 1

page 4

page 5

page 7

page 8

research
09/27/2022

OBBStacking: An Ensemble Method for Remote Sensing Object Detection

Ensemble methods are a reliable way to combine several models to achieve...
research
03/21/2023

Anchor Free remote sensing detector based on solving discrete polar coordinate equation

As the rapid development of depth learning, object detection in aviatic ...
research
03/14/2019

Learning Orientation-Estimation Convolutional Neural Network for Building Detection in Optical Remote Sensing Image

Benefiting from the great success of deep learning in computer vision, C...
research
08/18/2021

Multi-patch Feature Pyramid Network for Weakly Supervised Object Detection in Optical Remote Sensing Images

Object detection is a challenging task in remote sensing because objects...
research
04/05/2022

Learning to Reduce Information Bottleneck for Object Detection in Aerial Images

Object detection in aerial images is a fundamental research topic in the...
research
12/11/2020

Objectness-Guided Open Set Visual Search and Closed Set Detection

Searching for small objects in large images is currently challenging for...

Please sign up or login with your details

Forgot password? Click here to reset