An Empirical Study of DNNs Robustification Inefficacy in Protecting Visual Recommenders

10/02/2020
by   Vito Walter Anelli, et al.
1

Visual-based recommender systems (VRSs) enhance recommendation performance by integrating users' feedback with the visual features of product images extracted from a deep neural network (DNN). Recently, human-imperceptible images perturbations, defined adversarial attacks, have been demonstrated to alter the VRSs recommendation performance, e.g., pushing/nuking category of products. However, since adversarial training techniques have proven to successfully robustify DNNs in preserving classification accuracy, to the best of our knowledge, two important questions have not been investigated yet: 1) How well can these defensive mechanisms protect the VRSs performance? 2) What are the reasons behind ineffective/effective defenses? To answer these questions, we define a set of defense and attack settings, as well as recommender models, to empirically investigate the efficacy of defensive mechanisms. The results indicate alarming risks in protecting a VRS through the DNN robustification. Our experiments shed light on the importance of visual features in very effective attack scenarios. Given the financial impact of VRSs on many companies, we believe this work might rise the need to investigate how to successfully protect visual-based recommenders. Source code and data are available at https://anonymous.4open.science/r/868f87ca-c8a4-41ba-9af9-20c41de33029/.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/21/2022

A Mask-Based Adversarial Defense Scheme

Adversarial attacks hamper the functionality and accuracy of Deep Neural...
research
06/19/2017

Exploring Content-based Artwork Recommendation with Metadata and Visual Features

Compared to other areas, artwork recommendation has received little atte...
research
09/12/2019

An Empirical Investigation of Randomized Defenses against Adversarial Attacks

In recent years, Deep Neural Networks (DNNs) have had a dramatic impact ...
research
11/09/2020

An Empirical Study of Visual Features for DNN based Audio-Visual Speech Enhancement in Multi-talker Environments

Audio-visual speech enhancement (AVSE) methods use both audio and visual...
research
06/22/2017

Comparing Neural and Attractiveness-based Visual Features for Artwork Recommendation

Advances in image processing and computer vision in the latest years hav...
research
08/01/2020

An Empirical Study of Clarifying Question-Based Systems

Search and recommender systems that take the initiative to ask clarifyin...
research
07/24/2020

Personalised Visual Art Recommendation by Learning Latent Semantic Representations

In Recommender systems, data representation techniques play a great role...

Please sign up or login with your details

Forgot password? Click here to reset