MetaMorphosis: Task-oriented Privacy Cognizant Feature Generation for Multi-task Learning

by   Md. Adnan Arefeen, et al.
NC State University
University of Missouri-Kansas City

With the growth of computer vision applications, deep learning, and edge computing contribute to ensuring practical collaborative intelligence (CI) by distributing the workload among edge devices and the cloud. However, running separate single-task models on edge devices is inefficient regarding the required computational resource and time. In this context, multi-task learning allows leveraging a single deep learning model for performing multiple tasks, such as semantic segmentation and depth estimation on incoming video frames. This single processing pipeline generates common deep features that are shared among multi-task modules. However, in a collaborative intelligence scenario, generating common deep features has two major issues. First, the deep features may inadvertently contain input information exposed to the downstream modules (violating input privacy). Second, the generated universal features expose a piece of collective information than what is intended for a certain task, in which features for one task can be utilized to perform another task (violating task privacy). This paper proposes a novel deep learning-based privacy-cognizant feature generation process called MetaMorphosis that limits inference capability to specific tasks at hand. To achieve this, we propose a channel squeeze-excitation based feature metamorphosis module, Cross-SEC, to achieve distinct attention of all tasks and a de-correlation loss function with differential-privacy to train a deep learning model that produces distinct privacy-aware features as an output for the respective tasks. With extensive experimentation on four datasets consisting of diverse images related to scene understanding and facial attributes, we show that MetaMorphosis outperforms recent adversarial learning and universal feature generation methods by guaranteeing privacy requirements in an efficient way for image and video analytics.


page 10

page 13

page 15

page 17


Multi-task learning with compressible features for Collaborative Intelligence

A promising way to deploy Artificial Intelligence (AI)-based services on...

Multi-task learning from fixed-wing UAV images for 2D/3D city modeling

Single-task learning in artificial neural networks will be able to learn...

SpeechNet: A Universal Modularized Model for Speech Processing Tasks

There is a wide variety of speech processing tasks ranging from extracti...

Deep Joint Source-Channel Coding for Multi-Task Network

Multi-task learning (MTL) is an efficient way to improve the performance...

Binaural Audio Generation via Multi-task Learning

We present a learning-based approach for generating binaural audio from ...

Padding Module: Learning the Padding in Deep Neural Networks

During the last decades, many studies have been dedicated to improving t...

PATROL: Privacy-Oriented Pruning for Collaborative Inference Against Model Inversion Attacks

Collaborative inference has been a promising solution to enable resource...

Please sign up or login with your details

Forgot password? Click here to reset