Product semantics translation from brain activity via adversarial learning

03/29/2021
by   Pan Wang, et al.
0

A small change of design semantics may affect a user's satisfaction with a product. To modify a design semantic of a given product from personalised brain activity via adversarial learning, in this work, we propose a deep generative transformation model to modify product semantics from the brain signal. We attempt to accomplish such synthesis: 1) synthesising the product image with new features corresponding to EEG signal; 2) maintaining the other image features that irrelevant to EEG signal. We leverage the idea of StarGAN and the model is designed to synthesise products with preferred design semantics (colour shape) via adversarial learning from brain activity, and is applied with a case study to generate shoes with different design semantics from recorded EEG signals. To verify our proposed cognitive transformation model, a case study has been presented. The results work as a proof-of-concept that our framework has the potential to synthesis product semantic from brain activity.

READ FULL TEXT

page 6

page 8

research
02/20/2023

EEG2IMAGE: Image Reconstruction from EEG Brain Signals

Reconstructing images using brain signals of imagined visuals may provid...
research
09/03/2020

ThoughtViz: Visualizing Human Thoughts Using Generative Adversarial Network

Studying human brain signals has always gathered great attention from th...
research
05/22/2023

Towards Ultrasound Tongue Image prediction from EEG during speech production

Previous initial research has already been carried out to propose speech...
research
07/21/2017

Semantic Image Synthesis via Adversarial Learning

In this paper, we propose a way of synthesizing realistic images directl...
research
10/12/2020

The "Sound of Silence" in EEG – Cognitive voice activity detection

Speech cognition bears potential application as a brain computer interfa...
research
10/13/2021

End-to-end translation of human neural activity to speech with a dual-dual generative adversarial network

In a recent study of auditory evoked potential (AEP) based brain-compute...
research
10/16/2010

Wireless Sensor Network based Future of Telecom Applications

A system and method for enabling human beings to communicate by way of t...

Please sign up or login with your details

Forgot password? Click here to reset