Guiding Intelligent Surveillance System by learning-by-synthesis gaze estimation

by   Tongtong Zhao, et al.
Dalian Maritime University

We describe a novel learning-by-synthesis method for estimating gaze direction of an automated intelligent surveillance system. Recently, progress in learning-by-synthesis has proposed training models on synthetic images, which can effectively reduce the cost of manpower and material resources. However, learning from synthetic images still fails to achieve the desired performance compared to naturalistic images due to the different distribution of synthetic images. In an attempt to address this issue, previous method is to improve the realism of synthetic images by learning a model. However, the disadvantage of the method is that the distortion has not been improved and the authenticity level is unstable. To solve this problem, we put forward a new structure to improve synthetic images, via the reference to the idea of style transformation, through which we can efficiently reduce the distortion of pictures and minimize the need of real data annotation. We estimate that this enables generation of highly realistic images, which we demonstrate both qualitatively and with a user study. We quantitatively evaluate the generated images by training models for gaze estimation. We show a significant improvement over using synthetic images, and achieve state-of-the-art results on various datasets including MPIIGaze dataset.


page 3

page 5


Learning from Simulated and Unsupervised Images through Adversarial Training

With recent progress in graphics, it has become more tractable to train ...

Purifying Naturalistic Images through a Real-time Style Transfer Semantics Network

Recently, the progress of learning-by-synthesis has proposed a training ...

Mask-guided Style Transfer Network for Purifying Real Images

Recently, the progress of learning-by-synthesis has proposed a training ...

Gaze estimation problem tackled through synthetic images

In this paper, we evaluate a synthetic framework to be used in the field...

Multistream Gaze Estimation with Anatomical Eye Region Isolation by Synthetic to Real Transfer Learning

We propose a novel neural pipeline, MSGazeNet, that learns gaze represen...

Happy Are Those Who Grade without Seeing: A Multi-Task Learning Approach to Grade Essays Using Gaze Behaviour

The gaze behaviour of a reader is helpful in solving several NLP tasks s...

Unsupervised Synthetic Image Refinement via Contrastive Learning and Consistent Semantic-Structural Constraints

Ensuring the realism of computer-generated synthetic images is crucial t...

Please sign up or login with your details

Forgot password? Click here to reset