From Photo Streams to Evolving Situations

02/20/2017
by   Mengfan Tang, et al.
0

Photos are becoming spontaneous, objective, and universal sources of information. This paper develops evolving situation recognition using photo streams coming from disparate sources combined with the advances of deep learning. Using visual concepts in photos together with space and time information, we formulate the situation detection into a semi-supervised learning framework and propose new graph-based models to solve the problem. To extend the method for unknown situations, we introduce a soft label method which enables the traditional semi-supervised learning framework to accurately predict predefined labels as well as effectively form new clusters. To overcome the noisy data which degrades graph quality, leading to poor recognition results, we take advantage of two kinds of noise-robust norms which can eliminate the adverse effects of outliers in visual concepts and improve the accuracy of situation recognition. Finally, we demonstrate the idea and the effectiveness of the proposed model on Yahoo Flickr Creative Commons 100 Million.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/11/2021

Deep Photo Scan: Semi-supervised learning for dealing with the real-world degradation in smartphone photo scanning

Physical photographs now can be conveniently scanned by smartphones and ...
research
06/19/2020

Poisson Learning: Graph Based Semi-Supervised Learning At Very Low Label Rates

We propose a new framework, called Poisson learning, for graph based sem...
research
11/29/2022

Graph Based Semi-supervised Learning Using Spatial Segregation Theory

In this work we address graph based semi-supervised learning using the t...
research
04/28/2020

A Photo-Based Mobile Crowdsourcing Framework for Event Reporting

Mobile Crowdsourcing (MCS) photo-based is an arising field of interest a...
research
04/28/2020

A Photo-Based Mobile Crowdsourcing Frameworkfor Event Reporting

Mobile Crowdsourcing (MCS) photo-based is an arising field of interest a...
research
01/17/2020

GraphBGS: Background Subtraction via Recovery of Graph Signals

Graph-based algorithms have been successful approaching the problems of ...
research
05/14/2014

Active Mining of Parallel Video Streams

The practicality of a video surveillance system is adversely limited by ...

Please sign up or login with your details

Forgot password? Click here to reset