Structured learning and detailed interpretation of minimal object images

11/29/2017
by   Guy Ben-Yosef, et al.
0

We model the process of human full interpretation of object images, namely the ability to identify and localize all semantic features and parts that are recognized by human observers. The task is approached by dividing the interpretation of the complete object to the interpretation of multiple reduced but interpretable local regions. We model interpretation by a structured learning framework, in which there are primitive components and relations that play a useful role in local interpretation by humans. To identify useful components and relations used in the interpretation process, we consider the interpretation of minimal configurations, namely reduced local regions that are minimal in the sense that further reduction will turn them unrecognizable and uninterpretable. We show experimental results of our model, and results of predicting and testing relations that were useful to the model via transformed minimal images.

READ FULL TEXT

page 2

page 3

research
12/26/2017

A model for interpreting social interactions in local image regions

Understanding social interactions (such as 'hug' or 'fight') is a basic ...
research
05/24/2018

Complex Relations in a Deep Structured Prediction Model for Fine Image Segmentation

Many deep learning architectures for semantic segmentation involve a Ful...
research
04/04/2021

Learning Image Aesthetic Assessment from Object-level Visual Components

As it is said by Van Gogh, great things are done by a series of small th...
research
10/01/2019

Compensating Supervision Incompleteness with Prior Knowledge in Semantic Image Interpretation

Semantic Image Interpretation is the task of extracting a structured sem...
research
11/06/2017

Interpretable Feature Recommendation for Signal Analytics

This paper presents an automated approach for interpretable feature reco...
research
08/23/2023

CHORUS: Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images

We present a method for teaching machines to understand and model the un...
research
07/27/2022

Portrait Interpretation and a Benchmark

We propose a task we name Portrait Interpretation and construct a datase...

Please sign up or login with your details

Forgot password? Click here to reset