User-driven mobile robot storyboarding: Learning image interest and saliency from pairwise image comparisons

06/19/2017
by   Michael Burke, et al.
0

This paper describes a novel storyboarding scheme that uses a model trained on pairwise image comparisons to identify images likely to be of interest to a mobile robot user. Traditional storyboarding schemes typically attempt to summarise robot observations using predefined novelty or image quality objectives, but we propose a user training stage that allows the incorporation of user interest when storyboarding. Our approach dramatically reduces the number of image comparisons required to infer image interest by applying a Gaussian process smoothing algorithm on image features extracted using a pre-trained convolutional neural network. As a particularly valuable by-product, the proposed approach allows the generation of user-specific saliency or attention maps.

READ FULL TEXT

page 1

page 5

page 6

page 7

research
02/10/2022

Decreasing Annotation Burden of Pairwise Comparisons with Human-in-the-Loop Sorting: Application in Medical Image Artifact Rating

Ranking by pairwise comparisons has shown improved reliability over ordi...
research
10/19/2020

Investigating and Simplifying Masking-based Saliency Methods for Model Interpretability

Saliency maps that identify the most informative regions of an image for...
research
06/30/2020

ITSELF: Iterative Saliency Estimation fLexible Framework

Saliency object detection estimates the objects that most stand out in a...
research
11/21/2020

Rank-smoothed Pairwise Learning In Perceptual Quality Assessment

Conducting pairwise comparisons is a widely used approach in curating hu...
research
01/22/2021

Understanding Visual Saliency in Mobile User Interfaces

For graphical user interface (UI) design, it is important to understand ...
research
06/02/2000

Novelty Detection for Robot Neotaxis

The ability of a robot to detect and respond to changes in its environme...
research
04/02/2018

Exploring to learn visual saliency: The RL-IAC approach

The problem of object localization and recognition on autonomous mobile ...

Please sign up or login with your details

Forgot password? Click here to reset