Canonical Correlation Inference for Mapping Abstract Scenes to Text

08/09/2016
by   Nikos Papasarantopoulos, et al.
0

We describe a technique for structured prediction, based on canonical correlation analysis. Our learning algorithm finds two projections for the input and the output spaces that aim at projecting a given input and its correct output into points close to each other. We demonstrate our technique on a language-vision problem, namely the problem of giving a textual description to an "abstract scene".

READ FULL TEXT
research
09/13/2006

A kernel method for canonical correlation analysis

Canonical correlation analysis is a technique to extract common features...
research
09/17/2012

Generalized Canonical Correlation Analysis for Disparate Data Fusion

Manifold matching works to identify embeddings of multiple disparate dat...
research
02/22/2017

Stochastic Approximation for Canonical Correlation Analysis

We study canonical correlation analysis (CCA) as a stochastic optimizati...
research
02/28/2021

Discriminative Multiple Canonical Correlation Analysis for Information Fusion

In this paper, we propose the Discriminative Multiple Canonical Correlat...
research
09/22/2022

Output Mode Switching for Parallel Five-bar Manipulators Using a Graph-based Path Planner

The configuration manifolds of parallel manipulators exhibit more nonlin...
research
02/04/2018

A Scheme-Driven Approach to Learning Programs from Input/Output Equations

We describe an approach to learn, in a term-rewriting setting, function ...
research
07/27/2017

From Type Spaces to Probability Frames and Back, via Language

We investigate the connection between the two major mathematical framewo...

Please sign up or login with your details

Forgot password? Click here to reset