A Deep Learning Model for Structured Outputs with High-order Interaction

04/29/2015
by   Hongyu Guo, et al.
0

Many real-world applications are associated with structured data, where not only input but also output has interplay. However, typical classification and regression models often lack the ability of simultaneously exploring high-order interaction within input and that within output. In this paper, we present a deep learning model aiming to generate a powerful nonlinear functional mapping from structured input to structured output. More specifically, we propose to integrate high-order hidden units, guided discriminative pretraining, and high-order auto-encoders for this purpose. We evaluate the model with three datasets, and obtain state-of-the-art performances among competitive methods. Our current work focuses on structured output regression, which is a less explored area, although the model can be extended to handle structured label classification.

READ FULL TEXT
research
10/11/2022

Generalization Analysis on Learning with a Concurrent Verifier

Machine learning technologies have been used in a wide range of practica...
research
11/30/2020

A Hypergradient Approach to Robust Regression without Correspondence

We consider a regression problem, where the correspondence between input...
research
02/07/2023

Exact Inference in High-order Structured Prediction

In this paper, we study the problem of inference in high-order structure...
research
04/28/2015

Deep Neural Networks Regularization for Structured Output Prediction

A deep neural network model is a powerful framework for learning represe...
research
01/24/2019

Recovering Pairwise Interactions Using Neural Networks

Recovering pairwise interactions, i.e. pairs of input features whose joi...
research
11/19/2018

High Order Neural Networks for Video Classification

Capturing spatiotemporal correlations is an essential topic in video cla...
research
05/09/2012

Structured Input-Output Lasso, with Application to eQTL Mapping, and a Thresholding Algorithm for Fast Estimation

We consider the problem of learning a high-dimensional multi-task regres...

Please sign up or login with your details

Forgot password? Click here to reset