DeepAI AI Chat
Log In Sign Up

Set-to-Sequence Methods in Machine Learning: a Review

by   Mateusz Jurewicz, et al.

Machine learning on sets towards sequential output is an important and ubiquitous task, with applications ranging from language modelling and meta-learning to multi-agent strategy games and power grid optimization. Combining elements of representation learning and structured prediction, its two primary challenges include obtaining a meaningful, permutation invariant set representation and subsequently utilizing this representation to output a complex target permutation. This paper provides a comprehensive introduction to the field as well as an overview of important machine learning methods tackling both of these key challenges, with a detailed qualitative comparison of selected model architectures.


page 1

page 2

page 3

page 4


Weisfeiler and Leman go Machine Learning: The Story so far

In recent years, algorithms and neural architectures based on the Weisfe...

A Survey on Multi-output Learning

Multi-output learning aims to simultaneously predict multiple outputs gi...

PIC: Permutation Invariant Critic for Multi-Agent Deep Reinforcement Learning

Sample efficiency and scalability to a large number of agents are two im...

Improved Structural Discovery and Representation Learning of Multi-Agent Data

Central to all machine learning algorithms is data representation. For m...

Permutation-Invariant Set Autoencoders with Fixed-Size Embeddings for Multi-Agent Learning

The problem of permutation-invariant learning over set representations i...

A Sequential Set Generation Method for Predicting Set-Valued Outputs

Consider a general machine learning setting where the output is a set of...