Improved Representation of Asymmetrical Distances with Interval Quasimetric Embeddings

11/28/2022
by   Tongzhou Wang, et al.
0

Asymmetrical distance structures (quasimetrics) are ubiquitous in our lives and are gaining more attention in machine learning applications. Imposing such quasimetric structures in model representations has been shown to improve many tasks, including reinforcement learning (RL) and causal relation learning. In this work, we present four desirable properties in such quasimetric models, and show how prior works fail at them. We propose Interval Quasimetric Embedding (IQE), which is designed to satisfy all four criteria. On three quasimetric learning experiments, IQEs show strong approximation and generalization abilities, leading to better performance and improved efficiency over prior methods. Project Page: https://www.tongzhouwang.info/interval_quasimetric_embedding Quasimetric Learning Code Package: https://www.github.com/quasimetric-learning/torch-quasimetric

READ FULL TEXT

page 10

page 16

research
03/24/2023

marl-jax: Multi-agent Reinforcement Leaning framework for Social Generalization

Recent advances in Reinforcement Learning (RL) have led to many exciting...
research
06/09/2023

On the Importance of Feature Decorrelation for Unsupervised Representation Learning in Reinforcement Learning

Recently, unsupervised representation learning (URL) has improved the sa...
research
03/24/2023

Autonomous Blimp Control via H-infinity Robust Deep Residual Reinforcement Learning

Due to their superior energy efficiency, blimps may replace quadcopters ...
research
01/06/2022

Efficiently Disentangle Causal Representations

This paper proposes an efficient approach to learning disentangled repre...
research
07/03/2019

Reasoning and Generalization in RL: A Tool Use Perspective

Learning to use tools to solve a variety of tasks is an innate ability o...
research
02/25/2021

A Probabilistic Interpretation of Self-Paced Learning with Applications to Reinforcement Learning

Across machine learning, the use of curricula has shown strong empirical...
research
04/03/2021

New Benchmarks for Learning on Non-Homophilous Graphs

Much data with graph structures satisfy the principle of homophily, mean...

Please sign up or login with your details

Forgot password? Click here to reset