Constraint Inference in Control Tasks from Expert Demonstrations via Inverse Optimization

04/06/2023
by   Dimitris Papadimitriou, et al.
0

Inferring unknown constraints is a challenging and crucial problem in many robotics applications. When only expert demonstrations are available, it becomes essential to infer the unknown domain constraints to deploy additional agents effectively. In this work, we propose an approach to infer affine constraints in control tasks after observing expert demonstrations. We formulate the constraint inference problem as an inverse optimization problem, and we propose an alternating optimization scheme that infers the unknown constraints by minimizing a KKT residual objective. We demonstrate the effectiveness of our method in a number of simulations, and show that our method can infer less conservative constraints than a recent baseline method while maintaining comparable safety guarantees.

READ FULL TEXT

page 6

page 7

research
05/25/2023

Learning Safety Constraints from Demonstrations with Unknown Rewards

We propose Convex Constraint Learning for Reinforcement Learning (CoCoRL...
research
12/17/2018

Learning Constraints from Demonstrations

We extend the learning from demonstration paradigm by providing a method...
research
06/20/2022

Benchmarking Constraint Inference in Inverse Reinforcement Learning

When deploying Reinforcement Learning (RL) agents into a physical system...
research
11/28/2022

Autonomous Assessment of Demonstration Sufficiency via Bayesian Inverse Reinforcement Learning

In this paper we examine the problem of determining demonstration suffic...
research
09/10/2021

Discretizing Dynamics for Maximum Likelihood Constraint Inference

Maximum likelihood constraint inference is a powerful technique for iden...
research
07/06/2022

Inferring and Conveying Intentionality: Beyond Numerical Rewards to Logical Intentions

Shared intentionality is a critical component in developing conscious AI...
research
07/11/2018

Learning Singularity Avoidance

With the increase in complexity of robotic systems and the rise in non-e...

Please sign up or login with your details

Forgot password? Click here to reset