Adaptive Teaching of Temporal Logic Formulas to Learners with Preferences

01/27/2020
by   Zhe Xu, et al.
0

Machine teaching is an algorithmic framework for teaching a target hypothesis via a sequence of examples or demonstrations. We investigate machine teaching for temporal logic formulas – a novel and expressive hypothesis class amenable to time-related task specifications. In the context of teaching temporal logic formulas, an exhaustive search even for a myopic solution takes exponential time (with respect to the time span of the task). We propose an efficient approach for teaching parametric linear temporal logic formulas. Concretely, we derive a necessary condition for the minimal time length of a demonstration to eliminate a set of hypotheses. Utilizing this condition, we propose a myopic teaching algorithm by solving a sequence of integer programming problems. We further show that, under two notions of teaching complexity, the proposed algorithm has near-optimal performance. The results strictly generalize the previous results on teaching preference-based version space learners. We evaluate our algorithm extensively under a variety of learner types (i.e., learners with different preference models) and interactive protocols (e.g., batched and adaptive). The results show that the proposed algorithms can efficiently teach a given target temporal logic formula under various settings, and that there are significant gains of teaching efficacy when the teacher adapts to the learner's current hypotheses or uses oracles.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/14/2018

Understanding the Role of Adaptivity in Machine Teaching: The Case of Version Space Learners

In real-world applications of education and human teaching, an effective...
research
10/17/2020

Preference-Based Batch and Sequential Teaching

Algorithmic machine teaching studies the interaction between a teacher a...
research
11/29/2019

Class Teaching for Inverse Reinforcement Learners

In this paper we propose the first machine teaching algorithm for multip...
research
10/24/2019

Preference-Based Batch and Sequential Teaching: Towards a Unified View of Models

Algorithmic machine teaching studies the interaction between a teacher a...
research
06/02/2019

Learner-aware Teaching: Inverse Reinforcement Learning with Preferences and Constraints

Inverse reinforcement learning (IRL) enables an agent to learn complex b...
research
06/03/2020

Explaining Multi-stage Tasks by Learning Temporal Logic Formulas from Suboptimal Demonstrations

We present a method for learning multi-stage tasks from demonstrations b...
research
02/04/2022

Time-Constrained Learning

Consider a scenario in which we have a huge labeled dataset D and a limi...

Please sign up or login with your details

Forgot password? Click here to reset