Unsupervised Meta Learning for One Shot Title Compression in Voice Commerce

02/22/2021
by   Snehasish Mukherjee, et al.
0

Product title compression for voice and mobile commerce is a well studied problem with several supervised models proposed so far. However these models have 2 major limitations; they are not designed to generate compressions dynamically based on cues at inference time, and they do not transfer well to different categories at test time. To address these shortcomings we model title compression as a meta learning problem where we ask can we learn a title compression model given only 1 example compression? We adopt an unsupervised approach to meta training by proposing an automatic task generation algorithm that models the observed label generation process as the outcome of 4 unobserved processes. We create parameterized approximations to each of these 4 latent processes to get a principled way of generating random compression rules, which are treated as different tasks. For our main meta learner, we use 2 models; M1 and M2. M1 is a task agnostic embedding generator whose output feeds into M2 which is a task specific label generator. We pre-train M1 on a novel unsupervised segment rank prediction task that allows us to treat M1 as a segment generator that also learns to rank segments during the meta-training process. Our experiments on 16000 crowd generated meta-test examples show that our unsupervised meta training regime is able to acquire a learning algorithm for different tasks after seeing only 1 example for each task. Further, we show that our model trained end to end as a black box meta learner, outperforms non parametric approaches. Our best model obtains an F1 score of 0.8412, beating the baseline by a large margin of 25 F1 points.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/24/2021

Meta-Regularization by Enforcing Mutual-Exclusiveness

Meta-learning models have two objectives. First, they need to be able to...
research
03/02/2018

Natural Language to Structured Query Generation via Meta-Learning

In conventional supervised training, a model is trained to fit all the t...
research
12/09/2019

Unsupervised Curricula for Visual Meta-Reinforcement Learning

In principle, meta-reinforcement learning algorithms leverage experience...
research
06/04/2018

Meta Learner with Linear Nulling

We propose a meta learning algorithm utilizing a linear transformer that...
research
07/16/2020

Layer-Wise Adaptive Updating for Few-Shot Image Classification

Few-shot image classification (FSIC), which requires a model to recogniz...
research
06/27/2023

Unsupervised Episode Generation for Graph Meta-learning

In this paper, we investigate Unsupervised Episode Generation methods to...
research
08/01/2020

Relation-aware Meta-learning for Market Segment Demand Prediction with Limited Records

Recently, E-commerce platforms have extensive impacts on our human life....

Please sign up or login with your details

Forgot password? Click here to reset