Duality Regularization for Unsupervised Bilingual Lexicon Induction

09/03/2019
by   Xuefeng Bai, et al.
0

Unsupervised bilingual lexicon induction naturally exhibits duality, which results from symmetry in back-translation. For example, EN-IT and IT-EN induction can be mutually primal and dual problems. Current state-of-the-art methods, however, consider the two tasks independently. In this paper, we propose to train primal and dual models jointly, using regularizers to encourage consistency in back translation cycles. Experiments across 6 language pairs show that the proposed method significantly outperforms competitive baselines, obtaining the best-published results on a standard benchmark.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/27/2012

Duality between subgradient and conditional gradient methods

Given a convex optimization problem and its dual, there are many possibl...
research
01/31/2020

Unsupervised Bilingual Lexicon Induction Across Writing Systems

Recent embedding-based methods in unsupervised bilingual lexicon inducti...
research
10/24/2020

Clustering Contextualized Representations of Text for Unsupervised Syntax Induction

We explore clustering of contextualized text representations for two uns...
research
08/06/2023

Discrete weak duality of hybrid high-order methods for convex minimization problems

This paper derives a discrete dual problem for a prototypical hybrid hig...
research
05/26/2023

Duality in Multi-View Restricted Kernel Machines

We propose a unifying setting that combines existing restricted kernel m...
research
06/30/2011

Dual Modelling of Permutation and Injection Problems

When writing a constraint program, we have to choose which variables sho...

Please sign up or login with your details

Forgot password? Click here to reset