Log In Sign Up

Two Birds with One Stone: Investigating Invertible Neural Networks for Inverse Problems in Morphology

by   Gözde Gül Şahin, et al.

Most problems in natural language processing can be approximated as inverse problems such as analysis and generation at variety of levels from morphological (e.g., cat+Plural <-> cats) to semantic (e.g., (call + 1 2) <-> "Calculate one plus two."). Although the tasks in both directions are closely related, general approach in the field has been to design separate models specific for each task. However, having one shared model for both tasks, would help the researchers exploit the common knowledge among these problems with reduced time and memory requirements. We investigate a specific class of neural networks, called Invertible Neural Networks (INNs) (Ardizzone et al. 2019) that enable simultaneous optimization in both directions, hence allow addressing of inverse problems via a single model. In this study, we investigate INNs on morphological problems casted as inverse problems. We apply INNs to various morphological tasks with varying ambiguity and show that they provide competitive performance in both directions. We show that they are able to recover the morphological input parameters, i.e., predicting the lemma (e.g., cat) or the morphological tags (e.g., Plural) when run in the reverse direction, without any significant performance drop in the forward direction, i.e., predicting the surface form (e.g., cats).


A Resource for Studying Chatino Verbal Morphology

We present the first resource focusing on the verbal inflectional morpho...

Denoising Score-Matching for Uncertainty Quantification in Inverse Problems

Deep neural networks have proven extremely efficient at solving a wide r...

Parallel Diffusion Models of Operator and Image for Blind Inverse Problems

Diffusion model-based inverse problem solvers have demonstrated state-of...

Contextualization of Morphological Inflection

Critical to natural language generation is the production of correctly i...

Benchmarking Invertible Architectures on Inverse Problems

Recent work demonstrated that flow-based invertible neural networks are ...

Verifying Inverse Model Neural Networks

Inverse problems exist in a wide variety of physical domains from aerosp...

Tackling Morphological Analogies Using Deep Learning – Extended Version

Analogical proportions are statements of the form "A is to B as C is to ...