DeepAI AI Chat
Log In Sign Up

Why is constrained neural language generation particularly challenging?

by   Cristina Garbacea, et al.
University of Michigan

Recent advances in deep neural language models combined with the capacity of large scale datasets have accelerated the development of natural language generation systems that produce fluent and coherent texts (to various degrees of success) in a multitude of tasks and application contexts. However, controlling the output of these models for desired user and task needs is still an open challenge. This is crucial not only to customizing the content and style of the generated language, but also to their safe and reliable deployment in the real world. We present an extensive survey on the emerging topic of constrained neural language generation in which we formally define and categorize the problems of natural language generation by distinguishing between conditions and constraints (the latter being testable conditions on the output text instead of the input), present constrained text generation tasks, and review existing methods and evaluation metrics for constrained text generation. Our aim is to highlight recent progress and trends in this emerging field, informing on the most promising directions and limitations towards advancing the state-of-the-art of constrained neural language generation research.


Neural Language Generation: Formulation, Methods, and Evaluation

Recent advances in neural network-based generative modeling have reignit...

Judge the Judges: A Large-Scale Evaluation Study of Neural Language Models for Online Review Generation

Recent advances in deep learning have resulted in a resurgence in the po...

Controlling Linguistic Style Aspects in Neural Language Generation

Most work on neural natural language generation (NNLG) focus on controll...

Recent Advances in Neural Question Generation

Emerging research in Neural Question Generation (NQG) has started to int...

Controllable Text Generation for Open-Domain Creativity and Fairness

Recent advances in large pre-trained language models have demonstrated s...

Natural Language Generation for Advertising: A Survey

Natural language generation methods have emerged as effective tools to h...

Uncertainty in Natural Language Generation: From Theory to Applications

Recent advances of powerful Language Models have allowed Natural Languag...