Diffusion Models in NLP: A Survey

03/14/2023
by   Yuansong Zhu, et al.
0

Diffusion models have become a powerful family of deep generative models, with record-breaking performance in many applications. This paper first gives an overview and derivation of the basic theory of diffusion models, then reviews the research results of diffusion models in the field of natural language processing, from text generation, text-driven image generation and other four aspects, and analyzes and summarizes the relevant literature materials sorted out, and finally records the experience and feelings of this topic literature review research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/12/2023

Diffusion Models for Non-autoregressive Text Generation: A Survey

Non-autoregressive (NAR) text generation has attracted much attention in...
research
06/07/2023

A Survey on Generative Diffusion Models for Structured Data

In recent years, generative diffusion models have achieved a rapid parad...
research
02/11/2023

A Reparameterized Discrete Diffusion Model for Text Generation

This work studies discrete diffusion probabilistic models with applicati...
research
12/20/2022

SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers

Diffusion model, a new generative modelling paradigm, has achieved great...
research
09/02/2022

Diffusion Models: A Comprehensive Survey of Methods and Applications

Diffusion models are a class of deep generative models that have shown i...
research
07/25/2022

Innovations in Neural Data-to-text Generation

The neural boom that has sparked natural language processing (NLP) resea...
research
04/09/2023

A Comprehensive Survey on Knowledge Distillation of Diffusion Models

Diffusion Models (DMs), also referred to as score-based diffusion models...

Please sign up or login with your details

Forgot password? Click here to reset