AI Chat AI Image Generator AI Video Text to Speech

Training Data Extraction From Pre-trained Language Models: A Survey

05/25/2023

∙

by Shotaro Ishihara, et al.

∙

∙

As the deployment of pre-trained language models (PLMs) expands, pressing security concerns have arisen regarding the potential for malicious extraction of training data, posing a threat to data privacy. This study is the first to provide a comprehensive survey of training data extraction from PLMs. Our review covers more than 100 key papers in fields such as natural language processing and security. First, preliminary knowledge is recapped and a taxonomy of various definitions of memorization is presented. The approaches for attack and defense are then systemized. Furthermore, the empirical findings of several quantitative studies are highlighted. Finally, future research directions based on this review are suggested.

page 1

page 2

page 3

page 4

research

∙ 02/14/2022

Threats to Pre-trained Language Models: Survey and Taxonomy

Pre-trained language models (PTLMs) have achieved great success and rema...

0 Shangwei Guo, et al. ∙

research

∙ 08/28/2023

A Comprehensive Overview of Backdoor Attacks in Large Language Models within Communication Networks

The Large Language Models (LLMs) are poised to offer efficient and intel...

0 Haomiao Yang, et al. ∙

research

∙ 02/09/2023

Bag of Tricks for Training Data Extraction from Language Models

With the advance of language models, privacy protection is receiving mor...

0 Weichen Yu, et al. ∙

research

∙ 05/19/2023

Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning

Large Language Models (LLMs) are known to memorize significant portions ...

0 Mustafa Safa Ozdayi, et al. ∙

research

∙ 07/10/2023

Ethicist: Targeted Training Data Extraction Through Loss Smoothed Soft Prompting and Calibrated Confidence Estimation

Large pre-trained language models achieve impressive results across many...

0 Zhexin Zhang, et al. ∙

research

∙ 07/12/2023

A Comprehensive Overview of Large Language Models

Large Language Models (LLMs) have shown excellent generalization capabil...

0 Humza Naveed, et al. ∙

research

∙ 12/09/2022

Training Data Influence Analysis and Estimation: A Survey

Good models require good training data. For overparameterized deep model...

0 Zayd Hammoudeh, et al. ∙