research
∙
08/29/2023
Characterizing Learning Curves During Language Model Pre-Training: Learning, Forgetting, and Stability
How do language models learn to make predictions during pre-training? To...
share
research
∙
05/22/2022
