research
∙
07/12/2023
Mini-Batch Optimization of Contrastive Loss
Contrastive learning has gained significant attention as a method for se...
share
research
∙
07/07/2023
Teaching Arithmetic to Small Transformers
Large language models like GPT-4 exhibit emergent capabilities across ge...
research
∙
05/30/2023
Dissecting Chain-of-Thought: A Study on Compositional In-Context Learning of MLPs
Chain-of-thought (CoT) is a method that enables language models to handl...
research
∙
02/24/2022
Rare Gems: Finding Lottery Tickets at Initialization
It has been widely observed that large neural networks can be pruned to ...
research
∙
10/18/2021
Finding Everything within Random Binary Networks
A recent work by Ramanujan et al. (2020) provides significant empirical ...
research
∙
06/14/2021
An Exponential Improvement on the Memorization Capacity of Deep Threshold Networks
It is well known that modern deep neural networks are powerful enough to...
research
∙
07/09/2020