research
∙
06/15/2023
Inverse Scaling: When Bigger Isn't Better
Work on scaling laws has found that large language models (LMs) show pre...
share
research
∙
06/08/2023
FedMLSecurity: A Benchmark for Attacks and Defenses in Federated Learning and LLMs
This paper introduces FedMLSecurity, a benchmark that simulates adversar...
research
∙
05/27/2023
Beyond Positive Scaling: How Negation Impacts Scaling Trends of Language Models
Language models have been shown to exhibit positive scaling, where perfo...
research
∙
04/19/2023
Denoising Cosine Similarity: A Theory-Driven Approach for Efficient Representation Learning
Representation learning has been increasing its impact on the research a...
research
∙
04/01/2023
Towards Understanding the Mechanism of Contrastive Learning via Similarity Structure: A Theoretical Analysis
Contrastive learning is an efficient approach to self-supervised represe...
research
∙
03/06/2023
Deep Clustering with a Constraint for Topological Invariance based on Symmetric InfoNCE
We consider the scenario of deep clustering, in which the available prio...
research
∙
02/19/2023
DGP-Net: Dense Graph Prototype Network for Few-Shot SAR Target Recognition
The inevitable feature deviation of synthetic aperture radar (SAR) image...
research
∙
02/08/2023
Adapting Pre-trained Vision Transformers from 2D to 3D through Weight Inflation Improves Medical Image Segmentation
Given the prevalence of 3D medical imaging technologies such as MRI and ...
research
∙
02/08/2023
Diagnosing and Rectifying Vision Models using Language
Recent multi-modal contrastive learning models have demonstrated the abi...
research
∙
11/16/2022
Holistic Evaluation of Language Models
Language models (LMs) are becoming the foundation for almost all major l...
research
∙
03/03/2022
Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning
We present modality gap, an intriguing geometric phenomenon of the repre...
research
∙
07/29/2020
Biomedical and Clinical English Model Packages in the Stanza Python NLP Library
We introduce biomedical and clinical English model packages for the Stan...
research
∙
03/16/2020
Stanza: A Python Natural Language Processing Toolkit for Many Human Languages
We introduce Stanza, an open-source Python natural language processing t...
research
∙
11/29/2018