b'Kate Saenko'

research

∙ 08/31/2023

Socratis: Are large multimodal models emotionally aware?

Existing emotion prediction benchmarks contain coarse emotion labels whi...

0 Katherine Deng, et al. ∙

research

∙ 08/24/2023

Label Budget Allocation in Multi-Task Learning

The cost of labeling data often limits the performance of machine learni...

0 Ximeng Sun, et al. ∙

research

∙ 08/08/2023

From Fake to Real (FFR): A two-stage training pipeline for mitigating spurious correlations with synthetic data

Visual recognition models are prone to learning spurious correlations in...

0 Maan Qraitem, et al. ∙

research

∙ 08/03/2023

DualCoOp++: Fast and Effective Adaptation to Multi-Label Recognition with Limited Annotations

Multi-label image recognition in the low-label regime is a task of great...

0 Ping Hu, et al. ∙

research

∙ 07/24/2023

Multiscale Video Pretraining for Long-Term Activity Forecasting

Long-term activity forecasting is an especially challenging research pro...

0 Reuben Tan, et al. ∙

research

∙ 06/30/2023

Hardwiring ViT Patch Selectivity into CNNs using Patch Mixing

Vision transformers (ViTs) have significantly changed the computer visio...

0 Ariel N. Lee, et al. ∙

research

∙ 05/09/2023

WikiWeb2M: A Page-Level Multimodal Wikipedia Dataset

Webpages have been a rich resource for language and vision-language task...

0 Andrea Burns, et al. ∙

research

∙ 05/05/2023

COLA: How to adapt vision-language models to Compose Objects Localized with Attributes?

Compositional reasoning is a hallmark of human visual intelligence; yet ...

0 Arijit Ray, et al. ∙

research

∙ 05/05/2023

A Suite of Generative Tasks for Multi-Level Multimodal Webpage Understanding

Webpages have been a rich, scalable resource for vision-language and lan...

0 Andrea Burns, et al. ∙

research

∙ 04/04/2023

ERM++: An Improved Baseline for Domain Generalization

Multi-source Domain Generalization (DG) measures a classifier's ability ...

0 Piotr Teterwak, et al. ∙

research

∙ 03/31/2023

DIME-FM: DIstilling Multimodal and Efficient Foundation Models

Large Vision-Language Foundation Models (VLFM), such as CLIP, ALIGN and ...

0 Ximeng Sun, et al. ∙

research

∙ 03/28/2023

Language-Guided Audio-Visual Source Separation via Trimodal Consistency

We propose a self-supervised approach for learning to perform audio sour...

0 Reuben Tan, et al. ∙

research

∙ 03/26/2023

VisDA 2022 Challenge: Domain Adaptation for Industrial Waste Sorting

Label-efficient and reliable semantic segmentation is essential for many...

0 Dina Bashkirova, et al. ∙

research

∙ 03/26/2023

Mind the Backbone: Minimizing Backbone Distortion for Robust Object Detection

Building object detectors that are robust to domain shifts is critical f...

0 Kuniaki Saito, et al. ∙

research

∙ 02/10/2023

MaskSketch: Unpaired Structure-guided Masked Image Generation

Recent conditional image generation methods produce images of remarkable...

0 Dina Bashkirova, et al. ∙

research

∙ 02/06/2023

Pic2Word: Mapping Pictures to Words for Zero-shot Composed Image Retrieval

In Composed Image Retrieval (CIR), a user combines a query image with te...

0 Kuniaki Saito, et al. ∙

research

∙ 01/17/2023

The SwaNNFlight System: On-the-Fly Sim-to-Real Adaptation via Anchored Learning

Reinforcement Learning (RL) agents trained in simulated environments and...

0 Bassel El Mabsout, et al. ∙

research

∙ 11/29/2022

Finding Differences Between Transformers and ConvNets Using Counterfactual Simulation Testing

Modern deep neural networks tend to be evaluated on static test sets. On...

0 Nataniel Ruiz, et al. ∙

research

∙ 11/27/2022

Exploring Consistency in Cross-Domain Transformer for Domain Adaptive Semantic Segmentation

While transformers have greatly boosted performance in semantic segmenta...

0 Kaihong Wang, et al. ∙

research

∙ 11/22/2022

Human Evaluation of Text-to-Image Models on a Multi-Task Benchmark

We provide a new multi-task benchmark for evaluating text-to-image model...

0 Vitali Petsiuk, et al. ∙

research

∙ 09/30/2022

Bias Mimicking: A Simple Sampling Approach for Bias Mitigation

Prior work has shown that Visual Recognition datasets frequently under-r...

0 Maan Qraitem, et al. ∙

research

∙ 09/08/2022

FETA: Towards Specializing Foundation Models for Expert Task Applications

Foundation Models (FMs) have demonstrated unprecedented capabilities inc...

4 Amit Alfassy, et al. ∙

research

∙ 07/26/2022

NewsStories: Illustrating articles with visual summaries

Recent self-supervised approaches have used large-scale image-text datas...

0 Reuben Tan, et al. ∙

research

∙ 06/20/2022

DualCoOp: Fast Adaptation to Multi-Label Recognition with Limited Annotations

Solving multi-label recognition (MLR) for images in the low-label regime...

0 Ximeng Sun, et al. ∙

research

∙ 06/02/2022

Prefix Conditioning Unifies Language and Label Supervision

Vision-language contrastive learning suggests a new learning paradigm by...

0 Kuniaki Saito, et al. ∙

research

∙ 04/25/2022

Temporal Relevance Analysis for Video Action Models

In this paper, we provide a deep analysis of temporal modeling for actio...

0 Quanfu Fan, et al. ∙

research

∙ 04/07/2022

Many-to-many Splatting for Efficient Video Frame Interpolation

Motion-based video frame interpolation commonly relies on optical flow t...

1 Ping Hu, et al. ∙

research

∙ 04/01/2022

A Unified Framework for Domain Adaptive Pose Estimation

While pose estimation is an important computer vision task, it requires ...

0 Donghyun Kim, et al. ∙

research

∙ 03/22/2022

A Broad Study of Pre-training for Domain Generalization and Adaptation

Deep models must learn robust and transferable representations in order ...

0 Donghyun Kim, et al. ∙

research

∙ 02/04/2022

Interactive Mobile App Navigation with Uncertain or Under-specified Natural Language Commands

We introduce Mobile app Tasks with Iterative Feedback (MoTIF), a new dat...

0 Andrea Burns, et al. ∙

research

∙ 01/29/2022

Explaining Reinforcement Learning Policies through Counterfactual Trajectories

In order for humans to confidently decide where to employ RL agents for ...

0 Julius Frost, et al. ∙

research

∙ 12/09/2021

Extending the WILDS Benchmark for Unsupervised Adaptation

Machine learning systems deployed in the wild are often trained on a sou...

17 Shiori Sagawa, et al. ∙

research

∙ 12/04/2021

Unsupervised Domain Generalization by Learning a Bridge Across Domains

The ability to generalize learned representations across significantly d...

6 Sivan Harary, et al. ∙

research

∙ 12/03/2021

Learning to Detect Every Thing in an Open World

Many open-world applications require the detection of novel objects, yet...

0 Kuniaki Saito, et al. ∙

research

∙ 11/30/2021

Task2Sim : Towards Effective Pre-training and Transfer from Synthetic Data

Pre-training models on Imagenet or other massive datasets of real images...

2 Samarth Mishra, et al. ∙

research

∙ 11/26/2021

Disentangled Unsupervised Image Translation via Restricted Information Flow

Unsupervised image-to-image translation methods aim to map images from o...

0 Ben Usman, et al. ∙

research

∙ 10/28/2021

Contrast and Mix: Temporal Contrastive Video Domain Adaptation with Background Mixing

Unsupervised domain adaptation which aims to adapt models trained on a l...

12 Aadarsh Sahoo, et al. ∙

research

∙ 10/20/2021

Look at What I'm Doing: Self-Supervised Spatial Grounding of Narrations in Instructional Videos

We introduce the task of spatially localizing narrated interactions in v...

0 Reuben Tan, et al. ∙

research

∙ 08/26/2021

Learning Cross-modal Contrastive Features for Video Domain Adaptation

Learning transferable and domain adaptive feature representations from v...

0 Donghyun Kim, et al. ∙

research

∙ 08/24/2021

Tune it the Right Way: Unsupervised Validation of Domain Adaptation via Soft Neighborhood Density

Unsupervised domain adaptation (UDA) methods can dramatically improve ge...

0 Kuniaki Saito, et al. ∙

research

∙ 08/23/2021

Dynamic Network Quantization for Efficient Video Inference

Deep convolutional networks have recently achieved great success in vide...

5 Ximeng Sun, et al. ∙

research

∙ 08/10/2021

MetaPose: Fast 3D Pose from Multiple Views without 3D Supervision

Recently, huge strides were made in monocular and multi-view pose estima...

31 Ben Usman, et al. ∙

research

∙ 07/23/2021

VisDA-2021 Competition Universal Domain Adaptation to Improve Performance on Out-of-Distribution Data

Progress in machine learning is typically measured by training and testi...

0 Dina Bashkirova, et al. ∙

research

∙ 07/19/2021

Separating Skills and Concepts for Novel Visual Question Answering

Generalization to out-of-distribution data has been a problem for Visual...

2 Spencer Whitehead, et al. ∙

research

∙ 06/04/2021

ZeroWaste Dataset: Towards Automated Waste Recycling

Less than 35 leads to increased soil and sea pollution and is one of the...

0 Dina Bashkirova, et al. ∙

research

∙ 05/28/2021

OpenMatch: Open-set Consistency Regularization for Semi-supervised Learning with Outliers

Semi-supervised learning (SSL) is an effective means to leverage unlabel...

0 Kuniaki Saito, et al. ∙

research

∙ 05/11/2021

AdaMML: Adaptive Multi-Modal Learning for Efficient Video Recognition

Multi-modal learning, which focuses on utilizing various modalities to i...

0 Rameswar Panda, et al. ∙

research

∙ 04/20/2021

Detector-Free Weakly Supervised Grounding by Separation

Nowadays, there is an abundance of data involving images and surrounding...

7 Assaf Arbelle, et al. ∙

research

∙ 04/17/2021

Mobile App Tasks with Iterative Feedback (MoTIF): Addressing Task Feasibility in Interactive Visual Environments

In recent years, vision-language research has shifted to study tasks whi...

0 Andrea Burns, et al. ∙

research

∙ 04/07/2021

OVANet: One-vs-All Network for Universal Domain Adaptation

Universal Domain Adaptation (UNDA) aims to handle both domain-shift and ...

0 Kuniaki Saito, et al. ∙

Kate Saenko

Featured Co-authors