research
∙
06/16/2023
Meta-Personalizing Vision-Language Models to Find Named Instances in Video
Large-scale vision-language models (VLM) have shown impressive results f...
share
research
∙
06/15/2023
Language-Guided Music Recommendation for Video via Prompt Analogies
We propose a method to recommend music for an input video while allowing...
research
∙
02/27/2023
Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioning
In this work, we introduce Vid2Seq, a multi-modal single-stage dense eve...
research
∙
12/13/2022
MegaPose: 6D Pose Estimation of Novel Objects via Render Compare
We introduce MegaPose, a method to estimate the 6D pose of novel objects...
research
∙
11/24/2022
Multi-Task Learning of Object State Changes from Uncurated Videos
We aim to learn to temporally localize object state changes and the corr...
research
∙
09/19/2022
Differentiable Collision Detection: a Randomized Smoothing Approach
Collision detection appears as a canonical operation in a large range of...
research
∙
08/03/2022
Learning Object Manipulation Skills from Video via Approximate Differentiable Physics
We aim to teach robots to perform simple object manipulation tasks by wa...
research
∙
06/16/2022
Zero-Shot Video Question Answering via Frozen Bidirectional Language Models
Video question answering (VideoQA) is a complex task that requires diver...
research
∙
05/19/2022
Collision Detection Accelerated: An Optimization Perspective
Collision detection between two convex shapes is an essential feature of...
research
∙
05/10/2022
Learning to Answer Visual Questions from Web Videos
Recent methods for visual question answering rely on large-scale annotat...
research
∙
04/11/2022
Focal Length and Object Pose Estimation via Render and Compare
We introduce FocalPose, a neural render-and-compare method for jointly e...
research
∙
03/30/2022
TubeDETR: Spatio-Temporal Video Grounding with Transformers
We consider the problem of localizing a spatio-temporal tube in a video ...
research
∙
03/22/2022
Look for the Change: Learning Object States and State-Modifying Actions from Untrimmed Web Videos
Human actions often induce changes of object states such as "cutting an ...
research
∙
03/21/2022
Drive Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillation
This work investigates learning pixel-wise semantic image segmentation i...
research
∙
11/04/2021
Learning to Manipulate Tools by Aligning Simulation to Video Demonstration
A seamless integration of robots into human environments requires robots...
research
∙
11/02/2021
Estimating 3D Motion and Forces of Human-Object Interactions from Internet Videos
In this paper, we introduce a method to automatically reconstruct the 3D...
research
∙
10/07/2021
Weakly Supervised Human-Object Interaction Detection in Video via Contrastive Spatiotemporal Regions
We introduce the task of weakly supervised learning for detecting human ...
research
∙
09/09/2021
Reconstructing and grounding narrated instructional videos in 3D
Narrated instructional videos often show and describe manipulations of s...
research
∙
04/19/2021
Single-view robot pose and joint angle estimation via render compare
We introduce RoboPose, a method to estimate the joint angles and the 6D ...
research
∙
04/01/2021
Visualizing computation in large-scale cellular automata
Emergent processes in complex systems such as cellular automata can perf...
research
∙
03/30/2021
Thinking Fast and Slow: Efficient Text-to-Visual Retrieval with Transformers
Our objective is language-based search of large-scale image and video da...
research
∙
12/15/2020
Artificial Dummies for Urban Dataset Augmentation
Existing datasets for training pedestrian detectors in images suffer fro...
research
∙
12/01/2020
Just Ask: Learning to Answer Questions from Millions of Narrated Videos
Modern approaches to visual question answering require large annotated d...
research
∙
11/13/2020
Learning Object Manipulation Skills via Approximate State Estimation from Real Videos
Humans are adept at learning new tasks by watching a few instructional v...
research
∙
08/19/2020
CosyPose: Consistent multi-view multi-object 6D pose estimation
We introduce an approach for recovering the 6D pose of multiple known ob...
research
∙
08/03/2020
RareAct: A video dataset of unusual interactions
This paper introduces a manually annotated video dataset of unusual acti...
research
∙
04/30/2020
Occlusion resistant learning of intuitive physics from videos
To reach human performance on complex tasks, a key ability for artificia...
research
∙
04/22/2020
Efficient Neighbourhood Consensus Networks via Submanifold Sparse Convolutions
In this work we target the problem of estimating accurately localised co...
research
∙
12/13/2019
End-to-End Learning of Visual Representations from Uncurated Instructional Videos
Annotating videos is cumbersome, expensive and not scalable. Yet, many s...
research
∙
11/04/2019
Evolving Structures in Complex Systems
In this paper we propose an approach for measuring growth of complexity ...
research
∙
08/13/2019
Is This The Right Place? Geometric-Semantic Pose Verification for Indoor Visual Localization
Visual localization in large and complex indoor scenes, dominated by wea...
research
∙
08/02/2019
Combining learned skills and reinforcement learning for robotic manipulations
Manipulation tasks such as preparing a meal or assembling furniture rema...
research
∙
07/30/2019
Temporal Localization of Moments in Video Collections with Natural Language
In this paper, we introduce the task of retrieving relevant video moment...
research
∙
06/07/2019
HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips
Learning text-video embeddings usually requires a dataset of video clips...
research
∙
05/09/2019
D2-Net: A Trainable CNN for Joint Detection and Description of Local Features
In this work we address the problem of finding reliable pixel-level corr...
research
∙
04/23/2019
Monte-Carlo Tree Search for Efficient Visually Guided Rearrangement Planning
In this paper, we address the problem of visually guided rearrangement p...
research
∙
04/04/2019
Estimating 3D Motion and Forces of Person-Object Interactions from Monocular Video
In this paper, we introduce a method to automatically reconstruct the 3D...
research
∙
03/19/2019
Cross-task weakly supervised learning from instructional videos
In this paper we investigate learning visual models for the steps of ord...
research
∙
01/24/2019
Teaching robots to imitate a human with no on-teacher sensors. What are the key challenges?
In this paper, we consider the problem of learning object manipulation t...
research
∙
12/13/2018
Detecting rare visual relations using analogies
We seek to detect visual relations in images of the form of triplets t =...
research
∙
10/24/2018
Neighbourhood Consensus Networks
We address the problem of finding reliable dense correspondences between...
research
∙
09/05/2018
Localizing Moments in Video with Temporal Language
Localizing moments in a longer video via natural language queries is a n...
research
∙
04/07/2018
Learning a Text-Video Embedding from Incomplete and Heterogeneous Data
Joint understanding of video and language is an active research area wit...
research
∙
03/28/2018
InLoc: Indoor Visual Localization with Dense Matching and View Synthesis
We seek to predict the 6 degree-of-freedom (6DoF) pose of a query photog...
research
∙
12/19/2017
End-to-end weakly-supervised semantic alignment
We tackle the task of semantic alignment where the goal is to compute de...
research
∙
08/04/2017
Localizing Moments in Video with Natural Language
We consider retrieving a specific temporal segment, or moment, from a vi...
research
∙
07/29/2017
Weakly-supervised learning of visual relations
This paper introduces a novel approach for modeling visual relations bet...
research
∙
07/28/2017
Benchmarking 6DOF Urban Visual Localization in Changing Conditions
Visual localization enables autonomous vehicles to navigate in their sur...
research
∙
07/27/2017
Learning from Video and Text via Large-Scale Discriminative Clustering
Discriminative clustering has been successfully applied to a number of w...
research
∙
06/21/2017