b'Josef Sivic'

research

∙ 06/16/2023

Meta-Personalizing Vision-Language Models to Find Named Instances in Video

Large-scale vision-language models (VLM) have shown impressive results f...

0 Chun-Hsiao Yeh, et al. ∙

research

∙ 06/15/2023

Language-Guided Music Recommendation for Video via Prompt Analogies

We propose a method to recommend music for an input video while allowing...

0 Daniel McKee, et al. ∙

research

∙ 02/27/2023

Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioning

In this work, we introduce Vid2Seq, a multi-modal single-stage dense eve...

5 Antoine Yang, et al. ∙

research

∙ 12/13/2022

MegaPose: 6D Pose Estimation of Novel Objects via Render Compare

We introduce MegaPose, a method to estimate the 6D pose of novel objects...

0 Yann Labbé, et al. ∙

research

∙ 11/24/2022

Multi-Task Learning of Object State Changes from Uncurated Videos

We aim to learn to temporally localize object state changes and the corr...

0 Tomáš Souček, et al. ∙

research

∙ 09/19/2022

Differentiable Collision Detection: a Randomized Smoothing Approach

Collision detection appears as a canonical operation in a large range of...

0 Louis Montaut, et al. ∙

research

∙ 08/03/2022

Learning Object Manipulation Skills from Video via Approximate Differentiable Physics

We aim to teach robots to perform simple object manipulation tasks by wa...

8 Vladimír Petrík, et al. ∙

research

∙ 06/16/2022

Zero-Shot Video Question Answering via Frozen Bidirectional Language Models

Video question answering (VideoQA) is a complex task that requires diver...

8 Antoine Yang, et al. ∙

research

∙ 05/19/2022

Collision Detection Accelerated: An Optimization Perspective

Collision detection between two convex shapes is an essential feature of...

0 Louis Montaut, et al. ∙

research

∙ 05/10/2022

Learning to Answer Visual Questions from Web Videos

Recent methods for visual question answering rely on large-scale annotat...

7 Antoine Yang, et al. ∙

research

∙ 04/11/2022

Focal Length and Object Pose Estimation via Render and Compare

We introduce FocalPose, a neural render-and-compare method for jointly e...

7 Georgy Ponimatkin, et al. ∙

research

∙ 03/30/2022

TubeDETR: Spatio-Temporal Video Grounding with Transformers

We consider the problem of localizing a spatio-temporal tube in a video ...

8 Antoine Yang, et al. ∙

research

∙ 03/22/2022

Look for the Change: Learning Object States and State-Modifying Actions from Untrimmed Web Videos

Human actions often induce changes of object states such as "cutting an ...

4 Tomáš Souček, et al. ∙

research

∙ 03/21/2022

Drive Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillation

This work investigates learning pixel-wise semantic image segmentation i...

16 Antonin Vobecky, et al. ∙

research

∙ 11/04/2021

Learning to Manipulate Tools by Aligning Simulation to Video Demonstration

A seamless integration of robots into human environments requires robots...

0 Kateryna Zorina, et al. ∙

research

∙ 11/02/2021

Estimating 3D Motion and Forces of Human-Object Interactions from Internet Videos

In this paper, we introduce a method to automatically reconstruct the 3D...

0 Zongmian Li, et al. ∙

research

∙ 10/07/2021

Weakly Supervised Human-Object Interaction Detection in Video via Contrastive Spatiotemporal Regions

We introduce the task of weakly supervised learning for detecting human ...

11 Shuang Li, et al. ∙

research

∙ 09/09/2021

Reconstructing and grounding narrated instructional videos in 3D

Narrated instructional videos often show and describe manipulations of s...

3 Dimitri Zhukov, et al. ∙

research

∙ 04/19/2021

Single-view robot pose and joint angle estimation via render compare

We introduce RoboPose, a method to estimate the joint angles and the 6D ...

3 Yann Labbé, et al. ∙

research

∙ 04/01/2021

Visualizing computation in large-scale cellular automata

Emergent processes in complex systems such as cellular automata can perf...

0 Hugo Cisneros, et al. ∙

research

∙ 03/30/2021

Thinking Fast and Slow: Efficient Text-to-Visual Retrieval with Transformers

Our objective is language-based search of large-scale image and video da...

7 Antoine Miech, et al. ∙

research

∙ 12/15/2020

Artificial Dummies for Urban Dataset Augmentation

Existing datasets for training pedestrian detectors in images suffer fro...

0 Antonin Vobecky, et al. ∙

research

∙ 12/01/2020

Just Ask: Learning to Answer Questions from Millions of Narrated Videos

Modern approaches to visual question answering require large annotated d...

5 Antoine Yang, et al. ∙

research

∙ 11/13/2020

Learning Object Manipulation Skills via Approximate State Estimation from Real Videos

Humans are adept at learning new tasks by watching a few instructional v...

9 Vladimír Petrík, et al. ∙

research

∙ 08/19/2020

CosyPose: Consistent multi-view multi-object 6D pose estimation

We introduce an approach for recovering the 6D pose of multiple known ob...

12 Yann Labbé, et al. ∙

research

∙ 08/03/2020

RareAct: A video dataset of unusual interactions

This paper introduces a manually annotated video dataset of unusual acti...

15 Antoine Miech, et al. ∙

research

∙ 04/30/2020

Occlusion resistant learning of intuitive physics from videos

To reach human performance on complex tasks, a key ability for artificia...

0 Ronan Riochet, et al. ∙

research

∙ 04/22/2020

Efficient Neighbourhood Consensus Networks via Submanifold Sparse Convolutions

In this work we target the problem of estimating accurately localised co...

6 Ignacio Rocco, et al. ∙

research

∙ 12/13/2019

End-to-End Learning of Visual Representations from Uncurated Instructional Videos

Annotating videos is cumbersome, expensive and not scalable. Yet, many s...

35 Antoine Miech, et al. ∙

research

∙ 11/04/2019

Evolving Structures in Complex Systems

In this paper we propose an approach for measuring growth of complexity ...

0 Hugo Cisneros, et al. ∙

research

∙ 08/13/2019

Is This The Right Place? Geometric-Semantic Pose Verification for Indoor Visual Localization

Visual localization in large and complex indoor scenes, dominated by wea...

4 Hajime Taira, et al. ∙

research

∙ 08/02/2019

Combining learned skills and reinforcement learning for robotic manipulations

Manipulation tasks such as preparing a meal or assembling furniture rema...

5 Robin Strudel, et al. ∙

research

∙ 07/30/2019

Temporal Localization of Moments in Video Collections with Natural Language

In this paper, we introduce the task of retrieving relevant video moment...

1 Victor Escorcia, et al. ∙

research

∙ 06/07/2019

HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips

Learning text-video embeddings usually requires a dataset of video clips...

1 Antoine Miech, et al. ∙

research

∙ 05/09/2019

D2-Net: A Trainable CNN for Joint Detection and Description of Local Features

In this work we address the problem of finding reliable pixel-level corr...

16 Mihai Dusmanu, et al. ∙

research

∙ 04/23/2019

Monte-Carlo Tree Search for Efficient Visually Guided Rearrangement Planning

In this paper, we address the problem of visually guided rearrangement p...

26 Sergey Zagoruyko, et al. ∙

research

∙ 04/04/2019

Estimating 3D Motion and Forces of Person-Object Interactions from Monocular Video

In this paper, we introduce a method to automatically reconstruct the 3D...

0 Zongmian Li, et al. ∙

research

∙ 03/19/2019

Cross-task weakly supervised learning from instructional videos

In this paper we investigate learning visual models for the steps of ord...

4 Dimitri Zhukov, et al. ∙

research

∙ 01/24/2019

Teaching robots to imitate a human with no on-teacher sensors. What are the key challenges?

In this paper, we consider the problem of learning object manipulation t...

0 Radoslav Skoviera, et al. ∙

research

∙ 12/13/2018

Detecting rare visual relations using analogies

We seek to detect visual relations in images of the form of triplets t =...

14 Julia Peyre, et al. ∙

research

∙ 10/24/2018

Neighbourhood Consensus Networks

We address the problem of finding reliable dense correspondences between...

4 Ignacio Rocco, et al. ∙

research

∙ 09/05/2018

Localizing Moments in Video with Temporal Language

Localizing moments in a longer video via natural language queries is a n...

2 Lisa Anne Hendricks, et al. ∙

research

∙ 04/07/2018

Learning a Text-Video Embedding from Incomplete and Heterogeneous Data

Joint understanding of video and language is an active research area wit...

0 Antoine Miech, et al. ∙

research

∙ 03/28/2018

InLoc: Indoor Visual Localization with Dense Matching and View Synthesis

We seek to predict the 6 degree-of-freedom (6DoF) pose of a query photog...

0 Hajime Taira, et al. ∙

research

∙ 12/19/2017

End-to-end weakly-supervised semantic alignment

We tackle the task of semantic alignment where the goal is to compute de...

0 Ignacio Rocco, et al. ∙

research

∙ 08/04/2017

Localizing Moments in Video with Natural Language

We consider retrieving a specific temporal segment, or moment, from a vi...

0 Lisa Anne Hendricks, et al. ∙

research

∙ 07/29/2017

Weakly-supervised learning of visual relations

This paper introduces a novel approach for modeling visual relations bet...

0 Julia Peyre, et al. ∙

research

∙ 07/28/2017

Benchmarking 6DOF Urban Visual Localization in Changing Conditions

Visual localization enables autonomous vehicles to navigate in their sur...

0 Torsten Sattler, et al. ∙

research

∙ 07/27/2017

Learning from Video and Text via Large-Scale Discriminative Clustering

Discriminative clustering has been successfully applied to a number of w...

0 Antoine Miech, et al. ∙

research

∙ 06/21/2017

Learnable pooling with Context Gating for video classification

Common video representations often deploy an average or maximum pooling ...

0 Antoine Miech, et al. ∙

Josef Sivic

Featured Co-authors