b'Leonid Sigal'

research

∙ 01/03/2023

Vocabulary-informed Zero-shot and Open-set Learning

Despite significant progress in object categorization, in recent years, ...

Yanwei Fu, et al. ∙

research

∙ 12/06/2022

Semantically Enhanced Global Reasoning for Semantic Segmentation

Recent advances in pixel-level tasks (e.g., segmentation) illustrate the...

Mir Rayat Imtiaz Hossain, et al. ∙

research

∙ 11/28/2022

GraphPNAS: Learning Distribution of Good Neural Architectures via Deep Graph Generative Models

Neural architectures can be naturally viewed as computational graphs. Mo...

Muchen Li, et al. ∙

research

∙ 11/23/2022

Make-A-Story: Visual Memory Conditioned Consistent Story Generation

There has been a recent explosion of impressive generative models that c...

Tanzila Rahman, et al. ∙

research

∙ 10/24/2022

VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge

There has been a growing interest in solving Visual Question Answering (...

Sahithya Ravi, et al. ∙

research

∙ 10/04/2022

Real-Time Monitoring of User Stress, Heart Rate and Heart Rate Variability on Mobile Devices

Stress is considered to be the epidemic of the 21st-century. Yet, mobile...

Peyman Bateni, et al. ∙

research

∙ 07/27/2022

Iterative Scene Graph Generation

The task of scene graph generation entails identifying object entities a...

Siddhesh Khandelwal, et al. ∙

research

∙ 07/21/2022

Generalizable Patch-Based Neural Rendering

Neural rendering has received tremendous attention since the advent of N...

Mohammed Suhail, et al. ∙

research

∙ 03/22/2022

Self-supervision through Random Segments with Autoregressive Coding (RandSAC)

Inspired by the success of self-supervised autoregressive representation...

Tianyu Hua, et al. ∙

research

∙ 01/13/2022

Beyond Simple Meta-Learning: Multi-Purpose Models for Multi-Domain, Active and Continual Few-Shot Learning

Modern deep learning requires large-scale extensively labelled datasets ...

Peyman Bateni, et al. ∙

research

∙ 12/17/2021

Light Field Neural Rendering

Classical light field rendering for novel view synthesis can accurately ...

Mohammed Suhail, et al. ∙

research

∙ 11/24/2021

Layered Controllable Video Generation

We introduce layered controllable video generation, where we, without an...

Jiahui Huang, et al. ∙

research

∙ 10/26/2021

TriBERT: Full-body Human-centric Audio-visual Representation Learning for Visual Sound Separation

The recent success of transformer models in language, such as BERT, has ...

Tanzila Rahman, et al. ∙

research

∙ 06/06/2021

Referring Transformer: A One-step Approach to Multi-task Visual Grounding

As an important step towards visual reasoning, visual grounding (e.g., p...

Muchen Li, et al. ∙

research

∙ 04/29/2021

Segmentation-grounded Scene Graph Generation

Scene graph generation has emerged as an important problem in computer v...

Siddhesh Khandelwal, et al. ∙

research

∙ 03/25/2021

Weakly-supervised Audio-visual Sound Source Detection and Separation

Learning how to localize and separate individual object sounds in the au...

Tanzila Rahman, et al. ∙

research

∙ 03/03/2021

Energy-Based Learning for Scene Graph Generation

Traditional scene graph generation methods are trained using cross-entro...

Mohammed Suhail, et al. ∙

research

∙ 11/04/2020

An Improved Attention for Visual Question Answering

We consider the problem of Visual Question Answering (VQA). Given an ima...

Tanzila Rahman, et al. ∙

research

∙ 08/28/2020

Person-in-Context Synthesiswith Compositional Structural Space

Despite significant progress, controlled generation of complex images wi...

Weidong Yin, et al. ∙

research

∙ 08/27/2020

Attribute-guided image generation from layout

Recent approaches have achieved great success in image generation from s...

Ke Ma, et al. ∙

research

∙ 06/25/2020

Unsupervised Video Decomposition using Spatio-temporal Iterative Inference

Unsupervised multi-object scene decomposition is a fast-emerging problem...

Polina Zablotskaia, et al. ∙

research

∙ 06/23/2020

Discriminative Feature Alignment: Improving Transferability of Unsupervised Domain Adaptation by Gaussian-guided Latent Alignment

In this study, we focus on the unsupervised domain adaptation problem wh...

Jing Wang, et al. ∙

research

∙ 06/23/2020

Discriminative Feature Alignment: ImprovingTransferability of Unsupervised DomainAdaptation by Gaussian-guided LatentAlignment

In this study, we focus on the unsupervised domain adaptation problem wh...

Jing Wang, et al. ∙

research

∙ 06/12/2020

Weakly-supervised Any-shot Object Detection

Methods for object detection and segmentation rely on large scale instan...

Siddhesh Khandelwal, et al. ∙

research

∙ 04/02/2020

Consistent Multiple Sequence Decoding

Sequence decoding is one of the core components of most visual-lingual m...

Bicheng Xu, et al. ∙

research

∙ 02/24/2020

Variational Hyper RNN for Sequence Modeling

In this work, we propose a novel probabilistic sequence model that excel...

Ruizhi Deng, et al. ∙

research

∙ 12/23/2019

Front2Back: Single View 3D Shape Reconstruction via Front to Back Prediction

Reconstruction of a 3D shape from a single 2D image is a classical compu...

Yuan Yao, et al. ∙

research

∙ 12/07/2019

Improved Few-Shot Visual Classification

Few-shot learning is a fundamental task in computer vision that carries ...

Peyman Bateni, et al. ∙

research

∙ 12/05/2019

Zero-Shot Generation of Human-Object Interaction Videos

Generation of videos of complex scenes is an important open problem in c...

Megha Nawhal, et al. ∙

research

∙ 11/29/2019

OptiBox: Breaking the Limits of Proposals for Visual Grounding

The problem of language grounding has attracted much attention in recent...

Zicong Fan, et al. ∙

research

∙ 10/21/2019

DwNet: Dense warp-based network for pose-guided human video generation

Generation of realistic high-resolution videos of human subjects is a ch...

Polina Zablotskaia, et al. ∙

research

∙ 09/22/2019

Watch, Listen and Tell: Multi-modal Weakly Supervised Dense Event Captioning

Multi-modal learning, particularly among imaging and linguistic modaliti...

Tanzila Rahman, et al. ∙

research

∙ 07/24/2019

LayoutVAE: Stochastic Scene Layout Generation from a Label Set

Recently there is an increasing interest in scene generation within the ...

Akash Abdu Jyothi, et al. ∙

research

∙ 05/22/2019

AttentionRNN: A Structured Spatial Attention Mechanism

Visual attention mechanisms have proven to be integrally important const...

Siddhesh Khandelwal, et al. ∙

research

∙ 04/05/2019

A Variational Auto-Encoder Model for Stochastic Point Processes

We propose a novel probabilistic generative model for action sequences. ...

Nazanin Mehrasa, et al. ∙

research

∙ 03/18/2019

Neural Sequential Phrase Grounding (SeqGROUND)

We propose an end-to-end approach for phrase grounding in images. Unlike...

Pelin Dogan, et al. ∙

research

∙ 12/04/2018

Walking on Thin Air: Environment-Free Physics-based Markerless Motion Capture

We propose a generative approach to physics-based motion capture. Unlike...

Micha Livne, et al. ∙

research

∙ 12/01/2018

Towards Traversing the Continuous Spectrum of Image Retrieval

Image retrieval is one of the most popular tasks in computer vision. How...

Ziad Al-Halah, et al. ∙

research

∙ 11/28/2018

Image Generation from Layout

Despite significant recent progress on generative models, controlled gen...

Bo Zhao, et al. ∙

research

∙ 10/28/2018

Middle-Out Decoding

Despite being virtually ubiquitous, sequence-to-sequence models are chal...

Shikib Mehri, et al. ∙

research

∙ 10/17/2018

Learning to Separate Domains in Generalized Zero-Shot and Open Set Learning: a probabilistic perspective

This paper studies the problem of domain division problem which aims to ...

HanZe Dong, et al. ∙

research

∙ 10/01/2018

Where and When to Look? Spatio-temporal Attention for Action Recognition in Videos

Inspired by the observation that humans are able to process videos effic...

Lili Meng, et al. ∙

research

∙ 04/15/2018

Semantic Feature Augmentation in Few-shot Learning

A fundamental problem with few-shot learning is the scarcity of data in ...

Zitian Chen, et al. ∙

research

∙ 04/13/2018

Text-to-Clip Video Retrieval with Early Fusion and Re-Captioning

We propose a novel method capable of retrieving clips from untrimmed vid...

Huijuan Xu, et al. ∙

research

∙ 04/10/2018

Modular Generative Adversarial Networks

Existing methods for multi-domain image-to-image translation (or generat...

Bo Zhao, et al. ∙

research

∙ 03/21/2018

Probabilistic Video Generation using Holistic Attribute Control

Videos express highly structured spatio-temporal patterns of visual data...

Jiawei He, et al. ∙

research

∙ 02/28/2018

Joint Event Detection and Description in Continuous Video Streams

As a fine-grained video understanding task, dense video captioning invol...

Huijuan Xu, et al. ∙

research

∙ 02/19/2018

LSTM stack-based Neural Multi-sequence Alignment TeCHnique (NeuMATCH)

The alignment of heterogeneous sequential data (video to text) is an imp...

Pelin Dogan, et al. ∙

research

∙ 10/13/2017

Recent Advances in Zero-shot Recognition

With the recent renaissance of deep convolution neural networks, encoura...

Yanwei Fu, et al. ∙

research

∙ 09/23/2017

Visual Reference Resolution using Attention Memory for Visual Dialog

Visual dialog is a task of answering a series of inter-dependent questio...

Paul Hongsuck Seo, et al. ∙

Leonid Sigal

Featured Co-authors