Shih-Fu Chang

is this you? claim profile

∙ 0 followers
Columbia University

Senior Vice Dean at Columbia University, School of Engineering and Applied Science

Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos

Multimodal self-supervised learning is getting more and more attention a...
04/26/2021 ∙ by Brian Chen, et al. ∙ 0 ∙ share

read it
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text

We present a framework for learning multimodal representations from unla...
04/22/2021 ∙ by Hassan Akbari, et al. ∙ 21 ∙ share

read it
Meta Faster R-CNN: Towards Accurate Few-Shot Object Detection with Attentive Feature Alignment

Few-shot object detection (FSOD) aims to detect objects using only few e...
04/15/2021 ∙ by Guangxing Han, et al. ∙ 0 ∙ share

read it
Co-Grounding Networks with Semantic Attention for Referring Expression Comprehension in Videos

In this paper, we address the problem of referring expression comprehens...
03/23/2021 ∙ by Sijie Song, et al. ∙ 0 ∙ share

read it
VX2TEXT: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs

We present Vx2Text, a framework for text generation from multimodal inpu...
01/28/2021 ∙ by Xudong Lin, et al. ∙ 6 ∙ share

read it
Task-Adaptive Negative Class Envision for Few-Shot Open-Set Recognition

Recent works seek to endow recognition systems with the ability to handl...
12/24/2020 ∙ by Shiyuan Huang, et al. ∙ 0 ∙ share

read it
Open-Vocabulary Object Detection Using Captions

Despite the remarkable accuracy of deep neural networks in object detect...
11/20/2020 ∙ by Alireza Zareian, et al. ∙ 8 ∙ share

read it
Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language

Neuro-symbolic representations have proved effective in learning structu...
11/18/2020 ∙ by Hassan Akbari, et al. ∙ 18 ∙ share

read it
Weakly-supervised VisualBERT: Pre-training without Parallel Images and Captions

Pre-trained contextual vision-and-language (V L) models have brought i...
10/24/2020 ∙ by Liunian Harold Li, et al. ∙ 0 ∙ share

read it
Uncertainty-Aware Few-Shot Image Classification

Few-shot image classification aims to learn to recognize new categories ...
10/09/2020 ∙ by Zhizheng Zhang, et al. ∙ 0 ∙ share

read it
Ref-NMS: Breaking Proposal Bottlenecks in Two-Stage Referring Expression Grounding

The prevailing framework for solving referring expression grounding is b...
09/03/2020 ∙ by Long Chen, et al. ∙ 2 ∙ share

read it
COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation

To combat COVID-19, both clinicians and scientists need to digest the va...
07/01/2020 ∙ by Qingyun Wang, et al. ∙ 18 ∙ share

read it
Learning Visual Commonsense for Robust Scene Graph Generation

Scene graph generation models understand the scene through object and pr...
06/17/2020 ∙ by Alireza Zareian, et al. ∙ 0 ∙ share

read it
Deep Learning Guided Building Reconstruction from Satellite Imagery-derived Point Clouds

3D urban reconstruction of buildings from remotely sensed imagery has dr...
05/19/2020 ∙ by Bo Xu, et al. ∙ 8 ∙ share

read it
Cross-media Structured Common Space for Multimedia Event Extraction

We introduce a new task, MultiMedia Event Extraction (M2E2), which aims ...
05/05/2020 ∙ by Manling Li, et al. ∙ 0 ∙ share

read it
Unifying Specialist Image Embedding into Universal Image Embedding

Deep image embedding provides a way to measure the semantic similarity o...
03/08/2020 ∙ by Yang Feng, et al. ∙ 0 ∙ share

read it
Training with Streaming Annotation

In this paper, we address a practical scenario where training data is re...
02/11/2020 ∙ by Tongtao Zhang, et al. ∙ 0 ∙ share

read it
Weakly Supervised Visual Semantic Parsing

Scene Graph Generation (SGG) aims to extract entities, predicates and th...
01/08/2020 ∙ by Alireza Zareian, et al. ∙ 0 ∙ share

read it
Bridging Knowledge Graphs to Generate Scene Graphs

Scene graphs are powerful representations that encode images into their ...
01/07/2020 ∙ by Alireza Zareian, et al. ∙ 0 ∙ share

read it
General Partial Label Learning via Dual Bipartite Graph Autoencoder

We formulate a practical yet challenging problem: General Partial Label ...
01/05/2020 ∙ by Brian Chen, et al. ∙ 11 ∙ share

read it
Flow-Distilled IP Two-Stream Networks for Compressed Video Action Recognition

Two-stream networks have achieved great success in video recognition. A ...
12/10/2019 ∙ by Shiyuan Huang, et al. ∙ 0 ∙ share

read it
Flow-Distilled IP Two-Stream Networks for Compressed Video ActionRecognition

Two-stream networks have achieved great success in video recognition. A ...
12/10/2019 ∙ by Shiyuan Huang, et al. ∙ 0 ∙ share

read it
Learning to Learn Words from Narrated Video

When we travel, we often encounter new scenarios we have never experienc...
11/25/2019 ∙ by Dídac Surís, et al. ∙ 12 ∙ share

read it
LPAT: Learning to Predict Adaptive Threshold for Weakly-supervised Temporal Action Localization

Recently, Weakly-supervised Temporal Action Localization (WTAL) has been...
10/24/2019 ∙ by Xudong Lin, et al. ∙ 0 ∙ share

read it
Context-Gated Convolution

As the basic building block of Convolutional Neural Networks (CNNs), the...
10/12/2019 ∙ by Xudong Lin, et al. ∙ 0 ∙ share

read it
Report of 2017 NSF Workshop on Multimedia Challenges, Opportunities and Research Roadmaps

With the transformative technologies and the rapidly changing global R ...
08/06/2019 ∙ by Shih-Fu Chang, et al. ∙ 0 ∙ share

read it
Detecting and Simulating Artifacts in GAN Fake Images

To detect GAN generated images, conventional supervised machine learning...
07/15/2019 ∙ by Xu Zhang, et al. ∙ 1 ∙ share

read it
Variational Context: Exploiting Visual and Textual Context for Grounding Referring Expressions

We focus on grounding (i.e., localizing or linking) referring expression...
07/08/2019 ∙ by Yulei Niu, et al. ∙ 1 ∙ share

read it
CDSA: Cross-Dimensional Self-Attention for Multivariate, Geo-tagged Time Series Imputation

Many real-world applications involve multivariate, geo-tagged time serie...
05/23/2019 ∙ by Jiawei Ma, et al. ∙ 0 ∙ share

read it
Unsupervised Embedding Learning via Invariant and Spreading Instance Feature

This paper studies the unsupervised embedding learning problem, which re...
04/06/2019 ∙ by Mang Ye, et al. ∙ 0 ∙ share

read it
Unsupervised Rank-Preserving Hashing for Large-Scale Image Retrieval

We propose an unsupervised hashing method which aims to produce binary c...
03/04/2019 ∙ by Svebor Karaman, et al. ∙ 0 ∙ share

read it
DMC-Net: Generating Discriminative Motion Cues for Fast Compressed Video Action Recognition

Motion has shown to be useful for video understanding, where motion is t...
01/11/2019 ∙ by Zheng Shou, et al. ∙ 0 ∙ share

read it
Scene Dynamics: Counterfactual Critic Multi-Agent Training for Scene Graph Generation

Scene graphs -- objects as nodes and visual relationships as edges -- de...
12/06/2018 ∙ by Long Chen, et al. ∙ 6 ∙ share

read it
Multi-level Multimodal Common Semantic Space for Image-Phrase Grounding

We address the problem of phrase grounding by learning a multi-level com...
11/28/2018 ∙ by Hassan Akbari, et al. ∙ 6 ∙ share

read it
Multi-granularity Generator for Temporal Action Proposal

Temporal action proposal generation is an important task, aiming to loca...
11/28/2018 ∙ by Yuan Liu, et al. ∙ 0 ∙ share

read it
Low-shot Learning via Covariance-Preserving Adversarial Augmentation Networks

Deep neural networks suffer from over-fitting and catastrophic forgettin...
10/27/2018 ∙ by Hang Gao, et al. ∙ 0 ∙ share

read it
Heated-Up Softmax Embedding

Metric learning aims at learning a distance which is consistent with the...
09/11/2018 ∙ by Xu Zhang, et al. ∙ 0 ∙ share

read it
Multimodal Social Media Analysis for Gang Violence Prevention

Gang violence is a severe issue in major cities across the U.S. and rece...
07/23/2018 ∙ by Philipp Blandfort, et al. ∙ 0 ∙ share

read it
AutoLoc: Weakly-supervised Temporal Action Localization

Temporal Action Localization (TAL) in untrimmed video is important for m...
07/22/2018 ∙ by Zheng Shou, et al. ∙ 0 ∙ share

read it
Entity-aware Image Caption Generation

Image captioning approaches currently generate descriptions which lack s...
04/21/2018 ∙ by Di Lu, et al. ∙ 0 ∙ share

read it
Online Action Detection in Untrimmed, Streaming Videos - Modeling and Evaluation

The goal of Online Action Detection (OAD) is to detect action in a timel...
02/19/2018 ∙ by Zheng Shou, et al. ∙ 0 ∙ share

read it
Zero-Shot Visual Recognition using Semantics-Preserving Adversarial Embedding Network

We propose a novel framework called Semantics-Preserving Adversarial Emb...
12/05/2017 ∙ by Long Chen, et al. ∙ 0 ∙ share

read it
Grounding Referring Expressions in Images by Variational Context

We focus on grounding (i.e., localizing or linking) referring expression...
12/05/2017 ∙ by Hanwang Zhang, et al. ∙ 0 ∙ share

read it
Multi-Modal Multi-Scale Deep Learning for Large-Scale Image Annotation

Large-scale image annotation is a challenging task in image content anal...
09/05/2017 ∙ by Yulei Niu, et al. ∙ 0 ∙ share

read it
Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks

Recurrent Neural Networks (RNNs) continue to show outstanding performanc...
08/22/2017 ∙ by Victor Campos, et al. ∙ 0 ∙ share

read it
More cat than cute? Interpretable Prediction of Adjective-Noun Pairs

The increasing availability of affect-rich multimedia resources has bols...
08/21/2017 ∙ by Delia Fernandez, et al. ∙ 0 ∙ share

read it
PPR-FCN: Weakly Supervised Visual Relation Detection via Parallel Pairwise R-FCN

We aim to tackle a novel vision task called Weakly Supervised Visual Rel...
08/07/2017 ∙ by Hanwang Zhang, et al. ∙ 0 ∙ share

read it
Localizing Actions from Video Labels and Pseudo-Annotations

The goal of this paper is to determine the spatio-temporal location of a...
07/28/2017 ∙ by Pascal Mettes, et al. ∙ 0 ∙ share

read it
Modeling Multimodal Clues in a Hybrid Deep Learning Framework for Video Classification

Videos are inherently multimodal. This paper studies the problem of how ...
06/14/2017 ∙ by Yu-Gang Jiang, et al. ∙ 0 ∙ share

read it
PatternNet: Visual Pattern Mining with Deep Neural Network

Visual patterns represent the discernible regularity in the visual world...
03/18/2017 ∙ by Hongzhi Li, et al. ∙ 0 ∙ share

read it

Shih-Fu Chang

Featured Co-authors