b'Chen Sun'

research

∙ 08/09/2023

Evaluating the Generation Capabilities of Large Chinese Language Models

This paper presents CG-Eval, the first comprehensive evaluation of the g...

0 Hui Zeng, et al. ∙

research

∙ 07/31/2023

AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?

Can we better anticipate an actor's future actions (e.g. mix eggs) by kn...

0 Qi Zhao, et al. ∙

research

∙ 07/17/2023

Does Visual Pretraining Help End-to-End Reasoning?

We aim to investigate whether end-to-end learning of visual reasoning ca...

0 Chen Sun, et al. ∙

research

∙ 07/13/2023

NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception

Multi-agent multi-lidar sensor fusion between connected vehicles for coo...

0 Lantao Li, et al. ∙

research

∙ 07/07/2023

Goal-Conditioned Predictive Coding as an Implicit Planner for Offline Reinforcement Learning

Recent work has demonstrated the effectiveness of formulating decision m...

0 Zilai Zeng, et al. ∙

research

∙ 07/07/2023

Federated Learning over a Wireless Network: Distributed User Selection through Random Access

User selection has become crucial for decreasing the communication costs...

0 Chen Sun, et al. ∙

research

∙ 06/20/2023

Dense Video Object Captioning from Disjoint Supervision

We propose a new task and model for dense video object captioning – dete...

0 Xingyi Zhou, et al. ∙

research

∙ 06/20/2023

How can objects help action recognition?

Current state-of-the-art video models process a video clip as a long seq...

0 Xingyi Zhou, et al. ∙

research

∙ 06/15/2023

Winning Solution for the CVPR2023 Visual Anomaly and Novelty Detection Challenge: Multimodal Prompting for Data-centric Anomaly Detection

This technical report introduces the winning solution of the team \texti...

0 Yunkang Cao, et al. ∙

research

∙ 06/13/2023

AVIS: Autonomous Visual Information Seeking with Large Language Models

In this paper, we propose an autonomous information seeking visual quest...

0 Ziniu Hu, et al. ∙

research

∙ 05/18/2023

Segment Any Anomaly without Training via Hybrid Prompt Regularization

We present a novel framework, i.e., Segment Any Anomaly + (SAA+), for ze...

0 Yunkang Cao, et al. ∙

research

∙ 04/24/2023

End-to-End Spatio-Temporal Action Localisation with Video Transformers

The most performant spatio-temporal action localisation models use exter...

0 Alexey Gritsenko, et al. ∙

research

∙ 03/22/2023

Reconfigurable Intelligent Surface-aided Secret Key Generation in Multi-Cell Systems

Physical-layer key generation (PKG) exploits the reciprocity and randomn...

0 Lei Hu, et al. ∙

research

∙ 03/14/2023

Blockchain Based Spectrum Sharing

Spectrum sharing has long been considered as method to improve spectrum ...

0 Chen Sun, et al. ∙

research

∙ 03/08/2023

Comparing Trajectory and Vision Modalities for Verb Representation

Three-dimensional trajectories, or the 3D position and rotation of objec...

0 Dylan Ebert, et al. ∙

research

∙ 02/22/2023

Steerable Equivariant Representation Learning

Pre-trained deep image representations are useful for post-training task...

0 Sangnie Bhardwaj, et al. ∙

research

∙ 01/25/2023

DEJA VU: Continual Model Generalization For Unseen Domains

In real-world applications, deep learning models often run in non-statio...

5 Chenxi Liu, et al. ∙

research

∙ 12/10/2022

REVEAL: Retrieval-Augmented Visual-Language Pre-Training with Multi-Source Multimodal Knowledge Memory

In this paper, we propose an end-to-end Retrieval-Augmented Visual Langu...

0 Ziniu Hu, et al. ∙

research

∙ 10/12/2022

Contrastive introspection (ConSpec) to rapidly identify invariant steps for success

Reinforcement learning (RL) algorithms have achieved notable success in ...

31 Chen Sun, et al. ∙

research

∙ 09/01/2022

A New Knowledge Distillation Network for Incremental Few-Shot Surface Defect Detection

Surface defect detection is one of the most essential processes for indu...

7 Chen Sun, et al. ∙

research

∙ 08/14/2022

TL;DW? Summarizing Instructional Videos with Task Relevance Cross-Modal Saliency

YouTube users looking for instructions for a specific task may spend a l...

2 Medhini Narasimhan, et al. ∙

research

∙ 07/08/2022

Beyond Transfer Learning: Co-finetuning for Action Localisation

Transfer learning is the predominant paradigm for training deep networks...

9 Anurag Arnab, et al. ∙

research

∙ 06/23/2022

Do Trajectories Encode Verb Meaning?

Distributional models learn representations of words from text, but are ...

0 Dylan Ebert, et al. ∙

research

∙ 06/15/2022

AVATAR: Unconstrained Audiovisual Speech Recognition

Audio-visual automatic speech recognition (AV-ASR) is an extension of AS...

8 Valentin Gabeur, et al. ∙

research

∙ 04/01/2022

Learning Audio-Video Modalities from Image Captions

A major challenge in text-video and text-audio retrieval is the lack of ...

3 Arsha Nagrani, et al. ∙

research

∙ 03/31/2022

Do Vision-Language Pretrained Models Learn Primitive Concepts?

Vision-language pretrained models have achieved impressive performance o...

0 Tian Yun, et al. ∙

research

∙ 01/31/2022

Trajectory Balance: Improved Credit Assignment in GFlowNets

Generative Flow Networks (GFlowNets) are a method for learning a stochas...

1 Nikolay Malkin, et al. ∙

research

∙ 11/01/2021

Masking Modalities for Cross-modal Video Retrieval

Pre-training on large scale unlabelled datasets has shown impressive per...

2 Valentin Gabeur, et al. ∙

research

∙ 09/21/2021

Does Vision-and-Language Pretraining Improve Lexical Grounding?

Linguistic representations derived from text alone have been criticized ...

0 Tian Yun, et al. ∙

research

∙ 08/22/2021

DenseTNT: End-to-end Trajectory Prediction from Dense Goal Sets

Due to the stochasticity of human behaviors, predicting the future traje...

5 Junru Gu, et al. ∙

research

∙ 07/06/2021

Discrete-Valued Neural Communication

Deep learning has advanced from fully connected architectures to structu...

8 Dianbo Liu, et al. ∙

research

∙ 06/30/2021

Attention Bottlenecks for Multimodal Fusion

Humans perceive the world by concurrently processing and fusing high-dim...

24 Arsha Nagrani, et al. ∙

research

∙ 06/28/2021

HDMapGen: A Hierarchical Graph Generative Model of High Definition Maps

High Definition (HD) maps are maps with precise definitions of road lane...

12 Lu Mi, et al. ∙

research

∙ 05/13/2021

Episodic Transformer for Vision-and-Language Navigation

Interaction and navigation defined by natural language instructions in d...

16 Alexander Pashevich, et al. ∙

research

∙ 04/06/2021

Local Metrics for Multi-Object Tracking

This paper introduces temporally local metrics for Multi-Object Tracking...

21 Jack Valmadre, et al. ∙

research

∙ 04/01/2021

Composable Augmentation Encoding for Video Representation Learning

We focus on contrastive methods for self-supervised video representation...

12 Chen Sun, et al. ∙

research

∙ 03/29/2021

ViViT: A Video Vision Transformer

We present pure-transformer based models for video classification, drawi...

25 Anurag Arnab, et al. ∙

research

∙ 03/29/2021

Unified Graph Structured Models for Video Understanding

Accurate video understanding involves reasoning about the relationships ...

9 Anurag Arnab, et al. ∙

research

∙ 01/07/2021

Learning Temporal Dynamics from Cycles in Narrated Video

Learning to model how the world changes as time elapses has proven a cha...

2 Dave Epstein, et al. ∙

research

∙ 09/19/2020

Sum Secret Key Rate Maximization for TDD Multi-User Massive MIMO Wireless Networks

Physical-layer key generation (PKG) based on channel reciprocity has rec...

0 Guyue Li, et al. ∙

research

∙ 08/19/2020

TNT: Target-driveN Trajectory Prediction

Predicting the future behavior of moving agents is essential for real wo...

2 Hang Zhao, et al. ∙

research

∙ 07/29/2020

Learning Video Representations from Textual Web Supervision

Videos found on the Internet are paired with pieces of text, such as tit...

5 Jonathan C. Stroud, et al. ∙

research

∙ 07/21/2020

Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos

Despite the recent advances in video classification, progress in spatio-...

5 Anurag Arnab, et al. ∙

research

∙ 07/21/2020

Multi-modal Transformer for Video Retrieval

The task of retrieving video content relevant to natural language querie...

10 Valentin Gabeur, et al. ∙

research

∙ 05/20/2020

What makes for good views for contrastive learning

Contrastive learning between multiple views of the data has recently ach...

16 Yonglong Tian, et al. ∙

research

∙ 05/18/2020

Beam-Domain Secret Key Generation for Multi-User Massive MIMO Networks

Physical-layer key generation (PKG) in multi-user massive MIMO networks ...

0 You Chen, et al. ∙

research

∙ 05/08/2020

VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation

Behavior prediction in dynamic, multi-agent systems is an important prob...

10 Jiyang Gao, et al. ∙

research

∙ 03/30/2020

Speech2Action: Cross-modal Supervision for Action Recognition

Is it possible to guess human action from dialogue alone? In this work w...

6 Arsha Nagrani, et al. ∙

research

∙ 06/19/2019

Unsupervised Learning of Object Structure and Dynamics from Videos

Extracting and predicting object structure and dynamics from videos with...

4 Matthias Minderer, et al. ∙

research

∙ 06/13/2019

Contrastive Bidirectional Transformer for Temporal Representation Learning

This paper aims at learning representations for long sequences of contin...

4 Chen Sun, et al. ∙

Chen Sun

Featured Co-authors