research
∙
09/20/2023
Dense 2D-3D Indoor Prediction with Sound via Aligned Cross-Modal Distillation
Sound can convey significant information for spatial reasoning in our da...
share
research
∙
09/14/2023
EP2P-Loc: End-to-End 3D Point to 2D Pixel Localization for Large-Scale Visual Localization
Visual localization is the task of estimating a 6-DoF camera pose of a q...
research
∙
06/12/2023
Recursion of Thought: A Divide-and-Conquer Approach to Multi-Context Reasoning with Language Models
Generating intermediate steps, or Chain of Thought (CoT), is an effectiv...
research
∙
05/28/2023
KoSBi: A Dataset for Mitigating Social Bias Risks Towards Safer Large Language Model Application
Large language models (LLMs) learn not only natural text generation abil...
research
∙
05/27/2023
MPCHAT: Towards Multimodal Persona-Grounded Conversation
In order to build self-consistent personalized dialogue agents, previous...
research
∙
05/24/2023
Who Wrote this Code? Watermarking for Code Generation
Large language models for code have recently shown remarkable performanc...
research
∙
11/30/2022
Variational Laplace Autoencoders
Variational autoencoders employ an amortized inference model to approxim...
research
∙
09/19/2022
Panoramic Vision Transformer for Saliency Detection in 360° Videos
360^∘ video saliency detection is one of the challenging benchmarks for ...
research
∙
09/15/2022
LAVOLUTION: Measurement of Non-target Structural Displacement Calibrated by Structured Light
Displacement is an important measurement for the assessment of structura...
research
∙
02/02/2022
Lipschitz-constrained Unsupervised Skill Discovery
We study the problem of unsupervised skill discovery, whose goal is to l...
research
∙
12/07/2021
Unsupervised Representation Learning via Neural Activation Coding
We present neural activation coding (NAC) as a novel approach for learni...
research
∙
11/06/2021
Time Discretization-Invariant Safe Action Repetition for Policy Gradient Methods
In reinforcement learning, continuous time is often discretized by a tim...
research
∙
10/14/2021
Continual Learning on Noisy Data Streams via Self-Purified Replay
Continually learning in the real world must overcome many challenges, am...
research
∙
10/11/2021
Pano-AVQA: Grounded Audio-Visual Question Answering on 360^∘ Videos
360^∘ videos convey holistic views for the surroundings of a scene. It p...
research
∙
09/18/2021
Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion Causes
Empathy is a complex cognitive ability based on the reasoning of others'...
research
∙
06/27/2021
Unsupervised Skill Discovery with Bottleneck Option Learning
Having the ability to acquire inherent skills from environments without ...
research
∙
03/23/2021
Drop-Bottleneck: Learning Discrete Compressed Representation for Noise-Robust Exploration
We propose a novel information bottleneck (IB) method named Drop-Bottlen...
research
∙
01/26/2021
Automatic Curation of Large-Scale Datasets for Audio-Visual Representation Learning
Large-scale datasets are the cornerstone of self-supervised representati...
research
∙
12/08/2020
Parameter Efficient Multimodal Transformers for Video Representation Learning
The recent success of Transformers in the language domain has motivated ...
research
∙
10/17/2020
LID 2020: The Learning from Imperfect Data Challenge Results
Learning from imperfect data becomes an issue in many industrial applica...
research
∙
09/08/2020
Imbalanced Continual Learning with Partitioning Reservoir Sampling
Continual learning from a sequential stream of data is a crucial challen...
research
∙
06/11/2020
Augmenting Data for Sarcasm Detection with Unlabeled Conversation Context
We present a novel data augmentation technique, CRA (Contextual Response...
research
∙
04/13/2020
Public Self-consciousness for Endowing Dialogue Agents with Consistent Persona
Although consistency has been a long-standing issue in dialogue agents, ...
research
∙
03/27/2020
CurlingNet: Compositional Learning between Images and Text for Fashion IQ Data
We present an approach named CurlingNet that can measure the semantic di...
research
∙
02/18/2020
Sequential Latent Knowledge Selection for Knowledge-Grounded Dialogue
Knowledge-grounded dialogue is a task of generating an informative respo...
research
∙
01/03/2020
A Neural Dirichlet Process Mixture Model for Task-Free Continual Learning
Despite the growing interest in continual learning, most of its contempo...
research
∙
02/25/2019
Harmonizing Maximum Likelihood with GANs for Multimodal Conditional Generation
Recent advances in conditional image generation tasks, such as image-to-...
research
∙
02/18/2019
Discovery of Natural Language Concepts in Individual Units of CNNs
Although deep convolutional networks have achieved improved performance ...
research
∙
11/02/2018
Abstractive Summarization of Reddit Posts with Multi-level Memory Networks
We address the problem of abstractive summarization in two directions: p...
research
∙
08/07/2018
A Joint Sequence Fusion Model for Video Question Answering and Retrieval
We present an approach named JSFusion (Joint Sequence Fusion) that can m...
research
∙
07/07/2018
Video Prediction with Appearance and Motion Conditions
Video prediction aims to generate realistic future frames by learning dy...
research
∙
05/08/2018
A Memory Network Approach for Story-based Temporal Summarization of 360° Videos
We address the problem of story-based temporal summarization of long 360...
research
∙
04/10/2018
A Hierarchical Latent Structure for Variational Conversation Modeling
Variational autoencoders (VAE) combined with hierarchical RNNs have emer...
research
∙
03/05/2018
Memorization Precedes Generation: Learning Unsupervised GANs with Memory Networks
We propose an approach to address two issues that commonly occur during ...
research
∙
01/31/2018
A Deep Ranking Model for Spatio-Temporal Highlight Detection from a 360 Video
We address the problem of highlight detection from a 360 degree video by...
research
∙
09/27/2017
A Read-Write Memory Network for Movie Story Understanding
We propose a novel memory network model named Read-Write Memory Network ...
research
∙
07/19/2017
Supervising Neural Attention Models for Video Captioning by Human Gaze Data
The attention mechanisms in deep neural networks are inspired by human's...
research
∙
06/24/2017
Encoding Video and Label Priors for Multi-label Video Classification on YouTube-8M dataset
YouTube-8M is the largest video dataset for multi-label video classifica...
research
∙
04/21/2017
Attend to You: Personalized Image Captioning with Context Sequence Memory Networks
We address personalization issues of image captioning, which have not be...
research
∙
10/10/2016
End-to-end Concept Word Detection for Video Captioning, Retrieval, and Question Answering
We propose a high-level concept word detector that can be integrated wit...
research
∙
12/19/2015