research
∙
08/21/2023
Explore and Tell: Embodied Visual Captioning in 3D Environments
While current visual captioning models have achieved impressive performa...
share
research
∙
08/10/2023
Object Goal Navigation with Recursive Implicit Maps
Object goal navigation aims to navigate an agent to locations of a given...
research
∙
07/28/2023
Robust Visual Sim-to-Real Transfer for Robotic Manipulation
Learning visuomotor policies in simulation is much safer and cheaper tha...
research
∙
05/10/2023
InfoMetIC: An Informative Metric for Reference-free Image Caption Evaluation
Automatic image captioning evaluation is critical for benchmarking and p...
research
∙
04/24/2023
gSDF: Geometry-Driven Signed Distance Functions for 3D Hand-Object Reconstruction
Signed distance functions (SDFs) is an attractive framework that has rec...
research
∙
12/31/2022
Translating Text Synopses to Video Storyboards
A storyboard is a roadmap for video creation which consists of shot-by-s...
research
∙
11/17/2022
Language Conditioned Spatial Relation Reasoning for 3D Object Grounding
Localizing objects in 3D scenes based on natural language requires under...
research
∙
09/11/2022
Instruction-driven history-aware policies for robotic manipulations
In human environments, robots are expected to accomplish a variety of ma...
research
∙
08/24/2022
Learning from Unlabeled 3D Environments for Vision-and-Language Navigation
In vision-and-language navigation (VLN), an embodied agent is required t...
research
∙
02/23/2022
Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigation
Following language instructions to navigate in unseen environments is a ...
research
∙
10/25/2021
History Aware Multimodal Transformer for Vision-and-Language Navigation
Vision-and-language navigation (VLN) aims to build autonomous visual age...
research
∙
08/25/2021
Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-training
Translating e-commercial product descriptions, a.k.a product-oriented ma...
research
∙
08/20/2021
Airbert: In-domain Pretraining for Vision-and-Language Navigation
Vision-and-language navigation (VLN) aims to enable embodied agents to n...
research
∙
08/05/2021
Elaborative Rehearsal for Zero-shot Action Recognition
The growing number of action classes has posed a new challenge for video...
research
∙
08/04/2021
Question-controlled Text-aware Image Captioning
For an image with multiple scene texts, different people may be interest...
research
∙
08/04/2021
ICECAP: Information Concentrated Entity-aware Image Captioning
Most current image captioning systems focus on describing general image ...
research
∙
06/11/2021
Team RUC_AIM3 Technical Report at ActivityNet 2021: Entities Object Localization
Entities Object Localization (EOL) aims to evaluate how grounded or fait...
research
∙
05/30/2021
Towards Diverse Paragraph Captioning for Untrimmed Videos
Video paragraph captioning aims to describe multiple events in untrimmed...
research
∙
07/17/2020
2nd Place Solution to ECCV 2020 VIPriors Object Detection Challenge
In this report, we descibe our approach to the ECCV 2020 VIPriors Object...
research
∙
06/14/2020
Team RUC_AIM3 Technical Report at Activitynet 2020 Task 2: Exploring Sequential Events Detection for Dense Video Captioning
Detecting meaningful events in an untrimmed video is essential for dense...
research
∙
04/12/2020
YouMakeup VQA Challenge: Towards Fine-grained Action Understanding in Domain-Specific Videos
The goal of the YouMakeup VQA Challenge 2020 is to provide a common benc...
research
∙
03/01/2020
Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoning
Cross-modal retrieval between videos and texts has attracted growing att...
research
∙
03/01/2020
Say As You Wish: Fine-grained Control of Image Caption Generation with Abstract Scene Graphs
Humans are able to describe image contents with coarse to fine details a...
research
∙
11/24/2019
Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
A storyboard is a sequence of images to illustrate a story containing mu...
research
∙
10/15/2019
Integrating Temporal and Spatial Attentions for VATEX Video Captioning Challenge 2019
This notebook paper presents our model in the VATEX video captioning cha...
research
∙
08/15/2019
Unpaired Cross-lingual Image Caption Generation with Self-Supervised Rewards
Generating image descriptions in different languages is essential to sat...
research
∙
07/11/2019
Activitynet 2019 Task 3: Exploring Contexts for Dense Captioning Events in Videos
Contextual reasoning is essential to understand events in long untrimmed...
research
∙
06/03/2019
From Words to Sentences: A Progressive Learning Approach for Zero-resource Machine Translation with Visual Pivots
The neural machine translation model has suffered from the lack of large...
research
∙
06/02/2019
Unsupervised Bilingual Lexicon Induction from Mono-lingual Multimodal Data
Bilingual lexicon induction, translating words from the source language ...
research
∙
06/22/2018
RUC+CMU: System Report for Dense Captioning Events in Videos
This notebook paper presents our system in the ActivityNet Dense Caption...
research
∙
09/04/2017
Multi-modal Conditional Attention Fusion for Dimensional Emotion Prediction
Continuous dimensional emotion prediction is a challenging task where th...
research
∙
08/31/2017
Video Captioning with Guidance of Multimodal Latent Topics
The topic diversity of open-domain videos leads to various vocabularies ...
research
∙
08/31/2017