research
∙
09/11/2023
NExT-GPT: Any-to-Any Multimodal LLM
While recently Multimodal Large Language Models (MM-LLMs) have made exci...
share
research
∙
09/04/2023
Can I Trust Your Answer? Visually Grounded Video Question Answering
We study visually grounded VideoQA in response to the emerging trends of...
research
∙
08/26/2023
Empowering Dynamics-aware Text-to-Video Diffusion with Large Language Models
Text-to-video (T2V) synthesis has gained increasing attention in the com...
research
∙
08/12/2023
Context-aware Event Forecasting via Graph Disentanglement
Event forecasting has been a demanding and challenging task throughout t...
research
∙
08/09/2023
LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generation
In the text-to-image generation field, recent remarkable progress in Sta...
research
∙
08/09/2023
Constructing Holistic Spatio-Temporal Scene Graph for Video Semantic Role Labeling
Video Semantic Role Labeling (VidSRL) aims to detect the salient events ...
research
∙
08/08/2023
Revisiting Disentanglement and Fusion on Modality and Context in Conversational Multimodal Emotion Recognition
It has been a hot research topic to enable machines to understand human ...
research
∙
08/08/2023
Empowering Vision-Language Models to Follow Interleaved Vision-Language Instructions
Multimodal Large Language Models (MLLMs) have recently sparked significa...
research
∙
08/07/2023
Redundancy-aware Transformer for Video Question Answering
This paper identifies two kinds of redundancy in the current VideoQA par...
research
∙
08/03/2023
XNLP: An Interactive Demonstration System for Universal Structured NLP
Structured Natural Language Processing (XNLP) is an important subset of ...
research
∙
08/03/2023
SimTeG: A Frustratingly Simple Approach Improves Textual Graph Learning
Textual graphs (TGs) are graphs whose nodes correspond to text (sentence...
research
∙
07/22/2023
Discovering Spatio-Temporal Rationales for Video Question Answering
This paper strives to solve complex video question answering (VideoQA) w...
research
∙
06/08/2023
Two Heads Are Better Than One: Improving Fake News Video Detection by Correlating with Neighbors
The prevalence of short video platforms has spawned a lot of fake news v...
research
∙
06/06/2023
Revisiting Conversation Discourse for Dialogue Disentanglement
Dialogue disentanglement aims to detach the chronologically ordered utte...
research
∙
06/06/2023
Computational Technologies for Fashion Recommendation: A Survey
Fashion recommendation is a key research field in computational fashion ...
research
∙
06/05/2023
Discovering Dynamic Causal Space for DAG Structure Learning
Discovering causal structure from purely observational data (i.e., causa...
research
∙
05/24/2023
LLMDet: A Large Language Models Detection Tool
With the advancement of generative language models, the generated text h...
research
∙
05/23/2023
Robust Instruction Optimization for Large Language Models with Distribution Shifts
Large Language Models have demonstrated significant ability in accomplis...
research
∙
05/22/2023
MacLaSa: Multi-Aspect Controllable Text Generation via Efficient Sampling from Compact Latent Space
Multi-aspect controllable text generation aims to generate fluent senten...
research
∙
05/21/2023
InstructVid2Vid: Controllable Video Editing with Natural Language Instructions
We present an end-to-end diffusion-based method for editing videos with ...
research
∙
05/20/2023
Cross2StrA: Unpaired Cross-lingual Image Captioning with Cross-lingual Cross-modal Structure-pivoted Alignment
Unpaired cross-lingual image captioning has long suffered from irrelevan...
research
∙
05/20/2023
Constructing Code-mixed Universal Dependency Forest for Unbiased Cross-lingual Relation Extraction
Latest efforts on cross-lingual relation extraction (XRE) aggressively l...
research
∙
05/20/2023
Scene Graph as Pivoting: Inference-time Image-free Unsupervised Multimodal Machine Translation with Visual Scene Hallucination
In this work, we investigate a more realistic unsupervised multimodal ma...
research
∙
05/19/2023
Generating Visual Spatial Description via Holistic 3D Scene Understanding
Visual spatial description (VSD) aims to generate texts that describe th...
research
∙
05/19/2023
Information Screening whilst Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modeling
Existing research on multimodal relation extraction (MRE) faces two co-e...
research
∙
05/18/2023
Reasoning Implicit Sentiment with Chain-of-Thought Prompting
While sentiment analysis systems try to determine the sentiment polariti...
research
∙
05/17/2023
Dual Semantic Knowledge Composed Multimodal Dialog Systems
Textual response generation is an essential task for multimodal task-ori...
research
∙
05/04/2023
A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospects
Proactive dialogue systems, related to a wide range of real-world conver...
research
∙
05/03/2023
Doc2SoarGraph: Discrete Reasoning over Visually-Rich Table-Text Documents with Semantic-Oriented Hierarchical Graphs
Discrete reasoning over table-text documents (e.g., financial reports) g...
research
∙
05/02/2023
Transfer Visual Prompt Generator across LLMs
While developing a new vision-language LLM (VL-LLM) by pre-training on t...
research
∙
04/28/2023
Search-in-the-Chain: Towards Accurate, Credible and Traceable Large Language Models for Knowledge-intensive Tasks
With the wide application of Large Language Models (LLMs) such as ChatGP...
research
∙
04/19/2023
On the Robustness of Aspect-based Sentiment Analysis: Rethinking Model, Data, and Training
Aspect-based sentiment analysis (ABSA) aims at automatically inferring t...
research
∙
04/13/2023
LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model
Universally modeling all typical information extraction tasks (UIE) with...
research
∙
04/11/2023
Diffusion Recommender Model
Generative models such as Generative Adversarial Networks (GANs) and Var...
research
∙
04/07/2023
Generative Recommendation: Towards Next-generation Recommender Paradigm
Recommender systems typically retrieve items from an item corpus for per...
research
∙
03/28/2023
Causal Disentangled Recommendation Against User Preference Shifts
Recommender systems easily face the issue of user preference shifts. Use...
research
∙
03/12/2023
Gradient-Regulated Meta-Prompt Learning for Generalizable Vision-Language Models
Prompt tuning, a recently emerging paradigm, enables the powerful vision...
research
∙
03/06/2023
Boosting Differentiable Causal Discovery via Adaptive Sample Reweighting
Under stringent model type and variable distribution assumptions, differ...
research
∙
02/27/2023
Contrastive Video Question Answering via Video Graph Transformer
We propose to perform video question answering (VideoQA) in a Contrastiv...
research
∙
02/10/2023
Invariant Collaborative Filtering to Popularity Distribution Shift
Collaborative Filtering (CF) models, despite their great success, suffer...
research
∙
01/22/2023
Variational Cross-Graph Reasoning and Adaptive Structured Semantics Learning for Compositional Temporal Grounding
Temporal grounding is the task of locating a specific segment from an un...
research
∙
12/20/2022
Causal Inference for Knowledge Graph based Recommendation
Knowledge Graph (KG), as a side-information, tends to be utilized to sup...
research
∙
12/19/2022
Cognitive Accident Prediction in Driving Scenes: A Multimodality Benchmark
Traffic accident prediction in driving videos aims to provide an early w...
research
∙
11/22/2022
Visually Grounded Commonsense Knowledge Acquisition
Large-scale commonsense knowledge bases empower a broad range of AI appl...
research
∙
11/20/2022
FakeSV: A Multimodal Benchmark with Rich Social Context for Fake News Detection on Short Video Platforms
Short video platforms have become an important channel for news sharing,...
research
∙
11/14/2022
PiPa: Pixel- and Patch-wise Self-supervised Learning for Domain Adaptative Semantic Segmentation
Unsupervised Domain Adaptation (UDA) aims to enhance the generalization ...
research
∙
11/14/2022
Composed Image Retrieval with Text Feedback via Multi-grained Uncertainty Regularization
We investigate composed image retrieval with text feedback. Users gradua...
research
∙
11/10/2022
DiaASQ: A Benchmark of Conversational Aspect-based Sentiment Quadruple Analysis
The rapid development of aspect-based sentiment analysis (ABSA) within r...
research
∙
11/01/2022
Behavioral Intention Prediction in Driving Scenes: A Survey
In the driving scene, the road participants usually show frequent intera...
research
∙
10/20/2022