research
∙
08/15/2023
Dancing Avatar: Pose and Text-Guided Human Motion Videos Synthesis with Image Diffusion Model
The rising demand for creating lifelike avatars in the digital realm has...
share
research
∙
08/08/2023
Empowering Vision-Language Models to Follow Interleaved Vision-Language Instructions
Multimodal Large Language Models (MLLMs) have recently sparked significa...
research
∙
07/05/2023
ZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: TREK-150 Single Object Tracking
The Associating Objects with Transformers (AOT) framework has exhibited ...
research
∙
07/05/2023
ZJU ReLER Submission for EPIC-KITCHEN Challenge 2023: Semi-Supervised Video Object Segmentation
The Associating Objects with Transformers (AOT) framework has exhibited ...
research
∙
06/12/2023
Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow
Various industries such as finance, meteorology, and energy generate vas...
research
∙
05/26/2023
PromptNER: Prompt Locating and Typing for Named Entity Recognition
Prompt learning is a new paradigm for utilizing pre-trained language mod...
research
∙
05/22/2023
DiffusionNER: Boundary Diffusion for Named Entity Recognition
In this paper, we propose DiffusionNER, which formulates the named entit...
research
∙
05/22/2023
Interactive Data Synthesis for Systematic Vision Adaptation via LLMs-AIGCs Collaboration
Recent text-to-image generation models have shown promising results in g...
research
∙
05/21/2023
InstructVid2Vid: Controllable Video Editing with Natural Language Instructions
We present an end-to-end diffusion-based method for editing videos with ...
research
∙
05/11/2023
Continual Vision-Language Representation Learning with Off-Diagonal Information
This paper discusses the feasibility of continuously training the CLIP m...
research
∙
05/05/2023
DAMO-NLP at SemEval-2023 Task 2: A Unified Retrieval-augmented System for Multilingual Named Entity Recognition
The MultiCoNER 2 shared task aims to tackle multilingual named entity re...
research
∙
04/20/2023
Learning in Imperfect Environment: Multi-Label Classification with Long-Tailed Distribution and Partial Labels
Conventional multi-label classification (MLC) methods assume that all sa...
research
∙
03/30/2023
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace
Solving complicated AI tasks with different domains and modalities is a ...
research
∙
03/23/2023
Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World
Scene Graph Generation (SGG) aims to extract <subject, predicate, object...
research
∙
03/12/2023
Gradient-Regulated Meta-Prompt Learning for Generalizable Vision-Language Models
Prompt tuning, a recently emerging paradigm, enables the powerful vision...
research
∙
03/07/2023
Lformer: Text-to-Image Generation with L-shape Block Parallel Decoding
Generative transformers have shown their superiority in synthesizing hig...
research
∙
01/22/2023
Variational Cross-Graph Reasoning and Adaptive Structured Semantics Learning for Compositional Temporal Grounding
Temporal grounding is the task of locating a specific segment from an un...
research
∙
01/12/2023
1st Place Solution for ECCV 2022 OOD-CV Challenge Object Detection Track
OOD-CV challenge is an out-of-distribution generalization task. To solve...
research
∙
01/12/2023
1st Place Solution for ECCV 2022 OOD-CV Challenge Image Classification Track
OOD-CV challenge is an out-of-distribution generalization task. In this ...
research
∙
11/03/2022
Query-based Instance Discrimination Network for Relational Triple Extraction
Joint entity and relation extraction has been a core task in the field o...
research
∙
10/02/2022
Citation Trajectory Prediction via Publication Influence Representation Using Temporal Knowledge Graph
Predicting the impact of publications in science and technology has beco...
research
∙
08/04/2022
Fine-Grained Semantically Aligned Vision-Language Pre-Training
Large-scale vision-language pre-training has shown impressive advances i...
research
∙
08/03/2022
Dilated Context Integrated Network with Cross-Modal Consensus for Temporal Emotion Localization in Videos
Understanding human emotions is a crucial ability for intelligent robots...
research
∙
07/09/2022
BOSS: Bottom-up Cross-modal Semantic Composition with Hybrid Counterfactual Training for Robust Content-based Image Retrieval
Content-Based Image Retrieval (CIR) aims to search for a target image by...
research
∙
07/01/2022
ReLER@ZJU-Alibaba Submission to the Ego4D Natural Language Queries Challenge 2022
In this report, we present the ReLER@ZJU-Alibaba submission to the Ego4D...
research
∙
06/14/2022
Slimmable Domain Adaptation
Vanilla unsupervised domain adaptation methods tend to optimize the mode...
research
∙
06/14/2022
Label Matching Semi-Supervised Object Detection
Semi-supervised object detection has made significant progress with the ...
research
∙
06/13/2022
Learning Domain Adaptive Object Detection with Probabilistic Teacher
Self-training for unsupervised domain adaptive object detection is a cha...
research
∙
06/13/2022
Transductive CLIP with Class-Conditional Contrastive Learning
Inspired by the remarkable zero-shot generalization capacity of vision-l...
research
∙
06/04/2022
Robust Meta-learning with Sampling Noise and Label Noise via Eigen-Reptile
Recent years have seen a surge of interest in meta-learning techniques f...
research
∙
03/24/2022
Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learning
Temporal grounding in videos aims to localize one target video segment t...
research
∙
03/20/2022
Parallel Instance Query Network for Named Entity Recognition
Named entity recognition (NER) is a fundamental task in natural language...
research
∙
03/01/2022
DAMO-NLP at SemEval-2022 Task 11: A Knowledge-based System for Multilingual Named Entity Recognition
The MultiCoNER shared task aims at detecting semantically ambiguous and ...
research
∙
01/01/2022
Boosting RGB-D Saliency Detection by Leveraging Unlabeled RGB Images
Training deep models for RGB-D salient object detection (SOD) often requ...
research
∙
12/13/2021
MAGIC: Multimodal relAtional Graph adversarIal inferenCe for Diverse and Unpaired Text-based Image Captioning
Text-based image captioning (TextCap) requires simultaneous comprehensio...
research
∙
12/02/2021
Consensus Graph Representation Learning for Better Grounded Image Captioning
The contemporary visual captioning models frequently hallucinate objects...
research
∙
12/02/2021
Relational Graph Learning for Grounded Video Description Generation
Grounded video description (GVD) encourages captioning models to attend ...
research
∙
11/18/2021
Self-Supervised Class Incremental Learning
Existing Class Incremental Learning (CIL) methods are based on a supervi...
research
∙
09/29/2021
Federated Self-Supervised Contrastive Learning via Ensemble Similarity Distillation
This paper investigates the feasibility of learning good representation ...
research
∙
09/22/2021
Natural Language Video Localization with Learnable Moment Proposals
Given an untrimmed video and a natural language query, Natural Language ...
research
∙
07/30/2021
On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals
It is a consensus that small models perform quite poorly under the parad...
research
∙
07/26/2021
Alleviate Representation Overlapping in Class Incremental Learning by Contrastive Class Concentration
The challenge of the Class Incremental Learning (CIL) lies in difficulty...
research
∙
07/26/2021
Adaptive Hierarchical Graph Reasoning with Semantic Coherence for Video-and-Language Inference
Video-and-Language Inference is a recently proposed task for joint video...
research
∙
06/21/2021
CIL: Contrastive Instance Learning Framework for Distantly Supervised Relation Extraction
The journey of reducing noise from distant supervision (DS) generated tr...
research
∙
06/21/2021
Empower Distantly Supervised Relation Extraction with Collaborative Adversarial Training
With recent advances in distantly supervised (DS) relation extraction (R...
research
∙
05/26/2021
Deep Learning for Weakly-Supervised Object Detection and Object Localization: A Survey
Weakly-Supervised Object Detection (WSOD) and Localization (WSOL), i.e.,...
research
∙
05/19/2021
A Sequence-to-Set Network for Nested Named Entity Recognition
Named entity recognition (NER) is a widely studied task in natural langu...
research
∙
05/12/2021
VL-NMS: Breaking Proposal Bottlenecks in Two-Stage Visual-Language Matching
The prevailing framework for matching multimodal inputs is based on a tw...
research
∙
04/13/2021
Disentangled Motif-aware Graph Learning for Phrase Grounding
In this paper, we propose a novel graph learning framework for phrase gr...
research
∙
02/23/2021
