research
∙
09/02/2023
ModelScope-Agent: Building Your Customizable Agent System with Open-source Large Language Models
Large language models (LLMs) have recently demonstrated remarkable capab...
share
research
∙
08/31/2023
Ladder-of-Thought: Using Knowledge as Steps to Elevate Stance Detection
Stance detection aims to identify the attitude expressed in a document t...
research
∙
08/29/2023
Evaluation and Analysis of Hallucination in Large Vision-Language Models
Large Vision-Language Models (LVLMs) have recently achieved remarkable s...
research
∙
08/25/2023
COCO: Testing Code Generation Systems via Concretized Instructions
Code generation systems have been extensively developed in recent years ...
research
∙
08/08/2023
Sorted L1/L2 Minimization for Sparse Signal Recovery
This paper introduces a novel approach for recovering sparse signals usi...
research
∙
08/07/2023
COPA: Efficient Vision-Language Pre-training Through Collaborative Object- and Patch-Text Alignment
Vision-Language Pre-training (VLP) methods based on object detection enj...
research
∙
07/19/2023
CValues: Measuring the Values of Chinese Large Language Models from Safety to Responsibility
With the rapid evolution of large language models (LLMs), there is a gro...
research
∙
07/17/2023
BUS:Efficient and Effective Vision-language Pre-training with Bottom-Up Patch Summarization
Vision Transformer (ViT) based Vision-Language Pre-training (VLP) models...
research
∙
07/04/2023
mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
Document understanding refers to automatically extract, analyze and comp...
research
∙
06/07/2023
Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Dataset for Pre-training and Benchmarks
To promote the development of Vision-Language Pre-training (VLP) and mul...
research
∙
05/15/2023
CLIP-VG: Self-paced Curriculum Adapting of CLIP via Exploiting Pseudo-Language Labels for Visual Grounding
Visual Grounding (VG) refers to locating a region described by expressio...
research
∙
05/14/2023
Distinguish Before Answer: Generating Contrastive Explanation as Knowledge for Commonsense Question Answering
Existing knowledge-enhanced methods have achieved remarkable results in ...
research
∙
05/13/2023
AMTSS: An Adaptive Multi-Teacher Single-Student Knowledge Distillation Framework For Multilingual Language Inference
Knowledge distillation is of key importance to launching multilingual pr...
research
∙
05/03/2023
Transforming Visual Scene Graphs to Image Captions
We propose to Transform Scene Graphs (TSG) into more descriptive caption...
research
∙
04/27/2023
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality
Large language models (LLMs) have demonstrated impressive zero-shot abil...
research
∙
04/26/2023
From Association to Generation: Text-only Captioning by Unsupervised Cross-modal Mapping
With the development of Vision-Language Pre-training Models (VLPMs) repr...
research
∙
04/16/2023
ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Human
In this paper, we present ChatPLUG, a Chinese open-domain dialogue syste...
research
∙
04/04/2023
Improved Visual Fine-tuning with Natural Language Supervision
Fine-tuning a pre-trained model can leverage the semantic information fr...
research
∙
03/31/2023
CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactions
Motion capture is a long-standing research problem. Although it has been...
research
∙
02/13/2023
Correspondence-Free Domain Alignment for Unsupervised Cross-Domain Image Retrieval
Cross-domain image retrieval aims at retrieving images across different ...
research
∙
02/01/2023
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
Recent years have witnessed a big convergence of language, vision, and m...
research
∙
01/05/2023
Learning Trajectory-Word Alignments for Video-Language Tasks
Aligning objects with words plays a critical role in Image-Language BERT...
research
∙
12/30/2022
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
Video-language pre-training has advanced the performance of various down...
research
∙
11/14/2022
Zero-shot Image Captioning by Anchor-augmented Vision-Language Space Alignment
CLIP (Contrastive Language-Image Pre-Training) has shown remarkable zero...
research
∙
10/18/2022
Eye-tracking based classification of Mandarin Chinese readers with and without dyslexia using neural sequence models
Eye movements are known to reflect cognitive processes in reading, and p...
research
∙
10/14/2022
Communication-Efficient Topologies for Decentralized Learning with O(1) Consensus Rate
Decentralized optimization is an emerging paradigm in distributed learni...
research
∙
08/25/2022
Accelerated Sparse Recovery via Gradient Descent with Nonlinear Conjugate Gradient Momentum
This paper applies an idea of adaptive momentum for the nonlinear conjug...
research
∙
08/01/2022
DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning
Although pre-trained language models (PLMs) have achieved state-of-the-a...
research
∙
07/15/2022
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval
Video-text retrieval has been a crucial and fundamental task in multi-mo...
research
∙
05/24/2022
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections
Large-scale pretrained foundation models have been an emerging paradigm ...
research
∙
03/29/2022
Shifting More Attention to Visual Backbone: Query-modulated Refinement Networks for End-to-End Visual Grounding
Visual grounding focuses on establishing fine-grained alignment between ...
research
∙
01/01/2022
On the improved conditions for some primal-dual algorithms
The convex minimization of f(𝐱)+g(𝐱)+h(𝐀𝐱) over ℝ^n with differentiable ...
research
∙
11/17/2021
Achieving Human Parity on Visual Question Answering
The Visual Question Answering (VQA) task utilizes both visual image and ...
research
∙
11/15/2021
Improving Prosody for Unseen Texts in Speech Synthesis by Utilizing Linguistic Information and Noisy Data
Recent advancements in end-to-end speech synthesis have made it possible...
research
∙
08/21/2021
Grid-VLP: Revisiting Grid Features for Vision-Language Pre-training
Existing approaches to vision-language pre-training (VLP) heavily rely o...
research
∙
08/10/2021
Decentralized Composite Optimization with Compression
Decentralized optimization and communication compression have exhibited ...
research
∙
08/04/2021
ErrorCompensatedX: error compensation for variance reduced algorithms
Communication cost is one major bottleneck for the scalability for distr...
research
∙
07/26/2021
Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphs
In this work, we consider the decentralized optimization problem in whic...
research
∙
07/05/2021
Elastic Graph Neural Networks
While many existing graph neural networks (GNNs) have been proven to per...
research
∙
06/25/2021
Hessian informed mirror descent
Inspired by the recent paper (L. Ying, Mirror descent algorithms for min...
research
∙
06/14/2021
Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networks
In this paper, we propose two communication-efficient algorithms for dec...
research
∙
06/03/2021
E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning
Vision-language pre-training (VLP) on large-scale image-text pairs has a...
research
∙
05/24/2021
StructuralLM: Structural Pre-training for Form Understanding
Large pre-trained language models achieve state-of-the-art results when ...
research
∙
03/26/2021
RCT: Resource Constrained Training for Edge AI
Neural networks training on edge terminals is essential for edge AI comp...
research
∙
03/14/2021
SemVLP: Vision-Language Pre-training by Aligning Semantics at Multiple Levels
Vision-language pre-training (VLP) on large-scale image-text pairs has r...
research
∙
11/27/2020
CoRe: An Efficient Coarse-refined Training Framework for BERT
In recent years, BERT has made significant breakthroughs on many natural...
research
∙
10/10/2020
Deep Neural Network Test Coverage: How Far Are We?
DNN testing is one of the most effective methods to guarantee the qualit...
research
∙
09/23/2020
Deep Neural Networks with Short Circuits for Improved Gradient Learning
Deep neural networks have achieved great success both in computer vision...
research
∙
08/18/2020
Fast algorithms for robust principal component analysis with an upper bound on the rank
The robust principal component analysis (RPCA) decomposes a data matrix ...
research
∙
07/06/2020