research
∙
09/19/2023
Guide Your Agent with Adaptive Multimodal Rewards
Developing an agent capable of adapting to unseen environments remains a...
share
research
∙
09/08/2023
Curve Your Attention: Mixed-Curvature Transformers for Graph Representation Learning
Real-world graphs naturally exhibit hierarchical or cyclical structures ...
research
∙
09/08/2023
3D Denoisers are Good 2D Teachers: Molecular Pretraining via Denoising and Cross-Modal Distillation
Pretraining molecular representations from large unlabeled data is essen...
research
∙
09/05/2023
NICE 2023 Zero-shot Image Captioning Challenge
In this report, we introduce NICE project[<https://nice.lgresearch.ai/>]...
research
∙
08/25/2023
Go Beyond Imagination: Maximizing Episodic Reachability with World Models
Efficient exploration is a challenging topic in reinforcement learning, ...
research
∙
08/17/2023
Exploring Demonstration Ensembling for In-context Learning
In-context learning (ICL) operates by showing language models (LMs) exam...
research
∙
06/12/2023
Scalable 3D Captioning with Pretrained Models
We introduce Cap3D, an automatic approach for generating descriptive tex...
research
∙
05/31/2023
Fine-grained Text Style Transfer with Diffusion-Based Language Models
Diffusion probabilistic models have shown great success in generating hi...
research
∙
05/24/2023
Discriminator-Guided Multi-step Reasoning with Language Models
In the context of multi-step reasoning, language models (LMs) probabilit...
research
∙
03/23/2023
Artificial-intelligence-based molecular classification of diffuse gliomas using rapid, label-free optical imaging
Molecular classification has transformed the management of brain tumors ...
research
∙
03/16/2023
A Picture is Worth a Thousand Words: Language Models Plan from Pixels
Planning is an important capability of artificial agents that perform lo...
research
∙
03/14/2023
Lightweight feature encoder for wake-up word detection based on self-supervised speech representation
Self-supervised learning method that provides generalized speech represe...
research
∙
03/02/2023
Hierarchical discriminative learning improves visual representations of biomedical microscopy
Learning high-quality, self-supervised, visual representations is essent...
research
∙
03/02/2023
Preference Transformer: Modeling Human Preferences using Transformers for RL
Preference-based reinforcement learning (RL) provides a framework to tra...
research
∙
02/17/2023
Unsupervised Task Graph Generation from Instructional Video Transcripts
This work explores the problem of generating task graphs of real-world a...
research
∙
02/17/2023
Multimodal Subtask Graph Generation from Instructional Videos
Real-world tasks consist of multiple inter-dependent subtasks (e.g., a d...
research
∙
01/28/2023
Composing Task Knowledge with Modular Successor Feature Approximators
Recently, the Successor Features and Generalized Policy Improvement (SF ...
research
∙
01/27/2023
Learning to Unlearn: Instance-wise Unlearning for Pre-trained Classifiers
Since the recent advent of regulations for data protection (e.g., the Ge...
research
∙
01/07/2023
Transferring Pre-trained Multimodal Representations with Cross-modal Similarity Matching
Despite surprising performance on zero-shot transfer, pre-training a lar...
research
∙
12/25/2022
Neural Shape Compiler: A Unified Framework for Transforming between Text, Point Cloud, and Program
3D shapes have complementary abstractions from low-level geometry to par...
research
∙
12/14/2022
Significantly improving zero-shot X-ray pathology classification via fine-tuning pre-trained image-text encoders
Deep neural networks have been successfully adopted to diverse domains i...
research
∙
10/27/2022
Transformers meet Stochastic Block Models: Attention with Data-Adaptive Sparsity and Cost
To overcome the quadratic cost of self-attention, recent works have prop...
research
∙
09/27/2022
UniCLIP: Unified Framework for Contrastive Language-Image Pre-training
Pre-training vision-language models with contrastive objectives has show...
research
∙
09/07/2022
Grouping-matrix based Graph Pooling with Adaptive Number of Clusters
Graph pooling is a crucial operation for encoding hierarchical structure...
research
∙
07/19/2022
Learning Action Translator for Meta Reinforcement Learning on Sparse-Reward Tasks
Meta reinforcement learning (meta-RL) aims to learn a policy solving a s...
research
∙
07/06/2022
Pure Transformers are Powerful Graph Learners
We show that standard Transformers without graph-specific modifications ...
research
∙
06/16/2022
OpenSRH: optimizing brain tumor surgery using intraoperative stimulated Raman histology
Accurate intraoperative diagnosis is essential for providing safe and ef...
research
∙
06/16/2022
Is Continual Learning Truly Learning Representations Continually?
Continual learning (CL) aims to learn from sequentially arriving tasks w...
research
∙
05/28/2022
Few-shot Subgoal Planning with Language Models
Pre-trained large language models have shown successful progress in many...
research
∙
05/25/2022
LEPUS: Prompt-based Unsupervised Multi-hop Reranking for Open-domain QA
We study unsupervised multi-hop reranking for multi-hop QA (MQA) with op...
research
∙
05/25/2022
Fast Inference and Transfer of Compositional Task Structures for Few-shot Task Generalization
We tackle real-world problems with complex structures beyond the pixel-b...
research
∙
05/14/2022
RiCS: A 2D Self-Occlusion Map for Harmonizing Volumetric Objects
There have been remarkable successes in computer vision with deep learni...
research
∙
04/06/2022
Simple and Effective Synthesis of Indoor 3D Scenes
We study the problem of synthesizing immersive 3D indoor scenes from one...
research
∙
03/28/2022
Learning Parameterized Task Structure for Generalization to Unseen Entities
Real world tasks are hierarchical and compositional. Tasks can be compos...
research
∙
03/18/2022
SURF: Semi-supervised Reward Learning with Data Augmentation for Feedback-efficient Preference-based Reinforcement Learning
Preference-based reinforcement learning (RL) has shown potential for tea...
research
∙
03/15/2022
Rich CNN-Transformer Feature Aggregation Networks for Super-Resolution
Recent vision transformers along with self-attention have achieved promi...
research
∙
02/02/2022
Lipschitz-constrained Unsupervised Skill Discovery
We study the problem of unsupervised skill discovery, whose goal is to l...
research
∙
01/21/2022
Environment Generation for Zero-Shot Compositional Reinforcement Learning
Many real-world problems are compositional - solving them requires compl...
research
∙
11/22/2021
L-Verse: Bidirectional Generation Between Image and Text
Far beyond learning long-range interactions of natural language, transfo...
research
∙
11/18/2021
Successor Feature Landmarks for Long-Horizon Goal-Conditioned Reinforcement Learning
Operating in the real-world often requires agents to learn about a compl...
research
∙
11/18/2021
Improving Transferability of Representations via Augmentation-Aware Self-Supervision
Recent unsupervised representation learning methods have shown to be eff...
research
∙
08/08/2021
Contrastive Representation Learning for Rapid Intraoperative Diagnosis of Skull Base Tumors Imaged Using Stimulated Raman Histology
Background: Accurate diagnosis of skull base tumors is essential for pro...
research
∙
07/13/2021
Shortest-Path Constrained Reinforcement Learning for Sparse Reward Tasks
We propose the k-Shortest-Path (k-SP) constraint: a novel constraint on ...
research
∙
06/02/2021
Variational Empowerment as Representation Learning for Goal-Based Reinforcement Learning
Learning to reach goal states and learning diverse skills through mutual...
research
∙
05/18/2021
Pathdreamer: A World Model for Indoor Navigation
People navigating in unfamiliar buildings take advantage of myriad visua...
research
∙
04/14/2021
Revisiting Hierarchical Approach for Persistent Long-Term Video Prediction
Learning to predict the long-term future of video frames is notoriously ...
research
∙
03/02/2021
Adversarial Environment Generation for Learning to Navigate the Web
Learning to autonomously navigate the web is a difficult sequential deci...
research
∙
02/18/2021
State Entropy Maximization with Random Encoders for Efficient Exploration
Recent exploration methods have proven to be a recipe for improving samp...
research
∙
01/12/2021
Cross-Modal Contrastive Learning for Text-to-Image Generation
The output of text-to-image synthesis systems should be coherent, clear,...
research
∙
01/08/2021