research
∙
09/07/2023
Zero-Shot Audio Captioning via Audibility Guidance
The task of audio captioning is similar in essence to tasks such as imag...
share
research
∙
09/07/2023
Box-based Refinement for Weakly Supervised and Unsupervised Localization Tasks
It has been established that training a box-based detector network can e...
research
∙
06/28/2023
Reconstructing the Hemodynamic Response Function via a Bimodal Transformer
The relationship between blood flow and neuronal activity is widely reco...
research
∙
06/15/2023
Annotator Consensus Prediction for Medical Image Segmentation with Diffusion Models
A major challenge in the segmentation of medical images is the large int...
research
∙
06/11/2023
2-D SSM: A General Spatial Layer for Visual Transformers
A central objective in computer vision is to design models with appropri...
research
∙
06/10/2023
AutoSAM: Adapting SAM to Medical Images by Overloading the Prompt Encoder
The recently introduced Segment Anything Model (SAM) combines a clever a...
research
∙
06/08/2023
Decision S4: Efficient Sequence-Based RL via State Spaces Layers
Recently, sequence learning methods have been applied to the problem of ...
research
∙
06/02/2023
Centered Self-Attention Layers
The self-attention mechanism in transformers and the message-passing mec...
research
∙
06/01/2023
The Hidden Language of Diffusion Models
Text-to-image diffusion models have demonstrated an unparalleled ability...
research
∙
06/01/2023
Anomaly Detection with Variance Stabilized Density Estimation
Density estimation based anomaly detection schemes typically model anoma...
research
∙
05/24/2023
Focus Your Attention (with Adaptive IIR Filters)
We present a new layer in which dynamic (i.e.,input-dependent) Infinite ...
research
∙
05/22/2023
AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image Generation
In recent years, image generation has shown a great leap in performance,...
research
∙
03/30/2023
Discriminative Class Tokens for Text-to-Image Diffusion Models
Recent advances in text-to-image diffusion models have enabled the gener...
research
∙
03/13/2023
Improved Tree Search for Automatic Program Synthesis
In the task of automatic program synthesis, one obtains pairs of matchin...
research
∙
03/12/2023
Energy Regularized RNNs for Solving Non-Stationary Bandit Problems
We consider a Multi-Armed Bandit problem in which the rewards are non-st...
research
∙
02/22/2023
Gradient Adjusting Networks for Domain Inversion
StyleGAN2 was demonstrated to be a powerful image generation engine that...
research
∙
01/31/2023
Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models
Recent text-to-image generative models have demonstrated an unparalleled...
research
∙
01/31/2023
Domain-Generalizable Multiple-Domain Clustering
Accurately clustering high-dimensional measurements is vital for adequat...
research
∙
01/27/2023
Deep Quantum Error Correction
Quantum error correction codes (QECC) are a key component for realizing ...
research
∙
01/25/2023
Separate And Diffuse: Using a Pretrained Diffusion Model for Improving Source Separation
The problem of speech separation, also known as the cocktail party probl...
research
∙
11/25/2022
Generating 2D and 3D Master Faces for Dictionary Attacks with a Network-Assisted Latent Space Evolution
A master face is a face image that passes face-based identity authentica...
research
∙
10/21/2022
Describing Sets of Images with Textual-PCA
We seek to semantically describe a set of images, capturing both the att...
research
∙
10/02/2022
OCD: Learning to Overfit with Conditional Diffusion Models
We present a dynamic model in which the weights are conditioned on an in...
research
∙
09/16/2022
Denoising Diffusion Error Correction Codes
Error correction code (ECC) is an integral part of the physical communic...
research
∙
07/28/2022
Semi-supervised Learning of Partial Differential Operators and Dynamical Flows
The evolution of dynamical systems is generically governed by nonlinear ...
research
∙
07/22/2022
Zero-Shot Video Captioning with Evolving Pseudo-Tokens
We introduce a zero-shot video captioning method that employs two frozen...
research
∙
06/19/2022
What is Where by Looking: Weakly-Supervised Open-World Phrase-Grounding without Text Inputs
Given an input image, and nothing else, our method returns the bounding ...
research
∙
06/05/2022
Zero-Shot Voice Conditioning for Denoising Diffusion TTS Models
We present a novel way of conditioning a pretrained denoising diffusion ...
research
∙
06/02/2022
Optimizing Relevance Maps of Vision Transformers Improves Robustness
It has been observed that visual classification models often rely mostly...
research
∙
05/24/2022
SepIt: Approaching a Single Channel Speech Separation Bound
We present an upper bound for the Single Channel Speech Separation task,...
research
∙
05/22/2022
Neural Inverse Kinematics
Inverse kinematic (IK) methods recover the parameters of the joints, giv...
research
∙
05/05/2022
On Disentangled and Locally Fair Representations
We study the problem of performing classification in a manner that is fa...
research
∙
04/11/2022
No Token Left Behind: Explainability-Aided Image Classification and Generation
The application of zero-shot learning in computer vision has been revolu...
research
∙
03/30/2022
End to End Lip Synchronization with a Temporal AutoEncoder
We study the problem of syncing the lip movement in a video with the aud...
research
∙
03/27/2022
Error Correction Code Transformer
Error correction code is a major part of the communication physical laye...
research
∙
03/23/2022
Dynamically-Scaled Deep Canonical Correlation Analysis
Canonical Correlation Analysis (CCA) is a method for feature extraction ...
research
∙
03/08/2022
Dynamic Dual-Output Diffusion Models
Iterative denoising-based generation, also known as denoising diffusion ...
research
∙
02/15/2022
XAI for Transformers: Better Explanations through Conservative Propagation
Transformers have become an important workhorse of machine learning, wit...
research
∙
02/13/2022
Unsupervised Disentanglement with Tensor Product Representations on the Torus
The current methods for learning representations with auto-encoders almo...
research
∙
12/21/2021
fMRI Neurofeedback Learning Patterns are Predictive of Personal and Clinical Traits
We obtain a personal signature of a person's learning progress in a self...
research
∙
12/10/2021
Pre-training and Fine-tuning Transformers for fMRI Prediction Tasks
We present the TFF Transformer framework for the analysis of functional ...
research
∙
12/09/2021
Locally Shifted Attention With Early Global Integration
Recent work has shown the potential of transformers for computer vision ...
research
∙
12/06/2021
Learning Personal Representations from fMRIby Predicting Neurofeedback Performance
We present a deep neural network method for learning a personal represen...
research
∙
12/05/2021
Learning Query Expansion over the Nearest Neighbor Graph
Query Expansion (QE) is a well established method for improving retrieva...
research
∙
12/05/2021
End-to-End Segmentation via Patch-wise Polygons Prediction
The leading segmentation methods represent the output map as a pixel gri...
research
∙
12/01/2021
SegDiff: Image Segmentation with Diffusion Probabilistic Models
Diffusion Probabilistic Methods are employed for state-of-the-art image ...
research
∙
11/29/2021
Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic
Recent text-to-image matching models apply contrastive learning to large...
research
∙
11/28/2021
Learning a Weight Map for Weakly-Supervised Localization
In the weakly supervised localization setting, supervision is given as a...
research
∙
11/25/2021
A-Muze-Net: Music Generation by Composing the Harmony based on the Generated Melody
We present a method for the generation of Midi files of piano music. The...
research
∙
10/26/2021
