research
∙
09/07/2023
DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
Despite their impressive capabilities, large language models (LLMs) are ...
share
research
∙
06/08/2023
Revealing the Blind Spot of Sentence Encoder Evaluation by HEROS
Existing sentence textual similarity benchmark datasets only use a singl...
research
∙
06/01/2023
Improved Cross-Lingual Transfer Learning For Automatic Speech Translation
Research in multilingual speech-to-text translation is topical. Having a...
research
∙
05/26/2023
Entailment as Robust Self-Learner
Entailment has been recognized as an important metric for evaluating nat...
research
∙
05/26/2023
Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering
We propose EAR, a query Expansion And Reranking approach for improving p...
research
∙
05/21/2023
Comparison of Multilingual Self-Supervised and Weakly-Supervised Speech Pre-Training for Adaptation to Unseen Languages
Recent models such as XLS-R and Whisper have made multilingual speech te...
research
∙
05/18/2023
Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clustering
Self-supervised speech representation models have succeeded in various t...
research
∙
04/07/2023
Interpretable Unified Language Checking
Despite recent concerns about undesirable behaviors generated by large l...
research
∙
03/29/2023
What, when, and where? – Self-Supervised Spatio-Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructions
Spatio-temporal grounding describes the task of localizing events in spa...
research
∙
03/10/2023
Logic Against Bias: Textual Entailment Mitigates Stereotypical Sentence Reasoning
Due to their similarity-based learning objectives, pretrained sentence e...
research
∙
11/14/2022
On Unsupervised Uncertainty-Driven Speech Pseudo-Label Filtering and Model Calibration
Pseudo-label (PL) filtering forms a crucial part of Self-Training (ST) m...
research
∙
10/14/2022
PCFG-based Natural Language Interface Improves Generalization for Controlled Text Generation
Existing work on controlled text generation (CTG) assumes a control inte...
research
∙
10/07/2022
C2KD: Cross-Lingual Cross-Modal Knowledge Distillation for Multilingual Text-Video Retrieval
Multilingual text-video retrieval methods have improved significantly in...
research
∙
07/14/2022
Developing a Series of AI Challenges for the United States Department of the Air Force
Through a series of federal initiatives and orders, the U.S. Government ...
research
∙
05/17/2022
SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representation
We propose the SAMU-XLSR: Semantically-Aligned Multimodal Utterance-leve...
research
∙
04/06/2022
Simple and Effective Unsupervised Speech Synthesis
We introduce the first unsupervised speech synthesis system based on a s...
research
∙
03/02/2022
Controlling the Focus of Pretrained Language Generation Models
The finetuning of pretrained transformer-based language generation model...
research
∙
12/08/2021
Everything at Once – Multi-modal Fusion Transformer for Video Retrieval
Multi-modal learning from video data has seen increased attention recent...
research
∙
12/01/2021
Routing with Self-Attention for Multimodal Capsule Networks
The task of multimodal learning has seen a growing interest recently as ...
research
∙
11/08/2021
Cascaded Multilingual Audio-Visual Learning from Videos
In this paper, we explore self-supervised audio-visual models that learn...
research
∙
10/14/2021
Spoken ObjectNet: A Bias-Controlled Spoken Caption Dataset
Visually-grounded spoken language datasets can enable models to learn cr...
research
∙
10/07/2021
Magic dust for cross-lingual adaptation of monolingual wav2vec-2.0
We propose a simple and effective cross-lingual transfer learning method...
research
∙
10/04/2021
On the Interplay Between Sparsity, Naturalness, Intelligibility, and Prosody in Speech Synthesis
Are end-to-end text-to-speech (TTS) models over-parametrized? To what ex...
research
∙
09/06/2021
An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models
Prompt-based knowledge probing for 1-hop relations has been used to meas...
research
∙
08/29/2021
Interpretable Propaganda Detection in News Articles
Online users today are exposed to misleading and propagandistic news art...
research
∙
06/14/2021
Mitigating Biases in Toxic Language Detection through Invariant Rationalization
Automatic detection of toxic language plays an essential role in protect...
research
∙
06/10/2021
PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognition
Recent work on speech self-supervised learning (speech SSL) demonstrated...
research
∙
06/10/2021
Cross-Modal Discrete Representation Learning
Recent advances in representation learning have demonstrated an ability ...
research
∙
05/10/2021
Spoken Moments: Learning Joint Audio-Visual Representations from Video Descriptions
When people observe events, they are able to abstract key information an...
research
∙
04/26/2021
Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos
Multimodal self-supervised learning is getting more and more attention a...
research
∙
03/12/2021
Cooperative Learning of Zero-Shot Machine Reading Comprehension
Pretrained language models have significantly improved the performance o...
research
∙
02/02/2021
PSLA: Improving Audio Event Classification with Pretraining, Sampling, Labeling, and Aggregation
Audio event classification is an active research area and has a wide ran...
research
∙
01/24/2021
Knowledge Grounded Conversational Symptom Detection with Graph Memory Networks
In this work, we propose a novel goal-oriented dialog task, automatic sy...
research
∙
12/31/2020
Text-Free Image-to-Speech Synthesis Using Learned Segmental Units
In this paper we present the first model for directly synthesizing fluen...
research
∙
11/01/2020
Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies
Self-supervised speech representations have been shown to be effective i...
research
∙
10/26/2020
Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining
Much recent work on Spoken Language Understanding (SLU) is limited in at...
research
∙
10/22/2020
Similarity Analysis of Self-Supervised Speech Representations
Self-supervised speech representation learning has recently been a prosp...
research
∙
10/11/2020
We Can Detect Your Bias: Predicting the Political Ideology of News Articles
We explore the task of predicting the leading political ideology or bias...
research
∙
09/15/2020
A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation
This work studies the widely adopted ancestral sampling algorithms for a...
research
∙
08/20/2020
Constructing a Knowledge Graph from Unstructured Documents without External Alignment
Knowledge graphs (KGs) are relevant to many NLP tasks, but building a re...
research
∙
06/16/2020
AVLnet: Learning Audio-Visual Language Representations from Instructional Videos
Current methods for learning visually grounded language from videos ofte...
research
∙
06/04/2020
CSTNet: Contrastive Speech Translation Network for Self-Supervised Speech Representation Learning
More than half of the 7,000 languages in the world are in imminent dange...
research
∙
06/03/2020
A Convolutional Deep Markov Model for Unsupervised Speech Representation Learning
Probabilistic Latent Variable Models (LVMs) provide an alternative to se...
research
∙
05/19/2020
Prototypical Q Networks for Automatic Conversational Diagnosis and Few-Shot New Disease Adaption
Spoken dialog systems have seen applications in many domains, including ...
research
∙
05/17/2020
Vector-Quantized Autoregressive Predictive Coding
Autoregressive Predictive Coding (APC), as a self-supervised objective, ...
research
∙
05/09/2020
What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media Context
Predicting the political bias and the factuality of reporting of entire ...
research
∙
05/03/2020
Similarity Analysis of Contextual Word Representation Models
This paper investigates contextual word representation models from the l...
research
∙
04/11/2020
Improved Speech Representations with Multi-Target Autoregressive Predictive Coding
Training objectives based on predictive coding have recently been shown ...
research
∙
02/04/2020
Audio-Visual Calibration with Polynomial Regression for 2-D Projection Using SVD-PHAT
This paper proposes a straightforward 2-D method to spatially calibrate ...
research
∙
12/03/2019