b'James Glass'

research

∙ 05/26/2023

Entailment as Robust Self-Learner

Entailment has been recognized as an important metric for evaluating nat...

0 Jiaxin Ge, et al. ∙

research

∙ 05/26/2023

Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering

We propose EAR, a query Expansion And Reranking approach for improving p...

0 Yung-Sung Chuang, et al. ∙

research

∙ 05/21/2023

Comparison of Multilingual Self-Supervised and Weakly-Supervised Speech Pre-Training for Adaptation to Unseen Languages

Recent models such as XLS-R and Whisper have made multilingual speech te...

0 Andrew Rouditchenko, et al. ∙

research

∙ 05/18/2023

Self-supervised Fine-tuning for Improved Content Representations by Speaker-invariant Clustering

Self-supervised speech representation models have succeeded in various t...

0 Heng-Jui Chang, et al. ∙

research

∙ 04/07/2023

Interpretable Unified Language Checking

Despite recent concerns about undesirable behaviors generated by large l...

0 Tianhua Zhang, et al. ∙

research

∙ 03/29/2023

What, when, and where? – Self-Supervised Spatio-Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructions

Spatio-temporal grounding describes the task of localizing events in spa...

0 Brian Chen, et al. ∙

research

∙ 03/10/2023

Logic Against Bias: Textual Entailment Mitigates Stereotypical Sentence Reasoning

Due to their similarity-based learning objectives, pretrained sentence e...

0 Hongyin Luo, et al. ∙

research

∙ 11/14/2022

On Unsupervised Uncertainty-Driven Speech Pseudo-Label Filtering and Model Calibration

Pseudo-label (PL) filtering forms a crucial part of Self-Training (ST) m...

11 Nauman Dawalatabad, et al. ∙

research

∙ 10/14/2022

PCFG-based Natural Language Interface Improves Generalization for Controlled Text Generation

Existing work on controlled text generation (CTG) assumes a control inte...

0 Jingyu Zhang, et al. ∙

research

∙ 10/07/2022

C2KD: Cross-Lingual Cross-Modal Knowledge Distillation for Multilingual Text-Video Retrieval

Multilingual text-video retrieval methods have improved significantly in...

0 Andrew Rouditchenko, et al. ∙

research

∙ 07/14/2022

Developing a Series of AI Challenges for the United States Department of the Air Force

Through a series of federal initiatives and orders, the U.S. Government ...

5 Vijay Gadepally, et al. ∙

research

∙ 05/17/2022

SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representation

We propose the SAMU-XLSR: Semantically-Aligned Multimodal Utterance-leve...

0 Sameer Khurana, et al. ∙

research

∙ 04/06/2022

Simple and Effective Unsupervised Speech Synthesis

We introduce the first unsupervised speech synthesis system based on a s...

0 Alexander H. Liu, et al. ∙

research

∙ 03/02/2022

Controlling the Focus of Pretrained Language Generation Models

The finetuning of pretrained transformer-based language generation model...

0 Jiabao Ji, et al. ∙

research

∙ 12/08/2021

Everything at Once – Multi-modal Fusion Transformer for Video Retrieval

Multi-modal learning from video data has seen increased attention recent...

0 Nina Shvetsova, et al. ∙

research

∙ 12/01/2021

Routing with Self-Attention for Multimodal Capsule Networks

The task of multimodal learning has seen a growing interest recently as ...

0 Kevin Duarte, et al. ∙

research

∙ 11/08/2021

Cascaded Multilingual Audio-Visual Learning from Videos

In this paper, we explore self-supervised audio-visual models that learn...

0 Andrew Rouditchenko, et al. ∙

research

∙ 10/14/2021

Spoken ObjectNet: A Bias-Controlled Spoken Caption Dataset

Visually-grounded spoken language datasets can enable models to learn cr...

12 Ian Palmer, et al. ∙

research

∙ 10/07/2021

Magic dust for cross-lingual adaptation of monolingual wav2vec-2.0

We propose a simple and effective cross-lingual transfer learning method...

0 Sameer Khurana, et al. ∙

research

∙ 10/04/2021

On the Interplay Between Sparsity, Naturalness, Intelligibility, and Prosody in Speech Synthesis

Are end-to-end text-to-speech (TTS) models over-parametrized? To what ex...

1 Cheng-I Jeff Lai, et al. ∙

research

∙ 09/06/2021

An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models

Prompt-based knowledge probing for 1-hop relations has been used to meas...

52 Tianxing He, et al. ∙

research

∙ 08/29/2021

Interpretable Propaganda Detection in News Articles

Online users today are exposed to misleading and propagandistic news art...

34 Seunghak Yu, et al. ∙

research

∙ 06/14/2021

Mitigating Biases in Toxic Language Detection through Invariant Rationalization

Automatic detection of toxic language plays an essential role in protect...

0 Yung-Sung Chuang, et al. ∙

research

∙ 06/10/2021

PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognition

Recent work on speech self-supervised learning (speech SSL) demonstrated...

4 Cheng-I Jeff Lai, et al. ∙

research

∙ 06/10/2021

Cross-Modal Discrete Representation Learning

Recent advances in representation learning have demonstrated an ability ...

0 Alexander H. Liu, et al. ∙

research

∙ 05/10/2021

Spoken Moments: Learning Joint Audio-Visual Representations from Video Descriptions

When people observe events, they are able to abstract key information an...

4 Mathew Monfort, et al. ∙

research

∙ 04/26/2021

Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos

Multimodal self-supervised learning is getting more and more attention a...

0 Brian Chen, et al. ∙

research

∙ 03/12/2021

Cooperative Learning of Zero-Shot Machine Reading Comprehension

Pretrained language models have significantly improved the performance o...

0 Hongyin Luo, et al. ∙

research

∙ 02/02/2021

PSLA: Improving Audio Event Classification with Pretraining, Sampling, Labeling, and Aggregation

Audio event classification is an active research area and has a wide ran...

0 Yuan Gong, et al. ∙

research

∙ 01/24/2021

Knowledge Grounded Conversational Symptom Detection with Graph Memory Networks

In this work, we propose a novel goal-oriented dialog task, automatic sy...

0 Hongyin Luo, et al. ∙

research

∙ 12/31/2020

Text-Free Image-to-Speech Synthesis Using Learned Segmental Units

In this paper we present the first model for directly synthesizing fluen...

12 Wei-Ning Hsu, et al. ∙

research

∙ 11/01/2020

Non-Autoregressive Predictive Coding for Learning Speech Representations from Local Dependencies

Self-supervised speech representations have been shown to be effective i...

0 Alexander H. Liu, et al. ∙

research

∙ 10/26/2020

Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining

Much recent work on Spoken Language Understanding (SLU) is limited in at...

0 Cheng-I Lai, et al. ∙

research

∙ 10/22/2020

Similarity Analysis of Self-Supervised Speech Representations

Self-supervised speech representation learning has recently been a prosp...

0 Yu-An Chung, et al. ∙

research

∙ 10/11/2020

We Can Detect Your Bias: Predicting the Political Ideology of News Articles

We explore the task of predicting the leading political ideology or bias...

14 Ramy Baly, et al. ∙

research

∙ 09/15/2020

A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation

This work studies the widely adopted ancestral sampling algorithms for a...

10 Moin Nadeem, et al. ∙

research

∙ 08/20/2020

Constructing a Knowledge Graph from Unstructured Documents without External Alignment

Knowledge graphs (KGs) are relevant to many NLP tasks, but building a re...

0 Seunghak Yu, et al. ∙

research

∙ 06/16/2020

AVLnet: Learning Audio-Visual Language Representations from Instructional Videos

Current methods for learning visually grounded language from videos ofte...

14 Andrew Rouditchenko, et al. ∙

research

∙ 06/04/2020

CSTNet: Contrastive Speech Translation Network for Self-Supervised Speech Representation Learning

More than half of the 7,000 languages in the world are in imminent dange...

0 Sameer Khurana, et al. ∙

research

∙ 06/03/2020

A Convolutional Deep Markov Model for Unsupervised Speech Representation Learning

Probabilistic Latent Variable Models (LVMs) provide an alternative to se...

0 Sameer Khurana, et al. ∙

research

∙ 05/19/2020

Prototypical Q Networks for Automatic Conversational Diagnosis and Few-Shot New Disease Adaption

Spoken dialog systems have seen applications in many domains, including ...

0 Hongyin Luo, et al. ∙

research

∙ 05/17/2020

Vector-Quantized Autoregressive Predictive Coding

Autoregressive Predictive Coding (APC), as a self-supervised objective, ...

0 Yu-An Chung, et al. ∙

research

∙ 05/09/2020

What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media Context

Predicting the political bias and the factuality of reporting of entire ...

0 Ramy Baly, et al. ∙

research

∙ 05/03/2020

Similarity Analysis of Contextual Word Representation Models

This paper investigates contextual word representation models from the l...

0 John M. Wu, et al. ∙

research

∙ 04/11/2020

Improved Speech Representations with Multi-Target Autoregressive Predictive Coding

Training objectives based on predictive coding have recently been shown ...

0 Yu-An Chung, et al. ∙

research

∙ 02/04/2020

Audio-Visual Calibration with Polynomial Regression for 2-D Projection Using SVD-PHAT

This paper proposes a straightforward 2-D method to spatially calibrate ...

0 Francois Grondin, et al. ∙

research

∙ 12/03/2019

SemEval-2016 Task 3: Community Question Answering

This paper describes the SemEval–2016 Task 3 on Community Question Answe...

0 Preslav Nakov, et al. ∙

research

∙ 11/26/2019

SemEval-2015 Task 3: Answer Selection in Community Question Answering

Community Question Answering (cQA) provides new interesting research dir...

5 Preslav Nakov, et al. ∙

research

∙ 11/21/2019

Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech

In this paper, we present a method for learning discrete linguistic unit...

0 David Harwath, et al. ∙

research

∙ 11/01/2019

On the Linguistic Representational Power of Neural Machine Translation Models

Despite the recent success of deep neural networks in natural language p...

0 Yonatan Belinkov, et al. ∙

James Glass

Featured Co-authors