Damian Pascual | DeepAI

AI Chat

Featured Co-authors

Yang Liu
344 publications
Ryan Cotterell
156 publications
Roger Wattenhofer
119 publications
Clara Meister
31 publications
David Atienza
21 publications
Yue Ding
15 publications
Zhao Meng
12 publications
Gino Brunner
12 publications
Peter Staar
10 publications
Francesco Fusco
10 publications
Nicolas Langer
10 publications

∙ 02/09/2022

pNLP-Mixer: an Efficient all-MLP Architecture for Language

Large pre-trained language models drastically changed the natural langua...

0 Francesco Fusco, et al. ∙

∙ 11/06/2021

EEGEyeNet: a Simultaneous Electroencephalography and Eye-tracking Dataset and Benchmark for Eye Movement Prediction

We present a new dataset and benchmark with the goal of advancing resear...

0 Ard Kastrati, et al. ∙

∙ 09/27/2021

On Isotropy Calibration of Transformers

Different studies of the embedding space of transformer models suggest t...

0 Yue Ding, et al. ∙

∙ 09/20/2021

A Plug-and-Play Method for Controlled Text Generation

Large pre-trained language models have repeatedly shown their ability to...

0 Damian Pascual, et al. ∙

∙ 09/15/2021

BERT is Robust! A Case Against Synonym-Based Adversarial Examples in Text Classification

Deep Neural Networks have taken Natural Language Processing by storm. Wh...

0 Jens Hauser, et al. ∙

∙ 04/14/2021

Towards BERT-based Automatic ICD Coding: Limitations and Opportunities

Automatic ICD coding is the task of assigning codes from the Internation...

0 Damian Pascual, et al. ∙

∙ 01/12/2021

Of Non-Linearity and Commutativity in BERT

In this work we provide new insights into the transformer architecture, ...

0 Sumu Zhao, et al. ∙

∙ 12/31/2020

Directed Beam Search: Plug-and-Play Lexically Constrained Language Generation

Large pre-trained language models are capable of generating realistic te...

0 Damian Pascual, et al. ∙

∙ 09/10/2020

Brain2Word: Decoding Brain Activity for Language Generation

Brain decoding, understood as the process of mapping brain activities to...

0 Nicolas Affolter, et al. ∙

∙ 08/25/2020

Medley2K: A Dataset of Medley Transitions

The automatic generation of medleys, i.e., musical pieces formed by diff...

0 Lukas Faber, et al. ∙

∙ 04/10/2020

Telling BERT's full story: from Local Attention to Global Aggregation

We take a deep look into the behavior of self-attention heads in the tra...

0 Damian Pascual, et al. ∙

∙ 08/12/2019

On the Validity of Self-Attention as Explanation in Transformer Models

Explainability of deep learning systems is a vital requirement for many ...

0 Gino Brunner, et al. ∙

∙ 07/22/2019

Synthetic Epileptic Brain Activities Using Generative Adversarial Networks

Epilepsy is a chronic neurological disorder affecting more than 65 milli...

0 Damian Pascual, et al. ∙

Are you a researcher?
Expose your work
to one of the largest
A.I. communities in the world