research
∙
06/09/2023
Evaluating the Social Impact of Generative AI Systems in Systems and Society
Generative AI systems across modalities, ranging from text, image, audio...
share
research
∙
05/09/2023
Stronger Together: on the Articulation of Ethical Charters, Legal Tools, and Technical Documentation in ML
The growing need for accountability of the people behind AI systems can ...
research
∙
05/09/2023
StarCoder: may the source be with you!
The BigCode community, an open-scientific collaboration working on the r...
research
∙
03/22/2023
AfroDigits: A Community-Driven Spoken Digit Dataset for African Languages
The advancement of speech technologies has been remarkable, yet its inte...
research
∙
03/20/2023
Stable Bias: Analyzing Societal Representations in Diffusion Models
As machine learning-enabled Text-to-Image (TTI) systems are becoming inc...
research
∙
03/07/2023
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
As language models grow ever larger, the need for large-scale high-quali...
research
∙
02/27/2023
The ROOTS Search Tool: Data Transparency for LLMs
ROOTS is a 1.6TB multilingual text corpus developed for the training of ...
research
∙
01/20/2023
Towards Openness Beyond Open Access: User Journeys through 3 Open AI Collaboratives
Open Artificial Intelligence (Open source AI) collaboratives offer alter...
research
∙
01/09/2023
SantaCoder: don't reach for the stars!
The BigCode project is an open-scientific collaboration working on the r...
research
∙
12/09/2022
Measuring Data
We identify the task of measuring data to quantitatively characterize th...
research
∙
12/09/2022
BigScience: A Case Study in the Social Construction of a Multilingual Large Language Model
The BigScience Workshop was a value-driven initiative that spanned one a...
research
∙
11/20/2022
The Stack: 3 TB of permissively licensed source code
Large Language Models (LLMs) play an ever-increasing role in the field o...
research
∙
07/07/2022
Training Transformers Together
The infrastructure necessary for training state-of-the-art models is bec...
research
∙
05/04/2022
Data Governance in the Age of Large-Scale Data-Driven Language Technology
The recent emergence and adoption of Machine Learning technology, and sp...
research
∙
01/25/2022
Documenting Geographically and Contextually Diverse Data Sources: The BigScience Catalogue of Language Data and Resources
In recent years, large-scale data collection efforts have prioritized th...
research
∙
09/07/2021
Datasets: A Community Library for Natural Language Processing
The scale, variety, and quantity of publicly-available NLP datasets has ...
research
∙
08/16/2021
Reusable Templates and Guides For Documenting Datasets and Models for Natural Language Processing and Generation: A Case Study of the HuggingFace and GEM Data and Model Cards
Developing documentation guidelines and easy-to-use templates for datase...
research
∙
06/18/2021
Distributed Deep Learning in Open Collaborations
Modern deep learning applications require increasingly more compute to t...
research
∙
03/22/2021
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets
With the success of large-scale pre-training and multilingual modeling i...
research
∙
02/02/2021
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
We introduce GEM, a living benchmark for natural language Generation (NL...
research
∙
09/04/2020
KILT: a Benchmark for Knowledge Intensive Language Tasks
Challenging problems such as open-domain question answering, fact checki...
research
∙
11/21/2019
Improving Conditioning in Context-Aware Sequence to Sequence Models
Neural sequence to sequence models are well established for applications...
research
∙
08/22/2019
Unsupervised Text Summarization via Mixed Model Back-Translation
Back-translation based approaches have recently lead to significant prog...
research
∙
07/22/2019
Why Build an Assistant in Minecraft?
In this document we describe a rationale for a research program aimed at...
research
∙
07/22/2019
ELI5: Long Form Question Answering
We introduce the first large-scale corpus for long-form question answeri...
research
∙
07/19/2019
CraftAssist: A Framework for Dialogue-enabled Interactive Agents
This paper describes an implementation of a bot assistant in Minecraft, ...
research
∙
04/17/2019
CraftAssist Instruction Parsing: Semantic Parsing for a Minecraft Assistant
We propose a large scale semantic parsing dataset focused on instruction...
research
∙
05/23/2017
Grounded Recurrent Neural Networks
In this work, we present the Grounded Recurrent Neural Network (GRNN), a...
research
∙
04/23/2017
Discourse-Based Objectives for Fast Unsupervised Sentence Representation Learning
This work presents a novel objective function for the unsupervised train...
research
∙
11/18/2016
Variable Computation in Recurrent Neural Networks
Recurrent neural networks (RNNs) have been used extensively and with inc...
research
∙
10/14/2016
Simultaneous Learning of Trees and Representations for Extreme Classification and Density Estimation
We consider multi-class classification where the predictor has a hierarc...
research
∙
08/26/2015