research
∙
07/20/2023
Building Socio-culturally Inclusive Stereotype Resources with Community Engagement
With rapid development and deployment of generative language models in g...
share
research
∙
05/19/2023
SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Models
Stereotype benchmark datasets are crucial to detect and mitigate social ...
research
∙
05/19/2023
MD3: The Multi-Dialect Dataset of Dialogues
We introduce a new dataset of conversational speech representing English...
research
∙
01/23/2023
The Reasonable Effectiveness of Diverse Evaluation Data
In this paper, we present findings from an semi-experimental exploration...
research
∙
11/21/2022
Cultural Re-contextualization of Fairness Research in Language Technologies in India
Recent research has revealed undesirable biases in NLP data and models. ...
research
∙
11/19/2022
Cultural Incongruencies in Artificial Intelligence
Artificial intelligence (AI) systems attempt to imitate human behavior. ...
research
∙
10/11/2022
Underspecification in Scene Description-to-Depiction Tasks
Questions regarding implicitness, ambiguity and underspecification are c...
research
∙
10/06/2022
A Human Rights-Based Approach to Responsible AI
Research on fairness, accountability, transparency and ethics of AI-base...
research
∙
09/25/2022
Re-contextualizing Fairness in NLP: The Case of India
Recent research has revealed undesirable biases in NLP data and models. ...
research
∙
09/15/2022
Power to the People? Opportunities and Challenges for Participatory AI
Participatory approaches to artificial intelligence (AI) and machine lea...
research
∙
06/09/2022
CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotation
Human annotated data plays a crucial role in machine learning (ML) resea...
research
∙
05/11/2022
Evaluation Gaps in Machine Learning Practice
Forming a reliable judgement of a machine learning (ML) model's appropri...
research
∙
04/05/2022
PaLM: Scaling Language Modeling with Pathways
Large language models have been shown to achieve remarkable performance ...
research
∙
12/08/2021
Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotation
Human annotations play a crucial role in machine learning (ML) research ...
research
∙
12/06/2021
Thinking Beyond Distributions in Testing Machine Learned Models
Testing practices within the machine learning (ML) community have center...
research
∙
10/12/2021
Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotations
Majority voting and averaging are common approaches employed to resolve ...
research
∙
10/12/2021
On Releasing Annotator-Level Labels and Information in Datasets
A common practice in building NLP datasets, especially using crowd-sourc...
research
∙
04/08/2021
How Metaphors Impact Political Discourse: A Large-Scale Topic-Agnostic Study Using Neural Metaphor Detection
Metaphors are widely used in political rhetoric as an effective framing ...
research
∙
01/25/2021
Re-imagining Algorithmic Fairness in India and Beyond
Conventional algorithmic fairness is West-centric, as seen in its sub-gr...
research
∙
12/03/2020
Non-portability of Algorithmic Fairness in India
Conventional algorithmic fairness is Western in its sub-groups, values, ...
research
∙
10/23/2020
Learning to Recognize Dialect Features
Linguists characterize dialects by the presence, absence, and frequency ...
research
∙
06/17/2020
Extending the Machine Learning Abstraction Boundary: A Complex Systems Approach to Incorporate Societal Context
Machine learning (ML) fairness research tends to focus primarily on math...
research
∙
05/02/2020
Social Biases in NLP Models as Barriers for Persons with Disabilities
Building equitable and inclusive NLP technologies demands consideration ...
research
∙
10/09/2019
Perturbation Sensitivity Analysis to Detect Unintended Model Biases
Data-driven statistical Natural Language Processing (NLP) techniques lev...
research
∙
07/17/2018
Power Networks: A Novel Neural Architecture to Predict Power Relations
Can language analysis reveal the underlying social power relations that ...
research
∙
05/15/2018
Author Commitment and Social Power: Automatic Belief Tagging to Infer the Social Context of Interactions
Understanding how social power structures affect the way we interact wit...
research
∙
06/12/2017
Dialog Structure Through the Lens of Gender, Gender Environment, and Power
Understanding how the social context of an interaction affects our dialo...
research
∙
03/04/2015