Log In Sign Up

Confronting Structural Inequities in AI for Education

by   Michael Madaio, et al.

Educational technologies, and the systems of schooling in which they are deployed, enact particular ideologies about what is important to know and how learners should learn. As artificial intelligence technologies – in education and beyond – have led to inequitable outcomes for marginalized communities, various approaches have been developed to evaluate and mitigate AI systems' disparate impact. However, we argue in this paper that the dominant paradigm of evaluating fairness on the basis of performance disparities in AI models is inadequate for confronting the structural inequities that educational AI systems (re)produce. We draw on a lens of structural injustice informed by critical theory and Black feminist scholarship to critically interrogate several widely-studied and widely-adopted categories of educational AI systems and demonstrate how educational AI technologies are bound up in and reproduce historical legacies of structural injustice and inequity, regardless of the parity of their models' performance. We close with alternative visions for a more equitable future for educational AI research.


page 1

page 2

page 3

page 4


Experts' View on Challenges and Needs for Fairness in Artificial Intelligence for Education

In recent years, there has been a stimulating discussion on how artifici...

Risks of AI Foundation Models in Education

If the authors of a recent Stanford report (Bommasani et al., 2021) on t...

Equity and Artificial Intelligence in Education: Will "AIEd" Amplify or Alleviate Inequities in Education?

The development of educational AI (AIEd) systems has often been motivate...

Neural Language Models are Effective Plagiarists

As artificial intelligence (AI) technologies become increasingly powerfu...

A Transparency Index Framework for AI in Education

Numerous AI ethics checklists and frameworks have been proposed focusing...