DeepAI AI Chat
Log In Sign Up

Interpretable contrastive word mover's embedding

by   Ruijie Jiang, et al.
Tufts University

This paper shows that a popular approach to the supervised embedding of documents for classification, namely, contrastive Word Mover's Embedding, can be significantly enhanced by adding interpretability. This interpretability is achieved by incorporating a clustering promoting mechanism into the contrastive loss. On several public datasets, we show that our method improves significantly upon existing baselines while providing interpretation to the clusters via identifying a set of keywords that are the most representative of a particular class. Our approach was motivated in part by the need to develop Natural Language Processing (NLP) methods for the novel problem of assessing student work for scientific writing and thinking - a problem that is central to the area of (educational) Learning Sciences (LS). In this context, we show that our approach leads to a meaningful assessment of the student work related to lab reports from a biology class and can help LS researchers gain insights into student understanding and assess evidence of scientific thought processes.


page 1

page 2

page 3

page 4


Automatic coding of students' writing via Contrastive Representation Learning in the Wasserstein space

Qualitative analysis of verbal data is of central importance in the lear...

Supervised Stochastic Neighbor Embedding Using Contrastive Learning

Stochastic neighbor embedding (SNE) methods t-SNE, UMAP are two most pop...

Pair-Level Supervised Contrastive Learning for Natural Language Inference

Natural language inference (NLI) is an increasingly important task for n...

Analyzing Student Strategies In Blended Courses Using Clickstream Data

Educational software data promises unique insights into students' study ...

Contrastive Loss is All You Need to Recover Analogies as Parallel Lines

While static word embedding models are known to represent linguistic ana...

Applying Recent Innovations from NLP to MOOC Student Course Trajectory Modeling

This paper presents several strategies that can improve neural network-b...

Let GPT be a Math Tutor: Teaching Math Word Problem Solvers with Customized Exercise Generation

In this paper, we present a novel approach for distilling math word prob...