Lensing Machines: Representing Perspective in Latent Variable Models

01/20/2022
by   Karthik Dinakar, et al.
0

Many datasets represent a combination of different ways of looking at the same data that lead to different generalizations. For example, a corpus with examples generated by different people may be mixtures of many perspectives and can be viewed with different perspectives by others. It isnt always possible to represent the viewpoints by a clean separation, in advance, of examples representing each viewpoint and train a separate model for each viewpoint. We introduce lensing, a mixed initiative technique to extract lenses or mappings between machine learned representations and perspectives of human experts, and to generate lensed models that afford multiple perspectives of the same dataset. We apply lensing for two classes of latent variable models: a mixed membership model, a matrix factorization model in the context of two mental health applications, and we capture and imbue the perspectives of clinical psychologists into these models. Our work shows the benefits of the machine learning practitioner formally incorporating the perspective of a knowledgeable domain expert into their models rather than estimating unlensed models themselves in isolation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/14/2012

An Efficient Algorithm for Computing Interventional Distributions in Latent Variable Causal Models

Probabilistic inference in graphical models is the task of computing mar...
research
08/03/2023

Comparing scalable strategies for generating numerical perspectives

Numerical perspectives help people understand extreme and unfamiliar num...
research
10/27/2016

Stratification of patient trajectories using covariate latent variable models

Standard models assign disease progression to discrete categories or sta...
research
05/14/2019

Multilingual Factor Analysis

In this work we approach the task of learning multilingual word represen...
research
10/19/2016

A global optimization algorithm for sparse mixed membership matrix factorization

Mixed membership factorization is a popular approach for analyzing data ...
research
08/17/2021

SPMoE: Generate Multiple Pattern-Aware Outputs with Sparse Pattern Mixture of Experts

Many generation tasks follow a one-to-many mapping relationship: each in...
research
04/13/2023

Perspectives on Large Language Models for Relevance Judgment

When asked, current large language models (LLMs) like ChatGPT claim that...

Please sign up or login with your details

Forgot password? Click here to reset