Opinion Mining Using Population-tuned Generative Language Models

07/24/2023
by   Allmin Susaiyah, et al.
0

We present a novel method for mining opinions from text collections using generative language models trained on data collected from different populations. We describe the basic definitions, methodology and a generic algorithm for opinion insight mining. We demonstrate the performance of our method in an experiment where a pre-trained generative model is fine-tuned using specifically tailored content with unnatural and fully annotated opinions. We show that our approach can learn and transfer the opinions to the semantic classes while maintaining the proportion of polarisation. Finally, we demonstrate the usage of an insight mining system to scale up the discovery of opinion insights from a real text corpus.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/07/2020

Snippext: Semi-supervised Opinion Mining with Augmented Data

Online services are interested in solutions to opinion mining, which is ...
research
05/19/2023

Self-Agreement: A Framework for Fine-tuning Language Models to Find Agreement among Diverse Opinions

Finding an agreement among diverse opinions is a challenging topic in mu...
research
08/29/2019

From the Token to the Review: A Hierarchical Multimodal approach to Opinion Mining

The task of predicting fine grained user opinion based on spontaneous sp...
research
03/28/2023

Language Models Trained on Media Diets Can Predict Public Opinion

Public opinion reflects and shapes societal behavior, but the traditiona...
research
05/24/2023

Aligning Language Models to User Opinions

An important aspect of developing LLMs that interact with humans is to a...
research
05/13/2022

PathologyBERT – Pre-trained Vs. A New Transformer Language Model for Pathology Domain

Pathology text mining is a challenging task given the reporting variabil...
research
05/16/2023

AI-Augmented Surveys: Leveraging Large Language Models for Opinion Prediction in Nationally Representative Surveys

How can we use large language models (LLMs) to augment surveys? This pap...

Please sign up or login with your details

Forgot password? Click here to reset