NormMark: A Weakly Supervised Markov Model for Socio-cultural Norm Discovery

05/26/2023
by   Farhad Moghimifar, et al.
0

Norms, which are culturally accepted guidelines for behaviours, can be integrated into conversational models to generate utterances that are appropriate for the socio-cultural context. Existing methods for norm recognition tend to focus only on surface-level features of dialogues and do not take into account the interactions within a conversation. To address this issue, we propose NormMark, a probabilistic generative Markov model to carry the latent features throughout a dialogue. These features are captured by discrete and continuous latent variables conditioned on the conversation history, and improve the model's ability in norm recognition. The model is trainable on weakly annotated data using the variational technique. On a dataset with limited norm annotations, we show that our approach achieves higher F1 score, outperforming current state-of-the-art methods, including GPT3.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/16/2022

NormSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Fly

Norm discovery is important for understanding and reasoning about the ac...
research
04/10/2018

A Hierarchical Latent Structure for Variational Conversation Modeling

Variational autoencoders (VAE) combined with hierarchical RNNs have emer...
research
10/10/2016

Leveraging Recurrent Neural Networks for Multimodal Recognition of Social Norm Violation in Dialog

Social norms are shared rules that govern and facilitate social interact...
research
05/27/2022

Sparse Conditional Hidden Markov Model for Weakly Supervised Named Entity Recognition

Weakly supervised named entity recognition methods train label models to...
research
09/13/2022

Unsupervised representational learning with recognition-parametrised probabilistic models

We introduce a new approach to probabilistic unsupervised learning based...

Please sign up or login with your details

Forgot password? Click here to reset