BERTERS: Multimodal Representation Learning for Expert Recommendation System with Transformer

06/30/2020
by   N. Nikzad-Khasmakhi, et al.
0

The objective of an expert recommendation system is to trace a set of candidates' expertise and preferences, recognize their expertise patterns, and identify experts. In this paper, we introduce a multimodal classification approach for expert recommendation system (BERTERS). In our proposed system, the modalities are derived from text (articles published by candidates) and graph (their co-author connections) information. BERTERS converts text into a vector using the Bidirectional Encoder Representations from Transformer (BERT). Also, a graph Representation technique called ExEm is used to extract the features of candidates from the co-author network. Final representation of a candidate is the concatenation of these vectors and other features. Eventually, a classifier is built on the concatenation of features. This multimodal approach can be used in both the academic community and the community question answering. To verify the effectiveness of BERTERS, we analyze its performance on multi-label classification and visualization tasks.

READ FULL TEXT
research
04/30/2023

Multimodal Graph Transformer for Multimodal Question Answering

Despite the success of Transformer models in vision and language tasks, ...
research
01/16/2020

ExEm: Expert Embedding using dominating set theory with deep learning approaches

A collaborative network is a social network that is comprised of experts...
research
10/26/2018

Software Expert Discovery via Knowledge Domain Embeddings in a Collaborative Network

Community Question Answering (CQA) websites can be claimed as the most m...
research
05/10/2018

WISER: A Semantic Approach for Expert Finding in Academia based on Entity Linking

We present WISER, a new semantic search engine for expert finding in aca...
research
11/23/2020

Large Scale Multimodal Classification Using an Ensemble of Transformer Models and Co-Attention

Accurate and efficient product classification is significant for E-comme...
research
05/05/2020

The Cascade Transformer: an Application for Efficient Answer Sentence Selection

Large transformer-based language models have been shown to be very effec...
research
11/14/2016

Learning for Expertise Matching with Declination Prediction

We study the problem of finding appropriate experts who are able to comp...

Please sign up or login with your details

Forgot password? Click here to reset