SEEC: Semantic Vector Federation across Edge Computing Environments

08/30/2020
by   Shalisha Witherspoon, et al.
0

Semantic vector embedding techniques have proven useful in learning semantic representations of data across multiple domains. A key application enabled by such techniques is the ability to measure semantic similarity between given data samples and find data most similar to a given sample. State-of-the-art embedding approaches assume all data is available on a single site. However, in many business settings, data is distributed across multiple edge locations and cannot be aggregated due to a variety of constraints. Hence, the applicability of state-of-the-art embedding approaches is limited to freely shared datasets, leaving out applications with sensitive or mission-critical data. This paper addresses this gap by proposing novel unsupervised algorithms called SEEC for learning and applying semantic vector embedding in a variety of distributed settings. Specifically, for scenarios where multiple edge locations can engage in joint learning, we adapt the recently proposed federated learning techniques for semantic vector embedding. Where joint learning is not possible, we propose novel semantic vector translation algorithms to enable semantic query across multiple edge locations, each with its own semantic vector-space. Experimental results on natural language as well as graph datasets show that this may be a promising new direction.

READ FULL TEXT

page 1

page 7

page 8

page 10

research
08/03/2020

State-of-the-art Techniques in Deep Edge Intelligence

The potential held by the gargantuan volumes of data being generated acr...
research
05/22/2023

Sentence Representations via Gaussian Embedding

Recent progress in sentence embedding, which represents the meaning of a...
research
05/12/2018

Weight Initialization in Neural Language Models

Semantic Similarity is an important application which finds its use in m...
research
12/10/2020

DONE: Distributed Newton-type Method for Federated Edge Learning

There is growing interest in applying distributed machine learning to ed...
research
10/12/2018

Embedding Geographic Locations for Modelling the Natural Environment using Flickr Tags and Structured Data

Meta-data from photo-sharing websites such as Flickr can be used to obta...
research
10/07/2022

Learning to embed semantic similarity for joint image-text retrieval

We present a deep learning approach for learning the joint semantic embe...
research
07/26/2021

Preliminary Steps Towards Federated Sentiment Classification

Automatically mining sentiment tendency contained in natural language is...

Please sign up or login with your details

Forgot password? Click here to reset