deepSELF: An Open Source Deep Self End-to-End Learning Framework

05/11/2020
by   Tomoya Koike, et al.
0

We introduce an open-source toolkit, i.e., the deep Self End-to-end Learning Framework (deepSELF), as a toolkit of deep self end-to-end learning framework for multi-modal signals. To the best of our knowledge, it is the first public toolkit assembling a series of state-of-the-art deep learning technologies. Highlights of the proposed deepSELF toolkit include: First, it can be used to analyse a variety of multi-modal signals, including images, audio, and single or multi-channel sensor data. Second, we provide multiple options for pre-processing, e.g., filtering, or spectrum image generation by Fourier or wavelet transformation. Third, plenty of topologies in terms of NN, 1D/2D/3D CNN, and RNN/LSTM/GRU can be customised and a series of pretrained 2D CNN models, e.g., AlexNet, VGGNet, ResNet can be used easily. Last but not least, above these features, deepSELF can be flexibly used not only as a single model but also as a fusion of such.

READ FULL TEXT
research
02/04/2018

End2You -- The Imperial Toolkit for Multimodal Profiling by End-to-End Learning

We introduce End2You -- the Imperial College London toolkit for multimod...
research
08/11/2023

Deep Learning-Based Open Source Toolkit for Eosinophil Detection in Pediatric Eosinophilic Esophagitis

Eosinophilic Esophagitis (EoE) is a chronic, immune/antigen-mediated eso...
research
05/04/2020

ADVISER: A Toolkit for Developing Multi-modal, Multi-domain and Socially-engaged Conversational Agents

We present ADVISER - an open-source, multi-domain dialog system toolkit ...
research
03/04/2021

CLAIMED, a visual and scalable component library for Trusted AI

Deep Learning models are getting more and more popular but constraints o...
research
04/11/2018

Flexible and Scalable Deep Learning with MMLSpark

In this work we detail a novel open source library, called MMLSpark, tha...
research
10/25/2021

Deep Learning Tools for Audacity: Helping Researchers Expand the Artist's Toolkit

We present a software framework that integrates neural networks into the...
research
04/19/2016

M^2S-Net: Multi-Modal Similarity Metric Learning based Deep Convolutional Network for Answer Selection

Recent works using artificial neural networks based on distributed word ...

Please sign up or login with your details

Forgot password? Click here to reset