-
PhoBERT: Pre-trained language models for Vietnamese
We present PhoBERT with two versions of "base" and "large"–the first pub...
read it
-
N-LTP: A Open-source Neural Chinese Language Technology Platform with Pretrained Models
We introduce N-LTP, an open-source Python Chinese natural language proce...
read it
-
Transfer Learning Toolkit: Primers and Benchmarks
The transfer learning toolkit wraps the codes of 17 transfer learning mo...
read it
-
PaddleSeg: A High-Efficient Development Toolkit for Image Segmentation
Image Segmentation plays an essential role in computer vision and image ...
read it
-
Massive Choice, Ample Tasks (MaChAmp):A Toolkit for Multi-task Learning in NLP
Transfer learning, particularly approaches that combine multi-task learn...
read it
-
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
We present MT-DNN, an open-source natural language understanding (NLU) t...
read it
-
The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Models
We present the Language Interpretability Tool (LIT), an open-source plat...
read it
EasyTransfer – A Simple and Scalable Deep Transfer Learning Platform for NLP Applications
The literature has witnessed the success of applying deep Transfer Learning (TL) algorithms to many NLP applications, yet it is not easy to build a simple and scalable TL toolkit for this purpose. To bridge this gap, the EasyTransfer platform is designed to make it easy to develop deep TL algorithms for NLP applications. It is built with rich API abstractions, a scalable architecture and comprehensive deep TL algorithms, to make the development of NLP applications easier. To be specific, the build-in data and model parallelism strategy shows to be 4x faster than the default distribution strategy of Tensorflow. EasyTransfer supports the mainstream pre-trained ModelZoo, including Pre-trained Language Models (PLMs) and multi-modality models. It also integrates various SOTA models for mainstream NLP applications in AppZoo, and supports mainstream TL algorithms as well. The toolkit is convenient for users to quickly start model training, evaluation, offline prediction, and online deployment. This system is currently deployed at Alibaba to support a variety of business scenarios, including item recommendation, personalized search, and conversational question answering. Extensive experiments on real-world datasets show that EasyTransfer is suitable for online production with cutting-edge performance. The source code of EasyTransfer is released at Github (https://github.com/alibaba/EasyTransfer).
READ FULL TEXT
Comments
There are no comments yet.