A Workflow Manager for Complex NLP and Content Curation Pipelines

04/16/2020
by   Julian Moreno-Schneider, et al.
0

We present a workflow manager for the flexible creation and customisation of NLP processing pipelines. The workflow manager addresses challenges in interoperability across various different NLP tasks and hardware-based resource usage. Based on the four key principles of generality, flexibility, scalability and efficiency, we present the first version of the workflow manager by providing details on its custom definition language, explaining the communication components and the general system architecture and setup. We currently implement the system, which is grounded and motivated by real-world industry use cases in several innovation and transfer projects.

READ FULL TEXT
research
03/28/2020

Orchestrating NLP Services for the Legal Domain

Legal technology is currently receiving a lot of attention from various ...
research
01/11/2023

The Role of Interactive Visualization in Explaining (Large) NLP Models: from Data to Inference

With a constant increase of learned parameters, modern neural language m...
research
03/02/2021

A Data-Centric Framework for Composable NLP Workflows

Empirical natural language processing (NLP) systems in application domai...
research
10/10/2020

Designing for Recommending Intermediate States in A Scientific Workflow Management System

To process a large amount of data sequentially and systematically, prope...
research
04/16/2021

Translational NLP: A New Paradigm and General Principles for Natural Language Processing Research

Natural language processing (NLP) research combines the study of univers...
research
03/17/2023

Large-Scale Collaborative Writing: Technical Challenges and Recommendations

Collaborative writing is essential for teams that create documents toget...
research
05/14/2021

Methods Included: Standardizing Computational Reuse and Portability with the Common Workflow Language

A widely used standard for portable multilingual data analysis pipelines...

Please sign up or login with your details

Forgot password? Click here to reset