SimplyRetrieve: A Private and Lightweight Retrieval-Centric Generative AI Tool

08/08/2023
by   Youyang Ng, et al.
0

Large Language Model (LLM) based Generative AI systems have seen significant progress in recent years. Integrating a knowledge retrieval architecture allows for seamless integration of private data into publicly available Generative AI systems using pre-trained LLM without requiring additional model fine-tuning. Moreover, Retrieval-Centric Generation (RCG) approach, a promising future research direction that explicitly separates roles of LLMs and retrievers in context interpretation and knowledge memorization, potentially leads to more efficient implementation. SimplyRetrieve is an open-source tool with the goal of providing a localized, lightweight, and user-friendly interface to these sophisticated advancements to the machine learning community. SimplyRetrieve features a GUI and API based RCG platform, assisted by a Private Knowledge Base Constructor and a Retrieval Tuning Module. By leveraging these capabilities, users can explore the potential of RCG for improving generative AI performance while maintaining privacy standards. The tool is available at https://github.com/RCGAI/SimplyRetrieve with an MIT license.

READ FULL TEXT
research
03/06/2023

OpenICL: An Open-Source Framework for In-context Learning

In recent years, In-context Learning (ICL) has gained increasing attenti...
research
09/03/2023

A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecture

This study presents a method for implementing generative AI services by ...
research
11/17/2017

Double Deep Machine Learning

Very important breakthroughs in data-centric machine learning algorithms...
research
06/27/2023

KnowPrefix-Tuning: A Two-Stage Prefix-Tuning Framework for Knowledge-Grounded Dialogue Generation

Existing knowledge-grounded conversation systems generate responses typi...
research
03/20/2023

Generative AI and the Digital Commons

Many generative foundation models (or GFMs) are trained on publicly avai...
research
09/12/2023

Commands as AI Conversations

Developers and data scientists often struggle to write command-line inpu...

Please sign up or login with your details

Forgot password? Click here to reset