Unleashing the Power of Graph Learning through LLM-based Autonomous Agents

09/08/2023
by   Lanning Wei, et al.
0

Graph structured data are widely existed and applied in the real-world applications, while it is a challenge to handling these diverse data and learning tasks on graph in an efficient manner. When facing the complicated graph learning tasks, experts have designed diverse Graph Neural Networks (GNNs) in recent years. They have also implemented AutoML in Graph, also known as AutoGraph, to automatically generate data-specific solutions. Despite their success, they encounter limitations in (1) managing diverse learning tasks at various levels, (2) dealing with different procedures in graph learning beyond architecture design, and (3) the huge requirements on the prior knowledge when using AutoGraph. In this paper, we propose to use Large Language Models (LLMs) as autonomous agents to simplify the learning process on diverse real-world graphs. Specifically, in response to a user request which may contain varying data and learning targets at the node, edge, or graph levels, the complex graph learning task is decomposed into three components following the agent planning, namely, detecting the learning intent, configuring solutions based on AutoGraph, and generating a response. The AutoGraph agents manage crucial procedures in automated graph learning, including data-processing, AutoML configuration, searching architectures, and hyper-parameter fine-tuning. With these agents, those components are processed by decomposing and completing step by step, thereby generating a solution for the given data automatically, regardless of the learning task on node or graph. The proposed method is dubbed Auto^2Graph, and the comparable performance on different datasets and learning tasks. Its effectiveness is demonstrated by its comparable performance on different datasets and learning tasks, as well as the human-like decisions made by the agents.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/19/2021

Edge-Featured Graph Attention Network

Lots of neural network architectures have been proposed to deal with lea...
research
04/14/2021

Generative Causal Explanations for Graph Neural Networks

This paper presents Gem, a model-agnostic approach for providing interpr...
research
12/06/2022

Extending Universal Approximation Guarantees: A Theoretical Justification for the Continuity of Real-World Learning Tasks

Universal Approximation Theorems establish the density of various classe...
research
06/16/2022

A Robust Stacking Framework for Training Deep Graph Models with Multifaceted Node Features

Graph Neural Networks (GNNs) with numerical node features and graph stru...
research
06/30/2023

Graphtester: Exploring Theoretical Boundaries of GNNs on Graph Datasets

Graph Neural Networks (GNNs) have emerged as a powerful tool for learnin...
research
06/12/2023

Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow

Various industries such as finance, meteorology, and energy generate vas...
research
08/10/2020

Using Experts' Opinions in Machine Learning Tasks

In machine learning tasks, especially in the tasks of prediction, scient...

Please sign up or login with your details

Forgot password? Click here to reset