KGTuner: Efficient Hyper-parameter Search for Knowledge Graph Learning

05/05/2022
by   Yongqi Zhang, et al.
0

While hyper-parameters (HPs) are important for knowledge graph (KG) learning, existing methods fail to search them efficiently. To solve this problem, we first analyze the properties of different HPs and measure the transfer ability from small subgraph to the full graph. Based on the analysis, we propose an efficient two-stage search algorithm KGTuner, which efficiently explores HP configurations on small subgraph at the first stage and transfers the top-performed configurations for fine-tuning on the large full graph at the second stage. Experiments show that our method can consistently find better HPs than the baseline algorithms within the same time budget, which achieves 9.1% average relative improvement for four embedding models on the large-scale KGs in open graph benchmark.

READ FULL TEXT

page 5

page 17

research
12/08/2021

Prediction of Adverse Biological Effects of Chemicals Using Knowledge Graph Embeddings

We have created a knowledge graph based on major data sources used in ec...
research
11/20/2021

Graph-augmented Learning to Rank for Querying Large-scale Knowledge Graph

Knowledge graph question answering (i.e., KGQA) based on information ret...
research
07/01/2021

AutoSF+: Towards Automatic Scoring Function Design for Knowledge Graph Embedding

Scoring functions, which measure the plausibility of triples, have becom...
research
12/02/2022

UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph

Multi-hop Question Answering over Knowledge Graph (KGQA) aims to find th...
research
07/11/2022

Start Small, Think Big: On Hyperparameter Optimization for Large-Scale Knowledge Graph Embeddings

Knowledge graph embedding (KGE) models are an effective and popular appr...
research
12/02/2021

Learning Large-scale Network Embedding from Representative Subgraph

We study the problem of large-scale network embedding, which aims to lea...
research
06/05/2019

Revisiting Hyper-Parameter Tuning for Search-based Test Data Generation

Search-based software testing (SBST) has been studied a lot in the liter...

Please sign up or login with your details

Forgot password? Click here to reset