A new record of graph enumeration enabled by parallel processing

07/29/2019
by   Zhipeng Xu, et al.
0

Using three supercomputers, we broke a record set in 2011, in the enumeration of non-isomorphic regular graphs by expanding the sequence of A006820 in Online Encyclopedia of Integer Sequences (OEIS), to achieve the number for 4-regular graphs of order 23 as 429,668,180,677,439, while discovering serval optimal regular graphs with minimum average shortest path lengths (ASPL) that can be used as interconnection networks for parallel computers. The number of 4-regular graphs and the optimal graphs, extremely time-consuming to calculate, result from a method we adapt from GENREG, a classical regular graph generator, to fit for supercomputers' strengths of using thousands of processor cores.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

07/29/2019

A new record of enumeration of regular graphs by parallel processing

We broke a record, set 8 years ago, in the enumeration of non-isomorphic...
07/29/2019

Enumeration of regular graphs by using the cluster in high efficiency

In this note, we proposed a method to enumerate regular graphs on the cl...
10/29/2019

A Structured Table of Graphs with Special Properties

We organize a table of regular graphs with minimal diameters and mean pa...
04/26/2019

Regular Expression Matching on billion-nodes Graphs

In many applications, it is necessary to retrieve pairs of vertices with...
11/16/2018

Fixation properties of multiple cooperator configurations on regular graphs

Whether or not cooperation is favored in evolutionary games on graphs de...
10/29/2019

A Structured Table of Graphs with Symmetries and Other Special Properties

We organize a table of regular graphs with minimal diameters and minimal...
08/30/2019

Existence of regular nut graphs for degree at most 11

A nut graph is a singular graph with one-dimensional kernel and correspo...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Introduction

Analysis of regular graphs for their properties, including eigen-spectra and automorphisms, is a fertile field for discovering and applications in algebraic graph theory Godsil2001 . Yet, there are many unsolved problems, e.g., the Conway’s 99-graph problem conway and the 57-regular Moore graph Hoffman1960 . For analysis of interconnection networks, regularity is essential for its direct and useful relationship to the complexity of network implementation, and as such, many regular graphs including the Peterson graph, hypercube graph, and their extensions Dasa ; Ohringa ; Ohring1993 ; Seo2011 ; Seo2017 ; Seo2008 are widely used to construct interconnection networks for parallel computers.

For -regular graphs of order , Robinson and Wormald Robinson1983 ; Robinson1977 presented all counting results for , while pointing out that enumeration for unlabeled -regular graphs with is an unsolved problem. Meringer Meringer1999 proposed a practical method to construct regular graphs without pairwise isomorphism checking but with a fast test for canonicity. Brankmann Brinkmann1996 ; Brinkmann2017 developed minibaum and snarkhunter for generating 3-regular graphs. “The House of Graphs” Brinkmann2013 and the OEIS inc2019line databased the latest results for numbers of regular graphs. Kimberley A068934 contributed many results (A068934) to these databases by a package called GENREG developed by Meringer Meringer1999

. In addition to its challenges of pure mathematics, the graph counting problem is the root of topics in reliability, artificial intelligence, reasoning, statistical physics

Vadhan2001 , life sciences, chemistry Meringer2010 and even the search for the origins of life Meringer2017 .

GENREG, efficient for small-scale clusters due to its feature of task partition, approaches a hard wall of speedup for fine-grained partitioning on large-scale clusters, caused mainly by load imbalance. For obtaining larger graphs, we extend GENREG for distributed clusters by using the message passing interface (MPI) mpi2014 . Using the parallel GENREG we developed, we have obtained the following results:

  1. filtered all 3-regular graphs up to order 32 with minimum ASPLs;

  2. discovered thousands of 4-regular graphs of order 32 with minimum ASPLs;

  3. generated the exact counts of 4-regular graphs of order 23 by using the three supercomputer clusters located in the US, China, and Ecuador.

Among our results, the first and second have been applied to the interconnection network research Deng2019 for benchmark relationship of the graph ASPLs to network performance latencies. The third expands from 22 to 23, for the first time, in the sequence A006820 a006820 of OEIS, which is the number of connected 4-regular graphs of order . Kimberley a006820 used GENREG to enumerate the 4-regular graphs for up to the order 22 in 2011 Larrion2016 . This record for remained unchallenged until our enumeration for , enabled by our parallel computing implementation to advance it a step.

2 The enumeration framework and results

2.1 The enumeration function

For enumerating the regular graphs, published packages such as minibaum Brinkmann1996 , snarkhunter Brinkmann2017 , and GENREG have their own strengths and weaknesses, GENREG is more general in covering the graph degrees than minibaum and snarkhunter that only support 3-regular graphs.

In our parallel computing framework, we designate one node as the master, whose task involves adaptive scheduling and dispatching, and the rest as a team of workers. When our program starts, the workers send a message to the master to request a task, and the workers continue the requests until the list of tasks exhausts. As usual, when the master sends a task to a worker, this task is marked as selected and becomes unavailable. At last, when the task pool empties, the master signals all workers to exit.

Our dynamical scheduling strategy keeps cores in the cluster busy for useful tasks to allow us efficient search for graphs with specified parameters, e.g., diameters or eigenvalues, by inserting external serial programs. In addition to load balance, our parallel program reduces the communication cost to

, less requirement of bandwidth because the message itself is the message count. If we use a dedicated thread for task scheduling, the scalability and limit the maximum computer system can both shrink. Depending on the communication sub-system, the maximum scalable system our current approach can reach is approximately 3,000 cores, due to communication congestions, eventually. We may improve the scalability of our program by a multi-level scheduling; particularly, for the many-core systems.

2.2 Search for a regular graph with minimal ASPL

In the interconnection networks of supercomputers and data centers, regularity is a very significant feature because it is related to the complexity of the network configuration. For the topologies of regular graphs applied to the interconnection networks, it is highly desirable to obtain graphs with minimal ASPLs because they help reduce communication latencies. Let be the distance between vertex and , the ASPL is calculated as follows,

(1)

Cerf Cerf1975

calculated and proved lower bound of ASPL, hence the goal of optimal graph is to find graphs with minimum ASPLs. Usually and thus far, random or heuristic methods or intuitions were resorted to searching for graphs with such desired properties for large networks; Graph Golf

golf , a competition of searching for graphs with the minimal diameters and ASPLs, generated many graphs that are very commonly, but asymmetrically. However, we still hope to discover graphs with all desired properties including minimum diameters, ASPLs, symmetry, and robustness but with one disadvantage: smaller graphs. However, these graphs can be adopted in smaller clusters or multiple modules of these clusters or system-on-chip.

(a) (32,3)-optimal
(b) (32,4)-optimal
Figure 1: The optimal graphs used in, for example, a Beowulf cluster Deng2019 .

Using this framework, we decomposed the search into 200,000 sub-tasks and completed the exhaustive search of all of 3-regular graphs of order 32 with diameter 4 and minimal ASPL. The program running on the Sunway-Bluelight supercomputer sunway with 80,000 cores for 72 hours and discovered 56 graphs with the minimal ASPLs after exhausting all 18,941,522,184,590 possible graphs predicted by Robinson et al. [10] who only enumerated them without finding the graphs with desired properties including minimum diameters and ASPLs. Deng et al. Deng2019 applied one (Fig. 1 (a)) of these graphs to construct a Beowulf BE2003 cluster, and their benchmark results show that the graphs with the minimal ASPL outpeform other classical topologies.

Fig. 2

shows the distribution of generated graph numbers for all cases, which look like Gaussian distribution with the long tail containing hundreds of millions of graphs and the frequency fluctuates by 4 orders of magnitude. Clearly, the tasks of enumerations vary greatly from graph to graph, and our dynamic task scheduling has eliminated substantial waiting time due to load imbalance.

Figure 2: Number of graphs and frequency.

2.3 Graph counting for (23,4)-regular graphs

When we search for the minimum-ASPL graphs among all possible 4-regular graphs of order 32, there is no enumeration result for this scale when . We can still use our software to search for regular graphs with minimum ASPL, as shown in Fig. 1 (b), without confirmation of exhaustiveness. Therefore, we verified the results in Tab. 1 after decomposing the problem into 50,000 sub-tasks and setting the split-level as 12. We manage to increase the of the sequence A006820 from 22 to 23 and confirmed the number of 4-regular graphs of order 23 as 429,668,180,677,439 by using our parallel GENREG with the same parameters.

Order Quartics
5 1
6 1
7 2
8 6
9 16
10 59
11 265
12 1,544
13 10,778
14 88,168
15 805,491
16 8,037,418
17 86,221,634
18 985,870,522
19 11,946,487,647
20 152,808,063,181
21 2,056,692,014,474
22 28,566,273,166,527
23 429,668,180,677,439
Table 1: OEIS A006820

Our work to obtain the new enumeration for

is estimated to cost nearly 100 core-years. We ganged three supercomputers, the SeaWulf at Stony Brook University, while the Tianhe-1 with Intel Xeon X5670 processors and the IBM Quinde with Power8 processors can process 113,000 and 56,469 graphs per second per core, respectively. As shown in Tab.

2, the Seawulf with Intel Xeon Gold 6148 processors has the highest efficiency for searching 178,000 graphs per second per core, while the Tianhe-1 with Intel Xeon X5670 processors and the IBM Quinde with Power8 processors contributed the rest.

In fact, the result of graph counting for (23,4)-regular graphs was obtained by the strategic and opportunistic use of the fragmented and shared computing resources. In addition to the policy of fair and efficient share for most supercomputers, the Tianhe-1 would terminate tasks that last long for many cores because of maintenance, which prevents us from running long tasks. The external scheduling system we developed helps overcome the limitations of computing resources while facilitating optimal utilization of the occasionally available cores.

Cluster
Total processed
( graphs)
Computing time
(core years)
Core speed
( graphs/s)
Seawulf 66.12 178
Tianhe-1 19.53 113
IBM Quinde 13.25 56
Table 2: Cost on three clusters

3 Conclusions

Our parallel method adapting the GENREG enables us to complete the research and enumeration on systems of 3000 processor cores. For the first time, using this new approach, we discovered several optimal graphs of order 32 and found the enumeration count for 4-regular graphs of order 23, gaining confidence in the graph theory community that high-performance computing can help solve otherwise intractable problems.

Acknowledgements

Z. Xu is supported by the special project high performance computing of National Key Research and Development Program 2016YFB0200604. We thank the National Supercomputing Centers in Jinan and Changsha in China, for computing resources and, M. Meringer of German Aerospace Center, for technical support and of GENREG and beneficial suggestions of this manuscript via e-mails.

References