Heterogeneous Swarms for Maritime Dynamic Target Search and Tracking

Current strategies employed for maritime target search and tracking are primarily based on the use of agents following a predetermined path to perform a systematic sweep of a search area. Recently, dynamic Particle Swarm Optimization (PSO) algorithms have been used together with swarming multi-robot systems (MRS), giving search and tracking solutions the added properties of robustness, scalability, and flexibility. Swarming MRS also give the end-user the opportunity to incrementally upgrade the robotic system, inevitably leading to the use of heterogeneous swarming MRS. However, such systems have not been well studied and incorporating upgraded agents into a swarm may result in degraded mission performances. In this paper, we propose a PSO-based strategy using a topological k-nearest neighbor graph with tunable exploration and exploitation dynamics with an adaptive repulsion parameter. This strategy is implemented within a simulated swarm of 50 agents with varying proportions of fast agents tracking a target represented by a fictitious binary function. Through these simulations, we are able to demonstrate an increase in the swarm's collective response level and target tracking performance by substituting in a proportion of fast buoys.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 4

page 5

page 6

08/16/2021

Tracking Multiple Fast Targets With Swarms: Interplay Between Social Interaction and Agent Memory

The task of searching for and tracking of multiple targets is a challeng...
12/01/2005

On Self-Regulated Swarms, Societal Memory, Speed and Dynamics

We propose a Self-Regulated Swarm (SRS) algorithm which hybridizes the a...
08/21/2020

Robust and Efficient Swarm Communication Topologies for Hostile Environments

Swarm Intelligence-based optimization techniques combine systematic expl...
06/10/2021

Analysis of Evolved Response Thresholds for Decentralized Dynamic Task Allocation

We investigate the application of a multi-objective genetic algorithm to...
10/14/2014

Refined Particle Swarm Intelligence Method for Abrupt Motion Tracking

Conventional tracking solutions are not feasible in handling abrupt moti...
01/27/2019

Multi Objective Particle Swarm Optimization based Cooperative Agents with Automated Negotiation

This paper investigates a new hybridization of multi-objective particle ...
07/30/2016

Heterogeneous Strategy Particle Swarm Optimization

PSO is a widely recognized optimization algorithm inspired by social swa...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

I Introduction

The search and tracking of targets has many applications within the field of oceanic engineering. Examples of this include search and rescue (SAR) [1], environmental monitoring [2], and underwater mine countermeasures (UMCM) [3]. Recently, there has been increasing interest in the deployment of autonomous multi-robot systems (MRS) to mitigate the risks presented to human operators in hazardous working environments, as well as to reduce the need for human intervention in large scale and routine operations. Currently, the leading strategy for maritime target search and tracking is a systematic sweep of a search area carried out by agents following a predetermined route [4, 5]. However, these types of strategies are inadequate when dealing with targets that are able to travel faster than any individual agent. In addition, these strategies are not scalable and are unable to cope with the sudden failure of individual agents.

To overcome these critical issues, recent studies have focused on the implementation of decentralized multi-agent control strategies for target search and tracking using swarming MRS [6, 7, 8]. One of the most popular strategies in this field is based on Particle Swarm Optimization (PSO)—originally a computational method that simulates the dynamics of discrete agents behaving like flocking animals for the optimization of nonlinear functions. To implement this strategy in robots, several modifications have been made to the original PSO algorithm, such as the implementation of obstacle avoidance [9] and taking into account the limited communications range of robots [7, 10]. MRS using decentralized strategies such as PSO present several advantages over their traditional path following counterparts, as well as other non-decentralized or non-swarming MRS. These include faster search times, the ability to tolerate the failure of one or multiple robots—robustness, the ability to carry out the assigned mission with differing number of robots—scalability, and the ability to perform a task in a dynamic environment—flexibility [11, 12].

In addition, the modularity of MRS presents the opportunity for the incremental upgrade of the individual agents. Upgrades of this nature will inevitably result in a heterogeneous MRS comprised of agents with different physical and computational processing abilities. However, the incorporation of improved agents within a swarm may not necessarily benefit the swarm and could, conversely, be detrimental to the performance of the MRS [13]. For example, it was demonstrated that in the dynamic monitoring of open water bodies using mobile buoys, the addition of a small number of faster travelling buoys resulted in a significant increase in the swarm’s collective coverage performance only when the faster moving buoys were placed in the vicinity of the slower moving buoys [14]. A previous study has also suggested that there may be an optimum composition proportion in which heterogeneous teams should be deployed when carrying out site defence missions [15].

Furthermore, current research in heterogeneous PSO mainly focuses on different agent behaviors and communications networks instead of the motile properties of heterogeneous agents [16, 17]. This is due to the original applications of PSO in silico, where the agents’ travelling speeds are irrelevant and therefore ignored. As such, it is necessary to study physically heterogeneous swarms in order to benefit from the different capabilities of each agent in the physical world.

Current literature on PSO-based robotics is also mostly concentrated on the search for static targets, leaving the implementation of these behaviors for dynamic target searches largely unexplored. The two main challenges associated with dynamic target search and tracking using PSO-based algorithms are: (1) the swarm’s use of outdated information, and (2) a lack of exploratory actions carried out by the system [18]. In both cases, the swarm may be able to initially converge on the target but will be unable to continue tracking the target’s movements once engaged due to the PSO algorithm’s tendency to favor local exploitation over global exploration during the latter stages of the search process [19]. This shows that the swarm needs to be able to constantly explore the search space even after the target is found. In PSO-based robotics, common methods that promote search space exploration are done through the implementation of a memory limit, in which outdated information is discarded [7] or by employing inter-agent repulsion, preventing individuals from clustering in a small area [20].

Recently, it has been uncovered that there exists an optimal level of connectivity between swarming agents involved in a decentralized decision-making process, regardless of the agents’ physical capabilities [21]. This optimal level of connectivity is directly related to the speed of the driving signal of the target. In addition, both excessive or insufficient levels of inter-agent connectivity was found to limit a swarm’s ability to collectively respond to perturbations [22]. This implies that while tracking a dynamic target, tuning the amount of interaction between a swarm’s may result in an improved collective tracking performance.

In light of this, we recently proposed a PSO-based strategy using a topological -nearest neighbor graph with tunable exploration and exploitation dynamics (EED) with an adaptive repulsion parameter [8]. It has also been shown that by keeping the neighbors in communications range constant, the level of consensus reached by the swarm was able to be maintained despite sudden removals and injections of large amounts of agents [23]. Therefore, by means of a topological -nearest neighbor network, the level of inter-agent information exchange can be controlled better in comparison to a network determined purely by metric distance, maintaining the performance of the swarm [24]. In addition, by using the adaptive repulsion parameter, we are able to promote exploration of the search area among the swarming agents, preventing them from aggregating in a small area. Through this strategy, it was found that an optimum level of connectivity exists, at which the performance of a homogeneous swarm tracking a fast moving target was maximized.

In this paper, we present an extension of our work in [8], which used a homogeneous PSO-based swarm with an adjustable EED. Here, a heterogeneous swarm of 50 agents, comprised of two different types of agents with different maximum speeds, is modelled to search and track a target represented by a fictitious binary objective function. In doing so, we emulate one of the challenging cases of searching for a target travelling faster than the agents themselves while using a near-zero-range sensor. The performance of various swarm compositions is compared through the use of several metrics, providing insights into the swarm’s tracking performance, its response to the moving target, as well as its EED performance.

Ii Methods

Ii-a Search and Track Strategy

To achieve our goal of searching for and tracking a mobile target, we have implemented a PSO-based swarming MRS with tunable EED. This solution relies on a decentralized PSO algorithm using a dynamic network, searching for the global minimum location that corresponds to the position of a target. In addition, an adaptive repulsion behavior that increases the amount of collective exploratory actions performed by the swarm is implemented. This last parameter is controlled by varying the degree of the swarm’s -nearest neighbor communications network.

Ii-A1 -Nearest Neighbor Particle Swarm Optimization

In particle swarm optimization, the agents (also commonly referred to as particles or candidate solutions) that comprise a swarm are initially randomly placed around the search space. At any discrete time-step , each agent can be fully characterized by three state variables: its two-dimensional velocity, , its position, , and its objective function value, . In this paper, the objective function value of an agent at any time-step is assigned as follows.

(1)

Assigning an objective function value of either or , as seen in (1), allows a binary objective function to be modelled. The explicit dependence on time of the objective function value, , reflects the dynamic character of the target.

At each time-step, each agent attempts to minimize its objective function value by taking into account its current direction of travel and the best position of an agent within its neighborhood (also known as the “Neighborhood best”), denoted here by . This variable, also known as the social component, is the main driver behind the exploitative actions carried out by the swarm. Classical variants of PSO also include the influence of the personal best position—known as the cognitive component, which is reliant on the memory of the agents and causes them to explore the search area more [25]. Given that one the most challenging cases of a dynamic objective function is considered, the effects stemming from the utilization of an agent’s memory are known to be completely counter-effective and are therefore discarded as the information previously collected by the swarm rapidly becomes outdated [26, 7]. The velocity and position of the agents are updated according to Eqs. (2) & (3). The parameter is known as the velocity inertial weight, and as the velocity social weight, while is a number randomly drawn from the unit interval.

(2)
(3)

It should also be noted that is assigned the position of an agent’s topological neighbor with the best position at any particular time-step. This is unlike the original PSO algorithm where takes on the historical best position found by the particle’s neighbors. It is important note that in our framework, the concept of a neighbor is understood in the network sense [27]. This means that any agent has as many neighbors as its degree , and that the neighborhood changes given that a time-varying network topology is considered.

The idea of a topological neighborhood is conveniently represented by a -nearest neighbor graph. Here, the value of the degree , which is the same for all agents, characterizes the level of connectivity within the swarm. At each time-step, all agents identify their -nearest topological neighbors, and set their position to be the position of the nearest neighbor on target. Should the agent detect the target itself, or should none of the agent’s neighbors detect the target, is then set to the agent’s own position at that given time-step. At this point, is defined as the set of indices corresponding to the topological neighbors of agent at time-step . In the sequel, the reference to the time-step is dropped to simplify the notations.

It has previously shown that the level of connectivity (degree) significantly affects the collective dynamics or a swarm [11]. In addition, it has also been found that for PSO in both dynamic and static environments, higher levels of connectivity lead to higher levels of local exploitation, and consequently a higher degree of aggregation within the search space, while a low degree causes the swarm to prioritize exploration of the environment [20, 8].

Ii-A2 Adaptive Repulsion

The adaptive repulsion behavior was introduced in [8]. Through its implementation, the swarm was encouraged to carry out more exploratory movements, preventing agents from congregating within a small area after being outrun by their target. This led to an increase in the swarm’s tracking performance of the dynamic target when compared to a swarm using a constant repulsion scheme and also resulted in an increase to the swarm’s responsiveness to the changing environment. Furthermore, this behavior also provides a welcome inter-agent collision-avoidance measure.

The repulsive behavior adopted was based on the one used in another swarming system [14, 28]. For any agent with topological neighbors , the repulsion velocity can be expressed as:

(4)

where

is the vector from agent

to agent . This level of inter-agent repulsion is controlled by two variables: the repulsion strength , affecting the agents’ distance from each other at equilibrium, and the exponent in the pre-factor term . In the simulations carried out, is fixed at given that this value has very moderate effects on the performance of the EED strategy. At large and values, the repulsion strength causes the agents to distribute themselves evenly across the environment [14]. As such, these two parameters were set in a manner that enabled the swarm to cover the entire search area when there was no target found.

Critical to the implementation of the repulsive behavior is the ability of an agent to vary its level of repulsion based on the information it collects from the environment and provided by its neighbors. From these two sets of information, each agent can adjust the value of its own parameter within a set range, thereby yielding adaptive repulsion. In our numerical tests, was allowed to vary between 0.375 and 1.5. If the target is not within detection range of an agent or its neighbors, the agent enters an exploratory state, gradually increasing its until the maximum limit for is attained. On the other hand, if an agent or at least one of its neighbors is able to detect the target, the agent adopts a tracking state where the strength of its repulsion is lowered until a set minimum value. The adaptive repulsion scheme is summarized in Algorithm 1.

  Set , , , and
  while System active do
     if  or s.t.  then
        if  then
           
        end if
     else
        if  then
           
        end if
     end if
     Calculate using (4)
  end while
Algorithm 1 Adaptive Repulsion

Ii-A3 Exploration Exploitation Dynamics

Given the elements reported in the previous sections, the proposed search and tracking strategy is presented in Algorithm 2.

  Set , , , and
  while System active do
     for All agents  do
        Calculate
        if  then
           
        else
           Determine s.t. agent is a topological k-nearest neighbor of agent }
           if  s.t.  then
              
           else
              
           end if
        end if
        Calculate using (2)
        Calculate using Algorithm 1
        
        
        
     end for
     
  end while
Algorithm 2 Dynamic -Nearest Network PSO with Adaptive Repulsion

Ii-B Swarm Performance Metrics

To analyze the performance and dynamics of the swarm, three different metrics previously introduced in [8] for homogeneous swarms are adapted and used. These are the cumulative velocity fluctuation magnitude, the correlation between an agent’s heading and its bearing relative to the target’s location, and the proportion of time the swarm has at least one agent in detection range of the target.

Ii-B1 Cumulative Velocity Fluctuation Magnitude

It has previously been shown that in various flocking animals, including midges and starlings, the effectiveness of the transmission of information between swarming agents is closely connected to the level of velocity fluctuations of individual agents and their correlations [29, 30]. As such, the level of velocity fluctuations in an artificial swarm can be quantified to provide insight into the level of response of a swarm to its dynamic operating environment.

The velocity fluctuation of an agent i is defined as the difference between its velocity and the mean velocity of the entire swarm:

(5)

The average maximum speed of the swarm’s comprising agents can also be calculated:

(6)

Where is the number of fast agents, is the maximum velocity of the fast agents, is the number of slow agents, and is the maximum velocity of the slow agents.

The overall response of the swarm to its dynamic environment can then be determined by taking the time-averaged sum of all of the swarming agents’ velocity fluctuations, divided by the number of agents in the swarm, and then normalizing the value with respect to the average maximum speed of the agents in the swarm:

(7)

where is the total number of time-steps considered.

Ii-B2 Heading-Bearing Correlation

To quantify the exploitative activity of the swarm, the correlation between the heading of any agent and the target’s bearing relative to this agent at any time-step , denoted by , is calculated. This correlation can be calculated as follows:

(8)

where is the bearing of the target in relation to the agent and is the angle between the two unit vectors (see Fig. 1). The quantity will therefore take a value between and , with values approaching being related to exploratory actions, and values approaching revealing exploitative actions carried out by agents moving towards the target. Calculating this variable for all agents at each time-step of the simulation allows the generation of a histogram, showing the overall EED of the entire swarm. It should be noted that with this formula, agents that are stationary will have a heading-bearing correlation value of .

Ii-B3 Time on Target

The overall tracking performance of the swarm is classically determined by counting the number of time-steps when the target is able to be detected by at least one agent. Using this metric enabled us to calculate the percentage of time the system is engaged in tracking the target as it moves around the search-space.

Ii-C Swarm Robotic Platform

Fig. 1: (A) Original BoB-0 unit. (B) Upgraded BoB-1 unit. (C) Bearing of the target () relative to the buoy () and the heading of the buoy () at time .

In this work, we model the “Bunch of Buoys” (BoB) system, originally intended for the dynamic monitoring of open water bodies [28, 14]. The current system employs two types of buoys: BoB-0, which weighs and can attain a maximum speed of , and BoB-1, weighing and is capable of attaining a top speed of . Being faster and lighter, BoB-1 is able to better react to dynamic changes in its operating environment compared to BoB-0. Both of the robotic platforms have propulsion systems allowing for omnidirectional movement. In addition, both platforms house a suite of sensors, enabling the characterization of their local environment. A distributed mesh communications system is used for sharing locally sensed information among the buoys, as well as for sending and receiving of commands. In the simulations, 50 buoys tracking a fictitious moving target were modelled. Swarms with various compositions of BoB-0 and BoB-1 units and levels of connectivity were tested to observe the effects of gradually adding upgraded units to the system.

Ii-D Target Representation

Most research on collective search and tracking considers cases involving a target emitting a continuous gradient field. In this case, a classical gradient-descent approach can be used to locate the position of the target with relative ease without utilizing swarm intelligence. To demonstrate the use of swarm intelligence, the target was represented through the use of a binary objective function. As explained previously in Section II-A1, an agent on target was assigned an objective function value of and otherwise. In the simulations, the target was also modelled to have maximum speeds greater than that of the maximum speed of the BoB-1 unit. Allowing the target to move at such speeds and using a binary objective function was meant to mimic one of the most challenging cases with a near-zero-range sensor tracking a target faster than the agent themselves. We believe that the design of effective swarm strategies benefits from considering such challenging scenarios.

Iii Simulation Results

Iii-a Simulation Setup

A two-dimensional square search-space (dimensions ) was considered with a disc-shaped target having a fixed radius (see Fig. 2). The target moved randomly around the search-space at constant speed . If an agent fell within the radius of the target, it was assigned an objective function value of , and zero otherwise. This modelled a binary objective function, in which agents either were either fully informed of the target’s position or had no information at all. In our simulations, the speed of the target was set to either and , compared to for the BoB-0 units and for the BoB-1 units. All simulation runs lasted for a total of time-steps to ensure achieving statistically steady conditions. By using long simulation runs, a low level of variability was calculated for the three performance metrics between five different runs (below for both the tracking performance and the cumulative velocity fluctuation magnitude).

Fig. 2: A heterogeneous swarm comprised of 35 BoB-0 units (black crosses) and 15 BoB-1 units (blue crosses) tracking a disc-shaped target (dark blue). Agents to the left of the target are locked in position due to them attaining their maximum repulsion strength and lack of target information.

Iii-B Heading-Bearing Correlation

To visualize the overall EED of the swarm, the distribution of the heading-bearing correlation for all agents in the swarm was considered over the entire duration of a simulation ( time-steps). This was done by recording the heading-bearing correlations, calculated using Eq. (8), for all agents and iterations. The weight of each bin was then divided by the total number of iterations to give a time-averaged histogram for the entire swarm (see Fig. 3).

Fig. 3: Distribution of heading-bearing correlations (-axis) for different levels of the swarm connectivity () and target speeds (). The left column shows the heading-bearing correlations for a heterogeneous swarm comprised of 15 BoB-1 units and 35 BoB-0 units, while the right column shows the heading-bearing correlations for a homogeneous swarm of 50 BoB-0 units.

From the histograms, three observations can be made. Firstly, as the level of connectivity increases, so too does the amount of exploitative behavior carried out by the swarm. This observation is true for both the heterogeneous and homogeneous swarms. The increase in exploitation is characterized by a higher proportion of agents having a value large positive heading-bearing correlation value, suggesting that there was a higher proportion of agents moving towards the target instead of exploring the environment.

Secondly, in both homogeneous and heterogeneous swarms, the average number of agents with a heading-bearing correlation of increases at higher target speeds, implying a greater number of stationary agents. At higher speeds, the target is able to evade the agents more easily, causing the agents to spread out across the search area and be “locked” in place when their repulsion strength reaches the maximum limit. The agents remain in this position until they receive new information of the target’s position (see Fig. 2).

Finally, it can be seen that at lower levels of connectivity (), the time averaged number of agents with a heading-bearing correlation of was lower for the homogeneous swarm than that of the heterogeneous swarms. This can be attributed to higher collective response of the heterogeneous swarm at lower levels of connectivity compared to the homogeneous swarm. The difference in the the levels of collective response is further explored in Section III-D.

Iii-C Time on Target

Fig. 4: Tracking performance of a swarm comprised of varying proportions of fast buoys with a degree of .
Fig. 5: Tracking performance of a swarm of buoys comprised of fast agents with varying levels of connectivity, .
Fig. 6: A heterogeneous swarm comprised of 35 BoB-0 units (black crosses) and 15 BoB-1 units (blue crosses) tracking a disc-shaped target (dark blue). (Left) BoB-1 units clustering together; (Right) BoB-1 units distributed throughout the swarm due to the implemented adaptive repulsion behavior.

The plots in Fig. 4 show that the overall tracking performance of the swarm increases with the proportion of fast buoys included within the swarm and is consistent across all levels of connectivity. This result is due to the faster buoys being better able to keep up with and respond to the presence of the fast moving target. However, the benefit of adding upgraded units decreases at higher levels of connectivity. Figure 5 also confirms that, similar to the homogeneous swarm, there exists an optimum degree of connectivity, , at which the tracking performance is at a maximum for the heterogeneous swarm. Beyond this level, higher amounts of connectivity are detrimental to the swarm’s overall tracking performance due to the tendency of the swarm to carry out more exploitative actions, as mentioned in the previous section. Interestingly, this optimum occurs at a lower level of connectivity compared to the one for the slower homogeneous swarm.

In the conducted simulations, despite the randomized starting positions of the buoys, the heterogeneous swarm always showed an improvement in performance over the homogeneous swarm. This implies that, unlike in dynamic area monitoring, the initial placement of the upgraded agents does not play an integral part in improving the swarm’s tracking abilities. Through the visualization of the buoys’ positions, as seen in Fig. 6, it can be observed that although the faster BoB-1 units may at times cluster together, they are eventually able to disperse themselves throughout the swarm. This is due to the implementation of the adaptive repulsion behavior that causes the individual agents within the swarm to have different levels of repulsion at any given time-step. As demonstrated in [28], depending on an agent’s strength of repulsion with respect to its physical neighbours, the agents with different repulsion strengths can move past their neighbors by circumventing them or “sneaking” between them, instead of being locked within a fixed relative position.

Iii-D Cumulative Velocity Fluctuation Magnitude

Fig. 7: Cumulative velocity fluctuation magnitude plot of a swarm of varying proportions of fast buoys with a degree of .
Fig. 8: Cumulative velocity fluctuation magnitude plot of a swarm of buoys comprised of fast agents with varying levels of connectivity, .

As previously explained, the cumulative velocity fluctuation magnitude can be used as a proxy to quantify the level of responsiveness of a swarm to its dynamic environment, and hence the level of swarm intelligence activity. From Fig. 7, it can be seen that from low to intermediate levels of connectivity, the level of responsiveness of the swarm gradually increased with an increasing proportion of faster agents. Similar to the swarm’s tracking performance, this result stems from the upgraded agents’ ability to travel faster. Hence, the upgraded buoys were better able to react to the presence or absence of the target and carry out the necessary exploratory or exploitative actions.

In addition, it can be seen that in both homogeneous and heterogeneous swarms (Fig. 8), there is a peak in the systems’ levels of response at intermediate levels of connectivity. This peak occurs at a lower degree in heterogeneous swarms () than in the homogeneous one (). This is because upgrading a portion of the swarming MRS with faster agents essentially increases the average speed of the swarm. Therefore, even though the environment evolves at the same speed, this evolution occurs at a different time-scale relative to the swarm. By adding faster agents, the swarm needs to readjust its communications channel to adequately and optimally respond to its environment.

It should also be noted that in both homogeneous and heterogeneous swarms, the optimum level of connectivity associated with maximum response is higher than the level of connectivity required for maximum tracking performance. When the swarming agents are connected to provide maximum collective response, a large proportion of the swarm is attracted to the target once it is found. Consequently, there are little to no agents remaining to perform area exploration. As such, the target is eventually able to outrun the tracking agents. Conversely, when the swarm’s communications network is connected to provide maximum tracking performance, there are still agents free to perform exploratory actions. Hence, when the initial group of pursuing agents are outrun, the remaining agents are able to continue tracking the target.

Iv Discussion

The implementation of a swarming MRS in a target search and tracking mission allows for improving the performance of the system, as well as guaranteeing the robustness, scalability, and flexibility. In addition, the modularity of swarming MRS presents the opportunity to incrementally upgrade individual agents, necessitating the use of heterogeneous swarms. In this work, we presented a PSO-based heterogeneous swarm with an adjustable EED, capable of searching for and tracking a target moving faster than any of the individual swarming agents. The EED of the swarm was tuned through the use of an adaptive repulsion behavior along with a PSO-based algorithm using a topological -nearest neighbor network. These behaviors were implemented in simulated models of the BoB swarming buoy system.

The performance and swarm dynamics of the system were calculated through the use of three metrics, namely: the heading-bearing correlation, cumulative velocity fluctuation magnitude, and the percentage of time on target. Through simulations, these metrics provided insights into the swarm’s EED, response to the swarm’s dynamic environment, and the proportion of time where at least one agent is engaged with the target.

Using these metrics, it was observed that the addition of faster buoys within the swarm did not affect the EED of the swarm at all levels of connectivity; increasing the degree for both homogeneous and heterogeneous swarms increased the amount of exploitative actions carried out by the swarming agents while a decrease in resulted in the two swarms favoring area exploitation. The simulations performed were also showed an improvement in the tracking performance of the swarm, regardless of the degree of the swarm’s interconnecting -nearest neighbour network and starting position of the buoys. However, this benefit reduced at higher levels of inter-agent connectivity. In addition, it was revealed that there exists an optimum degree at which the swarm’s tracking performance was at a maximum for both swarms. This optimum degree was found to be lower in heterogeneous swarms than in homogeneous swarms due to the higher levels of system response generated by the heterogeneous swarms at low to intermediate levels of connectivity.

References

  • [1] D. S. López, G. Moreno, J. Cordero, J. Sanchez, S. Govindaraj, M. M. Marques, V. Lobo, S. Fioravanti, A. Grati, K. Rudin, M. Tosa, A. Matos, A. Dias, A. Martins, J. Bedkowski, H. Balta, and G. D. Cubber, “Interoperability in a Heterogeneous Team of Search and Rescue Robots,” Search and Rescue Robotics - From Theory to Practice, pp. 93–125, 2017.
  • [2] R. A. Coogle and A. M. Howard, “The iceberg observation problem: Using multiple agents to monitor and observe ablating target sources,” in Proceedings - 2013 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2013.   Manchester, United Kingdom: IEEE, 2013, pp. 1660–1665.
  • [3] Y. C. Tan and B. E. Bishop, “Evaluation of robot swarm control methods for underwater mine countermeasures,” in Proceedings of the Thirty-Sixth Southeastern Symposium on System Theory, Atlanta, GA, USA, 2004, pp. 294–298.
  • [4] M. Meghjani, S. Manjanna, and G. Dudek, “Multi-target rendezvous search,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’16), Daejeon, South Korea, 2016.
  • [5] T. Sousselier, J. Dreo, and M. Sevaux, “Line formation algorithm in a swarm of reactive robots constrained by underwater environment,” Expert Systems with Applications, vol. 42, no. 12, pp. 5117–5127, 2015.
  • [6] M. Senanayake, I. Senthooran, J. C. Barca, H. Chung, J. Kamruzzaman, and M. Murshed, “Search and tracking algorithms for swarms of robots: A survey,” Robotics and Autonomous Systems, vol. 75, pp. 422–434, 2016.
  • [7] C. Coquet, C. Aubry, A. Arnold, and P.-j. Bouvet, “A Local Charged Particle Swarm Optimization to Track an Underwater Mobile Source,” in OCEANS 2019 - Marseille.   Marseille, France: IEEE, 2019.
  • [8] H. L. Kwa, J. L. Kit, and R. Bouffanais, “Optimal swarm strategy for dynamic target search and tracking,” in Proc. of the 19th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2020), Auckland, New Zealand, 2020, pp. 672–680.
  • [9] M. S. Couceiro, R. P. Rocha, and N. M. Ferreira, “A Novel Multi-Robot Exploration Approach based on Particle Swarm Optimization Algorithms,” in 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.   Kyoto, Japan: IEEE, 2011, pp. 327–332.
  • [10] J. Yang, X. Wang, and P. Bauer, “Extended PSO Based Collaborative Searching for Robotic Swarms With Practical Constraints,” IEEE Access, vol. 7, pp. 76 328–76 341, 2019.
  • [11] R. Bouffanais, Design and Control of Swarm Dynamics, ser. SpringerBriefs in Complexity.   Heidelberg, Germany: Springer, 2016.
  • [12] J. Leong Kit, A. G. Dharmawan, D. Mateo, S. Foong, G. S. Soh, R. Bouffanais, and K. L. Wood, “Decentralized Multi-Floor Exploration by a Swarm of Miniature Robots Teaming with Wall-Climbing Units,” in 2019 International Symposium on Multi-Robot and Multi-Agent Systems (MRS).   New Brunswick, NJ, USA: IEEE, 2019, pp. 195–201.
  • [13] Y. Altshuler, “To Add With Caution — Decreasing a Swarm Robotics’ Efficiency by Imprudently Enhancing the Robots’ Capabilities,” in ICARA 2009 - Proceedings of the 4th International Conference on Autonomous Robots and Agents.   Wellington, New Zealand: IEEE, 2009, pp. 351–356.
  • [14] F. Vallegra, D. Mateo, G. Tokić, R. Bouffanais, and D. K. P. Yue, “Gradual Collective Upgrade of a Swarm of Autonomous Buoys for Dynamic Ocean Monitoring,” in IEEE-MTS OCEANS 2018, Charleston, SC, USA, 2018.
  • [15] L. Strickland, K. Baudier, K. Bowers, T. P. Pavlic, and C. Pippin, “Bio-inspired Role Allocation of Heterogeneous Teams in A Site Defense Task,” in Distributed Autonomous Robotic Systems 2018.   Boulder, CO, USA: Springer International Publishing, 2018.
  • [16] F. V. Nepomuceno and A. P. Engelbrecht, “A Self-adaptive Heterogeneous PSO for Real-Parameter Optimization,” in

    2013 IEEE Congress on Evolutionary Computation

    .   Cancún, Mexico: IEEE, 2013, pp. 361–368.
  • [17] X. Ma and H. Sayama, “Hierarchical heterogeneous particle swarm optimization: algorithms and evaluations,” International Journal of Parallel, Emergent and Distributed Systems, vol. 31, no. 5, pp. 504–516, 2016.
  • [18] A. R. Jordehi, “Particle Swarm Optimisation for Dynamic Optimisation Problems: A Review,” Neural Computing and Applications, vol. 25, pp. 1507–1516, 2014.
  • [19] K. Hussain, M. N. M. Salleh, S. Cheng, and Y. Shi, “On the exploration and exploitation in popular swarm-based metaheuristic algorithms,” Neural Computing and Applications, vol. 31, no. 11, pp. 7665–7683, 2019.
  • [20] T. Blackwell and J. Kennedy, “Impact of communication topology in particle swarm optimization,” IEEE Transactions on Evolutionary Computation, vol. 23, no. 4, pp. 689–702, 2018.
  • [21] D. Mateo, N. Horsevad, V. Hassani, M. Chamanbaz, and R. Bouffanais, “Optimal Network Topology for Effective Collective Response,” Science Advances, vol. 5, no. 4, p. eaau0999, 2019.
  • [22] D. Mateo, Y. K. Kuan, and R. Bouffanais, “Effect of Correlations in Swarms on Collective Response,” Scientific Reports, vol. 7, no. 10388, 2017.
  • [23] I. Rausch, A. Reina, P. Simoens, and Y. Khaluf, “Coherent collective behaviour emerging from decentralised balancing of social feedback and noise,” Swarm Intelligence, 2019.
  • [24] M. Komareji, Y. Shang, and R. Bouffanais, “Consensus in topologically interacting swarms under communication constraints and time-delays,” Nonlinear Dynamics, vol. 93, pp. 1287–1300, Apr 2018.
  • [25] J. Kennedy and R. Eberhart, “Particle Swarm Optimization,” in

    Proceedings of ICNN’95 - International Conference on Neural Networks

    .   Perth, WA, Australia: IEEE, 1995, pp. 1942–1948.
  • [26] B. J. Leonard, A. P. Engelbrecht, and A. B. van Wyk, “Heterogeneous Particle Swarms in Dynamic Environments,” in 2011 IEEE Symposium on Swarm Intelligence.   Paris, France: IEEE, 2011.
  • [27] A. Sekunda, M. Komareji, and R. Bouffanais, “Interplay between signaling network design and swarm dynamics,” Network Science, vol. 4, no. 2, pp. 244–265, 2016.
  • [28] B. M. Zoss, D. Mateo, Y. K. Kuan, G. Tokić, M. Chamanbaz, L. Goh, F. Vallegra, R. Bouffanais, and D. K. P. Yue, “Distributed system of autonomous buoys for scalable deployment and monitoring of large waterbodies,” Autonomous Robots, vol. 42, no. 8, pp. 1669–1689, 2018.
  • [29] A. Cavagna, A. Cimarelli, I. Giardina, G. Parisi, R. Santagati, F. Stefanini, and M. Viale, “Scale-free correlations in starling flocks,” Proceedings of the National Academy of Sciences, vol. 107, no. 26, pp. 11 865–11 870, 2010.
  • [30] A. Attanasi, A. Cavagna, L. Del Castello, I. Giardina, S. Melillo, L. Parisi, O. Pohl, B. Rossaro, E. Shen, E. Silvestri et al., “Collective behaviour without collective order in wild swarms of midges,” PLoS Comput. Biol., vol. 10, no. 7, p. e1003697, 2014.