The use of autonomous mobile sensors is becoming increasingly common in civilian and military applications, since they can provide support in tasks that are too dangerous, too expensive, or too difficult for humans to perform unaided. Tasks that can benefit from autonomous sensors include search and rescue, forest fire or oil spill monitoring, surveillance and reconnaissance, transportation and logistics management, and hazardous waste cleanup [1, 2, 3]. These applications require intelligent and practical strategies to govern autonomous behavior in the presence of numerous constraints that arise in realistic missions.
This article considers a particular mobile sensor scenario that is of interest, e.g., in military operations , where a single fixed-wing Unmanned Aerial Vehicle (UAV) collects visual sensor data within a large geographic environment. Here, the UAV is equipped with a gimbaled camera, and must provide surveillance imagery of multiple static ground targets, each having associated imaging constraints. These pre-specified constraints include (i) a desired tilt angle with tolerances, (ii) a desired azimuth with tolerances, including the option of a 360-degree view, and (iii) the amount of time that the UAV should dwell before moving to the next target. The goal is to construct flight paths that are optimal in some sense, while simultaneously allowing each target to be imaged with the prescribed specifications.
Ideally, we seek flight paths that simultaneously minimize two metrics: (i) the time required for the UAV to image all targets and return to the initial target, and (ii) the delay between the mission onset and the time the UAV reaches its first target. The latter goal is important because sensory data often plays a crucial role in the dynamic development of mission strategies, i.e., mission critical planning often cannot progress until some sensory information is provided. This is true, for example, in reconnaissance missions where sensory data supports the operations of a manned aircraft, e.g. . Thus, it is often important that initial imagery is provided quickly, even if at the expense of total tour duration.
Since these two objectives are conflicting in general, we construct solutions by constraining the second performance metric and optimizing over the first. This is a standard scalarization approach for addressing multi-objective problems, since solutions of the constrained problem allow for the construction of Pareto-optimal fronts . We develop a discrete-approximation strategy for constructing high-quality solutions to the scalarized problem, naturally leading to a complete heuristic framework for the full, multi-objective mission. This approach produces reasonable flight paths within a modular framework, while also leveraging existing solution strategies to classical routing problems to ensure straightforward, effective, practical implementation.
Specifically, the contributions of this article are as follows. First, we show how the multi-objective routing problem with both visibility and dwell-time constraints can be posed as a constrained optimization problem through reasonable assumptions about UAV trajectories and dwell-time maneuvers. Indeed, we define visibility regions at each target that reflect imaging requirements, along with a set of feasible dwell-time maneuvers, which are performed within the regions, that both accommodate the dynamic constraints of the UAV and are intuitively straightforward. These constructions are then translated into a constraint set and incorporated into a precise problem statement, which represents an -constraint scalarization of the multi-objective problem.
Then, we illustrate how the constrained optimization problem, having an infinite solution space, is approximated by a discrete problem, having a finite solution space. This discrete approximation implicitly considers both the time required for appropriate dwell-time maneuvers and the visibility constraints, as it is formulated through a selective sampling procedure. Namely, the UAV configuration space is carefully sampled to obtain a discrete set whose elements are each paired with a feasible dwell-time trajectory. Elements of this set form the nodes of a graph whose edge weights are defined via an augmented Dubins distance that incorporates required dwell-times. The discrete approximation is defined as an optimal path-finding problem over the resultant graph.
Next, we present a novel heuristic method for solving the discrete approximation that leverages solutions to standard Generalized Traveling Salesperson Problem (GTSP) instances. We show that our heuristic method produces feasible solutions and, in many cases, maps optimal solutions of a GTSP directly to optimal solutions of the discrete problem.
Finally, we incorporate these constructions into a complete heuristic framework to produce high-quality solutions to the full, multi-objective routing problem. We prove that the heuristic is resolution complete in a specific mathematical sense, and finish by illustrating our methods numerically.
We note that our work is most closely related to that of , which uses a similar sampling-based framework in order to address a Polygon-Visiting Dubins Traveling Salesperson Problem (PVDTSP). However, the framework in  considers a single performance metric (total tour time), and cannot incorporate non-trivial UAV dwell-time behaviors. As such, our work is, in some sense, an expansion of  to incorporate a more general set of geometric and temporal imaging behaviors, and accommodate an additional performance metric that is reflective of realistic mission scenarios. In fact, the more general solution framework herein reduces to that of  in particular cases (Remark 3).
2 Related Literature
A large amount of recent research focuses on the development of coordination strategies for UAV applications (e.g. [8, 9, 10, 11]). However, UAV research is a sub-class of a much larger body of literature that addresses algorithmic design and high-level reasoning for general mobile sensor applications [12, 13]. These applications often necessitate solutions to complex routing problems, which may involve logical, temporal, and spatial constraints, as well as environmental uncertainty. When construction of global optima is not feasible, heuristics are often used to permit the real-time construction of solutions for use within practical systems. For example, variations on the classic Traveling Salesperson Problem (TSP) [14, 15, 16] arise frequently and, since the TSP is NP-hard, global optima usually cannot be consistently found in reasonable time. However, several new insights have been developed over the last decade for the classical TSP, along with a number of variations [17, 18, 19], and sophisticated heuristic solvers, e.g.  can quickly construct high-quality solutions for practical use. Other problems that are common in mobile sensor applications include the construction region selection policies [21, 22], the derivation of static and dynamic coverage schemes [23, 24], the development of persistent task execution frameworks , and the design of load balancing strategies [26, 27].
The problem herein is loosely interpreted as a generalization of both the Polygon-Visiting Dubins Traveling Salesperson Problem (PVDTSP) [7, 28] and the Dubins Traveling Salesperson Problem with Neighborhoods (DTSPN) . The PVDTSP and the DTSPN are variations on the classic Dubins TSP (DTSP) that require vehicles to visit a series of geometric regions rather than discrete points. To incorporate explicit imaging constraints within a multi-objective framework, we adopt a strategy that is, in some sense, an extension of , where the authors approximate solutions to a PVDTSP by discretizing regions of interest and posing the resulting problem as a Generalized Traveling Salesperson Problem (GTSP) (also called the Set TSP, Group TSP, (Finite) One-in-a-set TSP, Multiple Choice TSP, or Covering Salesperson Problem). Sampling-based strategies that approximate a continuous motion planning problem with a discrete path-finding problem over a graph are typically called sampling-based roadmap methods [30, Ch. 5]. Such methods are traditionally used for point-to-point planning among obstacles; however, they have also been used for more general Dubins path planning, e.g. .
Like the TSP, the GTSP is a combinatorial optimization; however, strategies exist for computing high-quality solutions. The most popular solution approach converts the GTSP into anAsymmetric Traveling Salesperson Problem (ATSP) via a Noon-Bean transform . The availability of efficient solvers for the ATSP, e.g. LKH , make such transformations a viable GTSP solution option in practice, though they do not produce global optima in general. Other common GTSP solution approaches make use of meta-heuristics, e.g. .
Aside from the explicit visibility and dwell-time constraints, the problem herein differs from typical “TSP-like” problems due to the presence of multiple (potentially conflicting) performance objectives. A vast amount of literature addresses multi-objective optimization problems, some of which focuses on purely mathematical formulations while some targets solutions for particular applications [34, 35, 36]. Solution approaches typically seek to satisfy a pre-determined notion of optimality, the most common being Pareto optimality. Pareto-optimal fronts are usually difficult to characterize directly, so they are typically constructed using scalarization methods, which reduce the multi-objective problem to a single-objective problem whose optimal solutions map to Pareto-optimal solutions with respect to the original problem. The most common scalarization techniques are linear scalarization, where the cost is a linear combination of the objectives, and -constraint method, where the values of all but a single objective are explicitly treated as optimization constraints .
Our approach to the present problem uses an -constraint method that treats the initial UAV maneuver time as an explicit optimization constraint. In general, no single approach to multi-objective optimization is always superior; the appropriate method depends on the type of information available, the user’s preferences, solution requirements, and the availability of software . We choose the -constraint method since it (i) is a standard approach to multi-objective optimization, (ii) gives explicit flexibility in the degree to which the initial maneuver time is considered, allowing the approach to be easily tailored to specific mission scenarios, (iii) allows for a heuristic solution procedure that is naturally modular and can leverage solutions to standard routing problems, (iv) promotes straightforward approximation of Pareto-optimal fronts by varying scalarization parameters, and (v) is straightforward and intuitive, making it an attractive approach to both practitioners and theoreticians alike.
3 Problem Formulation
3.1 UAV Specifications
Consider a single fixed-wing UAV, equipped with a GPS location device and a gimbaled, omnidirectional camera. The camera is steered by a low-level controller, which is independent of the vehicle motion controller. For simplicity, we neglect the possibility of camera occlusions. The work herein focuses on high-level UAV trajectory planning, rather than low-level vehicle or camera motion control. We consider planar motion in a global, ground-plane reference frame, assuming the UAV maintains a fixed altitude and a fixed speed . We model the UAV as a Dubins vehicle  with minimum turning radius , neglecting dynamic effects caused by wind, etc. Let denote the UAV’s initial configuration (location, heading).
3.2 Target Specifications
Consider static targets, each with associated imaging, i.e., visibility and dwell-time, requirements. Each target is associated with the following (fixed) parameters:
, the location of the target in the ground-plane reference frame,
, the required viewing behavior, where ANY indicates no preference for the azimuth of the collected images, ANGLE indicates that the target should be imaged at a specific azimuth, and FULL indicates that a 360-degree view of the target should be provided,
, a range of acceptable azimuths when , as measured with respect to a reference ray in the ground plane (Fig. 1, top),
, acceptable camera tilt angles as measured with respect to a plane parallel to the ground-plane (Fig. 1, bottom), and
, the required number of dwell-time “loops.”
Define the visibility region, , for target as the set of locations from which the UAV is able to image the target with an acceptable tilt angle and azimuth (that is, a tilt angle within the interval and, if , an azimuth within the interval ; if , then any azimuth is acceptable). Each is uniquely defined by the UAV altitude , the location , the behavior , and the intervals , . Algorithm 1 presents the methodology for constructing visibility regions. Note that, if , then is a full annulus centered at ; otherwise, is an annular sector (Fig. 2).
As such, fixing target locations, each visibility region is parameterized by two radii (lower, upper radial limits) together with two angles (lower, upper angular limits).
The variable indicates the number of dwell-time “loops” that are required at the target . If , then the UAV accomplishes its task by passing over any point within . If , i.e., non-trivial dwell time is specified, assume the UAV images as follows: If , the UAV makes full circles around the target location at some constant radius; if , then the UAV selects a pivot point within and makes circles about the selected point at radius . Each non-trivial dwell-time maneuver must be performed entirely within the appropriate visibility region. Fig. 3 shows examples of acceptable imaging behavior for various choices of and .
For the remaining analysis, we assume that imaging parameters are chosen to ensure problem feasibility, i.e., there exists at least dwell-time maneuver at each target satisfying the aforementioned constraints.
Remark 1 (Feasibility)
Feasibility is always ensured if tolerance parameters are sufficiently large.
3.3 Problem Statement
The goal is to construct an optimal UAV trajectory with the following characteristics: The UAV begins its tour by moving from its initial configuration to a configuration where it can begin imaging a target and, after the initial maneuver, the UAV follows a closed trajectory, along which it images each target according to the required specifications. Note that by separating the initial maneuver from the remaining closed route, we ensure that the target imaging behavior can be effectively repeated if desired. Recall the performance metrics to be minimized: (i) the time required for the UAV to traverse the closed portion of the generated trajectory (beginning and ending at the first target), and (ii) the time required for the UAV to perform its initial maneuver, i.e., move from to the starting point of the closed portion. Since the metrics are conflicting in general, a tradeoff must be made. We consider the following formulation of the route-finding problem.
Problem 1 (Optimal UAV Tour)
Find a UAV tour (consisting of an initial maneuver, and a closed trajectory) that solves the following optimization problem:
where is a constant parameter.
Remark 2 (Scalarization)
The optimization problem (1) is an -constraint scalarization of the multi-objective problem. A typical alternative scalarization would instead account for the initial maneuver time within a linear objective: where , are constant parameters. For fixed , this alternative formulation is equivalent to (1) for some choice of . Further, parameter selection and subsequent solution of the linear alternative typically requires construction of a Pareto optimal front by solving instances of (1).
Remark 3 (Relation to )
If (i) is large (the initial maneuver is inconsequential), and (ii) for all (dwell-times are trivial), then solving Problem 1 is equivalent to solving a Polygon-Visiting Dubins Traveling Salesperson Problem, as in . Our methods are loosely based on , though we consider a more general multi-objective framework that also incorporates non-trivial dwell-times.
4 Discrete Approximation
Problem 1, which explicitly considers all target imaging constraints, has an infinite number of potential solutions and is difficult to solve. However, by carefully sampling the UAV configuration space, we can pose a finite, discrete alternative whose optimal solutions approximate those of the original problem. The discrete approximation is still a combinatorial search; however, it is closely related to standard path-finding problems, allowing us to leverage existing solvers to produce high-quality sub-optimal solutions. This section develops the discrete approximation of interest.
4.1 Configuration Space Sampling
Recalling the Dubins model, we sample the UAV configuration space to obtain a finite collection of points of the form . These points serve as the basis for the discrete approximation to Problem 1. Specifically, we choose a set of points that each represent the starting and ending configuration of an appropriate dwell-time “loop” at some target (valid dwell-time maneuvers each start and end at the same configuration). That is, each sampled point has heading that points in a direction tangent to a valid dwell-time loop (associated with some target ) passing through the location (Remark 4). By explicitly pairing each with its target , this procedure creates a natural one-to-one mapping between the generated points and a set of feasible dwell-time maneuvers. As such, subsequent graph formulations can “disregard” dwell-time constraints by using an augmented graph distance. Fig. 4 shows examples of valid sampled sets associated with some , for various and values. Here, the red dot is the sampled point’s location and the arrow represents its heading (distinct points can have the same planar location).
Algorithm 2 outlines the sampling process. Here, each set is defined thusly: If , let be the set of points having location that lies on the circular image of an appropriate dwell-time maneuver and heading that points in a direction tangent to the same circular image at . If , let . Notice Algorithm 2 allows multiple “copies” of the same configuration be sampled, provided each is associated with a distinct target, i.e., there may exist with identical locations and headings so long as .
Remark 4 (Dwell-Time Loops)
It is possible that some is tangent to multiple, distinct dwell-time loops associated with . Notice that all such loops have identical radii, i.e., the UAV requires the same amount of time to traverse each. Thus, we can assume without loss of generality that each is the starting and ending configuration of a single loop associated with .
4.2 Graph Construction
Algorithm 2 returns a discrete set , where each represents a point in the UAV configuration space that is the starting and ending point of a valid dwell-time maneuver at . Recalling that the optimal Dubins path between any two configurations is well defined (and easily computed) , we utilize Algorithm 3 to construct a weighted, directed graph that effectively discretizes the solution space of Problem 1. Here, the edge set contains directed edges connecting each pair of nodes in , along with directed edges connecting the initial UAV configuration with each node in . Weights are defined via an augmented distance that includes both the time required to complete the dwell-time maneuver at the source node and the time required to travel between configurations (recall that optimal Dubins paths are asymmetric in general). We are now ready to formally define the discrete approximation to Problem 1 using the graph .
Problem 2 (Discrete Approximation)
Consider the graph resulting from Algorithm 3. Find a sequence that solves
where corresponds to the initial UAV configuration and is a constant parameter.
5 UAV Tour Construction
Notice that solutions to Problem 1 can be recovered from solutions to Problem 2. Indeed, given a solution to (2), we recover a feasible solution to (1) by: (i) concatenating the optimal Dubins paths between adjacent nodes in the sequence (appending the path from to at the beginning and the path from with at the end) and (ii) appending the dwell-time trajectory associated to each node . The remainder of our analysis studies the discrete approximation (Problem 2) and its relation to the continuous formulation (Problem 1).
5.1 Solving the Discrete Problem
We leverage solutions of a classic graph path-finding problem to construct solutions to (2). In particular, we propose a heuristic framework that relates solutions of (2) to those of an (asymmetric) Generalized Traveling Salesperson Problem (GTSP), which is defined for convenience here.
Problem 3 (Gtsp)
Given a complete, weighted, directed graph , and a family of finite, non-empty subsets , find a minimum weight, closed path that visits exactly one node from each subset .
Remark 5 (GTSP Formulation)
A common alternative GTSP formulation requires the closed path to visit at least one node from each . If edge weights satisfy a triangle inequality, then this alternative and Problem 3 are identical. In what follows, we define GTSP instances on a complete subgraph , where is the graph constructed in Algorithm 3. In this case, edge weights in represent an augmented Dubins distance and, since the Dubins distance function satisfies a triangle inequality , edge weights in also satisfy a triangle inequality. Thus, we consider Problem 3 without loss of generality.
Remark 6 (GTSP Solutions)
The standard GTSP is NP-hard. However, practical strategies exist for quickly constructing high-quality solutions, e.g., transformation of the problem into a standard ATSP and application of a heuristic solver (see Section 2).
Note that, in general, Problem 2 is not equivalent to a GTSP, due to the constraint on the initial maneuver. We can, however, leverage GTSP solution procedures in constructing solutions to the constrained problem. Indeed, a heuristic procedure for constructing solutions to Problem 2 using the solutions to related GTSP instances is outlined in Algorithm 4.
Here, denotes the set of all nodes in that can be reached from in time less than . In general, the sequences produced by Algorithm 4 will not be optimal with respect to Problem 2. They will, however, be feasible. Further, if has a particular structure, then the subset (see Algorithm 4) can be chosen to ensure that the GTSP instance (line ) is equivalent to Problem 2. The following results make this discussion precise.
The GTSP solution (line ) will contain some . Thus, the permutation operation in line will produce with . It follows readily that the algorithmic output is feasible with respect to Problem 2
Remark 7 (Feasibility)
Theorem 1 does not require construction of an optimal GTSP solution, i.e., the result holds as long as any feasible GTSP solution is produced in line .
Theorem 2 (Equivalence)
Consider Algorithm 4. Suppose is nonempty and that there exists an index satisfying either:
If (line 3) is chosen as the set of all nodes in that are associated with , then optimal solutions of the GTSP in line 5 map to those of Problem 2 via the operation in line . That is, if a globally optimal solution to the GTSP in line 5 is produced, then the output of Algorithm 4 is a globally optimal solution to Problem 2.
Any solution to Problem 2 must contain exactly one node associated to each target, where . If only contains nodes associated to (condition (i)), then no feasible solution to Problem 2 contains any with . Thus, there is no loss of generality in considering the GTSP defined over the modified graph when (as opposed to defining a GTSP over the subgraph induced by ). The same applies when satisfies condition (ii) and equals the set of all nodes associated with , as this implies . Since cyclic permutation of the node sequence does not affect the cost, any optimal solution to the GTSP in line can be mapped to an optimal solution of Problem 2 via the operation in line . Figure 5 shows a graphical illustration of when the theorem conditions are met. We note that the conditions required by Theorem 2 are typically met whenever target spacing is large.
5.2 Complete Tour Construction
Solutions produced by Algorithm 5 are not optimal in general, though they will exhibit structural characteristics that generally improve in quality (with respect to Problem 1) as the sampling granularity is made increasingly fine. Indeed, Algorithm 5 is a resolution complete in some sense, providing justification for the sampling-based approximation approach. A precise characterization of the resolution completeness properties is included as an Appendix.
6 Numerical Examples
We illustrate our algorithms through numerical examples. For each simulated mission, solutions to Problem 1 are constructed via Algorithm 5, where GTSPs are solved through transformation into an equivalent ATSP (see ) that is subsequently solved using the Lin-Kernighan heuristic (as implemented by LKH ). In all cases, the set (Algorithm 4) is chosen as the set of all points in associated with some single target (satisfying Theorem 2 conditions whenever possible). A slightly modified version of Algorithm 2 is used for sampling in which the number of samples, , associated with each target is not fixed a priori, but instead is determined by creating a grid of samples within the appropriate sampling subsets. The grid spacing is determined by parameters , , and , which represent, loosely, the radial location spacing, the angular location spacing, and the angular heading spacing, resp. The parameters , , and are inversely proportional to the number of samples at each target, and the sampled set is dense in the limit as spacing parameters jointly tend to .
6.1 Pareto-Optimal Front
The first example is a target mission with the following UAV parameters: m, m, m/s, and . Target parameters are shown in Table 1 (tolerances are large enough for feasibility).
The approximate Pareto-optimal front (with respect to ) for Problem 1 as a function of the sampling granularity is shown in Figure 6. The figure also shows illustrations of solutions produced at spacing condition 5 when s (left) and s (right). Recalling that (i) Theorem 2 does not hold for all , and (ii) heuristic solvers for GTSPs do not guarantee global optima, to obtain the best approximation of the Pareto-optimal front, the following steps were taken to generate each curve: First, Algorithm 5 was called for a series of values, and the resulting initial maneuver/closed trajectory times were recorded. Then, in post-processing, the approximate Pareto-optimal curve was generated by selecting, for each , the lowest cost route satisfying the initial maneuver constraint out of the solutions produced in the computation stage. Note that increasing corresponds to relaxing the initial maneuver constraint, and thus the cost is non-increasing in . Notice also that the Pareto-optimal fronts shift toward zero as the sampling spacing is decreased.
Remark 8 (Pareto-optimal Fronts)
The optimal cost value in Problem 1 is only sensitive to changes in over some finite set that depends primarily on the target and UAV locations. This structure can be exploited for more efficient computation of Pareto-optimal fronts.
The next example illustrates the performance of Algorithm 5 in comparison to an incremental, “greedy” alternative that operates as follows: Visibility region creation and configuration space sampling are done using Algorithms 1 and 2. Starting with the initial UAV configuration, each successive UAV destination is chosen by selecting the closest node (Dubins distance) associated with a target that has not yet been imaged. A valid route is constructed by appending dwell-time maneuvers and connecting the last selected configuration () with the first (). We consider a target mission with the same UAV parameters and the same target locations, imaging behaviors, and tolerances as in the previous example. However, we vary the number of dwell-time loops associated with each target (assume each target requires same number of loops).
The difference between the closed trajectory times produced by the greedy method and those produced by Algorithm 5 as a function of under the spacing condition (Fig. 6) is shown in Fig. 7. Notice that the relative performance of Algorithm 5 improves as both and the number of dwell-time loops at each target are increased. In this example, the performance of the greedy search method can be made arbitrarily poor by increasing the number of dwell-time loops. This result is primarily due to targets that require a 360-degree view, since the greedy heuristic generally chooses those points lying on the perimeter of the visibility region, which are very far from the target location. Thus, increasing the number of dwell-time loops (performed at constant radius) can dramatically increase total tour times. As such, Algorithm 5 can provide a significant advantage over similar incremental planning strategies when non-trivial dwell-times are required.
6.3 Resolution Completeness
To illustrate the resolution completeness properties, consider a mission with targets whose relevant data is in Table 3. The UAV has the same altitude, velocity, and minimum turning radius as the UAVs in the previous examples, but has initial configuration .
This example has been carefully constructed so that the optimal solution is easily deduced for select conditions. In particular, when s, the optimal tour involves the UAV making an immediate left turn at minimum radius, and then visiting the remaining target for a total closed tour length of s. When s, the UAV is constrained to make a shorter initial maneuver, so the UAV travels straight until it hits the visibility region, and then proceeds with the remainder of the tour for an optimal closed tour length of s. A schematic showing optimal routes for the two conditions just described is shown in the top left portion of Fig. 9. (the red curve corresponds to the initial turn for the s case; the remainder of the route is identical). When s, the problem instance is non-degenerate (Definition 4) and satisfies the conditions required for resolution completeness (Theorem 3). Therefore, if a reasonable sampling method and GTSP solver are used, the solutions produced by Algorithm 5 will tend toward the global optimum with finer sampling. This behavior is illustrated by the top right plot in Figure 9, which shows the relative error between the cost produced via Algorithm 5 and the globally optimal cost (difference divided by the optimum) for the sampling conditions listed in the table when s. Notice that the relative error tends to zero with finer discretization. Also note that, for this example, the optimal solution to the discrete approximation involved vertices located on visibility region boundaries, resulting in an insensitivity to radial grid spacing. In contrast, when s, the problem becomes degenerate, since there is a single configuration to which the UAV can travel in order to satisfy the bound. In this case, Problem 2 is infeasible for any sampling scheme that does not choose the precise configuration in question. Therefore, Algorithm 5 is not resolution complete in the sense of Theorem 3 when . Note, however, that resolution completeness holds if is increased by any arbitrarily small positive amount.
A novel algorithmic framework was presented for constructing unmanned aerial vehicle trajectories for surveillance of multiple targets. Adopting reasonable constraints on optimal dwell-time behavior and UAV maneuvers, the framework works to balance mission goals, namely, the closed trajectory and the initial maneuver times, while simultaneously accommodating both viewing and dwell-time constraints associated with each target. In particular, an -constraint scalarization method is applied to rigorously pose the multi-objective problem as a constrained optimization, which is then approximated by a finite, path-planning problem that results from careful sampling of the UAV configuration space. Solutions to related GTSP problems can then be utilized to construct solutions to the discrete approximation which, in many cases, map directly to globally optimal solutions of the discrete problem. These solutions were then mapped to solutions of the continuous problem. It was shown that, under certain conditions, the complete heuristic procedure is resolution complete in the sense that solution quality generally increases with increasingly fine sampling.
Avenues of future research include the expansion to the multi-vehicle case, explicit comparisons with other routing schemes (e.g., Markov chain-based schemes), and an investigation of alternative discretization strategies. In addition, incorporation of uncertain dwell-times and the explicit pairing with other facets of complex missions, e.g. operator analysis of imagery, should be explored.
Appendix: Resolution Completeness of Algorithm 5
We start with some preliminary notions. For this appendix, we assume that all angles are equivalently represented as points on the unit circle via the relation . As such, we assume without loss of generality that the UAV configuration space is . Recall that is defined as the set of configurations from which a UAV can begin executing a feasible dwell-time maneuver at . We first parameterize the set of UAV routes that can be produced by Algorithm 5.
Definition 1 (Initial Maneuver Set)
The parametrized initial maneuver set, , is defined
where is the time required for the UAV to traverse the optimal Dubins path from to .
Note that we have re-defined as the continuous analog of the discrete set of Section 4.
Definition 2 (Closed Trajectory Set)
The parametrized closed trajectory set, , is defined
where is the set of all permutations of .
Notice that we can map each to a feasible solution of Problem 1 by (i) appending the initial configuration , (ii) constructing optimal Dubins routes between successive nodes (connecting to ), and (iii) appending dwell-time maneuvers. Strictly speaking, such a mapping is not unique, since, for some , there may exist that is the starting configuration for multiple distinct dwell-time maneuvers (associated to the same target). However, recalling Remark 4, this ambiguity is inconsequential to the present analysis and we can assume without loss of generality that, for each , the correspondence between and the set of dwell-time maneuvers at is bijective. Under this assumption, any optimal solution to Problem 1 is uniquely associated with some element in the set via the mapping just described. With this in hand, we now assign an appropriate cost to each element of .
Definition 3 (Cost)
Define the map where is the time required for the UAV to traverse the closed trajectory (beginning at ) that sequentially touches and performs the dwell-time maneuver associated with all vertices .
For each , the length of an appropriate dwell-time maneuver varies continuously as a function of the maneuver’s starting configuration (element in ). As such, results in  imply that (i) the map LGTH is well-defined and continuous except on a finite set of -dimensional smooth surfaces embedded in , and (ii) in the limit from one side of each discontinuity surface, LGTH is continuous up to and on the surface. The presence of discontinuity sets necessitates the following definition. Here, .
Definition 4 (Degeneracy)
An instance of Problem 1 is called degenerate if, for every sequence such that and exists, the limit either (i) is not contained in , (ii) belongs to a discontinuity set of LGTH, or (iii) has a first component (corresponding to the starting point of the closed trajectory) that is isolated in the set .
Finally, we introduce dense sampling procedures.
Definition 5 (Dense Sampling Procedure)
Suppose that, for each , a set is sampled times to form a discrete subset , i.e. for each . Such a procedure is called a dense sampling procedure if, for any and any open neighborhood of , there exists such that is non-empty for all .
We are now ready to rigorously characterize resolution completeness of Algorithm 5.
Theorem 3 (Resolution Completeness)
Form a sequence , where each element represents the output of a call to Algorithm 5 when: (i) the number of discrete samples at each target is , (ii) (Algorithm 4, line ) is chosen to satisfy the conditions of Theorem 2, and (iii) an optimal GTSP solution is found (Algorithm 4, line ). Then, is a feasible solution to Problem 1 for each , and if a dense sampling procedure is used to generate the discrete node sets at each target, then the length of the tours in the sequence approaches the length of an optimal solution to Problem 1 as .
First note that the notion of resolution completeness described here is well-defined under the specified assumptions. Indeed, if the (non-discrete) set satisfies the necessary assumptions, then the discrete analog always has the properties required for Theorem 2, and can be chosen to exploit the GTSP equivalence when constructing the sequence .
Feasibility of each follows from Theorem 1, and the fact that feasible solutions to Problem 2 map to feasible solutions to Problem 1. Let be a sequence such that . Note that can be represented as a bounded subset in . Invoking the Bolzano-Weierstrass theorem and compactness of , any infinite sequence in contains a subsequence that converges to some point in . Thus, recalling that Problem 1 is non-degenerate, we can assume without loss of generality that exists, is contained in , does not belong to a discontinuity sets of LGTH, and has a first component that is not isolated in . Since the function LGTH is continuous at the point , for any , there exists an open neighborhood of , within which LGTH takes values within of . Since the sampling procedure is dense, for some , there will be a discrete node placed inside of the set for all . Since the GTSP is solved exactly, it follows that for , proving convergence.
Theorem 3 states that, under a non-degeneracy assumption about the problem structure, reasonable implementations of Algorithm 5 will produce solutions that approximate optimal solutions to the full, multi-objective routing problem. Indeed, the resolution completeness property ensures that Problem 2 will be appropriately reflective of Problem 1.
A few final comments are in order. First, note that degenerate problems occur only in very select situations: a degenerate problem instance is made non-degenerate by perturbing target locations by an arbitrarily small amount (example degenerate problem instances for particular cases are shown in ). Thus, the non-degeneracy condition in Theorem 3 is not typically restrictive. Second, if does not satisfy the conditions of Theorem 3, then resolution completeness does not hold in general since Algorithm 4 is not guaranteed to find an optimal solution to Problem 2 (Theorem 2). Nevertheless, the quality of solutions produced by Algorithm 5 generally increase as sampling granularity is made increasingly fine. Finally, it is not generally possible to find optimal solutions to GTSPs. Therefore, the utility of Theorem 3 is its ability to provide intuition about qualitative solution behavior, and to ensure that the discrete method herein is an appropriate approximation.
The authors thank Karl J. Obermeyer of Obermeyer Labs for his insight regarding vehicle routing.
-  Roberts, J., 2006. “Special issue on uninhabited aerial vehicles”. Journal of Field Robotics, 23(3–4).
-  Valavanis, K. P., 2008. Advances in Unmanned Aerial Vehicles: State Of The Art And the Road To Autonomy. Springer.
US Air Force, 2010.
Report on technology horizons, a vision for Air Force Science And
Technology during 2010–2030.
Tech. rep., AF/ST-TR-10-01-PR, United States Air Force.
resources/AF_TechnologyHorizons2010-2030.pdf on Feb. 8, 2016.
-  US Office of the Secretary of Defense, 2005. Unmanned aircraft systems (UAS) roadmap, 2005-2030.
Army, U., 2007.
Attack reconnaissance helicopter operations.
Tech. Rep. FM 3-04.126, Department of the Army (US), Feb.
CDG/fms.html on Dec. 5, 2016.
-  Miettinen, K., 1998. Nonlinear Multiobjective Optimization. Springer.
-  Obermeyer, K. J., Oberlin, P., and Darbha, S., 2012. “Sampling-based path planning for a visual reconnaissance UAV”. AIAA Journal of Guidance, Control, and Dynamics, 35(2), pp. 619–631.
-  Rathinam, S., Sengupta, R., and Darbha, S., 2007. “A resource allocation algorithm for multi-vehicle systems with non holonomic constraints”. IEEE Transactions on Automation Sciences and Engineering, 4(1), pp. 98–104.
-  Kingston, D. B., Beard, R. W., and Holt, R. S., 2008. “Decentralized perimeter surveillance using a team of UAVs”. IEEE Transactions on Robotics, 24(6), pp. 1394–1404.
-  Las Fargeas, J., Kabamba, P., and Girard, A., 2015. “Cooperative surveillance and pursuit using unmanned aerial vehicles and unattended ground sensors”. Sensors, 15(1), pp. 1365–1388.
-  Shaferman, V., and Shima, T., 2015. “Tracking multiple ground targets in urban environments using cooperating unmanned aerial vehicles”. Journal of Dynamic Systems, Measurement, and Control, 137(5), pp. 051010–051010–11.
-  Rabbath, C. A., Su, C. Y., and Tsourdos, A., 2007. “Guest editorial introduction to the special issue on multivehicle systems cooperative control with application”. IEEE Transactions on Control Systems Technology, 15(4), pp. 599–600.
-  Hedrick, J., Basso, B., Love, J., and Lavis, B., 2011. “Tools and techniques for mobile sensor network control”. Journal of Dynamic Systems, Measurement, and Control, 133(2), pp. 024001–024001–7.
-  Gutin, G., and Punnen, A. P., 2007. The Traveling Salesman Problem and Its Variations. Springer.
-  Savla, K., Frazzoli, E., and Bullo, F., 2008. “Traveling Salesperson Problems for the Dubins vehicle”. IEEE Transactions on Automatic Control, 53(6), pp. 1378–1391.
-  Enright, J. J., Savla, K., Frazzoli, E., and Bullo, F., 2009. “Stochastic and dynamic routing problems for multiple UAVs”. AIAA Journal of Guidance, Control, and Dynamics, 34(4), pp. 1152–1166.
-  Malik, W., Rathinam, S., and Darbha, S., 2007. “An approximation algorithm for a symmetric generalized multiple depot, multiple travelling salesman problem”. Operations Research Letters, 35(6), pp. 747–753.
-  Niendorf, M., Kabamba, P. T., and Girard, A. R., 2016. “Stability of solutions to classes of traveling salesman problems”. IEEE Transactions on Cybernetics, 46(4).
-  Alighanbari, M., and How, J. P., 2008. “A robust approach to the UAV task assignment problem”. International Journal on Robust and Nonlinear Control, 18(2), pp. 118–134.
-  Helsgaun, K., 2000. “An effective implementation of the Lin–Kernighan traveling salesman heuristic”. European Journal of Operational Research, 126(1), pp. 106–130.
-  Srivastava, V., Pasqualetti, F., and Bullo, F., 2013. “Stochastic surveillance strategies for spatial quickest detection”. International Journal of Robotics Research, 32(12), pp. 1438–1458.
-  Patel, R., Agharkar, P., and Bullo, F., 2015. “Robotic surveillance and Markov chains with minimal weighted Kemeny constant”. IEEE Transactions on Automatic Control, 60(12), pp. 3156–3167.
-  Younis, M., and Akkaya, K., 2008. “Strategies and techniques for node placement in wireless sensor networks: A survey”. Ad Hoc Networks, 6(4), pp. 621–655.
-  Bullo, F., Frazzoli, E., Pavone, M., Savla, K., and Smith, S. L., 2011. “Dynamic vehicle routing for robotic systems”. Proceedings of the IEEE, 99(9), pp. 1482–1504.
-  Mathew, N., Smith, S. L., and Waslander, S. L., 2015. “Multirobot rendezvous planning for recharging in persistent tasks”. IEEE Transactions on Robotics, 31(1), pp. 128–142.
-  Bullo, F., Carli, R., and Frasca, P., 2012. “Gossip coverage control for robotic networks: Dynamical systems on the space of partitions”. SIAM Journal on Control and Optimization, 50(1), pp. 419–447.
-  Carlsson, J. G., 2012. “Dividing a territory among several vehicles”. INFORMS Journal on Computing, 24(4), pp. 565–577.
-  Obermeyer, K., 2009. “Path planning for a uav performing reconnaissance of static ground targets in terrain”. In AIAA Guidance, Navigation, and Control Conference, pp. 10–13.
-  Isaacs, J., and Hespanha, J. P., 2013. “Dubins traveling salesman problem with neighborhoods: A graph-based approach”. Algorithms, 6(1), pp. 84–99.
-  LaValle, S. M., 2006. Planning Algorithms. Cambridge University Press.
-  Oberlin, P., Rathinam, S., and Darbha, S., 2009. “A transformation for a heterogeneous, multiple depot, multiple traveling salesmen problem”. In American Control Conference, pp. 1292–1297.
-  Noon, C. E., and Bean, J. C., 1991. “A Lagrangian based approach for the asymmetric generalized traveling salesman problem”. Operations Research, 39(4), pp. 623–632.
Snyder, L. V., and Daskin, M. S., 2006.
“A random-key genetic algorithm for the generalized traveling salesman problem”.European Journal of Operational Research, 174(1), pp. 38–53.
-  Marler, R. T., and Arora, J. S., 2004. “Survey of multi-objective optimization methods for engineering”. Structural and multidisciplinary optimization, 26(6), pp. 369–395.
-  Fleming, P. J., Purshouse, R. C., and Lygoe, R. J., 2005. “Many-objective optimization: An engineering design perspective”. In Evolutionary Multi-Criterion Optimization, C. A. C. Coello, A. H. Aguirre, and E. Zitzler, eds. Springer, pp. 14–32.
-  Grundel, D., and Jeffcoat, D., 2004. “Formulation and solution of the target visitation problem”. In Proceedings of the AIAA 1st Intelligent Systems Technical Conference. AIAA 2004-6212.
-  Dubins, L. E., 1957. “On curves of minimal length with a constraint on average curvature and with prescribed initial and terminal positions and tangents”. American Journal of Mathematics, 79, pp. 497–516.