Adaptive Polar Active Contour for Segmentation and Tracking in Ultrasound Videos

03/19/2018 ∙ by Ebrahim Karami, et al. ∙ 0

Detection of relative changes in circulating blood volume is important to guide resuscitation and manage a variety of medical conditions including sepsis, trauma, dialysis and congestive heart failure. Recent studies have shown that estimates of circulating blood volume can be obtained from the cross-sectional area (CSA) of the internal jugular vein (IJV) from ultrasound images. However, accurate segmentation and tracking of the IJV in ultrasound imaging is a challenging task and is significantly influenced by a number of parameters such as the image quality, shape, and temporal variation. In this paper, we propose a novel adaptive polar active contour (Ad-PAC) algorithm for the segmentation and tracking of the IJV in ultrasound videos. In the proposed algorithm, the parameters of the Ad-PAC algorithm are adapted based on the results of segmentation in previous frames. The Ad-PAC algorithm is applied to 65 ultrasound videos captured from 13 healthy subjects, with each video containing 450 frames. The results show that spatial and temporal adaptation of the energy function significantly improves segmentation performance when compared to current state-of-the-art active contour algorithms.



There are no comments yet.


page 3

page 33

page 34

page 37

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

I Introduction

Determination of relative changes in circulating blood volume is important for a variety of acute and chronic medical conditions including hemorrhage from trauma, septic shock, dialysis and volume overload pertaining to congestive heart failure [1, 2, 3, 4, 5]. The estimation of absolute blood volume, while ideal, remains a significant challenge [6]. Recent studies suggest that non-invasive measures such as transverse ultrasound (cross-section area, CSA) of the internal jugular vein (IJV) can be used to detect and monitor relative changes in blood volume [7, 8]. As shown in Fig 1, the CSA of the IJV is dynamic with spatial and temporal variations that can correlate with relative changes in volume status. Short-term variability reflects a variety of factors including blood volume, proximity to the carotid artery, cardiac contractility, respiratory effort and local anatomy. Changes in parameters over the long-term can reflect relative changes in blood volume. Demonstration of short- and long-term CSA variability of a healthy patient sitting at different angles of inclination to simulate relative changes in circulating blood volume is shown in Fig. 2. Accurate segmentation and tracking of the rapidly changing IJV is fundamental to the use of ultrasound to estimate relative changes in blood volume.

Fig. 1: Sample images for IJV images with (a) low brightness, (b) high brightness, (c) fully collapsed, (d) partially missing contour (broken edge), (e) sharp contour (triangular) shape, and (f) non-convex contour shape.
Fig. 2: Temporal variations of IJV csa obtained from manual segmentation of two IJV videos with different CSA variability.

Portable ultrasound, the technology typically used to image the IJV in the acute care setting, does have its limitations. Ultrasound videos are generated at the point of care by clinicians with a broad range of skills which can result in significant variation in image quality. Furthermore, manual segmentation of IJV is a time-consuming task and inappropriate for real-time blood-volume monitoring applications.
Fully automatic segmentation algorithms are an ideal objective; however, they tend to require prior information about the images [9, 10, 11]. More recently, semi-automated segmentation algorithms requiring operator input have become popular in medical image processing [12, 13, 14, 15]. For example, combinatorial graph-cut based algorithms perform the segmentation task by minimizing an energy function to find the minimal energy paths through the vertices that are manually selected by an operator [16, 17, 18]. Unfortunately, graph-cut algorithms suffer from high computational complexity, making them inefficient for real-time frame-by-frame segmentation, and their results are sensitive to variations in image quality - a significant problem in ultrasound imaging.
Similar to graph-cut algorithms, active contours (ACs) segment images via minimization of an energy function; however, their energy function is more flexible than graph-cut based algorithms. This is demonstrated in their ability to adapt to complex shapes and track temporal deformations, making them suitable for real-time monitoring applications in medicine. An additional advantage is that the minimization is performed over a continuous surface, improving the computational complexity over graph-cut based techniques [19, 20, 21, 22, 23]. Unfortunately, these algorithms suffer from the fact that their performance is highly sensitive to the parameters of the energy function and the initial contour, resulting in a limited ability to track topological changes. This limitation was addressed in the geometric deformable AC models based on curve or surface evolution [24, 25, 26]. In these models, the evolution is independent of the parameter selection and topological variations, which makes them more suitable for object tracking; however, they are still unable to detect shape split or merge due to the low quality of ultrasound images.
In general, the performance of AC algorithms also depends on the initial segmentation, and therefore, can be combined with other segmentation algorithms in a coarse-to-fine strategy. The coarse initial segmentation, obtained from another algorithm, provides a rough segmentation which is subsequently refined with an AC algorithm [27, 28]. In [29], the combination of speckle tracking [30] and AC was proposed for the segmentation and tracking of the IJV in which the coarse segmentation obtained from speckle tracking was smoothed with an AC. Unfortunately, speckle tracking fails when the IJV undergoes fast variations, unless the ultrasound machine has a sufficiently high frame rate. This problem was addressed by cascading region growing [31] and AC (RGAC) [32]. Unfortunately, all of these methods continue to fail when the image quality is poor or when a part of the vessel wall is obscured by artifact.
In the case of broken edges, active contours fail to resolve the contours of intersecting objects resulting in leakage. An active shape model (ASM) using a statistical shape model can be used to address the above mentioned problem [33, 34]. Unfortunately, as per Fig. 1, the IJV assumes many different shapes and therefore, ASM is not applicable for the IJV segmentation. Other common approaches, such as Kalman filers, have been proposed for real-time vessel tracking in ultrasound imagery; however, similar to ASM, they require the geometry of the vessel [35].

Segmentation can be viewed and solved as a spatio-temporal three dimensional (3D) segmentation problem with the time (frame index) defined as the 3rd dimension. 3D segmentation algorithms work on frame-by-frame basis using the similarity between regions [36, 37, 38, 39] or by attempting to minimize a 3D AC model [40, 41, 42, 43, 44]. The former methods again require imaging machines with high frame rates so that deformation from one frame to the next one is insignificant. The latter algorithms suffer from (1) significant computational complexity, (2) lower accuracy associated with minimization of a 3D energy function which involves more parameters, and (3) the entire video prior to initiation of segmentation eliminating the possibility of real-time monitoring.

Polar representation of the contour is a useful technique in a variety of medical image processing applications, particularly vessel segmentation, in which the shape of the object is generally convex [45, 46, 47, 48]

. Polar contours sample the object boundary at certain angles, reducing the degree of freedom for each contour point to one. In other words, the contour is evolved only radially, enabling the energy function to be minimized faster and more efficiently than conventional ACs. Several examples include

[45] in which polar edge detection is combined with AC for segmentation of tongue images; [49] incorporated a polar active contour algorithm based on a classic energy function definition for segmentation of intra-vascular ultrasound images; [46] used a polar active contour defined with the external force derived from an energy term based on the area inside the contour; and [50], a variational polar active contour was proposed to inherit the robustness to local minima from Sobolev active contours. Unfortunately, all above mentioned polar AC algorithms are sensitive to image quality and object shape, with each working for a specific subset of image qualities and shapes. These algorithms fail to accurately segment clips across this spectrum, hence the need for an adaptive AC algorithm that accounts for these large variations.
In this paper, a novel adaptive polar AC algorithm (Ad-PAC) is proposed for semi-automatic segmentation and tracking of the IJV videos. This algorithm involves the initial frame being manually segmented by an operator and subsequently serving as the reference for the initial energy function parameters selection. The parameters are then adapted from one frame to the next based on the segmentation results of previous frames. Section II introduces two related state-of-the-art polar AC algorithms; Section III describes the proposed algorithm; Section IV presents the results with comparisons to manual segmentation, traditional AC algorithms, and the two polar AC algorithms of Section II; and the conclusions are presented in Section V.

Ii Related Work

Polar AC Algorithms
Polar representation of the contours reduce the degrees of freedom for each contour point such that the contour can only evolve radially. Each polar contour is sampled at certain angles, as shown in Fig. 3 as a contour with points.

Fig. 3: An example of polar contour with eight contour points.

In general, polar AC algorithms minimize the following energy function:


where is the internal energy of the contour including forces from the contour shape parameters such as curvature () and continuity () defined as


where , are positive real constants. In [51], the curvature and continuity energies at angle are defined as


where is the radial distance at angle . Furthermore, according to [51], is the external Hibernian energy at angle and defined as


where is a positive real constant and is the Hilbert transform of .
To overcome the problem of having shape-dependent constants, variational polar AC models have been proposed in the past[47, 50]. In these models, the energy function has been defined as [50]:


where in the first integral that denotes the area which is bounded by the contour , is the length of , and indicate the intensity and gradient functions, respectively, and is the weight given to boundary information. The -gradient flow of is calculated as [50]:


where denotes the normal of the contour and represents its curvature.

Iii The Proposed Algorithm: Adaptive Polar AC (Ad-PAC)

The proposed algorithm (Ad-PAC) can be categorized as a polar 2D AC where the parameters of the energy function are dynamically and automatically changed according to image quality as well as spatial and temporal variations of the object. Ad-PAC performs the segmentation task on a frame-by-frame basis creating the possibility for real-time applications. The novelties include:

  • Modified energy function: Ad-PAC enables researchers to incorporate many features followed by subsequent removal of weaker features depending on the application. An example of this is the continuity energy functional described in Section III-A - a weak feature for IJV segmentation which was subsequently removed. In this paper, we use six energy terms and derive their gradients in polar coordinates. Furthermore, we modified the energy terms proposed in existing polar ACs. For instance, from (3) one can see that the curvature energy proposed in [51] is not applicable, as in the case of a circular contour because it will result in an energy term equal to zero. This obviously cannot be correct as theoretically the curvature of a circle is the reciprocal of its radius and the curvature of a straight line is zero.

  • Automatic adaptation of the energy function: Ad-PAC automatically adapts the parameters based on the spatial and temporal features of the object as follows:
    1. Spatial parameter adaptation: The parameters of the energy function are selected such that each energy term is optimized and adapted based on local features of objects such as shape and intensity. This makes the proposed algorithm more robust to image artifacts such as shadowing.
    2. Temporal parameter adaptation: In the proposed algorithm, the parameters of the energy function are adapted to temporal variations of the object, such as variations in shape, intensity, and the object area, on a per-frame basis. In conventional ACs, to achieve the best performance, parameters must be optimized for individual frames, a task requiring significant operator intervention. Except for the initialization, Ad-PAC automatically calculates optimized parameters drastically reducing the need for human intervention.

In the following subsections, we discuss these novelties in detail.

Iii-a The Energy Function

In the proposed algorithm, we define the energy function as


where , , , , , and are real positive numbers, and , , , , , and are, respectively, the energy function corresponding to the information in the object curvature, continuity, boundary, variation of the intensity in and out of the contour, intensity on the object contour, and contraction energy.
is the energy term used to control the contour curvature. From (3), one can see that the curvature energy proposed in [51] does not provide a correct result as it takes its minimum value for a circle, where , i.e., it cannot segment the boundaries with less curvature than a circle (e.g., a straight line). In this paper, we extend the curvature energy defined in the Cartesian coordinates, which is applicable to contours with any value of curvature, to polar coordinates as:


where is the number of contour points,

is the vector absolute value, and

is the th point vector defined as


with and being the coordinates of the center of the object in previous frame, respectively, .
is the energy term used to control the distance between contour points and is defined as


This definition is also similar to the continuity energy term used in Cartesian ACs and is different from the simple continuity energy term used in [51].
represents the edge energy in the object boundary though this term has limited value in scenarios with indistinct edges as is often the case in ultrasound imaging. This energy term is defined as


where is the gradient magnitude of the image and is the image intensity at the current frame.
is similar to the variational energy term defined in either variational Cartesian or polar ACs and is defined as


where and are the mean intensities inside and outside of the contour, respectively.
is a proposed energy term which is defined to exploit the information in spatial illumination levels at the object boundary.


where is the reference intensity of the contour obtained from the previous segmented frame
is the energy term that controls the area of the object and is defined as


Iii-B Local Parameterization of the Energy Function

Iii-B1 Overview

A major shortcoming in existing AC algorithms is that they define similar energy terms for all contour points, despite the fact that intensity and shape vary across the region of interest. To overcome this problem, the proposed algorithm weights the energy terms locally. For example, if part of the IJV contour is obscured by shadow then the algorithm assigns smaller weights to the external energy of the points in the shadowed region such that increased emphasis is on the internal energy terms. Similarly, if a part of the contour has a sharp curvature, the algorithm gives a smaller weight to the curvature energy term for points in areas with sharp edges. These small, non-zero weights enable the contour points to have larger curvatures while still contributing to the total energy. Furthermore, regional variations in intensity are incorporated by subdividing the region of interest (ROI) into multiple sectors with each sector containing one contour point and values of and calculated locally as shown in Fig. (4).

Fig. 4: Adaptive polar structure.

After splitting the contour into sectors, the energy function is modified by giving spatial weights to equations (9-14) as:


where , , , , and are the weights given to the energy terms of the th region. Note that is the only remaining energy term which is not spatially adapted.

Iii-B2 Energy Functions in Polar Coordinates

Polar representation is used to derive the energy function in the following sections.

The curvature energy: By substitution of (10) in (16), the curvature energy function is rewritten as


and its gradient with respect to is obtained as


where is an penta-diagonal matrix with its elements defined as


where are the indices of the matrix.

The continuity energy: Similarly, by substitution of (10) in (17), the continuity energy function is rewritten as


and its gradient with respect to is computed as


where is an tridiagonal matrix with its elements defined as


The edge energy: From (18), the gradient of the edge energy with respect to is an vector where


The variational energy: In (19), and can be computed as,


where and are total intensities inside and , respectively, and are obtained as


with and as the areas inside and outside the th sector, respectively, and and are their corresponding areas which can be computed as follows,


where is the maximum radius of the search area. In this paper, is set to be 50 percent larger than the maximum contour radius, , estimated in previous frame.
From (28) and (29), the gradient of and with respect to is computed as,


From (13), (34), (35), (32), and (33), one can find the gradient of with respect to as


where is an bi-diagonal matrix defined as follows,


with defined as


The intensity energy: the gradient of the intensity energy with respect to is an vector , in which its elements are defined as


In this paper, simple iterative gradient descent technique is used to minimize the defined energy function, although due to single-dimentionality of the energy function, faster techniques are also applicable [52]. From equations (22), (25), (27), (36), and (39) the gradient of the total energy function is obtained as


where is all-ones vector. Using (40), the energy function can be iteratively minimized as


where is the estimation of at the th iteration, is the Hadamard vector product, and and are two step size parameters that let the algorithm to converge faster to the equilibrium when the contour point is farther from the center point.

Iii-C Parameter Adaptation

The parameters are adapted to the shape and size of the object and to the local intensities around the contour points of previous frames.

Adaptation of the number of contour points : The first parameter adapted is the number of contour points, , whose optimal value depends on the object size. Adaptation of is important due to large size variations in the contour. For example, when the contour shrinks, the elements of become very small such that some terms can become negative during energy minimization using (41). On the contrary, when the contour expands, the distance between adjacent contour points increases resulting in an inaccurate rough contour. In this paper, we select the number of contour points such that the average spacing between contour points is a constant value while later demonstrating the influence of on the segmentation accuracy. After segmenting each frame, the perimeter of the contour () is computed and used to calculate the number of contour points using


where denotes the smallest integer greater than or equal to , and superscript denotes the frame index. After updating the number of contour points, the contour is re-sampled at angles


where and .
Parameter selection for the curvature energy: If the object boundary around a contour point is sharp, then the gradient of the curvature energy of that contour point is relaxed such that at the equilibrium (total energy minimized) it can approach a value with larger absolute value compared to the points on more smooth parts of the contour. Therefore, in the proposed algorithm, we select the parameters of the th frame, such that at the equilibrium condition for the reference frame (previous frame), all contour points have similar gradient of curvature as


where is defined as the curvature energy of the th frame with the weights and is computed by substituting and in (21). Using (22) and (23), (44) can be rewritten as


where the elements of are calculated using equation (23) for the th frame. Note that equation (45) is NP-hard, but we can find an approximate closed form solution as follows. The th row of the matrix equation in (45) is


By assuming that the local parameters do not rapidly change, i.e., , (46) is simply as


where is a very small number to avoid zero at the denominator. Note that with this parameter selection, (44) is approximately satisfied.

Parameter selection for the continuity energy: Similarly, the weights of continuity energy are adapted using the segmentation result from the previous frame such that


where is the continuity energy of the th frame with the weights and is computed by substituting and in (24). Using (25) and (26), (48) can be rewritten as


Similar to (45), (49) is NP-Hard but has an approximate solution as


Parameter selection for the edge energy: Adaptation of the parameters in the edge energy function (see eq. 12)) is crucial. Lack of adaption would result in the edge energy forcing the AC to continue to expand in areas of broken edges or shadow resulting in leakage outside the actual object boundary. The weighting for the edge energy is selected such that


where is of the th frame. Consequently, the weights are obtained as


Parameter selection for the variational energy: Similar to the previous energy terms, the weights in the variational energy function (see equation (13)) are selected such that


where is a constant value and is the variational energy of the th frame with the weights and is computed by substituting and in (13). Consequently, using (36), (37), and (53), the weights can be approximately obtained as


Parameter selection for the intensity energy: The intensity energy and its gradient at the previous frame are both equal to zero (see eq. (14)) and hence, the weights cannot be based on the information from previous frame. In this paper, the weights

are heuristically set as


From (55), one can see that in the case of broken edge where the intensity is almost zero, the intensity energy is automatically set to zero which is a reasonable outcome.
Parameter Adaptation with Forgetting Factor: Since the parameters of the AC are not expected to change rapidly, the parameters obtained from previous frames can always be used to improve segmentation accuracy and avoid misleading results due to the poor segmentation of any one individual frame. The forgetting factor, , is defined as


where , , , and are the value of the parameters obtained from (47), (50), (52), and (54), respectively. Note that since the first frame is segmented manually, its results are assumed to be accurate and therefore, the forgetting factor is applied to weights obtained from the segmentation results of subsequent frames. Also note that, since it is assumed that at equilibrium, the overall gradient of energy is zero, then


Iv Implementation of The Ad-PAC Algorithm

The Ad-PAC algorithm is initialized from a manually generated segmentation of the first frame. This manual segmentation is adjusted and smoothed using Ad-PAC (without parameter adaptation), reducing the error associated with initial manual segmentation. This makes the initial segmentation insensitive to small operator errors as large as 5 pixels. For larger operator errors, this smoothing process may shift the initial manual segmentation to a different local minima (such as the boundary of an adjacent object). Next, the number of contour points is updated using (42). Third, the centroid is calculated as


followed by the contour being re-sampled at angles obtained from (43

) using a cubic spline interpolation algorithm

[53]. Next, the weights of the energy function are obtained using (47), (50), (52), (54), and (55). Then, the value of is iteratively updated using (41), until the equilibrium stop condition is met. In this paper, the algorithm is assumed to be at equilibrium if , where is element-wise maximum. Finally, the algorithm returns to the first step to repeat the procedure for the next frame. A summary of the Ad-PAC algorithm is shown in table 1.

  Input: A video, , with as manual segmentation of the first frame, where is the initial number of contour points, and parameters , , , , , and .
  - Read one frame from the input video.
  - Update the number of contour points using (42).
  - Find the center of the contour and re-sample the contour at the angles .
  - Update the weights of the energy function using (47), (50), (52), and (54), (55), (56), (57), (58), and (59), and (60).
  - Update the value of iteratively, using (41).
  - Repeat the previous step until the algorithm reaches to the equilibrium condition. The equilibrium condition is defined as the condition when the maximum absolute value of change in at the previous step is less than pixels.
  - Return to the first step for the next frame.
Table 1. Ad-PAC algorithm

Computational complexity: The computational complexity of the Ad-PAC algorithm is estimated using the number of floating point operations (flops) [54]. From 22, 23, 25, 26, 27, 36, 37, 39 and 41, one can see that the total number of flops required for each iteration of the algorithm is . From (47), (50), (52), and (54), (55), (56), (57), (58), and (59), and (60), one can further see that the total number of flops required to parameter adaptation is plus an additional flops required for cubic re-sampling [55], and flops to update the center of the contour. Additionally, to compute the Sobel gradients of a 380 by 365 frame, flops are required. Consequently, assuming as the number of iterations required to minimize the energy function, the total number of is required for segmentation of each frame with Ad-PAC algorithm. Note that since parameter adaption is performed only once per frame, it does not significantly affect the processing time. Assuming , , and 25 percent extra processing power required for the software overhead, with an average Intel Core i750 the segmentation of each 380 by 365 frame requires only sec, which makes the algorithm suitable for real time segmentation and tracking purpose. Note that the running time can be significantly reduced by using faster minimization techniques such as the dynamic programming approach described in [52].

V Results

The experimental data was collected from 13 healthy subjects and with head of the bed elevated at 0, 30, 45, 60, and 90 degrees to simulate relative changes in blood volume. The IJV was imaged in the transverse plane using a portable ultrasound (M-Turbe, Sonosite-FujiFilm) with a linear-array probe (6-15 Mhz). Each video has a frame rate of 30 fps, scan depth of 4cm, and a duration of 15 seconds (450 frames/clip). The study protocol was reviewed and approved by the Health Research Ethics Authority.

Ad-PAC performance was compared to expert manual segmentation, Ad-PAC without parameters adaptation, Ad-PAC without temporal adaptation, and two current state-of-the-art polar AC algorithms introduced in Section II [50, 51]. Additionally, it is also compared to region growing (RG) [31] and its combination with AC (RGAC) [32], Speckle tracking driven AC (STAC) [29], and two classic AC algorithms - Chan-Vese [56] and Geodesic [57]. For each of these algorithms, parameter optimization was accomplished using a small subset of videos with variable image quality. For each video, the first frame was manually segmented by an operator with subsequent frames segmented automatically.

Initial efforts involved noise filtration using a variety of median and bilateral filters; however, no performance improvement was noted on any of the algorithms. This is mainly due to the fact that speckle noise includes useful information as it is random but deterministic that can improve the performance of AC algorithms. Hence, pre-processing techniques were not employed throughout this research.

The average contour point spacing was defined to be 10 pixels for the Ad-PAC and the other four algorithms . Image intensities were normalized to between 0 and 1. The parameters of Ad-PAC algorithm were empirically set to be , , , , , , , , and . After segmentation of each frame, the maximum range was readjusted to be , where was the largest element of obtained from the previous frame.

V-a Evaluation of Extraction

Before we define the validation metrics, we need to define the following terms:
True positive (TP): The number of pixels correctly segmented as foreground (manual segmentation overlapping with algorithm segmentation) is True Positive (TP) and defined as


where and are the set of pixels inside the contour obtained from the algorithms and manual segmentation, respectively, the intersection of the area between them, and denotes the cardinality of the set.
False positive (FP): False positive (FP) is the number of pixels that are falsely segmented as foreground and is represented as


where superscript denotes set complement, i.e., set of the pixels outside the contour.
True negative (TN): True negative (TN) is the number of pixels correctly labeled as background and defined as


False negative (FN) is the number of pixels falsely detected as background and defined as


Using these terms, sensitivity and specificity which are also known as true positive and false positive rates, respectively, are obtained as


The DICE factor (DF), also known as Sorensen, is the most common metric used to determine the correlation between algorithm and manual segmentation results [58]. The DICE coefficient, , is defined as:


and can be obtained from the above metric as


V-B Influence of Initial Parameter Selection on the Performance of Ad-PAC

This section demonstrates the robustness of the algorithm for each parameter along with the relative importance of each parameter on the overall performance. This enables the identification and potential removal of weak features from the energy function in order to improve computational efficiency. For this study, the average DICE factor, sensitivity, and specificity of three different clips versus the initial parameters , , , , and are shown in Figs. 5-10. In the all of these figures, one can easily see that the specificity is always very close to one indicating a relatively small rate of .

The three test videos suggest setting to one supports optimal segmentation as shown in Fig. 5. Large values of result in excessive contour shrinking while small values reduce contour smoothness.
The parameter demonstrates optimal performance near zero as per Fig. 6. This strongly suggests that the continuity energy term is a weak feature and hence, can be removed from the energy function.
In Fig. 7, all three videos provide their best performance at a between 0.04 and 0.08, hence, is set at 0.06. In two of the three test videos, the edge energy does not significantly improve the segmentation performance as the curves appear flat around likely resulting from indistinct edges and consequently, providing limited information to improve segmentation results.
Fig. 8

highlights that different videos demonstrate considerable variance in sensitivities versus

. Sensitivity was relatively stable for ranging between 0.4 and 0.9, hence was set to 0.8.
For the parameter , the best performance was established between 125 - 175 as shown in Fig. 9. Hence, equal to 150 seems to be an appropriate selection.
Finally Fig. 10 shows that the best performance is obtained when is between 0.0009 and 0.0015 resulting in as an appropriate selection.

Fig. 5: The validation rates in terms of DF, sensitivity, and specificity versus the parameter .
Fig. 6: The validation rates in terms of DF, sensitivity, and specificity versus the parameter .
Fig. 7: The validation rates in terms of DF, sensitivity, and specificity versus the parameter .
Fig. 8: The validation rates in terms of DF, sensitivity, and specificity versus the parameter .
Fig. 9: The validation rates in terms of DF, sensitivity, and specificity versus the parameter .
Fig. 10: The validation rates in terms of DF, sensitivity, and specificity versus the parameter .

V-C Influence of Contour Points Spacing

Here, we study the effect of contour points spacing on the accuracy of the Ad-PAC algorithm. In this study, after segmentation of each frame, the contour is re-sampled and the new value of is chosen to be , where is the perimeter of the segmented contour, and is the contour points spacing. Fig. 11 presents the average DICE factor obtained from all videos for different values of . From this figure, one can see that the average DICE factor degrades quickly when the contour spacing is large and it improves when the contour spacing decreases but it nears saturation at pixels.

Fig. 11: Influence of contour spacing on the accuracy of Ad-PAC segmentation.

V-D Tracking Performance

This Section compares the tracking performance of the proposed Ad-PAC algorithm with the manual segmentation and other algorithms as per section V for two sample video as shown in Figs. 12 and 13, respectively. From both figures, it is evident that the proposed Ad-PAC algorithm outperforms the existing algorithms and produces results very close to the manual segmentation. Further supporting evidence that parameter adaption significantly improves the performance is evident in rows 3 and 4 row of Figs. 12 and 13. The segmented contour is not smooth without parameter adaptation (which is observed as spikes) suggesting that the weight given to the curvature energy term was not sufficiently large enough to compete with the other energy terms and consequently, dominated by them.

Fig. 12: Tracking of the IJV in a good quality video for manual segmentation, Ad-PAC and eight other algorithms.
Fig. 13: Tracking of the IJV in a poor quality video for manual segmentation, Ad-PAC and eight other algorithms.

Fig. 14 presents the DICE factors obtained from each algorithm, averaged across all 65 videos irrespective of IJV shape, intensity, speed of variation and quality. From this figure, it is clear that the proposed Ad-PAC algorithm outperforms all existing algorithms with its corresponding DICE factor greater than 0.64. Other algorithms perform significantly worse. In the following sub-sections, more detailed results are presented.

Fig. 14: The mean level of agreement between algorithm and manual segmentation versus frame index.

V-E Influence of Image Quality

For this study, all videos were categorized, as good, average, and poor quality videos based on the blinded expert opinion. Fig. 16 illustrates the DICE results. In good quality ultrasound videos, as per Fig. 16-(a), the proposed Ad-PAC algorithm performs very close to the manual segmentation with a DICE factor consistently above 0.95. The minimum value of DICE factors for the other algorithms range from 0.91 down to 0.37 for the Geodesic algorithm [57].
In average quality videos, as shown in Fig. 16-(b), the performance of Ad-PAC algorithm drops as low as 0.65, however, it still outperforms the other AC algorithms. Poor quality videos (Fig. 16-(c)) demonstrate the minimum DICE factor as being 0.55, still above other algorithms.

Fig. 15: The average level of agreement with manual segmentation versus frame index for ultrasound videos with (a) good, (b) average, and (c) poor qualities.
Fig. 16: The average level of agreement with manual segmentation versus frame index for (a) oval shape, (b) 1+ apices shape, (c) fully collapsed videos.
Fig. 15: The average level of agreement with manual segmentation versus frame index for ultrasound videos with (a) good, (b) average, and (c) poor qualities.

V-F Influence of IJV Shape

The IJV shape also impacts the segmentation results. Oval objects tend to be more suitable for polar representation whereas collapsed vessels tend to be much more challenging. The IJV represents a deformable model influenced by a number of factors including local anatomy, blood volume and blood flow. For this study, IJV videos are categorized into three categories being oval, 1+ apices, and fully collapsed. Fig. 16 presents the average DICE factor for the videos from each category. In Fig. 16-(a), it is evident that Ad-PAC performs close to manual segmentation when the IJV has an oval shape with a DICE coefficient greater than 0.90. The second best performance belongs to the proposed energy function without temporal adaptation having an average DICE coefficient larger than 0.83. Fig. 16-(b) shows that the IJV with 1+ apices result in the Ad-PAC performance as low as 0.50 but above other algorithms. Again, the proposed energy function without temporal adaptation is the second best algorithm with a minimum DICE factor as low as 0.48. Is is only when the IJV is fully collapsed does the Ad-PAC algorithm under-perform the algorithm without adaptation and in the worst case, the DICE factor drops to 0.19. This is a limitation of the polar contour model for fully collapsed objects such as the empty IJV.

V-G Influence of IJV Variation

The CSA of the IJV undergoes a wide range of variation that typically present a challenge for AC models as they are relatively sensitive to this parameter. This often results in a failure to track and converge to the edges of the object. To study the influence of variation, the ultrasound videos were categorized into three groups i) less than 10 percent, ii) between 10 and 90 percent and iii) more than 90 percent variations. Note that, in the case of more than 90 percent variation, the IJV shape deforms from oval or 1+ apical shape to fully collapsed, resulting in this category resembling the one in Fig. 16-(c). The numerical results based on this categorization are shown in Fig. 17. As one can see from Fig. 16-(a), when the CSA of the IJV undergoes small variations, the average DICE factor is always greater than 0.94. In Fig. 16-(b) with the variation between 10 to 90 percent, the Ad-PAC algorithm still performs well with an average DICE factor of 0.64 and still outperforms the other algorithms. Finally from Fig. 16-(c), it is observed that when the IJV undergoes large variations, all algorithms gradually lose tracking. Ad-PAC algorithm does not always outperform Ad-PAC without adaptation in these scenarios.

Fig. 17: The average level of agreement with manual segmentation for IJV videos with (a) less than 10% variation, (b) 10-90% variation, (c) greater than 90% variation.

Vi Conclusion and Future Work

In this paper, a novel adaptive polar active contour model (Ad-PAC) is developed for the segmentation and tracking of the internal jugular vein (IJV) in ultrasound imagery. In the proposed algorithm, the parameters of energy function are initialized and locally adapted to the contour features extracted in previous frames. We demonstrate that the extra processing required for parameter adaptation is negligible and that the proposed Ad-PAC algorithm performs well compared with manual segmentation while outperforming multiple existing algorithms across a broad range of image features including image quality, intensity, and temporal variation.

Although the proposed Ad-PAC algorithm still outperforms existing AC algorithms, the authors intend to address the cases of poor image quality or fully-collapsed IJV by incorporating additional information into its energy function. Furthermore, the focus of this paper centered on the energy function and parameter adaptation with future work being directed at improving the speed and accuracy of the functional minimization through developing more efficient techniques. Currently, the research team is evaluating the ability of the Ad-PAC algorithm to detect relative changes in circulating blood volume with the intent of predicting when patients with congestive heart failure are at risk of clinical deterioration and subsequent hospitalization.


  • [1] R. R. Steuer, D. H. Harris, and J. M. Conis, “A new optical technique for monitoring hematocrit and circulating blood volume: Its application in renal dialysis,” Dialysis & transplantation, vol. 22, no. 5, pp. 260–265, 1993.
  • [2] T. Kudo, S. Suzuki, and T. Iwabuehi, “Importance of monitoring the circulating blood volume in patients with cerebral vasospasm after subarachnoid hemorrhage,” Neurosurgery, vol. 9, no. 5, p. 514–520, 1981.
  • [3] H. Kasuya, H. Onda, T. Yoneyama, T. Sasaki, and T. Hori, “Bedside monitoring of circulating blood volume after subarachnoid hemorrhage,” Stroke, vol. 34, no. 4, p. 956–960, 2003.
  • [4] M. Yashiro, Y. Hamada, H. Matsushima, and E. Muso, “Estimation of filtration coefficients and circulating plasma volume by continuously monitoring hematocrit during hemodialysis,” Blood Purif Blood Purification, vol. 20, no. 6, p. 569–576, 2003.
  • [5] F. Bremer, A. Schiele, J. Sagkob, T. Palmaers, and K. Tschaikowsky, “Perioperative monitoring of circulating and central blood volume in cardiac surgery by pulse dye densitometry,” Intensive Care Med Intensive Care Medicine, vol. 30, no. 11, p. 2053–2059, 2004.
  • [6] P. Bose, F. Regan, and S. Paterson-Brown, “Improving the accuracy of estimated blood loss at obstetric haemorrhage using clinical reconstructions,” BJOG: An International Journal of Obstetrics & Gynaecology, vol. 113, no. 8, pp. 919–924, 2006.
  • [7] J. K. Bailey, J. Mccall, S. Smith, and R. J. Kagan, “Correlation of internal jugular vein/common carotid artery ratio to central venous pressure,” Journal of Burn Care & Research, vol. 33, no. 1, p. 89–92, 2012.
  • [8] K. Raksamani, V. Udompornmongkol, S. Suraseranivongse, M. Raksakietisak, and B. V. Bormann, “Correlation between cross-sectional area of the internal jugular vein and central venous pressure,” European Journal of Anaesthesiology, vol. 31, no. 1, p. 50–51, 2014.
  • [9] S. Bala and A. Doegar, “Automatic detection of sickle cell in red blood cell using watershed segmentation,” Blood, vol. 4, no. 6, 2015.
  • [10] J. Serra and P. Soille, Mathematical morphology and its applications to image processing.   Springer Science & Business Media, 2012, vol. 2.
  • [11] S. Diciotti, S. Lombardo, M. Falchini, G. Picozzi, and M. Mascalchi, “Automated segmentation refinement of small lung nodules in ct scans by local shape analysis,” IEEE Transactions on Biomedical Engineering, vol. 58, no. 12, pp. 3418–3428, 2011.
  • [12] R. Zwiggelaar, Y. Zhu, and S. Williams, “Semi-automatic segmentation of the prostate,” in

    Iberian Conference on Pattern Recognition and Image Analysis

    .   Springer, 2003, pp. 1108–1116.
  • [13] J. Xie, Y. Jiang, and H.-t. Tsui, “Segmentation of kidney from ultrasound images based on texture and shape priors,” IEEE transactions on medical imaging, vol. 24, no. 1, pp. 45–57, 2005.
  • [14] P. Karasev, I. Kolesov, K. Fritscher, P. Vela, P. Mitchell, and A. Tannenbaum, “Interactive medical image segmentation using pde control of active contours,” IEEE transactions on medical imaging, vol. 32, no. 11, pp. 2127–2139, 2013.
  • [15] T. V. Spina, P. A. de Miranda, and A. X. Falcão, “Hybrid approaches for interactive image segmentation using the live markers paradigm,” IEEE Transactions on Image Processing, vol. 23, no. 12, pp. 5756–5769, 2014.
  • [16] B. L. Price, B. Morse, and S. Cohen, “Geodesic graph cut for interactive image segmentation,” in Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on.   IEEE, 2010, pp. 3161–3168.
  • [17] D. Grosgeorge, C. Petitjean, J.-N. Dacher, and S. Ruan, “Graph cut segmentation with a statistical shape model in cardiac MRI,” Computer Vision and Image Understanding, vol. 117, no. 9, pp. 1027–1035, 2013.
  • [18] D. Mahapatra and J. M. Buhmann, “Automatic cardiac rv segmentation using semantic information with graph cuts,” in 2013 IEEE 10th International Symposium on Biomedical Imaging.   IEEE, 2013, pp. 1106–1109.
  • [19] L. Meziou, A. Histace, and F. Precioso, “Alpha-divergence maximization for statistical region-based active contour segmentation with non-parametric pdf estimations,” in 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).   IEEE, 2012, pp. 861–864.
  • [20] W. Wang, L. Zhu, J. Qin, Y.-P. Chui, B. N. Li, and P.-A. Heng, “Multiscale geodesic active contours for ultrasound image segmentation using speckle reducing anisotropic diffusion,” Optics and Lasers in Engineering, vol. 54, pp. 105–116, 2014.
  • [21] P. A. Yushkevich, J. Piven, H. C. Hazlett, R. G. Smith, S. Ho, J. C. Gee, and G. Gerig, “User-guided 3d active contour segmentation of anatomical structures: significantly improved efficiency and reliability,” Neuroimage, vol. 31, no. 3, pp. 1116–1128, 2006.
  • [22] B. Al-Diri, A. Hunter, and D. Steel, “An active contour model for segmenting and measuring retinal vessels,” IEEE Transactions on Medical imaging, vol. 28, no. 9, pp. 1488–1497, 2009.
  • [23] N. Paragios and R. Deriche, “Geodesic active contours and level sets for the detection and tracking of moving objects,” IEEE Transactions on pattern analysis and machine intelligence, vol. 22, no. 3, pp. 266–280, 2000.
  • [24] P. Mesejo, A. Valsecchi, L. Marrakchi-Kacem, S. Cagnoni, and S. Damas, “Biomedical image segmentation using geometric deformable models and metaheuristics,” Computerized Medical Imaging and Graphics, vol. 43, pp. 167–178, 2015.
  • [25] Z. Ma, R. M. N. Jorge, T. Mascarenhas, and J. M. R. Tavares, “Segmentation of female pelvic organs in axial magnetic resonance images using coupled geometric deformable models,” Computers in biology and medicine, vol. 43, no. 4, pp. 248–258, 2013.
  • [26] M. Lee, W. Cho, S. Kim, S. Park, and J. H. Kim, “Segmentation of interest region in medical volume images using geometric deformable model,” Computers in biology and medicine, vol. 42, no. 5, pp. 523–537, 2012.
  • [27] P. J. Yim and D. J. Foran, “Volumetry of hepatic metastases in computed tomography using the watershed and active contour algorithms,” in Computer-Based Medical Systems, 2003. Proceedings. 16th IEEE Symposium.   IEEE, 2003, pp. 329–335.
  • [28] S. Ali and A. Madabhushi, “An integrated region-, boundary-, shape-based active contour for multiple object overlap resolution in histological imagery,” IEEE transactions on medical imaging, vol. 31, no. 7, pp. 1448–1460, 2012.
  • [29] K. Qian, T. Ando, K. Nakamura, H. Liao, E. Kobayashi, N. Yahagi, and I. Sakuma, “Ultrasound imaging method for internal jugular vein measurement and estimation of circulating blood volume,” International journal of computer assisted radiology and surgery, vol. 9, no. 2, pp. 231–239, 2014.
  • [30] J.-U. Voigt, G. Pedrizzetti, P. Lysyansky, T. H. Marwick, H. Houle, R. Baumann, S. Pedri, Y. Ito, Y. Abe, S. Metz et al., “Definitions for a common standard for 2d speckle tracking echocardiography: consensus document of the eacvi/ase/industry task force to standardize deformation imaging,” Eur Heart J Cardiovasc Imaging, p. jeu184, 2014.
  • [31] J. Wu, S. Poehlman, M. D. Noseworthy, and M. V. Kamath, “Texture feature based automated seeded region growing in abdominal MRI segmentation,” in 2008 International Conference on BioMedical Engineering and Informatics, vol. 2.   IEEE, 2008, pp. 263–267.
  • [32] E. Karami, M. S. Shehata, P. McGuire, and A. Smith, “A semi-automated technique for internal jugular vein segmentation in ultrasound images using active contours,” in 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).   IEEE, 2016, pp. 184–187.
  • [33] S. Ali and A. Madabhushi, “An integrated region-, boundary-, shape-based active contour for multiple object overlap resolution in histological imagery,” IEEE transactions on medical imaging, vol. 31, no. 7, pp. 1448–1460, 2012.
  • [34] S. Sun, C. Bauer, and R. Beichel, “Automated 3-d segmentation of lungs with lung cancer in ct data using a novel robust active shape model approach,” IEEE transactions on medical imaging, vol. 31, no. 2, pp. 449–460, 2012.
  • [35] J. Guerrero, S. E. Salcudean, J. A. McEwen, B. A. Masri, and S. Nicolaou, “Real-time vessel segmentation and tracking for ultrasound imaging applications,” IEEE transactions on medical imaging, vol. 26, no. 8, pp. 1079–1090, 2007.
  • [36] F. Moscheni, S. Bhattacharjee, and M. Kunt, “Spatio-temporal segmentation based on region merging,” IEEE transactions on pattern analysis and machine intelligence, vol. 20, no. 9, pp. 897–915, 1998.
  • [37] J. Chen, G. Zhao, M. Salo, E. Rahtu, and M. Pietikainen, “Automatic dynamic texture segmentation using local descriptors and optical flow,” IEEE Transactions on Image Processing, vol. 22, no. 1, pp. 326–339, 2013.
  • [38] G. Hamarneh and T. Gustavsson, “Deformable spatio-temporal shape models: extending active shape models to 2d+ time,” Image and Vision Computing, vol. 22, no. 6, pp. 461–470, 2004.
  • [39] E. Karami, M. S. Shehata, and A. Smith, “Tracking of the internal jugular vein in ultrasound images using optical flow,” in 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).   IEEE, 2017, pp. 1–4.
  • [40] H. Li, T. Shen, D. Vavylonis, and X. Huang, “Actin filament segmentation using spatiotemporal active-surface and active-contour models,” in International Conference on Medical Image Computing and Computer-Assisted Intervention.   Springer, 2010, pp. 86–94.
  • [41] S. C. Mitchell, J. G. Bosch, B. P. Lelieveldt, R. J. Van der Geest, J. H. Reiber, and M. Sonka, “3-d active appearance models: segmentation of cardiac mr and ultrasound images,” IEEE transactions on medical imaging, vol. 21, no. 9, pp. 1167–1178, 2002.
  • [42] K. Li, X. Wu, D. Z. Chen, and M. Sonka, “Optimal surface segmentation in volumetric images-a graph-theoretic approach,” IEEE transactions on pattern analysis and machine intelligence, vol. 28, no. 1, pp. 119–134, 2006.
  • [43] M. Ristivojevic and J. Konrad, “Space-time image sequence analysis: object tunnels and occlusion volumes,” IEEE Transactions on Image Processing, vol. 15, no. 2, pp. 364–376, 2006.
  • [44] M. B. Smith, H. Li, T. Shen, X. Huang, E. Yusuf, and D. Vavylonis, “Segmentation and tracking of cytoskeletal filaments using open active contours,” Cytoskeleton, vol. 67, no. 11, pp. 693–705, 2010.
  • [45] W. Zuo, K. Wang, D. Zhang, and H. Zhang, “Combination of polar edge detection and active contour model for automated tongue segmentation,” in Image and Graphics (ICIG’04), Third International Conference on.   IEEE, 2004, pp. 270–273.
  • [46] C. Collewet, “Polar snakes: A fast and robust parametric active contour model,” in 2009 16th IEEE International Conference on Image Processing (ICIP).   IEEE, 2009, pp. 3013–3016.
  • [47] M. Baust and N. Navab, “A spherical harmonics shape model for level set segmentation,” in European Conference on Computer Vision.   Springer, 2010, pp. 580–593.
  • [48] E. Karami, M. S. Shehata, and A. Smith, “Segmentation and tracking of inferior vena cava in ultrasound images using a novel polar active contour algorithm,” in 5th IEEE Global Conference on Signal and Information Processing (GlobalSIP).   IEEE, 2017, pp. 1–4.
  • [49] G. D. Giannoglou, Y. S. Chatzizisis, V. Koutkias, I. Kompatsiaris, M. Papadogiorgaki, V. Mezaris, E. Parissi, P. Diamantopoulos, M. G. Strintzis, N. Maglaveras et al., “A novel active contour model for fully automated segmentation of intravascular ultrasound images: in vivo validation in human coronary arteries,” Computers in biology and medicine, vol. 37, no. 9, pp. 1292–1302, 2007.
  • [50] M. Baust, A. J. Yezzi, G. Unal, and N. Navab, “A sobolev-type metric for polar active contours,” in Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on.   IEEE, 2011, pp. 1017–1024.
  • [51] A. R. De Alexandria, P. C. Cortez, J. A. Bessa, J. H. da Silva Felix, J. S. De Abreu, and V. H. C. De Albuquerque, “psnakes: A new radial active contour model and its application in the segmentation of the left ventricle from echocardiographic images,” Computer methods and programs in biomedicine, vol. 116, no. 3, pp. 260–273, 2014.
  • [52] X. Jiang and D. Tenbrinck, “Region based contour detection by dynamic programming,” in International Conference on Computer Analysis of Images and Patterns.   Springer, 2013, pp. 152–159.
  • [53] F. N. Fritsch and R. E. Carlson, “Monotone piecewise cubic interpolation,” SIAM Journal on Numerical Analysis, vol. 17, no. 2, pp. 238–246, 1980.
  • [54] D. S. Watkins, Fundamentals of matrix computations.   John Wiley & Sons, 2004, vol. 64.
  • [55] E. Meijering and M. Unser, “A note on cubic convolution interpolation,” IEEE Transactions on Image processing, vol. 12, no. 4, pp. 477–479, 2003.
  • [56] T. F. Chan and L. A. Vese, “Active contours without edges,” IEEE Transactions on image processing, vol. 10, no. 2, pp. 266–277, 2001.
  • [57] V. Caselles, R. Kimmel, and G. Sapiro, “Geodesic active contours,” International journal of computer vision, vol. 22, no. 1, pp. 61–79, 1997.
  • [58] L. R. Dice, “Measures of the amount of ecologic association between species,” Ecology, vol. 26, no. 3, pp. 297–302, 1945.