Automatic Modelling of Human Musculoskeletal Ligaments – Framework Overview and Model Quality Evaluation

03/24/2020 ∙ by Noura Hamze, et al. ∙ Leopold Franzens Universität Innsbruck 0

Accurate segmentation of connective soft tissues is still a challenging task, which hinders the generation of corresponding geometric models for biomechanical computations. Alternatively, one could predict ligament insertion sites and then approximate the shapes, based on anatomical knowledge and morphological studies. Here, we describe a corresponding integrated framework for the automatic modelling of human musculoskeletal ligaments. We combine statistical shape modelling with geometric algorithms to automatically identify insertion sites, based on which geometric surface and volume meshes are created. For demonstrating a clinical use case, the framework has been applied to generate models of the interosseous membrane in the forearm. For the adoption to the forearm anatomy, ligament insertion sites in the statistical model were defined according to anatomical predictions following an approach proposed in prior work. For evaluation we compared the generated sites, as well as the ligament shapes, to data obtained from a cadaveric study, involving five forearms with a total of 15 ligaments. Our framework permitted the creation of 3D models approximating ligaments' shapes with good fidelity. However, we found that the statistical model trained with the state-of-the-art prediction of the insertion sites was not always reliable. Using that model, average mean square errors as well as Hausdorff distances of the meshes increased by more than one order of magnitude, as compared to employing the known insertion locations of the cadaveric study. Using the latter an average mean square error of 0.59 mm and an average Hausdorff distance of less than 7 mm resulted, for the complete set of ligaments. In conclusion, the presented approach for generating ligament shapes from insertion points appears to be feasible but the detection of the insertion sites with a SSM is too inaccurate.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 10

page 12

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Introduction

In orthopedic surgery, an accurate diagnosis and the subsequent preoperative planning of the surgical steps are crucial for the successful restoration of a patient’s anatomy. High precision in the preoperative planning and the surgical execution are mandatory for ensuring satisfactory clinical outcomes (e.g. Fürnstahl (2010); Fernandez (1982)). Three-dimensional, computer-assisted approaches have become the established option as they contribute to a more comprehensive planning. Providing dynamic biomechanical simulations allows for the analysis of complex pathologies, as well as an evaluation of a larger range of possible intervention strategies. Nevertheless, most preoperative methods are currently limited to simple bone-based models, not taking into account the influence of soft tissue.

For the correct diagnosis of soft tissue influence in case of impairment of the patient function, a simulation framework also integrating the influence of relevant soft tissue structures is required. As an example, the kinematics of forearm pro-supination, and the resulting range of motion, is highly influenced by the interosseous membrane (IOM). The latter is the strongest ligament structure in the forearm, connecting radius and ulna bones Nagy et al. (2008); Kitamura et al. (2011). Previous studies have demonstrated that it is the main stabilizing element during forearm motion Nagy et al. (2008); Kitamura et al. (2011); Pfaeffle et al. (2000); Nakamura et al. (2000), and thus has to be included in respective simulations. However, creating a geometric simulation model of such soft tissue structures is a challenging task, because of the high inter-subject variation in their shapes and insertion sites. Further, the segmentation of ligaments in medical images is hardly possible in a reliable way, due to low contrast to neighboring anatomy.

Regarding biomechanical simulations, some prior works have modelled ligaments from patient-specific segmentations. For instance, models of the anterior cruciate ligament of the knee have been generated using morphological operations combined with active contours Ho et al. (2010) or graph cuts with shape constraints Lee et al. (2014), applied to MR images. However, processing MR data acquired with clinical protocols is often not possible due to poor resolution and data heterogeneity. Other works have relied on surrogate modeling methods, based on prior knowledge of the ligaments’ shapes and locations. A common approach here is to employ single or multiple line segments connecting bones (see e.g. for the knee Bloemker et al. (2012); Graf et al. (2014), forearm Péan et al. (2017), or elbow Rahman et al. (2018)). In these models, the line segments are considered as linear springs; this is straightforward, but has several limitations, such as the inability to describe complex geometry or to predict nonuniform stresses and strains. As a more accurate alternative, the use of 3D finite element models for simulations has been proposed (e.g. for analyzing the knee Penrose et al. (2002); Weiss et al. (2005), ankle  Bandak et al. (2001), shoulder Zheng et al. (2017) or wrist Shimawaki et al. (2015)). Finally, statistical shape models have also been explored in this context, e.g. for ACL reconstruction Fleute et al. (1999) or for the planning of corrective orthopedic surgeries of malunited forearm bones Mauler et al. (2017).

We strongly believe that one reason for the limited clinical translation of functional preoperative planning, which is based on range of motion simulation in the forearm Kasten et al. (2002); Ward et al. (2000); Weinberg et al. (2000); Yasutomi et al. (2002); Matsuki et al. (2010), is associated with the difficulty of obtaining reliable patient-specific 3D models of the IOM ligaments. Motivated by these limitations, we aimed to develop a novel framework capable of generating 3D ligament models in an automatic fashion based on statistical shape models and geometric meshing algorithms. The work will contribute to improve the accuracy of patient-specific motion simulations in the forearm. Our approach was evaluated by comparing ligaments segmented from a cadaver study against models of our framework.

2 Methods

2.1 Framework Overview and IOM Test Scenario

Our ligament modelling framework is comprised of two main parts: a pre-computation phase in which a statistical shape model of the considered anatomy is set up, and a ligament model generation phase, in which ligament meshes for a specific patient anatomy are created. Although the framework is generic, we demonstrate its use in the context of modelling the IOM of the forearm. The latter is the ligamentous complex playing a primary role in maintaining forearm stability during pro-supination motion. Despite its complex anatomy, the IOM shape is often simplified to the most representative component, the so-called central band. However, in some studies Skahen et al. (1997); Fujita (1995)

, the anatomy is described with more precision; it is classified into several heterogeneous parts, comprising the central band (CB), accessory band (AB), distal oblique accessory cord (DOAC), distal oblique bundle (DOB), and proximal oblique cord (POC). In our work, we also follow this notion. Figure 

1 indicates the locations of the respective forearm ligaments.

Figure 1: Illustration of the different components of the IOM, with corresponding insertion locations indicated as green circles.

The anatomy of the ligaments can be described also according to their attachment (i.e. insertion) locations on the bones. We consider these as key anatomical landmarks for our approach. In general, an insertion point is given by the 3D coordinates of a mesh vertex. In Figure 1, also the landmarks are illustrated (as green circles), corresponding to different parts of the IOM. Depending on the ligament width, a landmark on the bone surface denotes either the center of a thinner band (e.g. AB), or the start and end location of a wider one (e.g. CB). In order to label the insertion points, we will below indicate their location as either on the radius (_R) or on the ulna (_U); and in case of a wider ligament the respective position on the bone as distal (D) or proximal (P). Thus, the insertion point of the accessory band on the ulna is labeled as AB_U, while the proximal insertion point on the central band on the radius is specified as CBP_R.

Regarding anatomical locations of insertion points, one of the most complete anatomical studies of the IOM was performed by Noda et al. Noda et al. (2009), incorporating 30 cadaver forearm specimens. They specified the 3D locations of IOM ligament origin and insertion as distance percentages, given as the ratio of the distance from the distal part of the corresponding bone to its total length. In addition, they provided widths and thicknesses of the structures. This state-of-the-art study will serve as a guide for the construction of the statistical shape model of our framework. Below, in Section 2.2 we first detail the setup of the statistical model in a pre-processing step. Note that there will be four different submodels, one each for radius and ulna, left and right side. Thereafter, in Section 2.3 we outline the use of the shape model to generate new ligament meshes in a patient-specific fashion.

2.2 Pre-Processing – Statistical Shape Modelling

2.2.1 Outline

Statistical shape models (SSMs) are a well established approach to describe the variability of a class of similar shapes (see e.g. Heimann (2009) for an overview). In SSMs, a key step is to determine variability across a set of constitutive samples, as well as the mean shape. With this information, the SSM permits to approximate any new candidate shape from the same class. A key step for SSMs is to establish point-to-point correspondences between input samples. To this end, we make use of a Gaussian Process Morphable model (GPMM), as outlined in Lüthi et al. (2018), which extends SSMs and permits incorporating expressive shape priors; in our case landmarks of ligaments on forearm bones. In GPMMs, shape deformations are represented as a Gaussian process, also permitting combination of multiple levels of deformations. Next, we describe the medical datasets from which the SSMs were built.

2.2.2 Training data

Training data were obtained from CT scans of 18 healthy forearms, acquired using a Somatom Edge Plus scanner (Siemens Medical Systems, Erlangen, Germany); with 1 slice thickness, at 120. 3D meshes of the radii and ulnae bones were segmented via intensity thresholding and region growing (Mimics® Medical, Version 19.0, Materialise 2016, Leuven, 195 Belgium), followed by 3D marching cube reconstruction Lorensen and Cline (1987). The average number of vertices in a bone mesh was 12K, which was further reduced to 3K using mesh decimation methods provided by ParaView Ahrens et al. (2015). Thereafter, six 3D coordinates for the ligaments’ landmarks were manually identified on each bone, guided by Noda’s prescribed percentages. The manual labelling was performed by an orthopedic resident at the Balgrist University Hospital Zurich, with the Medical Imaging ToolKit MITK 25. These details of ligament locations are consistently propagated through the subsequent pipeline.

Next, to be able to create a SSM, consistency has to be ensured across the contributing shapes by aligning them into the same coordinate system, enforcing the same number of vertices in all meshes, and establishing point-to-point correspondence between the vertices. In a first step, all bone meshes are rigidly transformed, starting with a coarse alignment of all bones according to the main axis of the longest one, followed by a fine alignment via the iterative closest point (ICP) registration Besl and McKay (1992), implemented in the Insight Segmentation and Registration Toolkit (ITK) 14. For the resulting aligned four sets of input meshes (one each for radius and ulna, left and right side), we next set up GPMMs to facilitate obtaining the correspondences Lüthi et al. (2018).

2.2.3 Setup of Gaussian Process Morphable models

The setup starts with the selection of a reference bone mesh; a typical choice being the average bone shape or one of the aligned input meshes. For each representative bone, denoted by , we assign a Gaussian process over the shape domain . Here, function encodes the mean deformation (i.e. shape variation) between instances in ; the latter being expressed as the mean square distance between points of two shape surfaces. Further, the Gaussian process kernel is a covariance matrix function, expressing the spread of deformations inside . Note that a key advantage of using GPMMs is the option to use multi-scale kernel Gaussian processes . We employ a smooth kernel for the landmarks as well as a larger scale one for the bones, leading to an expression via a sum of two functions:

This permits to conveniently include the ligaments’ landmarks with constraint position variations into the model, thus ensuring that these details are included in the shape-prior for the following registration. For setup of the GPMM we employ the open source shape modelling libraries Scalismo 

34 and Statismo Lüthi et al. (2012). Following Lüthi et al. (2018), we then make use of the GPMMs for establishing point-to-point correspondence between the training samples in .

2.2.4 Establishing correspondences

The problem of finding correspondences is formulated as a non-rigid registration between a target shape surface represented by a set of 3D points, and a binary reference image , constructed from the Gaussian process reference mesh . In the registration, a transformation function is sought that minimizes the mean squared distance from the reference image to the closest target point in current shape . Applying this transformation to all sample shapes in yields meshes with the desired properties – i.e., all meshes have the same number of vertice with established point-to-point correspondences, in the same coordinate system. The whole process is carried out again using ITK implementations. For the optimization in ITK, the Limited Memory Broyden Fletcher Goldfarb Shannon minimization with simple bounds (LBFGSB) Byrd et al. (1995)

is employed. Note that the insertion locations are maintained according to the GPMM formulation. In the final phase, a Principal Component Analysis (PCA)-model is built from the generated intermediate bone meshes with correspondences.

(a) PCA-model construction from a set of shapes in correspondence after fitting, landmarks indicated as red circles.
(b) Comparison in 3D of generated landmarks (red) to manually annotated ones (green).
Figure 2: Statistical shape model of forearm bones.

2.2.5 Statistical shape model of forearm bones

Following the PCA scheme, we create the final statistical model. Reference shapes with insertion landmarks can be obtained, as linear combination of the mean shape and the most important Eigen-shapes. Note that knowledge about the landmarks’ positions is implicitly embedded into the model through a restriction in variation in the intermediate input data. The restriction can be regarded as geometric constraints fixing parts of the bone at the ligament connection sites. Figure (a)a illustrates the PCA-model resulting from a set of meshes in correspondence with landmarks. In order to assess the accuracy of the shape model, we carried out a cross-validation study with leave-one-out testing. We found a mean error of 3 in the landmarks’ locations across all data samples. Figure (b)b also qualitatively compares landmarks obtained with our framework with manually annotated ones.

2.3 Patient-Specific Ligament Model Generation

2.3.1 Outline

The target of the model generation process is the automatic creation of ligament meshes, based on the known bone geometry of a specific patient, but without any knowledge about the ligaments. To predict the ligament insertion sites, we rely on the SSMs described in Section 2.2.5. In the first step, landmarks of ligament insertions are automatically transferred to the 3D patient-specific bone meshes which can be obtained by segmentation of medical image data. In the second step, 3D surface models represented by triangles or, if needed, volumetric meshes represented by tetrahedra are generated, approximating the shapes of the ligaments. The modelling is based on the identified landmarks as well as on additional anatomical parameters. The key steps in the modelling pipeline are overviewed in Figure 3.

(a) Alignment of target (yellow; shown before and after) to reference (green).
(b) Fitting process via establishing correspondences.
(c) Projection of landmarks.
(d) Creation of ligament meshes (with an instance shown for two insertion points).
Figure 3: Overview of the modelling pipeline.

2.3.2 Landmark transfer

In order to transfer a set of landmarks to a patient target bone shape , the latter is first aligned to the reference shape of each bone-specific SSM, via the ICP algorithm. Next, the target shape is fitted to , following the same process used before for establishing point-to-point correspondences (see Section 2.2.4). Finally, the set of landmarks found on the SSM are projected onto the target patient bone shape. For each landmark in the reference shape the closest vertex on the aligned and fitted target shape is found and labeled as that respective ligament landmark. The output of this phase is a patient-specific bone mesh with all ligament insertion points.

2.3.3 Ligament shape modelling

3D meshes of ligaments are generated based on the patient-specific bone meshes and associated landmarks of the previous step. As additional information, thickness of ligaments, and potentially also their width has to be supplied. The process is again outlined for the test scenario of the IOM, but transfers directly to any other anatomy.

The process is carried out in several substeps. First, four vertices are identified – the proximal and distal ends of a ligament on each bone. Next, pairs of these are connected, yielding four line segments forming a quadrilateral surface. The line segments are then regularly discretized, yielding a set of vertices on the quadrilateral boundary; some vertices are further projected onto bones surfaces for a better fit. Based on all boundary vertices, new vertices are then generated within the quadrilateral. A triangle mesh is finally generated from all vertices and perpendicularly extruded. Figure 4 indicates the vertices generated in this process, in case of the CB. In the following, the individual shape modelling substeps will be addressed with more detail.

Figure 4: Vertices generated for building the initial ligament surface triangle mesh (in order of creation; orange: ligament endpoints, red: sampled traversal segments, grey: sampled bone-aligned segments, black: projected samples, green: sampled ligament sheet).

The objective is to model a 3D surface of a ligament connecting two bone surfaces. As mentioned above, the starting points are four vertices located at the proximal and distal ends of a ligament on the radius and ulna meshes (orange vertices). According to the setup of the SSMs, in case of the CB these vertices are directly given by the four landmarks; i.e. vertices , , ,

, which in addition also yield the widths of a ligament along a bone directly on the surface. For the remaining ligaments (DOB, AB, DOAC, POC), only a mid-point landmark is available from the SSMs. In this case the four vertices at the ligament ends are found via the bone main axes direction vectors

or (pointing from proximal to distal end), and associated ligament widths per bone or . The former can be computed from the bone meshes, the latter have to be user-defined. This also results in four vertices; for instance, for AB we determine as one vertex .

Next, forming pairs of some of the four vertices – i.e. on each bone (magenta line segments), as well as traversally between the proximal and distal ends (stippled black line segments) – yields a quadrilateral surface. Note that the former line segments may intersect the bone meshes or the endpoints may not directly touch the bone surfaces. Subsequently, the line segments are regularly subdivided yielding additional vertices. The sampling is controlled via user-supplied parameters, indicating the intra-(along the bone) and inter-bone number of samples per ligament; in our experiments intra- and inter-bone sampling were, for instance in the case of CB, set to 10 and 12, respectively. The resulting 3D vertices are depicted as grey and red circles on the line segments.

As previously indicated, the line segment along each bone (magenta), and thus the sampled vertices (grey), will likely not be located directly on the bone mesh. Thus, in an additional step, these vertices are first projected onto the nearest bone mesh triangle along its normal whereafter the nearest existing vertex on the bone surface is finally found (black vertices). The reason for using existing vertices is the easier handling of boundary conditions in a potential subsequent biomechanical simulation, e.g. using finite element meshes. Overall, this results in a piecewise linear approximation of the ligament contact on the bone surface (blue).

Based on the vertices – i.e. those on the transversal segments (red) and the projected ones (black) – additional 3D vertices are then generated at regular locations (green), via linear interpolation of positions. Next, using the incremental builder functionality of the Computational Geometry Algorithms library CGAL 

38, a polygonal (triangle) surface is constructed from all vertices. Note that we employ a halfedge data structure to maintain incidence information of vertices, edges, and faces, using the CGAL Halfedge package Kettner (2019). An example of such a resulting triangle mesh is illustrated in Figure (a)a. Finally, to incorporate the ligament thickness, the mesh is extruded into normal direction, via the Linear Extrusion filter of ParaView Ahrens et al. (2015). A parameter for the thickness also has to be supplied; in our experiments we employed values in the range of 1 to 4 . The overall result is a 3D piecewise linear mesh, approximating the surface of a single ligament.

As an additional step, the surface triangle mesh of a ligament can be further transformed into a volumetric tetrahedral mesh. This is carried out with the Constrained Delaunay-based quality tetrahedral mesh generator TetGen Si (2015). In TetGen, the mesh quality can be controlled either by enforcing a maximum volume or a minimum radius value for each element. As an example, we have used radii in a range of 0.6 to 1 . Steiner points are added inside the ligament mesh volume to satisfy the imposed constraint. An example mesh is visualized in Figure (b)b.

(a) Generated intermediate triangle mesh.
(b) Visualizations of tetrahedral 3D volume mesh created in two steps.
Figure 5: Examples of generated ligament 3D surface and volume models (in this case, for the CB of dataset ).

3 Experiments and Results

3.1 Accuracy of Automatically Generated Landmarks

In a first study, we examined the accuracy of the landmarks that were automatically generated with our presented framework. To do so, we obtained ground truth data via a cadaveric study (see also Carrillo et al. (2019)). In the latter, radial and ulnar insertion locations of the ligaments were visually identified on five forearm specimens (two female, three male); associated datasets are denoted below as to . The individual ligaments of the IOM were marked by a surgeon with titanium ligation clips, via a clip applicator tool (Ethicon endo-surgery, LLC, USA). Note that the POC could not be labeled in any of the samples. Moreover, in the specimens either the DOAC or the DOB was present, but not both; the former was found in four cases, the latter only in one. This finding is in line with current anatomical knowledge about variation in forearm ligaments (see e.g. Kitamura et al. (2011); Noda et al. (2009)).

For annotation of DOB, AB, and CB four clips were employed, at the proximal and distal insertion locations of the ligament attachments on both bones, respectively. Further, due to its narrow width, the DOAC was annotated using only one metal clip per bone. The markers were placed at the centers of the attachments of its main fiber bundle. An example image of an annotated specimen is shown in Figure 6. Thereafter, Micro-CT as well as CT images were obtained from the annotated cadaveric arms. In the resulting image data, all IOM insertion locations were then manually segmented; the latter subsequently serving as ground truth for the comparison.

Figure 6: Annotation of ligaments with metallic clips in cadaver forearms; shown as example.

Next, using our proposed framework, we automatically obtained an additional set of landmarks via our SSM. As outlined, the input to the process was the bone surface meshes created from segmentations of the CT scans of the five cadaver arms. The output was the estimated landmarks of the IOM ligaments, matching the input geometries.

For further processing, in both the SSM-predicted and ground truth datasets, we computed for the wider ligaments (i.e. those with four marked locations; two proximal and two distal) the average mid-points. Based on this, we finally determined the -vector norm of the distances between the locations in the ground truth data and in the framework output. The averages of the distance errors are visualized per insertion location mid-point in millimeters in Figure (a)a. Note that due to the presence or absence of ligaments, some values are only based on a single measurement (i.e. the DOB).

(a) Mean square error in landmark mid-point locations in , comparing SSMs landmarks with those from cadaver study.
(b) Error in widths for CB in .
Figure 7: Quantitative evaluation of landmarks locations and ligament width.

Excluding the AB, the average errors range between 2.5 and 12.0; i.e. for CB, DOAC, and DOB. In contrast, the AB exhibits considerably larger errors of about 30. This large value is mainly caused by dataset , for which the respective ligament was exceptionally proximal.

Besides the insertion locations, the accuracy of the generated models can be assessed by examining the widths of the ligaments. Figure (b)b shows exemplary the width of the CB for the five specimens, separately for radius and ulna. An average width of about 35 was found for this band in the cadaver dataset. Note that this differs considerably from the 9.7 average reported by Noda et al.

3.2 Similarity of Generated Ligament Meshes

In the second experiment, we examined the geometric similarity of ligament surface triangle meshes, generated following different strategies. As ground truth we employed meshes, which were manually segmented by a medical student in the previously described cadaveric study. Starting points for these were raw ligament meshes which were then cut employing ParaView Ahrens et al. (2015) into three sub-components, according to the provided metallic clip annotations (see Section 3.1) on both radius and ulna. Note that when only the ligament mid-points were known, then widths were set according to quantitative measurements of the cadaver study. The resulting meshes were further improved, e.g. by filling holes. Overall, this resulted in three triangle surface meshes, for the respective ligaments present in the forearm specimen datasets to .

To this ground truth we then compared two sets of ligament meshes generated with our geometric modelling framework. For the first, we obtain insertion locations with our newly developed statistical framework. The widths of the ligaments were given according to the findings by Noda et al. Noda et al. (2009); i.e. 9.7 for CB, 3.2 for DOAC, and 4.4 for DOB, respectively. Further, in the case of AB, an experimental value of 7 was assigned, since this measurement was not provided in their study. Similarly, thickness was set according either to their data, or to the values of our cadaver study. For the second set of meshes, the generation process was repeated, however, this time using the ground truth locations of the metallic clips as insertion points. Moreover, widths and thicknesses were set as measured in Carrillo et al. (2019). Overall, this resulted in two additional sets of meshes and , which were compared against the ground truth. To illustrate the resulting triangle mesh surfaces, Figure 8 depicts these exemplary for dataset

. Meshes are rendered for the ligaments DOAC, CB, and AB, showing the ground truth (beige) against the modelled ligament meshes (red). Ligaments generated with insertions from the statistical framework are shown on top, those using the annotated clips instead on the bottom. Note that in the latter case the visual similarity is higher, since the same insertion locations and widths were employed.

(a) Modelling with landmarks from our statistical model.
(b) Modelling with landmarks given via clip annotation.
Figure 8: Comparison of modelled ligament meshes (red) against ground truth (beige) for example dataset (in this case comprising AB, CB, DOAC).

In order to quantify the similarity between a modelled triangle surface mesh () and the ground truth (), we computed four standard shape similarity metrics:

  1. the mean Euclidean distance – for all vertices in to their nearest neighbor vertices in ;

  2. the average symmetric surface distance – averaging all distances, from vertices in to nearest neighbors in and vice versa;

  3. the root mean square distance – given as square root of the average of all square distances from vertices in to nearest neighbors in and vice versa;

  4. the common Hausdorff distance between two points sets (see e.g. Rote (1991)).

The latter is given as the largest of all distances from a vertex in one mesh to the closest point in the other mesh. Applying these metrics, we obtain similarity measurements for both sets of modelled ligaments, in comparison to the ground truth. The data are compiled in Table 1. For each of the five forearm specimens the similarity metrics are provided (in ) per ligament and modelling approach. Also, the average over all values is specified.

As can be seen, surface meshes modelled using statistical prediction of insertion locations () exhibit larger errors compared to using the exact insertion locations (

). This is expected, since in the latter case the error to the ground truth is only due to differences in shape of the surfaces. In contrast, in the former case it is also resulting from differences in the ligament attachments and widths. Clear outliers (in bold) are the

metrics for the AB in and . The main reasons is the identification of the AB ligaments in those cadaver specimens on the proximal instead of the distal portion of the bones. Such a case was not included in the SSM training data. This underlines the high morphological variation in the forearm ligament anatomy. The relatively low errors for indicate that the ligament mesh modelling process can provide reasonable results, given insertion locations and widths of sufficient accuracy.

Data- Liga-
set ment
AB 22.14 5.74 8.97 0.24 5.92 0.73 7.875 1.161
CB 31.64 7.48 0.33 0.28 5.45 0.99 7.73 1.38
DOAC 13.40 7.20 4.55 0.49 3.11 1.50 3.87 1.93

AB 24.90 7.70 2.91 0.38 7.01 1.45 8.85 2.23
CB 13.82 9.61 0.62 0.84 4.06 1.74 4.81 2.37
DOAC 20.17 3.83 2.89 0.65 5.00 1.37 6.91 1.65

AB 95.98 3.13 3067.31 0.65 70.83 0.98 71.8 1.2
CB 13.67 5.73 0.62 0.45 2.30 0.77 3.29 1.03
DOAC 20.28 7.22 99.98 0.47 11.31 1.51 11.56 2.02

AB 75.41 2.23 2873.54 0.37 57.06 0.63 57.69 0.76
CB 33.51 8.02 0.84 0.61 6.86 0.99 9.67 1.32
DOAC 4.19 6.57 1.12 0.81 1.62 1.25 2.02 1.63

AB 46.22 9.47 59.77 0.60 19.53 1.48 22.12 2.04
CB 27.71 6.81 13.75 0.75 5.18 1.19 7.54  1.45
DOB 15.95 13.75 3.37 1.25 4.82 2.19 5.76 3.1

Average
30.60 6.97 408.82 0.59 14.00 1.25 15.44 1.69
Table 1: Similarity errors in between ground truth and ligament meshes modelled with our pipeline, assuming different insertion locations and widths; compiled for three ligaments in five cadaver specimens (note DOAC vs. DOB); outliers are shown in bold.

4 Discussion & Conclusion

We have outlined an automatic framework for patient-specific musculoskeletal ligament modelling. To this end, we combined statistical shape models with landmark transfer and mesh generation algorithms. As a proof of concept we applied the generic framework to the test scenario of the interosseous membrane of the forearm. For this, a statistical shape model was created based on forearm image data of 18 healthy subjects. Our framework was then evaluated using an additional dataset of five annotated cadaver forearm specimens. Ligament insertion locations and shapes based on our framework have been compared to the reference specimens.

The landmark transfer algorithm is capable of automatically generating landmarks for any ligament based on a statistical anatomical shape model. Regarding the latter, for our test scenario the training dataset was still relatively small, with only 18 samples. Nevertheless, increasing the number of samples on the same order of magnitude may not directly lead to a large accuracy improvement, due to the high anatomical variation of the IOM ligaments and insertion locations among humans. Our study indicates that using distance ratios on average bone shapes, as proposed in previous work such as Noda et al. may not be of sufficient precision for a reliable clinical application. Another source of inaccuracy may arise from the labeling process, both for the SSM training samples as well as the cadaveric study; this step was performed by only a single person, which may also introduce deviations from the exact locations. Further, the number of samples in the ex-vivo experiment was low and may have to be increased to allow for an improved quantitative assessment. Finally, the separation of the segmented IOM complex into separate bands likely also has suffered from inaccuracies.

As outlined in our study, errors were still found between ligaments modelled according to SSM generated insertion points and corresponding segmentations of ground truth data. Nevertheless, given accurate ligament attachments and widths, our modelling framework can generate shapes with reasonable accuracy. Still, smaller error is introduced according to the anatomical distribution of thickness and width of the ligaments, which are irregular across axial and medial direction Carrillo et al. (2019); McGinley et al. (2001). Another source of possible inaccuracy in our modelling algorithm can be the ligament-bone connection boundaries. These were defined by line segments along the bone surface, between two given vertices. Modelling these as spline curves instead may increase accuracy.

Nevertheless, to the best of our knowledge, our study is the first to provide quantitative comparisons of automatically modelled interosseous membrane ligament shapes with meshes based on ex-vivo data. Moreover, we have presented a framework for automatic ligament mesh generation; it is generic and can easily be applied to the modelling of other ligaments in the human body. It remains to be seen, which effect errors in the geometric shapes of ligaments will have on the overall forearm motion behavior in biomechanical simulations.

Overall, the described development is part of a larger research project focusing on improving the quality of preoperative planning in upper extremities. The introduced framework constitutes one step towards a more accurate representation of ligaments for simulations of forearm motion. The inclusion of soft tissues into the preoperative planning is generally a challenging task, which requires sufficient quality of the geometric models of the anatomy. Further, ligament simulation is time-consuming and highly dependent on the morphological data. Nevertheless, mere anatomical information of soft tissue attachments along forearm bones could already improve the preoperative pipeline. For example, better implant positions could be chosen, when taking into account the presence of soft tissue. Also, time during surgery could be saved and healing times be improved, by generating less invasive intraoperative interventions. Still, in future work we will focus on using the meshes in biomechanical simulations in the context of computer-assisted forearm surgery planning.

Acknowledgements.
This work was supported by the Swiss National Science Foundation, under grant number 325230L_163308, and the Austrian Science Fund FWF, under grant number I 2545-N31.

References

  • J. Ahrens, B. Geveci, and C. Law (2015)

    An End-User Tool for Large Data Visualization, Visualization Handbook

    .
    Elsevier. External Links: Link, ISBN 978-0123875822 Cited by: §2.2.2, §2.3.3, §3.2.
  • F. Bandak, R. Tannous, and T. Toridis (2001) On the development of an osseo-ligamentous finite element model of the human ankle joint. International Journal of Solids and Structures 38 (10-13), pp. 1681–1697. External Links: Document Cited by: §1.
  • P. J. Besl and N. D. McKay (1992) Method for registration of 3-D shapes. In Sensor fusion IV: control paradigms and data structures, Vol. 1611, pp. 586–606. Cited by: §2.2.2.
  • K. H. Bloemker, T. M. Guess, L. Maletsky, and K. Dodd (2012) Computational knee ligament modeling using experimentally determined zero-load lengths. The open biomedical engineering journal 6, pp. 33. Cited by: §1.
  • R. H. Byrd, P. Lu, J. Nocedal, and C. Zhu (1995) A limited memory algorithm for bound constrained optimization. SIAM Journal on Scientific Computing 16 (5), pp. 1190–1208. External Links: Document Cited by: §2.2.4.
  • F. Carrillo, S. Suter, S. R., L. Nagy, J. G. Snedeker, and P. Fürnstahl (2019) Digitalization of the IOM: A Comprehensive Cadaveric Study for Improving Forearm Functional Simulations. Note: submitted Cited by: §3.1, §3.2, §4.
  • D. L. Fernandez (1982) Correction of post-traumatic wrist deformity in adults by osteotomy, bone-grafting, and internal fixation. J Bone Joint Surg Am 64 (8), pp. 1164–1178. Cited by: §1.
  • M. Fleute, S. Lavallée, and R. Julliard (1999) Incorporating a statistically based shape model into a system for computer-assisted anterior cruciate ligament surgery. Medical Image Analysis 3 (3), pp. 209–222. External Links: Document Cited by: §1.
  • M. Fujita (1995) An anatomical study on the interosseous membrane of the forearm. Nippon Seikeigeka Gakkai Zasshi 69 (10), pp. 938–950. Cited by: §2.1.
  • P. Fürnstahl (2010) Computer-assisted planning for orthopedic surgery. Vol. 64, ETH Zurich. Cited by: §1.
  • M. Graf, S. Diether, L. Vlachopoulos, S. Fucentese, and P. Fürnstahl (2014) Automatic string generation for estimating in vivo length changes of the medial patellofemoral ligament during knee flexion. Medical & Biological Engineering & Computing 52 (6), pp. 511–520. External Links: Document Cited by: §1.
  • T. Heimann (2009) Statistical shape models for 3D medical image segmentation. VDM Verlag, Saarbrücken, Germany, Germany. External Links: ISBN 3639050568, 9783639050561 Cited by: §2.2.1.
  • J. H. Ho, W. Z. Lung, C. L. Seah, C. L. Poh, K. Sheah, D. T. T. Lie, and K. S. A. Yew (2010) Anterior cruciate ligament segmentation: using morphological operations with active contour. In 2010 4th International Conference on Bioinformatics and Biomedical Engineering, Vol. , pp. 1–4. External Links: Document, ISSN 2151-7622 Cited by: §1.
  • [14] ITK, the Insight segmentation and registration ToolKit. Note: http://www.itk.org Cited by: §2.2.2.
  • P. Kasten, M. Krefft, J. Hesselbach, and A. Weinberg (2002) Computer simulation of forearm rotation in angular deformities: a new therapeutic approach. Injury 33 (9), pp. 807–813. Cited by: §1.
  • L. Kettner (2019) 3D polyhedral surface. In CGAL User and Reference Manual, External Links: Link Cited by: §2.3.3.
  • T. Kitamura, H. Moritomo, S. Arimitsu, L. J. Berglund, K. D. Zhao, K. An, and M. Rizzo (2011) The biomechanical effect of the distal interosseous membrane on distal radioulnar joint stability: a preliminary anatomic study. The Journal of Hand Surgery 36 (10), pp. 1626–1630. External Links: Document Cited by: §1, §3.1.
  • H. Lee, H. Hong, and J. Kim (2014) Segmentation of anterior cruciate ligament in knee MR images using graph cuts with patient-specific shape constraints and label refinement. Computers in biology and medicine 55, pp. 1–10. Cited by: §1.
  • W. E. Lorensen and H. E. Cline (1987) Marching Cubes: A High Resolution 3D Surface Construction Algorithm. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’87, New York, NY, USA, pp. 163–169. External Links: ISBN 0-89791-227-6, Document Cited by: §2.2.2.
  • M. Lüthi, R. Blanc, T. Albrecht, T. Gass, O. Goksel, P. Büchler, M. Kistler, H. Bousleiman, M. Reyes, P. Cattin, and T. Vetter (2012) Statismo - a framework for PCA based statistical models. Note: http://hdl.handle.net/10380/3371 Cited by: §2.2.3.
  • M. Lüthi, T. Gerig, C. Jud, and T. Vetter (2018) Gaussian process morphable models. IEEE Transactions on Pattern Analysis and Machine Intelligence 40 (8), pp. 1860–1873. Cited by: §2.2.1, §2.2.2, §2.2.3.
  • K. O. Matsuki, K. Matsuki, S. Mu, T. Sasho, K. Nakagawa, N. Ochiai, K. Takahashi, and S. A. Banks (2010) In vivo 3D kinematics of normal forearms: analysis of dynamic forearm rotation. Clinical biomechanics 25 (10), pp. 979–983. Cited by: §1.
  • F. Mauler, C. Langguth, A. Schweizer, L. Vlachopoulos, T. Gass, M. Lüthi, and P. Fürnstahl (2017) Prediction of normal bone anatomy for the planning of corrective osteotomies of malunited forearm bones using a three-dimensional statistical shape model. Journal of Orthopaedic Research 35 (12), pp. 2630–2636. External Links: Document Cited by: §1.
  • J. C. McGinley, L. D’addessi, K. Sadeghipour, and S. H. Kozin (2001) Mechanics of the antebrachial interosseous membrane: response to shearing forces. The Journal of hand surgery 26 (4), pp. 733–741. Cited by: §4.
  • [25] MITK, the Medical Imaging Interaction Toolkit. Note: http://mitk.org/wiki/MITK Cited by: §2.2.2.
  • L. Nagy, L. Jankauskas, and C. E. Dumont (2008) Correction of forearm malunion guided by the preoperative complaint. Clinical orthopaedics and related research 466 (6), pp. 1419. Cited by: §1.
  • T. Nakamura, Y. Yabe, Y. Horiuchi, T. Seki, and N. Yamazaki (2000) Normal kinematics of the interosseous membrane during forearm pronation-supination—a three-dimensional MRI study. Hand Surgery 5 (01), pp. 1–10. Cited by: §1.
  • K. Noda, A. Goto, T. Murase, K. Sugamoto, H. Yoshikawa, and H. Moritomo (2009) Interosseous membrane of the forearm: an anatomical study of ligament attachment locations. The Journal of Hand Surgery 34 (3), pp. 415–422. External Links: Document Cited by: §2.1, §3.1, §3.2.
  • F. Péan, F. Carrillo, P. Fürnstahl, and O. Goksel (2017) Physical simulation of the interosseous ligaments during forearm rotation. In CAOS 2017. 17th Annual Meeting of the International Society for Computer Assisted Orthopaedic Surgery, K. Radermacher and F. R. Y. Baena (Eds.), EPiC Series in Health Sciences, Vol. 1, pp. 181–188. External Links: ISSN 2398-5305, Document Cited by: §1.
  • J.M.T. Penrose, G.M. Holt, M. Beaugonin, and D.R. Hose (2002) Development of an accurate three-dimensional finite element knee model. Computer Methods in Biomechanics and Biomedical Engineering 5 (4), pp. 291–300. External Links: Document Cited by: §1.
  • J. Pfaeffle, J. Weiss, J. Gardiner, K. Fischer, T. Manson, M. Tomaino, J. Herndon, and S. Woo (2000) The stress and strain distribution in the interosseous ligament of the human forearm varies with forearm rotation. In Trans 46th Meeting Orthop Res Soc, Vol. 25, pp. 140. Cited by: §1.
  • M. Rahman, M. S. Renani, A. Cil, and A. Stylianou (2018) Musculoskeletal model development of the elbow joint with an experimental evaluation. Bioengineering 5 (2), pp. 31. External Links: Document Cited by: §1.
  • G. Rote (1991) Computing the minimum hausdorff distance between two point sets on a line under translation. Information Processing Letters 38 (3), pp. 123–127. External Links: Document, Link Cited by: item 4.
  • [34] Scalismo - scalable image analysis and shape modelling. External Links: Link Cited by: §2.2.3.
  • S. Shimawaki, M. Oniwa, M. Nakabayashi, N. Sakai, H. Sugimoto, and S. Yamazaki (2015) Deformation of the distal radioulnar ligament during rotation using finite element analysis. Journal of Biomechanical Science and Engineering 10 (2). External Links: Document Cited by: §1.
  • H. Si (2015) TetGen, a Delaunay-Based Quality Tetrahedral Mesh Generator. ACM Trans. Math. Softw. 41 (2), pp. 11:1–11:36. External Links: ISSN 0098-3500, Link, Document Cited by: §2.3.3.
  • J. R. Skahen, A. K. Palmer, F. W. Werner, and M. D. Fortino (1997) The interosseous membrane of the forearm: anatomy and function. The Journal of Hand Surgery 22 (6), pp. 981–985. External Links: Document Cited by: §2.1.
  • [38] The CGAL Project, Computational Geometry Algorithms Library, 4.8.2 edition. Note: http://www.cgal.org Cited by: §2.3.3.
  • L. D. Ward, C. G. Ambrose, M. V. Masson, and F. Levaro (2000) The role of the distal radioulnar ligaments, interosseous membrane, and joint capsule in distal radioulnar joint stability. The Journal of hand surgery 25 (2), pp. 341–351. Cited by: §1.
  • A. Weinberg, I. Pietsch, M. Helm, J. Hesselbach, and H. Tscherne (2000) A new kinematic model of pro- and supination of the human forearm. Journal of biomechanics 33 (4), pp. 487–491. Cited by: §1.
  • J. A. Weiss, J. C. Gardiner, B. J. Ellis, T. J. Lujan, and N. S. Phatak (2005) Three-dimensional finite element modeling of ligaments: technical aspects. Medical Engineering & Physics 27 (10), pp. 845–861. External Links: Document Cited by: §1.
  • T. Yasutomi, Y. Nakatsuchi, H. Koike, and S. Uchiyama (2002) Mechanism of limitation of pronation/supination of the forearm in geometric models of deformities of the forearm bones. Clinical Biomechanics 17 (6), pp. 456–463. Cited by: §1.
  • M. Zheng, Z. Zou, P. J. Bartolo, C. Peach, and L. Ren (2017) Finite element models of the human shoulder complex: a review of their clinical implications and modelling techniques. Int J Numer Method Biomed Eng 33 (2). Cited by: §1.