Non-linear Hysteresis Compensation of a Tendon-sheath-driven Robotic Manipulator using Motor Current

Tendon-sheath-driven manipulators (TSM) are widely used in minimally invasive surgical systems due to their long, thin shape, flexibility, and compliance making them easily steerable in narrow or tortuous environments. Many commercial TSM-based medical devices have non-linear phenomena resulting from their composition such as backlash and dead zone hysteresis, which lead to a considerable challenge for achieving precise control of the end effector pose. However, many recent works in the literature do not consider the combined effects and compensation of these phenomena, and less focus on practical ways to identify model parameters in real field. In this paper, we propose a simplified piece-wise linear model to compensate both backlash and dead zone hysteresis together. Further, we introduce a practical method to identify model parameters using motor current from a robotic controller for the TSM. We analyze our proposed methods with multiple Intra-cardiac Echocardiography catheters, which are typical commercial example of TSM. Our results show that the errors from backlash and dead zone hysteresis are considerably reduced and therefore the accuracy of robotic control is improved when applying the presented methods.

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

09/14/2021

Shape-adaptive Hysteresis Compensation for Tendon-driven Continuum Manipulators

Tendon-driven continuum manipulators (TDCM) are commonly used in minimal...
05/23/2021

Design and Development of a Prototype Robotic Gripper

Robotic grippers are widely used in industries for handling objects. Thi...
09/12/2020

Towards Automatic Manipulation of Intra-cardiac Echocardiography Catheter

Intra-cardiac Echocardiography (ICE) has been evolving as a real-time im...
02/17/2022

Design of EMG-driven Musculoskeletal Model for Volitional Control of a Robotic Ankle Prosthesis

Existing robotic lower-limb prostheses use autonomous control to address...
11/13/2020

Coordinated Motion Control and Event-based Obstacle-crossing for Four Wheel-leg Independent Motor-driven Robotic System via MPC

This work presents the coordinated motion control and obstacle-crossing ...
11/19/2021

Takagi-Sugeno Fuzzy Modeling and Control for Effective Robotic Manipulator Motion

Robotic manipulators are widely used in applications that require fast a...
01/05/2021

Weight-of-evidence 2.0 with shrinkage and spline-binning

In many practical applications, such as fraud detection, credit risk mod...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

I Introduction

The tendon-sheath mechanism (TSM) is a popular control method that has been applied in many therapeutic [daoud1999ep, khoshnam2015robotics, khoshnam2017robotics, bai2012worldwide, khan2013first] and real-time diagnostic (e.g. endoscope [ott11endoscopy, le16survey, dario03review, phee97locomotion], colonoscope [chen06kinematics], and Intra-cardiac Echocardiography [loschak16ice, kim2020automatic]) manipulators to achieve steerability by providing a long, thin, flexible structure that is compliant with anatomy. These TSM-based steerable manipulators are favorable in narrow and tortuous conditions, which makes them well-situated in relation to the growing shift towards minimally invasive treatment.

While the TSM-based manipulator has many advantages and wide adoption, the performance is still limited by non-linear frictional behaviors caused by: 1) backlash hysteresis due to friction forces between the sheath and tendons, 2) dead zone due to structural wire slack in the driving parts, and 3) plastic torsion due to the complex arrangement of threads and tubes about the center of the device. These factors contribute to the degradation of control accuracy and limit the potential performance of robotic controllers for off-the-shelf TSM-based devices.

Simple TSM-based applications consist of a polymer sheath with one to four sliding thread tendons equally spaced concentrically within the sheath. Many common commercial products (e.g. endoscopy, Intra-cardiac Echocardiography (ICE), Transesophageal Echocardiography (TEE), etc.) utilize two antagonistic pairs of tendons which are each bound to control knobs at the proximal end of the device. An individual tendon can then be pulled, and the distal tip of the device bent, by rotating the associated control knob; thus, allowing the antagonistic tendon to remain inactive. This structure assumes an ideal zero-slack transition between paired tendons; however, this is not realistically achievable. Moreover, the center of the device can either be hollow or house multiple components in a central channel (e.g. camera, ultrasound transducer, grasping tools). Highly non-linear behaviors exist because of these structural considerations.

Accordingly, flexible TSM manipulators for different tasks will have different non-linear hysteresis of the tendon threads. An external robotic control system would therefore need to calibrate these effects before accurate manipulation can be achieved. Whether robotic control is being considered for disposable or reusable TSM manipulators, calibration would be required before each use.

Precise prediction of the tool tip pose for a specific knob configuration is challenged by these non-linear properties. Moreover, there are practical limitations (i.e. sterilization, cost, and size) which restrict adding traditional sensors to the tool tip to provide the necessary feedback for closed-loop control. As such, the control strategy for such a robotic system is open loop with no spatial feedback. However, much research has focused on modeling TSM itself without consideration of practical constraints and needs.

Fig. 1: A representative diagram and scenario: Given desired pose at a given time, our goal is to compensate the configuration states, finding a compensated motions that minimizes errors. The compensated configuration gives input equal to output while without compensation generates dead zone and backlash. A novel ideas are that 1) we propose a simplified hysteresis model for both dead zone and backlash. 2) the model parameters are mainly identified using motor current with behavior motions.

In this paper, we introduce new methods to model non-linear hysteresis and a practical method for calibration of application in robotic control for TSM manipulators. More specifically, (1) we propose a simplified piece-wise linear model to compensate non-linear hysteresis of both backlash and dead zone together and (2) in response to limitations in current practical settings, we validate the relationship between non-linear hysteresis and motor current experimentally. Then, we propose a parameter identification method which associates motor current to particular motion behavior. Finally, we evaluate the proposed methods on benchtop with multiple catheters.

Ii Related Work

Recently, several researcheres have addressed the non-linear characteristics of TSM with various analytical models (e.g., friction, hysteresis models), image-based and data-driven approaches.

To overcome backlash hysteresis, many studies have proposed a static model using coloumb friction [kaneko91tendon, kaneko92tendon, chiang09tendon, fuxiang08tendon, chen12tendon, palli06tendon, palli06optimal]. Tension propagation is represented with a friction coefficient and the radius curvature (the shape) of the sheath. However, it could not reflect the dynamic effect when the direction was changed, and the backlash function is discontinuous.

Various mathematical models including differential equations such as Bouc-Wen model and Prandtl-Ishlinskii model have also been proposed to reflect the dynamic characteristics [radu09identification, hassani13piezo, do14hysteresis, do15adaptive]

. However, there exist many hyperparameters, and the parameter identification is complicated. Mostly, additional sensors are required with controlled environments. In addition, they focus on varied shapes of backlash hysteresis rather than considering dead zone. The enhanced Bouc-Wen model considers the dead zone like shape (called as pinching 

[Ismail2009ACME]), however their main module (i.e. energy function) is for structural engineering application (vibration, stress modeling), which is not relevant to continuously manipulating system.

Image-based method is also proposed [paolo17adaptive, reiter14appearance, baek20hysteresis]

. This method is more robust than the previous methods in which the model’s performance is affected when the shape of the sheath changes. Pose of the bending section is estimated through the obtained image, and feedback compensation is performed using the difference between the predicted bending angle and the input bending angle. However, the performance may change depending on the image quality or the presence of obstacles.

In order to overcome the dead zone, a data-driven method has been proposed [yoon13error, zhang14flexible]. Data is obtained by sweeping the bending section up/down and left/right before use, and the motion was compensated by mapping the input and output data. However, this method also always required an additional sensor before use.

Although various attempts have been made, additional sensors such as load cells, vision sensors, and encoders were required, and it is hard to attach additional sensors in a clinical environment. Also, only one degree of freedom is considered, and no studies have considered both backlash hysteresis and dead zone together.

Iii Materials and Methods

Fig. 2: (a)-(b) Illustrative examples of 2-DOF TSM-based manipulators: ACUSON AcuNav Volume ICE catheter, ACUSON V5Ms TEE probe. Source: Siemens Healthineers. (c) 2-DOF TSM-based body cross-section: four thread sections (orange) combining with polymer cover (black) and ultrasound array (or tools) section (green)

Iii-a Tendon-sheath-driven robotic manipulator

An overview of the robotic system is illustrated in Figure 1. This is a typical open-loop control diagram for tendon-sheath-driven robotic manipulators. Herein, we focus on how to model and identify hysteresis compensation. Therefore, we do not re-visit fundamental forward and inverse kinematics in this paper. The detailed kinematics models can be found in [kai08continuum, loschak16ice, kim2020automatic].

We briefly review our motorized system that can manipulate multiple degree-of-freedom (DOF) tendon-sheath-driven devices. The robot has four degrees of freedom; two DOFs for steering the tip in two planes (anterior-posterior knob angle and right-left knob angle ) using two knobs on the handle, and other two DOFs for bulk rotation and translation along the major axis of the catheter body. Since rotation and translation do not contribute to the hysteresis phenomenon, we will focus on the two knob controls. We define the robot’s configuration state, in .

Figure 1 also shows an exemplary scenario. First, the desired pose of the tip is given. Second, the desired robotic configuration state is computed from the inverse kinematics model. Next, our compensator is applied to compute the compensated motor configuration , which is directly applied to the motors. Then, the input versus the real output curve ideally shows a diagonal line for (i.e. when properly compensated) while (i.e. without compensation) might show a hysteresis curve including deadzone and backlash.

Since external sensors (e.g. load cell, electromagnetic (EM) tracker) are not considered in the field, we believe the only input that we can use is motor current relative to enacted motions. Thus, we analyze a relationship between the motor current and hysteresis curve in Section III-B.

Iii-B Systematic analysis of motor current and hysteresis curve

In order to find out the relationship between the non-linear hysteresis and the motor current, we conduct a systematic test where the desired input is a simple sweep motion in the form of a sine wave that has been commonly used in other studies [palli06tendon, palli06optimal, hassani13piezo, do14hysteresis, do15adaptive, do14friction, do16realtime, baek20hysteresis]. The sweeping angle range is , and collected data for and . Two cycles of sweeping motions are applied with , and the shape of the sheath is constrained to remain straight.

Fig. 3: One analytical data represents dead zone and backlash hysteresis: (a) the desired robot state versus the real ouput angle (b) the desired robot state versus the motor current.

We collect the following data with the sine wave motion for each knob: (1) the desired robot configuration input (), (2) the real output angle of the bending section using EM tracker (3D guidance, Northern Digital Inc.), (), and (3) the motor current acquired from motor drivers in real time. We applied the proper filter for all settings (3rd order Butterworth filter, cutoff frequency 20 hz). We demonstrate one representative data to understand the relationship between hysteresis curve and motor current. Figure 3(a) shows the desired angle versus the real output angle. Figure 3(b) shows the desired angle versus the real output current.

Lesson 1 from Figure 3(a): We know the desired input and the real output should be the same if for an ideal TSM. However, this shows multiple non-linear behaviors: (1) dead zone when the input angle is near zero, there is a dead zone that maintains a constant output value even if the input value increases (or decreases). (2) backlash hysteresis when the direction of motion is changed, there is delay in the real output angle rather than immediately increasing (or decreasing) the angle.

Lesson 2 from Figure 3

(b): To explain the motor current behavios, we classify two phases; (1)

phase 1(dead zone):  This is an interval from 0 to 90. As the input is increased from 0 to a certain angle, there exist a smooth flat signal shape. Also the current magnitude remains a constant value in this section. However, when exceeding the certain angle, the output angle is gradually increased, and the current magnitude is increased according to the output angle. The same phenomenon is observed when moving in the opposite direction. Thus, we believe that the current measure can be used to detect the dead zone width. (2) phase 2 (backlash):  This is an interval from 90 to 0

. The moment that the desired input changes direction shows an interesting phenomenon such that the output angle is maintained for some time before it is gradually decreased. Looking at the behavior of the motor current at this time, the current direction changes sharply in the opposite direction, and after making a small peak, it was kept constant at a value near zero. The reason for the peak is that when the wire changes from pulling to releasing, the tension does not change immediately, but because there is a transitional phase in which the tension gradually decreases, finally it will stay a certain current level as tension is balanced. We can observe that the point at which the current begins to become constant and the point at which the backlash hysteresis ends are related. Thus, we believe the critical points of backlash and dead zone can be represented by motor current measures.

Lesson 3 from Figure 4: Additionally, we check whether one DOF affects other DOF. is swept while is constant. We varied from 0 to 90 with 30 intervals. Figure 4(a) shows the dead zone is shifted as the fixed value of is increased. The same phenomenon is occurred with the motor current in Figure 4(b). In the case of the backlash hysteresis, there is no significant change in either graph. However, we observe that the backlash hysteresis ends and the motor current remains constant after the small peak is observed. Furthermore, in Fig. 4(a), the slopes of the output were similar except for the dead zone and backlash period, and also the output angles in the dead zone were similar. The opposite direction, i.e. when is decreased from 0 to -90, is not shown here, but the result is symmetric, which is biased to the negative side.

Fig. 4: Sweeping motion for when is varied positively (equal to 0, 30, 60; (a) hysteresis curve of (b) motor current of

Iii-C Modeling non-linear hysteresis using piecewise linear approximation

As shown in Figure 4(a), we have a highly non-linear object curve, but our given input is desired input and motor current. Therefore, we propose a piecewise linear approximation to represent the non-linear hysteresis phenomenon. Our model consists of a total of eight line equations, half of which are when the velocity is positive and others are when the velocity is negative. To define a finite collection of linear functions, we define four parameters; the range of the dead zone (), the height of the dead zone (), the size of the backlash hysteresis (), and the slope of the lines () when the velocity is positive and negative, respectively. All parameters of our proposed method are shown in Figure 5. Additionally, we define as a reference point, which is the degree of the input and the degree of the real output, respectively, and we made following three design decisions to reduce the complexity of the model.

Fig. 5: Our proposed piecewise linear model: eight equations represent non-linear hysteresis phenomena.
Design Decision 1

We assume that and are given when one DOF is swept while another DOF is fixed to 0 degree.

Rationale:  This is a reasonable assumption since another DOF stays on 0 degree, so we can minimize interference while one DOF is swept. The commercial catheter is usually calibrated for and with regard to real output for reference axis like . In this manner, it becomes fairly trivial to acquire a reference point in specific condition (i.e., (,)={(0,90),(90,0),(-90,0)…}) by visual inspection.

Design Decision 2

The slope of the lines of the one target device is constant.

Design Decision 3

The height of the dead zone is constant for the target device.

Rationale:  As our target device is a commercial product, so its physical properties are optimized as similar. We bring this data from mechanical data sheets, or we simply can measure it one time for each product.

Accordingly, we define eight linear equations composed of four parameters and given assumptions. Figure 5 shows how the equations are divided over the region and each equation is addressed in Equations(1) to (8).

(1)
(2)
(3)
(4)
(5)
(6)
(7)
(8)

The dead zone (3⃝, 7⃝) and backlash hysteresis (1⃝, 5⃝) parts consist of a line with the slope of zero, and the other parts consist of a line with the slope of . When the velocity is positive, the output moves on lines 2⃝, 3⃝, and 4⃝ located at the bottom, and when the velocity is negative, the output moves on lines 6⃝, 7⃝, and 8⃝ located at the top. When the direction of movement changes, the output moves on lines 1⃝, and 5⃝ that can give the backlash hysteresis effect.

Iii-D Parameter Identification

In order to use our proposed model, we need to identify the model parameters along with target devices. Based on above lessons, we use motor current to identify four parameters with given the reference point .

Iii-D1 One DOF calibration procedure

We start to explain one DOF calibration method assuming other DOFs zero. The range of the dead zone () and the size of the backlash hysteresis () were measured through the motor current. The dead zone is obtained by selecting a moment when the period of constant current ends and it starts to increase or decrease. To find this moment, the ’findchangepts’ function in Matlab was used. This function returns the index at which the mean value changes the most in the data, so the moment when the slope changes sharply can be found. The size of the backlash hysteresis is obtained by selecting the moment at which the current starts to become constant after a small peak after changing the moving direction. To find this moment, the ’findpeak’ function in Matlab was used. This function finds the local maxima in the data, and the local minima can be obtained by multiplying the data by -1 and using this function.

Fig. 6: Identification of the size of the backlash hysteresis and the range of the dead zone in the motor current data

The slope of the line (), which is not obtained from the motor current, however we can compute this from and given and (see design decision 1-3). Now we have and from motor current, and with given and . Thus, we can identify all parameters of one DOF hysteresis function .

The slope of the line (

), which is not obtained from the motor current, however we could get ′A′ using collected data for four ICE catheters. From there, we got the average value 1.32 and the standard deviation is 0.12, indicating that most of them had similar slopes. Lastly, the height of the dead zone (

) were calculated using the parameters obtained earlier. The slope of the line is already determined, and it must be the same as the slope of the line passing the reference point and the point where the dead zone ends, so the height of the dead zone can be calculated. The values obtained are used continuously in one catheter (see design decision 1-3).

Iii-D2 Multiple DOF calibration procedure

For multiple DOF calibration, we collect the motor current with systematic motion behaviors; First, one DOF is sweeping , while other DOFs are fixed at certain conditions. (We changed other DOFs degrees.) Second, we can extract the range of deadzone and the size of backlash from motor current using change of points algorithms. Third, We can get changed depending on other DOFs conditions. However, we have and from one DOF calibration procedure in Section III-D1. So given , , and , we can compute the reference point differently for each condition.

Due to the limited resources, we could not apply all possible motion combinations with multiple DOFs calibration. From discrete motion combination ( at

intervals), we can interpolate

based on collected data. We show one real data as a example in Figure 7. shows a downward convex bell shape, and shows an upward convex bell shape. Accordingly, we can estimate all conditions of parameters. Then, the model calibration is completed for the whole workspace.

Fig. 7: anterio-posterior knob is sweeping over the whole workspace while left-right knob is fixed one condition ( degrees). Change of dead zone with interpolation is demonstrated.

Now we have compensator , which covers the whole workspace for multiple DOF TSM manipulator. This compensation is used as a feed-forward control after receiving the desired input. Then, the desired input can be compensated by as shown Figure 1.

Iv Experiment and Result

Iv-a Experimental Setup

We used ICE catheter with robotic system shown in Figure 1, and Figure 2(a). The ICE catheter consists of two knobs, which controls and . First, we carried on parameter identification using methods in Section III-D. As mentioned in Section III-D1, we used as 1.32 as the average value, then is computed with the determined parameters.

Then, we conducted two experiments; (1) One DOF test: One DOF knob is swept while another DOF is a constant, but this keep changed to . We did this with and without compensator to compare. (2) Two DOF test: Both and are simultaneously moving. We applied a sine wave with the range of the range of degrees, But we applied different velocity; works with /sec while works with /sec. This leads the period of is twice times period of . All the data collection comes with EM tracking sensor to get the real measure.

Iv-B Result of the non-linear hysteresis compensation

We tested three catheters, which has different hysteresis curve, but we modeled and identified parameters based on our proposed method. To evaluate the proposed method, we demonstrate the magnitude of the peak-to-peak, which is measured the highest value and the lowest value of the sine wave. In addition, we use the root mean squared error (RMSE) to show errors.

Due to the limited page, we show only one figure for 1 DOF out of four catheters in Figure 8. However, we show the overall performance evaluation in Table I- II. Table I shows the peak-to-peak error, which shows our proposed method improved the peak-to-peat error by to . Table II shows a promising improvement by to . Catheter 1 is shown in Figure 8; The first two row is for motion while the last two row is for motion. We shows time versus output angle and the input angle versus the output angle. From the second and fourth row of Figure 8, our proposed method compensates motions such that the blue-dot line is changed to the red-dot line, which is close to the linear line.

We demonstrate 2 DOF results for three catheters in Figure 9. The first two column is for catheter 1. The next two is for catheter 2, the last two is for catheter 3. The first row shows time versus output angle for and having different frequency. The second row shows the input angle versus the output angle for and motions. We also show the peak-to-peak error and RMSE in Table III. The results show that the peak-to-peak error is improved by , and RMSE is improved by over our test range.

(a)
(b)
(c)
(d)
(e)
(f)
(g)
(h)
(i)
(j)
(k)
(l)
(m)
(n)
(o)
(p)
(q)
(r)
(s)
(t)
Fig. 8: The result of the non-linear behavior compensation for catheter 1: The black dot is the ground truth. The blue dot is without compensation. The red dot is with our compensation. The first row shows time versus output angle, and the second row shows the input angle versus the output angle for the anterior-posterior knob motion, thus the left-right knob is fixed as addressed. The third and the fourth rows are for the left-right knob motion accordingly.
(a) catheter 1,
(b) catheter 1,
(c) catheter 2,
(d) catheter 2,
(e) catheter 3,
(f) catheter 3,
(g) catheter 1,
(h) catheter 1,
(i) catheter 2,
(j) catheter 2,
(k) catheter 3,
(l) catheter 3,
Fig. 9: This demonstrates 2 DOF results for three catheter: The black dot is the ground truth. The blue dot is without compensation. The red dot is with our compensation. The first two column is for catheter 1. The next one is for catheter 2, the last one is for catheter 3. The first row shows time versus output angle, and have different frequency as we designed. The second row shows the input angle versus the output angle for and motions.
Fixed angle from other DOF
No compensation (deg) 50.15 41.84 39.00 41.54 48.07
With compensation (deg) 33.89 27.22 20.16 25.66 27
Improvement rate () 32.42 34.94 48.29 38.21 43.84
TABLE I: Peak-to-peak errors of 1-DOF for all catheters
Fixed angle from other DOF
No compensation (deg) 16.67 12.83 11.67 11.83 15.83
With compensation (deg) 9.16 6.5 5.33 6.33 6.67
Improvement rate () 45.00 49.35 54.29 46.48 57.89
TABLE II: Root mean squared error of 1-DOF for all catheters
Error Peak-to-peak RMSE
No compensation 44.48 14.76
With compensation 35.39 9.27
Improvement rate () 20.42 48.29
TABLE III: Peak-to-peak error and RMSE for 2-DOFs for all catheters

V Discussion

The experimental results show that the proposed method is effective to compensate for non-linear hysteresis. Figures 8 shows typical examples; there is a delay in the dead zone before compensation, but it is reduced after compensation. In addition, the desired input angle degree was not reached before compensation, but it can reach degree. Lastly, the shape of the graph shows a straight line shape similar to the ideal case after compensation, which is shown in Figure 8 from (f) to (j), and from (p) to (t).

Our model is the piecewise linear approximation so there exists a limitation, which might be able to show a jerk motion in transitions. For example, our approach generate the shape changes when entering or exiting the dead zone. However, we can observe that there is a discrepancy between real phenomena(Figure 3 and our model (Figure 5). Also the backlash hysteresis section is not straight line as we did in real phenomena. For this reason, we can observe the jerk movement.

The result of two DOF shows also good improvement, however, it is not as good as one DOF test. We believe that there exist a coupling effects in mechanical structures, which is not detected as much as we expected. However, most commercial products of TSM has a complicated mechanical structures inside due to considerations of multiple uses (e.g., ultrasound image, grasping tools). In our previous work [kim2020automatic], we demonstrated the method to compensate the plastic torsion effects due to coupling. However, it is also in constrained environments (the shape of sheath is linear). We think the motor current is limited to detect coupling effects, thus it might be necessary to add external sensors like load cells and tip tracking.

Our experimental setup has the shape constraints, which is the shape of the sheath in a straight line. First, we wanted to understand the relationship between motor current and hysteresis so that we can design methods to identify model parameters using motor current. We know that changes of the sheath shape is another challenging problem. However, based on our observation, shape changes mostly affect the width of dead zone . Since we can detect using motor current, if motions are allowed in working environments, we might be able to update parameters according to shapes.

Vi Conclusion

In this paper, we proposed a simplified piece-wise linear model to compensate non-linear hysteresis of both dead zone and backlash in tendon-sheath-mechanism. Moreover, We proposed a simple parameter identification method for practical settings (e.g., surgical room) based on our validation of relationship between hysteresis curve and motor current. Through the relationship between the non-linear hysteresis and the behavior of the motor current, the range of the dead zone and the size of the backlash hysteresis are obtained, and we get the slope of the straight line through mechanical properties or data-driven method. Accordingly, the height of the dead zone can be computed. All the parameters of our model were easily determined. Based on our proposed method, we can easily calibrate robotic manipulators for multiple medical devices without external sensors, which are not always possible in clinical environments. We applied our methods for ICE catheter robotic manipulators. We demonstrated 1-DOF and 2-DOF cases. The results show the errors for both are significantly reduced.

Disclaimer

The concepts and information presented in this abstract/paper are based on research results that are not commercially available. Future availability cannot be guaranteed.

References