Planning for Dexterous Ungrasping: Secure Ungrasping through Dexterous Manipulation

This paper presents a robotic manipulation technique for dexterous ungrasping. It refers to the capability of securely transferring a grasped object from the gripper to the robot's environment, i.e. the inverse of grasping or picking, through dexterous manipulation. The game of Go offers an example: consider how the player would typically place an initially pinch-grasped stone onto the board through the dexterous interaction between the fingers, the stone, and the board. Likewise, dexterous ungrasping addresses the necessity of changing the object's configuration relative to the gripper or the environment in order to securely keep hold of the object. In particular, we present a planning framework for determining a feasible minimum-cost motion path that completes dexterous ungrasping. Digit asymmetry in a gripper, i.e. difference in digit lengths, is discovered as the key to feasible and secure ungrasping. A set of experiments show the effectiveness of dexterous ungrasping in practical placement tasks.



There are no comments yet.


page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8


Grasping and Manipulation with a Multi-Fingered Hand

This thesis is concerned with deriving planning algorithms for robot man...

Fast and resilient manipulation planning for target retrieval in clutter

This paper presents a task and motion planning (TAMP) framework for a ro...

Integration of 3D Object Recognition and Planning for Robotic Manipulation: A Preliminary Report

We investigate different approaches to integrating object recognition an...

Contact Mode Guided Motion Planning for Dexterous Manipulation

Within the field of robotic manipulation, a central goal is to replicate...

Task-driven Perception and Manipulation for Constrained Placement of Unknown Objects

Recent progress in robotic manipulation has dealt with the case of previ...

Leveraging Touch Sensors to Improve Mobile Manipulation

Despite many advances in service robotics, successful and secure object ...

Efficient Object Manipulation to an Arbitrary Goal Pose: Learning-based Anytime Prioritized Planning

We focus on the task of object manipulation to an arbitrary goal pose, i...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

I Introduction

Consider the task of placing stones in the game of Go, as shown in Fig. 1. We humans seem to address this by exploiting in-hand dexterity, which we almost take for granted, to constantly reposition and reorient the object at hand while properly interacting with the environment. The current state of the art in robotic manipulation is, however, still some distance from practical proficiency in these capabilities that require dexterity; this may have necessitated the human operator that is actually able to place stones for AlphaGo in the matches against human champions.

This work presents the technique of dexterous ungrasping, applicable to a range of object handling tasks such as Go stone placement. The term ungrasping refers to the inverse of grasping; in other words, a robot “passes” an object to its environment throughout ungrasping. It is thus exemplified in placement, insertion, or assembly tasks. Grasping has been known as a challenging problem; likewise, ungrasping can be as difficult as grasping. Although there is a large body of work concerned with some particular ungrasping tasks (for example, peg-in-hole assembly), ungrasping through dexterous manipulation, the key novelty of the presented work, has received scant attention. Dexterity in ungrasping, which would not be necessary for simply dropping the object at gripper or for the traditional peg-in-hole assembly, is essential in case the object’s pose needs to be carefully adjusted relative to the gripper and to an environment. This situation is particularly common in ungrasping slender or thin objects, which may begin with initial pinch grasping on the faces of the object and then involve a series of actions to relocate the finger from the face and to match the face with a target surface. An example can be seen in the way a Go player normally places a stone at a desired location through picking, in-hand manipulation, and interaction with the board using the index and the middle finger.

Fig. 1: (a) Go stone placement by human. (b) How can a robot place a Go stone stably?

The key aspect of the presented work is planning for dexterous ungrasping. We provide a framework for planning complete, optimal, secure ungrasping motion. The planned path comprises motion primitives of contact interaction that can be realized with a simple two-digit, finger-thumb gripper model, one of the most common and versatile gripper architectures. The planner reveals that a structural asymmetry in the gripper, exemplified as the difference in digit lengths, is necessary to find a feasible ungrasping plan. Our experiment results, featuring a range of scenarios including the task of Go stone placement, demonstrate that our approach leads to effective and secure dexterous ungrasping.

Ii Related Work

This study is closely related to robotic dexterous manipulation, also referred to as in-hand manipulation. It is generally defined as the capability of changing the configuration of a manipulated object relative to the gripper [1]. One classical approach to robotic dexterity is to devise “dexterous hands” with multi-jointed fingers and to manipulate the object at hand through finely controlled fingertip contacts. For example, the three-fingered Salisbury Hand [2]

had nine degrees-of-freedom (DOF)—three DOF for each finger—which were shown to be the lower bound for performing dexterous manipulation with rigid, frictional, fixed (neither rolling nor sliding) contacts. In finger gaiting

[3, 4], referring to changing grasps by repositioning fingers while the object is being manipulated by other fingers, it is often assumed that extra mobility is available, e.g. six DOF for each finger [5].

Alternatively, it is also possible to achieve advanced dexterity using grippers with relatively low-DOF. [6] used a parallel-jaw gripper for regrasping, a sequential execution of grasping and ungrasping. A body of work [7, 8] shows that dexterous manipulation with simple grippers is facilitated by sliding contacts. Incorporating nonholonomic constraints by rolling contacts also renders simple grippers dexterous as studied in [9, 10]. Grippers adopting active finger contact surfaces for exploiting rolling contacts have been presented in [11]. Recent approaches to enhancing dexterity for simple grippers include taking advantage of external resources such as contact with environmental surfaces or dynamic motion [12, 13] and incorporating mechanical compliance or underactuation [14, 15].

The manipulation for ungrasping in this work is directly applicable to part insertion/placement, which is important in many application domains. The classical peg-in-hole insertion, surveyed in [16], in which the peg is push-inserted into the hole has received considerable attention from a range of aspects such as control strategies [17] and mechanical design [18]. Our challenge tasks in this work are different from the traditional peg insertion in that dexterity is of critical importance. Robotic bin packing [19] is another relevant problem that addresses packing objects into a possibly confined space in an orderly manner. [20] (and references therein) presents a learning-based approach to context-aware object placement. Note, many practical solutions to insertion, placement, and packing usually feature custom-made automated systems, which are generally difficult to repurpose.

Iii Preliminaries

Our previous work on shallow-depth insertion [21], depicted in Fig. 2(a), verifies that it is possible to perform a certain type of dexterous ungrasping, i.e. dexterous insertion, securely without losing hold of the object. Here we review that work, but with a more detailed model of mechanics.

(a)Parallel-finger gripperObjectHole(b)FingerFingerHole(c)
Fig. 2: (a) Shallow-depth insertion using a conventional parallel-finger gripper. (b) Releasing the linear object from the gripper: the contacts and remain fixed while is sliding and is increased. (c) Bringing the object to the hole: , , and remain fixed while is decreased.

The key to successful shallow-depth insertion is the change of grasp realized by the motion primitive shown in Fig. 2(b), modeling the real setting in Fig. 2(a) on the plane normal to the hole’s bottom face. Fig. 2(b) thus features a grasp on a linear object composed of three point contacts at , , and , formed by a flat-bottomed hole and a parallel-finger gripper with two fingers of the same length. This primitive is used for releasing the object from the gripper. At , the finger slides on the object such that moves distally towards the fingertip. In the meantime, and are supposed to be fixed. It is kinematically possible to do so by coordinating the motions of the one-DOF gripper and a holonomic arm: the arm’s mobility can be used for rolling (or fixing) the fingertip at , counterclockwise as shown in Fig. 2(b), and the gripper’s mobility for providing enough space for the increasing distance between and the other finger’s face.

To complete the insertion, the motion primitive in Fig. 2(b) is combined with another modeled in Fig. 2(c), where the object is moved closer to the hole’s bottom through a rotation about , and all the contacts thus remain fixed. Fig. 3(a) shows an example motion path for complete shallow-depth insertion represented in the three-dimensional configuration space of the object-gripper-hole system, parametrized by , , and (refer to Fig. 2). Note, the dimensionless form of , where denotes the length of the linear object, was used in Fig. 3(a). At the terminal goal configuration of the path , is at its minimum, zero, such that the object’s face is in contact with the hole’s bottom face, and is at its maximum, , such that the object is out of the workspace of the gripper, whose fingers are the same length. At the initial configuration , the linear object is pinch-grasped by the fingers; thus, . The motion primitive in Fig. 2(b) (Fig. 2(c)) reconfigures the system along the -axis (-axis), while keeping fixed. The entire motion from to is therefore shown as a piecewise straight path on the -plane.

Fig. 3: (a) Complete insertion path (red arrow) contained in the set of force-closure grasps shaded gray (both light and dark), computed with the unit contact wrenches shown in (b), denoted at the contact . denotes the friction coefficient at . The colored contours delineate the cross-sections of the set on the -planes. (c) Grasp with no force-closure, marked in the lightly shaded volume in (a), due to the flatness at .

Throughout the entire insertion process, the object is kept in force-closure. In other words, the insertion motion path shown in Fig. 3(a) is contained in the volume representing the collection of force-closure grasps, shaded gray (regardless of color intensity for now), which is obtained in a numerical, sampling-based manner. For each sampled configuration

, a test for force-closure is formulated as a linear program verifying whether it is possible to span the entire wrench space

[22]. Fig. 3(b) shows the unit contact wrenches used for the test. These unit wrenches model the force interaction when the motion primitive in Fig. 2(b) is executed. At and , the contact wrenches are spanned by two unit wrenches, the normals of the hole corner edges at and the edges of the friction cone at . The contact wrenches at are spanned solely by the edge of the friction cone that is consistent with the sliding of the object toward the fingertip. With these unit wrenches, the entire shaded volume represents the grasps in force-closure throughout the whole process, in a conservative manner because there will be an additional unit wrench at , i.e. the other edge of the friction cone, when the other motion primitive shown in Fig. 2(c) is executed. That the object is kept in force-closure enabled the successful insertion demonstrations in [21].

Iv Planning-through-Contact for Dexterous Ungrasping

The viability of the special-case operation, shallow-depth insertion, motivates us to devise a generalized solution to dexterous ungrasping that can address a wider range of situations, e.g. placement onto a flat surface with no concavity, extending the task of insertion. Critical issues expected in the generalization are as follows. First, consider a placement situation in Fig. 3(c) whereby the contact is on a flat surface, unlike Fig. 3(b) where is at a concave corner. The contact wrenches at are thus spanned by the friction cone edges. Here, force-closure is unattainable. The red-shaded region labeled with “

” represented according to the method of moment labeling

[16] graphically indicates the inability to exhaust the entire wrench space. This happens near the goal configuration, with relatively large and small . The robot can thus lose the object near the goal (to be shown in our experiments). The collection of those configurations with no force-closure during the placement is represented as the volume shaded light gray in Fig. 3(a), around . Second, the two motion primitives used in the insertion (Fig. 2(b-c)) are inadequate to fully navigate the configuration space, e.g. across different values in Fig. 3(a). This problem can complicate collision avoidance. This section presents a planning framework to address these concerns.

Fig. 4: (a) Generalized model of planar ungrasping with a semi-elliptical object and a gripper whose fingertip (currently at ) can be placed freely relative to the thumb, as implied by the silhouette of a multi-jointed finger. The arrows are the contact normals. (b) 3D view of the ungrasping setting.

Iv-a Problem Formulation

We consider a generalized yet still planar ungrasping situation as shown in Fig. 4(a). Compared with the previous setting in Fig. 2, it features a more sophisticated, finger-thumb gripper model in which the fingertip can be placed freely with respect to the thumb’s face, a target surface without necessarily a concave corner, and an object with a convex contour such that the contact normals between the bodies are well-defined like Fig. 4(a). Similarly to the previous case, the gripper is assumed to be wielded by a three-DOF holonomic arm in the plane, and the contact interactions between the bodies in the object-gripper-environment system, all assumed to be rigid, are abstracted with the three unilateral point contacts at (between the object and the target surface), (between the fingertip and the object), and (between the object and the thumb’s face).

Let denote the configuration space of the object-gripper-environment system. The problem of the manipulation planning for secure ungrasping is then formalized as follows:

Find a feasible motion path in along which the object initially pinched by the gripper is taken toward the goal configuration where it rests on a target surface, with no loss of grasp security all the way through.

To keep hold of the object securely as required, is limited to the configurations in which the contacts , , and are appropriately maintained. For example, at any time at least two contacts (or four unit contact wrenches) are necessary for force-closure in the plane [22]. It is thus necessary to do planning-through-contact: how to arrange the contact interactions in the system, which will be embodied as dexterity, such that the object is safely ungrasped.

Each contact constraint at , , or can be regarded as a two-DOF joint in the sense that the contact can be either sliding or rolling. In case all the three contacts are active for example, the system is modeled as a planar linkage with three two-DOF joints, and a configuration of the system is represented as a six-tuple. The use of the three parameters , , and in Fig. 2 is a specialization of this concept due to the kinematic constraints imposed by an ordinary parallel-finger gripper handling a linear object.

We make further remarks about the viability of our setting in Fig. 4(a). This planar setting abstracts a real-world ungrasping situation illustrated in Fig. 4(b) with a thin, flat object and a multi-jointed gripper, under the assumption that the object’s motion out of the -plane can be effectively suppressed. To satisfy this, it is necessary to first align the object along an antipodal pair, for example, along a pair of parallel edges as shown in Fig. 4(b) with the rectangular object. This problem of regrasping/reorienting a pinch-grasped thin flat object has been a topic of interest in recent comprehensive studies [13, 23]. These can be performed prior to our ungrasping operation for the initial alignment, and then the use of the planar setting is justified.

Iv-B Planner Framework

Algorithm 1 presents our solution to the planning-through-contact problem for dexterous ungrasping that is applicable to a high-dimensional space, facilitates constraint checking, and yields an optimal solution with respect to a criterion of choice. Overall, the algorithm is based on the RRT* algorithm [24]. The pseudocode thus features the key methods of RRT* for sampling the configuration space to build a space-filling tree and for finding an optimal path from an initial configuration to a final . Specifically, we explore the search space through contact interactions, that is, sliding or rolling at the contacts , , and , and adopt a test for grasp security when building the tree. As will be elaborated below, these make it possible for the RRT* variant to plan through contact for dexterous ungrasping.

Algorithm 1 Dexterous Ungrasping Planner
Input: , Output: tree 1: 2:Repeat 3:       4:       5:       6:       if then 7:           8:           9:           10:Until reaches , a neighborhood of

First, the search space is explored using the motion primitives that determine the standardized ways to traverse the space through contact interaction. Each motion primitive thus specifies the contact modes at , , and . For example, the contact modes featured in the motion primitive in Fig. 2(b)—rolling at and , sliding at —can be denoted by


expressed as the sequence of the contact labels (rolling at the contact ) or (sliding at ). Likewise, the primitive in Fig. 2(c) is denoted by


From now on, motion primitives will be distinguished by the contact labels. In practice, a motion primitive also needs to specify the relationship between the configuration variables such that the search space can be traversed along a well-defined one-dimensional arc subject to the motion constraints imposed by the robot platform to use and the object’s shape (example in Sec. IV-C). The resulting path will then consist of the concatenation of the primitives. The method UngraspPrimitives in Algorithm 1 is the key to realize these ideas. It takes as input , a sampled configuration, and , the node closest to in the swath of . It then applies pre-defined motion primitives from to compute a set of locally reachable configurations. Among these, it returns , the one closest to , to be potentially connected to in the subsequent steps. The way we plan-through-contact with the motion primitives thus bears a similarity to the way differential constraints are typically addressed in sampling-based planning.

Second, we define the free configuration space , i.e. the search space of the algorithm, as:


where is the obstacle space and is the collection of secure grasps. Therefore, not only kinematic collisions between the gripper and the environment but also grasp security is taken into consideration when an edge is added to . Specifically, in the Free method that runs a test to determine whether can be connected to , we characterize grasp security as force-closure. Given the motion primitive to reach , force-closure is verified using a linear test transcribed with the contact modes determined by the primitive, as instanced in Sec. III. When running Algorithm 1, the computational cost of the linear programming is thus incurred in addition to that of the baseline RRT*.

Examples of the cost function for the RRT*-based framework include


where denotes the scalar positive cost of a node computed in an additive manner based on that of its parent . We assign the added term the number of contact mode switch-overs happening at , , and to reach from , due to a possible change of motion primitive at . In other words, frequently changing motion primitives (i.e. contact modes) are penalized. For example, if the motion primitive is preceded by , is assigned to be because there is one contact mode switch-over at . The cost function is initially computed after is inserted into (Line 7, Algorithm 1), and recalculated when is rewired (Line 9).

Iv-C Examples

We now present numerical examples of planned dexterous ungrasping generated by our software111 implementing Algorithm 1. Our planning scenes feature a two-fingered gripper interacting with a flat-bottomed object and other environmental surfaces (see Fig. 6(a) for example). The gripper is arranged to be a one-DOF parallel-finger gripper. Its two flat-faced fingers are controlled to move in the direction normal to the face. This arrangement is not only practically important but also conducive to visualizing the planning results, again using the three parameters , , and . Note, all the three contacts , , an are kept active all the way. At the initial configuration where the object is in a stable pinch grasp, is zero. At the goal , is zero (object lying on the target surface) and is at the tip of the thumb (object almost released from the gripper).

Fig. 5: Motion primitive to decrease . Both and slide while remains fixed.

The set of motion primitives used in the examples include the two, and , in Fig. 2(b-c). In case of object shape as a line segment, the former one is implemented using the parallel-finger gripper by imposing the following motion constraints


where denotes the commanded opening speed of the gripper in terms of the gripper’s orientation relative to the object. At the same time, the arm is controlled to increase . Given a different object shape, the control law can be adapted accordingly. In the latter, , only the gripper’s orientation relative to the surface is changed by the arm. In addition, the motion primitive illustrated in Fig. 5 with contact labels


is applied to changing by sliding and at the same time. This is also executed by the gripper control law Eq. 5 while the arm is controlled to move , in case of a linear object. The three primitives enable the planner to fully explore the three-dimensional configuration space .

(a)Target surfaceFingerThumb(b)()()
Fig. 6: (a) Planning scene for the placement of a linear object with a parallel-finger gripper. The collision hulls of the digits and the target surface are as depicted. (b) Failed to connect and . () is the region shaded gray (red).
(a)Target surfaceFingerThumb()()(b)Target surfaceFingerThumbObstacle()()(c)Target surfaceFingerThumb()()
Fig. 7: Successful planning for dexterous ungrasping (a) with digit asymmetry, (b) around another obstacle, and (c) with a semi-elliptical object. Each example depicts the planning scene on the left with the collision hulls of the bodies that can interact. The planned paths connecting and are shown in the -space. () is the region shaded gray (red). The green branches represent the search tree , constructed through 1,000 iterations (this took 36-38 seconds with our software written in Matlab).

Iv-C1 Failure with an ordinary parallel-finger gripper

First, we ran the planner with an ordinary parallel-finger gripper whose fingers are the same length (Fig. 6(a)). The planner was unable to find a feasible ungrasping path for the linear object because lies outside even when all the contacts , , and are fixed, as plotted in Fig. 6(b). In fact, all the other potential goal configurations at and lie outside , as aforementioned (recall Fig. 3(c)).

Iv-C2 Successful planning with digit asymmetry

Next, we seek to exploit the increased freedom of the gripper model in Fig. 4 by considering an asymmetric parallel-finger gripper. See the planning scene in Fig. 7(a) again with a linear object. The two flat-faced fingers are now different lengths (i.e. asymmetric) although these still open/close in the direction normal to the face. We call the longer one a finger and the shorter one a thumb. The asymmetry is quantified using the following dimensionless parameter :


where () denotes the position of the finger’s tip (thumb’s tip) along the -direction parallel to its contact surface (Fig. 7(a)). is always nonnegative since , i.e. the finger is no shorter than the thumb. The value of asymmetry dictates the value of at as follows:


and are also evaluated at , where is at the thumb’s tip. For an ordinary parallel-finger gripper with same-length fingers, is kept zero and thus . For a gripper with positive , becomes less than . This enables the planner to find a complete solution. Given , a path to where and was found in as shown in Fig. 7(a). The path, depicted as the black dashed line in the figure, represents a sequence of three motion primitives, each of which is shown as a line segment of fixed orientation: at the beginning, then briefly, and finally .

Iv-C3 Successful planning around another obstacle

In Fig. 7(b), a fixed obstacle was added to the planning scene, which resulted in a greatly enlarged . With the same asymmetric gripper setting as the previous example, our planner found a solution, a sequence of four motion primitives.

Iv-C4 Successful planning with semi-elliptical object

Fig. 7(c) features a planning scene with a nonlinear, semi-elliptical object. The path was planned with two primitives, and . It was necessary to adapt the primitive to two distinct cases. First, when is formed in the interior of the finger’s face, the finger rolls on the curved object. Second, when is at the sharp fingertip, the finger rotates about it and the location of is fixed. The planned path begins with with on the finger’s face, switches to another with at the fingertip, and terminates with .

Remark: These examples indicate the advantages offered by the introduction of digit asymmetry, i.e. the combination of a longer finger and a shorter thumb, enabled by the generalized gripper model (Fig. 4). First, it becomes possible to maintain force-closure all the way through. This is because digit asymmetry provides a greater degree of flexibility in the way ungrasping can be terminated: can be set less than as discussed. Second, decreased will reduce the duration of ungrasping. Third, the component of representing the collision between the thumb and the target surface shrinks with increased because of the relatively shortened thumb (compare Fig. 6 and Fig. 7(a)). Practically, these benefits can easily be reaped by using the asymmetric parallel-finger gripper featured in the examples.

V Experiments

UR10 armRobotiq 2F-140 gripperSurface(for placement)Task ObjectsAsymmetricfingers
Fig. 8: Our experiment setting featuring a gripper with asymmetric fingers and a UR10 arm. Also shown are test objects: a 3D-printed plate, a hardcover book, a Go stone, and a coin.

This section presents a set of experiments in dexterous ungrasping. Specifically, we examined the performance of precision placement: an object is to be placed at a specific location on a flat tabletop while being held securely all the way through. This is more challenging than insertion tasks (recall Fig. 3(b-c)). The objects we tested include a coin, a hardcover book, a Go stone, and a 3D-printed rectangular plate. Fig. 8 shows our setting with a Robotiq 2F-140 gripper carried by a UR10 arm. The gripper is equipped with customized 3D-printed fingers that vary in lengths to realize necessary digit asymmetry with different values.

Coin1⃝2⃝3⃝4⃝()()Go stone1⃝2⃝3⃝4⃝()()Hardcover Book1⃝2⃝3⃝4⃝()()(a)1⃝Initial Configuration2⃝ Increased3⃝ Decreased4⃝Goal Configuration(b)(c)DecreasedDecreasedGoal Configuration
Fig. 9: (a) Planned ungrasping paths shown as the dashed line with the waypoints --- inside shaded gray. The path for the Go stone is the same as Fig. 7(c); here, it is projected on the plane . (b) Progress of precision placement with the objects, following the waypoints ---. The reference frame shown in the top left panel is aligned with the one in Fig. 4(a). (c) Placement through the motion primitive . See also the video attachment.
Section Reference Task Object ObjectDimension thickness Digit Asymmetry Initial Configuration Placement Error Success Rate
(mm) () Mean(mm) Range(mm)
V-A Digit Asymmetry Coin 0.75 53/60
Go stone 0.9 55/60
Hardcover book 0.65 51/60
3D-printed plate 0.41 0.79 30 37/40
V-B Same-Length Fingers Coin 0.0 0.75 35 2/20
Go stone 0.0 0.9 35 3/20
Hardcover book 0.0 0.65 25 0/20

1 Placed onto a rubber mat with high friction.

TABLE I: Experiment results of precision placement.

V-a Placement with Digit Asymmetry

Given object geometry and friction properties, the ungrasping paths for the coin, the Go stone, and the book using the two motion primitives and were planned and executed in an open-loop manner, 60 times for each object by varying the choice of the digit asymmetry and initial (the angle between the object and the target surface). Instances of the planned paths are presented in Fig. 9(a), along the waypoints ---. Initially, the object was pinch-grasped from a stand as shown in Fig. 8. Before terminating an ungrasp, at a small value of , the robot is controlled to push the object down (Fig. 10) by rotating the gripper about the thumb’s tip in order to keep a safety distance between the thumb and the target surface. The gripper’s internal mobility was simply locked during this push-down maneuver, considering that its duration is short and the gripper has some passive compliance.

Fig. 10: Push-down maneuver to complete ungrasping while avoiding collision at the thumb. The fingertip at pushes the object down as the gripper is controlled to rotate about the thumb’s tip .

Fig. 9(b) shows the progress for each object. Table I reports two measures: success rate and placement error. An attempt of placement is regarded as a success if no loss of grasp occurs until the final push-down maneuver (Fig. 10) is performed. The overall success rate was then 159/180 (successes/attempts). In the failed attempts, the contact forces by the gripper were unable to counterbalance the weight of the object, and thus premature loss of grasp happened. This may account for why the heaviest object, the hardcover book, had the lowest success rate. The average placement errors, measured as the final positioning error of the distal end of the object on the surface along the -axis shown in Fig. 9(b), were mm, mm, and mm for the coin, the Go stone, and the hardcover book, respectively.

Fig. 9(c) shows ungrasping with the 3D-printed plate when the motion primitive was applied. Because the gripper exerts pulling forces at both and , a feasible motion path is obtained with large friction at . Still, the average placement error was relatively large at mm.

V-B Placement with Same-Length Fingers

It is not possible to find feasible paths with same-length fingers () because where and lies outside , as can be seen in Fig. 9(a). When the placement attempts were made anyway, the overall success rate was significantly lower at 5/60. As also reported in the table, placement errors significantly surged as the object dynamically slid out from the gripper.

Vi Conclusion

We presented a formulation for ungrasping through dexterous manipulation. Our planning framework based on a sampling-based search algorithm makes it possible to find an optimal course of secure, feasible manipulation actions specifying the necessary contact interactions. The reported experiments show that our current implementation of dexterous ungrasping is capable of addressing the novel challenges in placing real-world objects through dexterous manipulation. Our practical design feature, i.e. digit asymmetry, proved its effectiveness in securely holding the object through the experiments, as well as the numerical examples. The model of ungrasping manipulation established with the simple gripper model allows the use of a wide variety of grippers, apart from the parallel-finger gripper used in the experiments.


  • [1] A. Bicchi, “Hands for dexterous manipulation and robust grasping: a difficult road toward simplicity,” IEEE Transactions on Robotics and Automation, vol. 16, no. 6, pp. 652–662, 2000.
  • [2] M. T. Mason and J. K. Salisbury Jr, “Robot hands and the mechanics of manipulation,” 1985.
  • [3] R. Fearing, “Simplified grasping and manipulation with dextrous robot hands,” IEEE Journal on Robotics and Automation, vol. 2, no. 4, pp. 188–195, 1986.
  • [4] D. Rus, “In-hand dexterous manipulation of piecewise-smooth 3-d objects,” The International Journal of Robotics Research, vol. 18, no. 4, pp. 355–381, 1999.
  • [5] L. Han and J. C. Trinkle, “Dextrous manipulation by rolling and finger gaiting,” in Proceedings. 1998 IEEE International Conference on Robotics and Automation, pp. 730–735, IEEE, 1998.
  • [6] P. Tournassoud, T. Lozano-Perez, and E. Mazer, “Regrasping,” in Proceedings. 1987 IEEE International Conference on Robotics and Automation, vol. 4, pp. 1924–1928, 1987.
  • [7] J. C. Trinkle and R. P. Paul, “Planning for dexterous manipulation with sliding contacts,” The International Journal of Robotics Research, vol. 9, no. 3, pp. 24–48, 1990.
  • [8] A. A. Cole, P. Hsu, S. S. Sastry, et al., “Dynamic control of sliding by robot hands for regrasping,” IEEE Transactions on robotics and automation, vol. 8, no. 1, pp. 42–52, 1992.
  • [9] D. J. Montana, “The kinematics of contact and grasp,” The International Journal of Robotics Research, vol. 7, no. 3, pp. 17–32, 1988.
  • [10] L. Han, Y. S. Guan, Z. X. Li, Q. Shi, and J. C. Trinkle, “Dextrous manipulation with rolling contacts,” in Proceedings of International Conference on Robotics and Automation, April 1997.
  • [11] S. Yuan, A. D. Epps, J. B. Nowak, and J. K. Salisbury, “Design of a roller-based dexterous hand for object grasping and within-hand manipulation,” in 2020 International Conference on Robotics and Automation (ICRA), IEEE, 2020.
  • [12] N. C. Dafle, A. Rodriguez, R. Paolini, B. Tang, S. S. Srinivasa, M. Erdmann, M. T. Mason, I. Lundberg, H. Staab, and T. Fuhlbrigge, “Extrinsic dexterity: In-hand manipulation with external forces,” in 2014 IEEE International Conference on Robotics and Automation (ICRA), pp. 1578–1585, May 2014.
  • [13] J. Shi, J. Z. Woodruff, P. B. Umbanhowar, and K. M. Lynch, “Dynamic in-hand sliding manipulation,” IEEE Transactions on Robotics, vol. 33, no. 4, pp. 778–795, 2017.
  • [14] R. Deimel and O. Brock, “A novel type of compliant and underactuated robotic hand for dexterous grasping,” The International Journal of Robotics Research, vol. 35, no. 1-3, pp. 161–185, 2016.
  • [15] V. Babin and C. Gosselin, “Picking, grasping, or scooping small objects lying on flat surfaces: A design approach,” The International Journal of Robotics Research, vol. 37, no. 12, pp. 1484–1499, 2018.
  • [16] M. T. Mason, Mechanics of robotic manipulation. MIT press, 2001.
  • [17] S. Simunovic, “Force information in assembly processes,” in 5th International Symposium on Industrial Robots, pp. 415–431, 1975.
  • [18] P. C. Watson, “Remote center compliance system,” July 4 1978. US Patent 4,098,001.
  • [19] R. Shome, W. N. Tang, C. Song, C. Mitash, H. Kourtev, J. Yu, A. Boularias, and K. E. Bekris, “Towards robust product packing with a minimalistic end-effector,” in 2019 International Conference on Robotics and Automation (ICRA), pp. 9007–9013, IEEE, 2019.
  • [20] R. Newbury, K. He, A. Cosgun, and T. Drummond, “Learning to place objects onto flat surfaces in upright orientations,” IEEE Robotics and Automation Letters, vol. 6, no. 3, pp. 4377–4384, 2021.
  • [21] C. H. Kim and J. Seo, “Shallow-depth insertion: Peg in shallow hole through robotic in-hand manipulation,” IEEE Robotics and Automation Letters, vol. 4, pp. 383–390, April 2019.
  • [22] K. M. Lynch and F. C. Park, Modern Robotics: Mechanics, Planning, and Control. New York, NY, USA: Cambridge University Press, 2017.
  • [23] N. Chavan-Dafle, R. Holladay, and A. Rodriguez, “Planar in-hand manipulation via motion cones,” The International Journal of Robotics Research, vol. 39, no. 2-3, pp. 163–182, 2020.
  • [24] S. Karaman and E. Frazzoli, “Sampling-based algorithms for optimal motion planning,” The International Journal of Robotics Research, vol. 30, no. 7, pp. 846–894, 2011.