1 Introduction
Diffusion geometry is an umbrella term referring to geometric analysis of diffusion or random walk processes. Such methods, first introduced in theoretical geometry [3] have matured into practical applications in the fields of manifold learning [7] and shape analysis [11]. In the shape analysis community, diffusion geometry methods were used to define lowdimensional representations for manifolds [7, 21], build intrinsic distance metrics and construct shape distribution descriptors [21, 12], define spectral signatures [20] (shapeDNA), and local descriptors [23]. Diffusion embeddings were used for finding correspondence between shapes [13] and detecting intrinsic symmetries [18] . In many settings, the construction of diffusion geometry boils down to the definition of a Laplacian operator. Such an operator should possess certain invariance properties desired in a specific application.
In this paper, we construct (equi)affineinvariant diffusion geometry for 3D shapes. Affine invariance is important in many applications in the analysis of images [15] and 3D shapes [9]. We first construct an affineinvariant Riemannian metric that allows us define an affineinvariant Laplacian, with which we in turn define affine invariant diffusion geometry for surfaces. This new geometry enables efficient computational tools that handle both nonrigid approximatelyisometric deformations of the surface together with equiaffine transformations of the embedding space. We demonstrate the usefulness of our construction in a range of shape analysis applications, such as retrieval, correspondence, and symmetry detection.
2 Background
Let denote a compact twodimensional Riemannian manifold (possibly with boundary) representing the outer boundary of a physical solid object in the 3D space. The Riemannian metric tensor is defined as a local inner product on the tangent plane at each point . Given a smooth scalar field , its gradient at point is defined through the relation , where
is an infinitesimal tangent vector. The positive semidefinite selfadjoint
LaplaceBeltrami operatorassociated with the metric tensor
is defined by the identity(1) 
holding for any pair of smooth scalar fields ; here denotes the standard area measure on . Whenever possible, we will omit the subscript and refer to the LaplaceBeltrami operator simply as to .
Assuming further that the manifold is embedded isometrically in and (possibly, locally) parametrized by a regular map over a planar domain , the metric tensor assumes the form of a positivedefinite matrix called the first fundamental form, whose elements are given by the inner products .
The LaplaceBeltrami operator can be expressed in the parametrization coordinates as
(2) 
where we use Einstein’s summation convention, according to which denotes the determinant of the metric, are the components of the inverse metric tensor, and repeated indices are summed over. When the metric is Euclidean (), the operator reduces to the familiar (note that we define the Laplacian with the minus sign in order to ensure its positive semidefiniteness).
The LaplaceBeltrami operator gives rise to the partial differential equation
(3) 
called the heat equation. The heat equation describes the propagation of heat on the surface and its solution is the heat distribution at a point in time . The initial condition of the equation is some initial heat distribution ; if has a boundary, appropriate boundary conditions must be added. The solution of (3) corresponding to a point initial condition , is called the heat kernel and represents the amount of heat transferred from to in time due to the diffusion process. Using spectral decomposition, the heat kernel can be represented as
(4) 
where and
are, respectively, the eigenfunctions and eigenvalues of the LaplaceBeltrami operator satisfying
(without loss of generality, we assume to be sorted in increasing order starting with ). Since the LaplaceBeltrami operator is an intrinsic geometric quantity, i.e., it can be expressed solely in terms of the metric of , its eigenfunctions and eigenvalues as well as the heat kernel are invariant under isometric transformations of the manifold.The value of the heat kernel
can be interpreted as the transition probability density of a random walk of length
from the point to the point . This allows to construct a family of intrinsic metrics known as diffusion metrics,(5) 
which measure the “connectivity rate” of the two points by paths of length .
The parameter can be given the meaning of scale, and the family can be thought of as a scalespace of metrics. By integrating over all scales, a scaleinvariant version of (5) is obtained,
(6) 
This metric is referred to as the commutetime distance and can be interpreted as the connectivity rate by paths of any length. We will broadly call constructions related to the heat kernel, diffusion and commute time metrics as diffusion geometry.
3 Affineinvariant diffusion geometry
An affine transformation of the threedimensional Euclidean space can be parametrized by a regular matrix and a vector since all constructions discussed here are trivially translation invariant, we will omit the vector . The transformation is called special affine or equiaffine if it is volumepreserving, i.e., .
As the standard Euclidean metric is not affineinvariant, the LaplaceBeltrami operators associated with and are generally distinct, and so are the resulting diffusion geometries. In what follows, we are going to substitute the Euclidean metric by its equiaffine invariant counterpart. That, in turn, will induce an equiaffineinvariant LaplaceBeltrami operator and define equiaffineinvariant diffusion geometry.
The equiaffine metric can be defined through the parametrization of a curve [1, 4, 5, 6, 16, 22]. Let be a curve on parametrized by
. By the chain rule,
(7) 
where, for brevity, we denote and . As volumes are preserved under the equiaffine group of transformations, we define the invariant arclength through
(8) 
(9) 
from where we readily have an equiaffineinvariant premetric tensor
(10) 
where . The premetric tensor (10) defines a true metric only on strictly convex surfaces [5]; in more general cases, it might cease from being positive definite. In order to deal with arbitrary surfaces, we extend the metric definition by restricting the eigenvalues of the tensor to be positive. Representing as a matrix admitting the eigendecomposition , where is orthonormal and , we compose a new first fundamental form matrix . The corresponding metric tensor is positive definite and is equiaffine invariant.
Plugging this into (1), we obtain an equiaffineinvariant LaplaceBeltrami operator . Such an operator defines an equiaffineinvariant diffusion geometry, i.e., the eigenfunction, heat kernel, and diffusion metrics it generates remain unaltered by a global volumepreserving affine transformation of the shape (Figures 2–3).
4 Discretization
In order to compute the equiaffine metric we need to evaluate the secondorder derivatives of the surface with respect to some parametrization coordinates. While this can be done practically in any representation, here we assume that the surface is given as a triangular mesh. For each triangular face, the metric tensor elements are calculated from a quadratic surface patch fitted to the triangle itself and its three adjacent neighbor triangles. The four triangles are unfolded to the plane, to which an affine transformation is applied in such a way that the central triangle becomes a unit simplex. The coordinates of this planar representation are used as the parametrization with respect to which the first fundamental form coefficients are computed at the barycenter of the simplex (Figure 1). This step is performed for every triangle of the mesh.
Having the discretized first fundamental form coefficients, our next goal is to discretize the LaplaceBeltrami operator. Since our final goal is not the operator itself but its eigendecomposition, we skip the construction of the Laplacian and discretize its eigenvalues and eigenfunctions directly. This is achieved using the finite elements method (FEM) proposed in [8] and used in shape analysis in [19]. For that purpose, we translate the eigendecomposition of the LaplaceBeltrami operator into a weak form
(11) 
with respect to some basis spanning a (sufficiently smooth) subspace of . Specifically, we choose the ’s to be the firstorder finite element function obtaining the value of one at a vertex and decaying linearly to zero in its ring (the size of the basis equals to the number of vertices in the mesh). Substituting these functions into (11), we obtain
(12) 
Next, we approximate the eigenfunction in the finite element basis by . This yields
or, equivalently,
The last equation can be rewritten in matrix form as a generalized eigendecomposition problem solved for the coefficients , where
and the local surface area is expressed in parametrization coordinates as .
5 Applications and results
The proposed equiaffineinvariant Laplacian is a practical tool that can be employed in the construction of local and global diffusion geometric structures used in standard approaches in shape analysis, substituting the traditional noninvariant LaplaceBeltrami operator. In what follows, we detail the construction of such structures and show applications in shape retrieval, correspondence, matching, and symmetry detection.
5.1 Shape retrieval
Sun et al. [23] proposed using the diagonal of the heat kernel, , as a local descriptor of the shape, referred to as the heat kernel signature (HKS). In practice, the descriptor is computed by sampling the time parameter at a discrete set of points, , and collecting the corresponding values of into a vector . The HKS descriptor is isometryinvariant, easy to compute, and is provably informative [23]. The affineinvariant HKS descriptors can be used in onetoone featurebased shape matching methods [23], or in largescale shape retrieval applications using the bags of features paradigm [17]. In the latter, the shape is considered as a collection of “geometric words” from a fixed “vocabulary” and is described by the statistical distribution of such words. The vocabulary is constructed offline by clustering the descriptor space. Then, for each point on the shape, the descriptor is replaced by the nearest vocabulary word by means of vector quantization. Counting the frequency of each word, a bag of features is constructed. The similarity of two shapes is then computed as the distance between the corresponding bags of features.
To evaluate the performance of the proposed approach for the construction of local descriptors, we used the Shape Google framework [17] based on standard and equiaffineinvariant HKS. Both descriptors were computed at six scales (, and
). Bags of features were computed using soft vector quantization with variance taken as twice the median of all distances between cluster centers in a vocabulary of
entries. Approximate nearest neighbor method [2] was used for vector quantization. Both the standard and the affineinvariant LaplaceBeltrami operator discretization were computed using finite elements. Heat kernels were approximated using the first smallest eigenpairs.Evaluation was performed using the SHREC 2010 robust largescale shape retrieval benchmark methodology. The dataset consisted of two parts: 793 shapes from 13 shape classes with simulated transformation of different types (Figure 4) and strengths (60 per shape) used as queries, and the remaining 521 shapes used as the queried corpus. Transformations classes affine and isometry+affine were added to the original SHREC query set, representing, respectively, equiaffine transformations of different strengths of the null shape and its approximate isometry. The combined dataset consisted of 1314 shapes. Retrieval was performed by matching 780 transformed queries to the 534 null shapes. Each query had one correct corresponding null shape in the dataset. Performance was evaluated using precision/recall characteristic. Precision is defined as the percentage of relevant shapes in the first topranked retrieved shapes. Mean average precision (mAP), defined as , where is the relevance of a given rank, was used as a single measure of performance. Intuitively, mAP is interpreted as the area below the precisionrecall curve. Ideal retrieval performance (mAP=100%) is achieved when all queries return relevant first matches. Performance results were broken down according to transformation class and strength.
Tables 1–2 show that the equiaffine version of the ShapeGoogle approach obtains slightly higher precision than the original ShapeGoogle in all SHREC’10 transformations. We attribute this phenomenon to the smoothing effect of the second order interpolation. In addition, equiaffine ShapeGoogle exhibits nearly perfect retrieval under equiaffine transformations in affine transformations, where the original approach fails.
Strength  

Transform.  1  2  3  4  5 
Isometry  100.00  100.00  100.00  100.00  99.23 
Affine  100.00  100.00  100.00  100.00  97.44 
Iso.+Affine  100.00  100.00  100.00  100.00  100.00 
Topology  96.15  94.23  91.88  89.74  86.79 
Holes  100.00  100.00  100.00  100.00  100.00 
Micro holes  100.00  100.00  100.00  100.00  100.00 
Local scale  100.00  100.00  94.74  82.39  73.97 
Sampling  100.00  100.00  100.00  96.79  86.10 
Noise  100.00  100.00  89.83  78.53  69.22 
Shot noise  100.00  100.00  100.00  97.76  89.63 
Strength  

Transform.  1  2  3  4  5 
Isometry  100.00  100.00  100.00  100.00  100.00 
Affine  100.00  86.89  73.50  57.66  46.64 
Iso.+Affine  94.23  86.35  76.84  70.76  65.36 
Topology  100.00  100.00  98.72  98.08  97.69 
Holes  100.00  96.15  92.82  88.51  82.74 
Micro holes  100.00  100.00  100.00  100.00  100.00 
Local scale  100.00  100.00  97.44  87.88  78.78 
Sampling  100.00  100.00  100.00  96.25  91.43 
Noise  100.00  100.00  100.00  99.04  99.23 
Shot noise  100.00  100.00  100.00  98.46  98.77 
5.2 Global structures
The equiaffineinvariant Laplacian can also be employed in the construction of global geometric structures. By plugging it into (5), a family of equiaffineinvariant diffusion distances is obtained. Similarly, a truly affineinvariant version of the commute time metric is obtained by using the equiaffineinvariant operator in (6). These metric structures can be used in the GromovHausdorff framework [10, 14], in which shapes are modeled as metric spaces, and the similarity of two shapes and is established by looking at the minimumdistortion correspondence between them. A correspondence is defined as a subset such that for all there exists such that , and vice versa, for all there exists such that . The distortion of is defined as
(13) 
The GromovHausdorff distance is given as the minimum of the distortion over all possible correspondences,
(14) 
and serves as a criterion for shape similarity in the sense that two shapes with are at most isometric, and, vice versa, two isometric shapes have at most . A byproduct of this problem is the minimumdistortion correspondence .
Figure 5 shows the correspondences obtained between an equiaffine transformation of a shape using the standard and the equiaffineinvariant versions of the diffusion metric. Minimization of a leastsquares version of (14) was performed using the generalized multidimensional scaling (GMDS) algorithm. In the case of the standard diffusion metric, the embedding distortion grew by over times as the result of the transformation, while in the case of the proposed invariant diffusion metric, the increase was by mere .
5.3 Intrinsic symmetry detection
Ovsjanikov et al. [18] proposed detecting intrinsic symmetries of a shape by analyzing the eigenfunctions of the LaplaceBeltrami operator. Intrinsic symmetry is manifested in the existence of a selfisometry , under which the metric structure of the shape is preserved, i.e., , where is the commute time metric. Ovsjanikov et al. [18] observe that for any intrinsic reflection symmetry , simple eigenfunctions of satisfy . Thus, the symmetries of can be parameterized by the sign signature ; such that .
Given a truncated sign signature , define an energy
It is easy to show that for sign signatures corresponding to intrinsic symmetries, and for approximate symmetries satisfying . The symmetry itself is recovered as
Employing our equiaffineinvariant Laplacian, the detection of intrinsic symmetries can be made under affine transformations of the shape.
Figure 6 shows an example of intrinsic symmetry detection with the method of [18] using standard (first row) and the proposed affineinvariant (second row) LaplaceBeltrami operator on an intrinsically symmetric centaur shape that underwent a mild isometric and affine transformation. In this experiment, we use the five first nontrivial eigenfunctions and show the approximate symmetries corresponding to the sign signatures producing the smallest values of (sign signature corresponding to the identity transformation was ignored). While no meaningful symmetries are detected in the first case, using our affineinvariant LaplaceBeltrami operator we were able to detect three approximate symmetries of the shape: hands and forward legs reflection (left), rear legs reflection (center), and full body reflection (right).
6 Conclusions
We introduced an equiaffineinvariant LaplaceBeltrami operator on twodimensional surfaces, and showed that it can be utilized to construct affineinvariant local and global diffusion geometric structures. Performance of the proposed tools was demonstrated on shape retrieval, correspondence, and symmetry detection applications. Our results show that affineinvariant diffusion geometries gracefully compete with, and sometimes even outperform, their classical counterparts under isometric changes and in the presence of geometric and topological noise, while significantly outperforming the latter under affine transformations.
Extension of the proposed equiaffine framework into fully affine invariance (including scale) could be accomplished by either exploiting the scale invariance property of the commute time distance, or the consideration of scale invariant signatures, two approaches we plan to study in the future.
7 Acknowledgements
This research was supported in part by The Israel Science Foundation (ISF) grant number 623/08, and by the USA Office of Naval Research (ONR) grant.
References
 [1] L. Alveraz, F. Guichard, P. L. Lions, and J. M. Morel. Axioms and fundamental equations of image processing. Archive for Rational Mechanics and Analysis, 123(3):199–257, 1993.
 [2] S. Arya, D. M. Mount, N. S. Netanyahu, R. Silverman, and A. Y. Wu. An optimal algorithm for approximate nearest neighbor searching. J. ACM, 45:891–923, 1998.
 [3] P. Bérard, G. Besson, and S. Gallot. Embedding riemannian manifolds by their heat kernel. Geometric and Functional Analysis, 4(4):373–398, 1994.
 [4] A. M. Bruckstein and D. Shaked. On projective invariant smoothing and evolutions of planarcurves and polygons. Journal of Mathematical Imaging and Vision, 7:225–240, June 1997.
 [5] S. Buchin. Affine differential geometry. Beijing, China: Science Press, 1983.
 [6] V. Caselles and C. Sbert. What is the best causal scale space for 3d images? SIAM Journal Applied Math., (56):1196–1246, 1996.
 [7] R. R. Coifman and S. Lafon. Diffusion maps. Applied and Computational Harmonic Analysis, 21:5–30, July 2006.
 [8] G. Dziuk. Finite elements for the Beltrami operator on arbitrary surfaces. In S. Hildebrandt and R. Leis, editors, Partial differential equations and calculus of variations, pages 142–155. 1988.
 [9] D. Ghosh, N. Amenta, and M. Kazhdan. Closedform blending of local symmetries. In Proc. SGP, 2010.
 [10] M. Gromov. Structures Métriques Pour les Variétés Riemanniennes. Number 1 in Textes Mathématiques. 1981.
 [11] B. Lévy. LaplaceBeltrami eigenfunctions towards an algorithm that “understands” geometry. In Proc. Shape Modeling and Applications, 2006.
 [12] M. Mahmoudi and G. Sapiro. Threedimensional point cloud recognition via distributions of geometric distances. Graphical Models, 71(1):22–31, January 2009.
 [13] D. Mateus, R. P. Horaud, D. Knossow, F. Cuzzolin, and E. Boyer. Articulated shape matching using laplacian eigenfunctions and unsupervised point registration. Proc. CVPR, June 2008.
 [14] F. Mémoli and G. Sapiro. A theoretical and computational framework for isometry invariant recognition of point cloud data. Foundations of Computational Mathematics, 5:313–346, 2005.
 [15] K. Mikolajczyk, T. Tuytelaars, C. Schmid, A. Zisserman, J. Matas, F. Schaffalitzky, T. Kadir, and L. V. Gool. A comparison of affine region detectors. IJCV, 65(1–2):43–72, 2005.
 [16] P. Olver, G. Sapiro, and A. Tennenbaum. Invariant geometric evolutions of surfaces and volumetric smoothing. SIAM Journal Applied Math., (57):176–194, 1997.

[17]
M. Ovsjanikov, A. M. Bronstein, M. M. Bronstein, and L. J. Guibas.
Shape Google: a computer vision approach to invariant shape retrieval.
In Proc. NORDIA, 2009.  [18] M. Ovsjanikov, J. Sun, and L. J. Guibas. Global intrinsic symmetries of shapes. In Computer Graphics Forum, volume 27, pages 1341–1348, 2008.
 [19] M. Reuter, S. Biasotti, D. Giorgi, G. Patanè, and M. Spagnuolo. Discrete Laplace–Beltrami operators for shape analysis and segmentation. Computers & Graphics, 33(3):381–390, 2009.
 [20] M. Reuter, F.E. Wolter, and N. Peinecke. Laplacespectra as fingerprints for shape matching. In Proc. ACM Symp. Solid and Physical Modeling, pages 101–106, 2005.
 [21] R. M. Rustamov. LaplaceBeltrami eigenfunctions for deformation invariant shape representation. In Proc. SGP, pages 225–233, 2007.
 [22] N. Sochen. Affineinvariant flows in the Beltrami framework. Journal of Mathematical Imaging and Vision, 20(1):133–146, 2004.
 [23] J. Sun, M. Ovsjanikov, and L. J. Guibas. A concise and provably informative multiscale signature based on heat diffusion. In Proc. SGP, 2009.
Comments
There are no comments yet.