 # On Orthogonal Projections on the Space of Consistent Pairwise Comparisons Matrices

In this study, the orthogonalization process for different inner products is applied to pairwise comparisons. Properties of consistent approximations of a given inconsistent pairwise comparisons matrix are examined. A method of a derivation of a priority vector induced by a pairwise comparison matrix for a given inner product has been introduced. The mathematical elegance of orthogonalization and its universal use in most applied sciences has been the motivating factor for this study. However, the finding of this study that approximations depend on the inner product assumed, is of considerable importance.

## Authors

##### This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

## 1 Introduction

The growing number of various orthogonalization approaches in [1, 2, 3, 4] supports the importance of orthogonalization in various computer science applications. Pairwise comparisons allow us to express assessments of many entities (especially, of the subjective nature) into one value for the use in the decision making process. Pairwise comparisons have been used since the late years in the 13th century by Llull for conducting the better election process (as stipulated in ). However, the ineffability of pairwise comparisons comes from decision making which must have been made by our ancestors during the Stone Age. Two stones must have been compared to decide which of them fit for the purpose. It could be for a hatchet, a gift, or a decoration.

Pairwise comparisons matrices can be transformed by a logarithmic mapping into a linear space and the set of consistent matrices into its subspace. The structure of a Hilbert space is obtained by using an inner product. Such a space is complete with respect to the norm corresponding to the inner product. In such a space, we may use orthogonal projections as a tool to produce a consistent approximation of a given pairwise comparison matrix.

### Structure of the paper

A gentle introduction to pairwise comparisons is provided in Section 2. Section 3 discusses the problem of approximation of an inconsistent PC matrix by a consistent PC matrix using Frobenius inner product on the space of matrices. Other inner products are discussed in Section 4. In Section 5 the dependence of an optimal priority vector on the choice of an inner product on the space of pairwise comparison matrices has been proved. The Conclusions are self explanatory.

## 2 Pairwise comparisons matrices

In this subsection, we define a pairwise comparisons matrix (for short, PC matrix) and introduce some related notions. Pairwise comparisons are traditionally stored in a PC matrix. It is a square matrix with real positive elements for every where represents a relative preference of an entity over as a ratio. The entity could be an object, attribute of it, abstract concept, or a stimulus. For most abstract entities, we do not have a well established measure such as a meter or kilogram. “Software safety” or “environmental friendliness” are examples of such entities or attributes used in pairwise comparisons.

When we use a linguistic expression containing "how many times", we process ratios. The linguistic expression "by how much", "by how much percent" (or similar) gives us a relative difference. Ratios often express subjective preferences of two entities, however, it does not imply that they can be obtained only by division. In fact, equalizing the ratios with the division (e.g., ), for pairwise comparisons, is in general unacceptable. It is only acceptable when applied to entities with the existing units of measure (e.g., distance). However, when entities are subjective (e.g., reliability and robustness commonly used in a software development process as product attributes), the division operation has no mathematical meaning although we can still consider which of them is more (or less) important than the other for a given project. The use of the symbol "/" is in the context of "related to" (not the division of two numbers). Problems with some popular customization of PCs have been addressed in . We decided not to address them here.

A PC matrix is called reciprocal if for every . In such case, for every .

We can assume that the PC matrix has positive real entries and is reciprocal without the loss of generality since a non reciprocal PC matrix can be made reciprocal by the theory presented in . The conversion is done by replacing and

with geometric means of

and (). The reciprocal value is .

Thus a PC matrix is the -matrix of the form:

 M=⎡⎢ ⎢ ⎢ ⎢ ⎢ ⎢⎣1m12⋯m1n1m121⋯m2n⋮⋮⋮⋮1m1n1m2n⋯1⎤⎥ ⎥ ⎥ ⎥ ⎥ ⎥⎦.

Sometimes, we write that in order to indicate the size of a given PC matrix.

### 2.1 The Geometric Means Method

The main goal to use a pairwise comparison matrix is to obtain the so called priority vector. The coordinates of this vector correspond to the weights of alternatives. If we know the priority vector, we can set alternatives in order from the best to the worst one.

In the Geometric Means Method (GMM) introduced in  the coordinates of the vector are calculated as the geometric means of the elements in rows of the matrix:

 vi=n ⎷n∏j=1aij. (1)

The above vector is the solution of the Logarithmic Least Square Method.

### 2.2 Triads, transitivity, and submatrices of a PC matrix

One of the fundamental problems in pairwise comparisons is the inconsistency. It takes place when we provide, for any reason, all (hence supernumerary) comparisons of entities which is or if the reciprocity is assumed and used to reduce the number of entered comparisons. The sufficient number of comparisons is , as stipulated in , but this number is based on some arbitrary selection criteria of the minimal set of entities to compare. In practice, we have a tendency to make all comparisons (when reciprocity is assumed which is expressed by property also not always without its problem). Surprisingly, the equality does not take place even if both and . For example, the blind wine testing may result in claiming that is better than and is better than or even that is better than which is placed on the main diagonal in a PC matrix , expressing all pairwise comparisons in a form of a matrix.

The basic concept of inconsistency may be illustrated as follows. If an alternative is three times better than , and is twice better than , than should not be evaluated as five times better than C. Unfortunately, it does not imply that to should be hence 6, as the common sense may dictate, since all three assessments (3, 5, and 2) may be inaccurate and we do not know which one of them is or not incorrect. Inconsistency is sometimes mistakenly taken for the approximation error but it is incorrect. For example, triad can be approximated by with 0 inconsistency but we can see that such approximation is far from optimal by any standard. So, the inconsistency can be 0 yet the approximation error can be different than 0 and of arbitrarily large value.

### 2.3 Multiplicative variant of pairwise comparisons

###### Definition 2.1.

Given , we define

 T(n)={(i,j,k)∈{1,…,n}:i

as the set of all PC matrix indexes of all permissible triads in the upper triangle.

###### Definition 2.2.

A PC matrix is called consistent (or transitive) if, for every

 mikmkj=mij. (2)

Equation (2) was proposed a long time ago (in 1930s) and it is known as a "consistency condition". Every consistent PC matrix is reciprocal, however, the converse is false in general. If the consistency condition does not hold, the PC matrix is inconsistent (or intransitive). In several studies, conducted between 1940 and 1961 ([12, 13, 14, 15]) the inconsistency in pairwise comparisons was defined and examined.

Inconsistency in pairwise comparisons occurs due to superfluous input data. As demonstrated in , only pairwise comparisons are really needed to create the entire PC matrix for entities, while the upper triangle has comparisons. Inconsistencies are not necessarily "wrong" as they can be used to improve the data acquisition. However, there is a real necessity to have a "measure" for it.

###### Lemma 2.3.

If a matrix is consistent, then

 mij=ωiωj for all i,j=1,2,…,n

where for every .

###### Proof.

By the definition of and consistency of one gets

 m1j=ω1ω1/m1j=ω1ωj

and

 mij=mi−1,jmi−1,i=ωi−1/ωjωi−1/ωi=ωiωj.

whenever

It is easy to observe that the set of all consistent matrices is a multiplicative subgroup of the group of all -matrices endowed with the coordinate-wise multiplication where and . Its representation in consists of all priority vectors defined uniquely as in Lemma 2.3, up to a multiplicative constant In the following we use priority vectors normalized by the condition unless otherwise stated.

### 2.4 Additive variant of pairwise comparisons

Instead of a PC matrix with the set of positive real numbers considered with multiplication, we can transform entries of by a logarithmic function and get a matrix Since a matrix is reciprocal, it follows that it is anti-symmetric, i.e.

 aij=−aji for every i,j=1,2,…,n.

Moreover, if is consistent then satisfies the condition of additive consistency:

 aik+akj=aij for every (i,j,k)∈T(n),

which yields the following well-known representation.

###### Lemma 2.4.

If an anti-symmetric matrix is additively consistent, then

 aij=σi−σj for all i,j=1,2,…,n,

where is arbitrary and for every .

In view of this representation, the set of all additively consistent matrices is an additive subgroup of all - matrices, whenever it is endowed with the coordinatewise matrix addition of and . It is a one-to-one image of the multiplicative group by the group isomorphism . The inverse group isomorphism is clearly given by the formula Moreover, the additive priority vector of satisfies where is supposed to be arbitrary additive constant. In particular, it is said to be normalized if Here and in the following matrix functions and are always understood in the coordinate- wise sense.

## 3 Approximation by projections

Numerous heuristics have been proposed for approximations of inconsistent pairwise comparisons matrices by consistent pairwise comparisons matrices. Geometric means (GM) of rows is regarded as dominant. Some mathematical evidence, to support GM as the method of choice, was also provided in

.  shows that orthogonal projections have a limit which is GM (to a constant).  demonstrates that the inconsistency reduction algorithm based on the orthogonal projections converges very quickly for practical applications. The proof of inconsistency convergence was outlined in  and finalized in . Axiomatization of inconsistency still remains elusive. Its recent mutation in  has a deficiency (the monotonicity axiom incorrectly defined).

### 3.1 Space of consistent matrices

Let = Let be the set of all-matrices with entries from the field and let be the set of all consistent -matrices with entries from the field. We consider as a linear space with addition of matrices and multiplication by numbers from the field clearly = and the unit matrices

 Eij=[ei,jrs]nr,s=1,  i,j=1,2,…,n,

form a basis in where is equal to 1, if and and otherwise 0.

In the linear space one can define the Frobenius inner product as follows. For all

 ⟨A,B⟩F=n∑i=1n∑j=1aij¯bij.

In this Section we recall results from .

###### Theorem 3.1.

The set is a linear subspace of

###### Proof.

Let that is

 aik+akj=aij and bik+bkj=bij.

Let then

 cik+ckj=(aik+bik)+(akj+bkj)=(aik+akj)+(bik+bkj)=aij+bij=cij.

Hence,

Let and It is clear that

###### Theorem 3.2.

The subspace has dimension over

###### Proof.

By applying the consistency condition, all elements of the matrix can be generated by elements for i.e. by the second diagonal, that is diagonal directly above the main diagonal (see ). ∎

###### Theorem 3.3 ([19, Proposition 1]).

The following set of matrices constitutes a basis of

 Bk=[bkij], where bkij=⎧⎨⎩−1,% for 1≤i≤k

where

###### Remark.

For the standard inner product (i.e. Frobenius), an example of approximation of a inconsistent matrix as a projection onto is given in .

### 3.2 Approximation by a consistent matrix

Suppose that we have a matrix i.e. is inconsistent. Our aim is to find a consistent metric projection of onto the set with respect to norm induced by an inner product , i.e. a nonlinear mapping such that the distance of to

 dist(A, C)=infB∈C∥A−B∥=∥A−Aapprox∥.

is attained by the matrix

In the additive case metric projection coincides with the orthogonal projection of onto the -linear subspace which is characterized by the well-known orthogonality condition

 A−Aapprox⊥ An.

This condition enables to compute the orthogonal projection much more effectively than its nonlinear multiplicative counterpart . Therefore, it was proposed [10, 17]

to linearize the process of determining metric projections for practical applications. It was achieved by introducing a new concept of linearized consistent approximations to estimate nonlinear metric projections. For the simplicity, in the following the symbol

will be also used to denote these linearized consistent approximations. It would not lead to misunderstanding, since we shall always restrict our attention to the linearized case, unless otherwise stated.

###### Definition 3.4.

Let be a inconsistent matrix.

A consistent approximation of onto is defined in the following way:

1. we construct the matrix

2. we find the orthogonal projection of onto the -dimensional subspace

3. we set

In short, we define

### 3.3 Orthogonalization

In order to simplify calculation in the examples below, we would like to have orthogonal basis for

We produce such a basis by the Gram-Schmidt process. Namely, let

be an -dimensional vector space over with an inner product and be its basis. We construct an orthogonal basis as follows:

 E1=B1,E2=B2−⟨E1,B2⟩⟨E1,E1⟩E1,E3=B3−⟨E1,B3⟩⟨E1,E1⟩E1−⟨E2,B3⟩⟨E2,E2⟩E2,…=…En=Bn−n−1∑j=1⟨Ej,Bn⟩⟨Ej,Ej⟩Ej. (3)
###### Example 3.5.

Consider an inconsistent PC matrix in the multiplicative variant:

 M=⎡⎢⎣1e2e7e−21e3e−7e−31⎤⎥⎦. (4)

Its priority vector obtained by (1) is

 v(M)=⎡⎢ ⎢ ⎢⎣e3e13e−103⎤⎥ ⎥ ⎥⎦. (5)

Taking natural logarithms, we switch to the additive PC matrix variant and get the following additive PC matrix:

 A=⎡⎢⎣027−203−7−30⎤⎥⎦.

We need to find , the projection of onto By Theorem 3.2, we have that By Theorem 3.3, we get a basis of the linear space of consistent matrices

 B1=⎡⎢⎣−011−100−100⎤⎥⎦ and B2=⎡⎢⎣−0−01−0−01−1−10⎤⎥⎦.

Evidently, Therefore, we have to apply Gram-Schmidt process of orthogonalization (3). If denotes an orthogonal basis of then

 E1=⎡⎢⎣−011−100−100⎤⎥⎦ and E2=⎡⎢ ⎢ ⎢⎣−0−1212−12−01−12−10⎤⎥ ⎥ ⎥⎦.

Our goal is to find that is to find coefficients and such that for every which is equivalent to solving:

 ⟨A−ε1E1−ε2E2,E1⟩F=0,⟨A−ε1E1−ε2E2,E2⟩F=0.

Since and are orthogonal, we get a system of linear equations:

 ⟨A,E1⟩F−ε1⟨E1,E1⟩F=0,⟨A,E2⟩F−ε2⟨E2,E2⟩F=0.

By computing Frobenius inner products, we get the following equation:

 18−4ε1=0,11−3ε2=0.

By solving the above equations for we get and Thus,

 Aproj=Aapprox,F=92E1+113E2=⎡⎢ ⎢ ⎢⎣−083193−83−0113−193−1130⎤⎥ ⎥ ⎥⎦.

Finally, we get a consistent approximation for

 Mapprox,F=⎡⎢ ⎢ ⎢ ⎢⎣1e83e193e−831e113e−193e−1131⎤⎥ ⎥ ⎥ ⎥⎦∈C.

Notice that the priority vector coincides with given by (5).

## 4 Other inner products on M(n,K)

The standard (Frobenius) inner product on the linear space is defined by:

 ⟨A,B⟩F=Tr(B∗A). (6)

The above inner product is exactly the Frobenius inner product defined in previous section, and it defines the Frobenius norm in a usual way by:

 ∥A∥2F=⟨A,A⟩F=n∑i=1n∑j=1|aij|2.

In  the following result is mentioned:

###### Proposition 4.1.

For every and positive semi-definite matrices , the following function:

 ⟨A,B⟩∗=Tr(m∑i=1B∗XiAYi) (7)

defines an inner product in

###### Proof.

All properties of an inner product follow from the following equation:

 ⟨A,B⟩∗=Tr(m∑i=1B∗XiAYi)=TrB∗(m∑i=1XiAYi)=⟨m∑i=1XiAYi,B∗⟩F.

###### Example 4.2.

Consider the following four matrices in the space

 X1=⎡⎢⎣112123236⎤⎥⎦,X2=⎡⎢⎣211121115⎤⎥⎦,Y1=⎡⎢⎣232373235⎤⎥⎦,Y2=⎡⎢⎣521251111⎤⎥⎦.

By applying Sylvester’s criterion in , it is easy to see that they are positive semi-definite. Evidently, they are symmetric hence Hermitian.

Let

 A(A)=A{Xi,Yi∣i=1,2}(A)=X1AY1+X2AY2.

Define

 ⟨A,B⟩∗=⟨A(A),B⟩F.

By Proposition 4.1, is an inner product in

###### Example 4.3.

Consider matrices , with real entries computed by the formula in Theorem 3.3 (see Example 3.5 for details). Evidently, is a basis for By applying Gram-Schmidt process (3) with the inner product from Example 4.2 to the basis , we get an orthogonal basis for in

The above transformations imply that . Since

 A(E1)=⎡⎢⎣−5−9−4−17−5−3−35−13−6⎤⎥⎦,

we have

 ⟨E1,B2⟩∗=49 and ⟨E1,E1⟩∗=65.

By equations (3), we get

 E1=⎡⎢⎣−011−100−100⎤⎥⎦ and E2=⎡⎢ ⎢ ⎢⎣−0−49651665−4965−01−1665−1−0⎤⎥ ⎥ ⎥⎦=165⎡⎢⎣−0−4916−49−065−16−65−0⎤⎥⎦.
###### Example 4.4.

Take the following additive PC matrix:

 A=⎡⎢⎣027−203−7−30⎤⎥⎦.

This is the PC matrix from Example 3.5. Next, we compute the orthogonal (with respect to the inner product from Example 4.2) projection onto the space For it, we need to solve a system of linear equations for and :

 ⟨A,E1⟩∗−ε1⟨E1,E1⟩∗=0,⟨A,E2⟩∗−ε2⟨E2,E2⟩∗=0. (8)

We get

 A(E2)=−165⎡⎢⎣5701,710−362261,234−6501,9305,050−1,006⎤⎥⎦.

We can also utilize some computation conducted in the previous example and by using the symmetry of the inner product the equation (8) becomes:

 355−65ε1=0,27,39065−(165)2473,520ε2=0.

Consequently, therefore, we get:

 Aproj,1=Aapprox,∗1=ε1E1+ε2E2=⎡⎢ ⎢ ⎢⎣0ε1−4965ε2ε1+1665ε2−ε1+4965ε20ε2−ε1−1665ε2−ε20⎤⎥ ⎥ ⎥⎦.

Finally, we obtain the following multiplicative PC matrix:

###### Example 4.5.

Let us repeat the calculations made in Examples 4.2, 4.3 and 4.4 to provide a consistent approximation of the matrix set in (4) by means of the inner product induced by matrices:

 X1=⎡⎢⎣100020003⎤⎥⎦,X2=⎡⎢⎣200030001⎤⎥⎦,Y1=⎡⎢⎣300010002⎤⎥⎦,Y2=⎡⎢⎣100030002⎤⎥⎦.

We obtain

 A(E1)=⎡⎢⎣−076−900−1000⎤⎥⎦,

so

 ⟨E1,B2⟩∗=16 and ⟨E1,E1⟩∗=32.

By equations (3), we get

 E1=⎡⎢⎣−011−100−100⎤⎥⎦ and E2=⎡⎢ ⎢ ⎢⎣−0−1212−12−01−12−10⎤⎥ ⎥ ⎥⎦=12⎡⎢⎣−0−11−1−02−1−20⎤⎥⎦.

Since

 A(E2)=−12⎡⎢⎣−0−76−9−020−10−120⎤⎥⎦,

we calculate the inner products

 ⟨A,E1⟩∗=144, ⟨A,E2⟩∗=88 and ⟨E2,E2⟩∗=24.

By solving the equations

 144−32ε1=0,88−24ε2=0.

we get and therefore,

 Aproj,2=Aapprox,∗2=ε1E1+ε2E2=⎡⎢ ⎢ ⎢⎣−0−83193−83−0113−193−1130⎤⎥ ⎥ ⎥⎦.

Finally,

 Mapprox,∗2=⎡⎢ ⎢ ⎢ ⎢⎣1e83e193e−831e113e−193e−1131⎤⎥ ⎥ ⎥ ⎥⎦,

and its priority vector calculated with the use of GMM is equal to

 v(Mapprox,∗2)=⎡⎢ ⎢ ⎢⎣e3e13e−103⎤⎥ ⎥ ⎥⎦=v(M).

## 5 Approximation selection

It is worthwhile to stress that in the previous examples we got three approximations of the same matrix . An important dilemma has surfaced: how to compare different approximations of a given PC matrix obtained by the use of different inner products? The answer to this question is: they are incomparable.

### 5.1 Inconsistency

The first criterion that we took into consideration was to compare inconsistency indices of the exponential transformations of differences . However, this attempt appeared to be incorrect.

Let us consider the inconsistency index of a pairwise comparison matrix given by formula:

 Kii(M)=maxi

This indicator satisfies all the desired axioms formulated in .

###### Theorem 5.1.

Let and be additive pairwise comparison matrices such that is additively consistent. Then

 Kii(exp(A−B))=Kii(exp(A)).
###### Proof.

Take any . Since , we get

 1 − min{eaik−bikeaij−bijeajk−bjk,eaij−bijeajk−bjkeaik−bik}= 1 − min{eaikebij+bjk−bikeaijeajk,eaijeajkeaikebij+bjk−bik}= 1 − min{eaikeaijeajk,eaijeajkeaik},

which completes the proof. ∎

From the above theorem it follows that if we take two different consistent approximations and of an additive matrix they satisfy

 Kii(exp(A−B))=Kii(exp(A))=Kii(exp(A−C)).

### 5.2 Priority vectors for different inner products

The second attempt to judge whether a consistent approximation of a matrix is acceptable could be to compare the priority vectors induced by and for any inner product. In  it has been proved that the elements of a projection matrix induced by a Frobenius product are given by the ratios , where vector is obtained by GMM. As it has been shown in  the priority vectors induced by and in this case coincide:

###### Theorem 5.2.

Let be a PC matrix and , where , i.e.

 wk=n ⎷n∏j=1akj.

Then .

As the following example shows the priority vectors of a matrix and its consistent approximation may differ if we use other inner products.

###### Example 5.3.

Consider an inconsistent additive PC matrix from Example 3.5:

 A=⎡⎢⎣027−203−7−30⎤⎥⎦

and its corresponding multiplicative PC matrix . Let us take three inner products: Frobenius product and the inner products and from Examples 4.2 and  4.5. The approximations , and are given in Examples  3.5,  4.3 and  4.5, respectively.

Notice that

 GM(exp(A))=GM(exp(Aapprox,F))=GM(exp(Aapprox,∗2)),

but and are linearly independent. This observation, however, is not surprising. The matrix minimizes the distance from to the set of cosistent PC matrices according to the inner product , but not to the Frobenius inner product.

In the following we show that as we change the inner product, we also have to change the formula for a priority vector. It is done by extending Theorem 5.2 to weighted Frobenius inner products. For this purpose we recall the most general standard definition of an inner product in

Let be linearly independent matrices in the space . Represent matrices in a unique manner as

 A=N∑k=1αkGk;αk∈K,

and

 B=N∑k=1βkGk;βk∈K,