DeepAI AI Chat
Log In Sign Up

A Method with Feedback for Aggregation of Group Incomplete Pair-Wise Comparisons

by   Vitaliy Tsyganok, et al.

A method for aggregation of expert estimates in small groups is proposed. The method is based on combinatorial approach to decomposition of pair-wise comparison matrices and to processing of expert data. It also uses the basic principles of Analytic Hierarchy/Network Process approaches, such as building of criteria hierarchy to decompose and describe the problem, and evaluation of objects by means of pair-wise comparisons. It allows to derive priorities based on group incomplete pair-wise comparisons and to organize feedback with experts in order to achieve sufficient agreement of their estimates. Double entropy inter-rater index is suggested for usage as agreement measure. Every expert is given an opportunity to use the scale, in which the degree of detail (number of points/grades) most adequately reflects this expert's competence in the issue under consideration, for every single pair comparison. The method takes all conceptual levels of individual expert competence (subject domain, specific problem, individual pair-wise comparison matrix, separate pair-wise comparison) into consideration. The method is intended to be used in the process of strategic planning in weakly-structured subject domains.


Comparing Efficiency of Expert Data Aggregation Methods

Expert estimation of objects takes place when there are no benchmark val...

Rank Centrality: Ranking from Pair-wise Comparisons

The question of aggregating pair-wise comparisons to obtain a global ran...

A Comparison of Prior Elicitation Aggregation using the Classical Method and SHELF

Subjective Bayesian prior distributions elicited from experts can be agg...

Linear NDCG and Pair-wise Loss

Linear NDCG is used for measuring the performance of the Web content qua...

The incomplete Analytic Hierarchy Process and Bradley-Terry model: (in)consistency and information retrieval

Several methods of preference modeling, ranking, voting and multi-criter...

Learning Mixed Multinomial Logit Model from Ordinal Data

Motivated by generating personalized recommendations using ordinal (or p...