DeepAI AI Chat
Log In Sign Up

Crowdsourcing Pareto-Optimal Object Finding by Pairwise Comparisons

by   Abolfazl Asudeh, et al.

This is the first study on crowdsourcing Pareto-optimal object finding, which has applications in public opinion collection, group decision making, and information exploration. Departing from prior studies on crowdsourcing skyline and ranking queries, it considers the case where objects do not have explicit attributes and preference relations on objects are strict partial orders. The partial orders are derived by aggregating crowdsourcers' responses to pairwise comparison questions. The goal is to find all Pareto-optimal objects by the fewest possible questions. It employs an iterative question-selection framework. Guided by the principle of eagerly identifying non-Pareto optimal objects, the framework only chooses candidate questions which must satisfy three conditions. This design is both sufficient and efficient, as it is proven to find a short terminal question sequence. The framework is further steered by two ideas---macro-ordering and micro-ordering. By different micro-ordering heuristics, the framework is instantiated into several algorithms with varying power in pruning questions. Experiment results using both real crowdsourcing marketplace and simulations exhibited not only orders of magnitude reductions in questions when compared with a brute-force approach, but also close-to-optimal performance from the most efficient instantiation.


Continuous Monitoring of Pareto Frontiers on Partially Ordered Attributes for Many Users

We study the problem of continuous object dissemination---given a large ...

Can we reach Pareto optimal outcomes using bottom-up approaches?

Traditionally, researchers in decision making have focused on attempting...

Optimal Cost-Preference Trade-off Planning with Multiple Temporal Tasks

Autonomous robots are increasingly utilized in realistic scenarios with ...

A Margin-based MLE for Crowdsourced Partial Ranking

A preference order or ranking aggregated from pairwise comparison data i...

Aggregation of Pareto optimal models

In statistical decision theory, a model is said to be Pareto optimal (or...

Efficient Contour Computation of Group-based Skyline

Skyline, aiming at finding a Pareto optimal subset of points in a multi-...

Multiview Representation Learning from Crowdsourced Triplet Comparisons

Crowdsourcing has been used to collect data at scale in numerous fields....