Solving multiple-criteria R&D project selection problems with a data-driven evidential reasoning rule

10/31/2018
by   Fang Liu, et al.
0

In this paper, a likelihood based evidence acquisition approach is proposed to acquire evidence from experts'assessments as recorded in historical datasets. Then a data-driven evidential reasoning rule based model is introduced to R&D project selection process by combining multiple pieces of evidence with different weights and reliabilities. As a result, the total belief degrees and the overall performance can be generated for ranking and selecting projects. Finally, a case study on the R&D project selection for the National Science Foundation of China is conducted to show the effectiveness of the proposed model. The data-driven evidential reasoning rule based model for project evaluation and selection (1) utilizes experimental data to represent experts' assessments by using belief distributions over the set of final funding outcomes, and through this historic statistics it helps experts and applicants to understand the funding probability to a given assessment grade, (2) implies the mapping relationships between the evaluation grades and the final funding outcomes by using historical data, and (3) provides a way to make fair decisions by taking experts' reliabilities into account. In the data-driven evidential reasoning rule based model, experts play different roles in accordance with their reliabilities which are determined by their previous review track records, and the selection process is made interpretable and fairer. The newly proposed model reduces the time-consuming panel review work for both managers and experts, and significantly improves the efficiency and quality of project selection process. Although the model is demonstrated for project selection in the NSFC, it can be generalized to other funding agencies or industries.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/22/2014

Belief-Rule-Based Expert Systems for Evaluation of E- Government: A Case Study

Little knowledge exists on the impact and results associated with e-gove...
research
12/13/2018

A multiple criteria methodology for prioritizing and selecting portfolios of urban projects

This paper presents an integrated methodology supporting decisions in ur...
research
09/14/2020

ColVis: Collaborative Visualization Design Workshops for Diverse User Groups

Understanding different types of users' needs can even be more critical ...
research
03/20/2013

A Non-Numeric Approach to Multi-Criteria/Multi-Expert Aggregation Based on Approximate Reasoning

We describe a technique that can be used for the fusion of multiple sour...
research
11/01/2022

Contextual Mixture of Experts: Integrating Knowledge into Predictive Modeling

This work proposes a new data-driven model devised to integrate process ...
research
02/26/2019

Developing and Using Special-Purpose Lexicons for Cohort Selection from Clinical Notes

Background and Significance: Selecting cohorts for a clinical trial typi...
research
03/27/2013

Towards a Normative Theory of Scientific Evidence

A scientific reasoning system makes decisions using objective evidence i...

Please sign up or login with your details

Forgot password? Click here to reset