FOCA: A Methodology for Ontology Evaluation

12/10/2016
by   Judson Bandeira, et al.
0

Modeling an ontology is a hard and time-consuming task. Although methodologies are useful for ontologists to create good ontologies, they do not help with the task of evaluating the quality of the ontology to be reused. For these reasons, it is imperative to evaluate the quality of the ontology after constructing it or before reusing it. Few studies usually present only a set of criteria and questions, but no guidelines to evaluate the ontology. The effort to evaluate an ontology is very high as there is a huge dependence on the evaluator's expertise to understand the criteria and questions in depth. Moreover, the evaluation is still very subjective. This study presents a novel methodology for ontology evaluation, taking into account three fundamental principles: i) it is based on the Goal, Question, Metric approach for empirical evaluation; ii) the goals of the methodologies are based on the roles of knowledge representations combined with specific evaluation criteria; iii) each ontology is evaluated according to the type of ontology. The methodology was empirically evaluated using different ontologists and ontologies of the same domain. The main contributions of this study are: i) defining a step-by-step approach to evaluate the quality of an ontology; ii) proposing an evaluation based on the roles of knowledge representations; iii) the explicit difference of the evaluation according to the type of the ontology iii) a questionnaire to evaluate the ontologies; iv) a statistical model that automatically calculates the quality of the ontologies.

READ FULL TEXT

page 10

page 13

page 19

research
09/17/2015

A Study Investigating Typical Concepts and Guidelines for Ontology Building

In semantic technologies, the shared common understanding of the structu...
research
04/01/2017

An Ontological Architecture for Orbital Debris Data

The orbital debris problem presents an opportunity for inter-agency and ...
research
06/06/2022

Automatically Drafting Ontologies from Competency Questions with FrODO

We present the Frame-based ontology Design Outlet (FrODO), a novel metho...
research
09/27/2017

A Literature Based Approach to Define the Scope of Biomedical Ontologies: A Case Study on a Rehabilitation Therapy Ontology

In this article, we investigate our early attempts at building an ontolo...
research
10/16/2015

Evaluating the Competency of a First-Order Ontology

We report on the results of evaluating the competency of a first-order o...
research
05/02/2023

Towards a better labeling process for network security datasets

Most network security datasets do not have comprehensive label assignmen...
research
04/03/2013

Predicting Network Attacks Using Ontology-Driven Inference

Graph knowledge models and ontologies are very powerful modeling and re ...

Please sign up or login with your details

Forgot password? Click here to reset