Understanding in Artificial Intelligence

01/17/2021
by   Stefan Maetschke, et al.
0

Current Artificial Intelligence (AI) methods, most based on deep learning, have facilitated progress in several fields, including computer vision and natural language understanding. The progress of these AI methods is measured using benchmarks designed to solve challenging tasks, such as visual question answering. A question remains of how much understanding is leveraged by these methods and how appropriate are the current benchmarks to measure understanding capabilities. To answer these questions, we have analysed existing benchmarks and their understanding capabilities, defined by a set of understanding capabilities, and current research streams. We show how progress has been made in benchmark development to measure understanding capabilities of AI methods and we review as well how current methods develop understanding capabilities.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/19/2019

Challenges and Prospects in Vision and Language Research

Language grounded image understanding tasks have often been proposed as ...
research
10/04/2021

A curated, ontology-based, large-scale knowledge graph of artificial intelligence tasks and benchmarks

Research in artificial intelligence (AI) is addressing a growing number ...
research
03/09/2022

Mapping global dynamics of benchmark creation and saturation in artificial intelligence

Benchmarks are crucial to measuring and steering progress in artificial ...
research
05/10/2023

A Glimpse in ChatGPT Capabilities and its impact for AI research

Large language models (LLMs) have recently become a popular topic in the...
research
05/31/2023

Evaluating GPT's Programming Capability through CodeWars' Katas

In the burgeoning field of artificial intelligence (AI), understanding t...
research
10/14/2019

Engineering Reliable Deep Learning Systems

Recent progress in artificial intelligence (AI) using deep learning tech...
research
09/13/2017

Using NLU in Context for Question Answering: Improving on Facebook's bAbI Tasks

For the next step in human to machine interaction, Artificial Intelligen...

Please sign up or login with your details

Forgot password? Click here to reset