Understanding Natural Language Understanding Systems. A Critical Analysis

03/01/2023
by   Alessandro Lenci, et al.
0

The development of machines that «talk like us», also known as Natural Language Understanding (NLU) systems, is the Holy Grail of Artificial Intelligence (AI), since language is the quintessence of human intelligence. The brief but intense life of NLU research in AI and Natural Language Processing (NLP) is full of ups and downs, with periods of high hopes that the Grail is finally within reach, typically followed by phases of equally deep despair and disillusion. But never has the trust that we can build «talking machines» been stronger than the one engendered by the last generation of NLU systems. But is it gold all that glitters in AI? do state-of-the-art systems possess something comparable to the human knowledge of language? Are we at the dawn of a new era, in which the Grail is finally closer to us? In fact, the latest achievements of AI systems have sparkled, or better renewed, an intense scientific debate on their true language understanding capabilities. Some defend the idea that, yes, we are on the right track, despite the limits that computational models still show. Others are instead radically skeptic and even dismissal: The present limits are not just contingent and temporary problems of NLU systems, but the sign of the intrinsic inadequacy of the epistemological and technological paradigm grounding them. This paper aims at contributing to such debate by carrying out a critical analysis of the linguistic abilities of the most recent NLU systems. I contend that they incorporate important aspects of the way language is learnt and processed by humans, but at the same time they lack key interpretive and inferential skills that it is unlikely they can attain unless they are integrated with structured knowledge and the ability to exploit it for language use.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/02/2020

Impossibility of Unambiguous Communication as a Source of Failure in AI Systems

Ambiguity is pervasive at multiple levels of linguistic analysis effecti...
research
10/27/2022

Towards Language-driven Scientific AI

Inspired by recent and revolutionary developments in AI, particularly in...
research
09/21/2023

Rethinking the Evaluating Framework for Natural Language Understanding in AI Systems: Language Acquisition as a Core for Future Metrics

In the burgeoning field of artificial intelligence (AI), the unprecedent...
research
12/05/2020

Neurosymbolic AI for Situated Language Understanding

In recent years, data-intensive AI, particularly the domain of natural l...
research
06/29/2022

Is it possible not to cheat on the Turing Test_Exploring the potential and challenges for true natural language 'understanding' by computers

The increasing sophistication of NLP models has renewed optimism regardi...
research
12/30/2021

Chatbot for fitness management using IBM Watson

Chatbots have revolutionized the way humans interact with computer syste...
research
05/08/2023

SmartState: A Protocol-Driven Human Interface

Since the inception of human research studies, researchers often need to...

Please sign up or login with your details

Forgot password? Click here to reset