Shortcut Learning in Deep Neural Networks

04/16/2020
by   Robert Geirhos, et al.
3

Deep learning has triggered the current rise of artificial intelligence and is the workhorse of today's machine intelligence. Numerous success stories have rapidly spread all over science, industry and society, but its limitations have only recently come into focus. In this perspective we seek to distil how many of deep learning's problem can be seen as different symptoms of the same underlying problem: shortcut learning. Shortcuts are decision rules that perform well on standard benchmarks but fail to transfer to more challenging testing conditions, such as real-world scenarios. Related issues are known in Comparative Psychology, Education and Linguistics, suggesting that shortcut learning may be a common characteristic of learning systems, biological and artificial alike. Based on these observations, we develop a set of recommendations for model interpretation and benchmarking, highlighting recent advances in machine learning to improve robustness and transferability from the lab to real-world applications.

READ FULL TEXT

page 2

page 5

page 9

page 13

page 14

research
09/28/2020

Artificial Intelligence in Surgery: Neural Networks and Deep Learning

Deep neural networks power most recent successes of artificial intellige...
research
11/08/2021

Artificial Intelligence Technology analysis using Artificial Intelligence patent through Deep Learning model and vector space model

Thanks to rapid development of artificial intelligence technology in rec...
research
06/20/2019

Autonomous Haiku Generation

Artificial Intelligence is an excellent tool to improve efficiency and l...
research
03/26/2019

Data Science and Digital Systems: The 3Ds of Machine Learning Systems Design

Machine learning solutions, in particular those based on deep learning m...
research
12/22/2020

Limitations of Deep Neural Networks: a discussion of G. Marcus' critical appraisal of deep learning

Deep neural networks have triggered a revolution in artificial intellige...
research
06/10/2023

Practical Problems of Statistical Learning

Statistical models have seen a significant rise in popularity in recent ...
research
08/23/2021

Deep neural networks approach to microbial colony detection – a comparative analysis

Counting microbial colonies is a fundamental task in microbiology and ha...

Please sign up or login with your details

Forgot password? Click here to reset