Ablation of a Robot's Brain: Neural Networks Under a Knife

12/13/2018
by   Peter Lillian, et al.
0

It is still not fully understood exactly how neural networks are able to solve the complex tasks that have recently pushed AI research forward. We present a novel method for determining how information is structured inside a neural network. Using ablation (a neuroscience technique for cutting away parts of a brain to determine their function), we approach several neural network architectures from a biological perspective. Through an analysis of this method's results, we examine important similarities between biological and artificial neural networks to search for the implicit knowledge locked away in the network's weights.

READ FULL TEXT
research
01/24/2019

Ablation Studies in Artificial Neural Networks

Ablation studies have been widely used in the field of neuroscience to t...
research
01/23/2023

Towards NeuroAI: Introducing Neuronal Diversity into Artificial Neural Networks

Throughout history, the development of artificial intelligence, particul...
research
11/05/2020

Architecture Agnostic Neural Networks

In this paper, we explore an alternate method for synthesizing neural ne...
research
11/23/2022

Functional Connectome: Approximating Brain Networks with Artificial Neural Networks

We aimed to explore the capability of deep learning to approximate the f...
research
12/07/2021

Relating transformers to models and neural representations of the hippocampal formation

Many deep neural network architectures loosely based on brain networks h...
research
07/31/2020

Neural Network Degeneration and its Relationship to the Brain

This report discusses the application of neural networks (NNs) as small ...
research
07/27/2023

Understanding Forward Process of Convolutional Neural Network

This paper reveal the selective rotation in the CNNs' forward processing...

Please sign up or login with your details

Forgot password? Click here to reset